We are currently mitigating an attack on the 'charlie' server - the team are working to resolve this as soon as possible.
We are working on some intermittent issues with the bravo server.
We aim to have services running as normal today - the issue has been escalated internally
The alpha server has been under a large scale attack for around 60 minutes - we are mitigating this, however the load spike has forced us to reboot.
Services will be running soon.
__________________________________________________________________
Although sites went offline for a very short period, we have mitigated the attack. Services are now running as normal.
We are going to be adding additional CPU cores to the Bravo server, which will take it offline for a brief period.
We expect the downtime to be around 3 minutes.
Normally, maintenance like this would be scheduled in advance, however, we are adding the cores to allow the server to handle with an urgent spike.
Kind regards,
Dennis
______________________________________________________________________
Update - server is back online and was down for 1 minute and 1 second.
Scheduled Maintenance - Resize of main disk on zulu
Downtime is to be expected during the resize process, as several reboots may be required.
Apologies for the inconvenience caused however the upgrade is essential.
Scheduled Maintenance - The alpha server will be rebooted with minimal downtime between 10pm and 11pm this evening.
This will be to add additional backup storage to the server in order for us to backup accounts in excess of the current 5GB account limit.
The reboot, although scheduled for these hours should only last for between 5 - 15 minutes.
UPDATE:
The scheduled reboot was delayed slightly and lasted around 7 minutes.
Cloud alpha will be taking down at 3 a.m. this evening / tomorrow morning.
This will be to add in additional storage resources for both backups and core user data.
Expected down time will be less than 45 minutes.
If you are using a monitoring tools such as uptime robot, we would recommend adding in a maintenance window from between 3 a.m. and 4 a.m..
Cloud07 is currently under additional load due to a DDoS attack.
Whilst every effort is being made to keep the server stable, during our mitigation of the attack you may experience intermittent 502 (or other) errors.
There will be intermittent connectivity to our 'alpha' server and DNS cluster during the scheduled times.
Our aim is to ensure downtime is of course kept to a minimum - our target maximum downtime is 8 minutes.
A connectivity error at the datacenter has taken all servers online. In booting them back up, cloud07 is booting with an error.
The team are working on this with the highest priority.
Maintenance Upgrades - cloud07
Increasing storage capacity and performing a bulk migration of sites from a seperate cloud instance.
Performance will not be impacted following the upgrade.
Reboots will be required as part of the process, however these will be kept to a minimum.
Many thanks for your patience.
Kind regards,
Dennis Nind
cloud05 has faced another attack, which has forced the CPU to jump above its thresholds without enough time for the autoscaling to kick in.
As such, we have increased the RAM to 20GB and cores to 12.
Services are back online.
Cloud05 is currently under attack, as such some sites will be offline temporarily. We are bringing these back up as a matter of urgency.
We are currently in the process of implementing additional resources to Cloud 05 (one of our cPanel Reseller clouds).
You may experience a short amount of downtime, however we still aim to maintain this months SLA of 99.9%.
The reboot required should only take around 4 minutes and will take place later on this evening.
Kind regards,
Ryan
Brixly - Support
Please bare with us while these issues are investigated.
Kind regards,
Dennis
