It looks like we have a disk failure on this server resulting in MySQL4 databases becoming non-operational.
Technicians are currently working on the issue and we shall post an update as soon as we have one…
UPDATE 15:19 – Unfortunately it is confirmed that the drive has failed and we are currently waiting for technicians to replace it. Once this is done we shall be able to restore data from the backups.
UPDATE 16:18 – The disk has now been replaced and we have started to restore data from the backups. This should take no more than 2 hours to complete.
UPDATE 16:47 – Data has now been restored, we are in the process of reconfiguring the database server.
UPDATE 19:18 – Unfortunately our batch restore script is failing to restore databases correctly so to ensure zero data loss we are having to restore databases one by one. There are currently 181 databases on the server and each one takes 30-60 seconds to restore. Databases will be restored in alphabetical order so we appreciate your patience whilst we carry out this work.
UPDATE 20:44 – We are now restoring databases beginning with “H” and are more than 50% through the restoration work.
UPDATE 23:03 – All databases have now been restored, if you experience any further problems then please do not hesitate to get in touch with our support team. We shall be issuing a full RFO (Reason For Outage) tomorrow.