We are currently investigating an issue with ColdFusion MX6 server and slow responses to http requests. We will update users shortly…
Update 17:37 – Speed has now improved significantly however we are going to run a full analysis of the server disks to ensure they are operating at top speed.
Update 18:46 – This issue is now fully resolved
Linux server one rebooted a short while ago and has not automatically restarted. We have the data centre looking into the issue as a matter of urgency…
Update 10:32 – At this stage it looks like the network card has conflicted with the kernel upgrade. We are waiting for the data centre to upgrade the card drivers and reboot the server…
Update 10:57 – It does indeed look like the NIC card is the problem. The data centre are replacing the card and re-configuring the drivers now…
Update 11:26 – The main server is now back online, we are now waiting for IPs to be reallocated to the new NIC which should take between 10-15 minutes…
Update 12:10 – IP address re-allocations are still filtering through the new NIC card and routers, this is approximately 50% complete…
Update 12:46 – 95% of the IPs are now back online with only three remaining to propagate through..
Update 14:24 – This issue is now fully resolved…
Despite our best efforts we are still having ongoing issues with the load on server one. We have deployed a new server and are currently preparing it for use.
We shall then start identifying high use sites and will be moving them to that server.
Unfortunately we are continuing to have issue with Linux server one with intermittent outages.
Please bear with us whilst we try and resolve this ongoing problem.
Update 14:45 – We are currently rebuilding Apache which will take approximately 30 minutes to complete. We should be able to start serving requests once this is complete.
Update 15:17 – Apache has now been rebuilt and the server is now up and running. We have taken the opportunity to upgrade several core elements of Apache including upgrading to php v5.2.10 to attempt to reduce the server load and increase stability.
We would like to apologise for the excessive downtime over the last few days on this server. This is something we do take very seriously in providing a top quality service and please rest assured we are doing everything we can to ensure your service is uninterrupted as possible.
Update 17:12 – We currently have technicians working on the server upgrading all software to latest versions so service may be a little patchy for a while.
Once this work is complete the server should be up to full speed…
This is just a update on the issues we have been having with Linux server one.
Over the last week we have had a number of instances where the server load has shot through the roof and this has caused Apache (the web server) to stop responding as well as MySQL. We have identified several user accounts that were contributing to this high load and those accounts have now been disabled.
We have also spent some time optimising the server and in particular MySQL. During this optimisation it came to our attention that some MySQL databases had become corrupted. These databases are using the InnoDB storage engine.
ACTION REQUIRED BY YOU!
If you use MySQL for your site please as a matter of urgency login to your cPanel account and access phpMyAdmin from the database management section. Then for each database check the database structure for the words “in use” in the records column.
If you see the words “in use” then your database table has been corrupted. Please open a support ticket at http://www.openmindhosting.co.uk/support/ and let us know the database name. We will then restore the database free of charge from last nights backup.
It is imperative that all users who utilise MySQL on their site carry out this request as soon as possible.
Finally we are in the process of upgrading the BIND name servers on the server. The plan is to move the name server records to separate servers to reduce load and increase redundancy.
We appreciate that that the last few days have been frustrating for all users concerned but please rest assured we are working as quickly as possible to restore a stable service for your sites.
Issues experienced on Friday with Linux server one have unfortunately resurfaced and we are investigating as a matter of urgency.
Update 13:19 – We have found some accounts using excessive resources and we have now suspended those accounts.
Please note that it is against our TOU for any domain to run scripts that cause excessive usage on our shared servers and domains found to be causing an issue will be disabled/removed without notice.
We are aware of an issue with Linux server one and we are currently working to resolve the problem.
Update 16:07 – We are currently scripts to repair WHM/cPanel and will post another update when this is completed.
Update 16:31 – Services are starting to come back online now but users may experience some slowness/timeouts whilst our checks are completed
Update 16:39 – All services should now be up and running. If you experience issue then please do open a ticket at our helpdesk: http://www.openmindhosting.co.uk/support/
This is an important update, please read it carefully and contact us if you have any questions.
We will be performing maintenance which will affect your service. This will last about 20 minutes, and during this time, your service will go offline.
Date: 21 July 2009
Window: 02:00 AM for 1 Hour
Duration: < 20 minutes
This maintenance is to upgrade the IOS firmware on our RSH.North core router, from our new Maidenhead facility. Currently the network is configured with dual uplinks from our core router to the edge switches in each rack. This upgrade will enable clustering capabilities on the core router and once the core router will be configured as a cluster, it will increase the availability of the service in case of a core router failure.
This will improve redundancy across our network ensuring maximum availability for all our services.
We apologise for any inconvenience this may cause, please do not hesitate to contact us if you have any queries or questions regarding this maintenance window.