June 10, 2013 :: Datacenter maintenance on Sandstorm - Planned outage

Started by Jason, June 05, 2013, 08:16:55 PM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

Jason

Server: Sandstorm
Date:  Monday, June 10, 2013 -- starting at 11pm EST


The datacenter has reported that the storage system that Sandstorm uses has experienced a degraded RAID state.  Basically, the harddrives are reporting errors that is going to require maintenance/replacement.

No data has been lost at this time but they would likely to proactively relocate this virtual instance.

What does this mean?

On Monday evening around 11pm EST, Sandstorm will essentially experience a reboot (approx 10-20 minutes of outage roughly) at which point it will be back online. During the time after this outage, all data on this server will be migrated in the background to a new storage configuration.  Once that transfer is done, Sandstorm will experience a second outage (typically about the same time) afterwhich it will be back online on the new setup.

This is the same process that we've done mutliple times on other virtual servers with great success.

In summary, we should see about 20 minutes (maybe less) around 11pm Monday EST followed by several hours of normal uptime and then a second/final outage of around 20 minutes to complete the data move.

Unfortuntely it's not possible to provide exact timeframes (other than the start time) but these have gone quite well in the past.  Please let me know if you have any questions.

Regards,
Jason

Jason

A notice and link to this thread has been sent to all customers with account(s) on Sandstorm via our billing system.

I've also posted it to our Server Status page so it can be monitored in realtime if needed:

http://www.charlottezweb.com/clients/serverstatus.php

Thanks,
Jason

Jason

Reminder that this maintenance is scheduled for tonight -- approx 6 hours from now.

Jason

This data transfer is still running in the background.  It's approximately 60-70% complete as of now.  At this rate I imagine it should complete at some point around early afternoon today which would mean the second outage would occur at that time.

The outage recorded last night was approximately 5 minutes.

Thanks,
Jason

Jason

This maintenance completed a few minutes before noon EST today.

Thank you,
Jason