Mysql updated overnight with a new stable release of cpanel.
At this point, mysql is not working properly on Blizzard and Cyclone.
We're looking into this now.
If you have a site (like a forum) that runs entirely on mysql, you will likely have a database connection error right now until this is resolved.
We are reverting to cpanel 10 on these impacted boxes right now.
Hi Jason,
How much longer will it be in your estimation until everything is back to normal. I have had 2 sites down for several hours now?
Bob
I am trying to get an update now. We're reverting cpanel to an earlier version on these two servers so it's not a quick fix.
All services are up except mysql so if you're site is a forum only, you can add a normal html page to advise of the outage in the meantime if you'd like.
As soon as I get a timeframe, I will post it here immediately.
Cpanel has been reverted and mysql is up again, however, a few sites I've tested are generating blank pages.
We're looking into that presently.
Please check your sites and post here if you're having mysql-related issues still so I can have a list of examples to work with. Thanks
Client www.celebratingtheword.com is still having issues.
on edit:
working again - thanks
Up again on www.celebratingtheword.com.
Quote from: akheir on August 17, 2007, 08:47:58 AM
Client www.celebratingtheword.com is still having issues.
Ok, please try again now.
Thank you.
I will provide you a full status on this as soon as I can today in this thread.
Here's an explanation on what happened with mysql on Cyclone and Blizzard today.
Please note that this only impacted mysql functionality (which is certainly very important!) but did not impact any other services including http.
We determined the root cause and it's due to a version upgrade (from version 10.x to 11.x) of cPanel that happened overnight. Cpanel has updates that happen all the time but a version change is significant and this new release has a LOT of new features and configurations.
On several servers we have mysql located in spots that are non-standard. In other words, we have purposely moved mysql to store databases in a location different than what the stock operating system install would define. Because of this, the cPanel update overnight wasn't able to handle that and this caused the internal linking to our database locations to break and we had to manually fix it all.
Now that we're on version 11 and back up and running, I don't anticipate any further issues related to this problem but it's certainly something we'll keep in mind for any next major releases. cPanel 11 has been in the making for years so you can rest assured that these sorts of upgrades don't happen often. I think cPanel 10 has been out for years prior to this but I'd have to check to be sure.
On a side note, cPanel 11 has been out for months now but hasn't been released as "stable" by their standards. The way our servers are configured, they update ONLY on stable versions (or for security releases of course). The fact that 11 went from "release" to "stable" this week triggered automated updates to run. At this point, I think all but a few of our servers are on 11 now. I'm going to verify that tonight and will likely push those still on version 10 to version 11 manually asap just to be confident those migrations go smoothly.
I know of at least 3 of our other servers on cPanel 11 that upgraded without issue so we unfortunately hit a snag with these two.
Thank you for your patience and understanding. Unfortunately this was an upgrade incompatibility with the software that happens from time to time.
Regards,
Jason
There were 3 servers (Cyclone, Maelstom and Thunderstorm) still on cPanel 10.
They have "standard" partitions which should make for a normal upgrade.
To be sure, we're manually upgrading these to cPanel 11 right now.
I will update this thread when that's complete and confirmed to be successful.
Thanks
Are there any key features in this release or is it mainly non important stuff?
Quote from: Killer Possum on August 18, 2007, 12:17:19 AM
Are there any key features in this release or is it mainly non important stuff?
On my end, I'm seeing quite a bit of new stuff but I haven't had the opportunity to study it all closely yet. I don't know that cpanel will look any differently from your perspective but I haven't verified that yet either.
Here's a mini-site focused on the new changes/features:
http://www.cpanel.net/products/cPanelandWHM/linux/cpanel11/index.html
Ah I see. As far as I can tell nothing has changed, but would the theme have to be updated to support any new features (if there are any that is)? You know how 3rd party themes work.
I have a strong feeling that our older themes probably aren't 100% compliant but I know RVSkin should be. It's been cPanel 11 compliant for awhile now and it's setup to update itself daily.
Part of the new site design was to roll out rvskin (since it's branded to the new logo look) to everyone and to uninstall the outdated ones so we're all on the same theme.
Assuming all goes well, I'll take care of that today.
Ah OK, well I just logged into webmail and I noticed some slight changes to that page.
The webmail portal page?
Yeah before you choose the client.