Subsim forum outage June 1-2, 3-4

[XabbaRus]

Subsim server was down due to an electrical fire at the server centre. Very big, quite a lot still to do but Subsim has recovered and is back on the waves.

H1 Data Center Offline - Status Updates

New items and articles


FIRRRRRE!

The Planet Explosion Causes Outages

By Justin Lee, theWHIR.com
June 2, 2008 -- (WEB HOST INDUSTRY REVIEW) -- Dedicated hosting provider The Planet (theplanet.com) suffered an explosion, 4:55 pm CST on Saturday at its H1 data center in Houston, Texas, which led to an outage that affected approximately 9,000 servers and 7,500 customers.

The explosion and accompanying fire knocked down three walls surrounding the facility's electrical equipment room, as well as destroyed the underground cabling that powers the first floor of the facility. Fortunately, there were no injuries, nor were any servers damaged or lost.

The company has been in constant communication with its customers -- an essential aspect of any disaster recovery plan -- through its forum (forums.theplanet.com) and customer portal, as well as other popular forums like Web Hosting talk (webhostingtalk.com).

In an earlier post yesterday on The Planet's forums, Kevin Hazard said the "short was in a high-volume wire conduit" and that the fire department instructed the company to not "activate [its] backup generator plan."

After the fire marshall inspected the facility The Planet was allowed to restore power to the facility. The company immediately turned back on the generators to receive power on the second floor.
Then, earlier this morning, the company successfully brought back 90 percent of the second floor servers after more than 40 hours of troubleshooting. Meanwhile, support technicians are currently working on location to manually restore the remaining 10 percent on the second floor, as well as restore power to the first floor.

Despite this, many customers, namely those companies who have lost sales, customers, and other revenues, remain upset by how long the recovery process is taking and have actively voiced these criticisms on forums.

One WHT member C0bra writes: "I'm fed up waiting for more information about these terrifying issues. Communication is poor and every minute my site is down is costing me $1000s in ad revenues. This is probably going to cost me a $10,000,000 sponsorship deal with a major brand advertiser."

Douglas Erwin, The Planet chairman and CEO, responded to these complaints late Sunday evening onThe Planet forum.
He writes: "I would like to extend my sincere thanks for your patience during the past 28 hours. We are acutely aware that uptime is critical to your business, and you have my personal commitment that The Planet team will continue to work around the clock to restore your service.
"We understand that you will be due service credits based on our Service Level Agreement. We will proactively begin providing those following the restoration of service, which is our number priority, so please bear with us until this has been completed."

[Dowly]

Great news!

[CCIP]

Wow! I was wondering what happened. Good to have it back however.

[nikimcbee]

Yeah, it's working again. I was going through withdrawls:rotfl:

[Kapitan_Phillips]

Hey guys, I've been in contact with Neal, he asked me to add this:

'The datacenter which hosts the Subsim and Deep Domain server had a transformer explosion late Sat night. The techs restored power Monday June 2 approx. 1430. We apologize for the inconvenience.

Neal'

http://techblog.dallasnews.com/archi...tinues-re.html

[Jimbuna]

Pleased to see it's sorted.....was beginning to wonder if the server was stored in the King Kong buildinf at Universal Studios

[nikimcbee]

Originally Posted by Kapitan_Phillips

Hey guys, I've been in contact with Neal, he asked me to add this:

'The datacenter which hosts the Subsim and Deep Domain server had a transformer explosion late Sat night. The techs restored power Monday June 2 approx. 1430. We apologize for the inconvenience.

Neal'

http://techblog.dallasnews.com/archi...tinues-re.html

Tank u 4 callin the sub simm servr farm hot line fors custers survice


Yez, Neal is aware subsimms iz down.
What?
Yes, Steed only recived minor burnz. Hez okay

[HunterICX]

Glad to hear its getting sorted

HunterICX

[Skybird]

And I thought it was a mass-keelhauling underway...

[Fubar2Niner]

YaaaaaaaaaaaaaaaaaaaaaaaaaaaaaYYYY !!!!!!!! my fav forum back at last I missed you guys last couple days. Hope there weren't too much damage shipmates.

Best regards.

Fubar2Niner

[Jimbuna]

Originally Posted by nikimcbee

Tank u 4 callin the sub simm servr farm hot line fors custers survice


Yez, Neal is aware subsimms iz down.
What?
Yes, Steed only recived minor burnz. Hez okay

ROFLMAO

[Jacky Fisher]

so that explains everything.....

[ReallyDedPoet]

Welcome back SUBSIM


RDP

[NightCrawler-SimHQ]

Great to have you back, Subsim! Now all is needed is some new fire extinguishers!

[les green01]

woowoo back in buisness this was worst than not having coffee and i think smokes