Doom Comic
Register | User Profile | Member List | F.A.Q | Privacy Policy | New Blog | Search Forums | Forums Home
Doomworld Forums : Powered by vBulletin version 2.2.5 Doomworld Forums > Misc. > Everything Else > MancuNET go boom, will be fixed within 48-72 hours
 
Author
All times are GMT. The time now is 04:48. Post New Thread    Post A Reply
Mancubus II
Purple is not a breakfast color


Posts: 1940
Registered: 02-03


Primary hard disk failure on MancuNET. They're going to replace it within 24 hours, but things may be unavailable for the next few days as I will have to go through and set everything up again. Thankfully there's no charge for this (except for my time and frustration) and ServerBeach are quick and professional (as opposed to dreamhost who are a joke and terrible).

Will keep this thread updated with any new information. Yes data are backed up.

[UPDATE 07/08/09 3:11PM]
The drive is being replaced during a 4 hour window of 8pm-11:59pm CDT (so starting within about 5 hours). Starting tomorrow I will be going through the process of setting back up all the crap. Thankfully I got this thing with a spare drive in it I was not yet using, so I partitioned, formatted and now I have a spare drive to copy things to. Makes backing up much faster!

[UPDATE 07/08/09 5:35PM]
Attempting to do mysqldump does not fully dump before throwing itself into read-only mode (from warm boot). I've backed up the actual database files and dirs themselves, which should restore fine. I used the packaged version (lenny) of mysql 5 and I will be reinstalling the same version most likely. Nothing too critical will be lost with these dbs but I am doing my best to ensure they're still alive. ServerBeach continues to be fantastic in their support.

I will not be near a computer until tomorrow morning. When I return to a computer I should have waiting for me a freshly provisioned server. Thankfully lessons were learned from the errors I was having before in my initial setup so things should go more smoothly this time. The biggest issue tends to be permissions related and besides lessons learned, everything has been backed up with that information intact.

[UPDATE 07/09/09 10:08AM]
The server is back online, but it only has the new drive, not my second backup drive. They were testing to see if I could log in before putting in my other drive. However, their language seemed to indicate that they'd be putting in my original disk back in so I could copy off of it. EDIT: Spoke with them on the phone, they did indeed mean putting back in my other healthy drive. It's happening as I type this.

[UPDATE 07/09/09 10:55AM]
All drives are in, fresh /dev/sda, backup /dev/sdb and fartknocker brokendrive on /dev/sdc. Will be doing software rebuild over the course of the afternoon/evening starting in a few hours. Most if not all services will be restored in the next 12-24 hours. Thank you everyone for your continued patience and support.

[UPDATE 07/10/09 8:26AM]
Most everything is back to normal. Email is not set up yet but that is a separate process. All accounts should be restored, passwords are the same, all subversion repositories are restored and websites are restored. Please note: things may still be a little intermittent as I stop/restart different services during the remainder of the setup process.

If you are finding that something is missing, I will still be checking these threads regularly. You can also send an email to my offsite email address (fuzztooth@gmail.com).

Last edited by Mancubus II on 07-10-09 at 15:08

Old Post 07-08-09 21:18 #
Mancubus II is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
Khorus
Strife!


Posts: 1393
Registered: 04-05


Bugger. :(

But good to hear that data wasn't lost.

Old Post 07-08-09 21:37 #
Khorus is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
exp(x)


Posts: 2595
Registered: 04-04


Don't most large scale servers have hot-swappable drive arrays with redundancy? Or are you just using them as a colocation facility for your own server?

Old Post 07-09-09 01:11 #
exp(x) is offline Profile || Blog || PM || Email || Search || Add Buddy IP || Edit/Delete || Quote
Enjay
ASK ME ABOUT FOOTBALL / STEAM / DEAD CELEBRITIES / THE BLAIR WITCH PROJECT


Posts: 6382
Registered: 12-00


Aha! That would explain why I've not been able to access it. Thanks for letting people know.

Old Post 07-09-09 01:29 #
Enjay is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
Scuba Steve


Posts: 3934
Registered: 11-02


DOWN TIME IS LOST URBAN BRAWL PROFITS!

Old Post 07-09-09 02:21 #
Scuba Steve is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
DuckReconMajor
Forum Legend


Posts: 4226
Registered: 01-09


I was gonna buy 1,000 copies of Action Doom 2 but the site was down.

Oh well.

Old Post 07-09-09 02:54 #
DuckReconMajor is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
HackNeyed
Member


Posts: 383
Registered: 08-04


Wait, what? I just bought AD2:UB last night...

I hope this doesn't impact the arrival of my order of pure awesome in a can of a box sewn and stitched by blind elderly orphans who also love awesome!

Old Post 07-09-09 04:12 #
HackNeyed is offline Profile || Blog || PM || Search || Add Buddy IP || Edit/Delete || Quote
Creaphis
I will deliberately take a contrary position just for the sake of writing incredibly long arguments


Posts: 4181
Registered: 10-05


As soon as I saw Manc's avatar wouldn't load I knew some shit was going down.

Old Post 07-09-09 07:07 #
Creaphis is offline Profile || Blog || PM || Email || Search || Add Buddy IP || Edit/Delete || Quote
GreyGhost
Why don't I have a custom title by now?!


Posts: 8758
Registered: 01-08


I hope that drive failure wasn't the result of having too many fish avatars on the one page.

Old Post 07-09-09 07:29 #
GreyGhost is offline Profile || Blog || PM || Email || Search || Add Buddy IP || Edit/Delete || Quote
leileilol
dork stalker


Posts: 2726
Registered: 06-04


I saw it start happening around 6:35AM CST when I tried to approve members of my board, then KAPOW sessions table corrupt, and BAM can't go into webadmin, and DOOSH 404 forever.

Old Post 07-09-09 11:51 #
leileilol is offline Profile || Blog || PM || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
Mancubus II
Purple is not a breakfast color


Posts: 1940
Registered: 02-03



exp(x) said:
Don't most large scale servers have hot-swappable drive arrays with redundancy? Or are you just using them as a colocation facility for your own server?

Yes and if I had a large scale server setup I might have that. But that costs money, and my setup is one machine just for me. I have two drives but they're not set up for any redundancy at this time.

Old Post 07-09-09 16:08 #
Mancubus II is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
Mancubus II
Purple is not a breakfast color


Posts: 1940
Registered: 02-03


All drives are in, fresh /dev/sda, backup /dev/sdb and fartknocker brokendrive on /dev/sdc. Will be doing software rebuild over the course of the afternoon/evening starting in a few hours. Most if not all services will be restored in the next 12-24 hours. Thank you everyone for your continued patience and support.

Old Post 07-09-09 16:56 #
Mancubus II is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
Mancubus II
Purple is not a breakfast color


Posts: 1940
Registered: 02-03


Most everything is back to normal. Email is not set up yet but that is a separate process. All accounts should be restored, passwords are the same, all subversion repositories are restored and websites are restored. Please note: things may still be a little intermittent as I stop/restart different services during the remainder of the setup process.

If you are finding that something is missing, I will still be checking these threads regularly. You can also send an email to my offsite email address (fuzztooth@gmail.com).


GreyGhost said:
I hope that drive failure wasn't the result of having too many fish avatars on the one page.

More like there's not enough! Now that it's back up I can finally update the gallery!


Scuba Steve said:
DOWN TIME IS LOST URBAN BRAWL PROFITS!

There's profits??

Last edited by Mancubus II on 07-10-09 at 15:08

Old Post 07-10-09 14:32 #
Mancubus II is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
Scuba Steve


Posts: 3934
Registered: 11-02


OK, so I pretty much just break even... but nonetheless...

Old Post 07-10-09 21:16 #
Scuba Steve is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
kristus
Megablast!


Posts: 10620
Registered: 07-00


Don't worry Scuba. I'll make you rich. *Orders a copy*

Old Post 07-11-09 11:31 #
kristus is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
All times are GMT. The time now is 04:48. Post New Thread    Post A Reply
 
Doomworld Forums : Powered by vBulletin version 2.2.5 Doomworld Forums > Misc. > Everything Else > MancuNET go boom, will be fixed within 48-72 hours

Show Printable Version | Email this Page | Subscribe to this Thread

 

Forum Rules:
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
HTML code is OFF
vB code is ON
Smilies are OFF
[IMG] code is ON
 

< Contact Us - Doomworld >

Powered by: vBulletin Version 2.2.5
Copyright ©2000, 2001, Jelsoft Enterprises Limited.