EMAIL IS DOWN

[Goosemaster]

TEST YOUR BACKUPS,TEST YOUR BACKUPS,TEST YOUR BACKUPS!

The magnitude of the brick that you will sh!t when one of your stores is corrupted* and goes down is unavoidable. Devote some effort to TEST YOUR BACKUPS,TEST YOUR BACKUPS,TEST YOUR BACKUPS! Sweat on your brow and wrinkles on your face are worthless without the smile on your face when you can bring it all up again when it really counts.

TEST YOUR BACKUPS,TEST YOUR BACKUPS,TEST YOUR BACKUPS!

I so need a beer right now but all I have is cider:Q

*=hypothetical

*=Also, fuck computers.

*=Also,fuck CDP and its high cost.

 

[Newbian]

Don't worry... when it comes back up my 5 chain letters will be waiting for you.

 

[Crusty]

Well duh... that's like putting a roll cage in a car without actually testing whether or not it works. Natural selection at it's finest.

 

[Goosemaster]

Originally posted by: Crusty
Well duh... that's like putting a roll cage in a car without actually testing whether or not it works. Natural selection at it's finest.

Look up the statistics on how many corps do NOT test their backups... it's shocking.

 

[her209]

Originally posted by: Crusty
Well duh... that's like putting a roll cage in a car without actually testing whether or not it works. Natural selection at it's finest.

I was going to use that analogy myself, but with sports cups.

 

[Goosemaster]

Originally posted by: her209

Originally posted by: Crusty
Well duh... that's like putting a roll cage in a car without actually testing whether or not it works. Natural selection at it's finest.

I was going to use that analogy myself, but with sports cups.

by all means...

 

[vshah]

the system. is down. the system. is down.

 

[Fullmetal Chocobo]

"Crap, I need this outlet to plug a power strip in so I can plug in another machine. Fuck it, it's suppose to be a redundant power supply to the server--let's see if it works."

It did.

 

[FDF12389]

*whistles* :music: :music: :music: :music:

 

[Goosemaster]

Originally posted by: vshah
the system. is down. the system. is down.

my reaction today...

what the...no that can't be write, its.. DISMOUNTED?! OMG...*runs checks* noooooooo....

 

[Goosemaster]

Originally posted by: Fullmetal Chocobo
"Crap, I need this outlet to plug a power strip in so I can plug in another machine. Fuck it, it's suppose to be a redundant power supply to the server--let's see if it works."

It did.

well, did it work?

*wags tail*

 

[ballmode]

Ohhhs mies gawddd

 

[James Bond]

Why F CDP?

 

[FP]

Update your whistleblower thread asshat.

 

[kevnich2]

Originally posted by: Fullmetal Chocobo
"Crap, I need this outlet to plug a power strip in so I can plug in another machine. Fuck it, it's suppose to be a redundant power supply to the server--let's see if it works."

It did.

Haha, I have done this exact same thing once. Also did it again when we brought in a new UPS and I had to switch a few servers to the new one, worked great.

 

[Goosemaster]

Originally posted by: James Bond
Why F CDP?

Cause it would be a dream to revert at line speed without having to restore. I'm just bitching about toys I can't have as we all do

My restore speeds, taking decompression and decryption into account, are not where we want them to be but we are working on it. We do not do brick-level backups so exchange requires full restores. It's a trade off one has to make with non-negotiable windows.

 

[Newbian]

Originally posted by: FP
Update your whistleblower thread asshat.

He can't... the information is all in emails and it's down.

 

[Goosemaster]

Originally posted by: Newbian

Originally posted by: FP
Update your whistleblower thread asshat.

He can't... the information is all in emails and it's down.

nice...:beer:

 

[Red Squirrel]

At least you *HAVE* backups. Where I work nothing really gets backed up properly. It's brutal. I've basially been doing exchange backups manually every now and then with windows backup. They take about 5 hours, and it's stored on the same SAN.
But yeah, I hope we never need to use the backups...


Speaking of email disasters, I decided to use xmerge to move a mailbox. I did the "1 step" choise but it never asked me WHERE I wanted to move the mailbox, the process just started right away after I hit next (expecting for it to prompt me where to put it).

Thankfully the user did not have much email, but it basically duplicated all her emails 3 times. I said screw it and did the move the old fasioned way. Export to PST, reimport to new account.

This makes me realize how the new backup solution needs to be put in place STAT. Too bad there's so much crappy politics in IT, anything takes forever to actually get off the ground. Servers are so much easier at home. The day I wanted a home backup solution, I had the equipment ordered, and the day it arrived, I had it setup. I don't get why big companies like to lag projects so much. There's planning, and then there's screwing the dog.

 

[Goosemaster]

Originally posted by: RedSquirrel
At least you *HAVE* backups. Where I work nothing really gets backed up properly. It's brutal. I've basially been doing exchange backups manually every now and then with windows backup. They take about 5 hours, and it's stored on the same SAN.
But yeah, I hope we never need to use the backups...

This makes me realize how the new backup solution needs to be put in place STAT. Too bad there's so much crappy politics in IT, anything takes forever to actually get off the ground. Servers are so much easier at home. The day I wanted a home backup solution, I had the equipment ordered, and the day it arrived, I had it setup. I don't get why big companies like to lag projects so much. There's planning, and then there's screwing the dog.

dear lord... you have to drive the message home. have numbers and situations ready to present that show how absolutely fucked they would be if things were down, much less unrecoverable.

I, like everyone else, face budget limitations, but made the most of what I had (Audit, then GFS as soon as possible, D2D2T soon thereafter, encryption, optimization etc.) and still have a ways to go.

You backup that stuff using ntbackup to external drive if you have to. Hell I had to do that (I call those the "bad times). The most basic requirement is to have SOMETHING and work up from SOMETHING to SOMETHING DECENT to SOMETHING USEFUL and so on

<---wants bare metal but not at that stage yet

edit: this assumes that we aren't talking about individual stores that are larger than a terabyte in which case you're fvked

 

[Injury]

Originally posted by: vshah
the system. is down. the system. is down.

beeeedeeeleeedo!
Bum bum bum
beeeedeeeleeedo!
Bum bum bum
beeeedeeeleeedo!
Bum bum bum
beeeedeeeleeedo!
Bum bum bum

 

[drinkmorejava]

Hard drive died a month or two ago. Now EVERYTHING is raided, and the important stuff gets back up to a third drive everynight in case a raid decides to shit itself.

 

[hiromizu]

Reading this thread makes me realize that what we've got in place is never overkill.

 

[Red Squirrel]

Originally posted by: Goosemaster

Originally posted by: RedSquirrel
At least you *HAVE* backups. Where I work nothing really gets backed up properly. It's brutal. I've basially been doing exchange backups manually every now and then with windows backup. They take about 5 hours, and it's stored on the same SAN.
But yeah, I hope we never need to use the backups...

This makes me realize how the new backup solution needs to be put in place STAT. Too bad there's so much crappy politics in IT, anything takes forever to actually get off the ground. Servers are so much easier at home. The day I wanted a home backup solution, I had the equipment ordered, and the day it arrived, I had it setup. I don't get why big companies like to lag projects so much. There's planning, and then there's screwing the dog.

dear lord... you have to drive the message home. have numbers and situations ready to present that show how absolutely fucked they would be if things were down, much less unrecoverable.

I, like everyone else, face budget limitations, but made the most of what I had (Audit, then GFS as soon as possible, D2D2T soon thereafter, encryption, optimization etc.) and still have a ways to go.

You backup that stuff using ntbackup to external drive if you have to. Hell I had to do that (I call those the "bad times). The most basic requirement is to have SOMETHING and work up from SOMETHING to SOMETHING DECENT to SOMETHING USEFUL and so on

<---wants bare metal but not at that stage yet

edit: this assumes that we aren't talking about individual stores that are larger than a terabyte in which case you're fvked

Right now it's decent, the entire 4 stores put together are a bit under 200GB so they actually fit on a single DLT2 tape. Problem is I don't know enough about the tivoli backup system on how to even do a manual backup. I need to find some really good doc, read it, know it, and redo the system or something.

But yeah, it's bad when my home backup solution is better then the office one.

 

[Red Squirrel]

Originally posted by: hiromizu
Reading this thread makes me realize that what we've got in place is never overkill.

Nope, it's better to have too many backups, then not enough.