EMAIL IS DOWN

Page 2 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

Fullmetal Chocobo

Moderator<br>Distributed Computing
Moderator
May 13, 2003
13,704
7
81
Originally posted by: kevnich2
Originally posted by: Fullmetal Chocobo
"Crap, I need this outlet to plug a power strip in so I can plug in another machine. Fuck it, it's suppose to be a redundant power supply to the server--let's see if it works."

It did.

Haha, I have done this exact same thing once. Also did it again when we brought in a new UPS and I had to switch a few servers to the new one, worked great.

Yep. No problem at all. The server wasn't online yet, so it wasn't that big of a deal if it did shit the bed. Good to test it before it actually is deployed, right?
 

Red Squirrel

No Lifer
May 24, 2003
68,736
12,763
126
www.anyf.ca
Originally posted by: Fullmetal Chocobo
Originally posted by: kevnich2
Originally posted by: Fullmetal Chocobo
"Crap, I need this outlet to plug a power strip in so I can plug in another machine. Fuck it, it's suppose to be a redundant power supply to the server--let's see if it works."

It did.

Haha, I have done this exact same thing once. Also did it again when we brought in a new UPS and I had to switch a few servers to the new one, worked great.

Yep. No problem at all. The server wasn't online yet, so it wasn't that big of a deal if it did shit the bed. Good to test it before it actually is deployed, right?

Before I started where I"m at now, they found out the hard way that the SAN does not come back very smoothly if it's shut down. They then had another power switchover the day the support expired for the SAN, this time they walked the power, don't know why they did not do this the first time. Redundant PSUs FTW.

I also have a theory that if you unplug and replug within 1/60th of a second, you should be ok as you'll cut out one AC phase and the capacitors should be able to handle that. You need VERY fast hands.
 

adlep

Diamond Member
Mar 25, 2001
5,287
6
81
So the Exchange store is down?
Will not mount?
Maybe I can help...
Have some expertise with recovering stuff.

1. Make sure that you have enough space on the partition where all of your stores reside.
2. ESUTIL is your friend.
3. Offline defrag is a must at the end.
4. Tape sucks. What you want to migrate to is product called Backup Exec System Recovery 8.5 which is basically a Norton Ghost for Servers. That + External USB 2.0 hard drive will get you a nice recovery point that you can restore back to your partition in no time.
 

Red Squirrel

No Lifer
May 24, 2003
68,736
12,763
126
www.anyf.ca
Originally posted by: Skeeedunt
Pfff, who needs backups. Isn't that what RAID 0 is for?

I talked management into making one huge LUN on the san as a raid 0. Imagine the performance. They did not go for it.

No, imagine though. That would be insane. Only something advisable if you know you wont work there long. LOL
 

Goosemaster

Lifer
Apr 10, 2001
48,775
3
81
Originally posted by: RedSquirrel
Originally posted by: Goosemaster
Originally posted by: RedSquirrel
At least you *HAVE* backups. Where I work nothing really gets backed up properly. It's brutal. I've basially been doing exchange backups manually every now and then with windows backup. They take about 5 hours, and it's stored on the same SAN.
But yeah, I hope we never need to use the backups...

This makes me realize how the new backup solution needs to be put in place STAT. Too bad there's so much crappy politics in IT, anything takes forever to actually get off the ground. Servers are so much easier at home. The day I wanted a home backup solution, I had the equipment ordered, and the day it arrived, I had it setup. I don't get why big companies like to lag projects so much. There's planning, and then there's screwing the dog.

dear lord... you have to drive the message home. have numbers and situations ready to present that show how absolutely fucked they would be if things were down, much less unrecoverable.

I, like everyone else, face budget limitations, but made the most of what I had (Audit, then GFS as soon as possible, D2D2T soon thereafter, encryption, optimization etc.) and still have a ways to go.

You backup that stuff using ntbackup to external drive if you have to. Hell I had to do that (I call those the "bad times). The most basic requirement is to have SOMETHING and work up from SOMETHING to SOMETHING DECENT to SOMETHING USEFUL and so on

<---wants bare metal but not at that stage yet

edit: this assumes that we aren't talking about individual stores that are larger than a terabyte in which case you're fvked


Right now it's decent, the entire 4 stores put together are a bit under 200GB so they actually fit on a single DLT2 tape. Problem is I don't know enough about the tivoli backup system on how to even do a manual backup. I need to find some really good doc, read it, know it, and redo the system or something.

But yeah, it's bad when my home backup solution is better then the office one.

so we are in the same league then

I would definitely make sure you have something reliable and consistent that works. ntbackup (2k.2k3) isn't sunshine but you can backup most anything somewhat reliably with it. TSM is pointless to waist time on if you haven't put in a solid 0-day solution in place with or without it. Get an old box, stuff a bunch of disks into it with freenas or openfile and just have a nice ntbackup incremental/differential and full backup that overwrites every week if nothing else. Odds are you can find the spare parts in the office to build it and it will be worth it's weight in gold.

Then, and only then, fiddle around with TSM.*

*= so jealous


Originally posted by: RedSquirrel
Originally posted by: hiromizu
Reading this thread makes me realize that what we've got in place is never overkill.

Nope, it's better to have too many backups, then not enough.

in some situations it can drive you insane but what supersedes too many vs not enough is the business need. you have to analyze what is worse: immediate downtime prevention/recovery, archival restoration ability, complete DR(fvk!), and if it isn't clear you need to plan accordingly.

if it's not cut and dry, having a backup implementation suited for a non cut and dry set of situations is what matters. otherwise you are just wasting space


Originally posted by: adlep
So the Exchange store is down?
Will not mount?
Maybe I can help...
Have some expertise with recovering stuff.

1. Make sure that you have enough space on the partition where all of your stores reside.
2. ESUTIL is your friend.
3. Offline defrag is a must at the end.
4. Tape sucks. What you want to migrate to is product called Backup Exec System Recovery 8.5 which is basically a Norton Ghost for Servers. That + External USB 2.0 hard drive will get you a nice recovery point that you can restore back to your partition in no time.

2. this particular issue made the store unrecoverable. trust me we tried.
4. I have no server that will be able to keep with our tape (lto-4). I have to "tone it down" to 80MB/s with restores coming in a only a few notches lower. There is also the durability factor*, the perm-offsite factor*, the the cpu usage**, among other things.

Needless to say, despite a lack of snapshots, my system is pretty decent. We are looking at very short down time for full IS failure and I am working on improving that everyday.

*=disks usually allow you to pile on backups on the same media. From an efficiency standpoint you get massive capacity and respectable speed at a basement price with off the shelf components. the density is quite a liability when you realize that a single drop could take out everything though. the fact that constant usage of these discs requires an on site presence is a no go as well. I have had a transitional period where we did D2D2D but that was only temporary. unless we are talking rugged disks (those that can handle a 1m drop on concrete), I wouldn't risk it unless you have to. there is also the fact that tape is EXTREMELY reliable if you treat it correctly. I have no qualms with staking my reputation on tape.

**=usb, especially local usb, is very processor intensive and when you add software encryption and compression it gets worse. the fact that tape drives are usually parallel scsi or sas means that the controller is doing a lot of the work for you, minimizing the cpu usage.
 

hiromizu

Diamond Member
Jul 6, 2007
3,405
1
0
Originally posted by: RedSquirrel
Originally posted by: hiromizu
Reading this thread makes me realize that what we've got in place is never overkill.

Nope, it's better to have too many backups, then not enough.

That's what I was saying. Backups + DR + DR of backups : )
 

vshah

Lifer
Sep 20, 2003
19,003
24
81
Originally posted by: Injury
Originally posted by: vshah
the system. is down. the system. is down.

beeeedeeeleeedo!
Bum bum bum
beeeedeeeleeedo!
Bum bum bum
beeeedeeeleeedo!
Bum bum bum
beeeedeeeleeedo!
Bum bum bum

Originally posted by: Nik
Originally posted by: vshah
the system. is down. the system. is down.

DOODOOLOOTDOOT.DOODOOLOOTDOOT.DOODOOLOOTDOOT.DOODOOLOOTDOOT.

sorry nik, injury wins...
 

Nik

Lifer
Jun 5, 2006
16,101
2
56
Originally posted by: vshah
Originally posted by: Injury
Originally posted by: vshah
the system. is down. the system. is down.

beeeedeeeleeedo!
Bum bum bum
beeeedeeeleeedo!
Bum bum bum
beeeedeeeleeedo!
Bum bum bum
beeeedeeeleeedo!
Bum bum bum

Originally posted by: Nik
Originally posted by: vshah
the system. is down. the system. is down.

DOODOOLOOTDOOT.DOODOOLOOTDOOT.DOODOOLOOTDOOT.DOODOOLOOTDOOT.

sorry nik, injury wins...

His doesn't sound right; mine does!
 

ultimatebob

Lifer
Jul 1, 2001
25,134
2,446
126
Originally posted by: RedSquirrel
Originally posted by: Goosemaster
Originally posted by: RedSquirrel
At least you *HAVE* backups. Where I work nothing really gets backed up properly. It's brutal. I've basially been doing exchange backups manually every now and then with windows backup. They take about 5 hours, and it's stored on the same SAN.
But yeah, I hope we never need to use the backups...

This makes me realize how the new backup solution needs to be put in place STAT. Too bad there's so much crappy politics in IT, anything takes forever to actually get off the ground. Servers are so much easier at home. The day I wanted a home backup solution, I had the equipment ordered, and the day it arrived, I had it setup. I don't get why big companies like to lag projects so much. There's planning, and then there's screwing the dog.

dear lord... you have to drive the message home. have numbers and situations ready to present that show how absolutely fucked they would be if things were down, much less unrecoverable.

I, like everyone else, face budget limitations, but made the most of what I had (Audit, then GFS as soon as possible, D2D2T soon thereafter, encryption, optimization etc.) and still have a ways to go.

You backup that stuff using ntbackup to external drive if you have to. Hell I had to do that (I call those the "bad times). The most basic requirement is to have SOMETHING and work up from SOMETHING to SOMETHING DECENT to SOMETHING USEFUL and so on

<---wants bare metal but not at that stage yet

edit: this assumes that we aren't talking about individual stores that are larger than a terabyte in which case you're fvked


Right now it's decent, the entire 4 stores put together are a bit under 200GB so they actually fit on a single DLT2 tape. Problem is I don't know enough about the tivoli backup system on how to even do a manual backup. I need to find some really good doc, read it, know it, and redo the system or something.

But yeah, it's bad when my home backup solution is better then the office one.

Umm... the Dsmc backup command is basically all you should need to do a manual backup if the dsm.opt file is set right. Just don't try to backup something like a database while it's in use... it won't work without some additional Tivoli (TDP) plug-ins.

TSM also has a nice GUI and a TON of web-based documentation that comes with the server. It's not that hard to learn, compared to some other IBM products.
 

Goosemaster

Lifer
Apr 10, 2001
48,775
3
81
Originally posted by: ultimatebob
Originally posted by: RedSquirrel
Originally posted by: Goosemaster
Originally posted by: RedSquirrel
At least you *HAVE* backups. Where I work nothing really gets backed up properly. It's brutal. I've basially been doing exchange backups manually every now and then with windows backup. They take about 5 hours, and it's stored on the same SAN.
But yeah, I hope we never need to use the backups...

This makes me realize how the new backup solution needs to be put in place STAT. Too bad there's so much crappy politics in IT, anything takes forever to actually get off the ground. Servers are so much easier at home. The day I wanted a home backup solution, I had the equipment ordered, and the day it arrived, I had it setup. I don't get why big companies like to lag projects so much. There's planning, and then there's screwing the dog.

dear lord... you have to drive the message home. have numbers and situations ready to present that show how absolutely fucked they would be if things were down, much less unrecoverable.

I, like everyone else, face budget limitations, but made the most of what I had (Audit, then GFS as soon as possible, D2D2T soon thereafter, encryption, optimization etc.) and still have a ways to go.

You backup that stuff using ntbackup to external drive if you have to. Hell I had to do that (I call those the "bad times). The most basic requirement is to have SOMETHING and work up from SOMETHING to SOMETHING DECENT to SOMETHING USEFUL and so on

<---wants bare metal but not at that stage yet

edit: this assumes that we aren't talking about individual stores that are larger than a terabyte in which case you're fvked


Right now it's decent, the entire 4 stores put together are a bit under 200GB so they actually fit on a single DLT2 tape. Problem is I don't know enough about the tivoli backup system on how to even do a manual backup. I need to find some really good doc, read it, know it, and redo the system or something.

But yeah, it's bad when my home backup solution is better then the office one.

Umm... the Dsmc backup command is basically all you should need to do a manual backup if the dsm.opt file is set right. Just don't try to backup something like a database while it's in use... it won't work without some additional Tivoli (TDP) plug-ins.

TSM also has a nice GUI and a TON of web-based documentation that comes with the server. It's not that hard to learn, compared to some other IBM products.

Wouldn't it be wiser just to do DB dumps and spend your time getting making sure flat files get backed up than screwing around with plugin integration
 

loup garou

Lifer
Feb 17, 2000
35,132
1
81
hmm...that reminds me have to build a testbed for this Exchange 2010 beta. Very interested in the database replicas across JBOD.
 

Goosemaster

Lifer
Apr 10, 2001
48,775
3
81
Originally posted by: loup garou
hmm...that reminds me have to build a testbed for this Exchange 2010 beta. Very interested in the database replicas across JBOD.

Is this like CCR or more like regular syncronous sql db replicas
 

Red Squirrel

No Lifer
May 24, 2003
68,736
12,763
126
www.anyf.ca
Originally posted by: skace
No time to test backups got more shit to setup

And meetings to attend, can't forget those.

I'm not hugely involved in many meetings yet, but wow, I don't know if every server tech has to go through this, but some days have more meetings then actual work lol. My coworker is always in meetings about new deployments that are coming etc... but those things wont deploy themselves! give us the go, and we'll do it!
 

loup garou

Lifer
Feb 17, 2000
35,132
1
81
Originally posted by: Goosemaster
Originally posted by: loup garou
hmm...that reminds me have to build a testbed for this Exchange 2010 beta. Very interested in the database replicas across JBOD.

Is this like CCR or more like regular syncronous sql db replicas

PR info that's out now isn't clear and I can't find any whitepapers...
 
sale-70-410-exam    | Exam-200-125-pdf    | we-sale-70-410-exam    | hot-sale-70-410-exam    | Latest-exam-700-603-Dumps    | Dumps-98-363-exams-date    | Certs-200-125-date    | Dumps-300-075-exams-date    | hot-sale-book-C8010-726-book    | Hot-Sale-200-310-Exam    | Exam-Description-200-310-dumps?    | hot-sale-book-200-125-book    | Latest-Updated-300-209-Exam    | Dumps-210-260-exams-date    | Download-200-125-Exam-PDF    | Exam-Description-300-101-dumps    | Certs-300-101-date    | Hot-Sale-300-075-Exam    | Latest-exam-200-125-Dumps    | Exam-Description-200-125-dumps    | Latest-Updated-300-075-Exam    | hot-sale-book-210-260-book    | Dumps-200-901-exams-date    | Certs-200-901-date    | Latest-exam-1Z0-062-Dumps    | Hot-Sale-1Z0-062-Exam    | Certs-CSSLP-date    | 100%-Pass-70-383-Exams    | Latest-JN0-360-real-exam-questions    | 100%-Pass-4A0-100-Real-Exam-Questions    | Dumps-300-135-exams-date    | Passed-200-105-Tech-Exams    | Latest-Updated-200-310-Exam    | Download-300-070-Exam-PDF    | Hot-Sale-JN0-360-Exam    | 100%-Pass-JN0-360-Exams    | 100%-Pass-JN0-360-Real-Exam-Questions    | Dumps-JN0-360-exams-date    | Exam-Description-1Z0-876-dumps    | Latest-exam-1Z0-876-Dumps    | Dumps-HPE0-Y53-exams-date    | 2017-Latest-HPE0-Y53-Exam    | 100%-Pass-HPE0-Y53-Real-Exam-Questions    | Pass-4A0-100-Exam    | Latest-4A0-100-Questions    | Dumps-98-365-exams-date    | 2017-Latest-98-365-Exam    | 100%-Pass-VCS-254-Exams    | 2017-Latest-VCS-273-Exam    | Dumps-200-355-exams-date    | 2017-Latest-300-320-Exam    | Pass-300-101-Exam    | 100%-Pass-300-115-Exams    |
http://www.portvapes.co.uk/    | http://www.portvapes.co.uk/    |