For those of you who frequent the Vidown streaming and download systems. please be aware that we are performing routine maintenance tonight (April 28th, 2020) at about 10:00pm PDT (GMT -7) We are rebooting most of our servers and doing maintenance on a power distribution system. If all goes well, everything should be back up within 30 minutes.
Science bless patching and update season. Working as a linux admin in the data center environment, the joy that is rolling updates across an infrastructure with limited physical on-site break-fix access due to covid to help when a machine won't come back up because of hardware issues that only choose to expose themselves on a post-patch reboot is not foreign to me. My best wishes are with you!
Everything came back up except for one server, which had a complete RAID1 failure on both drives. Since it had 4 TB of accounts on it, I'm still doing recovery from backups to a new server.
Fortunately for everyone on the UMD, they aren't WAM-related accounts
Fortunately for me, the data center is 50 feet from my front door. Pants are optional.
soundguy said: Everything came back up except for one server, which had a complete RAID1 failure on both drives. Since it had 4 TB of accounts on it, I'm still doing recovery from backups to a new server.
Fortunately for everyone on the UMD, they aren't WAM-related accounts
Fortunately for me, the data center is 50 feet from my front door. Pants are optional.
Patrick, pants are ALWAYS optional. You just may find that they are more likely to incur negative feedback and/or fines in certain situations.
soundguy said: Everything came back up except for one server, which had a complete RAID1 failure on both drives. Since it had 4 TB of accounts on it, I'm still doing recovery from backups to a new server.
Fortunately for everyone on the UMD, they aren't WAM-related accounts
Fortunately for me, the data center is 50 feet from my front door. Pants are optional.
soundguy said: Everything came back up except for one server, which had a complete RAID1 failure on both drives. Since it had 4 TB of accounts on it, I'm still doing recovery from backups to a new server.
Fortunately for everyone on the UMD, they aren't WAM-related accounts
Fortunately for me, the data center is 50 feet from my front door. Pants are optional.
just curious was it hard or soft raid?
Always Linux soft RAID. Got burned on a toasted hardware card that was no longer available once.
Never had this happen before. Lost about 3000 sectors on the B drive during shutdown and somehow the systemd journal file on the A drive got corrupted. (not a systemd fan BTW)
I got used to the way things were done through init.d in my openBSD days. In the environment I support currently most of the systems use HP raid cards for physical raid and with their cache batteries and auto rebuilds I'm pretty happy generally. Using LSI megacli garbage makes me wanna pull out my hair.