1. Reason

Fritz threw a disk two months ago. SrikanthSastry volunteered to deal with hardware stuff, but had yet to receive a key and was generally unfamiliar with the hardware since there was no continuity between on-site people. Since ClintonEbadi managed to reboot fritz and have it not come back to life, ClintonEbadi and BtTempleton went to NYC to fix things.

2. Goals

• Make fritz bootable again
• Figure out why the new disks for fritz won't work
• See if the remote console can be revived
• Try to clean the rack out because it is an awful mess

3. Report

• Fritz was unbootable because ClintonEbadi forgot to add the UUID of the new /boot RAID1 to /etc/mdadm.conf. D'oh.

• The new Seagate disks for fritz appear to fail because the LSI MPT-SAS controller does not support link speed autonegotiation. At least that seems feasible since the new drives were the only ones that did not work and are also the only 6Gbps SATA drives in the machine. 3Gbps replacements were overnighted.
• The IPKVM looks pretty dead. Or maybe the power adapter is dead. Will debug, and maybe remove.

4. Plans

• Show SrikanthSastry the data center and general hardware set up on the 27th

• Install new drives and move KVM disk images to new partition to free up space
• Shuffle network around so that Fritz's BCM is behind hopper, and deleuze's IPMI serial port is attached to hopper, thus giving us remote console and power access to all machines again without a huge KVM.
• Test Belkin KVM for signs of life
  • Power switch does nothing, seems dead. If not, we can try to fix the IPKVM. If the Belkin is dead, remove and prepare to recycle.
• Take the pile of dead hard drives and krunk back to Raleigh. Destroy dead hard drives and recycle (just in case), recycle krunk.