Hardware Card for Sun Thumper X4500
This is our old Storage node for dCache with 48 disks inside
Specifications
What's inside the hardware, probably depending on what we're talking about.
- Disk controller model. 6 x Marvell MV88SX6081 (8 ports)
- Network card model: 4 x Intel 82546EB + 1 Mellanox IB MT23108 (added later)
- Space that takes in the rack: 3U
- Max CPUs, Max Disks, Max Mem slots. 2 x AMD Opteron DualCore 290
- CDROM
- Dual power supply: yes
- Front / Back picture (maybe available online?)
- Any other?
Power consumption (measured before and during the CPU/Disk tests)
- Minimum: 1000 W
- Maximum 1130 W
Ambiental details
- External working temperature
- Normal CPU/memory internal temperature
- Air flow (cubic meters per hour)
- Power disipation: 3856 BTU/h
- Noise (dB)
Operations
Interesting information like how to handle it, anything interesting which is not trivial.
How to get into the ILOM
Power up/down procedures
Commands to issue in an internal console
Firmware updates
Replacement of internal components
Installation notes
Instructions on how to set up a new machines that arrives, with things like:
BIOS settings
RAID configuration
Drivers required / kernel compatibility
Check firmware homogeneity with other machines in the cluster
Benchmarks
Information about benchmarks performed in the machine.
Disk benchmarks (i.e. Bonnie++)
CPU benchmarks (i.e. HepSpec06)
Network benchmarks (i.e. Iperf)
Monitoring
Instructions about monitoring the hardware
Power Consumption
Raid Sanity
I’ve gotten cron log from one of my servers today which says:
/etc/cron.weekly/99-raid-check: WARNING: mismatch_cnt is not 0 on /dev/md0
Quick look at
cat /proc/mdstat
showed, that array is allright.
This mismatch_cnt value is the value of the blocks, that are not synchronized between RAID drives. On my server the value was
cat /sys/block/md0/md/mismatch_cnt
and partition was md0, which is BOOT. SO, I quickly found the way to repair the problem by using
echo repair >/sys/block/md0/md/sync_action
watch cat /proc/mdstat
and after repair is completed
echo check >/sys/block/md0/md/sync_action
watch cat /proc/mdstat
After those operations the value of desynchronized blocks went to 0 again:
cat /sys/block/md0/md/mismatch_cnt=
Disk layout for scsi to drive mapping
---------------------SunFireX4500------Rear----------------------------
36: 37: 38: 39: 40: 41: 42: 43: 44: 45: 46: 47:
sdab sdaf sdt sdx sdar sdav sdaj sdan sdl sdp sdd sdh
c3t3 c3t7 c2t3 c2t7 c5t3 c5t7 c4t3 c4t7 c1t3 c1t7 c0t3 c0t7
24: 25: 26: 27: 28: 29: 30: 31: 32: 33: 34: 35:
sdaa sdae sds sdw sdaq sdau sdai sdam sdk sdo sdc sdg
c3t2 c3t6 c2t2 c2t6 c5t2 c5t6 c4t2 c4t6 c1t2 c1t6 c0t2 c0t6
12: 13: 14: 15: 16: 17: 18: 19: 20: 21: 22: 23:
sdz sdad sdr sdv sdap sdat sdah sdal sdj sdn sdb sdf
c3t1 c3t5 c2t1 c2t5 c5t1 c5t5 c4t1 c4t5 c1t1 c1t5 c0t1 c0t5
0: 1: 2: 3: 4: 5: 6: 7: 8: 9: 10: 11:
sdy sdac sdq sdu sdao sdas sdag sdak sdi sdm sde sda
c3t0 c3t4 c2t0 c2t4 c5t0 c5t4 c4t0 c4t4 c1t0 c1t4 c0t0 c0t4
b b
-------*-----------*-SunFireX4500--*---Front-----*-----------*----------
Other?
Manuals
External links to manuals
Issues
Information about issues found with this hardware, and how to deal with them
Issue1
Issue2