HardwareThumper < LCGTier2

Tags: view all tags

<!-- keep this as a security measure:
   * Set ALLOWTOPICCHANGE = Main.TWikiAdminGroup,Main.LCGAdminGroup
   * Set ALLOWTOPICRENAME = Main.TWikiAdminGroup,Main.LCGAdminGroup
   #uncomment this if you want the page only be viewable by the internal people
   #* Set ALLOWTOPICVIEW = Main.TWikiAdminGroup,Main.LCGAdminGroup
-->

---+ Hardware Card for Sun Thumper X4500

This is our old Storage node for dCache with 48 disks inside

%TOC%

---++ Specifications

What's inside the hardware, probably depending on what we're talking about.
   * Disk controller model. *6 x Marvell MV88SX6081 (8 ports)*
   * Network card model: *4 x Intel 82546EB + 1 Mellanox IB MT23108 (added later)*
   * Space that takes in the rack: *3U*
   * Max CPUs, Max Disks, Max Mem slots. *2 x AMD Opteron DualCore 290*
   * CDROM
   * Dual power supply: *yes*
   * Front / Back picture (maybe available online?)
   * Any other?

---+++ Power consumption (measured before and during the CPU/Disk tests)
   * Minimum: *1000 W*
   * Maximum *1130 W*

---+++ Ambiental details
   * External working temperature
   * Normal CPU/memory internal temperature
   * Air flow (cubic meters per hour)
   * Power disipation: *3856 BTU/h*
   * Noise (dB)

---++ Operations

Interesting information like how to handle it, anything interesting which is not trivial.
---+++ How to get into the ILOM
---+++ Power up/down procedures
---+++ Commands to issue in an internal console
---+++ Firmware updates
---+++ Replacement of internal components

---++ Installation notes

Instructions on how to set up a new machines that arrives, with things like:
---+++ BIOS settings
---+++ RAID configuration
---+++ Drivers required / kernel compatibility
---+++ Check firmware homogeneity with other machines in the cluster

---++ Benchmarks

Information about benchmarks performed in the machine.
---+++ Disk benchmarks (i.e. Bonnie++)
---+++ CPU benchmarks (i.e. HepSpec06)
---+++ Network benchmarks (i.e. Iperf)

---++ Monitoring

Instructions about monitoring the hardware
---+++ Power Consumption
<h3>Raid Sanity</h3>

I&rsquo;ve gotten cron log from one of my servers today which says:<br />
/etc/cron.weekly/99-raid-check: WARNING: mismatch_cnt is not 0 on /dev/md0 <br />
Quick look at<br />
cat /proc/mdstat<br />
showed, that array is allright.<br />
This mismatch_cnt value is the value of the blocks, that are not synchronized between RAID drives. On my server the value was<br />
cat /sys/block/md0/md/mismatch_cnt<br />
and partition was md0, which is BOOT. SO, I quickly found the way to repair the problem by using<br />
echo repair &gt;/sys/block/md0/md/sync_action<br />
watch cat /proc/mdstat<br />
and after repair is completed<br />
echo check &gt;/sys/block/md0/md/sync_action<br />
watch cat /proc/mdstat<br />
After those operations the value of desynchronized blocks went to 0 again:<br />
cat /sys/block/md0/md/mismatch_cnt=

<h3>Disk layout for scsi to drive mapping</h3>

<pre>
---------------------SunFireX4500------Rear----------------------------
 
36:   37:   38:   39:   40:   41:   42:   43:   44:   45:   46:   47:   
sdab  sdaf  sdt   sdx   sdar  sdav  sdaj  sdan  sdl   sdp   sdd   sdh
c3t3  c3t7  c2t3  c2t7  c5t3  c5t7  c4t3  c4t7  c1t3  c1t7  c0t3  c0t7  
 
24:   25:   26:   27:   28:   29:   30:   31:   32:   33:   34:   35:   
sdaa  sdae  sds   sdw   sdaq  sdau  sdai  sdam  sdk   sdo   sdc   sdg
c3t2  c3t6  c2t2  c2t6  c5t2  c5t6  c4t2  c4t6  c1t2  c1t6  c0t2  c0t6  
 
12:   13:   14:   15:   16:   17:   18:   19:   20:   21:   22:   23:   
sdz   sdad  sdr   sdv   sdap  sdat  sdah  sdal  sdj   sdn   sdb   sdf
c3t1  c3t5  c2t1  c2t5  c5t1  c5t5  c4t1  c4t5  c1t1  c1t5  c0t1  c0t5  
 
 0:    1:    2:    3:    4:    5:    6:    7:    8:    9:   10:   11:   
sdy   sdac  sdq   sdu   sdao  sdas  sdag  sdak  sdi   sdm   sde   sda
c3t0  c3t4  c2t0  c2t4  c5t0  c5t4  c4t0  c4t4  c1t0  c1t4  c0t0  c0t4  
 b     b       
-------*-----------*-SunFireX4500--*---Front-----*-----------*----------
</pre>
---+++ Other?

---++ Manuals

External links to manuals

---++ Issues

Information about issues found with this hardware, and how to deal with them
---+++ Issue1
---+++ Issue2

HardwareCardForm
Model name	X4500
Manufacturer	Sun
Used for	dCache storage
Number in production	29
You install OS inside	Yes
First purchase date	Dec 2008
CPU performance in HS06	N/A
Disk performance in MB/s	400
Power consumption in Watts	1130