Hardware Card for IBM DCS3700
Short description about the hardware.
Specifications
What's inside the hardware, probably depending on what we're talking about.
- Disk controller model. Linux driver needed? Drives connected over FC with multipath.
- Network card model 2x 8Gb FC Dual HBA
- Space that takes in the rack (U's): 4U
- Max CPUs, Max Disks, Max Mem slots. currently 60x 3TB HDD
- CDROM? No
- Dual power supply? Yes
- Front / Back picture (maybe available online?)
- Any other?
Controller IBM System x3650 M4
- Disk controller model. Linux driver needed? LSI 2208 SAS controller, installs fine with standard SL
- Network card model 2x Intel I350 gigabit adapter and 2x QLogic QLE2562 - QLogic 8Gb FC Dual-port HBA for System x
- Space that takes in the rack (U's): 2U
- Max CPUs, Max Disks, Max Mem slots. 2x Xeon E5, currently 2x Intel(R) Xeon(R) CPU E5-2643 0 @ 3.30GHz. Up to 384 GB DDR-3 LRDIMM memory via 12 DIMM slots, currently 64GB (8x 8GB DIMMS).
- CDROM? No
- Dual power supply? Yes
- Front / Back picture (maybe available online?)
- Any other?
Power consumption (measured before and during the CPU/Disk tests)
Ambiental details
- External working temperature
- Normal CPU/memory internal temperature
- Air flow (cubic meters per hour)
- Noise (dB)
Operations
Interesting information like how to handle it, anything interesting which is not trivial.
How to get into the ILOM
Power up/down procedures
Commands to issue in an internal console
Firmware updates
Replacement of internal components
Installation notes
Instructions on how to set up a new machines that arrives, with things like:
Setting up multipath
Copy a multipath.conf from another machine
scp se11:/etc/multipath.conf /etc/
Ensure mulipathd is runninig.
service multipathd start
chkconfig multipathd on
Run a "multipath -ll". Ensure that you see the WWIDs that corrospond to the attached storage, this information can be found within SMclient.
multipath -ll
phaseG_storage_8_array4 (360080e50002e3fea0000039d507668fc) dm-2 IBM,1818 FAStT
size=22T features='0' hwhandler='1 rdac' wp=rw
|-+- policy='round-robin 0' prio=6 status=active
| `- 2:0:0:4 sdq 65:0 active ready running
`-+- policy='round-robin 0' prio=1 status=enabled
`- 1:0:0:4 sdk 8:160 active ghost running
...
Update the multipath.conf with the correct WWIDs and aliases.Be sure to copy this back into cfengine under the appropriate hosts.
Check that dev mapper has detected the storage.
Feb 14 13:06 [root@se12:~]# ll /dev/mapper/
Proceed to create LVM volumes and format as normal but ensure that the LVM.conf only allows for acitvation of one set of stoarge per se server. E.G. on se11
volume_list = [ "vg_root", "phaseG_storage_7" ]
whereas on se12
volume_list = [ "vg_root", "phaseG_storage_8" ]
BIOS settings
RAID configuration
Disks array grouped into RAID6 arrarys consisting of 10 disks. There are 6 arrays within each DS3700 enclosure.
Drivers required / kernel compatibility
Check firmware homogeneity with other machines in the cluster
Benchmarks
Information about benchmarks performed in the machine.
Disk benchmarks (i.e. Bonnie++)
Example:
CPU benchmarks (i.e. HepSpec06)
Network benchmarks (i.e. Iperf)
Monitoring
Instructions about monitoring the hardware
Power Consumption
Raid Sanity
Other?
Manuals
External links to manuals
Issues
Information about issues found with this hardware, and how to deal with them
Issue1
Issue2