Move to Lugano
This is a compendium of things to consider when moving to the new building in Lugano.
Details on the new building
12 water-cooled racks per island, each:
- 42 U fully usable.
- 80 cm width, 120 cm depth.
- One cooling unit every two racks (30 cm width).
- Powered with 36 (x2) female PDU (C13/C14).
- Hole for cables in the back top side.
Things to consider / TODO
Rack mount
- Measure depth of the rails, to be able to adjust the rack accordingly.
- Ensure there are spare rails and screws in the new building.
- Find the place for storage of spare parts / tools.
Checklist before the move
- Review tasklist and timing per person.
- Place 2 copies of the map with cabling on the island.
- Check availability of the infrastructure people
- Check availability of necessary machinery:
- Lifts to help rack machines
- Pulls to move racks inside building
- Target racks are in place and correctly powered
- Check all items are properly boxed and labeled
- Inventory of moved parts: racks and boxes.
Checklist after the move
- Everything in the new building is turned on and working fine
- Failover capabilities in all hosts (where required)
- Everything in the old building is turned off
- Waste is in the right place
- Build a TODO list with the remaining (prescindible) things to do.
- Change BDII entries with new geographical location (and ARC)
Schedule
- On Wednesday 18th of April at 9:00 we shut down the power of the whole cluster.
- That day, during the morning, we uncable everything, prepairing all racks for the moving company.
- That same day, after noon, the moving company comes and prepares all racks for their move.
- On Thursday 19th, a truck comes at 9:00 and carries all stuff downtown.
- That same day, we start positioning the racks close to the island, and begin the labor.
- First, we do the Service Nodes (NFS, Xen, KVM, consoles)
- Then, we do Storage (storage01-02, pools, controllers/enclosures)
- And finally, we do Scratch (MDS, OSS, OST) and the AMD Compute Nodes.
On Thursday 10th of May the cluster should be up and running in the new location.
Shopping list
- Tools for rack mounting: screwdrivers, cutters, cutter-clamps, electric screwdriver, magnetic tips, velcro. BUS
- Toolbox and/or tray organizer for material.
- Cable organizer for below ethernet/infiniband switches.
- Cables (power, ethernet/colors, infiniband)
- Gloves for everyone BUS
- Enough IBM 2TB disks for safety spares.
- Rack-mounted VGA console
- Rail arms for IBM machines BUS
Rack Layout
This is the layout of the new Island:
Inventory
The list of things to move.
Server types:
Total: 121 machines
Briefing of network connectivity:
- 62 IB cables (+36 WN extension)