Scheduled Maintenance on 2013-05-15

The next first working Wednesday of the month we will go into Scheduled Downtime. It will last from 9:00 to 20:00, but we will return to operation as soon as we finish.

As usual, CMS and Atlas queues will be closed 24 hours before the maintenance, and LHCb queue will close 48 hours before the maintenance.

Summary of interventions

We will perform the following operations on the cluster:

Network intervention

• Description: Update firmware of 2 Nexus 5548 switches
• Affected nodes:
• Notes: To be done between 9:00 and 10:00

Upgrade dCache head nodes to 2.2 from 1.9.12

• Description: Update dCache head nodes from SL5/dcache 1.9.12 on ageing Sun machines to SL6/dcache 2.2 on new IBM hardware
• Affected nodes: storage01 storage02 and se[01-14]
• Notes: Migration notes can be found here https://wiki.chipp.ch/twiki/bin/view/LCGTier2/DCacheMigrationTo22

Upgrade dCache pools to 2.2 from 1.9.12

• Description: Update dCache version from 1.9.12 to 2.2 on all the SE pools.
• Affected nodes: se[01-14]
• Notes: Migration notes can be found here https://wiki.chipp.ch/twiki/bin/view/LCGTier2/DCacheMigrationTo22

Firmware upgrade on DS3500 controller

• Description:One of the controllers still requires it's firmware to be updated
• Affected nodes:
• Notes: This is a carry over from the previous maintaince as it failed

Install CVMFS on new hardware

• Description: Install CVMFS on new IBM hardware
• Affected nodes: cvmfs1.lcg.cscs.ch
• Notes:

Other minor updates

1. Disk parameters of DM devices on se09.lcg.cscs.ch are not correct. Need to reboot the system.
2. Modify entry of CVMFS on WNs to point to the new cvmfs server /etc/cvmfs/default.local should have:

   CVMFS_HTTP_PROXY="http://cvmfs1.lcg.cscs.ch:3128|http://cvmfs.lcg.cscs.ch:3128"

3. Increase RAM available to cream03.lcg.cscs.ch and modify the swap usage reporter script /etc/glite-ce-cream-utils/glite_cream_load_monitor.conf Also this system has been migrated to SL 6.4 and updated with latest packages (including UMD-2 CREAM-CE)
4. Move the following VMs to kvm02 and kvm03 and update them to SL59:
   1. arc01
   2. arc02 NOTE: this is a Xen VM that requires extra work.
   3. lrms01
   4. ganglia
   5. nagios
   6. [POSTPONED] pub