Tags:
create new tag
view all tags

CMS Tier-3 News Item

T3 Scheduled Downtime on Monday 6th May ~9:30 am

Summary

We need to stop for ~ 2h several VMs that have to be migrated into the new PSI VMware cluster.

Details

A new and powerful VMWare cluster has been installed at PSI with 2013 HW plus a recent VMWare installation;

as a consequence of this change our T3 VMs have to be migrated from the current VMWare cluster to the new environment.

In terms of operations and services impact this will mean:

  • Around 9:30 am I'll send a 1st e-mail announcing the beginning of this downtime.
  • I'll stop and migrate the VMs: t3ce02,t3se01,t3dcachedb03,t3frontier01 ( our local CMS Fontier ),t3cmsvobox02 ( our local Phedex )
  • Servers t3ui0[1-9]* will be left ON all the time but during the downtime their /pnfs/psi.ch/cms mount point will be not accessible for a while.
  • Users can submit jobs before the downtime but during the downtime I'll switch in disabled mode the batch queues and I'll kill all the running jobs.
  • Following the migration I'll enable the batch queues and the pending jobs will start to run as usual.
  • It will follow a 2nd and final e-mail announcing the end of this downtime.

Hint:
If you want to preserve your jobs from being killed then you can put in "hold" your pending jobs by running the command qhold and after the downtime you can enable again your jobs by running the command qrls; ideally you should try to get in the state where all your pending jobs are "in hold" and there are not running jobs, so the T3 downtime will be transparent for you; your CMS proxy hasn't to expire during the downtime.


FabioMartinelli 29. 04. 2013

T3NewsForm
Title T3 Scheduled Downtime on Monday 6th May ~9:30 am
Summary We need to stop for ~ 2h several VMs that have to be migrated into the new PSI VMware cluster.
User FabioMartinelli
Date 29. 04. 2013
Edit | Attach | Watch | Print version | History: r2 < r1 | Backlinks | Raw View | Raw edit | More topic actions
Topic revision: r2 - 2013-04-30 - FabioMartinelli
 
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback