MeetingSwissGridOperations20190502 < LCGTier2

Tags: view all tags
&lt;!-- keep this as a security measure:<br /> * Set ALLOWTOPICCHANGE = Main.TWikiAdminGroup,Main.LCGAdminGroup,Main.EgiGroup<br /> * Set ALLOWTOPICRENAME = Main.TWikiAdminGroup,Main.LCGAdminGroup<br /> #uncomment this if you want the page only be viewable by the internal people<br /> #* Set ALLOWTOPICVIEW = Main.TWikiAdminGroup,Main.LCGAdminGroup,Main.ChippComputingBoardGroup<br />--&gt;

---+ Swiss Grid Operations Meeting on 2019-05-02 at 14:00
   * *Place*: Vidyo (room: Swiss_Grid_Operations_Meeting, extension: 10537598)
   * *External link*: https://vidyoportal.cern.ch/flex.html?roomdirect.html&key=FAEn4zjAba7BqoQ11TGZu66VSDE
   * *Phone gate*: From Switzerland: 0227671400 (portal) + 10537598 (extension) + # (pound sign)
   * *IRC chat*: irc:gridchat.cscs.ch:994#lcg (ask pw via email)
   * *Switch Vidyo SIP IP*: 137.138.248.204
%TOC%

---++ Site status
---+++ CSCS

*Systems*
   * Phoenix complete shutdown
   * Un-Racked all WN and Services nodes and cleaned from cables.

<b>Storage<br /></b>

   * *dCache*
   1 *-* No special reports for the service
   1 - New (SE) servers installed, starting full data migration soon
   1 - SE servers will have GPFS as backend: this will give more performance and flexibility to the service and is the base for future steps (containers)
   1 - Planning the future of storage01-02: as first step they will be virtualized and then will be consolidated in one (v)server with external chimera (postgres) database

   * *GPFS (scratch)*
   1 - Servers moved to a new location, on a new network with no impact to the filesystem
   1 - Storage (SSD) moved to the new location
   1 - HDD Tier/pool moved from DDN SF12k to DELL SC9000
   1 - Will double the FC connections squeeze more performance (sometimes I see FC connections reaching the limit)

---+++ PSI
   * Xxx
   * [[http://t3mon.psi.ch/ganglia/PSIT3-custom/accounting.txt][Accounting numbers (from scheduler) from last month]]

---+++ UNIBE-LHEP
   * Stable running despite lack of maintenance
   * Started decommissioning nodes, but re-deployment delayed, since Phoenix hardware is still at CSCS
      * this will very likely affect our ability to meet the deadline for CentOs 7 migration (1st June)
   * Monthly summary: Pledged: 42k, delivered 22k
   * Ubelix contributing ~45% (23% typical)
   * Running an average &gt;2000 slots (2500 typical during the previous pledge period)
WC UNIBE-LHEP: <img align="middle" alt="WC_UNIBE-LHEP.png" height="152" src="%ATTACHURL%/WC_UNIBE-LHEP.png" width="393" /><br />5month_UNIBE-LHEP: <img alt="5month_UNIBE-LHEP.png" src="%ATTACHURL%/5month_UNIBE-LHEP.png" width="393" /><br /><br /><br />
   * *Accounting numbers (from scheduler) from last month*
      * Omitted this month
---+++ Swiss ATLAS statistics
   * <strong>Hammercloud availability:<br /><br /></strong><strong><img alt="ATLAS_HammerCloud.png" src="%ATTACHURL%/ATLAS_HammerCloud.png" width="643" /></strong>
   * 
      * ANALY_CSCS-HPC: 80%
      * CSCS-LCG2-HPC_MCORE: 99%
      * ANALY_UNIBE*: 100%
      * UNIBE-* : 99%<br /><br />
   * <b>Running slots<br /><img alt="ATLAS_slots.png" src="%ATTACHURL%/ATLAS_slots.png" width="393" /><br /><br /></b>
      * CSCS: 3.4k
      * UNIBE: 2.1k (38%)

   * <b>CPU consumption</b><br /><img alt="ATLAS_CPU.png" src="%ATTACHURL%/ATLAS_CPU.png" width="393" /> <br /><br /><br />
   * <b>Accounting Numbers from the ATLAS dashboard (April 2019) CSCS+UNIBE</b><br />%EDITTABLE{}%

| *Cluster* | *Job Type* | *Produced WC core-hours* | *Good vs Bad WC %* | *CPU eff good jobs %* |
| CSCS | Any | 2'133'333; 59% | 0.68 | 0.85 |
| UniBe | Any | 1'502'777; 41% | 0.75 | 0.80 |
<br /><br />
   * <b>Delivered vs pledged</b><br />CSCS-LCG2: pledged 50k, delivered 39.4k<br />UNIBE-LHEP: pledged 42k, delivered 22k<br /><br /><img alt="ATLAS_delivered_vs_pledge.png" src="%ATTACHURL%/ATLAS_delivered_vs_pledge.png" width="393" /><br /><br />
   * *Update on VO shares at CSCS*
      * We have discussed this at length ion the past. In that occasion the issue seems to afflict mostly Phoenix and much less or not at all Piz Daint.
      * Shares on Daint have been ok also after the decommissioning of Phoenix (40:40:20)
      * Following the recent outages however, the shares are largely wrong, much worse problem that before
      * RT ticket, Miguel following up<br /><br />
   * <p><img alt="CSCS-slots.png" src="%ATTACHURL%/CSCS-slots.png" width="393" /><br /><br /><br /></p>
   * *Further ATLAS CSCS topics*
      * CentOS 7 migration
         * deadline 1st June, awaiting clarification from ATLAS on what to do
      * ARC monitoring
         * Dino will join the NorduGrid conference in June to discuss his ideas
         * There is alreday a feature request open since many weeks
---+++ UNIBE-ID
   * <ins>Smooth operation of ARC-CE services for UNIBE-LHEP-UBELIX </ins>* currently lots of failed jobs due to memory excess
   * Soon changing storage current storage in a downtime (one of the next two)
      * current: 575TB GPFS based, new: 3.9PB still GPFS based
---+++ UNIGE
   * ARC CE provisioning further delayed<br /><br />
---+++ NGI_CH
   * <b>Status of CA / certificates</b><br /><br />
   * <b>NGI-CH Open Tickets review</b><br /> <table border="0" cellpadding="2" cellspacing="0" style="width: 920px; padding-left: 30px;"> <tbody style="padding-left: 30px;"> <tr style="padding-left: 30px;"> <td colspan="5" style="padding-left: 30px;"> *4 Tickets found* </td> </tr> <tr style="padding-left: 30px;"> <td style="padding-left: 30px;"> *Ticket-ID* </td> <td style="padding-left: 30px;"> *Type* </td> <td style="padding-left: 30px;"> *VO* </td> <td style="padding-left: 30px;"> *Site* </td> <td style="padding-left: 30px;"> *Priority* </td> <td style="padding-left: 30px;"> *Resp. Unit* </td> <td style="padding-left: 30px;"> *Status* </td> <td style="padding-left: 30px;"> *Last Update* </td> <td style="padding-left: 30px;"> *Subject* </td> <td style="padding-left: 30px;"> *Scope* </td> </tr> <tr style="padding-left: 30px;"> <td align="center" style="padding-left: 30px;" width="60px"><a href="https://ggus.eu/index.php?mode=ticket_info&ticket_id=140546" target="_blank">140546 </a></td> <td align="center" style="padding-left: 30px;"><img alt="" border="0" height="10" src="https://ggus.eu/index.php?mode=download&img=team_ticket.gif" width="38" /></td> <td style="padding-left: 30px;">lhcb</td> <td style="padding-left: 30px;">CSCS-LCG2</td> <td style="padding-left: 30px;">very urgent</td> <td style="padding-left: 30px;">NGI_CH <img alt="" border="0" src="https://ggus.eu/index.php?mode=download&img=tri.gif" /> involved</td> <td style="padding-left: 30px;">in progress</td> <td style="padding-left: 30px;">2019-04-23</td> <td align="left" style="padding-left: 30px;" width="250px">Data transfers problem from CSCS-LCG2</td> <td style="padding-left: 30px;">WLCG</td> </tr> <tr style="padding-left: 30px;"> <td align="center" style="padding-left: 30px;" width="60px"><a href="https://ggus.eu/index.php?mode=ticket_info&ticket_id=139574" target="_blank">139574 </a></td> <td align="center" style="padding-left: 30px;"> </td> <td style="padding-left: 30px;">dteam</td> <td style="padding-left: 30px;">CSCS-LCG2</td> <td style="padding-left: 30px;">less urgent</td> <td style="padding-left: 30px;">NGI_CH</td> <td style="padding-left: 30px;">in progress</td> <td style="padding-left: 30px;">2019-04-29</td> <td align="left" style="padding-left: 30px;" width="250px">please configure mesh on ...</td> <td style="padding-left: 30px;">EGI</td> </tr> <tr style="padding-left: 30px;"> <td align="center" style="padding-left: 30px;" width="60px"><a href="https://ggus.eu/index.php?mode=ticket_info&ticket_id=131965" target="_blank">131965 </a></td> <td align="center" style="padding-left: 30px;"> </td> <td style="padding-left: 30px;">none</td> <td style="padding-left: 30px;">UNIBE-LHEP</td> <td style="padding-left: 30px;">less urgent</td> <td style="padding-left: 30px;">NGI_CH <img alt="" border="0" src="https://ggus.eu/index.php?mode=download&img=tri.gif" /> assigned</td> <td style="padding-left: 30px;">on hold</td> <td style="padding-left: 30px;">2019-02-19</td> <td align="left" style="padding-left: 30px;" width="250px">IPv6 deployment at WLCG Tier-2 sites</td> <td style="padding-left: 30px;">EGI</td> </tr> <tr style="padding-left: 30px;"> <td align="center" style="padding-left: 30px;" width="60px"><a href="https://ggus.eu/index.php?mode=ticket_info&ticket_id=131432" target="_blank">131432 </a></td> <td align="center" style="padding-left: 30px;"> </td> <td style="padding-left: 30px;">none</td> <td style="padding-left: 30px;">CSCS-LCG2</td> <td style="padding-left: 30px;">urgent</td> <td style="padding-left: 30px;">NGI_CH <img alt="" border="0" src="https://ggus.eu/index.php?mode=download&img=tri.gif" /> assigned <img alt="" border="0" src="https://ggus.eu/index.php?mode=download&img=tri.gif" /> involved</td> <td style="padding-left: 30px;">in progress</td> <td style="padding-left: 30px;">2019-04-18</td> <td align="left" style="padding-left: 30px;" width="250px">Storage accounting deployment</td> <td style="padding-left: 30px;">EGI</td> </tr> </tbody> </table> <p> </p>
---++ Other topics
   * Topic1
   * Topic2 <p> </p> <p> </p> <p> </p> <p> </p> <p> </p> Next meeting date: <p> </p>
---++ A.O.B.

---++ Attendants
   * CSCS:
   * CMS:
   * ATLAS: Gianfranco
   * LHCb:
   * EGI: Gianfranco <p> </p>
---++ Action items
   * Item1
   *
Attachments
Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
png	5month_UNIBE-LHEP.png	r1	manage	250.9 K	2019-05-02 - 08:17	GianfrancoSciacca	5month_UNIBE-LHEP
png	ATLAS_CPU.png	r1	manage	216.3 K	2019-05-02 - 08:44	GianfrancoSciacca	ATLAS_CPU
png	ATLAS_HammerCloud.png	r1	manage	274.7 K	2019-05-02 - 08:26	GianfrancoSciacca	ATLAS_HammerCloud
png	ATLAS_delivered_vs_pledge.png	r1	manage	141.7 K	2019-05-02 - 09:33	GianfrancoSciacca
png	ATLAS_slots.png	r1	manage	194.7 K	2019-05-02 - 08:33	GianfrancoSciacca	ATLAS_slots
png	CSCS-slots.png	r1	manage	186.3 K	2019-05-02 - 09:38	GianfrancoSciacca	CSCS-slots
png	WC_UNIBE-LHEP.png	r1	manage	78.9 K	2019-05-02 - 08:08	GianfrancoSciacca	WC UNIBE-LHEP