(r260) PhoenixMonOverview < LCGTier2

Tags: view all tags
%INCLUDE{%SYSTEMWEB%.WebChangesRightBox}%
<!-- keep this as a security measure:
   * Set ALLOWTOPICCHANGE = Main.TWikiAdminGroup,Main.LCGAdminGroup
   * Set ALLOWTOPICRENAME = Main.TWikiAdminGroup,Main.LCGAdminGroup
   * Set GANGLIA3BASE = http://ganglia.lcg.cscs.ch/ganglia3/

   #uncomment this if you want the page only be viewable by the internal people
   # * Set ALLOWTOPICVIEW = Main.TWikiAdminGroup,Main.LCGAdminGroup
-->

%CALC{"$SET(jobint,$IF($EXACT(%URLPARAM{"jobint"}%,),day,%URLPARAM{"jobint"}%))"}%
%CALC{"$SET(jobintp,$IF($EXACT(%URLPARAM{"jobintp"}%,),day,%URLPARAM{"jobintp"}%))"}%
%CALC{"$SET(jobintd,$IF($EXACT(%URLPARAM{"jobintd"}%,),day,%URLPARAM{"jobintd"}%))"}%
%CALC{"$SET(freestorageint,$IF($EXACT(%URLPARAM{"freestorageint"}%,),week,%URLPARAM{"freestorageint"}%))"}%
%CALC{"$SET(netwint,$IF($EXACT(%URLPARAM{"netwint"}%,),day,%URLPARAM{"netwint"}%))"}%
%CALC{"$SET(coreint,$IF($EXACT(%URLPARAM{"coreint"}%,),day,%URLPARAM{"coreint"}%))"}%

---+!! Phoenix Monitoring Overview

%TOC%

Phoenix is a cluster comprised of =Phoenix= nodes and =Daint(HPC)= nodes.

---++ VoMonitoringDashboard

The following URLs are related to external monitoring pages and VO-specific monitoring pages: CERN credentials or a personal X509 certificate installed in your browser may be required:

*Monitoring Pages*:
   * *Site mon:*
      * SLURM top: [[https://lhcpublic.cscs.ch/sltop_wlcg.html][SLTOP Daint]]
   * *ATLAS:* [[http://hammercloud.cern.ch/hc/app/atlas/siteoverview/?site=CSCS-LCG2&startTime=2017-11-01&endTime=2017-11-07&templateType=isGolden][Hammer Cloud]] */* ARC [[http://www.nordugrid.org/monitor/loadmon.php][Cloud monitor]] */* [[http://dashb-atlas-job.cern.ch/dashboard/request.py/dailysummary#button=successfailures&sites%5B%5D=CSCS-LCG2&sitesCat%5B%5D=CH-CHIPP-CSCS&resourcetype=All&sitesSort=2&sitesCatSort=2&start=null&end=null&timerange=lastMonth&granularity=8+Hours&generic=0&sortby=16&series=30&activities%5B%5D=all][Daily Job Summary]]
   * *CMS:* [[https://etf-cms-prod.cern.ch/etf/check_mk/index.py?start_url=%2Fetf%2Fcheck_mk%2Fview.py%3Fview_name%3Dsearchhost%26host_regex%3DCSCS%26filled_in%3Dfilter][ETF]] */* [[http://dashb-ssb.cern.ch/dashboard/request.py/siteview?site=T2_CH_CSCS][Overview]] */* [[http://hammercloud.cern.ch/hc/app/cms/][CMS hammercloud]] */* [[https://cmsweb.cern.ch/phedex/debug/Activity::QualityPlots?graph=quality_all&entity=src&src_filter=&dest_filter=CSCS&no_mss=true&period=l7d&upto=][PhEDEx transfers WORLD -&gt; CSCS]] */* [[http://cms-site-readiness.web.cern.ch/cms-site-readiness/SiteReadiness/HTML/SiteReadinessReport.html][CMS Site Readiness reports]] */* [[http://wlcg-sam-cms.cern.ch/templates/ember/#/historicalsmry/heatMap?profile=CMS_CRITICAL_FULL&site=T2_CH_CSCS&time=48h&view=Test%20History][SAM Tests]]
   * *LHCb:* [[http://lhcb-portal-dirac.cern.ch/DIRAC/?view=tabs&theme=Grey&url_state=1|*DIRAC.SiteSummary.classes.SiteSummary][Site Summary (DIRAC)]] */* [[http://dashb-lhcb-ssb.cern.ch/dashboard/request.py/siteview?site=LCG.CSCS.ch][Overview]] */* [[http://lhcbproject.web.cern.ch/lhcbproject/Operations/queues.html][Queues length]] */*
   * *Accounting*: [[http://goc-accounting.grid-support.ac.uk/rss/CSCS-LCG2_Pub.html][APEL status]]

---++ Batch jobs (Daint)

Status plots from %SERVERTIME% (page is refreshed every 5 minutes).

<form name="formJobintP" action="%TOPICURL%?#Batch_jobs_on_Phoenix" method=GET>
<select name="jobintp" onchange="formJobintP.submit()">
<option %CALC{"$IF($EXACT($GET(jobintp),hour),selected,)"}%>hour</option>
<option %CALC{"$IF($EXACT($GET(jobintp),day),selected,)"}%>day</option>
<option %CALC{"$IF($EXACT($GET(jobintp),week),selected,)"}%>week</option>
<option %CALC{"$IF($EXACT($GET(jobintp),month),selected,)"}%>month</option>
<option %CALC{"$IF($EXACT($GET(jobintp),year),selected,)"}%>year</option>
</select>

<input type="hidden" name="jobintp" value=%CALC{"$GET(jobintp)"}%>
<input type="hidden" name="netwint" value=%CALC{"$GET(netwint)"}%>

</form>

%CALC{"$IF($EXACT($GET(jobintp),hour),$SET(jobintp2, 1h),)"}%
%CALC{"$IF($EXACT($GET(jobintp),day),$SET(jobintp2, 1d),)"}%
%CALC{"$IF($EXACT($GET(jobintp),week),$SET(jobintp2, 1w),)"}%
%CALC{"$IF($EXACT($GET(jobintp),month),$SET(jobintp2, 1M),)"}%
%CALC{"$IF($EXACT($GET(jobintp),year),$SET(jobintp2, 1y),)"}%

<img alt="" src="https://lhcpublic.cscs.ch/slurm_daint_%CALC{"$GET(jobintp2)"}%.png" />

---++ Cores Usage by VO (Daint)

<form name="formCoreint" action="%TOPICURL%?#Core_Usage_on_Phoenix" method=GET>
<select name="coreint" onchange="formCoreint.submit()">
<option %CALC{"$IF($EXACT($GET(coreint),hour),selected,)"}%>hour</option>
<option %CALC{"$IF($EXACT($GET(coreint),day),selected,)"}%>day</option>
<option %CALC{"$IF($EXACT($GET(coreint),week),selected,)"}%>week</option>
<option %CALC{"$IF($EXACT($GET(coreint),month),selected,)"}%>month</option>
<option %CALC{"$IF($EXACT($GET(coreint),year),selected,)"}%>year</option>
</select>

<input type="hidden" name="coreint" value=%CALC{"$GET(coreint)"}%>
</form>

%CALC{"$IF($EXACT($GET(coreint),hour),$SET(coreint2, 1h),)"}%
%CALC{"$IF($EXACT($GET(coreint),day),$SET(coreint2, 1d),)"}%
%CALC{"$IF($EXACT($GET(coreint),week),$SET(coreint2, 1w),)"}%
%CALC{"$IF($EXACT($GET(coreint),month),$SET(coreint2, 1M),)"}%
%CALC{"$IF($EXACT($GET(coreint),year),$SET(coreint2, 1y),)"}%

<img alt="" src="https://lhcpublic.cscs.ch/slurm_cores_daint_%CALC{"$GET(coreint2)"}%.png" />

---++ Storage Element

Links:
   * [[http://%SEHOST%:2288/][dCache GUI]]
   * *CMS:* [[http://dashb-ssb.cern.ch/dashboard/request.py/siteview?view=storage][dashboard summary view]] [[https://cmsweb.cern.ch/phedex/prod/Reports::SiteUsage?node=T2_CH_CSCS][accounting per phys. group]]

Free storage space: <form name="formFreestorageint" action="%TOPICURL%?#Storage_Element" method=GET>
<select name="freestorageint" onchange="formFreestorageint.submit()">
<option %CALC{"$IF($EXACT($GET(freestorageint),hour),selected,)"}%>hour</option>
<option %CALC{"$IF($EXACT($GET(freestorageint),day),selected,)"}%>day</option>
<option %CALC{"$IF($EXACT($GET(freestorageint),week),selected,)"}%>week</option>
<option %CALC{"$IF($EXACT($GET(freestorageint),month),selected,)"}%>month</option>
<option %CALC{"$IF($EXACT($GET(freestorageint),year),selected,)"}%>year</option>
</select>
<input type="hidden" name="jobint" value=%CALC{"$GET(jobint)"}%>
<input type="hidden" name="netwint" value=%CALC{"$GET(netwint)"}%>
</form>

%CALC{"$IF($EXACT($GET(freestorageint),hour),$SET(freestorageint2, 1h),)"}%
%CALC{"$IF($EXACT($GET(freestorageint),day),$SET(freestorageint2, 1d),)"}%
%CALC{"$IF($EXACT($GET(freestorageint),week),$SET(freestorageint2, 1w),)"}%
%CALC{"$IF($EXACT($GET(freestorageint),month),$SET(freestorageint2, 1M),)"}%
%CALC{"$IF($EXACT($GET(freestorageint),year),$SET(freestorageint2, 1y),)"}%

<img alt="" src="https://lhcpublic.cscs.ch/dcache_%CALC{"$GET(freestorageint2)"}%.png" />

---++ Networking and File Transfers

Links:
   * *ATLAS* [[http://dashb-atlas-ddm.cern.ch/ddm2/#activity=(Data+Brokering,Data+Consolidation,Express,Group+Subscriptions,Production,Production+Input,Production+Output,Recovery,User+Subscriptions,default)&d.dst.cloud=%22DE%22&d.dst.site=%22CSCS-LCG2%22&d.dst.token=%22DATADISK%22&d.error_code=131&d.state=(TRANSFER_FAILED)&date.interval=2880&dst.cloud=(%22DE%22)&dst.site=(%22CSCS-LCG2%22)&dst.tier=(0,1,2)&dst.token=(-TEST,-CEPH,-PPS,-GRIDFTP)&grouping.dst=(cloud,site,token)&m.content=(d_dof,d_eff,d_faf,s_eff,s_err,s_suc,t_eff,t_err,t_suc)&p.dim.height=567&p.dim.width=1104&samples=true&src.site=(-TEST,-RDF,-AWS,-CEPH)&src.tier=(0,1,2)&src.token=(-TEST,-CEPH,-PPS,-GRIDFTP)&tab=transfer_plots][Transfer Plots]] */* [[http://dashb-atlas-data.cern.ch/dashboard/request.py/site?statsInterval=168&name=FZK][ATLAS FZK Cloud Data activity last 7 days]]
   * *CMS* [[http://cmsweb.cern.ch/phedex/prod/Components::Status][Status Prod]] */* [[http://cmsweb.cern.ch/phedex/prod/Components::Links#?from_filter=T2_CH_CSCS&andor=or&to_filter=T2_CH_CSCS&Update=Update][PhEDEx enabled data transfer links at CSCS]] */* [[https://cmsweb.cern.ch/phedex/debug/Activity::QualityPlots?graph=quality_all&entity=link&src_filter=&dest_filter=T2_CH_CSCS&no_mss=true&period=l12h&upto=&.submit=Update][Phedex]]

---++ Other monitoring websites
   * [[http://grono.cscs.ch/switchmap/vlans/vlan64.html][CSCS Internal VLAN64]]

---++ CMS Monitoring Page

[[CMSMonitoring]]