Tags:
create new tag
view all tags

Arrow left Go to previous page / next page of CMS site log MOVED TO...

23. 09. 2009 phedex data service: TFC and LFN mappings. Some problematic sites

In order to test another problem, I needed the SRM URLs for a number of sites and their dcache versions. I then noticed that for a lot of sites the data service did not give results (because of site misconfiguration).

The table below is made with a little bash script test-phedexds-sites.sh. It shows which sites correctly publish a TFC and which sites can map the CMS /store/group LFN with their SRMv2 protocol in the data service (but you can ask for any TFC protocol and any LFN). The script also optionally parses out the backend storage technology strings (software,version) that the service's srmv2 access point provides.

Note:

  • The script will not do a full syntax check of the TFC. It just will confirm that a TFC is published and that the given URL could directly be mapped by the data service based on this TFC.
  • If the backend column shows unreachable this just means that the service did not correctly respond to the sent srmping (may also mean that the backend does not support this SRM call)

Script usage information: Show Hide

name: test-phedexds-sites.sh - get site storage information from central CMS PhEDEx data service

synopsis: test-phedexds-sites.sh [options]

Options:
       -l LFN           : LFN to map through the site's TFC (/store/group)
       -p "prot1 prot2" : space separated list of protocols to map for (srmv2 direct)
       -b               : query srmv2 endpoint for storage backend information
       -d               : debug mode (msg to stderr)
       -h/--help        : this help text

Examples:
       test-phedexds-sites.sh
       test-phedexds-sites.sh -l /store/group -p "srmv2 direct" -b

NODE TFC backend srmv2
T0_CH_CERN_Export ok CASTOR-2.1.8 srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/cms/store/group
T0_CH_CERN_MSS ok CASTOR-2.1.8 srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/cms/store/group
T1_CH_CERN_Buffer ok CASTOR-2.1.8 srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/cms/store/group
T1_CH_CERN_MSS ok CASTOR-2.1.8 srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/cms/store/group
T1_DE_FZK_Buffer ok dCache-production-1-9-1-11 srm://gridka-dCache.fzk.de:8443/srm/managerv2?SFN=/pnfs/gridka.de/cms/Prod/store/group
T1_DE_FZK_MSS ok dCache-production-1-9-1-11 srm://gridka-dCache.fzk.de:8443/srm/managerv2?SFN=/pnfs/gridka.de/cms/Prod/store/group
T1_DE_KIT_Buffer ok dCache-production-1.9.4-2 srm://cmssrm-fzk.gridka.de:8443/srm/managerv2?SFN=/pnfs/gridka.de/cms/store/group
T1_DE_KIT_MSS ok dCache-production-1.9.4-2 srm://cmssrm-fzk.gridka.de:8443/srm/managerv2?SFN=/pnfs/gridka.de/cms/store/group
T1_ES_PIC_Buffer ok dCache-production-1-9-2-10 srm://srmcms.pic.es:8443/srm/managerv2?SFN=/pnfs/pic.es/data/cms/store/group
T1_ES_PIC_MSS ok dCache-production-1-9-2-10 srm://srmcms.pic.es:8443/srm/managerv2?SFN=/pnfs/pic.es/data/cms/store/group
T1_FR_CCIN2P3_Buffer ok unreachable srm://ccsrm.in2p3.fr:8443/srm/managerv2?SFN=/pnfs/in2p3.fr/data/cms/data/store/group
T1_FR_CCIN2P3_MSS ok unreachable srm://ccsrm.in2p3.fr:8443/srm/managerv2?SFN=/pnfs/in2p3.fr/data/cms/data/store/group
T1_IT_CNAF_Buffer ok CASTOR-2.1.7 srm://srm-v2-cms.cr.cnaf.infn.it:8443/srm/managerv2?SFN=/castor/cnaf.infn.it/grid/lcg/cms/tape/group
T1_IT_CNAF_MSS ok CASTOR-2.1.7 srm://srm-v2-cms.cr.cnaf.infn.it:8443/srm/managerv2?SFN=/castor/cnaf.infn.it/grid/lcg/cms/tape/group
T1_TW_ASGC_Buffer ok CASTOR-2.1.7-19 srm://srm2.grid.sinica.edu.tw:8443/srm/managerv2?SFN=/castor/grid.sinica.edu.tw/d0t1/cms/store/group
T1_TW_ASGC_MSS ok CASTOR-2.1.7-19 srm://srm2.grid.sinica.edu.tw:8443/srm/managerv2?SFN=/castor/grid.sinica.edu.tw/d0t1/cms/store/group
T1_UK_RAL_Buffer ok CASTOR-2.1.7-27 srm://srm-cms.gridpp.rl.ac.uk:8443/srm/managerv2?SFN=/castor/ads.rl.ac.uk/prod/cms/store/group
T1_UK_RAL_MSS ok CASTOR-2.1.7-27 srm://srm-cms.gridpp.rl.ac.uk:8443/srm/managerv2?SFN=/castor/ads.rl.ac.uk/prod/cms/store/group
T1_US_FNAL_Buffer ok dCache-production-1-9-2-4 srm://cmssrm.fnal.gov:8443/srm/managerv2?SFN=/11/store/group
T1_US_FNAL_MSS ok dCache-production-1-9-2-4 srm://cmssrm.fnal.gov:8443/srm/managerv2?SFN=/11/store/group
T2_AT_Vienna ok DPM-1.7.2-4 srm://hephyse.oeaw.ac.at:8446/srm/managerv2?SFN=/dpm/oeaw.ac.at/home/cms/store/group
T2_BE_IIHE ok dCache-0.0.0 srm://maite.iihe.ac.be:8443/srm/managerv2?SFN=/pnfs/iihe/cms/ph/sc4/store/group
T2_BE_UCL ok unreachable srm://ingrid-se02.cism.ucl.ac.be:8444/srm/managerv2?SFN=/storage/data/cms/store/group
T2_BR_SPRACE ok dCache-production-1-9-0-10 srm://osg-se.sprace.org.br:8443/srm/managerv2?SFN=/pnfs/sprace.org.br/data/cms/store/group
T2_BR_UERJ ok unreachable srm://se-dcache.hepgrid.uerj.br:8443/srm/managerv2?SFN=/pnfs/hepgrid.uerj.br/data/cms/store/group
T2_CH_CAF ok CASTOR-2.1.8 srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/cms/store/group
T2_CH_CSCS ok dCache-production-1.9.3-3 srm://storage01.lcg.cscs.ch:8443/srm/managerv2?SFN=/pnfs/lcg.cscs.ch/cms/trivcat/store/group
T2_CN_Beijing ok dCache-production-1-9-1-4 srm://srm.ihep.ac.cn:8443/srm/managerv2?SFN=/pnfs/ihep.ac.cn/data/cms/store/group
T2_DE_DESY ok dCache-production-1-9-1-10 srm://dcache-se-cms.desy.de:8443/srm/managerv2?SFN=/pnfs/desy.de/cms/tier2/store/group
T2_DE_RWTH ok dCache-production-1-9-1-6 srm://grid-srm.physik.rwth-aachen.de:8443/srm/managerv2?SFN=/pnfs/physik.rwth-aachen.de/cms/store/group
T2_EE_Estonia ok dCache-production-1.9.3-3 srm://io.hep.kbfi.ee:8443/srm/managerv2?SFN=/pnfs/hep.kbfi.ee/data/cms/store/group
T2_ES_CIEMAT ok dCache-production-1-9-1-7 srm://srm.ciemat.es:8443/srm/managerv2?SFN=/pnfs/ciemat.es/data/cms/prod/store/group
T2_ES_IFCA ok StoRM-<FE:1.3.20><BE:1.3.20> srm://storm.ifca.es:8444/srm/managerv2?SFN=/cms/store/group
T2_FI_HIP ok dCache-production-1.9.4-3 srm://madhatter.csc.fi:8443/srm/managerv2?SFN=/pnfs/csc.fi/data/cms/store/group
T2_FR_CCIN2P3 ok unreachable srm://ccsrmt2.in2p3.fr:8443/srm/managerv2?SFN=/store/group
T2_FR_GRIF_IRFU ok DPM-1.7.2-4 srm://node12.datagrid.cea.fr:8446/srm/managerv2?SFN=/dpm/datagrid.cea.fr/home/cms/trivcat/store/group
T2_FR_GRIF_LLR ok DPM-1.7.2-4 srm://polgrid4.in2p3.fr:8446/srm/managerv2?SFN=/dpm/in2p3.fr/home/cms/trivcat/store/group
T2_FR_IPHC ok DPM-1.7.2-4 srm://sbgse1.in2p3.fr:8446/srm/managerv2?SFN=/dpm/in2p3.fr/home/cms/phedex/store/group
T2_HU_Budapest ok DPM-1.7.2-4 srm://grid143.kfki.hu:8446/srm/managerv2?SFN=/dpm/kfki.hu/home/cms/phedex/store/group
T2_IN_TIFR ok DPM-1.7.0-5 srm://se01.indiacms.res.in:8446/srm/managerv2?SFN=/dpm/indiacms.res.in/home/cms/store/group
T2_IT_Bari ok unreachable srm://storm-se-01.ba.infn.it:8444/srm/managerv2?SFN=//cms/store/group
T2_IT_Legnaro ok dCache-production-1-8-0-12p4 srm://t2-srm-02.lnl.infn.it:8443/srm/managerv2?SFN=/pnfs/lnl.infn.it/data/cms/store/group
T2_IT_Pisa ok dCache-production-1-8-0-15p12 srm://cmsdcache.pi.infn.it:8443/srm/managerv2?SFN=/pnfs/pi.infn.it/data/cms/store/group
T2_IT_Rome ok dCache-production-1-8-0-15p12 srm://cmsrm-se01.roma1.infn.it:8443/srm/managerv2?SFN=/pnfs/roma1.infn.it/data/cms/store/group
T2_KR_KNU ok dCache-production-1-9-1-11 srm://cluster142.knu.ac.kr:8443/srm/managerv2?SFN=/pnfs/knu.ac.kr/data/cms/store/group
T2_PK_NCP ok DPM-1.7.2-4 srm://pcncp22.ncp.edu.pk:8446/srm/managerv2?SFN=/dpm/ncp.edu.pk/home/cms/store/group
T2_PL_Warsaw ok DPM-1.6.11-3 srm://se.polgrid.pl:8446/srm/managerv2?SFN=/dpm/polgrid.pl/home/cms/phedex/store/store/group
T2_PT_LIP_Lisbon ok StoRM-<FE:1.4.0-01.sl4><BE:1.4.0-00> srm://srm01.lip.pt:8443/srm/managerv2?SFN=/lustre/lip.pt/data/cms/store/group
T2_PT_NCG_Lisbon ok StoRM-<FE:1.4.0-01.sl4><BE:1.4.0-00> srm://srm01.ncg.ingrid.pt:8443/srm/managerv2?SFN=/cms/store/group
T2_RU_IHEP ok dCache-production-1-8-0-12p6 srm://se0003.m45.ihep.su:8443/srm/managerv2?SFN=/pnfs/m45.ihep.su/data/cms/store/group
T2_RU_INR ok DPM-1.7.2-4 srm://grse001.inr.troitsk.ru:8446/srm/managerv2?SFN=/dpm/inr.troitsk.ru/home/cms/store/group
T2_RU_ITEP ok dCache-production-1-9-0-8 srm://se3.itep.ru:8443/srm/managerv2?SFN=/pnfs/itep.ru/data/cms/store/group
T2_RU_JINR ok unreachable srm://lcgsedc01.jinr.ru:8443/srm/managerv2?SFN=/pnfs/jinr.ru/data/cms/store/group
T2_RU_PNPI missing    
T2_RU_RRC_KI ok DPM-1.7.2-4 srm://se.grid.kiae.ru:8446/srm/managerv2?SFN=/dpm/grid.kiae.ru/home/cms/store/group
T2_RU_SINP ok DPM-1.6.11-3 srm://grid128.sinp.msu.ru:8446/srm/managerv2?SFN=/dpm/sinp.msu.ru/grid128/cms/store/group
T2_TR_METU ok DPM-1.7.2-4 srm://eymir.grid.metu.edu.tr:8446/srm/managerv2?SFN=/dpm/grid.metu.edu.tr/home/cms/store/group
T2_TW_Taiwan ok DPM-1.7.2-4 srm://f-dpm001.grid.sinica.edu.tw:8446/srm/managerv2?SFN=/dpm/grid.sinica.edu.tw/home/cms/store/group
T2_UA_KIPT ok DPM-1.6.11-3 srm://cms-se0.kipt.kharkov.ua:8446/srm/managerv2?SFN=/dpm/kipt.kharkov.ua/home/cms/store/group
T2_UK_London_Brunel ok DPM-1.6.11-3 srm://dgc-grid-50.brunel.ac.uk:8446/srm/managerv2?SFN=/dpm/brunel.ac.uk/home2/cms/store/group
T2_UK_London_IC ok dCache-production-1-9-1-11 srm://gfe02.hep.ph.ic.ac.uk:8443/srm/managerv2?SFN=/pnfs/hep.ph.ic.ac.uk/data/cms/store/group
T2_UK_SGrid_Bristol ok DPM-1.6.11-3 srm://lcgse01.phy.bris.ac.uk:8446/srm/managerv2?SFN=/dpm/phy.bris.ac.uk/home/cms/store/group
T2_UK_SGrid_RALPP ok dCache-production-1-9-1-7 srm://heplnx204.pp.rl.ac.uk:8443/srm/managerv2?SFN=/pnfs/pp.rl.ac.uk/data/cms/group
T2_US_Caltech ok BeStMan-2.2.1.2.i7 srm://cit-se2.ultralight.org:8443/srm/v2/server?SFN=/mnt/hadoop/store/group
T2_US_Florida ok unreachable srm://srm.ihepa.ufl.edu:8443/srm/managerv2?SFN=/cmsdata/store/group
T2_US_MIT ok dCache-production-1.9.3-3 srm://se01.cmsaf.mit.edu:8443/srm/managerv2?SFN=/pnfs/cmsaf.mit.edu/t2bat/cms/store/group
T2_US_Nebraska ok BeStMan-2.2.1.2.i4 srm://dcache07.unl.edu:8443/srm/v2/server?SFN=/mnt/hadoop/user/uscms01/pnfs/unl.edu/data4/cms/store/group
T2_US_Purdue ok dCache-production-1-9-2-10 srm://srm-dcache.rcac.purdue.edu:8443/srm/managerv2?SFN=/store/group
T2_US_UCSD ok BeStMan-2.2.1.2.i6 srm://bsrm-1.t2.ucsd.edu:8443/srm/v2/server?SFN=/hadoop/cms/phedex/store/group
T2_US_Wisconsin ok dCache-production-1-9-0-8 srm://cmssrm.hep.wisc.edu:8443/srm/managerv2?SFN=/pnfs/hep.wisc.edu/store/group
T3_CH_PSI ok dCache-production-1-9-2-5 srm://t3se01.psi.ch:8443/srm/managerv2?SFN=/pnfs/psi.ch/cms/trivcat/store/group
T3_CN_PKU ok unreachable srm://grid09.phy.pku.edu.cn:8446/srm/managerv2?SFN=/dpm//phy.pku.edu.cn/home/cms/store/group
T3_CO_Uniandes missing    
T3_DE_Karlsruhe missing    
T3_ES_Oviedo ok unreachable file:////data/oviedo/cms/store/group
T3_FR_IPNL ok DPM-1.7.2-4 srm://lyogrid06.in2p3.fr:8446/srm/managerv2?SFN=/dpm/in2p3.fr/home/cms/data/store/group
T3_GR_Demokritos missing    
T3_GR_IASA_GR missing    
T3_GR_IASA_HG missing    
T3_GR_Ioannina ok DPM-1.7.2-4 srm://pc138.physics.uoi.gr:8446/srm/managerv2?SFN=/dpm/physics.uoi.gr/home/cms/store/group
T3_IT_Firenze missing    
T3_IT_Napoli missing    
T3_IT_Perugia ok dCache-production-1.9.3-3 srm://gridse3.pg.infn.it:8443/srm/managerv2?SFN=/pnfs/pg.infn.it/data/cms/store/group
T3_TW_NCU ok unreachable srm://grid02.phy.ncu.edu.tw:8446/srm/managerv2?SFN=/dpm/phy.ncu.edu.tw/home/cms/store/group
T3_UCLASaxon_Buffer missing    
T3_UK_London_QMUL ok StoRM-<FE:1.4.0-01.sl4><BE:1.4.0-00> srm://se03.esc.qmul.ac.uk:8444/srm/managerv2?SFN=/cms/store/group
T3_UK_London_RHUL ok DPM-1.6.11-3 srm://se2.ppgrid1.rhul.ac.uk:8446/srm/managerv2?SFN=/dpm/ppgrid1.rhul.ac.uk/home/cms/store/group
T3_UK_London_UCL ok DPM-1.6.11-3 srm://gw-3.ccc.ucl.ac.uk:8446/srm/managerv2?SFN=/dpm/ccc.ucl.ac.uk/home/cms/store/group
T3_UK_ScotGrid_ECDF ok DPM-1.7.2-4 srm://srm.glite.ecdf.ed.ac.uk:8446/srm/managerv2?SFN=/dpm/ecdf.ed.ac.uk/home/cms/store/group
T3_UK_ScotGrid_GLA ok DPM-1.7.2-5 srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/cms/store/group
T3_UK_SGrid_Oxford ok DPM-1.7.2-4 srm://t2se01.physics.ox.ac.uk:8446/srm/managerv2?SFN=/dpm/physics.ox.ac.uk/home/cms/store/group
T3_UMiss_Buffer missing    
T3_US_Colorado ok BeStMan-2.2.1.2.i7 srm://hepse01.colorado.edu:8443/srm/v2/server?SFN=/bestman/storage/cms/store/group
T3_US_Cornell ok BeStMan-2.2.1.2.e7 srm://osg-se.cac.cornell.edu:8443/srm/v2/server?SFN=/xrootdfs/cms/store/group
T3_US_FIT ok BeStMan-2.2.1.2.i7 srm://uscms1-se.fltech-grid3.fit.edu:8443/srm/v2/server?SFN=/mnt/nas0/OSG/BeStMan/cms/store/group
T3_US_FNALLPC ok dCache-production-1-9-2-4 srm://cmssrm.fnal.gov:8443/srm/managerv2?SFN=/11/store/group
T3_US_FNALXEN ok BeStMan-2.2.1.2.i7 srm://cms-xen19.fnal.gov:8443/srm/v2/server?SFN=/data/se/store/group
T3_US_FSU missing    
T3_US_JHU ok unreachable file:////export/d1/store/group
T3_US_Kansas missing    
T3_US_Minnesota ok unreachable file:////data/whybee0/phedex/data/store/group
T3_US_Omaha ok BeStMan-2.2.1.2.i5 srm://ff-se.unl.edu:8443/srm/v2/server?SFN=/panfs/panasas/CMS/store/group
T3_US_OSU missing    
T3_US_Princeton ok unreachable file:////mnt/cms/store/group
T3_US_Princeton_ICSE ok unreachable file:////tigress-hsm/zuranski/store/group
T3_US_Rice ok unreachable srm://osg-gate.rice.edu:8443/srm/v2/server?SFN=/data/cms/se/store/group
T3_US_Rutgers ok unreachable file:////cms/se/phedex/store/group
T3_US_TTU ok unreachable file:////mnt/hep/cms/buffer/store/group
T3_US_UCD ok BeStMan-2.2.1.2.i7 srm://se.tier3.ucdavis.edu:8443/srm/v2/server?SFN=/mnt/hadoop/store/group
T3_US_UCR ok BeStMan-2.2.1.2.i5 srm://charm.ucr.edu:10443/srm/v2/server?SFN=/data/bottom/cms/store/group
T3_US_UIowa missing    
T3_US_UMD ok BeStMan-2.2.1.2.i7 srm://hepcms-0.umd.edu:8443/srm/v2/server?SFN=/data/se/store/group
T3_US_UTENN missing    
T3_US_Vanderbilt ok BeStMan-2.2.1.2.i7 srm://se1.accre.vanderbilt.edu:6288/srm/v2/server?SFN=/store/group
T3_UVA_Buffer missing    
TV_LCG_Production missing    
TX_LCGBO_Buffer missing    
TX_TEST3_Buffer missing    

-- DerekFeichtinger - 2009-09-23


Arrow left Go to previous page / next page of CMS site log MOVED TO...

Topic attachments
I AttachmentSorted ascending History Action Size Date Who Comment
Unix shell scriptsh test-phedexds-sites.sh r5 r4 r3 r2 r1 manage 3.6 K 2009-10-01 - 11:57 DerekFeichtinger phedex data service site test
Edit | Attach | Watch | Print version | History: r7 < r6 < r5 < r4 < r3 | Backlinks | Raw View | Raw edit | More topic actions
Topic revision: r7 - 2009-10-01 - DerekFeichtinger
 
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback