<!-- keep this as a security measure: * Set ALLOWTOPICCHANGE = Main.TWikiAdminGroup,Main.LCGAdminGroup * Set ALLOWTOPICRENAME = Main.TWikiAdminGroup,Main.LCGAdminGroup #uncomment this if you want the page only be viewable by the internal people # * Set ALLOWTOPICVIEW = Main.TWikiAdminGroup,Main.LCGAdminGroup --> %TOC% %ICON{arrowleft}% Go to [[CMSSiteLog18][previous page]] / [[CMSSiteLog20][next page]] of CMS site log %M% ---+ 23. 09. 2009 phedex data service: TFC and LFN mappings. Some problematic sites In order to test another problem, I needed the SRM URLs for a number of sites and their dcache versions. I then noticed that for a lot of sites the data service did not give results (because of site misconfiguration). The table below is made with a little bash script [[%ATTACHURL%/test-phedexds-sites.sh][test-phedexds-sites.sh]]. It shows which sites correctly publish a TFC and which sites can map the CMS =/store/group= LFN with their SRMv2 protocol in the data service (but you can ask for any TFC protocol and any LFN). The script also optionally parses out the backend storage technology strings (software,version) that the service's srmv2 access point provides. Note: * The script will not do a full syntax check of the TFC. It just will confirm that a TFC is published and that the given URL could directly be mapped by the data service based on this TFC. * If the backend column shows =unreachable= this just means that the service did not correctly respond to the sent srmping (may also mean that the backend does not support this SRM call) Script usage information:%TWISTY{showlink="Show" hidelink="Hide" showimgleft="%ICONURLPATH{toggleopen-small}%" hideimgleft="%ICONURLPATH{toggleclose-small}%"}%<pre> name: test-phedexds-sites.sh - get site storage information from central CMS PhEDEx data service synopsis: test-phedexds-sites.sh [options] Options: -l LFN : LFN to map through the site's TFC (/store/group) -p "prot1 prot2" : space separated list of protocols to map for (srmv2 direct) -b : query srmv2 endpoint for storage backend information -d : debug mode (msg to stderr) -h/--help : this help text Examples: test-phedexds-sites.sh test-phedexds-sites.sh -l /store/group -p "srmv2 direct" -b </pre> %ENDTWISTY% | *NODE* | *TFC*| *backend* | *srmv2* | | T0_CH_CERN_Export | ok | CASTOR-2.1.8 | srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/cms/store/group | | T0_CH_CERN_MSS | ok | CASTOR-2.1.8 | srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/cms/store/group | | T1_CH_CERN_Buffer | ok | CASTOR-2.1.8 | srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/cms/store/group | | T1_CH_CERN_MSS | ok | CASTOR-2.1.8 | srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/cms/store/group | | T1_DE_FZK_Buffer | ok | dCache-production-1-9-1-11 | srm://gridka-dCache.fzk.de:8443/srm/managerv2?SFN=/pnfs/gridka.de/cms/Prod/store/group | | T1_DE_FZK_MSS | ok | dCache-production-1-9-1-11 | srm://gridka-dCache.fzk.de:8443/srm/managerv2?SFN=/pnfs/gridka.de/cms/Prod/store/group | | T1_DE_KIT_Buffer | ok | dCache-production-1.9.4-2 | srm://cmssrm-fzk.gridka.de:8443/srm/managerv2?SFN=/pnfs/gridka.de/cms/store/group | | T1_DE_KIT_MSS | ok | dCache-production-1.9.4-2 | srm://cmssrm-fzk.gridka.de:8443/srm/managerv2?SFN=/pnfs/gridka.de/cms/store/group | | T1_ES_PIC_Buffer | ok | dCache-production-1-9-2-10 | srm://srmcms.pic.es:8443/srm/managerv2?SFN=/pnfs/pic.es/data/cms/store/group | | T1_ES_PIC_MSS | ok | dCache-production-1-9-2-10 | srm://srmcms.pic.es:8443/srm/managerv2?SFN=/pnfs/pic.es/data/cms/store/group | | T1_FR_CCIN2P3_Buffer | ok | unreachable | srm://ccsrm.in2p3.fr:8443/srm/managerv2?SFN=/pnfs/in2p3.fr/data/cms/data/store/group | | T1_FR_CCIN2P3_MSS | ok | unreachable | srm://ccsrm.in2p3.fr:8443/srm/managerv2?SFN=/pnfs/in2p3.fr/data/cms/data/store/group | | T1_IT_CNAF_Buffer | ok | CASTOR-2.1.7 | srm://srm-v2-cms.cr.cnaf.infn.it:8443/srm/managerv2?SFN=/castor/cnaf.infn.it/grid/lcg/cms/tape/group | | T1_IT_CNAF_MSS | ok | CASTOR-2.1.7 | srm://srm-v2-cms.cr.cnaf.infn.it:8443/srm/managerv2?SFN=/castor/cnaf.infn.it/grid/lcg/cms/tape/group | | T1_TW_ASGC_Buffer | ok | CASTOR-2.1.7-19 | srm://srm2.grid.sinica.edu.tw:8443/srm/managerv2?SFN=/castor/grid.sinica.edu.tw/d0t1/cms/store/group | | T1_TW_ASGC_MSS | ok | CASTOR-2.1.7-19 | srm://srm2.grid.sinica.edu.tw:8443/srm/managerv2?SFN=/castor/grid.sinica.edu.tw/d0t1/cms/store/group | | T1_UK_RAL_Buffer | ok | CASTOR-2.1.7-27 | srm://srm-cms.gridpp.rl.ac.uk:8443/srm/managerv2?SFN=/castor/ads.rl.ac.uk/prod/cms/store/group | | T1_UK_RAL_MSS | ok | CASTOR-2.1.7-27 | srm://srm-cms.gridpp.rl.ac.uk:8443/srm/managerv2?SFN=/castor/ads.rl.ac.uk/prod/cms/store/group | | T1_US_FNAL_Buffer | ok | dCache-production-1-9-2-4 | srm://cmssrm.fnal.gov:8443/srm/managerv2?SFN=/11/store/group | | T1_US_FNAL_MSS | ok | dCache-production-1-9-2-4 | srm://cmssrm.fnal.gov:8443/srm/managerv2?SFN=/11/store/group | | T2_AT_Vienna | ok | DPM-1.7.2-4 | srm://hephyse.oeaw.ac.at:8446/srm/managerv2?SFN=/dpm/oeaw.ac.at/home/cms/store/group | | T2_BE_IIHE | ok | dCache-0.0.0 | srm://maite.iihe.ac.be:8443/srm/managerv2?SFN=/pnfs/iihe/cms/ph/sc4/store/group | | T2_BE_UCL | ok | unreachable | srm://ingrid-se02.cism.ucl.ac.be:8444/srm/managerv2?SFN=/storage/data/cms/store/group | | T2_BR_SPRACE | ok | dCache-production-1-9-0-10 | srm://osg-se.sprace.org.br:8443/srm/managerv2?SFN=/pnfs/sprace.org.br/data/cms/store/group | | T2_BR_UERJ | ok | unreachable | srm://se-dcache.hepgrid.uerj.br:8443/srm/managerv2?SFN=/pnfs/hepgrid.uerj.br/data/cms/store/group | | T2_CH_CAF | ok | CASTOR-2.1.8 | srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/cms/store/group | | T2_CH_CSCS | ok | dCache-production-1.9.3-3 | srm://storage01.lcg.cscs.ch:8443/srm/managerv2?SFN=/pnfs/lcg.cscs.ch/cms/trivcat/store/group | | T2_CN_Beijing | ok | dCache-production-1-9-1-4 | srm://srm.ihep.ac.cn:8443/srm/managerv2?SFN=/pnfs/ihep.ac.cn/data/cms/store/group | | T2_DE_DESY | ok | dCache-production-1-9-1-10 | srm://dcache-se-cms.desy.de:8443/srm/managerv2?SFN=/pnfs/desy.de/cms/tier2/store/group | | T2_DE_RWTH | ok | dCache-production-1-9-1-6 | srm://grid-srm.physik.rwth-aachen.de:8443/srm/managerv2?SFN=/pnfs/physik.rwth-aachen.de/cms/store/group | | T2_EE_Estonia | ok | dCache-production-1.9.3-3 | srm://io.hep.kbfi.ee:8443/srm/managerv2?SFN=/pnfs/hep.kbfi.ee/data/cms/store/group | | T2_ES_CIEMAT | ok | dCache-production-1-9-1-7 | srm://srm.ciemat.es:8443/srm/managerv2?SFN=/pnfs/ciemat.es/data/cms/prod/store/group | | T2_ES_IFCA | ok | StoRM-<FE:1.3.20><BE:1.3.20> | srm://storm.ifca.es:8444/srm/managerv2?SFN=/cms/store/group | | T2_FI_HIP | ok | dCache-production-1.9.4-3 | srm://madhatter.csc.fi:8443/srm/managerv2?SFN=/pnfs/csc.fi/data/cms/store/group | | T2_FR_CCIN2P3 | ok | unreachable | srm://ccsrmt2.in2p3.fr:8443/srm/managerv2?SFN=/store/group | | T2_FR_GRIF_IRFU | ok | DPM-1.7.2-4 | srm://node12.datagrid.cea.fr:8446/srm/managerv2?SFN=/dpm/datagrid.cea.fr/home/cms/trivcat/store/group | | T2_FR_GRIF_LLR | ok | DPM-1.7.2-4 | srm://polgrid4.in2p3.fr:8446/srm/managerv2?SFN=/dpm/in2p3.fr/home/cms/trivcat/store/group | | T2_FR_IPHC | ok | DPM-1.7.2-4 | srm://sbgse1.in2p3.fr:8446/srm/managerv2?SFN=/dpm/in2p3.fr/home/cms/phedex/store/group | | T2_HU_Budapest | ok | DPM-1.7.2-4 | srm://grid143.kfki.hu:8446/srm/managerv2?SFN=/dpm/kfki.hu/home/cms/phedex/store/group | | T2_IN_TIFR | ok | DPM-1.7.0-5 | srm://se01.indiacms.res.in:8446/srm/managerv2?SFN=/dpm/indiacms.res.in/home/cms/store/group | | T2_IT_Bari | ok | unreachable | srm://storm-se-01.ba.infn.it:8444/srm/managerv2?SFN=//cms/store/group | | T2_IT_Legnaro | ok | dCache-production-1-8-0-12p4 | srm://t2-srm-02.lnl.infn.it:8443/srm/managerv2?SFN=/pnfs/lnl.infn.it/data/cms/store/group | | T2_IT_Pisa | ok | dCache-production-1-8-0-15p12 | srm://cmsdcache.pi.infn.it:8443/srm/managerv2?SFN=/pnfs/pi.infn.it/data/cms/store/group | | T2_IT_Rome | ok | dCache-production-1-8-0-15p12 | srm://cmsrm-se01.roma1.infn.it:8443/srm/managerv2?SFN=/pnfs/roma1.infn.it/data/cms/store/group | | T2_KR_KNU | ok | dCache-production-1-9-1-11 | srm://cluster142.knu.ac.kr:8443/srm/managerv2?SFN=/pnfs/knu.ac.kr/data/cms/store/group | | T2_PK_NCP | ok | DPM-1.7.2-4 | srm://pcncp22.ncp.edu.pk:8446/srm/managerv2?SFN=/dpm/ncp.edu.pk/home/cms/store/group | | T2_PL_Warsaw | ok | DPM-1.6.11-3 | srm://se.polgrid.pl:8446/srm/managerv2?SFN=/dpm/polgrid.pl/home/cms/phedex/store/store/group | | T2_PT_LIP_Lisbon | ok | StoRM-<FE:1.4.0-01.sl4><BE:1.4.0-00> | srm://srm01.lip.pt:8443/srm/managerv2?SFN=/lustre/lip.pt/data/cms/store/group | | T2_PT_NCG_Lisbon | ok | StoRM-<FE:1.4.0-01.sl4><BE:1.4.0-00> | srm://srm01.ncg.ingrid.pt:8443/srm/managerv2?SFN=/cms/store/group | | T2_RU_IHEP | ok | dCache-production-1-8-0-12p6 | srm://se0003.m45.ihep.su:8443/srm/managerv2?SFN=/pnfs/m45.ihep.su/data/cms/store/group | | T2_RU_INR | ok | DPM-1.7.2-4 | srm://grse001.inr.troitsk.ru:8446/srm/managerv2?SFN=/dpm/inr.troitsk.ru/home/cms/store/group | | T2_RU_ITEP | ok | dCache-production-1-9-0-8 | srm://se3.itep.ru:8443/srm/managerv2?SFN=/pnfs/itep.ru/data/cms/store/group | | T2_RU_JINR | ok | unreachable | srm://lcgsedc01.jinr.ru:8443/srm/managerv2?SFN=/pnfs/jinr.ru/data/cms/store/group | | T2_RU_PNPI | missing | | | | T2_RU_RRC_KI | ok | DPM-1.7.2-4 | srm://se.grid.kiae.ru:8446/srm/managerv2?SFN=/dpm/grid.kiae.ru/home/cms/store/group | | T2_RU_SINP | ok | DPM-1.6.11-3 | srm://grid128.sinp.msu.ru:8446/srm/managerv2?SFN=/dpm/sinp.msu.ru/grid128/cms/store/group | | T2_TR_METU | ok | DPM-1.7.2-4 | srm://eymir.grid.metu.edu.tr:8446/srm/managerv2?SFN=/dpm/grid.metu.edu.tr/home/cms/store/group | | T2_TW_Taiwan | ok | DPM-1.7.2-4 | srm://f-dpm001.grid.sinica.edu.tw:8446/srm/managerv2?SFN=/dpm/grid.sinica.edu.tw/home/cms/store/group | | T2_UA_KIPT | ok | DPM-1.6.11-3 | srm://cms-se0.kipt.kharkov.ua:8446/srm/managerv2?SFN=/dpm/kipt.kharkov.ua/home/cms/store/group | | T2_UK_London_Brunel | ok | DPM-1.6.11-3 | srm://dgc-grid-50.brunel.ac.uk:8446/srm/managerv2?SFN=/dpm/brunel.ac.uk/home2/cms/store/group | | T2_UK_London_IC | ok | dCache-production-1-9-1-11 | srm://gfe02.hep.ph.ic.ac.uk:8443/srm/managerv2?SFN=/pnfs/hep.ph.ic.ac.uk/data/cms/store/group | | T2_UK_SGrid_Bristol | ok | DPM-1.6.11-3 | srm://lcgse01.phy.bris.ac.uk:8446/srm/managerv2?SFN=/dpm/phy.bris.ac.uk/home/cms/store/group | | T2_UK_SGrid_RALPP | ok | dCache-production-1-9-1-7 | srm://heplnx204.pp.rl.ac.uk:8443/srm/managerv2?SFN=/pnfs/pp.rl.ac.uk/data/cms/group | | T2_US_Caltech | ok | BeStMan-2.2.1.2.i7 | srm://cit-se2.ultralight.org:8443/srm/v2/server?SFN=/mnt/hadoop/store/group | | T2_US_Florida | ok | unreachable | srm://srm.ihepa.ufl.edu:8443/srm/managerv2?SFN=/cmsdata/store/group | | T2_US_MIT | ok | dCache-production-1.9.3-3 | srm://se01.cmsaf.mit.edu:8443/srm/managerv2?SFN=/pnfs/cmsaf.mit.edu/t2bat/cms/store/group | | T2_US_Nebraska | ok | BeStMan-2.2.1.2.i4 | srm://dcache07.unl.edu:8443/srm/v2/server?SFN=/mnt/hadoop/user/uscms01/pnfs/unl.edu/data4/cms/store/group | | T2_US_Purdue | ok | dCache-production-1-9-2-10 | srm://srm-dcache.rcac.purdue.edu:8443/srm/managerv2?SFN=/store/group | | T2_US_UCSD | ok | BeStMan-2.2.1.2.i6 | srm://bsrm-1.t2.ucsd.edu:8443/srm/v2/server?SFN=/hadoop/cms/phedex/store/group | | T2_US_Wisconsin | ok | dCache-production-1-9-0-8 | srm://cmssrm.hep.wisc.edu:8443/srm/managerv2?SFN=/pnfs/hep.wisc.edu/store/group | | T3_CH_PSI | ok | dCache-production-1-9-2-5 | srm://t3se01.psi.ch:8443/srm/managerv2?SFN=/pnfs/psi.ch/cms/trivcat/store/group | | T3_CN_PKU | ok | unreachable | srm://grid09.phy.pku.edu.cn:8446/srm/managerv2?SFN=/dpm//phy.pku.edu.cn/home/cms/store/group | | T3_CO_Uniandes | missing | | | | T3_DE_Karlsruhe | missing | | | | T3_ES_Oviedo | ok | unreachable | file:////data/oviedo/cms/store/group | | T3_FR_IPNL | ok | DPM-1.7.2-4 | srm://lyogrid06.in2p3.fr:8446/srm/managerv2?SFN=/dpm/in2p3.fr/home/cms/data/store/group | | T3_GR_Demokritos | missing | | | | T3_GR_IASA_GR | missing | | | | T3_GR_IASA_HG | missing | | | | T3_GR_Ioannina | ok | DPM-1.7.2-4 | srm://pc138.physics.uoi.gr:8446/srm/managerv2?SFN=/dpm/physics.uoi.gr/home/cms/store/group | | T3_IT_Firenze | missing | | | | T3_IT_Napoli | missing | | | | T3_IT_Perugia | ok | dCache-production-1.9.3-3 | srm://gridse3.pg.infn.it:8443/srm/managerv2?SFN=/pnfs/pg.infn.it/data/cms/store/group | | T3_TW_NCU | ok | unreachable | srm://grid02.phy.ncu.edu.tw:8446/srm/managerv2?SFN=/dpm/phy.ncu.edu.tw/home/cms/store/group | | T3_UCLASaxon_Buffer | missing | | | | T3_UK_London_QMUL | ok | StoRM-<FE:1.4.0-01.sl4><BE:1.4.0-00> | srm://se03.esc.qmul.ac.uk:8444/srm/managerv2?SFN=/cms/store/group | | T3_UK_London_RHUL | ok | DPM-1.6.11-3 | srm://se2.ppgrid1.rhul.ac.uk:8446/srm/managerv2?SFN=/dpm/ppgrid1.rhul.ac.uk/home/cms/store/group | | T3_UK_London_UCL | ok | DPM-1.6.11-3 | srm://gw-3.ccc.ucl.ac.uk:8446/srm/managerv2?SFN=/dpm/ccc.ucl.ac.uk/home/cms/store/group | | T3_UK_ScotGrid_ECDF | ok | DPM-1.7.2-4 | srm://srm.glite.ecdf.ed.ac.uk:8446/srm/managerv2?SFN=/dpm/ecdf.ed.ac.uk/home/cms/store/group | | T3_UK_ScotGrid_GLA | ok | DPM-1.7.2-5 | srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/cms/store/group | | T3_UK_SGrid_Oxford | ok | DPM-1.7.2-4 | srm://t2se01.physics.ox.ac.uk:8446/srm/managerv2?SFN=/dpm/physics.ox.ac.uk/home/cms/store/group | | T3_UMiss_Buffer | missing | | | | T3_US_Colorado | ok | BeStMan-2.2.1.2.i7 | srm://hepse01.colorado.edu:8443/srm/v2/server?SFN=/bestman/storage/cms/store/group | | T3_US_Cornell | ok | BeStMan-2.2.1.2.e7 | srm://osg-se.cac.cornell.edu:8443/srm/v2/server?SFN=/xrootdfs/cms/store/group | | T3_US_FIT | ok | BeStMan-2.2.1.2.i7 | srm://uscms1-se.fltech-grid3.fit.edu:8443/srm/v2/server?SFN=/mnt/nas0/OSG/BeStMan/cms/store/group | | T3_US_FNALLPC | ok | dCache-production-1-9-2-4 | srm://cmssrm.fnal.gov:8443/srm/managerv2?SFN=/11/store/group | | T3_US_FNALXEN | ok | BeStMan-2.2.1.2.i7 | srm://cms-xen19.fnal.gov:8443/srm/v2/server?SFN=/data/se/store/group | | T3_US_FSU | missing | | | | T3_US_JHU | ok | unreachable | file:////export/d1/store/group | | T3_US_Kansas | missing | | | | T3_US_Minnesota | ok | unreachable | file:////data/whybee0/phedex/data/store/group | | T3_US_Omaha | ok | BeStMan-2.2.1.2.i5 | srm://ff-se.unl.edu:8443/srm/v2/server?SFN=/panfs/panasas/CMS/store/group | | T3_US_OSU | missing | | | | T3_US_Princeton | ok | unreachable | file:////mnt/cms/store/group | | T3_US_Princeton_ICSE | ok | unreachable | file:////tigress-hsm/zuranski/store/group | | T3_US_Rice | ok | unreachable | srm://osg-gate.rice.edu:8443/srm/v2/server?SFN=/data/cms/se/store/group | | T3_US_Rutgers | ok | unreachable | file:////cms/se/phedex/store/group | | T3_US_TTU | ok | unreachable | file:////mnt/hep/cms/buffer/store/group | | T3_US_UCD | ok | BeStMan-2.2.1.2.i7 | srm://se.tier3.ucdavis.edu:8443/srm/v2/server?SFN=/mnt/hadoop/store/group | | T3_US_UCR | ok | BeStMan-2.2.1.2.i5 | srm://charm.ucr.edu:10443/srm/v2/server?SFN=/data/bottom/cms/store/group | | T3_US_UIowa | missing | | | | T3_US_UMD | ok | BeStMan-2.2.1.2.i7 | srm://hepcms-0.umd.edu:8443/srm/v2/server?SFN=/data/se/store/group | | T3_US_UTENN | missing | | | | T3_US_Vanderbilt | ok | BeStMan-2.2.1.2.i7 | srm://se1.accre.vanderbilt.edu:6288/srm/v2/server?SFN=/store/group | | T3_UVA_Buffer | missing | | | | TV_LCG_Production | missing | | | | TX_LCGBO_Buffer | missing | | | | TX_TEST3_Buffer | missing | | | -- Main.DerekFeichtinger - 2009-09-23 ---------------- %ICON{arrowleft}% Go to [[CMSSiteLog18][previous page]] / [[CMSSiteLog20][next page]] of CMS site log %M%
Attachments
Attachments
Topic attachments
I
Attachment
History
Action
Size
Date
Who
Comment
sh
test-phedexds-sites.sh
r5
r4
r3
r2
r1
manage
3.6 K
2009-10-01 - 11:57
DerekFeichtinger
phedex data service site test
This topic: LCGTier2
>
WebHome
>
CMSInfoPages
>
CMSSiteLog
>
CMSSiteLog19
Topic revision: r7 - 2009-10-01 - DerekFeichtinger
Copyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki?
Send feedback