Tags:
tag this topic
create new tag
view all tags
<!-- keep this as a security measure: #uncomment if the subject should only be modifiable by the listed groups # * Set ALLOWTOPICCHANGE = Main.TWikiAdminGroup,Main.CMSAdminGroup # * Set ALLOWTOPICRENAME = Main.TWikiAdminGroup,Main.CMSAdminGroup #uncomment this if you want the page only be viewable by the listed groups # * Set ALLOWTOPICVIEW = Main.TWikiAdminGroup,Main.CMSAdminGroup,Main.CMSAdminReaderGroup --> ---++ *Introduction* The production is not based on crab, but on 1+3 scripts. It can be run either on the grid or on the T3 batch system. The output is (by default) stored to CSCS, and should be replicated manually to PSI. The production is divided into separate channels, e.g. Bs -> mu mu or Bs -> K mu nu. Each channel is produced in several runs. Different runs NEED different random seed initializations (else identical files are produced). The production is split into (1) gen+sim+digi step and (2) reco steps. The reco step is fast, the time-consuming part is (1). ---++ *Files* An example production setup was called [[http://cmssw.cvs.cern.ch/cgi-bin/cmssw.cgi/CMSSW/HeavyFlavorAnalysis/Bs2MuMu/test/Winter10/][Winter10]] * The `template' py files for the generation step are stored in [[http://cmssw.cvs.cern.ch/cgi-bin/cmssw.cgi/CMSSW/HeavyFlavorAnalysis/Bs2MuMu/test/Winter10/gen/][Winter10/gen]] and have the runnumber as part of the filename. * The `template' py files for the reco step are stored in [[http://cmssw.cvs.cern.ch/cgi-bin/cmssw.cgi/CMSSW/HeavyFlavorAnalysis/Bs2MuMu/test/Winter10/reco/][Winter10/reco]] and have the runnumber as part of the filename. * csh template scripts [[http://cmssw.cvs.cern.ch/cgi-bin/cmssw.cgi/CMSSW/HeavyFlavorAnalysis/Bs2MuMu/test/Winter10/gen.csh?view=markup][Winter10/gen.csh]] and [[http://cmssw.cvs.cern.ch/cgi-bin/cmssw.cgi/CMSSW/HeavyFlavorAnalysis/Bs2MuMu/test/Winter10/reco.csh?view=markup][Winter10/reco.csh]] are used to execute the job. * A PERL script [[http://cmssw.cvs.cern.ch/cgi-bin/cmssw.cgi/CMSSW/HeavyFlavorAnalysis/Bs2MuMu/perl/run?view=markup][run]] is used to submit the jobs. * Two PERL scripts [[http://cmssw.cvs.cern.ch/cgi-bin/cmssw.cgi/CMSSW/HeavyFlavorAnalysis/Bs2MuMu/perl/monGrid?view=markup][monGrid]] and [[http://cmssw.cvs.cern.ch/cgi-bin/cmssw.cgi/CMSSW/HeavyFlavorAnalysis/Bs2MuMu/perl/monSge?view=markup][monSge]] are used to submit the grid and batch jobs, respectively. * A PERL script 'replicate' (e.g. in ~ursl/perl/replicate) is used to 'replicate' the py files, replacing the (run)number in the filename and simultaneously inside the file. ---++ *Procedure* 1) create a working directory for the production (which does not go to CVS) <pre> cd Winter10 mkdir production cd production </pre> 2) run the gen step (assumes tcsh, probably) <pre> mkdir BsToMuMu cd BsToMuMu cp ../../gen/BsToMuMu_7TeV_GEN_SIM_DIGI_L1_DIGI2RAW_HLT_START-10000.py . replicate -f 10000 -l 10100 -p 10000 -t BsToMuMu_7TeV_GEN_SIM_DIGI_L1_DIGI2RAW_HLT_START-10000.py setenv MODE BsToKK && ../../../../run -c ../../gen.csh -r "STORAGE1 srm://storage01.lcg.cscs.ch:8443/srm/managerv2\?SFN=/pnfs/lcg.cscs.ch/cms/trivcat/store/user/ursl/production/Winter10/${MODE}" -t ~/grid/Winter07/grid-1.tar.gz -m batch ${MODE}_7TeV_GEN_SIM_DIGI_L1_DIGI2RAW_HLT_START-100??.py </pre> Note that the argument after -m can be 'grid' or 'batch' or 'local' or 'debug' (in which case nothing happens). 3) Wait a while and then check the progress <pre> monGrid -o </pre> If something went wrong, and you want to remove the job's broken output from the SE, use <pre> monGrid -o -r </pre> If only a specific job should be looked at, use <pre> monGrid -o -u https://wms218.cern.ch:9000/XeAJqYxM_Yysmx9N5Wve9g </pre> If you ran in batch, use <pre> monSge </pre> instead. All the monitoring scripts assume that the job information is in a file called jobs.list. 4) Do a careful job with bookkeeping which channel has progressed how far and how successful it was. 4) Run the reco step: <pre> setenv MODE BsToKK && run -c ../../reco.csh -r "STORAGE1 srm://storage01.lcg.cscs.ch:8443/srm/managerv2\?SFN=/pnfs/lcg.cscs.ch/cms/trivcat/store/user/ursl/production/Winter10/${MODE}%INFILE ${MODE}_7TeV_GEN_SIM_DIGI_L1_DIGI2RAW_HLT_START-XXXX.root" -t ~/grid/Winter07/grid-2.tar.gz -m grid ${MODE}_7TeV_RAW2DIGI_RECO_START-100??.py </pre> -- Main.UrsLangenegger - 2010-03-18
E
dit
|
A
ttach
|
Watch
|
P
rint version
|
H
istory
: r2
<
r1
|
B
acklinks
|
V
iew topic
|
Ra
w
edit
|
M
ore topic actions
Topic revision: r2 - 2010-03-18
-
UrsLangenegger
CmsTier3
Log In
CmsTier3 Web
Create New Topic
Index
Search
Changes
Notifications
Statistics
Preferences
User Pages
Main Page
Policies
Monitoring Storage Space
Monitoring Slurm Usage
Physics Groups
Steering Board Meetings
Admin Pages
AdminArea
Cluster Specs
Home
Site map
CmsTier3 web
LCGTier2 web
PhaseC web
Main web
Sandbox web
TWiki web
CmsTier3 Web
Create New Topic
Index
Search
Changes
Notifications
RSS Feed
Statistics
Preferences
P
P
P
View
Raw View
Print version
Find backlinks
History
More topic actions
Edit
Raw edit
Attach file or image
Edit topic preference settings
Set new parent
More topic actions
Account
Log In
E
dit
A
ttach
Copyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki?
Send feedback