Tags:
tag this topic
create new tag
view all tags
<!-- keep this as a security measure: #uncomment if the subject should only be modifiable by the listed groups # * Set ALLOWTOPICCHANGE = Main.TWikiAdminGroup,Main.CMSAdminGroup # * Set ALLOWTOPICRENAME = Main.TWikiAdminGroup,Main.CMSAdminGroup #uncomment this if you want the page only be viewable by the listed groups # * Set ALLOWTOPICVIEW = Main.TWikiAdminGroup,Main.CMSAdminGroup --> ---+ Test simple CMSSW batch submission on local files/SE ---+++ Using CMSSW * The CMS software environment is set up with: <pre>source /swshare/cms/cmsset_default.sh</pre> * prepare to run CMSSW <pre>cd CMSSW_Version/src; eval `scramv1 runtime -(c)sh`</pre> or <pre>cmsenv</pre> ---+++ Run CMSSW interactively on a file stored on t3se01.psi.ch * To run CMSSW interactively on a file stored on the t3se01.psi.ch, modify the "PoolSource" parameters in the CMSSW config file as follows <pre> source = PoolSource { untracked vstring fileNames = { 'dcap://t3se01.psi.ch:22125/pnfs/psi.ch/cms/catalog/store/user/.../yourfile' } untracked int32 maxEvents = 10 } </pre> ---+++ SGE batch job script * For SGE, Batch jobs are shell scripts. Job submission is telling SGE to execute a shell script. You normally start your program from within that script. You don't need to create old-school job description files since you can talk with SGE from within the job script in case you need. Lines starting with #$ are interpreted by SGE. Below is a sample job script for submitting CMSSW job to SGE: <pre> #!/bin/bash # #$ -cwd #$ -j y #$ -S /bin/bash # date hostname pwd source /swshare/cms/cmsset_default.sh eval `scramv1 runtime -sh` cmsRun yourCMSSWconfig.cfg </pre> Submit it with command <pre>qsub test.job</pre>. In the job script, the lines starting with a #$ are SGE commands. Above, -cwd tells sge to cd to the directory job has been submitted when it starts: running(e.g. your cmssw project directory), "-j y" is to transfer the current environment variable state to the shell starting the job and -S tells which shell to dispatch the job with. ---+++ Demo on Submitting CMSSW jobs to SGE Change to your <pre>src</pre> directory: <pre> mkdir demo cd Demo mkedanlzr DemoAnalyzer </pre> Compile the code: <pre> cd DemoAnalyzer scramv1 b </pre> The mkedanlzr script has generated an example configuration file demoanalyzer.cfg in the DemoAnalyzer directory. Edit this file to change the data source file myfile.root to an event sample file containing muons and add a parameter limiting the number of events which located in local filesystem(using "file:myfile.root" or our SE(using "dcap://t3se01.psi.ch:22125/pnfs/psi.ch/cms/catalog/store/....". Now the configuration file should read like that. <pre> import FWCore.ParameterSet.Config as cms process = cms.Process("Demo") process.load("FWCore.MessageService.MessageLogger_cfi") process.maxEvents = cms.untracked.PSet( input = cms.untracked.int32(-1) ) process.source = cms.Source("PoolSource", # replace 'myfile.root' with the source file you want to use fileNames = cms.untracked.vstring( 'dcap://t3se01.psi.ch:22125/pnfs/psi.ch/cms/catalog/store/user/zlchen/test.root' ) ) process.demo = cms.EDAnalyzer('DemoAnalyzer' ) process.p = cms.Path(process.demo) </pre> Create a job script"demoCMSSW.job" with following lines: <pre> #!/bin/bash # #$ -cwd #$ -j y #$ -S /bin/bash # date hostname pwd source /swshare/cms/cmsset_default.sh eval `scramv1 runtime -sh` cmsRun demoanalyzer_cfg.py </pre> Submit job to SGE: <pre> $ qsub demoCMSSW.job Your job 24 ("demoCMSSW.job") has been submitted $ qstat -g c CLUSTER QUEUE CQLOAD USED AVAIL TOTAL aoACDS cdsuE ------------------------------------------------------------------------------- all.q 0.00 1 31 56 0 24 ...... $ qstat -g c CLUSTER QUEUE CQLOAD USED AVAIL TOTAL aoACDS cdsuE ------------------------------------------------------------------------------- all.q 0.00 0 32 56 0 24 </pre> The output of job script and your CMSSW program is in demoCMSSW.job.o24 -- Main.ZhilingChen - 04 Sep 2008
E
dit
|
A
ttach
|
Watch
|
P
rint version
|
H
istory
: r5
<
r4
<
r3
<
r2
<
r1
|
B
acklinks
|
V
iew topic
|
Ra
w
edit
|
M
ore topic actions
Topic revision: r5 - 2008-09-11
-
ZhilingChen
CmsTier3
Log In
CmsTier3 Web
Create New Topic
Index
Search
Changes
Notifications
Statistics
Preferences
User Pages
Main Page
Policies
Monitoring Storage Space
Monitoring Slurm Usage
Physics Groups
Steering Board Meetings
Admin Pages
AdminArea
Cluster Specs
Home
Site map
CmsTier3 web
LCGTier2 web
PhaseC web
Main web
Sandbox web
TWiki web
CmsTier3 Web
Create New Topic
Index
Search
Changes
Notifications
RSS Feed
Statistics
Preferences
P
View
Raw View
Print version
Find backlinks
History
More topic actions
Edit
Raw edit
Attach file or image
Edit topic preference settings
Set new parent
More topic actions
Account
Log In
E
dit
A
ttach
Copyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki?
Send feedback