CRAB+SGE Toubleshooting
CARB crashed when querying status of glite jobs
When I was trying to get the status of glite jobs from CRAB, I got following error:
[chen_z@t3ui01 testnow]$ crab -status
crab. crab (version 2.3.1) running on Fri Oct 24 10:59:04 2008
crab. Working options:
scheduler glite
job type CMSSW
working directory /shome/chen_z/tests/cmssw2/cmssw_test/CMSSW_2_1_6/src/demo/DemoAnalyzer/test/crab_0_081024_104340/
crab. Checking the status of all jobs: please wait
Traceback (most recent call last):
File "/swshare/CRAB/CRAB_2_3_1/python/crab.py", line 782, in ?
crab.run()
File "/swshare/CRAB/CRAB_2_3_1/python/crab.py", line 741, in run
if act in self.actions.keys(): self.actions[act].run()
File "/swshare/CRAB/CRAB_2_3_1/python/Status.py", line 21, in run
self.query()
File "/swshare/CRAB/CRAB_2_3_1/python/Status.py", line 34, in query
upTask = common.scheduler.queryEverything(task['id'])
File "/swshare/CRAB/CRAB_2_3_1/python/Scheduler.py", line 129, in queryEverything
return self.boss().queryEverything(taskid)
File "/swshare/CRAB/CRAB_2_3_1/python/Boss.py", line 139, in queryEverything
statusRes = self.schedSession().query( str(taskid))
File "/swshare/CRAB/CRAB_2_3_1/external/ProdCommon/BossLite/API/BossLiteAPISched.py", line 147, in query
self.scheduler.query( task, queryType )
File "/swshare/CRAB/CRAB_2_3_1/external/ProdCommon/BossLite/Scheduler/Scheduler.py", line 181, in query
'node' )
File "/swshare/CRAB/CRAB_2_3_1/external/ProdCommon/BossLite/Scheduler/SchedulerGLiteAPI.py", line 1040, in query
from ProdCommon.BossLite.Scheduler.GLiteLBQuery import \
File "/swshare/CRAB/CRAB_2_3_1/external/ProdCommon/BossLite/Scheduler/GLiteLBQuery.py", line 13, in ?
from glite_wmsui_LbWrapper import Status
File "/opt/glite/lib/python/glite_wmsui_LbWrapper.py", line 5, in ?
import _glite_wmsui_LbWrapper
ImportError: No module named _glite_wmsui_LbWrapper
crab. Log-file is /shome/chen_z/tests/cmssw2/cmssw_test/CMSSW_2_1_6/src/demo/DemoAnalyzer/test/crab_0_081024_104340/log/crab.log
[chen_z@t3ui01 testnow]$ echo :${GLITE_LOCATION}
:/opt/glite
[chen_z@t3ui01 lib]$ pwd
/opt/glite/lib
[chen_z@t3ui01 lib]$ nm _glite_wmsui_LbWrapper.so | grep glite_wmsui_LbWrapper
0000000000007390 T init_glite_wmsui_LbWrapper
0000000000026d38 b _ZZ26init_glite_wmsui_LbWrapperE12SWIG_globals
0000000000026d3c b _ZZ26init_glite_wmsui_LbWrapperE8typeinit
Apparently default value of PYTHONPATH does not allow to use the gLite LB python libraries. After
$ export PYTHONPATH=${PYTHONPATH}:${GLITE_LOCATION}/lib
The error disappears. Now carb -status for glite jobs works fine.
I goggled this problem. Found the link:https://savannah.cern.ch/bugs/?34694
So a fix in YAIM is probably needed.
Now I corrected the PATH as a (temporary?) solution:
Add:
gridpath_append "PYTHONPATH" "/opt/glite/lib"
in /etc/profile.d/grid-env.sh
--
ZhilingChen - 24 Oct 2008