CRAB+SGE Toubleshooting

CARB crashed when querying status of glite jobs

When I was trying to get the status of glite jobs from CRAB, I got following error:

[chen_z@t3ui01 testnow]$ crab -status
crab. crab (version 2.3.1) running on Fri Oct 24 10:59:04 2008

crab. Working options:
  scheduler           glite
  job type            CMSSW
  working directory   /shome/chen_z/tests/cmssw2/cmssw_test/CMSSW_2_1_6/src/demo/DemoAnalyzer/test/crab_0_081024_104340/

crab. Checking the status of all jobs: please wait
Traceback (most recent call last):
  File "/swshare/CRAB/CRAB_2_3_1/python/crab.py", line 782, in ?
    crab.run()
  File "/swshare/CRAB/CRAB_2_3_1/python/crab.py", line 741, in run
    if act in self.actions.keys(): self.actions[act].run()
  File "/swshare/CRAB/CRAB_2_3_1/python/Status.py", line 21, in run
    self.query()
  File "/swshare/CRAB/CRAB_2_3_1/python/Status.py", line 34, in query
    upTask = common.scheduler.queryEverything(task['id'])
  File "/swshare/CRAB/CRAB_2_3_1/python/Scheduler.py", line 129, in queryEverything
    return self.boss().queryEverything(taskid)
  File "/swshare/CRAB/CRAB_2_3_1/python/Boss.py", line 139, in queryEverything
    statusRes =  self.schedSession().query( str(taskid))
  File "/swshare/CRAB/CRAB_2_3_1/external/ProdCommon/BossLite/API/BossLiteAPISched.py", line 147, in query
    self.scheduler.query( task, queryType )
  File "/swshare/CRAB/CRAB_2_3_1/external/ProdCommon/BossLite/Scheduler/Scheduler.py", line 181, in query
    'node' )
  File "/swshare/CRAB/CRAB_2_3_1/external/ProdCommon/BossLite/Scheduler/SchedulerGLiteAPI.py", line 1040, in query
    from ProdCommon.BossLite.Scheduler.GLiteLBQuery import \
  File "/swshare/CRAB/CRAB_2_3_1/external/ProdCommon/BossLite/Scheduler/GLiteLBQuery.py", line 13, in ?
    from glite_wmsui_LbWrapper import Status
  File "/opt/glite/lib/python/glite_wmsui_LbWrapper.py", line 5, in ?
    import _glite_wmsui_LbWrapper
ImportError: No module named _glite_wmsui_LbWrapper
crab. Log-file is /shome/chen_z/tests/cmssw2/cmssw_test/CMSSW_2_1_6/src/demo/DemoAnalyzer/test/crab_0_081024_104340/log/crab.log

[chen_z@t3ui01 testnow]$ echo :${GLITE_LOCATION}
:/opt/glite

[chen_z@t3ui01 lib]$ pwd
/opt/glite/lib
[chen_z@t3ui01 lib]$ nm _glite_wmsui_LbWrapper.so | grep glite_wmsui_LbWrapper
0000000000007390 T init_glite_wmsui_LbWrapper
0000000000026d38 b _ZZ26init_glite_wmsui_LbWrapperE12SWIG_globals
0000000000026d3c b _ZZ26init_glite_wmsui_LbWrapperE8typeinit

Apparently default value of PYTHONPATH does not allow to use the gLite LB python libraries. After

$ export PYTHONPATH=${PYTHONPATH}:${GLITE_LOCATION}/lib

The error disappears. Now carb -status for glite jobs works fine.

I goggled this problem. Found the link:https://savannah.cern.ch/bugs/?34694 So a fix in YAIM is probably needed.

Now I corrected the PATH as a (temporary?) solution: Add:

gridpath_append      "PYTHONPATH" "/opt/glite/lib"

-- ZhilingChen - 24 Oct 2008