Tags:
tag this topic
create new tag
view all tags
<!-- keep this as a security measure: * Set ALLOWTOPICCHANGE = Main.TWikiAdminGroup,Main.LCGAdminGroup * Set ALLOWTOPICRENAME = Main.TWikiAdminGroup,Main.LCGAdminGroup #uncomment this if you want the page only be viewable by the internal people #* Set ALLOWTOPICVIEW = Main.TWikiAdminGroup,Main.LCGAdminGroup --> %TOC% %ICON{arrowleft}% Go to [[CMSSiteLog10][previous page]] / [[CMSSiteLog12][next page]] of CMS site log %M% ---+ CCRC08 ---++ General impression Most of CCRC08 went quite well for T2_CH_CSCS. No major technical problems were observed with the exception of the first week of June, where a middle ware update caused many jobs to abort. CSCS serves three experiments: ATLAS, CMS and LHCb. For most of this month only CMS significantly exercised the system. This is particularly valid in respect to the storage where only the CMS jobs used access by *dcap* protocol. The total generated load was not enough to really stress our ressources and the usage patterns are surely not representative of what we will see in a few months. ---+++ Jobs Running jobs per experiment: <br /> <img src="%ATTACHURLPATH%/running-month.gif" alt="running-month.gif" width='481' height='179' /> Job quality was rather good over the period of May: <img src="%ATTACHURLPATH%/Dashboard-activity-May.jpg" alt="Dashboard-activity-May.jpg" width='1063' height='457' /> <img src="%ATTACHURLPATH%/Dashboard-users-May1.jpg" alt="Dashboard-users-May1.jpg" width='1051' height='501' /> Overview over the used datasets: <img src="%ATTACHURLPATH%/Dashboard-datasets-May.jpg" alt="Dashboard-datasets-May.jpg" width='1043' height='367' /> During the first week of June the middleware update caused a lot of problems: <img src="%ATTACHURLPATH%/Dashboard-activity-June.jpg" alt="Dashboard-activity-June.jpg" width='1045' height='367' /> ---+++ !PhEDEx !PhEDEx downloads were of much better quality than in the months before (probably due to everybody being much more attentive), but the system was under much lower stress due to the turning off of the Debug instance's !LoadTest transfers. This is reflected in the plots below being mostly empty. <img src="%ATTACHURLPATH%/storage_free_cms.jpg" alt="storage_free_cms.jpg" width='397' height='154' /> <img src="%ATTACHURLPATH%/fileservers-IO.jpg" alt="fileservers-IO.jpg" width='397' height='154' /> !PhEDEx Transfer Quality: <br /> <img src="%ATTACHURLPATH%/PhEDExTransferQualityPerSite.jpg" alt="PhEDExTransferQualityPerSite.jpg" width='833' height='483' /> !PhEDEx Transfer Rate: <br /> <img src="%ATTACHURLPATH%/PhEDExTransferRatePerSite.jpg" alt="PhEDExTransferRatePerSite.jpg" width='807' height='509' /> !PhEDEx Transfer Volume: <br /> <img src="%ATTACHURLPATH%/PhEDExTransferVolumePerSite.jpg" alt="PhEDExTransferVolumePerSite.jpg" width='815' height='499' /> ---++ 2. 6. - 5. 6. 2008 Analysis Latency Tests Exercises consist of subscribing to a data set and running a sample analysis job with CRAB over all its files. Monday and Tuesday CSCS had a number of problems due to a middleware upgrade of the CE and nodes which despite expectations caused a lot of jobs to abort. But I was able to download a dataset from PIC at a speed of ~90MB/s. Tuesday evening and night was ok, but allowing only one cycle for the following data set: Dataset name: =/Njet_5j_400_5600-alpgen/CMSSW_1_6_7-CSA07-1206675842/RECO from T1_PIC= | Time | Time delta | Comment | | 15:00 | *0* | Dataset subscription approved | | 15:25 | 0:25 | download beginning | | 20:45 | 5:45 | dataset completely on site (280880 Events, 281 Files from T1_ES_PIC, *1.4TB*, 0 Errors, *avg. 69.1 MB/s*) | | 21:40 | 6:40 | DBS still only shows 41 files at CSCS | | 21:43 | *6:43* | DBS shows whole dataset to be on site | | 21:45 | *6:45* | crab -submit | | 21:49 | 6:49 | all 29 Jobs running at T2_CH_CSCS | | 04:34 | *13:34* | last job finished (no Errors) | Wednesday was again bad luck, when FZK's network had severe problems, causing all transfers for =/WW_incl/CMSSW_1_6_7-CSA07-1196178448/RECO= to fail. FZK recovered sometime in the afternoon, but the CSCS !PhEDEx download agent got stuck because of blocking of a =glite-transfer-query= and a =glite-transfer-submit= request, which I only noticed on Thursday morning. !PhEDEx transfers from FZK began to trickle in by 13:30h, but the cluster is now completely filled with user jobs, which will add considerable latency to the eventual CRAB run. %ICON{arrowleft}% Go to [[CMSSiteLog10][previous page]] / [[CMSSiteLog12][next page]] of CMS site log %M% -- Main.DerekFeichtinger - 04 Jun 2008
Attachments
Attachments
Topic attachments
I
Attachment
History
Action
Size
Date
Who
Comment
jpg
Dashboard-activity-June.jpg
r1
manage
47.9 K
2008-06-05 - 19:49
DerekFeichtinger
jpg
Dashboard-activity-May.jpg
r1
manage
56.2 K
2008-06-05 - 19:48
DerekFeichtinger
jpg
Dashboard-datasets-May.jpg
r1
manage
56.0 K
2008-06-05 - 19:49
DerekFeichtinger
jpg
Dashboard-users-May1.jpg
r1
manage
82.7 K
2008-06-05 - 19:49
DerekFeichtinger
jpg
fileservers-IO.jpg
r1
manage
19.9 K
2008-06-05 - 20:08
DerekFeichtinger
jpg
PhEDExTransferQuality.jpg
r1
manage
48.2 K
2008-06-05 - 19:47
DerekFeichtinger
jpg
PhEDExTransferQualityPerSite.jpg
r1
manage
52.9 K
2008-06-05 - 19:58
DerekFeichtinger
jpg
PhEDExTransferRate.jpg
r1
manage
54.9 K
2008-06-05 - 19:47
DerekFeichtinger
jpg
PhEDExTransferRatePerSite.jpg
r1
manage
63.7 K
2008-06-05 - 19:58
DerekFeichtinger
jpg
PhEDExTransferVolume.jpg
r1
manage
55.6 K
2008-06-05 - 19:48
DerekFeichtinger
jpg
PhEDExTransferVolumePerSite.jpg
r1
manage
57.8 K
2008-06-05 - 19:58
DerekFeichtinger
gif
running-month.gif
r1
manage
12.4 K
2008-06-05 - 20:07
DerekFeichtinger
jpg
storage_free_cms.jpg
r1
manage
11.1 K
2008-06-05 - 20:07
DerekFeichtinger
E
dit
|
A
ttach
|
Watch
|
P
rint version
|
H
istory
: r7
<
r6
<
r5
<
r4
<
r3
|
B
acklinks
|
V
iew topic
|
Ra
w
edit
|
M
ore topic actions
Topic revision: r7 - 2008-06-07
-
DerekFeichtinger
LCGTier2
Log In
(Topic)
LCGTier2 Web
Create New Topic
Index
Search
Changes
Notifications
Statistics
Preferences
Users
Entry point / Contact
RoadMap
ATLAS Pages
CMS Pages
CMS User Howto
CHIPP CB
Outreach
Technical
Cluster details
Services
Hardware and OS
Tools & Tips
Monitoring
Logs
Maintenances
Meetings
Tests
Issues
Blog
Home
Site map
CmsTier3 web
LCGTier2 web
PhaseC web
Main web
Sandbox web
TWiki web
LCGTier2 Web
Users
Groups
Index
Search
Changes
Notifications
RSS Feed
Statistics
Preferences
P
P
View
Raw View
Print version
Find backlinks
History
More topic actions
Edit
Raw edit
Attach file or image
Edit topic preference settings
Set new parent
More topic actions
Warning: Can't find topic "".""
Account
Log In
E
dit
A
ttach
Copyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki?
Send feedback