CMSTier3Log5 < CmsTier3

Tags: view all tags

<!-- keep this as a security measure:
   #uncomment if the subject should only be modifiable by the listed groups 
   * Set ALLOWTOPICCHANGE = Main.TWikiAdminGroup,Main.CMSAdminGroup
   * Set ALLOWTOPICRENAME = Main.TWikiAdminGroup,Main.CMSAdminGroup
   #uncomment this if you want the page only be viewable by the listed groups
   # * Set ALLOWTOPICVIEW = Main.TWikiAdminGroup,Main.CMSAdminGroup
-->

%TOC%

%ICON{arrowleft}% Go to [[CMSTier3LogXX][previous page]] / [[CMSTier3LogXX][next page]] of Tier3 site log %M%

---+ 25. 02. 2009 Worker Node to Fileserver write throughput

We currently have three Thumpers active in dcache. T. Punz had a number of jobs running which showed some I/O wait when writing in parallel to the dCache. The max write throughput was around 300 MByte/s =~  2.5 Gbit/s, and generated by ca. 25 gridftp connections (we do not know the number of streams). The SE showed a symmetric load of 30 MByte/s read/write from the worker nodes plus 20-30 MByte/s read from the UI (dcap, ca. 4 processes).

6 worker nodes wrote with ca. 40 MByte/s =~ 335 Mbit/s, 2 with ca. 25 MByte/s. All showed some I/O wait over the period of the intensive writing, and little CPU usage. Based on the load graphs for the machines, it seems that each machine ran 6 to 8 of these jobs.


-- Main.DerekFeichtinger - 25 Feb 2009

----------------

%ICON{arrowleft}% Go to [[CMSTier3LogXX][previous page]] / [[CMSTier3LogXX][next page]] of Tier3 site log %M%
 * wn-load-day-2009020935.png: <br />
   <img src="%ATTACHURLPATH%/wn-load-day-2009020935.png" alt="wn-load-day-2009020935.png" width='397' height='182' />

 * wn-cpu-day-2009020935.png: <br />
   <img src="%ATTACHURLPATH%/wn-cpu-day-2009020935.png" alt="wn-cpu-day-2009020935.png" width='397' height='182' />

 * wn_netw-day-2009020935.png: <br />
   <img src="%ATTACHURLPATH%/wn_netw-day-2009020935.png" alt="wn_netw-day-2009020935.png" width='397' height='182' />

 * fs-netw-day-2009020935.png: <br />
   <img src="%ATTACHURLPATH%/fs-netw-day-2009020935.png" alt="fs-netw-day-2009020935.png" width='397' height='182' />

 * wan-movers-day-2009020935.png: <br />
   <img src="%ATTACHURLPATH%/wan-movers-day-2009020935.png" alt="wan-movers-day-2009020935.png" width='381' height='154' />

 * se-netw.day-20090225.png: <br />
   <img src="%ATTACHURLPATH%/se-netw.day-20090225.png" alt="se-netw.day-20090225.png" width='397' height='182' />


---+ 13. 05. 2009 !PhEDEx download throughput example

<pre>
Error message statistics per site:
===================================

 *** ERRORS from T1_DE_FZK_Buffer:***
      1   copy did not complete or status unknown

 *** ERRORS from T2_CH_CSCS:***
      2   copy of [srm-URL] into [srm-URL] failed, status = SRM_FAILURE explanation=FAILED: at [date] state Failed : retrieval of "from" TURL failed with error java.lang.ArrayIndexOutOfBoundsException: 2

SITE STATISTICS:
==================
                         first entry: 2009-05-12 19:45:03      last entry: 2009-05-13 07:20:29
    T1_DE_FZK_Buffer (OK: 105  Err:   1  Exp:   0  Canc:   0  Lost:   0)   succ.: 99.1 %   total:  133.8 GB  ( 3.2 MB/s)
          T2_CH_CSCS (OK: 830  Err:   2  Exp:   0  Canc:   0  Lost:   0)   succ.: 99.8 %   total: 1992.9 GB  (47.8 MB/s)

TOTAL SUMMARY:
==================
                         first entry: 2009-05-12 19:45:03      last entry: 2009-05-13 07:20:29
total transferred: 1980.7 GB  in 11.6 hours
avg. total rate: 48.6 MB/s = 388.9 Mb/s  = 4101.3 GB/day
</pre>

Attachments

Topic attachments
I	Attachment	History	Action	Size	Date	Who
png	fs-netw-day-2009020935.png	r1	manage	17.5 K	2009-02-25 - 10:46	DerekFeichtinger
png	se-netw.day-20090225.png	r1	manage	15.8 K	2009-02-25 - 10:56	DerekFeichtinger
png	wan-movers-day-2009020935.png	r1	manage	10.6 K	2009-02-25 - 10:46	DerekFeichtinger
png	wn-cpu-day-2009020935.png	r1	manage	13.8 K	2009-02-25 - 10:45	DerekFeichtinger
png	wn-load-day-2009020935.png	r1	manage	16.6 K	2009-02-25 - 10:45	DerekFeichtinger
png	wn_netw-day-2009020935.png	r1	manage	13.9 K	2009-02-25 - 10:45	DerekFeichtinger

Topic revision: r2 - 2009-05-13 - DerekFeichtinger

CmsTier3

User Pages
Main Page
Policies

Physics Groups
Steering Board Meetings

Admin Pages
AdminArea
Cluster Specs