Tags:
create new tag
view all tags

Arrow left Go to previous page / next page of CMS site log MOVED TO...

20. 09. 2010 High throughput (~200 MB/s) sustained for ~24h from various sites

  • quantity_rates.png:
    quantity_rates.png

  • quality_all.png:
    quality_all.png

Sep 20 13:45 [phedex@cmsvobox:~]$ /home/phedex/PHEDEX/Utilities/InspectPhedexLog -c 300 -es "-3 days" download.1 download.2 
given starttime 2010-09-17 11:46:10
given endtime 2010-09-20 11:46:10


==============
ERROR ANALYSIS
==============


Data base Errors
==================


Expired tasks
==================
Total: 191


Error message statistics per site:
===================================

 *** ERRORS from T2_ES_IFCA:***
    200   SOURCE error during TRANSFER_PREPARATION phase: [CONNECTION_ERROR] failed to contact on remote SRM [httpg://storm.ifca.es:8444/srm/managerv2]. Givin' up after 3 tries
    189   transfer expired in the PhEDEx download agent queue after [hours] h
      9   SOURCE error during TRANSFER phase: [TRANSFER_TIMEOUT] globus_ftp_client_size: Connection timed out
      5   SOURCE error during TRANSFER_PREPARATION phase: [HTTP_TIMEOUT] service timeout during [srm2__srmPrepareToGet]
      5   SOURCE error during TRANSFER_PREPARATION phase: [INVALID_PATH] Requested file is still in SRM_SPACE_AVAILABLE state!
      4   SOURCE error during TRANSFER_PREPARATION phase: [USER_ERROR] source file doesn't exist
      3   SOURCE error during TRANSFER_PREPARATION phase: [GENERAL_FAILURE] source file failed on the SRM with error [SRM_ABORTED]
      2   SOURCE error during TRANSFER_PREPARATION phase: [GENERAL_FAILURE] srmPrepareToGet chunk is being processed!
      1   SOURCE error during TRANSFER_PREPARATION phase: [REQUEST_TIMEOUT] Request timeout (internal error or too long processing), request aborted

 *** ERRORS from T2_DE_RWTH:***
      2   transfer expired in the PhEDEx download agent queue after [hours] h
      1   TRANSFER error during TRANSFER phase: [GRIDFTP_ERROR] globus_xio: System error in read: Connection reset by peer globus_xio: A system call failed: Connection reset by peer

 *** ERRORS from T2_US_Nebraska:***
     20   TRANSFER error during TRANSFER phase: [GRIDFTP_ERROR] an end-of-file was reached globus_xio: An end of file occurred (possibly the destination disk is full)
      4   SOURCE error during TRANSFER_PREPARATION phase: [HTTP_TIMEOUT] failed to contact on remote SRM [httpg://dcache07.unl.edu:8443/srm/v2/server]. Givin' up after 3 tries

 *** ERRORS from T2_FR_GRIF_LLR:***
     51   SOURCE error during TRANSFER_PREPARATION phase: [CONNECTION_ERROR] failed to contact on remote SRM [httpg://polgrid4.in2p3.fr:8446/srm/managerv2]. Givin' up after 3 tries

 *** ERRORS from T2_US_UCSD:***
      8   SOURCE error during TRANSFER phase: [GRIDFTP_ERROR] globus_ftp_client: the server responded with an error 530 530-Login incorrect. : globus_gss_assist: Error invoking callout 530-globus_callout_module: The callout returned an error 530-globus_gridmap_callout_error: Gridmap lookup failure: Identity M...(error cut)

 *** ERRORS from T1_UK_RAL_Buffer:***
      2   SOURCE error during TRANSFER_PREPARATION phase: [GENERAL_FAILURE] source file failed on the SRM with error [SRM_FAILURE]

SITE STATISTICS:
==================
                         first entry: 2010-09-17 11:46:16      last entry: 2010-09-18 22:05:03
   T1_IT_CNAF_Buffer (OK: 263  Err:   0  Exp:   0  Canc:   0  Lost:   0)   succ.: 100.0 %   total: 1605.9 GB  (13.0 MB/s)
    T1_UK_RAL_Buffer (OK: 278  Err:   2  Exp:   0  Canc:   0  Lost:   0)   succ.: 99.3 %   total: 1732.4 GB  (14.0 MB/s)
   T1_US_FNAL_Buffer (OK: 337  Err:   0  Exp:   0  Canc:   0  Lost:   0)   succ.: 100.0 %   total: 2115.4 GB  (17.1 MB/s)
       T2_CN_Beijing (OK: 215  Err:   0  Exp:   0  Canc:   0  Lost:   0)   succ.: 100.0 %   total: 1081.5 GB  ( 8.8 MB/s)
          T2_DE_RWTH (OK: 886  Err:   1  Exp:   2  Canc:   0  Lost:   0)   succ.: 99.9 %   total: 5468.9 GB  (44.3 MB/s)
          T2_ES_IFCA (OK: 665  Err: 229  Exp: 189  Canc:   0  Lost:   0)   succ.: 74.4 %   total: 4029.5 GB  (32.6 MB/s)
      T2_FR_GRIF_LLR (OK:  40  Err:  51  Exp:   0  Canc:   0  Lost:   0)   succ.: 44.0 %   total:  230.1 GB  ( 1.9 MB/s)
          T2_IT_Bari (OK:   1  Err:   0  Exp:   0  Canc:   0  Lost:   0)   succ.: 100.0 %   total:    0.0 GB  ( 0.0 MB/s)
     T2_UK_London_IC (OK: 149  Err:   0  Exp:   0  Canc:   0  Lost:   0)   succ.: 100.0 %   total:  866.4 GB  ( 7.0 MB/s)
       T2_US_Caltech (OK:   9  Err:   0  Exp:   0  Canc:   0  Lost:   0)   succ.: 100.0 %   total:    0.1 GB  ( 0.0 MB/s)
           T2_US_MIT (OK:  21  Err:   0  Exp:   0  Canc:   0  Lost:   0)   succ.: 100.0 %   total:    1.6 GB  ( 0.0 MB/s)
      T2_US_Nebraska (OK:  87  Err:  24  Exp:   0  Canc:   0  Lost:   0)   succ.: 78.4 %   total:  434.0 GB  ( 3.5 MB/s)
          T2_US_UCSD (OK: 155  Err:   8  Exp:   0  Canc:   0  Lost:   0)   succ.: 95.1 %   total:  893.9 GB  ( 7.2 MB/s)
     T2_US_Wisconsin (OK:   2  Err:   0  Exp:   0  Canc:   0  Lost:   0)   succ.: 100.0 %   total:    0.0 GB  ( 0.0 MB/s)

TOTAL SUMMARY:
==================
                         first entry: 2010-09-17 11:46:16      last entry: 2010-09-18 22:05:03
total transferred: 17191.8 GB  in 34.3 hours
avg. total rate: 142.5 MB/s = 1140.1 Mb/s  = 12024.7 GB/day

-- LeonardoSala - 2010-09-20


Arrow left Go to previous page / next page of CMS site log MOVED TO...

Topic attachments
I Attachment History Action Size Date Who Comment
PNGpng quality_all.png r1 manage 50.3 K 2010-09-20 - 11:34 LeonardoSala  
PNGpng quantity_rates.png r1 manage 48.5 K 2010-09-20 - 11:33 LeonardoSala  
Topic revision: r1 - 2010-09-20 - LeonardoSala
 
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback