Throughput Tests with ASGC

These throughput tests were done with Jason Shih, Chia Ming Kuo and Aries Hung.

April 30th 2007

Route, RTT and packet loss

traceroute to 140.109.98.111 (140.109.98.111), 30 hops max, 38 byte packets
 1  148.187.33.2 (148.187.33.2)  2.133 ms  4.339 ms  0.425 ms
 2  148.187.32.4 (148.187.32.4)  0.227 ms  0.394 ms  0.203 ms
 3  swima2.cscs.ch (148.187.20.2)  0.488 ms  0.449 ms  0.369 ms
 4  swiEL2-10GE-1-4.switch.ch (130.59.37.77)  3.118 ms  3.230 ms  3.115 ms
 5  swiCE3-10GE-1-3.switch.ch (130.59.37.65)  3.865 ms  3.979 ms  3.991 ms
 6  swiCE2-10GE-1-4.switch.ch (130.59.36.209)  5.239 ms  20.762 ms  4.167 ms
 7  switch.rt1.gen.ch.geant2.net (62.40.124.21)  4.112 ms  4.088 ms  3.992 ms
 8  so-7-2-0.rt1.fra.de.geant2.net (62.40.112.22)  12.109 ms  12.217 ms  12.112 ms
 9  abilene-wash-gw.rt1.fra.de.geant2.net (62.40.125.18)  104.424 ms  104.787 ms  104.924 ms
10  ge-1-0-0.418.rtr.chic.net.internet2.edu (64.57.28.10)  112.168 ms  108.534 ms  106.558 ms
11  * s4-ge-peer1.manlan-abilene.twaren.net (211.79.48.157)  126.927 ms  127.001 ms
12  s4-ge-chti-ir3.tpc-chi.twaren.net (211.79.48.189)  317.155 ms  317.146 ms  317.290 ms
13  ascc-76-v20.twaren.net (211.79.60.97)  317.797 ms  317.881 ms  317.788 ms
14  202.169.174.90 (202.169.174.90)  315.784 ms  315.901 ms  315.788 ms
15  202.169.174.50 (202.169.174.50)  315.787 ms  315.781 ms  315.903 ms
16  202.169.174.29 (202.169.174.29)  315.912 ms  315.927 ms  315.951 ms
17  202.169.175.101 (202.169.175.101)  317.450 ms  316.449 ms  316.430 ms
18  140.109.98.111 (140.109.98.111)  315.950 ms !<10>  315.709 ms !<10>  315.785 ms !<10>


--- 140.109.98.111 ping statistics ---
20 packets transmitted, 19 received, 5% packet loss, time 19177ms
rtt min/avg/max/mdev = 315.619/315.828/316.150/0.386 ms, pipe 2

I was only able to observe this packet loss in one of the ping runs.

A mtr run showed the following

HOST                                    LOSS  RCVD SENT    BEST     AVG   WORST
148.187.33.2                              0%    30   30    0.36    0.52    1.64
148.187.32.4                              0%    30   30    0.12    0.23    0.52
swima2.cscs.ch                            7%    28   30    0.36    4.14  103.37
swiEL2-10GE-1-4.switch.ch                 0%    30   30    3.11    3.27    3.50
swiCE3-10GE-1-3.switch.ch                 0%    30   30    3.86    9.12   82.84
swiCE2-10GE-1-4.switch.ch                 0%    30   30    3.99    5.28   39.01
switch.rt1.gen.ch.geant2.net              0%    30   30    3.99    4.25    9.21
so-7-2-0.rt1.fra.de.geant2.net            0%    30   30   12.09   12.90   32.72
abilene-wash-gw.rt1.fra.de.geant2.net     0%    30   30  104.35  107.07  120.82
ge-1-0-0.418.rtr.chic.net.internet2.edu   0%    30   30  106.20  107.59  115.95
s4-ge-peer1.manlan-abilene.twaren.net     0%    30   30  126.78  133.63  283.48
s4-ge-chti-ir3.tpc-chi.twaren.net         0%    30   30  317.07  317.26  317.63
ascc-76-v20.twaren.net                    0%    30   30  317.72  318.01  321.91
202.169.174.90                            4%    29   30  315.68  315.84  316.57
202.169.174.50                           10%    27   30  315.73  319.90  369.34
202.169.174.29                            4%    29   30  315.74  317.45  361.22
202.169.175.101                           4%    29   30  316.08  317.23  330.83
140.109.98.111                            4%    29   30  315.67  315.82  316.14

Jason Shih's mtr run from ASGC to CSCS:

 1. 140.109.98.1                           0%   30   30     0    0    1     13
 2. 202.169.175.102                        0%   30   30     0    0    0      1
 3. 202.169.174.61                         0%   29   29   189  188  191    244
 4. 202.169.174.149                        0%   29   29   193  190  198    257
 5. so-3-0-0.0.rtr.wash.net.internet2.edu  0%   29   29   211  211  213    221
 6. abilene-wash.rt1.fra.de.geant2.net     0%   29   29   304  303  304    312
 7. so-6-2-0.rt1.gen.ch.geant2.net         0%   29   29   312  312  312    313
 8. swiCE2-10GE-1-1.switch.ch              4%   28   29   312  312  312    312
 9. swiCE3-10GE-1-4.switch.ch              0%   29   29   312  312  322    506
10. swiEL2-10GE-1-3.switch.ch              0%   29   29   312  312  313    315
11. swiMA2-10GE-1-3.switch.ch             11%   26   29   316  315  315    316
12. fw1-e2.cscs.ch                        22%   22   29   316  315  315    316
13. ???

Influence of TCP window size and number of parallel streams

Upload to ASGC:

Download from ASGC:

The influence of the maximal TCP window size setting seems negligible. So, the congestion window never really can open up, probably due to packet loss.

May 5th 2007

Much better throughput from ASGC to CSCS. Maybe due to the measurement being carried out on a Saturday where there might be less traffic? Similar speed as seen in measurements on the Linux 2.6 system.

Basic sysctl settings

net.ipv4.tcp_rmem = 131072      1048576 2097152
net.ipv4.tcp_wmem = 131072      1048576 2097152
net.ipv4.tcp_mem = 195584       196096  196608
net.core.rmem_default = 1048576
net.core.wmem_default = 1048576
net.core.rmem_max = 2097152
net.core.wmem_max = 2097152

Influence of TCP window size and number of parallel streams

Upload to ASGC:

Download from ASGC:

-- DerekFeichtinger - 05 May 2007