Tags:
create new tag
view all tags

Arrow left Go to previous page / next page of Tier3 site log MOVED TO...

28. 06. 2010 Bandwidth measurement between CSCS and PSI Tier-3

Using the following machines:

  • se39.lcg.cscs.ch
  • t3fs02.psi.ch Solaris10

First tests with non-ideal settings:

tcp_max_buf: 1048576
tcp_cwnd_max: 1048576
tcp_xmit_hiwat: 49152
tcp_recv_hiwat: 49152


ping -I 1 se39.lcg.cscs.ch
PING se39.lcg.cscs.ch: 56 data bytes
64 bytes from se39.lcg.cscs.ch (148.187.66.239): icmp_seq=0. time=4.17 ms
64 bytes from se39.lcg.cscs.ch (148.187.66.239): icmp_seq=1. time=4.18 ms
64 bytes from se39.lcg.cscs.ch (148.187.66.239): icmp_seq=2. time=4.06 ms
64 bytes from se39.lcg.cscs.ch (148.187.66.239): icmp_seq=3. time=3.93 ms
64 bytes from se39.lcg.cscs.ch (148.187.66.239): icmp_seq=4. time=3.87 ms
64 bytes from se39.lcg.cscs.ch (148.187.66.239): icmp_seq=5. time=3.87 ms
64 bytes from se39.lcg.cscs.ch (148.187.66.239): icmp_seq=6. time=3.87 ms
64 bytes from se39.lcg.cscs.ch (148.187.66.239): icmp_seq=7. time=4.21 ms

/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 2M -P 1
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 48.0 KByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[  4] local 192.33.123.42 port 32876 connected with 148.187.66.239 port 20001
[  4]  0.0-10.0 sec    143 MBytes    120 Mbits/sec

/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 2M -P 1
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 48.0 KByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[  4] local 192.33.123.42 port 32877 connected with 148.187.66.239 port 20001
[  4]  0.0-10.0 sec  68.8 MBytes  57.7 Mbits/sec

/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 2M -P 1
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 48.0 KByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[  4] local 192.33.123.42 port 32878 connected with 148.187.66.239 port 20001
[  4]  0.0-10.1 sec  65.1 MBytes  54.3 Mbits/sec

/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 2M -P 1
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 48.0 KByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[  4] local 192.33.123.42 port 32879 connected with 148.187.66.239 port 20001
[  4]  0.0-10.3 sec  69.4 MBytes  56.8 Mbits/sec

-------------------

/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 2M -P 5
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 48.0 KByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[  8] local 192.33.123.42 port 32884 connected with 148.187.66.239 port 20001
[  5] local 192.33.123.42 port 32881 connected with 148.187.66.239 port 20001
[  4] local 192.33.123.42 port 32880 connected with 148.187.66.239 port 20001
[  7] local 192.33.123.42 port 32882 connected with 148.187.66.239 port 20001
[  6] local 192.33.123.42 port 32883 connected with 148.187.66.239 port 20001
[  8]  0.0-10.1 sec  34.5 MBytes  28.7 Mbits/sec
[  5]  0.0-10.1 sec  39.9 MBytes  33.2 Mbits/sec
[  6]  0.0-10.2 sec  32.8 MBytes  27.0 Mbits/sec
[  4]  0.0-10.2 sec  35.7 MBytes  29.3 Mbits/sec
[  7]  0.0-10.3 sec  44.1 MBytes  35.9 Mbits/sec
[SUM]  0.0-10.3 sec    187 MBytes    152 Mbits/sec

/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 2M -P 5
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 48.0 KByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[  8] local 192.33.123.42 port 32889 connected with 148.187.66.239 port 20001
[  5] local 192.33.123.42 port 32885 connected with 148.187.66.239 port 20001
[  6] local 192.33.123.42 port 32886 connected with 148.187.66.239 port 20001
[  4] local 192.33.123.42 port 32887 connected with 148.187.66.239 port 20001
[  7] local 192.33.123.42 port 32888 connected with 148.187.66.239 port 20001
[  8]  0.0-10.0 sec  34.7 MBytes  29.0 Mbits/sec
[  7]  0.0-10.1 sec  40.9 MBytes  34.1 Mbits/sec
[  6]  0.0-10.1 sec  40.8 MBytes  33.9 Mbits/sec
[  5]  0.0-10.2 sec  33.2 MBytes  27.2 Mbits/sec
[  4]  0.0-10.2 sec  49.0 MBytes  40.1 Mbits/sec
[SUM]  0.0-10.2 sec    199 MBytes    163 Mbits/sec


/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 2M -P 5
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 48.0 KByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[  7] local 192.33.123.42 port 32894 connected with 148.187.66.239 port 20001
[  4] local 192.33.123.42 port 32890 connected with 148.187.66.239 port 20001
[  5] local 192.33.123.42 port 32891 connected with 148.187.66.239 port 20001
[  6] local 192.33.123.42 port 32893 connected with 148.187.66.239 port 20001
[  8] local 192.33.123.42 port 32892 connected with 148.187.66.239 port 20001
[  6]  0.0-10.0 sec  41.0 MBytes  34.3 Mbits/sec
[  7]  0.0-10.0 sec  34.2 MBytes  28.7 Mbits/sec
[  4]  0.0-10.0 sec  39.5 MBytes  33.1 Mbits/sec
[  5]  0.0-10.0 sec  43.5 MBytes  36.5 Mbits/sec
[  8]  0.0-10.0 sec  34.5 MBytes  28.9 Mbits/sec
[SUM]  0.0-10.0 sec    193 MBytes    161 Mbits/sec

/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 2M -P 5
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 48.0 KByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[  7] local 192.33.123.42 port 32898 connected with 148.187.66.239 port 20001
[  5] local 192.33.123.42 port 32895 connected with 148.187.66.239 port 20001
[  4] local 192.33.123.42 port 32897 connected with 148.187.66.239 port 20001
[  8] local 192.33.123.42 port 32899 connected with 148.187.66.239 port 20001
[  6] local 192.33.123.42 port 32896 connected with 148.187.66.239 port 20001
[  4]  0.0-10.0 sec  45.1 MBytes  37.7 Mbits/sec
[  5]  0.0-10.0 sec  30.0 MBytes  25.1 Mbits/sec
[  7]  0.0-10.1 sec  46.4 MBytes  38.6 Mbits/sec
[  6]  0.0-10.2 sec  36.0 MBytes  29.5 Mbits/sec
[  8]  0.0-10.5 sec  39.7 MBytes  31.7 Mbits/sec
[SUM]  0.0-10.5 sec    197 MBytes    157 Mbits/sec

-----------------

/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 2M -P 10
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 48.0 KByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 10] local 192.33.123.42 port 32906 connected with 148.187.66.239 port 20001
[  4] local 192.33.123.42 port 32900 connected with 148.187.66.239 port 20001
[  9] local 192.33.123.42 port 32904 connected with 148.187.66.239 port 20001
[  5] local 192.33.123.42 port 32901 connected with 148.187.66.239 port 20001
[  7] local 192.33.123.42 port 32902 connected with 148.187.66.239 port 20001
[  8] local 192.33.123.42 port 32905 connected with 148.187.66.239 port 20001
[  6] local 192.33.123.42 port 32903 connected with 148.187.66.239 port 20001
[ 12] local 192.33.123.42 port 32908 connected with 148.187.66.239 port 20001
[ 13] local 192.33.123.42 port 32909 connected with 148.187.66.239 port 20001
[ 11] local 192.33.123.42 port 32907 connected with 148.187.66.239 port 20001
[  6]  0.0-10.0 sec  28.6 MBytes  24.0 Mbits/sec
[  8]  0.0-10.0 sec  22.6 MBytes  18.9 Mbits/sec
[ 12]  0.0-10.0 sec  26.7 MBytes  22.3 Mbits/sec
[  7]  0.0-10.0 sec  28.4 MBytes  23.8 Mbits/sec
[  9]  0.0-10.1 sec  31.6 MBytes  26.3 Mbits/sec
[  4]  0.0-10.1 sec  27.3 MBytes  22.7 Mbits/sec
[ 10]  0.0-10.1 sec  23.6 MBytes  19.5 Mbits/sec
[ 11]  0.0-10.3 sec  32.7 MBytes  26.6 Mbits/sec
[ 13]  0.0-10.4 sec  20.8 MBytes  16.8 Mbits/sec
[  5]  0.0-10.4 sec  26.0 MBytes  20.9 Mbits/sec
[SUM]  0.0-10.4 sec    268 MBytes    216 Mbits/sec


/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 2M -P 10
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 48.0 KByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 13] local 192.33.123.42 port 32919 connected with 148.187.66.239 port 20001
[  4] local 192.33.123.42 port 32910 connected with 148.187.66.239 port 20001
[  6] local 192.33.123.42 port 32911 connected with 148.187.66.239 port 20001
[  7] local 192.33.123.42 port 32912 connected with 148.187.66.239 port 20001
[  8] local 192.33.123.42 port 32913 connected with 148.187.66.239 port 20001
[  5] local 192.33.123.42 port 32914 connected with 148.187.66.239 port 20001
[ 10] local 192.33.123.42 port 32916 connected with 148.187.66.239 port 20001
[ 12] local 192.33.123.42 port 32918 connected with 148.187.66.239 port 20001
[  9] local 192.33.123.42 port 32915 connected with 148.187.66.239 port 20001
[ 11] local 192.33.123.42 port 32917 connected with 148.187.66.239 port 20001
[  9]  0.0-10.0 sec  34.0 MBytes  28.5 Mbits/sec
[  4]  0.0-10.0 sec  29.2 MBytes  24.4 Mbits/sec
[  5]  0.0-10.1 sec  22.5 MBytes  18.8 Mbits/sec
[ 11]  0.0-10.1 sec  17.5 MBytes  14.6 Mbits/sec
[  7]  0.0-10.1 sec  31.8 MBytes  26.3 Mbits/sec
[  8]  0.0-10.1 sec  31.7 MBytes  26.3 Mbits/sec
[  6]  0.0-10.2 sec  30.7 MBytes  25.4 Mbits/sec
[ 10]  0.0-10.2 sec  29.0 MBytes  23.9 Mbits/sec
[ 12]  0.0-10.2 sec  31.6 MBytes  26.0 Mbits/sec
[ 13]  0.0-10.3 sec  29.8 MBytes  24.3 Mbits/sec
[SUM]  0.0-10.3 sec    288 MBytes    235 Mbits/sec


/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 2M -P 10
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 48.0 KByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 10] local 192.33.123.42 port 32926 connected with 148.187.66.239 port 20001
[  4] local 192.33.123.42 port 32920 connected with 148.187.66.239 port 20001
[  5] local 192.33.123.42 port 32921 connected with 148.187.66.239 port 20001
[  8] local 192.33.123.42 port 32924 connected with 148.187.66.239 port 20001
[  6] local 192.33.123.42 port 32922 connected with 148.187.66.239 port 20001
[  7] local 192.33.123.42 port 32923 connected with 148.187.66.239 port 20001
[  9] local 192.33.123.42 port 32925 connected with 148.187.66.239 port 20001
[ 11] local 192.33.123.42 port 32927 connected with 148.187.66.239 port 20001
[ 12] local 192.33.123.42 port 32928 connected with 148.187.66.239 port 20001
[ 13] local 192.33.123.42 port 32929 connected with 148.187.66.239 port 20001
[  5]  0.0-10.0 sec  26.1 MBytes  21.8 Mbits/sec
[  7]  0.0-10.0 sec  34.0 MBytes  28.5 Mbits/sec
[ 11]  0.0-10.0 sec  29.5 MBytes  24.7 Mbits/sec
[ 13]  0.0-10.1 sec  24.6 MBytes  20.5 Mbits/sec
[ 10]  0.0-10.1 sec  24.4 MBytes  20.2 Mbits/sec
[  9]  0.0-10.1 sec  22.8 MBytes  18.9 Mbits/sec
[  8]  0.0-10.2 sec  35.4 MBytes  29.2 Mbits/sec
[  6]  0.0-10.2 sec  22.5 MBytes  18.5 Mbits/sec
[  4]  0.0-10.2 sec  21.1 MBytes  17.4 Mbits/sec
[ 12]  0.0-10.3 sec  28.1 MBytes  22.9 Mbits/sec
[SUM]  0.0-10.3 sec    268 MBytes    219 Mbits/sec


/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 2M -P 10
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 48.0 KByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 12] local 192.33.123.42 port 32938 connected with 148.187.66.239 port 20001
[  7] local 192.33.123.42 port 32930 connected with 148.187.66.239 port 20001
[  4] local 192.33.123.42 port 32932 connected with 148.187.66.239 port 20001
[  8] local 192.33.123.42 port 32933 connected with 148.187.66.239 port 20001
[  6] local 192.33.123.42 port 32931 connected with 148.187.66.239 port 20001
[  9] local 192.33.123.42 port 32934 connected with 148.187.66.239 port 20001
[ 11] local 192.33.123.42 port 32937 connected with 148.187.66.239 port 20001
[ 13] local 192.33.123.42 port 32939 connected with 148.187.66.239 port 20001
[ 10] local 192.33.123.42 port 32936 connected with 148.187.66.239 port 20001
[  5] local 192.33.123.42 port 32935 connected with 148.187.66.239 port 20001
[ 11]  0.0-10.0 sec  31.1 MBytes  26.1 Mbits/sec
[ 10]  0.0-10.0 sec  25.6 MBytes  21.5 Mbits/sec
[ 13]  0.0-10.0 sec  29.5 MBytes  24.8 Mbits/sec
[  7]  0.0-10.0 sec  20.8 MBytes  17.4 Mbits/sec
[  4]  0.0-10.0 sec  31.2 MBytes  26.2 Mbits/sec
[  6]  0.0-10.0 sec  26.5 MBytes  22.2 Mbits/sec
[ 12]  0.0-10.0 sec  31.0 MBytes  26.0 Mbits/sec
[  9]  0.0-10.0 sec  30.7 MBytes  25.7 Mbits/sec
[  5]  0.0-10.0 sec  31.6 MBytes  26.5 Mbits/sec
[  8]  0.0-10.2 sec  29.3 MBytes  24.2 Mbits/sec
[SUM]  0.0-10.2 sec    287 MBytes    237 Mbits/sec


Using better settings on sender side

tcp_max_buf: 4194304
tcp_cwnd_max: 2097152
tcp_xmit_hiwat: 65536
tcp_recv_hiwat: 65536



/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 1M
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 1.00 MByte
------------------------------------------------------------
[  4] local 192.33.123.42 port 32954 connected with 148.187.66.239 port 20001
[  4]  0.0-10.0 sec    156 MBytes    131 Mbits/sec

/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 1M
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 1.00 MByte
------------------------------------------------------------
[  4] local 192.33.123.42 port 32955 connected with 148.187.66.239 port 20001
[  4]  0.0-10.5 sec  72.4 MBytes  57.8 Mbits/sec

/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 1M
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 1.00 MByte
------------------------------------------------------------
[  4] local 192.33.123.42 port 32956 connected with 148.187.66.239 port 20001
[  4]  0.0-10.1 sec  68.1 MBytes  56.9 Mbits/sec


-------------------

/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 1M -P 10
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 1.00 MByte
------------------------------------------------------------
[ 10] local 192.33.123.42 port 32963 connected with 148.187.66.239 port 20001
[  4] local 192.33.123.42 port 32957 connected with 148.187.66.239 port 20001
[  6] local 192.33.123.42 port 32959 connected with 148.187.66.239 port 20001
[  9] local 192.33.123.42 port 32962 connected with 148.187.66.239 port 20001
[ 11] local 192.33.123.42 port 32964 connected with 148.187.66.239 port 20001
[  7] local 192.33.123.42 port 32961 connected with 148.187.66.239 port 20001
[  8] local 192.33.123.42 port 32960 connected with 148.187.66.239 port 20001
[  5] local 192.33.123.42 port 32958 connected with 148.187.66.239 port 20001
[ 13] local 192.33.123.42 port 32966 connected with 148.187.66.239 port 20001
[ 12] local 192.33.123.42 port 32965 connected with 148.187.66.239 port 20001
[ 12]  0.0-10.1 sec  18.3 MBytes  15.3 Mbits/sec
[  5]  0.0-10.1 sec  20.5 MBytes  17.0 Mbits/sec
[  8]  0.0-10.1 sec  24.5 MBytes  20.4 Mbits/sec
[  7]  0.0-10.1 sec  32.7 MBytes  27.2 Mbits/sec
[ 11]  0.0-10.1 sec  24.5 MBytes  20.4 Mbits/sec
[  6]  0.0-10.1 sec  28.7 MBytes  23.8 Mbits/sec
[  9]  0.0-10.1 sec  34.0 MBytes  28.1 Mbits/sec
[ 10]  0.0-10.2 sec  30.6 MBytes  25.3 Mbits/sec
[ 13]  0.0-10.2 sec  28.6 MBytes  23.4 Mbits/sec
[  4]  0.0-10.5 sec  22.6 MBytes  18.0 Mbits/sec
[SUM]  0.0-10.5 sec    265 MBytes    211 Mbits/sec

/mnt/master/Solaris/iperf_sun -c se39.lcg.cscs.ch -p 20001 -w 1M -P 10
------------------------------------------------------------
Client connecting to se39.lcg.cscs.ch, TCP port 20001
TCP window size: 1.00 MByte
------------------------------------------------------------
[ 13] local 192.33.123.42 port 32976 connected with 148.187.66.239 port 20001
[  6] local 192.33.123.42 port 32968 connected with 148.187.66.239 port 20001
[  4] local 192.33.123.42 port 32967 connected with 148.187.66.239 port 20001
[  5] local 192.33.123.42 port 32970 connected with 148.187.66.239 port 20001
[  7] local 192.33.123.42 port 32969 connected with 148.187.66.239 port 20001
[  9] local 192.33.123.42 port 32973 connected with 148.187.66.239 port 20001
[  8] local 192.33.123.42 port 32971 connected with 148.187.66.239 port 20001
[ 11] local 192.33.123.42 port 32974 connected with 148.187.66.239 port 20001
[ 10] local 192.33.123.42 port 32972 connected with 148.187.66.239 port 20001
[ 12] local 192.33.123.42 port 32975 connected with 148.187.66.239 port 20001
[  5]  0.0-10.2 sec  36.9 MBytes  30.5 Mbits/sec
[  7]  0.0-10.2 sec  34.6 MBytes  28.6 Mbits/sec
[ 12]  0.0-10.2 sec  28.7 MBytes  23.5 Mbits/sec
[  9]  0.0-10.3 sec  35.7 MBytes  29.2 Mbits/sec
[  8]  0.0-10.3 sec  29.8 MBytes  24.3 Mbits/sec
[  6]  0.0-10.3 sec  30.7 MBytes  25.1 Mbits/sec
[  4]  0.0-10.3 sec  32.7 MBytes  26.7 Mbits/sec
[ 13]  0.0-10.3 sec  26.4 MBytes  21.4 Mbits/sec
[ 11]  0.0-10.3 sec  37.9 MBytes  30.8 Mbits/sec
[ 10]  0.0-10.9 sec  28.6 MBytes  21.9 Mbits/sec
[SUM]  0.0-10.9 sec    322 MBytes    247 Mbits/sec




-- DerekFeichtinger - 2010-06-28


Arrow left Go to previous page / next page of Tier3 site log MOVED TO...

Topic revision: r1 - 2010-06-28 - DerekFeichtinger
 
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback