Switch information

Local port to switch port mappings

Host Name	local interface	switch port
t3fs01	0	10
	1	9
	2	12
	3	11
t3fs02	0	13
	1	14
	2	15
	3	16
t3fs03	0	8
	1	6
	2	7
	3	5
t3fs04	0	1
	1	4
	2	2
	3	3

Testing of the X4500's interface bonding

For incoming connections, the 4 bonded interfaces of each X4500 must be known to the Switch, so that these connections are balanced over the interfaces.

The tests used my IperfLoadTest test suite.

Test setup:

3 X4500 servers with 4*1Gb/s aggregated (bonded) interfaces (File Servers)
7 X4150 servers with 1*1Gb/s interface (Worker Nodes)

Worker nodes as clients sending data

This is testing the switch and the hash function it uses to balance connections between the target interfaces on every thumper. The CISCO switches we use are regrettably only able to do IP or MAC based hashing.

7 clients sending to 3 servers:

Config: mode=tcp time=60

Clients:
--------------------------------------------
     Client             Server       Total   Rate
                                     MBytes  Mbits/s
192.33.123.83:32831  192.33.123.43:8001 3650.00  523.00
192.33.123.81:32851  192.33.123.43:8001 3630.00  520.00
192.33.123.84:32835  192.33.123.41:8001 5380.00  770.00
192.33.123.87:32836  192.33.123.42:8001 5430.00  777.00
192.33.123.85:32838  192.33.123.42:8001 5350.00  766.00
192.33.123.82:32832  192.33.123.41:8001 3450.00  494.00
192.33.123.86:32835  192.33.123.41:8001 3010.00  431.00

Servers:
--------------------------------------------
     Server       Total   Rate     clients
                  MBytes  Mbits/s
192.33.123.43:8001 7280.00 1043.00     2
192.33.123.41:8001 11840.00 1695.00     3
192.33.123.42:8001 10780.00 1543.00     2

Total:
--------------------------------------------
Rate: 4281 Mbits/sec
Data sent: 29900 MBytes

14 clients sending to 3 servers:

Config: mode=tcp time=60


Clients:
--------------------------------------------
     Client             Server       Total   Rate
                                     MBytes  Mbits/s
192.33.123.82:32834  192.33.123.41:8001 2150.00  308.00
192.33.123.83:32831  192.33.123.43:8001 3360.00  480.00
192.33.123.87:32836  192.33.123.42:8001 2690.00  385.00
192.33.123.81:32851  192.33.123.43:8001 3390.00  485.00
192.33.123.86:32835  192.33.123.41:8001 1950.00  279.00
192.33.123.87:32838  192.33.123.41:8001 3770.00  540.00
192.33.123.86:32837  192.33.123.42:8001 3580.00  513.00
192.33.123.83:32833  192.33.123.42:8001 2890.00  414.00
192.33.123.85:32840  192.33.123.42:8001 2830.00  406.00
192.33.123.81:32853  192.33.123.43:8001 2870.00  411.00
192.33.123.84:32835  192.33.123.41:8001 3250.00  465.00
192.33.123.84:32837  192.33.123.43:8001 3250.00  465.00
192.33.123.85:32838  192.33.123.43:8001 3700.00  529.00
192.33.123.82:32832  192.33.123.41:8001 2470.00  354.00

Servers:
--------------------------------------------
     Server       Total   Rate     clients
                  MBytes  Mbits/s
192.33.123.43:8001 16570.00 2370.00     5
192.33.123.41:8001 13590.00 1946.00     5
192.33.123.42:8001 11990.00 1718.00     4

Total:
--------------------------------------------
Rate: 6034 Mbits/sec
Data sent: 42150 MBytes

21 clients sending to 3 servers:

Config: mode=tcp time=60

Clients:
--------------------------------------------
     Client             Server       Total   Rate
                                     MBytes  Mbits/s
192.33.123.82:32837  192.33.123.41:8001 1820.00  260.00
192.33.123.84:32840  192.33.123.43:8001 1780.00  255.00
192.33.123.87:32836  192.33.123.41:8001 1960.00  281.00
192.33.123.81:32851  192.33.123.43:8001 1960.00  280.00
192.33.123.87:32838  192.33.123.42:8001 2250.00  322.00
192.33.123.87:32841  192.33.123.41:8001 2360.00  338.00
192.33.123.83:32833  192.33.123.41:8001 2250.00  322.00
192.33.123.85:32840  192.33.123.42:8001 1530.00  219.00
192.33.123.84:32837  192.33.123.43:8001 3010.00  431.00
192.33.123.85:32838  192.33.123.43:8001 3380.00  483.00
192.33.123.83:32831  192.33.123.42:8001 1790.00  256.00
192.33.123.82:32834  192.33.123.41:8001 2480.00  355.00
192.33.123.85:32843  192.33.123.42:8001 1530.00  219.00
192.33.123.81:32856  192.33.123.43:8001 1960.00  280.00
192.33.123.86:32840  192.33.123.41:8001 2280.00  327.00
192.33.123.86:32835  192.33.123.42:8001 1760.00  252.00
192.33.123.86:32837  192.33.123.42:8001 1760.00  252.00
192.33.123.81:32853  192.33.123.43:8001 2660.00  381.00
192.33.123.84:32835  192.33.123.41:8001 1780.00  255.00
192.33.123.83:32836  192.33.123.42:8001 2540.00  363.00
192.33.123.82:32832  192.33.123.43:8001 2230.00  319.00

Servers:
--------------------------------------------
     Server       Total   Rate     clients
                  MBytes  Mbits/s
192.33.123.43:8001 16980.00 2429.00     7
192.33.123.41:8001 14930.00 2138.00     7
192.33.123.42:8001 13160.00 1883.00     7

Total:
--------------------------------------------
Rate: 6450 Mbits/sec
Data sent: 45070 MBytes

28 clients sending to 3 servers:

Config: mode=tcp time=60


Clients:
--------------------------------------------
     Client             Server       Total   Rate
                                     MBytes  Mbits/s
192.33.123.82:32837  192.33.123.43:8001 1580.00  226.00
192.33.123.84:32840  192.33.123.41:8001 1640.00  235.00
192.33.123.87:32845  192.33.123.41:8001 2220.00  318.00
192.33.123.87:32836  192.33.123.43:8001 1440.00  206.00
192.33.123.81:32851  192.33.123.41:8001 1650.00  236.00
192.33.123.85:32847  192.33.123.43:8001 1330.00  191.00
192.33.123.87:32838  192.33.123.43:8001 1440.00  206.00
192.33.123.87:32841  192.33.123.42:8001 1470.00  211.00
192.33.123.83:32833  192.33.123.42:8001 1470.00  210.00
192.33.123.85:32840  192.33.123.43:8001 1330.00  191.00
192.33.123.84:32837  192.33.123.41:8001 1640.00  235.00
192.33.123.81:32860  192.33.123.41:8001 1650.00  236.00
192.33.123.85:32838  192.33.123.42:8001 1430.00  205.00
192.33.123.82:32841  192.33.123.41:8001 2880.00  413.00
192.33.123.84:32844  192.33.123.42:8001 1640.00  235.00
192.33.123.83:32831  192.33.123.41:8001 1470.00  210.00
192.33.123.82:32834  192.33.123.43:8001 1060.00  151.00
192.33.123.85:32843  192.33.123.42:8001 1430.00  205.00
192.33.123.81:32856  192.33.123.41:8001 1650.00  236.00
192.33.123.86:32840  192.33.123.42:8001 1330.00  190.00
192.33.123.86:32835  192.33.123.43:8001 1270.00  182.00
192.33.123.86:32837  192.33.123.42:8001 1330.00  190.00
192.33.123.86:32844  192.33.123.41:8001 2600.00  372.00
192.33.123.81:32853  192.33.123.43:8001 1640.00  235.00
192.33.123.84:32835  192.33.123.42:8001 1640.00  235.00
192.33.123.83:32836  192.33.123.43:8001 1430.00  205.00
192.33.123.82:32832  192.33.123.42:8001 1050.00  151.00
192.33.123.83:32840  192.33.123.41:8001 2200.00  316.00

Servers:
--------------------------------------------
     Server       Total   Rate     clients
                  MBytes  Mbits/s
192.33.123.43:8001 12520.00 1793.00     9
192.33.123.41:8001 19600.00 2807.00    10
192.33.123.42:8001 12790.00 1832.00     9

Total:
--------------------------------------------
Rate: 6432 Mbits/sec
Data sent: 44910 MBytes

-- DerekFeichtinger - 08 Sep 2008