bigrow@newmon:~$ traceroute uct2-s3.uchicago.edu
traceroute to uct2-s3.uchicago.edu (128.135.158.223), 30 hops max, 40 byte packets
 1  amon (130.199.3.124)  0.247 ms  0.156 ms  0.147 ms
 2  mutt (130.199.3.224)  0.229 ms  0.183 ms  0.178 ms
 3  128.135.247.130 (128.135.247.130)  24.831 ms  24.711 ms  24.674 ms
 4  * * *
 5  uct2-s3.uchicago.edu (128.135.158.223)  24.581 ms  24.601 ms  24.575 ms
bigrow@newmon:~$ 

bigrow@newmon:~$  iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 131072
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[ 10] local 130.199.3.7 port 41339 connected with 128.135.158.223 port 5001
[  3] local 130.199.3.7 port 41332 connected with 128.135.158.223 port 5001
[  9] local 130.199.3.7 port 41334 connected with 128.135.158.223 port 5001
[  6] local 130.199.3.7 port 41335 connected with 128.135.158.223 port 5001
[  8] local 130.199.3.7 port 41337 connected with 128.135.158.223 port 5001
[  5] local 130.199.3.7 port 41338 connected with 128.135.158.223 port 5001
[  4] local 130.199.3.7 port 41333 connected with 128.135.158.223 port 5001
[  7] local 130.199.3.7 port 41336 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-10.1 sec    663 MBytes    551 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-10.1 sec    434 MBytes    359 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-10.2 sec    457 MBytes    377 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-10.2 sec    278 MBytes    229 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-10.5 sec    455 MBytes    365 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-10.5 sec    457 MBytes    364 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-11.0 sec    257 MBytes    195 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-11.6 sec    281 MBytes    203 Mbits/sec
[SUM]  0.0-11.6 sec  3.21 GBytes  2.37 Gbits/sec
bigrow@newmon:~$ 

[test@nettest10g ~]$ traceroute uct2-s3.uchicago.edu 
traceroute to uct2-s3.uchicago.edu (128.135.158.223), 30 hops max, 40 byte packets
 1  mutt.usatlas.bnl.gov (192.12.15.224)  0.357 ms  0.450 ms  0.436 ms
 2  128.135.247.130 (128.135.247.130)  25.478 ms  25.611 ms  25.723 ms
 3  uct2-s3.uchicago.edu (128.135.158.223)  24.639 ms  24.750 ms  24.735 ms
[test@nettest10g ~]$ 

[test@nettest10g ~]$ traceroute uct2-s3.uchicago.edu 
traceroute to uct2-s3.uchicago.edu (128.135.158.223), 30 hops max, 40 byte packets
 1  mutt.usatlas.bnl.gov (192.12.15.224)  0.357 ms  0.450 ms  0.436 ms
 2  128.135.247.130 (128.135.247.130)  25.478 ms  25.611 ms  25.723 ms
 3  uct2-s3.uchicago.edu (128.135.158.223)  24.639 ms  24.750 ms  24.735 ms
[test@nettest10g ~]$ iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 13107
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[ 10] local 192.12.15.25 port 38458 connected with 128.135.158.223 port 5001
[  4] local 192.12.15.25 port 38452 connected with 128.135.158.223 port 5001
[  5] local 192.12.15.25 port 38453 connected with 128.135.158.223 port 5001
[  6] local 192.12.15.25 port 38454 connected with 128.135.158.223 port 5001
[  7] local 192.12.15.25 port 38455 connected with 128.135.158.223 port 5001
[  8] local 192.12.15.25 port 38456 connected with 128.135.158.223 port 5001
[  9] local 192.12.15.25 port 38457 connected with 128.135.158.223 port 5001
[  3] local 192.12.15.25 port 38451 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.2 sec    191 MBytes    158 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-10.5 sec    256 MBytes    204 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-10.6 sec    256 MBytes    202 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-10.9 sec    299 MBytes    231 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-11.2 sec    212 MBytes    159 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-11.9 sec    147 MBytes    103 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-12.6 sec    148 MBytes  98.1 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-13.2 sec    236 MBytes    150 Mbits/sec
[SUM]  0.0-13.2 sec  1.70 GBytes  1.11 Gbits/sec
[test@nettest10g ~]$ 

[test@nettest10g ~]$ iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 13107
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[  4] local 192.12.15.25 port 34509 connected with 128.135.158.223 port 5001
[  5] local 192.12.15.25 port 34510 connected with 128.135.158.223 port 5001
[  6] local 192.12.15.25 port 34511 connected with 128.135.158.223 port 5001
[  7] local 192.12.15.25 port 34512 connected with 128.135.158.223 port 5001
[  8] local 192.12.15.25 port 34513 connected with 128.135.158.223 port 5001
[ 10] local 192.12.15.25 port 34515 connected with 128.135.158.223 port 5001
[  3] local 192.12.15.25 port 34508 connected with 128.135.158.223 port 5001
[  9] local 192.12.15.25 port 34514 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-10.2 sec    191 MBytes    157 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-10.2 sec    191 MBytes    158 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-10.4 sec    212 MBytes    171 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-10.5 sec    191 MBytes    153 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-10.6 sec    233 MBytes    183 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-10.8 sec    190 MBytes    148 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-10.8 sec    191 MBytes    149 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-12.2 sec    191 MBytes    131 Mbits/sec
[SUM]  0.0-12.2 sec  1.55 GBytes  1.09 Gbits/sec
[test@nettest10g ~]$ 

bigrow@newmon:~$ traceroute uct2-s3.uchicago.edu
traceroute to uct2-s3.uchicago.edu (128.135.158.223), 30 hops max, 40 byte packets
 1  amon (130.199.3.124)  0.247 ms  0.156 ms  0.147 ms
 2  mutt (130.199.3.224)  0.229 ms  0.183 ms  0.178 ms
 3  128.135.247.130 (128.135.247.130)  24.831 ms  24.711 ms  24.674 ms
 4  * * *
 5  uct2-s3.uchicago.edu (128.135.158.223)  24.581 ms  24.601 ms  24.575 ms
bigrow@newmon:~$  iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 131072
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[ 10] local 130.199.3.7 port 41339 connected with 128.135.158.223 port 5001
[  3] local 130.199.3.7 port 41332 connected with 128.135.158.223 port 5001
[  9] local 130.199.3.7 port 41334 connected with 128.135.158.223 port 5001
[  6] local 130.199.3.7 port 41335 connected with 128.135.158.223 port 5001
[  8] local 130.199.3.7 port 41337 connected with 128.135.158.223 port 5001
[  5] local 130.199.3.7 port 41338 connected with 128.135.158.223 port 5001
[  4] local 130.199.3.7 port 41333 connected with 128.135.158.223 port 5001
[  7] local 130.199.3.7 port 41336 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-10.1 sec    663 MBytes    551 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-10.1 sec    434 MBytes    359 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-10.2 sec    457 MBytes    377 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-10.2 sec    278 MBytes    229 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-10.5 sec    455 MBytes    365 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-10.5 sec    457 MBytes    364 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-11.0 sec    257 MBytes    195 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-11.6 sec    281 MBytes    203 Mbits/sec
[SUM]  0.0-11.6 sec  3.21 GBytes  2.37 Gbits/sec
bigrow@newmon:~$ 
bigrow@newmon:~$  iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 131072
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[ 10] local 130.199.3.7 port 51167 connected with 128.135.158.223 port 5001
[  4] local 130.199.3.7 port 51161 connected with 128.135.158.223 port 5001
[  3] local 130.199.3.7 port 51162 connected with 128.135.158.223 port 5001
[  6] local 130.199.3.7 port 51163 connected with 128.135.158.223 port 5001
[  7] local 130.199.3.7 port 51164 connected with 128.135.158.223 port 5001
[  8] local 130.199.3.7 port 51165 connected with 128.135.158.223 port 5001
[  5] local 130.199.3.7 port 51160 connected with 128.135.158.223 port 5001
[  9] local 130.199.3.7 port 51166 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-10.4 sec    388 MBytes    314 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.4 sec    567 MBytes    456 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-10.5 sec    481 MBytes    386 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-10.5 sec    479 MBytes    383 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-10.7 sec    213 MBytes    167 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-10.8 sec    235 MBytes    182 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-11.2 sec    150 MBytes    111 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-11.4 sec    192 MBytes    140 Mbits/sec
[SUM]  0.0-11.4 sec  2.64 GBytes  1.98 Gbits/sec
bigrow@newmon:~$ 

bigrow@newmon:~$  iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 131072
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[ 10] local 130.199.3.7 port 36507 connected with 128.135.158.223 port 5001
[  3] local 130.199.3.7 port 36500 connected with 128.135.158.223 port 5001
[  5] local 130.199.3.7 port 36502 connected with 128.135.158.223 port 5001
[  6] local 130.199.3.7 port 36503 connected with 128.135.158.223 port 5001
[  8] local 130.199.3.7 port 36505 connected with 128.135.158.223 port 5001
[  9] local 130.199.3.7 port 36506 connected with 128.135.158.223 port 5001
[  4] local 130.199.3.7 port 36501 connected with 128.135.158.223 port 5001
[  7] local 130.199.3.7 port 36504 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.1 sec    595 MBytes    493 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-10.2 sec    552 MBytes    456 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-10.2 sec    686 MBytes    563 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-10.4 sec    191 MBytes    154 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-10.4 sec    526 MBytes    424 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-10.5 sec    322 MBytes    256 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-11.5 sec    191 MBytes    139 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-11.5 sec    127 MBytes  92.2 Mbits/sec
[SUM]  0.0-11.5 sec  3.12 GBytes  2.32 Gbits/sec
bigrow@newmon:~$ iperf -c nettest10g.usatlas.bnl.gov -p 20000 -P 5 -w 16M -l 131072

[test@nettest10g ~]$ iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 13107
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[  4] local 192.12.15.25 port 33140 connected with 128.135.158.223 port 5001
[  5] local 192.12.15.25 port 33141 connected with 128.135.158.223 port 5001
[  6] local 192.12.15.25 port 33142 connected with 128.135.158.223 port 5001
[  7] local 192.12.15.25 port 33143 connected with 128.135.158.223 port 5001
[  8] local 192.12.15.25 port 33144 connected with 128.135.158.223 port 5001
[ 10] local 192.12.15.25 port 33146 connected with 128.135.158.223 port 5001
[  3] local 192.12.15.25 port 33139 connected with 128.135.158.223 port 5001
[  9] local 192.12.15.25 port 33145 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-10.2 sec    170 MBytes    140 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.4 sec    148 MBytes    119 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-10.5 sec    147 MBytes    118 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-10.5 sec    211 MBytes    169 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-11.0 sec    169 MBytes    130 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-11.0 sec    169 MBytes    129 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-12.2 sec    148 MBytes    102 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-12.3 sec    169 MBytes    115 Mbits/sec
[SUM]  0.0-12.3 sec  1.30 GBytes    905 Mbits/sec
[test@nettest10g ~]$ 

[test@nettest10g ~]$ iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 13107
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[  7] local 192.12.15.25 port 59803 connected with 128.135.158.223 port 5001
[  8] local 192.12.15.25 port 59804 connected with 128.135.158.223 port 5001
[ 10] local 192.12.15.25 port 59806 connected with 128.135.158.223 port 5001
[  4] local 192.12.15.25 port 59800 connected with 128.135.158.223 port 5001
[  3] local 192.12.15.25 port 59799 connected with 128.135.158.223 port 5001
[  6] local 192.12.15.25 port 59802 connected with 128.135.158.223 port 5001
[  9] local 192.12.15.25 port 59805 connected with 128.135.158.223 port 5001
[  5] local 192.12.15.25 port 59801 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-10.4 sec    127 MBytes    103 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-10.4 sec    300 MBytes    242 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-10.6 sec    191 MBytes    151 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-10.9 sec    235 MBytes    182 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-11.9 sec    147 MBytes    104 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-12.3 sec    191 MBytes    130 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-12.3 sec    234 MBytes    160 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-12.6 sec    169 MBytes    113 Mbits/sec
[SUM]  0.0-12.6 sec  1.56 GBytes  1.06 Gbits/sec
[test@nettest10g ~]$ 
[test@nettest10g ~]$ 

bigrow@newmon:~$  iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 131072 
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[ 10] local 130.199.3.7 port 42932 connected with 128.135.158.223 port 5001
[  3] local 130.199.3.7 port 42925 connected with 128.135.158.223 port 5001
[  4] local 130.199.3.7 port 42926 connected with 128.135.158.223 port 5001
[  5] local 130.199.3.7 port 42927 connected with 128.135.158.223 port 5001
[  6] local 130.199.3.7 port 42928 connected with 128.135.158.223 port 5001
[  7] local 130.199.3.7 port 42929 connected with 128.135.158.223 port 5001
[  9] local 130.199.3.7 port 42931 connected with 128.135.158.223 port 5001
[  8] local 130.199.3.7 port 42930 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-10.4 sec    369 MBytes    298 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-10.4 sec    954 MBytes    771 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-10.5 sec    343 MBytes    274 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-10.5 sec    256 MBytes    204 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-10.5 sec    345 MBytes    275 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.6 sec    455 MBytes    362 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-10.7 sec    324 MBytes    253 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-12.4 sec    192 MBytes    130 Mbits/sec
[SUM]  0.0-12.4 sec  3.16 GBytes  2.19 Gbits/sec
bigrow@newmon:~$ 

-------------------------------------- vlan 315 and 2622 set to ip mtu 9000 ---------------------------------

bigrow@newmon:~$  iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 131072
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[ 10] local 130.199.3.7 port 40810 connected with 128.135.158.223 port 5001
[  5] local 130.199.3.7 port 40803 connected with 128.135.158.223 port 5001
[  3] local 130.199.3.7 port 40805 connected with 128.135.158.223 port 5001
[  6] local 130.199.3.7 port 40806 connected with 128.135.158.223 port 5001
[  4] local 130.199.3.7 port 40804 connected with 128.135.158.223 port 5001
[  8] local 130.199.3.7 port 40808 connected with 128.135.158.223 port 5001
[  9] local 130.199.3.7 port 40809 connected with 128.135.158.223 port 5001
[  7] local 130.199.3.7 port 40807 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.1 sec    458 MBytes    379 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-10.2 sec    344 MBytes    283 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-10.4 sec    390 MBytes    315 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-10.4 sec    344 MBytes    277 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-10.5 sec    498 MBytes    399 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-10.5 sec    344 MBytes    274 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-10.5 sec    431 MBytes    343 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-10.8 sec    364 MBytes    283 Mbits/sec
[SUM]  0.0-10.8 sec  3.10 GBytes  2.47 Gbits/sec
bigrow@newmon:~$ 

[test@nettest10g ~]$ iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 13107
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[  4] local 192.12.15.25 port 48971 connected with 128.135.158.223 port 5001
[  5] local 192.12.15.25 port 48972 connected with 128.135.158.223 port 5001
[  6] local 192.12.15.25 port 48973 connected with 128.135.158.223 port 5001
[  7] local 192.12.15.25 port 48974 connected with 128.135.158.223 port 5001
[ 10] local 192.12.15.25 port 48977 connected with 128.135.158.223 port 5001
[  8] local 192.12.15.25 port 48975 connected with 128.135.158.223 port 5001
[  3] local 192.12.15.25 port 48970 connected with 128.135.158.223 port 5001
[  9] local 192.12.15.25 port 48976 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-10.1 sec    170 MBytes    141 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-10.3 sec    191 MBytes    156 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.8 sec    233 MBytes    182 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-11.0 sec    190 MBytes    145 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-11.1 sec    213 MBytes    160 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-11.3 sec    212 MBytes    158 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-12.4 sec    191 MBytes    129 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-12.5 sec    170 MBytes    114 Mbits/sec
[SUM]  0.0-12.5 sec  1.53 GBytes  1.05 Gbits/sec
[test@nettest10g ~]$ 
[test@nettest10g ~]$ iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 13107
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[  4] local 192.12.15.25 port 53684 connected with 128.135.158.223 port 5001
[  5] local 192.12.15.25 port 53685 connected with 128.135.158.223 port 5001
[  6] local 192.12.15.25 port 53686 connected with 128.135.158.223 port 5001
[  7] local 192.12.15.25 port 53687 connected with 128.135.158.223 port 5001
[ 10] local 192.12.15.25 port 53690 connected with 128.135.158.223 port 5001
[  8] local 192.12.15.25 port 53688 connected with 128.135.158.223 port 5001
[  3] local 192.12.15.25 port 53683 connected with 128.135.158.223 port 5001
[  9] local 192.12.15.25 port 53689 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-10.2 sec    148 MBytes    122 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-10.3 sec    147 MBytes    120 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-10.3 sec    257 MBytes    209 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-10.9 sec    191 MBytes    146 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-11.1 sec    147 MBytes    112 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-11.1 sec    191 MBytes    144 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-11.3 sec    212 MBytes    158 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-11.6 sec    190 MBytes    137 Mbits/sec
[SUM]  0.0-11.6 sec  1.45 GBytes  1.07 Gbits/sec
[test@nettest10g ~]$ 

bigrow@newmon:~$  iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 131072
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[ 10] local 130.199.3.7 port 34588 connected with 128.135.158.223 port 5001
[  4] local 130.199.3.7 port 34582 connected with 128.135.158.223 port 5001
[  5] local 130.199.3.7 port 34583 connected with 128.135.158.223 port 5001
[  6] local 130.199.3.7 port 34584 connected with 128.135.158.223 port 5001
[  7] local 130.199.3.7 port 34585 connected with 128.135.158.223 port 5001
[  8] local 130.199.3.7 port 34586 connected with 128.135.158.223 port 5001
[  3] local 130.199.3.7 port 34581 connected with 128.135.158.223 port 5001
[  9] local 130.199.3.7 port 34587 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-10.1 sec    388 MBytes    323 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.1 sec    752 MBytes    623 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-10.2 sec    367 MBytes    302 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-10.3 sec    214 MBytes    174 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-10.3 sec    369 MBytes    300 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-10.3 sec    366 MBytes    298 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-10.4 sec    433 MBytes    350 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-10.8 sec    343 MBytes    267 Mbits/sec
[SUM]  0.0-10.8 sec  3.16 GBytes  2.52 Gbits/sec
bigrow@newmon:~$ 

---------------------put back to 1500---------------------------

[test@nettest10g ~]$ iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 13107
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[ 10] local 192.12.15.25 port 44994 connected with 128.135.158.223 port 5001
[  4] local 192.12.15.25 port 44988 connected with 128.135.158.223 port 5001
[  5] local 192.12.15.25 port 44989 connected with 128.135.158.223 port 5001
[  6] local 192.12.15.25 port 44990 connected with 128.135.158.223 port 5001
[  7] local 192.12.15.25 port 44991 connected with 128.135.158.223 port 5001
[  8] local 192.12.15.25 port 44992 connected with 128.135.158.223 port 5001
[  9] local 192.12.15.25 port 44993 connected with 128.135.158.223 port 5001
[  3] local 192.12.15.25 port 44987 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-10.0 sec    191 MBytes    160 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-10.1 sec    170 MBytes    142 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.2 sec    169 MBytes    139 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-10.6 sec    213 MBytes    168 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-10.7 sec    235 MBytes    184 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-10.9 sec    191 MBytes    147 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-11.4 sec    169 MBytes    124 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-11.8 sec    148 MBytes    105 Mbits/sec
[SUM]  0.0-11.8 sec  1.45 GBytes  1.05 Gbits/sec
[test@nettest10g ~]$ 
[test@nettest10g ~]$ iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 13107
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[  4] local 192.12.15.25 port 44724 connected with 128.135.158.223 port 5001
[  5] local 192.12.15.25 port 44725 connected with 128.135.158.223 port 5001
[  6] local 192.12.15.25 port 44726 connected with 128.135.158.223 port 5001
[  7] local 192.12.15.25 port 44727 connected with 128.135.158.223 port 5001
[  8] local 192.12.15.25 port 44728 connected with 128.135.158.223 port 5001
[  3] local 192.12.15.25 port 44723 connected with 128.135.158.223 port 5001
[ 10] local 192.12.15.25 port 44730 connected with 128.135.158.223 port 5001
[  9] local 192.12.15.25 port 44729 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.7 sec    191 MBytes    149 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-10.9 sec    256 MBytes    198 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-10.9 sec    191 MBytes    147 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-11.6 sec    127 MBytes  91.3 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-12.3 sec    148 MBytes    100 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-12.4 sec    169 MBytes    114 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-12.9 sec    192 MBytes    125 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-13.2 sec    191 MBytes    122 Mbits/sec
[SUM]  0.0-13.2 sec  1.43 GBytes    931 Mbits/sec
[test@nettest10g ~]$  
 
bigrow@newmon:~$  iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 131072
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[ 10] local 130.199.3.7 port 49569 connected with 128.135.158.223 port 5001
[  4] local 130.199.3.7 port 49563 connected with 128.135.158.223 port 5001
[  5] local 130.199.3.7 port 49564 connected with 128.135.158.223 port 5001
[  6] local 130.199.3.7 port 49565 connected with 128.135.158.223 port 5001
[  7] local 130.199.3.7 port 49566 connected with 128.135.158.223 port 5001
[  8] local 130.199.3.7 port 49567 connected with 128.135.158.223 port 5001
[  3] local 130.199.3.7 port 49562 connected with 128.135.158.223 port 5001
[  9] local 130.199.3.7 port 49568 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-10.1 sec    522 MBytes    435 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-10.1 sec    436 MBytes    362 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-10.2 sec    498 MBytes    409 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.5 sec    390 MBytes    311 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-10.6 sec    344 MBytes    273 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-10.6 sec    456 MBytes    360 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-10.8 sec    300 MBytes    234 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-10.8 sec    322 MBytes    250 Mbits/sec
[SUM]  0.0-10.8 sec  3.19 GBytes  2.54 Gbits/sec
bigrow@newmon:~$  iperf -c uct2-s3.uchicago.edu -w 32M -P8 -l 131072
------------------------------------------------------------
Client connecting to uct2-s3.uchicago.edu, TCP port 5001
TCP window size: 64.0 MByte (WARNING: requested 32.0 MByte)
------------------------------------------------------------
[  3] local 130.199.3.7 port 60855 connected with 128.135.158.223 port 5001
[  5] local 130.199.3.7 port 60857 connected with 128.135.158.223 port 5001
[  4] local 130.199.3.7 port 60856 connected with 128.135.158.223 port 5001
[  7] local 130.199.3.7 port 60859 connected with 128.135.158.223 port 5001
[  6] local 130.199.3.7 port 60858 connected with 128.135.158.223 port 5001
[  8] local 130.199.3.7 port 60860 connected with 128.135.158.223 port 5001
[  9] local 130.199.3.7 port 60861 connected with 128.135.158.223 port 5001
[ 10] local 130.199.3.7 port 60862 connected with 128.135.158.223 port 5001
[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-10.5 sec    169 MBytes    136 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-10.7 sec    235 MBytes    184 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-10.7 sec    365 MBytes    286 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-10.8 sec    279 MBytes    217 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-10.8 sec    277 MBytes    215 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-10.8 sec    256 MBytes    198 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-12.4 sec    307 MBytes    208 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-14.1 sec    301 MBytes    180 Mbits/sec
[SUM]  0.0-14.1 sec  2.14 GBytes  1.31 Gbits/sec
bigrow@newmon:~$