New infiniband benchmarks


Ebay.com seller telnetliquid had 3 DDR Host channel adapters for a reasonable price. After clearing them from customs I could finally upgrade the Xen nodes and test.

Test summary:

Oh-My-Good

 

 

Test details:

 


[root@waxh0003 ~]# ib_rdma_bw 192.168.100.107 -b -c -t 1000 -n 200
8681: | port=18515 | ib_port=1 | size=65536 | tx_depth=1000 | iters=200 | duplex=1 | cma=1 |
8681: Local address:  LID 0000, QPN 000000, PSN 0x6a3e5e RKey 0x18043c VAddr 0x000000b7f93000
8681: Remote address: LID 0000, QPN 000000, PSN 0x5471ea, RKey 0x34003a VAddr 0x000000b7ef1000


8681: Bandwidth peak (#0 to #199): 2860.26 MB/sec
8681: Bandwidth average: 2860.25 MB/sec
8681: Service Demand peak (#0 to #199): 908 cycles/KB
8681: Service Demand Avg  : 88 cycles/KB

2.8GB/s full duplex RDMA bandwidth using one port.

10GigabitEthernet?

Couldn’t care less.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s