How to test RDMA performance between two nodes with Intel's IMB benchmark

Question

Hello I am new to using RDMA benchmark tools and currently trying to use Intel's IMB benchmark https://software.intel.com/en-us/articles/intel-mpi-benchmarks

and currently, tested all the examples in the document.

However, I have no idea how to use two nodes to test the performances. Is it something really obvious?

The only example that mentioned about using the two nodes was

mpirun -np <2P> IMB-MPI1 -map <P>x2 -multi 0 PingPong

but there is absolutely no description about the node information.

Anyone who is familiar with using these type of benchmark, I really appreciate your answer.

score 0 · Answer 1 · answered Oct 05 '17 at 02:52

0

you can using these to specify the nodes infor

mpirun -hosts node1,node2 -ppn 1 -n 2

answered Oct 05 '17 at 02:52

li7hui

score 0 · Accepted Answer · answered Oct 05 '17 at 23:16

0

The key was to divide the subnet for the ethernet and the Infiniband

In essence the ethernet and the Infiniband should not share the same subnet.

After that the arp table recognized the Infiniband device and everything ran smoothly.

answered Oct 05 '17 at 23:16

Sungho Hong

Are you saying we should separate the subnet to avoid any confusion since the OS cannot tell the request should be sent from either ethernet or IB channel? – Craig Yang Oct 14 '17 at 10:22
Why not use qperf? – Craig Yang Oct 14 '17 at 10:22

2 Answers2