Questions tagged [rdma]

RDMA refers to "Remote Direct Memory Access," which is a set of networking technologies typically used for high performance, low latency communication.

RDMA refers to "Remote Direct Memory Access," which is a set of networking technologies typically used for high performance, low latency communication.

RDMA networks have three main attributes:

  1. Asynchronous queueing: network operations are submitted by adding requests "work queues" which are asynchronously executed by hardware; when complete, the result is returned to software in a "completion queue."
  2. Kernel bypass: userspace processes can submit operations directly to the network adapter hardware without any system calls.
  3. One-sided operations: one system can read from or write into the memory of a remote system without involving any software on the remote system.
177 questions
0
votes
1 answer

Error while starting opensm

I'm working on Accelio on top of softRoCE. Ib devices configured - # ibv_devices device node GUID ------ ---------------- rxe1 821f02fffef91598 rxe0 d6bed9fffebe94af error…
dhara
  • 1
  • 3
0
votes
1 answer

rdma connection manager driver pattern

I'm using the OFED 3.18r2 implementation of Infiniband drivers for my application. In particular I'm using the rdma connection manager wrapper functions. To understand better what's going on under the hood I'm used to look at the source code. Doing…
Antonio
  • 35
  • 4
0
votes
1 answer

Using same memory region for both local and remote just for testing

The thread/process would include the MR rkey in the data passed to post_send() and configure the sge list with MR lkey to transfer from. I am playing with infiniband HW and wanted to check if it was legal to have MR using lkey and rkey by the same…
SFbay007
  • 1,917
  • 1
  • 20
  • 39
0
votes
1 answer

Are Windows IND & Linux verbs implementations compatible?

I've been having a very confusing discussion with a colleague about the use of Network Direct in Windows to provide RDMA, and Linux where we have a working implementation using the verbs api and rdmacm. Said collegue developed his Network Direct…
hookenz
  • 36,432
  • 45
  • 177
  • 286
0
votes
1 answer

linux rdma mellanox clarification

I was going through the linux/drivers/net/ethernet/mellanox/mlx4/qp.c Got a few questions. Would really appreciate if someone can clarify: In the function, mlx4_qp_alloc_icm, To allocate a QP, there are 2 paths taken: using the ALLOC_RES virtual…
Marc Spencer
  • 357
  • 1
  • 3
  • 12
0
votes
1 answer

Can I send via Infiniband data without using a DMA-controller?

Can I send data via Infiniband without using a DMA-controller and what the smallest size of packages can I send? That is, can I directly access to the memory of the remote CPU2-RAM from current CPU1-Core by using simple pointer (i.e. only x86-asm:…
Alex
  • 12,578
  • 15
  • 99
  • 195
0
votes
1 answer

Where to begin if I want to implement a RDMA NIC driver - Suggestions

Really appreciate the wonderful and very helpful community here. Need help understanding where to begin. My task is to understand and write device drivers for RDMA over Converged Ethernet. My problem is that I don't know where to start. I have…
Marc Spencer
  • 357
  • 1
  • 3
  • 12
0
votes
1 answer

function ibv_get_cq_event() does not return after destrcution

The function ibv_get_cq_event() block and never return even after destruction all resources. I do init all InfiniBand resources, launch ibv_get_cq_event in separate thread, then destroy all InfiniBand resources but ibv_get_cq_event never…
Daniil
  • 143
  • 3
  • 9
-1
votes
1 answer

Confusion regarding RDMA read behavior during retransmission

The Spec says: The PSN of the retried RDMA READ request need not be the same as the PSN of the original RDMA READ request. Any retried request must correspond exactly to a subset of the original RDMA READ request in such a manner that all potential…
-1
votes
1 answer

Rsync over Infiniband/RDMA

Does rsync currently supports datta transfer over RDMA/Infiniband? I have to send some data to another server, but it's taking long to transfer, after searching for some time, i found there is somethng called as Infiniband network protocol which…
ram
  • 83
  • 6
-1
votes
1 answer

How could I detect the completion of a RDMA read / write

I am new in RDMA. Now, I am learning to use RDMA read/write. If a client posts a write/read to a server. How could the client know whether the write/read is successfully complete? In other words, how to know writes have been applied to the server,…
tuffy chow
  • 117
  • 1
  • 7
-1
votes
2 answers

Compilation error for Tensorflow

I am trying to build Tensorflow 1.6 with MPI support. I am getting the following error: ERROR: /gpfshome01/u/amalik/Tensorflow/tensorflow/tensorflow/contrib/gdr/BUILD:52:1: C++ compilation of rule '//tensorflow/contrib/gdr:gdr_memory_manager'…
1 2 3
11
12