Stack Overflow
Stack Overflow

Questions tagged [infiniband]

InfiniBand is a high-speed switched fabric communications link technology used in high-performance computing and enterprise data centers.

InfiniBand is a switched fabric communications link used in high-performance computing and enterprise data centers. Its features include scalability, high throughput, low latency, quality of service and failover. The InfiniBand architecture specification defines a connection between processor nodes and high performance I/O nodes such as storage devices. Infiniband host bus adapters and network switches are commonly manufactured by both Mellanox and Intel.

178 questions
1
vote
1 answer

What is the logic behind setting valid region half the size of PSN range?

In order to make it possible for the responder to distinguish duplicate packets from out of order packets, a given send queue shall have a series of PSNs no greater than 8,388,608 outstanding at any given time. Therefore, a send queue shall have no…
Barney_su
  • 43
  • 6
1
vote
1 answer

What's the difference between Doorbell and Doorbell Record?

I'm new to RDMA technology and I can't figure out what's the difference between doorbell and doorbell record. In my opinion, when Software posts its work request, it rings the doorbell register to notify the hardware to fetch the work request. I…
MitsuiYang
  • 21
  • 2
1
vote
0 answers

Relationship among different RDMA libraries

I'm new to RDMA technology, and I'm confused by several rdma libraries. I cannot figure out the relationship among them. The libraries and kernel headers I'm confused with are as follows: 1.rdma-core/libibverbs 2.rdma-core/librdmacm…
MitsuiYang
  • 21
  • 2
1
vote
2 answers

How can I receive Ethernet frames with ibverbs?

I want to write a simple test program to receive Ethernet frames using the ibverbs API. The code below compiles and runs but never receives any packets. I'm using Mellanox ConnectX-3 hardware on Ubuntu 18. Questions: If, while running this RX…
Andrew Bainbridge
  • 4,651
  • 3
  • 35
  • 50
1
vote
2 answers

What is the meaning of "driver core" in the context of Linux kernel device drivers?

I was reading through the Linux Device Drivers, Third Edition book and in the "Putting It All Together" section in Chapter 14, they mention the interaction between "PCI core, driver core and the individual PCI drivers." And they used the word…
Rohit Zambre
  • 13
  • 4
1
vote
1 answer

Why does Intel MPI use DAPL and OpenMPI native ibverbs?

I don't understand why Intel MPI use DAPL, if native ibverbs are faster than DAPL, OpenMPI use native ibverbs. However, in this benchmark IntelMPI achieves better…
Brayme Guaman
  • 175
  • 2
  • 12
1
vote
2 answers

Why does MPI use IpoIB instead of native IB?

I understand that OpenMPI uses OpenIB, and OpenIB uses Ip over Infiniband (IPoIB). I don't understand why not use native IB, if is it faster than IPoIB? Is there any implementation of MPI, that it use native IB?
Brayme Guaman
  • 175
  • 2
  • 12
1
vote
2 answers

rdma_create_qp() error: invalid argument

I'm new to rdma programming and am currently setting up a simple client/server using ib verbs and rdma cma, but have hit a wall. My server runs and waits for the connection, but my client never connects because it fails at rdma_create_qp(). I'm not…
Pixel Razor
  • 11
  • 4
1
vote
2 answers

OpenMPI + Infiniband performance

I'm new to HPC and I am curious about a point regarding the performance of MPI over Infiniband. For reference, I am using OpenMPI over two different machines connected through IB. I've coded a very simple benchmark to see how fast I can transfer…
Joshua Gevirtz
  • 401
  • 3
  • 14
1
vote
0 answers

kernel program RDMA (krping)

I'm using a kernel module to do RDMA transfer in kernel space on Infiniband (krping.c, link: git.openfabrics.org Git - ~sgrimberg/krping.git/summary). The cards I have are Mellanox ConnectX-4 (driver: mlx5), Linux kernel version: 3.13, Ubuntu 12.04,…
S. Salman
  • 590
  • 1
  • 6
  • 22
1
vote
1 answer

RDMA API for Linux kernel

Is there an API for RDMA (Infiniband) that can be used in kernel Space? Most of the API's that I have found are user Space. kDAPL and kAL can be used in the linux kernel; however, I have not yet found sample code to use these API's. Can somebody…
S. Salman
  • 590
  • 1
  • 6
  • 22
1
vote
1 answer

Pcap link type of Infiniband

I'm Trying to capture Infiniband packets using the pcap format, and for that i thought i should use LINKTYPE_INFINIBAND 247 DLT_INFINIBAND as mentioned in the tcpdump's LINK-LAYER HEADER TYPES. When i try to open the pcap file in Wireshark i get…
Tal
  • 111
  • 2
  • 7
1
vote
2 answers

RDMA transfer without mapping memory

I have supplementary processes which should exchange files over IB network. Then the files will be used by other processes. The workflow is following: Create files in /dev/shm Resize files appropriately Map files in process' VM Register mmaped area…
mcsim
  • 1,647
  • 2
  • 16
  • 35
1
vote
1 answer

How to send messages over RDMA (Infiniband) from within KVM code to another instance of KVM?

I am trying to setup an RDMA channel between two instances of KVM. I want to send a simple string between the two instances using RDMA (Infiniband) Verbs API from inside the hypervisor. I don't want to do anything on the user-space - purely kernel…
gohar94
  • 138
  • 1
  • 3
  • 11
1
vote
1 answer

To create multiple Queue Pairs in RDMA

I am a new newbie in RDMA programming. My workflow is as follows. struct rdma_cm_id *cm_client_id = NULL; struct rdma_cm_event *cm_event = NULL; ret = process_rdma_cm_event(cm_event_channel, RDMA_CM_EVENT_CONNECT_REQUEST, &cm_event); cm_client_id…
HuangJie
  • 1,488
  • 1
  • 16
  • 33
1 2 3
…
11 12