Stack Overflow
Stack Overflow

Questions tagged [infiniband]

InfiniBand is a high-speed switched fabric communications link technology used in high-performance computing and enterprise data centers.

InfiniBand is a switched fabric communications link used in high-performance computing and enterprise data centers. Its features include scalability, high throughput, low latency, quality of service and failover. The InfiniBand architecture specification defines a connection between processor nodes and high performance I/O nodes such as storage devices. Infiniband host bus adapters and network switches are commonly manufactured by both Mellanox and Intel.

178 questions
2
votes
1 answer

python rdma "Hello World"

This program is my first attempt at Infiniband programming. I am using this library: https://github.com/jgunthorpe/python-rdma I am probably doing very funny things wrong. I am just trying to send a sequence of bytes "Hello, World" to a multicast…
Ivan
  • 7,448
  • 14
  • 69
  • 134
2
votes
1 answer

Benchmark tools for Soft-RoCE

I am new to SoftRoCE, I have installed OFED-1.5.2-rxe in my system. currently using kernel version 3.0.0+. Is there any specific benchmark tools for SoftRoCE. And is opensm is mandatory for SoftRocE? while i am trying to run rdma_bw vvdn@vvdn:~$…
Dinesh Kb
  • 31
  • 2
2
votes
0 answers

Does Windows Azure supports Infiniband on Linux VM?

Is the lack of RDMA a reason (source1, source2) for problems with a network, e.g. ifconfig displays eth1-avahi (see link)? I want to run OpenFOAM on two A8 nodes and have to do /etc/init.d/networking restart frequently to enable just eth0.…
luksmir
  • 3,104
  • 5
  • 22
  • 38
2
votes
2 answers

mpi + infiniband too many connections

I am running a MPI application on a cluster, using 4 nodes each with 64 cores. The application performs an all to all communication pattern. Executing the application by the following runs fine: $: mpirun -npernode 36 ./Application Adding a further…
erikzenker
  • 752
  • 5
  • 18
2
votes
2 answers

How to use SRQ with different connections in libibverbs

How to use SRQ when connected to more than one connections. lets say, there are three connections namely process 0, 1 and 2. for creating SRQ, we need to call struct ibv_srq *ibv_create_srq(struct ibv_pd *pd, struct ibv_srq_init_attr…
Aunn Raza
  • 468
  • 2
  • 12
2
votes
2 answers

segmention fault using openMPI jobs with SLURM

I have a problem when trying tu use slurm SBATCH jobs or SRUN jobs with MPI over infiniband. OpenMPI is installed, and if I launch the following test program (called hello) with mpirun -n 30 ./hello it works. // compilation: mpicc -o helloMPI…
Danduk82
  • 769
  • 1
  • 10
  • 29
2
votes
1 answer

Best way to wait for infiniband receive completions on Linux?

We're porting Isis2 (isis2.codeplex.com) to make better use of Infiniband verbs and have our code running. However, IB is oriented around an asynchronous receive model in which you post a bunch of receive buffers and then, as receives complete, you…
Ken Birman
  • 1,088
  • 8
  • 25
2
votes
1 answer

Infiniband connection issue

I get a cluster of which the nodes are connected in fat tree IB. The switches are Qlogic 12300. The problem I have is certain nodes can't talk with each other. Even there are other nodes, which can talk with both of the impacted nodes. I used…
Wei
  • 718
  • 1
  • 6
  • 18
2
votes
2 answers

How to write a Hello World iWarp application?

I am trying to write a small program demonstrating Remote DMA over iWarp. I have the softiwarp Linux kernel module loaded and the userspace library compiled. I am looking for documentation or sample code that explains setting up a connection and,…
Julian Stecklina
  • 1,271
  • 1
  • 10
  • 24
1
vote
1 answer

Interworking MPI between Windows and Linux

I have several Windows box and Linux box interconnected with Infiniband, and I need to run MPI jobs in both environment, does anyone know what's the best way to interwork them ? Currently, I am considering using the beta release of windows binary of…
code monkey
  • 81
  • 8
1
vote
1 answer

Perf stat counts context-switches in what way?

perf stat displays some interesting statistics that can be gathered from examining hardware and software counters. In my research, I couldn't find any reliable information about what counts as a context-switch in perf stat. In spite of my efforts, I…
Bahamas
  • 345
  • 1
  • 2
  • 13
1
vote
1 answer

How to dynamically modify QP rate limit in ConnectX-6 Infiniband/VPI adapter

I have a ConnectX-6 Infiniband/VPI Adapter. I can setup the hardware rate limit when creating a qp like this: ... ibv_qp_attr.ah_attr.static_rate = 7; // set qp rate limit to 40Gbps ... ibv_modify_qp(qp, &ibv_qp_attr, flags); ... But I cannot…
Dillion Wang
  • 362
  • 3
  • 18
1
vote
0 answers

MPI hello_world to test infiniband

I have virtual machine which has passthrough infiniband nic. I am testing inifinband functionality using hello world program. I am new in this world so may need help to understand following error I have install openmpi on ubuntu using apt-get…
Satish
  • 16,544
  • 29
  • 93
  • 149
1
vote
1 answer

Infiniband RDMA completion queues with multithreading

I'm learning how to use RDMA via Inifniband and one problem I'm having is using a connection with more than 1 thread because I cant figure out how to create another completion queue so the work completions get mixed up between the threads and it…
CommanderLake
  • 51
  • 9
1
vote
0 answers

FPGA to DMA to RDMA

I am trying to send data generated from my FPGA card out to an IB device. I want the latency to be as low as possible, so I am thinking this may be the data path. FPGA --> DMA via scatter/gather DMA into Memory Buffer --> RDMA into a ConnectX-6 card…
bchang32
  • 27
  • 3
1 2 3
…
11 12