Questions tagged [infiniband]

InfiniBand is a high-speed switched fabric communications link technology used in high-performance computing and enterprise data centers.

InfiniBand is a switched fabric communications link used in high-performance computing and enterprise data centers. Its features include scalability, high throughput, low latency, quality of service and failover. The InfiniBand architecture specification defines a connection between processor nodes and high performance I/O nodes such as storage devices. Infiniband host bus adapters and network switches are commonly manufactured by both Mellanox and Intel.

178 questions
0
votes
1 answer

testing 3 nodes at once

I've been using the Infiniband commands (such as ib_send_bw, ibv_rc_pingpong, etc) to test latency and bandwidth between nodes (through the infiniband switch). However, I want to test more things. Is it possible to test latency and bandwith when…
0
votes
2 answers

Hadoop: File ... could only be replicated to 0 nodes, instead of 1

I am trying to deploy Hadoop-RDMA on 8 node IB (OFED-1.5.3-4.0.42) cluster and got into the following problem (a.k.a File ... could only be replicated to 0 nodes, instead of 1): frolo@A11:~/hadoop-rdma-0.9.8> ./bin/hadoop dfs -copyFromLocal…
Alexander
  • 713
  • 1
  • 7
  • 20
0
votes
1 answer

MVAPICH2 - supported network types

Can MVAPICH2 be installed on a normal ethernet network other than InfiniBand or other HPC networking technology?
Maddy
  • 2,114
  • 7
  • 30
  • 50
0
votes
1 answer

Can I send via Infiniband data without using a DMA-controller?

Can I send data via Infiniband without using a DMA-controller and what the smallest size of packages can I send? That is, can I directly access to the memory of the remote CPU2-RAM from current CPU1-Core by using simple pointer (i.e. only x86-asm:…
Alex
  • 12,578
  • 15
  • 99
  • 195
0
votes
1 answer

MPI_Bcast hanging after some data transferred

I am running application that performs some transformations of large matrices on 7-node cluster. Nodes are connected via QDR 40 Gbit Infiniband. Open MPI 1.4.3 is installed on the system. Given matrix transformation requires large data exchange…
dzovejn
  • 3
  • 1
0
votes
1 answer

Infiniband SDP EGAIN error while using a TCP non-blockling socket

I'm using Mellanox Connext-X 3 QDR cards on RHEL 6.2. I've OFED 1.5.4 because it includes SDP. I get EAGAIN error message when using SDP in LD_PRELOAD mode for a TCP app that configures the socket in non-blocking mode. Any thoughts?
Sumant
  • 4,286
  • 1
  • 23
  • 31
0
votes
2 answers

ibv_post_recv() return -1 instead of errno

function ibv_post_recv() return -1, but according to documentation it should return errno. How to know the fail reason in this case? Best Regards,
Daniil
  • 143
  • 3
  • 9
0
votes
1 answer

function ibv_get_cq_event() does not return after destrcution

The function ibv_get_cq_event() block and never return even after destruction all resources. I do init all InfiniBand resources, launch ibv_get_cq_event in separate thread, then destroy all InfiniBand resources but ibv_get_cq_event never…
Daniil
  • 143
  • 3
  • 9
0
votes
2 answers

/etc/init.d/openibd: line 147: syntax error near unexpected token `;&'

Hi I am trying to install a fairly lengthy script to install infiniband and the OFED stack on rocks cluster 6.0 here is what i try to run user@cluster # /etc/init.d/openibd restart /etc/init.d/openibd: line 147: syntax error near unexpected…
pyCthon
  • 11,746
  • 20
  • 73
  • 135
-1
votes
1 answer

Confusion regarding RDMA read behavior during retransmission

The Spec says: The PSN of the retried RDMA READ request need not be the same as the PSN of the original RDMA READ request. Any retried request must correspond exactly to a subset of the original RDMA READ request in such a manner that all potential…
-1
votes
1 answer

Rsync over Infiniband/RDMA

Does rsync currently supports datta transfer over RDMA/Infiniband? I have to send some data to another server, but it's taking long to transfer, after searching for some time, i found there is somethng called as Infiniband network protocol which…
ram
  • 83
  • 6
-1
votes
1 answer

how to use sample control for port counters

I want to monitoring ports in IB fabric. I happened to notice in the out of perfquery some counter like a ticks and port sampling. Its will be great for accurate monitoring. But I cant found some info about setup and using sampling controi for IB…
Black S.
  • 19
  • 5
-2
votes
1 answer

Mellanox Drivers Need Contract?

I have a small Mellanox SAN for an ESXi lab. I've been running ESXi 5.1 on it, so I decided to experiment with 5.5 and 6.0 to get experience. When I went to the drivers at http://www.mellanox.com/page/products_dyn?product_family=36 it said: NOTE:…
jwc
  • 41
  • 2
  • 7
1 2 3
11
12