Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [mellanox]

Mellanox Technologies Ltd. is an Israeli and American multinational supplier of computer networking products using InfiniBand and Ethernet technology

Mellanox Technologies Ltd. is an Israeli and American multinational supplier of computer networking products using InfiniBand and Ethernet technology

40 questions
1
vote
2 answers

In Infiniband can I use the same port for IPoIB traffic as well as RDMA traffic?

Good day, and my disclaimer that I am no IB expert and have not worked on IB directly yet. My question seems a trivial one, yet I could not find anything in google that answers it. Question: In Infiniband can I use the same port for IPoIB traffic…
BeGa
  • 21
  • 6
1
vote
0 answers

Mellanox MT27500 Link to Port 1 is Down

I have Mellanox MT27500 dual port card which is installed on HP SL250s. Ubuntu 14.04.5 with 3.13.0-24-generic kernel is running on the server. Both port1 type and port 2 type are defined as eth. I have connected port 1 and port 2 to switch with same…
Gpost
  • 11
  • 3
1
vote
1 answer

InfiniBand RDMA latency test on Xen's dom0 crashes

The short story: while setting up InfiniBand connection between two servers, I cannot complete the RDMA latency test. It crashes even with breaking the ssh connection. The long story. The first server is the Xen 4.4 with Ubuntu 14.04 as dom0…
Grigory
  • 167
  • 1
  • 2
  • 10
1
vote
0 answers

openstack, bridging, netfilter and dnat

In a recent upgrade (from Openstack Diablo on Ubuntu Lucid to Openstack Essex on Ubuntu Precise), we found that DNS packets were frequently (almost always) dropped on the bridge interface (br100). For our compute-node hosts, that's a Mellanox…
cas
  • 6,783
  • 32
  • 35
1
vote
1 answer

mellanox connectx-3 (cx312a) link down though light is blinking

I have a system running TrueNas Scale. For some odd reasons, the system does not see the link is up even though dmesg reports it up and the light is blinking on the port. I'm not sure if this is optic's compatibility because I am using a Ericson's…
Long Tran
  • 11
  • 2
1
vote
1 answer

X710 and mlx5_core together on same server

I have a amd server with centos 7.9 I am trying to using the the kernel driver for 2 cards: Ethernet Controller X710 for 10GbE SFP+ 1572 --> i40e MT27800 Family [ConnectX-5] 1017' --> mlx5_core For mellanox i…
yaron
  • 113
  • 1
  • 5
1
vote
1 answer

Infiniband OpenSM N-to-N port routing configuration

I have 10 servers with two CPUs each and one Mellanox 100G Infiniband NIC per CPU. Each NIC is connected to a single Mellanox 36 port 100G IB switch. My RDMA application runs as one process per NUMA node and binds to the local NIC to avoid cross CPU…
Hugo Maxwell
  • 121
  • 4
0
votes
1 answer

Infiniband P_Keys and the Linux kernel

I'm trying to configure Infiniband partitions between two Debian based Linux hosts running the 4.15 kernel and A Mellanox SX6036 switch. I've setup a "DMZ" partition on the swich using a PKey of 0x0001 and added the Port GUID numbers from the active…
Server Fault
  • 3,714
  • 12
  • 54
  • 89
0
votes
1 answer

Mellanox adapter on GCP instance

I'm trying to install MOFED on an instance (preferably with a GPU) and was wondering if anyone knows if a Mellanox adapter is available at any Google Cloud Platform VM. The VM instances that I've been spinning up come with a Virtio network card that…
afernandezody
  • 1
  • 1
0
votes
1 answer

Connecting Intel X722 SFP+ to Mellanox SX1012 QSFP via 4-split breakout cable using ubuntu

I have two servers running Ubuntu 18.04, each equipped with two SFP+ interfaces, each showing up in lshw like the following. *-network:1 description: Ethernet interface product: Ethernet Connection X722 for 10GbE SFP+ vendor:…
fbindel
  • 1
  • 2
0
votes
1 answer

Can not setup Mellanox connectx-2 in 40g speed

I have Mellanox connectX-2 network card (MT26428) and I installed MLNX_OFED_LINUX-3.4-1.0.0.0-ubuntu16.04-x86_64 driver from Mellanox repository but I'm wondering this equipment setup 20G at maximum although I expected it to setup 40G instead. here…
MDK
  • 101
  • 2
0
votes
1 answer

Managed switch for Mellanox MCX354A-FCBT cards?

I've inherited two Mellanox Infiniband environments. One on a LAN, and the other in a DMZ. Both IB networks have their own SX6005 unmanaged switches and a couple small desktop computers running the subnet manager for the network. As I understand,…
Server Fault
  • 3,714
  • 12
  • 54
  • 89
0
votes
1 answer

Troubles with ibverbs in OpenSUSE Leap 42.2 for Mellanox ConnectX-3 HCA

SOLVED I got troubles setting up infiniband software from OpenSUSE repository. The same card works fine with SLES12 + Mellanox OFED stack. Installing everything containing 'infiniband' from yast I see that HCA is up and diagnostic tools like ibnodes…
catbus
  • 1
  • 2
0
votes
1 answer

VMware infiniband configuration

I have a server which is intended to be a vmware host. This server has two Infiniband Mellanox ConnectX-2 dual-port cards. What I want to do is to make the following setup: The first card should work as a native Ethernet 10G network adapter, talking…
Tigran Baluyan
  • 61
  • 5
0
votes
2 answers

Is ibdump in Mellanox OFED 2 supported in Ubuntu 14.04?

I have Ubuntu 14.04. I have Mellanox Technologies MT27500 Family [ConnectX-3] HCAs. I was able to pass all the tests like ibping and ib_rdma_lat. Now I'm running MPI tests to verify that InfiniBand is working. How can I actually see that there is…
Grigory
  • 167
  • 1
  • 2
  • 10
1
2
3