One of the InfiniBand Port is Down (Doc ID 2295183.1)

Last updated on AUGUST 10, 2017

Applies to:

Linux OS - Version Oracle Linux 6.0 and later
Linux x86-64

Symptoms

There are two ports in the InfiniBand, port1 is configured as ib0 and port 2 is configured as ib1. However the Linux only detected one IB interface ib0.

1. Configurations for ib1 is correct:

/etc/sysconfig/network-scripts/ifcfg-ib1

DEVICE=ib1
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
CONNECTED_MODE=yes

 

 

2. When trying to bring up ib1, you might get the following output.

[root@ovcacn30r1 ~]# ifconfig ib1
ib1: error fetching interface information: Device not found
[root@ovcacn30r1 ~]# ifup ib1
Device ib1 does not seem to be present, delaying initialization.
[root@ovcacn30r1 ~]# ifenslave bond1 ib1
Illegal operation: The specified master interface 'bond1' is not ethernet-like.
This program is designed to work with ethernet-like network interfaces.
Use the '-f' option to force the operation.

 

 

3. If you run command ibstat, you find the port is LinkUp. If the output shows the port is LinkDown, you should check the physical line and IB switch first.

[root@ovcacn30r1 ~]# ibstat
CA 'mlx4_0'
CA type: MT4099
Number of ports: 2
Firmware version: 2.11.1280
Hardware version: 0
Node GUID: 0x0010e00001921288
System image GUID: 0x0010e0000192128b
Port 1:
State: Active
Physical state: LinkUp
Rate: 40
Base lid: 47
LMC: 0
SM lid: 6
Capability mask: 0x02514868
Port GUID: 0x0010e00001921289
Link layer: IB
Port 2:
State: Active
Physical state: LinkUp
Rate: 40
Base lid: 48
LMC: 0
SM lid: 6
Capability mask: 0x02514868
Port GUID: 0x0010e0000192128a
Link layer: IB

 

 

4. No errors in dmesg and ilom hostconsole

Changes

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms