[PCA 2.x] One InfiniBand Port is Down (Doc ID 2295183.1)

Last updated on JANUARY 08, 2025

Applies to:

Symptoms

There are two ports in the InfiniBand, port1 is configured as ib0 and port 2 is configured as ib1. However the Linux only detected one IB interface ib0.

1. Configurations for ib1 is correct:

/etc/sysconfig/network-scripts/ifcfg-ib1

DEVICE=ib1
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
CONNECTED_MODE=yes 

2. When trying to bring up ib1, you might get the following output.

[root@ovcacn30r1 ~]# ifconfig ib1
ib1: error fetching interface information: Device not found
[root@ovcacn30r1 ~]# ifup ib1
Device ib1 does not seem to be present, delaying initialization.
[root@ovcacn30r1 ~]# ifenslave bond1 ib1
Illegal operation: The specified master interface 'bond1' is not ethernet-like.
This program is designed to work with ethernet-like network interfaces.
Use the '-f' option to force the operation. 

3. If you run command ibstat, you find the port is LinkUp. If the output shows the port is LinkDown, you should check the physical line and IB switch first.

[root@ovcacn30r1 ~]# ibstat
CA 'mlx4_0'
CA type: MT4099
Number of ports: 2
Firmware version: 2.11.1280
Hardware version: 0
Node GUID: 0x0010e00001921288
System image GUID: 0x0010e0000192128b
Port 1:
State: Active
Physical state: LinkUp
Rate: 40
Base lid: 47
LMC: 0
SM lid: 6
Capability mask: 0x02514868
Port GUID: 0x0010e00001921289
Link layer: IB
Port 2:
State: Active
Physical state: LinkUp
Rate: 40
Base lid: 48
LMC: 0
SM lid: 6
Capability mask: 0x02514868
Port GUID: 0x0010e0000192128a
Link layer: IB 

4. No errors in dmesg and ilom hostconsole

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.