Infiniband Interfaces Do Not Work After Rebooting an Exadata VM - Error: "clib0: P_Key 0xa002 is not found" (Doc ID 2525080.1)

Last updated on OCTOBER 25, 2020

Applies to:

Symptoms

Error in dmesg when starting interface manually

[235640.710536] clib0: P_Key 0xa002 is not found

[235676.824189] clib1: P_Key 0xa002 is not found

The vm is confiugred with the following 4 Interfaces on Physical Machine in vm.cfg file:

ib_pkeys = [{'pf':'03:00.0','port':'1','pkey':['0x2a00','0xa002',]},{'pf':'03:00.0','port':'2','pkey':['0x2a00','0xa002',]},]

2 Interfaces are working fine on same Virtual Machine with or without reboot and no errors reported for 2 interfaces and issue seen only on other 2 IB interfaces.

Changes

After changing the memory settings, VM InfiniBand interfaces are not up or after bounce VM InfiniBand interfaces are not up

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.