My Oracle Support Banner

Exacheck Reports Topology Errors On Infiniband Network (Doc ID 1483604.1)

Last updated on SEPTEMBER 28, 2021

Applies to:

Exadata Database Machine X2-2 Hardware - Version All Versions and later
Information in this document applies to any platform.

Symptoms

Exacheck Reports some infiniband topology errors.
verify-topology also reports errors as seen below.

 


Leaf Switch <IB-SWITCH NAME>.<DOMAINNAME>.com with GUID 0x2128469d62a0a0has fewer than 8 links to compute nodes
It has 5 links (14A 13A 13B 12B 5A) to compute nodes
                                                               [ERROR]

 

However  an investigation  using listlinkup output and ibnetdiscover does not show any cable connectivity issues.

ibnetdiscover  output has entries like the following 


[28]    "H-00212800013f1346"[2](212800013f1348)                 # "<COMPUTE NODE> HCA-1" lid 62 4xQDR

 

Ideally the correct entry  in ibnetdiscover should be like the following. In the previous output IP address is missing.


[12]    "H-00212800013f22d6"[1](212800013f22d7)                 # "<COMPUTE_NODE> S <IP>  HCA-1" lid 44 4xQDR

 

Changes

 A software upgrade.

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.