Exacheck Reports Topology Errors On Infiniband Network
(Doc ID 1483604.1)
Last updated on SEPTEMBER 28, 2021
Applies to:Exadata Database Machine X2-2 Hardware - Version All Versions and later
Information in this document applies to any platform.
Exacheck Reports some infiniband topology errors.
verify-topology also reports errors as seen below.
Leaf Switch <IB-SWITCH NAME>.<DOMAINNAME>.com with GUID 0x2128469d62a0a0has fewer than 8 links to compute nodes
It has 5 links (14A 13A 13B 12B 5A) to compute nodes
However an investigation using listlinkup output and ibnetdiscover does not show any cable connectivity issues.
ibnetdiscover output has entries like the following
 "H-00212800013f1346"(212800013f1348) # "<COMPUTE NODE> HCA-1" lid 62 4xQDR
Ideally the correct entry in ibnetdiscover should be like the following. In the previous output IP address is missing.
 "H-00212800013f22d6"(212800013f22d7) # "<COMPUTE_NODE> S <IP> HCA-1" lid 44 4xQDR
A software upgrade.
To view full details, sign in with your My Oracle Support account.
Don't have a My Oracle Support account? Click to get started!