Running "bdacheckib -s" Command to Verifiy Infiniband Topology on New Install of Oracle Big Data Appliance X4-2 Shows Many Links as DOWN

(Doc ID 1663348.1)

Last updated on OCTOBER 03, 2014

Applies to:

Big Data Appliance X4-2 Hardware - Version All Versions and later
Linux x86-64

Symptoms

Running "bdacheckib -s" command to verifiy Infiniband Topology on new Oracle Big Data Appliance X4-2 but many links are showing as down. The -s switch uses the BDAShip.json to verify the Infiniband Topology.

[root@bda01 bda]# bdacheckib -s
using switch names <switch prefix name>-bda1sw-i and <switch prefix name>-bda1sw-i
LINK <switch prefix name>-bda1sw-i.0B   ...  <switch prefix name>-bda1sw-i.8B    UP
LINK <switch prefix name>-i.1B   ...  <switch prefix name>-bda1sw-i.8B    UP
LINK <switch prefix name>-bda1sw-i.15A  ...  bda02.HCA-1.2           UP
LINK <switch prefix name>-i.15B  ...  bda01.HCA-1.2           UP
LINK <switch prefix name>-bda1sw-i.14A  ...  bda04.HCA-1.2           UP
LINK <switch prefix name>-bda1sw-i.14B  ...  bda03.HCA-1.2           UP
LINK <switch prefix name>-bda1sw-i.13A  ...  bda06.HCA-1.2           UP
LINK <switch prefix name>-bda1sw-i.13B  ...  bda05.HCA-1.2           UP
LINK <switch prefix name>-bda1sw-i.12A  ...  bda07.HCA-1.2           UP
LINK <switch prefix name>-bda1sw-i.12B  ...  <switch prefix name>-bda1sw-i.11B   UP
LINK <switch prefix name>-bda1sw-i.9B   ...  <switch prefix name>-bda1sw-i.9A    UP
LINK <switch prefix name>-bda1sw-i.9A   ...  <switch prefix name>-bda1sw-i.9B    UP
LINK <switch prefix name>-bda1sw-i.10B  ...  <switch prefix name>-bda1sw-i.10A   UP
LINK <switch prefix name>-bda1sw-i.10A  ...  <switch prefix name>-bda1sw-i.10B   UP
LINK <switch prefix name>-bda1sw-i.11B  ...  <switch prefix name>-bda1sw-i.12B   UP
LINK <switch prefix name>-bda1sw-i.11A  ...  bda08.HCA-1.2           UP
LINK <switch prefix name>-bda1sw-i.3B   ...  bda11.HCA-1.1           UP
LINK <switch prefix name>-bda1sw-i.3A   ...  bda12.HCA-1.1           UP
LINK <switch prefix name>-bda1sw-i.4B   ...  bda09.HCA-1.2           UP
LINK <switch prefix name>-bda1sw-i.4A   ...  bda10.HCA-1.1           UP
LINK <switch prefix name>-bda1sw-i.8A   ...  <switch prefix name>-bda1sw-i.8A    UP
LINK <switch prefix name>-bda1sw-i.8B   ...  <switch prefix name>-bda1sw-i.0B    UP
LINK <switch prefix name>-bda1sw-i.15A  ...  bda02.HCA-1.1           UP
LINK <switch prefix name>-bda1sw-i.15B  ...  bda01.HCA-1.1           UP
LINK <switch prefix name>-bda1sw-i.14A  ...  bda04.HCA-1.1           UP
LINK <switch prefix name>-bda1sw-i.14B  ...  bda03.HCA-1.1           UP
LINK <switch prefix name>-bda1sw-i.13A  ...  bda06.HCA-1.1           UP
LINK <switch prefix name>-bda1sw-i.13B  ...  bda05.HCA-1.1           UP
LINK <switch prefix name>-bda1sw-i.12A  ...  bda07.HCA-1.1           UP
LINK <switch prefix name>-bda1sw-i.12B  ...  <switch prefix name>-bda1sw-i.11B   UP
LINK <switch prefix name>-bda1sw-i.9B   ...  <switch prefix name>-bda1sw-i.9A    UP
LINK <switch prefix name>-bda1sw-i.9A   ...  <switch prefix name>-bda1sw-i.9B    UP
LINK <switch prefix name>-bda1sw-i.10B  ...  <switch prefix name>-bda1sw-i.10A   UP
LINK <switch prefix name>-bda1sw-i.10A  ...  <switch prefix name>-bda1sw-i.10B   UP
LINK <switch prefix name>-bda1sw-i.11B  ...  <switch prefix name>-bda1sw-i.12B   UP
LINK <switch prefix name>-bda1sw-i.11A  ...  bda08.HCA-1.1           UP
LINK <switch prefix name>-bda1sw-i.3B   ...  bda11.HCA-1.2           UP
LINK <switch prefix name>-bda1sw-i.3A   ...  bda12.HCA-1.2           UP
LINK <switch prefix name>-bda1sw-i.4B   ...  bda09.HCA-1.1           UP
LINK <switch prefix name>-bda1sw-i.4A   ...  bda10.HCA-1.2           UP
LINK <switch prefix name>-bda1sw-i.8A   ...  <switch prefix name>-bda1sw-i.8A    UP
LINK <switch prefix name>-bda1sw-i.8B   ...  <switch prefix name>-bda1sw-i.1B    UP
LINK <switch prefix name>-bda1sw-i.0A   ...  bda18.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.0B   ...  bda17.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.1A   ...  bda16.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.1B   ...  bda15.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.2A   ...  bda14.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.2B   ...  bda13.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.3A   ...  bda12.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.3B   ...  bda11.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.4A   ...  bda10.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.0A   ...  bda18.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.0B   ...  bda17.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.1A   ...  bda16.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.1B   ...  bda15.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.2A   ...  bda14.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.2B   ...  bda13.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.3A   ...  bda12.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.3B   ...  bda11.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.4A   ...  bda10.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.4B   ...  bda09.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.11A  ...  bda08.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.12A  ...  bda07.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.13A  ...  bda06.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.13B  ...  bda05.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.14A  ...  bda04.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.14B  ...  bda03.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.15A  ...  bda02.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.15B  ...  bda01.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.4B   ...  bda09.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.11A  ...  bda08.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.12A  ...  bda07.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.13A  ...  bda06.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.13B  ...  bda05.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.14A  ...  bda04.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.14B  ...  bda03.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.15A  ...  bda02.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.15B  ...  bda01.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.0A   ...  bda18.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.0B   ...  bda17.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.1A   ...  bda16.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.1B   ...  bda15.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.2A   ...  bda14.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.2B   ...  bda13.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.0A   ...  bda18.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.0B   ...  bda17.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.1A   ...  bda16.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.1B   ...  bda15.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.2A   ...  bda14.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.2B   ...  bda13.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.0A   ...  bda18.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.0B   ...  bda17.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.1A   ...  bda16.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.1B   ...  bda15.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.2A   ...  bda14.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.2B   ...  bda13.HCA-1.1           DOWN
LINK <switch prefix name>-bda1sw-i.0A   ...  bda18.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.0B   ...  bda17.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.1A   ...  bda16.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.1B   ...  bda15.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.2A   ...  bda14.HCA-1.2           DOWN
LINK <switch prefix name>-bda1sw-i.2B   ...  bda13.HCA-1.2           DOWN

This was run on a 12-node Oracle Big Data Appliance (BDA) Cluster so some of the nodes would show as DOWN and this would be expected.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms