Exalogic Virtual: New Infiniband Gateway Switch Not Getting Discovered Correctly From EMOC After Switch Replacement Activity (Doc ID 2603224.1)

Last updated on NOVEMBER 14, 2022

Applies to:

Symptoms

In Exalogic Virtual racks, issue is noticed where the Infiniband Switch is not discovered properly in EMOC after Switch replacement.

After the switch replacement, EMOC job log corresponding to adding the newly replaced Switch into EMOC shows that the job completed successfully. Also the newly replaced switch is shown as added under Assets accordion in EMOC BUI console. But when we click on the newly added Switch asset and go to "Connectivity" tab, we see that there is no Switch port connectivity information shown under "Switch Port Connectivity" Pane on the right hand side.

Below is screenshot from EMOC BUI console showing the "Switch Port Connectivity" for Infiniband Switch which is discovered correctly from EMOC. For the problem scenario mentioned in this Note you will notice that there is no data shown under "Switch Port Connectivity" pane for Switch which is not discovered correctly from EMOC.

Also we see symptoms in EMOC Job logs corresponding to vserver creation and startup which indicates the Switch is not discovered properly in EMOC. In EMOC Job logs corresponding to new vservers creation or starting of existing vservers we do not see Fabric CRUD tasks for Switch which is not discovered correctly from EMOC. We only see Fabric CRUD tasks to other one switch. Because of this what happens is for any existing vServers which are started from EMOC will not have any VNICs created on the Switch which is not discovered correctly from EMOC. For newly created vservers no bonding file are create as the EMOC/OVM will not be able to connect to the Switch which is not discovered correctly from EMOC for provisioning Network tasks.

When checking the Proxy Controller cacao logs, we notice below errors indicating that "/opt/sun/n1gc/bin/ib_showgwports.expect" expect script execution failed.

Changes

Infiniband Switch replacement. 

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.