My Oracle Support Banner

Exalogic Virtual: Procedure For Replacing Infiniband HCA Card On Dom0 Compute Nodes (Doc ID 1621976.1)

Last updated on MAY 10, 2024

Applies to:

Oracle Exalogic Elastic Cloud Software - Version 2.0.6.0.0 and later
Linux x86-64
Oracle Virtual Server(x86-64)

Purpose

This Note provides detailed steps involved when replacing the Infiniband HCA cards on the Dom0 Compute nodes in Exalogic Virtual racks.

Each of the step listed in this Note provides information whether that particular step has to be executed by Oracle Field Engineer (who is physically replacing the IB HCA card) or Customer.

Scope

Steps in this Note are applicable for use case of replacing the IB HCA cards on Dom0 Compute nodes in Exalogic Virtual racks.

Details

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Purpose
Scope
Details
 PRE-REQUISITES
 a) Customer Task: Take backup of the Exalogic Control stack using Exabr
 b) Customer Task: Take backup of all the Exalogic IB Switches using Exabr
 PROCEDURE
 1) Customer Task: Make a note of the IB firmware version and Port GUIDs on the Compute node before IB HCA card replacement
 2) Customer Task: Put the Compute node for which IB HCA card is being replaced in Maintenance mode
 3) Field Task: IB HCA card physical replacement
 4) Field Task: Verify the IB Firmware version and make note of new Port GUID's after the IB HCA card replacement
 5)  Customer Task: Update the Infiniband partitions with the new Port GUIDs of the Compute node after IB HCA card replacement
 6)  Customer Task: Validate if IB networks are working on the Compute node for which IB HCA card has been replaced
 7)  Customer Task: Rediscover Compute node (for which IB HCA card was replaced) from OVM Manager BUI Console
 8) Customer Task: Refresh repository from OVM Manager BUI Console
 9) Customer Task: Remove the maintenance mode on Compute node (for which IB HCA card was replaced) from EMOC BUI
 10) Customer Task: Remove Blacklisting on Compute node (for which IB HCA card was replaced) from EMOC
 11) Customer Task: Refresh Compute node (for which IB HCA card was replaced) asset from EMOC
 12) Customer Task: Bring up the VM's the Compute node (for which IB HCA was replaced) and test
References

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.