Infiniband Switch Replacement - Follow-up Actions (Doc ID 2125203.1)

Last updated on AUGUST 28, 2023

Applies to:

Sun Network QDR InfiniBand Gateway Switch - Version All Versions to All Versions [Release All Releases]
Exadata Database Machine V2 - Version All Versions and later
Sun Datacenter InfiniBand Switch 36 - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.

Goal

Provide follow-up reconfiguration steps to be performed after Infiniband (IB) switch replacement.

This document is intended to be used immediately after physical replacement steps have been completed, as detailed in the How to Replace documents. Also, the How to Prepare document must also have been followed prior, to prepare the plan for this stage. Refer to: Infiniband Switch Replacement – Overview and guide to key articles (Doc ID 2125242.1)

Note: For IB switches within an exalogic system, use Doc ID 2218689.1 instead of this document

Solution

	To view full details, sign in with your My Oracle Support account.
	Don't have a My Oracle Support account? Click to get started!

In this Document

A. State that the Switch must be in

B. For exalogic Systems, refer to Doc ID 2218689.1

C. Restoration using ILOM backup or where no valid backup is available

1. Restore configuration using ILOM backup (where available)

2. Check/update smnodes list on this replacement IB switch

3. Set smpriority and enablesm on this switch

4. For NM2-GW replacement switch only, list the GUIDs of the four bridges

5. If the configuration is configured using partitions other than the default,, Propagate IB Partitions from the running SM Master (and set GUIDs if not already done)

6. Check/propagate secret M-Key policy from the running SM Master.

7. To configure passwordless ssh to the the switch from a node.

E. Final checkup and verification

1. Check/set firewall rule settings on port 623

2. Check the opensm status and smpriorities on all switches in the IB fabric

3. Check network/fabric is operating normally

4. Take a fresh switch configuration backup

5. Take a snapshot of key diags; engage Oracle support if any problems

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.