My Oracle Support Banner

HOW TO: Configure Infiniband Active-Active Network with Failover/Failback Support Using RDS "active-bonding" Feature in Oracle Linux (Doc ID 2135112.1)

Last updated on AUGUST 04, 2018

Applies to:

Linux OS - Version Oracle Linux 6.0 and later
Linux x86-64

Goal

 This document will provide guidance on how to setup an Infiniband Active-Active Network with Failover/Failback Support using RDS bonding feature in Oracle Linux using UEK Kernel

 Recent kernel version v2.6.39-400.278.1 which contains all bugfixes which can affect RDS active-active operation is recommended.   Please refer to section  "5. Recommended kernel and HCAs for using RDS Active-Active configurations with Failover/Failback"

 Import to consider:

This document will not provide information about how RDS and infiniband works.   The purpose of the document is to help the user with its configuration provinding examples of configuration and results of testing.  

 

There will be a "caveat and limitation"  section at the end of the document that we recommend the Reader to review.

Solution

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Goal
Solution
 
1. Network Configuration for IB Ports in /etc/sysconfig/network-scripts/* Configuration Files
 A. Example of configuration files are provided below
 The interface configuration for HCA-1 containing interfaces ib0 and ib1
 The interface configuration for HCA-2 containing interfaces ib2 and ib3
 The interface configuration for HCA-3 containing interfaces ib4 and ib5
 The interface configuration for HCA-4 containing interfaces ib6 and ib7
 The interface configuration with PKEY based device interfaces
 2 .Per Network Interface Parameter Configuration with System Variables in /etc/sysctl.conf
 A. Example of sysctl.conf
 Interface parameters for 4-HCA machine for physical interfaces
 Interface parameters in /etc/sysctl.conf for pkey based interfaces
 
 3. Enable RDS Active-Active failover/failback (RDS active bonding) feature
 A. Example of rds_rdma module parameter setting
 4.  Caveats and Limitations when using RDS Active-Active failover/failback
 5. Recommended kernel and HCAs for using RDS Active-Active configurations with Failover/Failback
 6. Verifying/Testing RDS Active Bnding Failover/Failback
 A. Testing RDS Active-Active with failover
 7.  Verifying RDS Active-Active Initialization on System Boot

References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.