VERIFY_ROCE_CABLES.PY Fails if ZFS or PCA VPC Peer Link is Configured and Running Image 22.1.6.0 (Doc ID 2917180.1)

Last updated on DECEMBER 23, 2022

Applies to:

Symptoms

verify_roce_cables.py Fails on 22.1.6.0 if zfsbackup appliance or pca direct connect is configured with VPC peer link

[root@x8m2--dbadm01 ibdiagtools]# ./verify_roce_cables.py -n NODES.lst -s SWITCHES.lst
SWITCH PORT (EXPECTED PEER) LOWER LEAF (x8m2--sw-rca0) : CABLE OK? UPPER LEAF (x8m2--sw-rcb0) : CABLE OK?
----------- --------------- -------------------------------- : -------- -------------------------------- : ---------
Eth1/1 (ISL spine switch) : - : FAIL - : FAIL
Eth1/2 (ISL spine switch) : - : FAIL - : FAIL
Eth1/3 (ISL spine switch) : - : FAIL - : FAIL
Eth1/4 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/17 : FAIL x8m2--sw-rcs0 Ethernet1/9 : OK
Eth1/5 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/13 : OK x8m2--sw-rcs0 Ethernet1/5 : OK
Eth1/6 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/19 : FAIL x8m2--sw-rcs0 Ethernet1/11 : FAIL<-----------Random non VPC ports also fail 
Eth1/7 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/15 : OK x8m2--sw-rcs0 Ethernet1/7 : OK
Eth1/21 (adm02) : x8m2--dbadm02 port-1 : OK x8m2--dbadm02 port-2 : OK
Eth1/22 (adm01) : x8m2--dbadm01 port-1 : OK x8m2--dbadm01 port-2 : OK
Eth1/27 (celadm03) : x8m2--celadm03 port-1 : OK x8m2--celadm03 port-2 : OK
Eth1/28 (celadm02) : x8m2--celadm02 port-1 : OK x8m2--celadm02 port-2 : OK
Eth1/29 (celadm01) : x8m2--celadm01 port-1 : OK x8m2--celadm01 port-2 : OK
Eth1/30 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/17 : OK x8m8--sw-rcs0 Ethernet1/9 : OK
Eth1/31 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/13 : OK x8m8--sw-rcs0 Ethernet1/5 : OK
Eth1/32 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/19 : FAIL x8m8--sw-rcs0 Ethernet1/11 : FAIL<----------Random non VPC ports also fail
Eth1/33 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/15 : OK x8m8--sw-rcs0 Ethernet1/7 : OK
Eth1/34 (ISL spine switch) : roceb0 Ethernet1/34 : FAIL rack2sw-rocea0 Ethernet1/34 : FAIL<-------------------------------VPC PEER LINK
Eth1/35 (ISL spine switch) : roceb0 Ethernet1/35 : FAIL rack2sw-rocea0 Ethernet1/35 : FAIL<-------------------------------VPC PEER LINK
Eth1/36 (ISL spine switch) : - : FAIL - : FAIL

==============================================
verify_roce_cables.py Passes on 22.1.4 on the same rack

[root@x8m2--dbadm01 ibdiagtools]# ./verify_roce_cables.py -n /u01/install/NODES.lst -s /u01/install/SWITCHES.lst
SWITCH PORT (EXPECTED PEER) LOWER LEAF (x8m2--sw-rca0) : CABLE OK? UPPER LEAF (x8m2--sw-rcb0) : CABLE OK?
----------- --------------- -------------------------------- : -------- -------------------------------- : ---------
Eth1/4 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/17 : OK x8m2--sw-rcs0 Ethernet1/9 : OK
Eth1/5 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/13 : OK x8m2--sw-rcs0 Ethernet1/5 : OK
Eth1/6 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/19 : OK x8m2--sw-rcs0 Ethernet1/11 : OK
Eth1/7 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/15 : OK x8m2--sw-rcs0 Ethernet1/7 : OK<-------------
Eth1/21 (adm02) : x8m2--dbadm02 port-1 : OK x8m2--dbadm02 port-2 : OK
Eth1/22 (adm01) : x8m2--dbadm01 port-1 : OK x8m2--dbadm01 port-2 : OK
Eth1/27 (celadm03) : x8m2--celadm03 port-1 : OK x8m2--celadm03 port-2 : OK
Eth1/28 (celadm02) : x8m2--celadm02 port-1 : OK x8m2--celadm02 port-2 : OK
Eth1/29 (celadm01) : x8m2--celadm01 port-1 : OK x8m2--celadm01 port-2 : OK
Eth1/30 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/17 : OK x8m8--sw-rcs0 Ethernet1/9 : OK
Eth1/31 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/13 : OK x8m8--sw-rcs0 Ethernet1/5 : OK
Eth1/32 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/19 : OK x8m8--sw-rcs0 Ethernet1/11 : OK
Eth1/33 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/15 : OK x8m8--sw-rcs0 Ethernet1/7 : OK

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.