VERIFY_ROCE_CABLES.PY Fails if ZFS or PCA VPC Peer Link is Configured and Running Image 22.1.6.0
(Doc ID 2917180.1)
Last updated on DECEMBER 23, 2022
Applies to:
Cisco Nexus Switch - Version All Versions to All Versions [Release All Releases]Information in this document applies to any platform.
Symptoms
verify_roce_cables.py Fails on 22.1.6.0 if zfsbackup appliance or pca direct connect is configured with VPC peer link
[root@x8m2--dbadm01 ibdiagtools]# ./verify_roce_cables.py -n NODES.lst -s SWITCHES.lst
SWITCH PORT (EXPECTED PEER) LOWER LEAF (x8m2--sw-rca0) : CABLE OK? UPPER LEAF (x8m2--sw-rcb0) : CABLE OK?
----------- --------------- -------------------------------- : -------- -------------------------------- : ---------
Eth1/1 (ISL spine switch) : - : FAIL - : FAIL
Eth1/2 (ISL spine switch) : - : FAIL - : FAIL
Eth1/3 (ISL spine switch) : - : FAIL - : FAIL
Eth1/4 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/17 : FAIL x8m2--sw-rcs0 Ethernet1/9 : OK
Eth1/5 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/13 : OK x8m2--sw-rcs0 Ethernet1/5 : OK
Eth1/6 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/19 : FAIL x8m2--sw-rcs0 Ethernet1/11 : FAIL<-----------Random non VPC ports also fail
Eth1/7 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/15 : OK x8m2--sw-rcs0 Ethernet1/7 : OK
Eth1/21 (adm02) : x8m2--dbadm02 port-1 : OK x8m2--dbadm02 port-2 : OK
Eth1/22 (adm01) : x8m2--dbadm01 port-1 : OK x8m2--dbadm01 port-2 : OK
Eth1/27 (celadm03) : x8m2--celadm03 port-1 : OK x8m2--celadm03 port-2 : OK
Eth1/28 (celadm02) : x8m2--celadm02 port-1 : OK x8m2--celadm02 port-2 : OK
Eth1/29 (celadm01) : x8m2--celadm01 port-1 : OK x8m2--celadm01 port-2 : OK
Eth1/30 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/17 : OK x8m8--sw-rcs0 Ethernet1/9 : OK
Eth1/31 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/13 : OK x8m8--sw-rcs0 Ethernet1/5 : OK
Eth1/32 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/19 : FAIL x8m8--sw-rcs0 Ethernet1/11 : FAIL<----------Random non VPC ports also fail
Eth1/33 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/15 : OK x8m8--sw-rcs0 Ethernet1/7 : OK
Eth1/34 (ISL spine switch) : roceb0 Ethernet1/34 : FAIL rack2sw-rocea0 Ethernet1/34 : FAIL<-------------------------------VPC PEER LINK
Eth1/35 (ISL spine switch) : roceb0 Ethernet1/35 : FAIL rack2sw-rocea0 Ethernet1/35 : FAIL<-------------------------------VPC PEER LINK
Eth1/36 (ISL spine switch) : - : FAIL - : FAIL
==============================================
verify_roce_cables.py Passes on 22.1.4 on the same rack
[root@x8m2--dbadm01 ibdiagtools]# ./verify_roce_cables.py -n /u01/install/NODES.lst -s /u01/install/SWITCHES.lst
SWITCH PORT (EXPECTED PEER) LOWER LEAF (x8m2--sw-rca0) : CABLE OK? UPPER LEAF (x8m2--sw-rcb0) : CABLE OK?
----------- --------------- -------------------------------- : -------- -------------------------------- : ---------
Eth1/4 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/17 : OK x8m2--sw-rcs0 Ethernet1/9 : OK
Eth1/5 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/13 : OK x8m2--sw-rcs0 Ethernet1/5 : OK
Eth1/6 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/19 : OK x8m2--sw-rcs0 Ethernet1/11 : OK
Eth1/7 (ISL spine switch) : x8m2--sw-rcs0 Ethernet1/15 : OK x8m2--sw-rcs0 Ethernet1/7 : OK<-------------
Eth1/21 (adm02) : x8m2--dbadm02 port-1 : OK x8m2--dbadm02 port-2 : OK
Eth1/22 (adm01) : x8m2--dbadm01 port-1 : OK x8m2--dbadm01 port-2 : OK
Eth1/27 (celadm03) : x8m2--celadm03 port-1 : OK x8m2--celadm03 port-2 : OK
Eth1/28 (celadm02) : x8m2--celadm02 port-1 : OK x8m2--celadm02 port-2 : OK
Eth1/29 (celadm01) : x8m2--celadm01 port-1 : OK x8m2--celadm01 port-2 : OK
Eth1/30 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/17 : OK x8m8--sw-rcs0 Ethernet1/9 : OK
Eth1/31 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/13 : OK x8m8--sw-rcs0 Ethernet1/5 : OK
Eth1/32 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/19 : OK x8m8--sw-rcs0 Ethernet1/11 : OK
Eth1/33 (ISL spine switch) : x8m8--sw-rcs0 Ethernet1/15 : OK x8m8--sw-rcs0 Ethernet1/7 : OK
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
Symptoms |
Cause |
Solution |