Oracle ZFS Storage Appliance: Infiniband mcxnex WARNINGS - retry counter exceeded - filling up debug.sys logs on ZFS-SA arrays inside Exalogic running Oracle VM Servers (Doc ID 2243804.1)

Last updated on SEPTEMBER 29, 2021

Applies to:

Symptoms

Infiniband mcxnex WARNINGS  "retry counter exceeded" messages filling up debug.sys logs on ZFSSA arrays inside Exalogic running Oracle VM Servers

PROBLEM DESCRIPTION & SYMPTOMS:
-------------------------------
On exalogic 2.0.6.x.x virtual, OVM 3.2.9, Customer is seeing many retry counter exceeded messages filling up ZFSSA debug.sys log files.

No clients are affected.  The messages do not show for which client the warning messages are printed.

Mar 30 01:32:07 HOSTNAME genunix: [ID 549104 kern.warning] WARNING: mcxnex0: CQE transport retry counter exceeded
Mar 30 01:33:55 HOSTNAME genunix: [ID 801312 kern.warning] WARNING: mcxnex0: CQE ERR: cqe fffff6103509e040 QPN 58 indx 2 status 0x15 vendor syndrome 81
Mar 30 01:33:55 HOSTNAME genunix: [ID 549104 kern.warning] WARNING: mcxnex0: CQE transport retry counter exceeded
Mar 30 01:39:57 HOSTNAME genunix: [ID 801312 kern.warning] WARNING: mcxnex0: CQE ERR: cqe fffff60fa7ca55a0 QPN 300085 indx 12d status 0x15 vendor syndrome 81
Mar 30 01:39:57 HOSTNAME genunix: [ID 549104 kern.warning] WARNING: mcxnex0: CQE transport retry counter exceeded
Mar 30 01:53:13 HOSTNAME genunix: [ID 801312 kern.warning] WARNING: mcxnex0: CQE ERR: cqe fffff60fa7ca32e0 QPN 14007d indx 17 status 0x15 vendor syndrome 81

Changes

The reported issues have been seen on the Exalogic X5-2 rack that's just an observation so far the X5-2 that is.

Its only been seen with vservers running. Specifically OVM “Oracle VM Manager”

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.