ALL THE THREE CELLS HAVE DO-NOT-SERVICE LED SWITCHED ON simulaneously in Exadata X9M-2 EF (Doc ID 2892899.1)

Last updated on NOVEMBER 16, 2022

Applies to:

Symptoms

1. Sundiag report of cell reported DO-NOT-SERVICE switched on as below example, no switch off output.

==cell01

ms-odl-2.trc:24713:[2022-07-17T10:34:07.887+08:00] [ossmgmt] [TRACE] [] [oracle.ossmgmt.ms.core.MSDNSLEDPollTimerTask] [tid: 38] [SRC_CLASS: oracle.ossmgmt.ms.core.MSDNSLEDPollTimerTask] [SRC_METHOD: taskRun] Reconcile Do-Not-Service LED Status: Do-Not-Service LED switched on

==cell02
ms-odl-2.trc:24495:[2022-07-17T10:34:07.971+08:00] [ossmgmt] [TRACE] [] [oracle.ossmgmt.ms.core.MSDNSLEDPollTimerTask] [tid: 38] [SRC_CLASS: oracle.ossmgmt.ms.core.MSDNSLEDPollTimerTask] [SRC_METHOD: taskRun] Reconcile Do-Not-Service LED Status: Do-Not-Service LED switched on

==cell03
ms-odl-2.trc:23470:[2022-07-17T10:34:08.076+08:00] [ossmgmt] [TRACE] [] [oracle.ossmgmt.ms.core.MSDNSLEDPollTimerTask] [tid: 38] [SRC_CLASS: oracle.ossmgmt.ms.core.MSDNSLEDPollTimerTask] [SRC_METHOD: taskRun] Reconcile Do-Not-Service LED Status: Do-Not-Service LED switched on

2. in asm side, there was possibly some disk errors or other errors which triggered to switch on DO-NOT-SERVICE, but after issue in ASM was fixed, there is still no DO-NOT-SERVICE switched off output in cell side. refer to the following output

2022-07-17T10:33:06.299125+08:00
GMON updating disk modes for group 2 at 13 for pid 45, osid 244636
WARNING: Write Failed. group:2 disk:24 AU:1 offset:4096 size:4096 <------ here, this possible is because Node1 down.
path:/dev/exadata_quorum/QD_RECOC1_<hostname>
incarnation:0xf0f03294 synchronous result:'I/O error'
subsys:System krq:0x7fb63a3d4478 bufp:0x7fb63a3ca000 osderr1:0x534b4950 osderr2:0x0
IO elapsed time: 0 usec Time waited on I/O: 0 usec

2022-07-17T10:40:01.048502+08:00
NOTE: disk validation pending for 1 disk in group 2/0x8240c2df (RECOC1)
NOTE: Attempting voting file relocation on diskgroup DATAC1
NOTE: Successful voting file relocation on diskgroup DATAC1
NOTE: Found /dev/exadata_quorum/QD_RECOC1_<hostname> for disk QD_RECOC1_<hostname> <--- here, online again.
NOTE: completed disk validation for 2/0x8240c2df (RECOC1)
NOTE: reopening 1 disks for group 2

3. asm is not in upgrade mode.
# crsctl query crs activeversion -f
Oracle Clusterware active version on the cluster is [19.0.0.0.0]. The cluster upgrade state is [NORMAL]. The cluster active patch level is [710070081].

4. image version is 22.1.0.0.0

Changes

 no

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.