OSYSMOND Crash with CRS 8503 [crfjson_format_system()+1242]
(Doc ID 2542493.1)
Last updated on APRIL 17, 2023
Applies to:
Oracle Database - Enterprise Edition - Version 12.1.0.1 to 19.1.0.0.0 [Release 12.1 to 18]Information in this document applies to any platform.
Symptoms
OSYSMOND crash on one RAC node with following message logged in Clusterware Alert log at <ORACLE_BASE>/diag/crs/<HOSTNAME>/crs/trace location.
2019-04-25 16:56:15.381 [OCSSD(23589)]CRS-1719: Cluster Synchronization Service daemon (CSSD) clssnmvWorkerThread_0 not scheduled for 8360 msecs.
2019-04-25 20:25:24.706 [CLSECHO(338034)]AFD-0654: AFD is not supported on Exadata systems
2019-04-26 02:25:24.257 [CLSECHO(299707)]AFD-0654: AFD is not supported on Exadata systems
2019-04-26 03:08:01.003 [OSYSMOND(23542)]CRS-8503: Oracle Clusterware process OSYSMOND with operating system process ID 23542 experienced fatal signal or exception code 11.
2019-04-26T03:08:01.024675+02:00
Errors in file /u01/app/oracle/diag/crs/<HOSTNAME1>/crs/trace/osysmond.trc (incident=33):
CRS-8503 [crfjson_format_system()+1242] [Signal/Exception: 11] [Instruction Addr: 0x7f6a7c446b42] [Memory Addr: (nil)] [] [] [] [] [] [] [] []
Incident details in: /u01/app/oracle/diag/crs/<HOSTNAME1>/crs/incident/incdir_33/osysmond_i33.trc
2019-04-26 03:08:45.020 [OSYSMOND(105482)]CRS-8500: Oracle Clusterware OSYSMOND process is starting with operating system process ID 105482
2019-04-26 07:02:29.549 [OCSSD(23589)]CRS-1719: Cluster Synchronization Service daemon (CSSD) clssnmvWorkerThread_0 not scheduled for 7720 msecs.
2019-04-26 08:25:21.783 [CLSECHO(267517)]AFD-0654: AFD is not supported on Exadata systems
2019-04-25 20:25:24.706 [CLSECHO(338034)]AFD-0654: AFD is not supported on Exadata systems
2019-04-26 02:25:24.257 [CLSECHO(299707)]AFD-0654: AFD is not supported on Exadata systems
2019-04-26 03:08:01.003 [OSYSMOND(23542)]CRS-8503: Oracle Clusterware process OSYSMOND with operating system process ID 23542 experienced fatal signal or exception code 11.
2019-04-26T03:08:01.024675+02:00
Errors in file /u01/app/oracle/diag/crs/<HOSTNAME1>/crs/trace/osysmond.trc (incident=33):
CRS-8503 [crfjson_format_system()+1242] [Signal/Exception: 11] [Instruction Addr: 0x7f6a7c446b42] [Memory Addr: (nil)] [] [] [] [] [] [] [] []
Incident details in: /u01/app/oracle/diag/crs/<HOSTNAME1>/crs/incident/incdir_33/osysmond_i33.trc
2019-04-26 03:08:45.020 [OSYSMOND(105482)]CRS-8500: Oracle Clusterware OSYSMOND process is starting with operating system process ID 105482
2019-04-26 07:02:29.549 [OCSSD(23589)]CRS-1719: Cluster Synchronization Service daemon (CSSD) clssnmvWorkerThread_0 not scheduled for 7720 msecs.
2019-04-26 08:25:21.783 [CLSECHO(267517)]AFD-0654: AFD is not supported on Exadata systems
Corresponding incident trace file from <ORACLE_BASE>/diag/crs/<HOSTNAME1>/crs/incident/incdir_33/osysmond_i33.trc have following messages
----- Incident Context Dump -----
Address: 0x7f6a70db8a30
Incident ID: 33
Problem Key: CRS 8503 [crfjson_format_system()+1242]
Error: CRS-8503 [crfjson_format_system()+1242] [Signal/Exception: 11] [Instruction Addr: 0x7f6a7c446b42] [Memory Addr: (nil)] [] [] [] [] [] [] [] []
[00]: dbgexPopulateIncCtx [diag_dde]<-- Signaling
[01]: dbgexProcessError [diag_dde]
[02]: dbgePostErrorDirectVaList_int [diag_dde]
[03]: dbgePostErrorDirect [diag_dde]
.
Address: 0x7f6a70db8a30
Incident ID: 33
Problem Key: CRS 8503 [crfjson_format_system()+1242]
Error: CRS-8503 [crfjson_format_system()+1242] [Signal/Exception: 11] [Instruction Addr: 0x7f6a7c446b42] [Memory Addr: (nil)] [] [] [] [] [] [] [] []
[00]: dbgexPopulateIncCtx [diag_dde]<-- Signaling
[01]: dbgexProcessError [diag_dde]
[02]: dbgePostErrorDirectVaList_int [diag_dde]
[03]: dbgePostErrorDirect [diag_dde]
.
.
[09]: skgesig_sigactionHandler []
[10]: __sighandler []
[11]: crfjson_format_system []
[12]: crfjson_convert_sample []
[13]: crfmond_jsondump []
[14]: start_thread []
MD [00]: 'Client ProcId'='osysmond.bin@<HOSTNAME>.<DOMAIN_NAME>.23542_140095136790272' (0x0)
Impact 0:
[10]: __sighandler []
[11]: crfjson_format_system []
[12]: crfjson_convert_sample []
[13]: crfmond_jsondump []
[14]: start_thread []
MD [00]: 'Client ProcId'='osysmond.bin@<HOSTNAME>.<DOMAIN_NAME>.23542_140095136790272' (0x0)
Impact 0:
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Cause |
| Solution |
| References |