Instance crash due to ORA-00600: [kjmscndscq:timeout] (Doc ID 2578674.1)

Thu Jul 11 06:10:26 2019
Errors in file $TRACE/<SID>_lmd0_22638.trc (incident=11441019):
ORA-00600: internal error code, arguments: [kjmscndscq:timeout], [326], [163], [0], [0], [4], [24608], [], [], [], [], []
Incident details in: /u01/app/oracle/diag/rdbms/orcl/<SID>/incident/incdir_11441019/<SID>_lmd0_22638_i11441019.trc
Thu Jul 11 06:10:29 2019
Dumping diagnostic data in directory=[cdmp_20190711061029], requested by (instance=1, osid=4294989934 (LMD0)), summary=[incident=11441019].
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
Thu Jul 11 06:10:38 2019
Errors in file $TRACE/<SID>_lmd0_22638.trc:
ORA-00600: internal error code, arguments: [kjmscndscq:timeout], [326], [163], [0], [0], [4], [24608], [], [], [], [], []
Thu Jul 11 06:10:38 2019
USER (ospid: 22638): terminating the instance due to error 482
...
Thu Jul 11 06:10:55 2019
Instance terminated by USER, pid = 22638
Thu Jul 11 07:36:54 2019
Starting ORACLE instance (normal) (OS id: 2237)

<SID>_lmd0_22638_i11441019.trc
-------------------------------------------
[TOC00001]
ORA-00600: internal error code, arguments: [kjmscndscq:timeout], [326], [163], [0], [0], [4], [24608], [], [], [], [], []
[TOC00001-END]
.
.
[TOC00003]
----- SQL Statement (None) -----
Current SQL information unavailable - no cursor.
[TOC00003-END]

[TOC00004]
----- Call Stack Trace -----
...
kjmscndscq()+7556 CALL kgeasnmierr() FFFFFFFF78610E18 ?
FFFFFFFF6D1A0808 ?
103369628 ? 000000006 ?
000000000 ? 000000146 ?
kjmdmain_0()+31864 CALL kjmscndscq() 000103000 ?
FFFFFFFF78603E68 ?
D1C6253E8 ?
FFFFFFFF786154C0 ?
CC3FF41C8 ? 000000002 ?
kjmdm()+80 CALL kjmdmain_0() 000024C00 ? 000000001 ?
FFFFFFFF77B06D18 ?
D1C6277D8 ? 05D26B6B1 ?
D2D1C4DF0 ?
...
[TOC00004-END]

<SID>_lmhb_22708.trc
----------------------------
*** 2019-07-11 06:08:50.747
: heartbeat check status 2 (acceptable) (threshold 70 sec)
: heartbeat state 0x5.ffff (inwait|latch-get) pso-flag 0x100
: waiting for event 'latch free' for 0 secs with wait_id 559255897.
: waiting for latch 'KJC message pool free list'.
===[ Wait Chain ]===
Wait chain is empty.
===[ Latch Chain ]===
LMS0 (ospid: 22644) waits for latch 'KJC message pool free list'.
LMS6 (ospid: 22702) is not waiting for any latch.
: heartbeat check status 2 (acceptable) (threshold 70 sec)
: heartbeat state 0x5.ffff (inwait|latch-get) pso-flag 0x100
: waiting for event 'latch free' for 0 secs with wait_id 563431500.
: waiting for latch 'KJC message pool free list'.
===[ Wait Chain ]===
Wait chain is empty.
===[ Latch Chain ]===
LMS1 (ospid: 22648) waits for latch 'KJC message pool free list'.
The latch chain state is changed.
: heartbeat check status 2 (acceptable) (threshold 70 sec)
: heartbeat state 0x2.ffff () pso-flag 0x100
: Not in wait; last wait ended 0 secs ago.
: last wait_id 560462387 at 'latch free'.
==============================
Dumping PROCESS LMS2 (ospid: 22681) States
==============================
===[ Callstack ]===
*** 2019-07-11 06:08:50.748
Process diagnostic dump for oracle@ssc01dbadm01 (LMS2), OS id=22681,
pid: 21, proc_ser: 1, sid: 2815, sess_ser: 65287
------------------------------------------------------------------------------
-
os thread scheduling delay history: (sampling every 1.000000 secs)
0.000000 secs at [ 06:08:50 ]
NOTE: scheduling delay has not been sampled for 0.247647 secs
0.000000 secs from [ 06:08:46 - 06:08:51 ], 5 sec avg
0.000000 secs from [ 06:07:51 - 06:08:51 ], 1 min avg
0.000000 secs from [ 06:03:50 - 06:08:51 ], 5 min avg

*** 2019-07-11 06:08:51.921
loadavg : 6.85 10.74 12.31
swap info: free_mem = 16983.30M rsv = 214706.04M
alloc = 144076.18M avail = 92393.11M swap_free = 163022.97M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY
TIME CMD
0 S oracle 22681 1 0 39 0 ? 27601843 ? Jul 01 ?
1231:51 ora_lms2_<SID>
Short stack dump:
ksedsts()+572<-ksdxfstk()+44<-ksdxcb()+2220<-sspuser()+240<-ssprtmin()+188<-__
sighndlr()+12<-call_user_handler()+868<-sigacthandler()+92<-kghfnd_in_free_lis
ts()+248<-kghalo()+740<-kghxal()+176<-kjcsmpav()+5020<-kjcsmba()+2744<-kjccgmb
_pbatch()+4784<-kjxmgmb_breq_header()+956<-kjbmsrmexpack()+96<-kjblprmexp()+93
12<-kjbmprmexp()+1032<-kjmxmpm()+1112<-kjmpbmsg()+3720<-kjmsm()+15280<-ksbrdp(
)+1388<-opirip()+904<-opidrv()+648<-sou2o()+112<-opimai_real()+276<-ssthrdmain
()+456<-main()+320<-_start()+300