Database instance crash with ORA-29770 while RSnn was waiting with 'cell ram cache population' (Doc ID 2794421.1)

2021-07-08T06:10:50.539346+00:00
RS00 (ospid: 121787_121948) waits for event 'cell ram cache population' for 0 secs.
2021-07-08T06:10:52.784335+00:00
Errors in file /u01/app/oracle/diag/rdbms/xxxxxxxc/xxxxxxx1/trace/xxxxxxx1_lmhb_121854.trc (incident=25161) (PDBNAME=CDB$ROOT):
ORA-29770: global enqueue process RS00 (OSID 121787_121948) is hung for more than 70 seconds
Incident details in: /u01/app/oracle/diag/rdbms/xxxxxxxc/xxxxxxx1/incident/incdir_25161/xxxxxxx1_lmhb_121854_i25161.trc
2021-07-08T06:10:55.501969+00:00
LOCK_DBGRP: GCR_SYSTEST debug event locked group GR+DB_xxxxxxxC by memno 0
2021-07-08T06:10:55.838165+00:00
Process termination requested for pid 121787_121790 [source = rdbms], [info = 0] [request issued by pid: 121854, uid: 25265]
2021-07-08T06:10:55.838476+00:00

File_name:: alert_xxxxxxx1.log

[TOC00001-END]
[TOC00002]
========= Dump for incident 29996 (ORA 29770) ========
[TOC00003]
----- Beginning of Customized Incident Dump(s) -----
==================================================
=== RS00 (ospid: 385055_385080) Heartbeat Report
==================================================
RS00 (ospid: 385055_385080) has no heartbeats for 91 sec. (threshold 70)
: heartbeat state 0x1.ffff (inwait) pso-flag 0x100
: waiting for event 'cell ram cache population' for 0 secs with wait_id 66123755.
===[ Wait Chain ]===
Wait chain is empty.
=[SNAPSHOT SUMMARY]=
Process moved according to collected snapshots
===[NO-HB PROCESS CALLSTACK]===
ksedsts()+426<-ksdxfstk()+58<-ksdxcb()+872<-sspuser()+200<-__sighandler()<-ossnet_ipcdat_is_keep_alive_needed()+122
<-ossnet_ipcdat_handle_timeout()+130<-ossnet_wait()+160<-ossnet_execute_deferred_connect()+1640
<-ossnet_drive_deferred_connects()+459<-ossnet_wait_internal()+6274<-ossnet_wait()+186<-oss_wait_ext()+1628<-oss_wait()+129
<-kcfis_reap_ioctl()+334<-kcfis_finalize()+1644<-kcbflc_op_internal_kcfis_ctx()+1057<-kcbflc_ramcache_pop()+147<-kclrcflush()+1362
<-kclpbi()+825<-kjmrmslmain()+3284<-ksvrdp_int()+1941<-ksvrdp_cbk()+13<-ksbdispatch()+367<-opirip()+522<-opidrv()+581<-sou2o()+165
<-opimai_real()+173<-ssthrdmain()+417<-skgp_thread_async_main()+321<-start_thread()+197
==============================
==============================
Dumping PROCESS RS00 (ospid: 385055_385080) States
==============================
===[ System Load State ]===
CPU Total 2 Raw 2 Core 48 Socket 2
Load normal: Cur 609 Highmark 122880 (2.37 480.00)
===[ Latch State ]===
Not in Latch Get
===[ Session State Object ]===
----------------------------------------

[3 samples, 05:02:30 - 05:02:32]
idle wait at each sample
[1 sample, 05:02:29]
waited for 'cell ram cache population', seq_num: 47288
p1: 'cellhash#'=0x5fee1d57
p2: ''=0x0
p3: ''=0x0
time_waited: >= 0 sec (still in wait)
[38 samples, 05:01:53 - 05:02:28]
idle wait at each sample
---------------------------------------------------
Sampled Session History Summary:
longest_non_idle_wait: 'cell ram cache population'
[1 sample, 05:02:45 ]
time_waited: 0.000002 sec (sample interval: 0 sec)
---------------------------------------------------
----------------------------------------

File_name:: xxxxxxx1_lmhb_385066_i29996.trc