OUT OF MEMORY for message buffers along with ORA-00600 [kjccgmb:1] (Doc ID 2075443.1)

Last updated on FEBRUARY 12, 2016

Applies to:

Oracle Database - Enterprise Edition - Version 10.2.0.5 and later
Information in this document applies to any platform.

Symptoms

"OUT OF MEMORY for message buffers" messages were observed in RDBMS alert log file along with ORA-00600 [kjccgmb:1] when the database shutdown was in progress.

alert_prdsvc1.log
=================
Sat Sep 12 05:28:57 UTC 2015
Shutting down instance (immediate)
Sat Sep 12 05:28:57 UTC 2015
Shutting down instance: further logons disabled
.
.
Sat Sep 12 05:31:07 UTC 2015
OUT OF MEMORY for message buffers <<<<<<<<<
Sat Sep 12 05:31:07 UTC 2015
Errors in file /u02/app/oracle/admin/prdsvc/bdump/prdsvc1_lms1_30690.trc:
ORA-00600: internal error code, arguments: [kjccgmb:1], [], [], [], [], [], [], []
Sat Sep 12 05:31:07 UTC 2015
OUT OF MEMORY for message buffers
Sat Sep 12 05:31:07 UTC 2015
Errors in file /u02/app/oracle/admin/prdsvc/bdump/prdsvc1_lms0_30672.trc:
ORA-00600: internal error code, arguments: [kjccgmb:1], [], [], [], [], [], [], []
Sat Sep 12 05:31:08 UTC 2015
Trace dumping is performing id=[cdmp_20150912053108]
Sat Sep 12 05:33:46 UTC 2015
Errors in file /u02/app/oracle/admin/prdsvc/bdump/prdsvc1_lms1_30690.trc:
ORA-00600: internal error code, arguments: [kjccgmb:1], [], [], [], [], [], [], []
Sat Sep 12 05:33:46 UTC 2015
LMS1: terminating instance due to error 484
Sat Sep 12 05:33:46 UTC 2015
System state dump is made for local instance
System State dumped to trace file /u02/app/oracle/admin/prdsvc/bdump/prdsvc1_diag_30570.trc
Sat Sep 12 05:33:46 UTC 2015
Errors in file /u02/app/oracle/admin/prdsvc/bdump/prdsvc1_diag_30570.trc:
ORA-00484: LMS* process terminated with error
Sat Sep 12 05:33:46 UTC 2015
Trace dumping is performing id=[cdmp_20150912053346]
Sat Sep 12 05:33:48 UTC 2015
Shutting down instance (abort)
License high water mark = 220
Sat Sep 12 05:33:51 UTC 2015
Instance terminated by LMS1, pid = 30690
Sat Sep 12 05:33:53 UTC 2015
Instance terminated by USER, pid = 30128 <<<<<<<<<<

 

The process trace files shows the issue occurred when trying to allocate a 480 bytes of space for a "ges regular m" chunk:

prdsvc1_lms1_30690.trc
======================
*** 2015-09-12 05:29:51.357
=================================
Begin 4031 Diagnostic Information
=================================
The following information assists Oracle in diagnosing
causes of ORA-4031 errors. This trace may be disabled
by setting the init.ora _4031_dump_bitvec = 0
=====================================
Allocation Request Summary Informaton
=====================================
Current information setting: 04014fff
SGA Heap Dump Interval=3600 seconds
Dump Interval=300 seconds
Last Dump Time=09/12/2015 05:29:39
Dump Count=1
Allocation request for: ges regular m <<<<
Heap: 0x6003e830, size: 480
.
.
*** 2015-09-12 05:31:07.565
ksedmp: internal or fatal error
ORA-00600: internal error code, arguments: [kjccgmb:1], [], [], [], [], [], [], []
----- Call Stack Trace -----
calling call entry argument values in hex
location type point (? means dubious value)
-------------------- -------- -------------------- ----------------------------
ssd_unwind_bp: unhandled instruction at 0x3d2162e instr=f
ssd_unwind_bp: unhandled instruction at 0x109846b instr=f
ssd_unwind_bp: unhandled instruction at 0xd76629 instr=69
.
.

 

 The call stack observed in the trace file:

ksedst <- ksedmp <- ksfdmp <- kgerinv <- kgeasnmierr <- kjccgmb <- kjbclose <- kclpfl <- kjmcachefin <- kjmsm <- ksbrdp <- opirip <- opidrv <- sou2o <- opimai_real <- main <- libc_start_main <- start

 

The database had a small shared pool but a big buffer cache:

sga_max_size = 18253611008
__shared_pool_size = 2147483648
shared_pool_size = 2147483648
__db_cache_size = 9143582720
db_cache_size = 3221225472
db_keep_cache_size = 6442450944

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms