EM 12c: Enterprise Manager 12c Cloud Control OMS Crashes Generating Java Core Dumps with JVMDUMP006I Processing dump event "gpf" error (Doc ID 1500526.1)

Last updated on JUNE 29, 2017

Applies to:

Enterprise Manager Base Platform - Version 12.1.0.2.0 and later
IBM AIX on POWER Systems (64-bit)

Symptoms

Enterprise Manager Cloud Control OMS 12.1.0.2 crashed and created java core dumps.

From ../gc_inst/user_projects/domains/GCDomain/javacore.20121008.190520.46858486.0002.txt:

Compiled_method=java/util/ArrayList.get(I)Ljava/lang/Object;
Target=2_40_20110624_085526 (AIX 6.1)
CPU=ppc64 (32 logical CPUs) (0x300000000 RAM)
----------- Stack Backtrace -----------
(0x0900000002658BC0 [libj9vm24.so+0xbbc0])
(0x09000000026D7F94 [libj9prt24.so+0x1f94])
(0x0900000002658AE0 [libj9vm24.so+0xbae0])
(0x090000000241BC70 [libj9thr24.so+0x1c70])
_pthread_body+0xf0 (0x0900000000541D54 [libpthreads.a+0x3d54])
---------------------------------------
JVMDUMP006I Processing dump event "gpf", detail "" - please wait.
JVMDUMP032I JVM requested System dump using '/gcrtsw/oracle/middleware/gc_inst/user_projects/domains/GCDomain/core.20121004.165821.56033310.0001.dmp' in response to an event
Note: "Enable full CORE dump" in smit is set to FALSE and as a result there will be limited threading information in core file.
JVMDUMP010I System dump written to /gcrtsw/oracle/middleware/gc_inst/user_projects/domains/GCDomain/core.20121004.165821.56033310.0001.dmp
JVMDUMP032I JVM requested Java dump using '/gcrtsw/oracle/middleware/gc_inst/user_projects/domains/GCDomain/javacore.20121004.165821.56033310.0002.txt' in response to an event
JVMDUMP010I Java dump written to /gcrtsw/oracle/middleware/gc_inst/user_projects/domains/GCDomain/javacore.20121004.165821.56033310.0002.txt
JVMDUMP032I JVM requested Snap dump using '/gcrtsw/oracle/middleware/gc_inst/user_projects/domains/GCDomain/Snap.20121004.165821.56033310.0003.trc' in response to an event
JVMDUMP010I Snap dump written to /gcrtsw/oracle/middleware/gc_inst/user_projects/domains/GCDomain/Snap.20121004.165821.56033310.0003.trc
JVMDUMP013I Processed dump event "gpf", detail "".

.

From ../gc_inst/em/EMGC_OMS1/sysman/log/emctl.msg:

HealthMonitor Oct 5, 2012 7:44:35 AM Job Dispatcher error: Job Dispatcher timed out. Job Dispatcher id=39
Critical error err=3 detected in module Job Dispatcher
OMS will be restarted. A full thread dump will be generated in the log file
/gcrtsw/oracle/middleware/gc_inst/user_projects/domains/GCDomain/servers/EMGC_OMS1/logs/EMGC_OMS1.out
to help Oracle Support analyse the problem.
Please consult My Oracle Support Note 964469.1 for additional information.

 

From ../gc_inst/user_projects/domains/GCDomain/servers/EMGC_OMS1/logs/EMGC_OMS1.out:

HealthMonitor : Executing diagnostic command for module omsThread. Oct 5, 2012 7:44:35 AM

JVMDUMP006I Processing dump event "user", detail "" - please wait.
JVMDUMP032I JVM requested Java dump using '/gcrtsw/oracle/middleware/gc_inst/user_projects/domains/GCDomain/javacore.20121005.074437.13697156.0001.txt' in response to an event
JVMDUMP010I Java dump written to /gcrtsw/oracle/middleware/gc_inst/user_projects/domains/GCDomain/javacore.20121005.074437.13697156.0001.txt
JVMDUMP013I Processed dump event "user", detail ""

 

The OMS Status shows:

 

 

Changes

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms