My Oracle Support Banner

OMS Startup Fails: 'opmnctl status' Shows OC4J_EM Component in 'Stop' Status (Doc ID 444031.1)

Last updated on DECEMBER 11, 2019

Applies to:

Enterprise Manager Base Platform - Version 10.1.0.3 to 10.2.0.5 [Release 10.1 to 10.2]
Information in this document applies to any platform.
***Checked for relevance on 05-Oct-2011***
Checked for relevance on 12-APR-2013

Symptoms

Trying to access Grid Console URL returns a "500 Internal server error" :

The server encountered an internal error or misconfiguration and was unable to complete your request. Please contact the server administrator, you@your.address and inform them of the time the error occurred, and anything you might have done that
may have caused the error.

More information about this error may be available in the server error log.


Re-starting the OMS using these steps :

$ cd <OMS_HOME>/opmn/bin
$ opmnctl stopall
opmnctl: stopping opmn and all managed processes...

$ opmnctl startall
opmnctl: starting opmn and all managed processes...

$ opmnctl status

Processes in Instance: EnterpriseManager0.hostname
-------------------+--------------------+---------+---------
ias-component | process-type | pid | status
-------------------+--------------------+---------+---------
DSA | DSA | N/A | Down
HTTP_Server | HTTP_Server | 970894 | Alive
LogLoader | logloaderd | N/A | Down
dcm-daemon | dcm-daemon | N/A | Down
OC4J | home | 573466 | Stop
OC4J | OC4J_EM | 581664 | Stop
OC4J | OC4J_EMPROV | 1114300 | Alive
WebCache | WebCache | 975082 | Alive
WebCache | WebCacheAdmin | 237646 | Alive

The <OMS_HOME>/opmn/logs/OC4J~home~default_island~1 shows:

07/07/06 15:49:55 Warning: Error reading transaction-log file (<OMS_HOME>/j2ee/home/persistence/home_default_island_1/transaction.state) for recovery: premature end of file
07/07/06 15:49:55 Forced or abrupt (crash etc) server shutdown detected, starting recovery process...
07/07/06 15:49:55 Recovery completed, 0 connections committed and 0 rolled back...
07/07/06 15:49:56 Oracle Application Server Containers for J2EE 10g (10.1.2.0.2) initialized

--------
07/07/09 09:22:42 Stop process
--------
Error: Could not connect to the remote server. Please check if the server is down or the client is using invalid host, ORMI port or password to connect: Connection refused

The file <OMS_HOME>/opmn/logs/ipm.log shows following:

07/07/09 13:16:18 [4] [libopmnoc4j] Forcefully Terminating Process: OC4J~home~default_island~1 (1451294726:573466)
07/07/09 13:16:18 [4] [libopmnoc4j] Forcefully Terminating Process: OC4J~OC4J_EM~default_island~1 (1451294725:581664)
07/07/09 13:18:20 [4] Stopping Process: OC4J~OC4J_EM~default_island~1 (1451294725:581664)
07/07/09 13:18:20 [4] [libopmnoc4j] Forcefully Terminating Process: OC4J~OC4J_EM~default_island~1 (1451294725:581664)
07/07/09 13:18:20 [4] Stopping Process: OC4J~home~default_island~1 (1451294726:573466)



The "opmnctl status" command shows that the OC4J_EM  process as always in a status of "Stop" and the Grid Console functionality is not available.
The ipm.log shows that OPMN is constantly trying to stop but never starts the OC4J_EM managed process.

Changes

Unclean shutdown of the opmnctl processes due to the machine crash / rebooted or any other reason, resulting in abnormal termination of the opmn processes.

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!

In this Document
Symptoms
Changes
Cause
Solution
References

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.