My Oracle Support Banner

EM 13.4: OMS Restarts With "OMS Heartbeat Recorder error: Heartbeat recorder timed out" emoms_pbs.trc Reports "Error dequeuing admininstrative message IO Error: Socket connect timed out" (Doc ID 2796108.1)

Last updated on AUGUST 21, 2021

Applies to:

Enterprise Manager Base Platform - Version 13.4.0.0.0 to 13.4.0.0.0 [Release 13c]
Information in this document applies to any platform.

Symptoms

EM 13c OMS Restarts with the following error reporting in emctl.msg file

HealthMonitor Jan 30, 2021 2:08:09 AM OMS Heartbeat Recorder error: Heartbeat recorder timed out. OMS id=153
Critical error err=3 detected in module OMS Heartbeat Recorder
OMS will be restarted. A full thread dump will be generated in the log file
/../oem13c/gc_inst/user_projects/domains/GCDomain/servers/EMGC_OMS1/logs/EMGC_OMS1.out

Repository database is in RAC.

emoms_pbs.trc file reports following errors:

2021-01-30 01:37:02,949 [PingHeartBeatRecorder:PingHeartBeatWork::0] ERROR ping.PingHeartBeatWork updateEMDListHeartBeat.281 - Exception caught while recording.. IO Error: Connection reset by peer
java.sql.SQLRecoverableException: IO Error: Connection reset by peer
at oracle.jdbc.driver.T4CCallableStatement.executeForRows(T4CCallableStatement.java:930)
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1194)
at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3833)
at oracle.jdbc.driver.T4CCallableStatement.executeInternal(T4CCallableStatement.java:1301)
at oracle.jdbc.driver.OraclePreparedStatement.execute(OraclePreparedStatement.java:3940)

2021-01-30 01:39:02,257 [PbsAdminMsgListener] WARN jdbc.ConnectionCache _getConnection.450 - Got a fatal exeption when getting a connection; Error code = 17002; Cleaning up cache and retrying
2021-01-30 01:39:07,259 [PbsAdminMsgListener] ERROR adminmsg.PbsAdminMsgListener run.227 - Error dequeuing admininstrative message IO Error: Socket connect timed out
java.sql.SQLRecoverableException: IO Error: Socket connect timed out
at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:775)
at oracle.jdbc.driver.PhysicalConnection.connect(PhysicalConnection.java:819)
at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:40)
at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:704)

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!

In this Document
Symptoms
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.