OMS is Timing Out when Starting and then Crashing
(Doc ID 2747339.1)
Last updated on NOVEMBER 16, 2022
Applies to:
Enterprise Manager Base Platform - Version 13.4.0.0.0 and laterInformation in this document applies to any platform.
Symptoms
Starting the OMS is very slow, the command is timing out and eventually, the OMS is crashing. The command is showing:
emctl start oms
Oracle Enterprise Manager Cloud Control 13c Release 4
Copyright (c) 1996, 2020 Oracle Corporation. All rights reserved.
Starting Oracle Management Server...
WebTier Successfully Started
Oracle Management Server Successfully Started
Oracle Management Server is intializing.
Context not fully initialized yet.
Check EM Server log file for details: /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/servers/EMGC_OMS1/logs/EMGC_OMS1.out
JVMD Engine is Up
Starting BI Publisher Server ...
BI Publisher Server Successfully Started
BI Publisher Server is Up
Oracle Enterprise Manager Cloud Control 13c Release 4
Copyright (c) 1996, 2020 Oracle Corporation. All rights reserved.
Starting Oracle Management Server...
WebTier Successfully Started
Oracle Management Server Successfully Started
Oracle Management Server is intializing.
Context not fully initialized yet.
Check EM Server log file for details: /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/servers/EMGC_OMS1/logs/EMGC_OMS1.out
JVMD Engine is Up
Starting BI Publisher Server ...
BI Publisher Server Successfully Started
BI Publisher Server is Up
Upon checking the EMGC_OMS1.out file, many blocked/stuck threads are observed such as:
"loaderjob-work-1 [Polling]" #235 daemon prio=5 os_prio=0 tid=0x00007f917c05e000 nid=0x2d28 waiting for monitor entry [0x00007f913bd85000]
java.lang.Thread.State: BLOCKED (on object monitor)
at java.net.InetAddress.getLocalHost(InetAddress.java:1487)
- waiting to lock <0x000000075a047290> (a java.lang.Object)
at oracle.jdbc.driver.T4CTTIoauthenticate.setSessionFields(T4CTTIoauthenticate.java:1474)
at oracle.jdbc.driver.T4CTTIoauthenticate.<init>(T4CTTIoauthenticate.java:292)
at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:600)
"NotificationMgrThread" #242 daemon prio=10 os_prio=0 tid=0x00007f919c084800 nid=0x2d72 waiting for monitor entry [0x00007f913b57f000]
java.lang.Thread.State: BLOCKED (on object monitor)
at java.net.InetAddress.getLocalHost(InetAddress.java:1487)
- waiting to lock <0x000000075a047290> (a java.lang.Object)
at oracle.jdbc.driver.T4CTTIoauthenticate.setSessionFields(T4CTTIoauthenticate.java:1474)
at oracle.jdbc.driver.T4CTTIoauthenticate.<init>(T4CTTIoauthenticate.java:292)
at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:600)
"[ACTIVE] ExecuteThread: '4' for queue: 'weblogic.kernel.Default (self-tuning)'" #35 daemon prio=5 os_prio=0 tid=0x00007f91c4001000 nid=0x2937 runnable [0x00007f91db4f5000]
java.lang.Thread.State: RUNNABLE
at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:929)
at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1324)
at java.net.InetAddress.getLocalHost(InetAddress.java:1501)
- locked <0x000000075a047290> (a java.lang.Object)
at oracle.jdbc.driver.T4CTTIoauthenticate.setSessionFields(T4CTTIoauthenticate.java:1474)
at oracle.jdbc.driver.T4CTTIoauthenticate.<init>(T4CTTIoauthenticate.java:292)
at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:600)
at oracle.jdbc.driver.PhysicalConnection.connect(PhysicalConnection.java:819)
java.lang.Thread.State: BLOCKED (on object monitor)
at java.net.InetAddress.getLocalHost(InetAddress.java:1487)
- waiting to lock <0x000000075a047290> (a java.lang.Object)
at oracle.jdbc.driver.T4CTTIoauthenticate.setSessionFields(T4CTTIoauthenticate.java:1474)
at oracle.jdbc.driver.T4CTTIoauthenticate.<init>(T4CTTIoauthenticate.java:292)
at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:600)
"NotificationMgrThread" #242 daemon prio=10 os_prio=0 tid=0x00007f919c084800 nid=0x2d72 waiting for monitor entry [0x00007f913b57f000]
java.lang.Thread.State: BLOCKED (on object monitor)
at java.net.InetAddress.getLocalHost(InetAddress.java:1487)
- waiting to lock <0x000000075a047290> (a java.lang.Object)
at oracle.jdbc.driver.T4CTTIoauthenticate.setSessionFields(T4CTTIoauthenticate.java:1474)
at oracle.jdbc.driver.T4CTTIoauthenticate.<init>(T4CTTIoauthenticate.java:292)
at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:600)
"[ACTIVE] ExecuteThread: '4' for queue: 'weblogic.kernel.Default (self-tuning)'" #35 daemon prio=5 os_prio=0 tid=0x00007f91c4001000 nid=0x2937 runnable [0x00007f91db4f5000]
java.lang.Thread.State: RUNNABLE
at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:929)
at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1324)
at java.net.InetAddress.getLocalHost(InetAddress.java:1501)
- locked <0x000000075a047290> (a java.lang.Object)
at oracle.jdbc.driver.T4CTTIoauthenticate.setSessionFields(T4CTTIoauthenticate.java:1474)
at oracle.jdbc.driver.T4CTTIoauthenticate.<init>(T4CTTIoauthenticate.java:292)
at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:600)
at oracle.jdbc.driver.PhysicalConnection.connect(PhysicalConnection.java:819)
Changes
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Changes |
| Cause |
| Solution |
| References |