TESS 2.0 OAM PROD OUTAGE - DC2 Servers Went To Warning State

(Doc ID 2365908.1)

Last updated on MARCH 05, 2018

Applies to:

Oracle Coherence - Version 3.7.1.1 and later
Information in this document applies to any platform.

Symptoms

On : 3.7.1.1 version, Clustering,Network,Membership

OAM PROD OUTAGE - servers went to warning state

OAM protected applications in production environment were reporting slowness/intermittent issues with SSO functionality.
We could observe the OAM managed servers were in 'Warning' state and not serving the requests.

Required logs ( diagnostic logs, jfr dumps) will be uploaded.

Please let us know, if more details are needed.

Thanks,

ERROR
-----------------------

"[STUCK] ExecuteThread: '36' for queue: 'weblogic.kernel.Default
(self-tuning)'" daemon prio=3 tid=0x000000010ad0c800 nid=0x20582 in
Object.wait() [0xffffffff323fb000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at
com.tangosol.util.SegmentedConcurrentMap$LockableEntry.waitForNotify(Segmented
ConcurrentMap.java:939)
        at
com.tangosol.util.SegmentedConcurrentMap.lock(SegmentedConcurrentMap.java:370)

        - locked (a
com.tangosol.util.SegmentedConcurrentMap$LockableEntry)
        at com.tangosol.net.cache.CachingMap.get(CachingMap.java:474)
        at
oracle.security.am.foundation.mapimpl.coherence.CoherenceMapImpl.get(Coherence
MapImpl.java:955)
        at
oracle.security.am.engines.sme.mgr.AbstractSessionManager.findSessionWithoutUp
date(AbstractSessionManager.java:1367)
        at
oracle.security.am.engines.sso.adapter.AbstractSessionAdapterImpl.retrieveSess
ion(AbstractSessionAdapterImpl.java:466)
        at
oracle.security.am.engines.sso.adapter.AbstractSessionAdapterImpl.retrieveActi
veSession(AbstractSessionAdapterImpl.java:415)
        at
oracle.security.am.engines.enginecontroller.heartbeat.OAMServerHeartBeat.check
ServerHeartBeat(OAMServerHeartBeat.java:130)
        at
oracle.security.am.engines.enginecontroller.SSOEngineController.processEvent(S
SOEngineController.java:795)
        at
oracle.security.am.controller.MasterController.processEvent(MasterController.j
ava:596)




STEPS
-----------------------
The issue can be reproduced at will with the following steps:
1.
2.
3.

BUSINESS IMPACT
-----------------------
The issue has the following business impact:
Due to this issue, users cannot .

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms