Thread Gets Stuck On a File Read As a Consequence of Trying to Establish a Secure Database Connection On Oracle Enterprise Linux (Doc ID 1420968.1)

Last updated on NOVEMBER 03, 2016

Applies to:

Oracle Coherence - Version 3.5.0 and later
Information in this document applies to any platform.
***Checked for relevance on 31-Jul-2013***

Symptoms

Problem 1:

It is observed that after starting the cache servers we observe the following InterruptedException in the logs :

[2012-02-19T12:08:31.815+01:00] [server_oam_DEV01] [ERROR] [] [Coherence] [tid: Logger@9272718 3.5.3/465p2] [userId: <anonymous>] [ecid: ff71ab29a4f15752:-12e19bdb:135954bd256:-8000-0000000000000002,0] [APP: oam_server] 2012-02-19 12:08:31.815/218.222 Oracle Coherence GE 3.5.3/465p2 <Error> (thread=Cluster, member=3): Terminating guarded execution (due to hard timeout) of Guard{Daemon=DistributedCache}
[2012-02-19T12:08:32.223+01:00] [server_oam_DEV01] [ERROR] [] [Coherence] [tid: Logger@9272718 3.5.3/465p2] [userId: <anonymous>] [ecid: ff71ab29a4f15752:-12e19bdb:135954bd256:-8000-0000000000000002,0] [APP: oam_server] 2012-02-19 12:08:32.223/218.630 Oracle Coherence GE 3.5.3/465p2 <Error> (thread=DistributedCache, member=3): BackingMapManager com.tangosol.net.DefaultConfigurableCacheFactory$Manager: failed to instantiate a cache: oracle.ngam.sme.SmeCache
[2012-02-19T12:08:32.226+01:00] [server_oam_DEV01] [ERROR] [] [Coherence] [tid: Logger@9272718 3.5.3/465p2] [userId: <anonymous>] [ecid: ff71ab29a4f15752:-12e19bdb:135954bd256:-8000-0000000000000002,0] [APP: oam_server] 2012-02-19
12:08:32.224/218.631 Oracle Coherence GE 3.5.3/465p2 <Error> (thread=DistributedCache, member=3): [[
(Wrapped) java.lang.InterruptedException
at com.tangosol.util.Base.ensureRuntimeException(Base.java:293)
at com.tangosol.util.Base.ensureRuntimeException(Base.java:269)
at com.tangosol.util.Daemon.finishStarting(Daemon.java:513)
at com.tangosol.util.Daemon.start(Daemon.java:355)



Problem 2:

From a review of the error log provided, it appears that there is a very consistent pattern in the behavior - Coherence cluster service fails to startup completely with the DistributedCache thread hanging.

Thread[DistributedCache,5,Cluster]
java.io.FileInputStream.readBytes(FileInputStream.java)
java.io.FileInputStream.read(FileInputStream.java:220)
sun.security.provider.SeedGenerator$URLSeedGenerator.getSeedBytes(SeedGenerator.java:493)
sun.security.provider.SeedGenerator.generateSeed(SeedGenerator.java:117)
sun.security.provider.SecureRandom.engineGenerateSeed(SecureRandom.java:114)
sun.security.provider.SecureRandom.engineNextBytes(SecureRandom.java:171)
java.security.SecureRandom.nextBytes(SecureRandom.java:433)
oracle.security.o5logon.O5LoginClientHelper.generateOAuthResponse(Unknown Source)
oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.java:706)
oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:376)
oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:670)
oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:230)
oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:34)
oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:567)
weblogic.jdbc.common.internal.ConnectionEnvFactory.makeConnection(ConnectionEnvFactory.java:350)
weblogic.jdbc.common.internal.ConnectionEnvFactory.createResource(ConnectionEnvFactory.java:236)
weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1249)
weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1166)
weblogic.common.resourcepool.ResourcePoolImpl.reserveResourceInternal(ResourcePoolImpl.java:450)
weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:342)
weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:329)
weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:417)
weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:324)
weblogic.jdbc.common.internal.ConnectionPoolManager.reserve(ConnectionPoolManager.java:94)
weblogic.jdbc.common.internal.ConnectionPoolManager.reserve(ConnectionPoolManager.java:115)
weblogic.jdbc.pool.Driver.connect(Driver.java:150)
weblogic.jdbc.jts.Driver.getNonTxConnection(Driver.java:651)
weblogic.jdbc.jts.Driver.connect(Driver.java:127)
weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:364)
oracle.security.am.foundation.mapimpl.coherence.store.DataConnectionUtility.configureConnection(DataConnectionUtility.java:223)
oracle.security.am.foundation.mapimpl.coherence.store.DataConnectionUtility.getConnection(DataConnectionUtility.java:191)
oracle.security.am.engines.sme.mapimpl.db.DbOraSmeStore.checkStoreVersion(DbOraSmeStore.java:289)
oracle.security.am.engines.sme.mapimpl.db.DbOraSmeStore.<init>(DbOraSmeStore.java:178)
oracle.security.am.engines.sme.mapimpl.db.DbOraSmeStore.<init>(DbOraSmeStore.java:333)
sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
java.lang.reflect.Constructor.newInstance(Constructor.java:513)
com.tangosol.util.ClassHelper.newInstance(ClassHelper.java:615)
com.tangosol.run.xml.XmlHelper.createInstance(XmlHelper.java:2297)
com.tangosol.net.DefaultConfigurableCacheFactory.instantiateAny(DefaultConfigurableCacheFactory.java:2994)
com.tangosol.net.DefaultConfigurableCacheFactory.instantiateCacheStore(DefaultConfigurableCacheFactory.java:2857)
com.tangosol.net.DefaultConfigurableCacheFactory.instantiateReadWriteBackingMap(DefaultConfigurableCacheFactory.java:1493)
com.tangosol.net.DefaultConfigurableCacheFactory.configureBackingMap(DefaultConfigurableCacheFactory.java:1258)
com.tangosol.net.DefaultConfigurableCacheFactory$Manager.instantiateBackingMap(DefaultConfigurableCacheFactory.java:3492)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$Storage.instantiateResourceMap(DistributedCache.CDB:22)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$Storage.setCacheName(DistributedCache.CDB:27)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache.ensureKnownStorage(DistributedCache.CDB:28)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache.onNotify(DistributedCache.CDB:21)
com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:42)



Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms