Starting 11g wls_ods1 Managed Server Fails with: Failed to obtain DB connection from data source 'schedulerDS' | IO Error: Socket read timed out (Doc ID 1682456.1)

Last updated on AUGUST 30, 2023

Applies to:

Symptoms

After performing a fresh installation of OID 11.1.1.7.0 and RDBMS 11.2.0.1.0 you find that when starting wls_ods1 managed server you get the following errors:

$DOMAIN_HOME/servers/wls_ods1/logs/wls_ods1.log file shows:

When going into Weblogic Server Administration Console --> Services--> Datasources then select "schedulerDS"--> Monitoring--> Testing and testing the "wls_ods1" datasource you also get an error message:

Test of schedulerDS on server wls_ods1 failed, reason:
Connection test failed with the following exception: weblogic.common.resourcepool.ResourceDeadException: 0:weblogic.common.ResourceException: Could not create pool connection. The DBMS driver exception was: IO Error: Socket read timed out

Additional symptoms from logs:

[2018-10-13T05:08:40.122-04:00] [wls_ods1] [ERROR] [] [org.quartz.impl.jdbcjobstore.JobStoreTX] [tid: QuartzScheduler_DefaultQuartzScheduler-xxxxx0_ClusterManager] [userId: <anonymous>] [ecid: <ECID>] [APP: DIP#11.1.1.2.0] ClusterManager: Error managing cluster: Failed to obtain DB connection from data source 'schedulerDS': java.sql.SQLException: Could not retrieve datasource via JNDI url 'jdbc/schedulerDS' weblogic.jdbc.extensions.PoolLimitSQLException: weblogic.common.resourcepool.ResourceLimitException: No resources currently available in pool schedulerDS to allocate to applications, please increase the size of the pool and retry..[[
org.quartz.JobPersistenceException: Failed to obtain DB connection from data source 'schedulerDS': java.sql.SQLException: Could not retrieve datasource via JNDI url 'jdbc/schedulerDS' weblogic.jdbc.extensions.PoolLimitSQLException: weblogic.common.resourcepool.ResourceLimitException: No resources currently available in pool schedulerDS to allocate to applications, please increase the size of the pool and retry.. [See nested exception: java.sql.SQLException: Could not retrieve datasource via JNDI url 'jdbc/schedulerDS' weblogic.jdbc.extensions.PoolLimitSQLException: weblogic.common.resourcepool.ResourceLimitException: No resources currently available in pool schedulerDS to allocate to applications, please increase the size of the pool and retry..]
at org.quartz.impl.jdbcjobstore.JobStoreSupport.getConnection(JobStoreSupport.java:636)
at org.quartz.impl.jdbcjobstore.JobStoreTX.getNonManagedTXConnection(JobStoreTX.java:72)
at org.quartz.impl.jdbcjobstore.JobStoreSupport.doCheckin(JobStoreSupport.java:3070)
at org.quartz.impl.jdbcjobstore.JobStoreSupport$ClusterManager.manage(JobStoreSupport.java:3713)
at org.quartz.impl.jdbcjobstore.JobStoreSupport$ClusterManager.run(JobStoreSupport.java:3749)
Caused by: java.sql.SQLException: Could not retrieve datasource via JNDI url 'jdbc/schedulerDS' weblogic.jdbc.extensions.PoolLimitSQLException: weblogic.common.resourcepool.ResourceLimitException: No resources currently available in pool schedulerDS to allocate to applications, please increase the size of the pool and retry..
at org.quartz.utils.JNDIConnectionProvider.getConnection(JNDIConnectionProvider.java:166)
at org.quartz.utils.DBConnectionManager.getConnection(DBConnectionManager.java:112)
at org.quartz.impl.jdbcjobstore.JobStoreSupport.getConnection(JobStoreSupport.java:633)
... 4 more

also

First -- DIP hit errors connecting to DB in prov profile

[2018-08-31T19:36:33.607-04:00] [wls_ods1] [NOTIFICATION] [] [oracle.dip] [tid: <EXPORT_PROFILE>] [userId: <anonymous>] [ecid: <ECID>] [APP: DIP#11.1.1.2.0] End of Execution
[2018-08-31T19:36:36.612-04:00] [wls_ods1] [ERROR] [DIP-20050] [oracle.dip.<EXPORT_PROFILE>] [tid: <EXPORT_PROFILE>] [userId: <anonymous>] [ecid: <ECID>] [APP: DIP#11.1.1.2.0] connecting as : URL : jdbc:oracle:thin:@oracle10:10710:orcl , User : APPS
[2018-08-31T19:36:36.613-04:00] [wls_ods1] [ERROR] [DIP-20052] [oracle.<EXPORT_PROFILE>] [tid: <EXPORT_PROFILE>] [userId: <anonymous>] [ecid: <ECID>] [APP: DIP#11.1.1.2.0] Exception on connecting to DB.[[
java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish the connection
at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:489)
at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:678)

And then schedulerDS errors

[2018-09-01T23:13:14.566-04:00] [wls_ods1] [NOTIFICATION] [DIP-10535] [oracle.dip.update] [tid: Scheduler] [userId: <anonymous>] [ecid: <ECID>] [APP: DIP#11.1.1.2.0] profile added successfully for scheduling : orcl_orcl10
[2018-09-01T23:13:14.589-04:00] [wls_ods1] [ERROR] [] [oracle.dip] [tid: Scheduler] [userId: <anonymous>] [ecid: <ECID>] [APP: DIP#11.1.1.2.0] ERROR_SUBMITTING_JOBS[[
org.quartz.JobPersistenceException: Failed to obtain DB connection from data source 'schedulerDS': java.lang.AssertionError: java.lang.ClassNotFoundException: weblogic.jdbc.wrapper.PoolConnection [See nested exception: java.lang.AssertionError: java.lang.ClassNotFoundException: weblogic.jdbc.wrapper.PoolConnection]
at org.quartz.impl.jdbcjobstore.JobStoreSupport.getConnection(JobStoreSupport.java:640)
at org.quartz.impl.jdbcjobstore.JobStoreTX.getNonManagedTXConnection(JobStoreTX.java:72)
at org.quartz.impl.jdbcjobstore.JobStoreSupport.executeInNonManagedTXLock(JobStoreSupport.java:3659)
at org.quartz.impl.jdbcjobstore.JobStoreTX.executeInLock(JobStoreTX.java:93)

Changes

 New installation of OID 

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.