My Oracle Support Banner

WebLogic (WLS) Domain Configuration Wizard Using Shared Server Database Fails at 95%: CFGFWK-64254: Error occurred in "Post Processing" phase execution / JPS-00027 java.sql.SQLRecoverableException: Closed Connection / No more data to read from socket (Doc ID 2847038.1)

Last updated on FEBRUARY 07, 2022

Applies to:

Oracle Platform Security for Java - Version 12.2.1.4.0 and later
Oracle Fusion Middleware - Version 12.2.1.4.0 and later
JDBC - Version 19.3 and later
Oracle Database - Enterprise Edition - Version 19.0.0.0 and later
Information in this document applies to any platform.

Symptoms

Installing and configuring application integrated with WebLogic Server (WLS), e.g. Oracle Identity Manager (OIM) 12c.

Created the schema successfully using RCU. Database (DB) using shared server.

Attempting to run the Domain Configuration Wizard following the steps documented in:

Oracle® Fusion Middleware Installing and Configuring Oracle Identity and Access Management 12c (12.1.2.4.0)
Chapter 4 Installing and Configuring the Oracle Identity Governance Software
Section Configuring the Domain

It fails at 95% in the "Post Processing" stage with error:

CFGFWK-64254: Error occurred in "Post Processing" phase execution
Encountered error: oracle.security.opss.tools.lifecycle.LifecycleException: JPS-00027: There was an internal error: java.sql.SQLRecoverableException:
Closed Connection

And/Or:

IO Error: Socket read timed out
Error Code: 17002
Error occurred when commiting changes, calling abort method to clean up the environment
oracle.security.jps.service.policystore.PolicyStoreConnectivityException: JPS-00027: There was an internal error: java.sql.SQLRecoverableException: Closed Connection
Error Code: 17008

The same occurs with either the baseline version or with latest patches applied.

Was previously getting SQLException 17410 and JPS-00027. Found and applied the following Doc Id, using  "-Doracle.jdbc.ReadTimeout=180000"  :  No more data to read in the socket (Doc ID 2667165.1)

But the config wizard still fails, but instead of 17410, now getting SQLExceptions 17002 and 17008 along with JPS-00027.

Tried dropping the schema via the RCU, and then recreate the schema via the RCU before each attempt, to no help.

The database team reports deadlocks at the time, such as:

deadlock detected; shared servers=10, max servers=10, processes=127
2022-01-19T03:35:28.876713-05:00

AWR report shows there are issues with:

SQL statement with SQL_ID 1kjg5c0hbmh97.
SELECT entity_key FROM jps_entity_lock jol WHERE (jol.entity_key = :1) FOR UPDATE

Elapsed Time (s) Executions Elapsed Time per Exec (s) %Total %CPU %IO SQL Id SQL Module SQL Text
7,739.66 508 15.24 100.11 0.00 0.00 1kjg5c0hbmh97 JDBC Thin Client SELECT entity_key FROM jps_entity_lock jol WHERE (jol.entity_key = :1) FOR UPDATE


Confirmed that can connect with any/all schema from SQL Developer. The issue happens "out of the box" by running the Infrastructure, SOA, and OIM install jars, then creating the schema via the RCU, then running the Domain Config Wizard and it fails at 95%.

Can reproduce the issue at will by running the RCU, dropping the schema, deleting the incomplete domain files, removing the reference in the domain registry xml, running the RCU again and recreating the schema, then running the config wizard and again it fails at 95%.


Config.log errors examples:

2022-01-28 11:31:03,128 WARNING [157] null -
Local Exception Stack:
Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.7.v20190604-418f1a1c56): org.eclipse.persistence.exceptions.DatabaseException
Internal Exception: java.sql.SQLRecoverableException: No more data to read from socket
Error Code: 17410
Query: DataReadQuery(sql="SELECT entity_key FROM jps_entity_lock jol WHERE (jol.entity_key = ?) FOR UPDATE")
at org.eclipse.persistence.exceptions.DatabaseException.sqlException(DatabaseException.java:331)
at org.eclipse.persistence.exceptions.DatabaseException.sqlException(DatabaseException.java:326)
at org.eclipse.persistence.sessions.DefaultConnector.connect(DefaultConnector.java:138)
at org.eclipse.persistence.sessions.DatasourceLogin.connectToDatasource(DatasourceLogin.java:162)
at org.eclipse.persistence.internal.databaseaccess.DatasourceAccessor.connectInternal(DatasourceAccessor.java:346)
at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.connectInternal(DatabaseAccessor.java:309)
at org.eclipse.persistence.internal.databaseaccess.DatasourceAccessor.connect(DatasourceAccessor.java:434)
at org.eclipse.persistence.sessions.server.ConnectionPool.buildConnection(ConnectionPool.java:217)
at org.eclipse.persistence.sessions.server.ConnectionPool.acquireConnection(ConnectionPool.java:136)
at org.eclipse.persistence.sessions.server.ServerSession.acquireClientConnection(ServerSession.java:249)
at org.eclipse.persistence.sessions.server.ClientSession.executeCall(ClientSession.java:280)
at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.executeCall(DatasourceCallQueryMechanism.java:260)
at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.executeCall(DatasourceCallQueryMechanism.java:246)
at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.executeSelectCall(DatasourceCallQueryMechanism.java:317)
at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.executeSelect(DatasourceCallQueryMechanism.java:299)
at org.eclipse.persistence.queries.DataReadQuery.executeNonCursor(DataReadQuery.java:197)
at org.eclipse.persistence.queries.DataReadQuery.executeDatabaseQuery(DataReadQuery.java:152)
at org.eclipse.persistence.queries.DatabaseQuery.execute(DatabaseQuery.java:911)
at org.eclipse.persistence.queries.DataReadQuery.execute(DataReadQuery.java:137)
at org.eclipse.persistence.queries.DatabaseQuery.executeInUnitOfWork(DatabaseQuery.java:810)
at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.internalExecuteQuery(UnitOfWorkImpl.java:2899)
at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1863)
at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1845)
at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1810)
at org.eclipse.persistence.internal.jpa.QueryImpl.executeReadQuery(QueryImpl.java:258)
at org.eclipse.persistence.internal.jpa.QueryImpl.getResultList(QueryImpl.java:478)
at oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager.lockEntityRow(JpsDBDataManager.java:2412)
at oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager.getLock(JpsDBDataManager.java:2380)
at oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager.beginTransactionInDoAs(JpsDBDataManager.java:2251)
at oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager.beginTransaction(JpsDBDataManager.java:2238)
at oracle.security.jps.internal.policystore.ldap.PermissionManagerImpl.modifyPermission(PermissionManagerImpl.java:722)
at oracle.security.jps.internal.tools.utility.destination.apibased.JpsDstPolicy$ParallelPermissionMigrator.migrate(JpsDstPolicy.java:3524)
at oracle.security.jps.internal.tools.utility.destination.apibased.JpsDstPolicy$PermissionMigratorThread.run(JpsDstPolicy.java:3558)
Caused by: java.sql.SQLRecoverableException: No more data to read from socket
at oracle.jdbc.driver.T4CMAREngineNIO.prepareForUnmarshall(T4CMAREngineNIO.java:784)
at oracle.jdbc.driver.T4CMAREngineNIO.unmarshalUB1(T4CMAREngineNIO.java:429)
at oracle.jdbc.driver.T4C8TTIpro.receive(T4C8TTIpro.java:134)
at oracle.jdbc.driver.T4CConnection.connect(T4CConnection.java:1628)
at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:588)
at oracle.jdbc.driver.PhysicalConnection.connect(PhysicalConnection.java:793)
at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:57)
at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:747)
at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:562)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.eclipse.persistence.sessions.DefaultConnector.connect(DefaultConnector.java:98)
... 30 more
2022-01-28 11:31:03,128 FINE  [157] oracle.security.jps.internal.policystore.rdbms.DBStoreManager - JpsDataManager ThreadLocal being removed: current JpsDBDataManager='[Ljava.lang.Object;@24474b3b'
2022-01-28 11:31:03,128 WARNING [157] ParallelPermissionMigrator - Migrate Permission Name = 3DA4FAEB508A4B25BA505B769F3CAEAA, Exception during modification of permission. Message = JPS-00027: There was an internal error: java.sql.SQLRecoverableException: No more data to read from socket.
2022-01-28 11:31:03,128 WARNING [157] ParallelPermissionMigrator - Miagrtion failed in Perm Member : [; jaznGranteeDn=orclguid=EB58A72BD23C446B830814F81A0E0A45,cn=Grantees,cn=JAAS Policy,cn=soa-infra,cn=opssSecurityStore,cn=JPSContext,cn=opssRoot].
2022-01-28 11:31:03,128 FINE  [157] oracle.security.jps.internal.common.util.JpsCommonUtil - JpsConfigUtil.getJpsFarmDN - rootDn: null
2022-01-28 11:31:03,128 FINE  [157] oracle.security.jps.internal.common.util.JpsCommonUtil - JpsCommonUtil.getJpsFarmDN - rootNameDN: cn=opssRoot, farmNameDN: cn=opssSecurityStore
2022-01-28 11:31:03,128 FINE  [157] oracle.security.jps.internal.common.util.JpsCommonUtil - JpsCommonUtil.getJpsFarmDN - farmDN: cn=opssSecurityStore,cn=JPSContext,cn=opssRoot
2022-01-28 11:31:03,128 FINE  [157] oracle.security.jps.internal.policystore.rdbms.DBStoreManager - JpsDataManager ThreadLocal: current='null', new='oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager@17b53b95'
2022-01-28 11:31:03,128 CONFIG [157] null - connecting(DatabaseLogin(
platform=>Oracle12Platform
user name=> "<prefix>_OPSS"
datasource URL=> "jdbc:oracle:thin:@//<DB hostname>:<port>/<service name>"
))

 

2022-01-19 22:49:44,246 WARNING [159] null -
Local Exception Stack:
Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.7.v20190604-418f1a1c56): org.eclipse.persistence.exceptions.DatabaseException
Internal Exception: java.sql.SQLRecoverableException: IO Error: Socket read timed out
Error Code: 17002
Call: SELECT entity_key FROM jps_entity_lock jol WHERE (jol.entity_key = ?) FOR UPDATE
bind => [1 parameter bound]
Query: DataReadQuery(sql="SELECT entity_key FROM jps_entity_lock jol WHERE (jol.entity_key = ?) FOR UPDATE")
at org.eclipse.persistence.exceptions.DatabaseException.sqlException(DatabaseException.java:340)
at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.processExceptionForCommError(DatabaseAccessor.java:1620)

Caused by: java.sql.SQLRecoverableException: IO Error: Socket read timed out
at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:993)
at oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1012)
... 25 more
Caused by: oracle.net.nt.TimeoutInterruptHandler$IOReadTimeoutException: Socket read timed out
at oracle.net.nt.TimeoutSocketChannel.handleInterrupt(TimeoutSocketChannel.java:254)
at oracle.net.nt.TimeoutSocketChannel.read(TimeoutSocketChannel.java:180)
at oracle.net.ns.NSProtocolNIO.doSocketRead(NSProtocolNIO.java:555)


2022-01-19 22:49:45,029 FINE  [96] oracle.security.jps.internal.tools.utility.destination.apibased.JpsDstPolicy - Total Available Memory after migration caches and applications were cleared : 237036704
2022-01-19 22:49:45,029 SEVERE [96] oracle.security.opss.tools.lifecycle.ProductArtifactsConfigDelegate - Error occurred when commiting changes, calling abort method to clean up the environment
oracle.security.jps.service.policystore.PolicyStoreConnectivityException: JPS-00027: There was an internal error: java.sql.SQLRecoverableException: Closed Connection
at oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager.handleDatabaseException(JpsDBDataManager.java:2303)
at oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager.processJPAException(JpsDBDataManager.java:2808)
at oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager.internalRollbackTxn(JpsDBDataManager.java:2586)
at oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager.rollbackTransaction(JpsDBDataManager.java:2568)
at oracle.security.jps.internal.policystore.ldap.PermissionManagerImpl.modifyPermission(PermissionManagerImpl.java:730)
at oracle.security.jps.internal.tools.utility.destination.apibased.JpsDstPolicy$ParallelPermissionMigrator.migrate(JpsDstPolicy.java:3524)
at oracle.security.jps.internal.tools.utility.destination.apibased.JpsDstPolicy$PermissionMigratorThread.run(JpsDstPolicy.java:3558)
Caused by: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.7.v20190604-418f1a1c56): org.eclipse.persistence.exceptions.DatabaseException
Internal Exception: java.sql.SQLRecoverableException: Closed Connection
Error Code: 17008
at org.eclipse.persistence.exceptions.DatabaseException.sqlException(DatabaseException.java:340)
at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.processExceptionForCommError(DatabaseAccessor.java:1620)
at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.basicRollbackTransaction(DatabaseAccessor.java:1715)
at org.eclipse.persistence.internal.databaseaccess.DatasourceAccessor.rollbackTransaction(DatasourceAccessor.java:688)
at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.rollbackTransaction(DatabaseAccessor.java:1700)
at org.eclipse.persistence.internal.sessions.AbstractSession.basicRollbackTransaction(AbstractSession.java:841)
at org.eclipse.persistence.sessions.server.ClientSession.basicRollbackTransaction(ClientSession.java:207)
at org.eclipse.persistence.internal.sessions.AbstractSession.rollbackTransaction(AbstractSession.java:3873)
at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.rollbackTransaction(UnitOfWorkImpl.java:4671)
at org.eclipse.persistence.internal.sessions.RepeatableWriteUnitOfWork.rollbackTransaction(RepeatableWriteUnitOfWork.java:532)
at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.release(UnitOfWorkImpl.java:4477)
at org.eclipse.persistence.internal.jpa.transaction.EntityTransactionImpl.rollback(EntityTransactionImpl.java:187)
at oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager.internalRollbackTxn(JpsDBDataManager.java:2582)
... 4 more
Caused by: java.sql.SQLRecoverableException: Closed Connection
at oracle.jdbc.driver.PhysicalConnection.getAutoCommit(PhysicalConnection.java:2089)
at oracle.jdbc.driver.PhysicalConnection.rollback(PhysicalConnection.java:2218)
at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.basicRollbackTransaction(DatabaseAccessor.java:1709)
... 14 more
2022-01-19 22:49:45,029 SEVERE [96] oracle.security.opss.tools.lifecycle.cie.OpssSecurityConfiguration - Error while processing end method. Exception oracle.security.opss.tools.lifecycle.LifecycleException: JPS-00027: There was an internal error: java.sql.SQLRecoverableException: Closed Connection
2022-01-19 22:49:45,029 SEVERE [96] com.oracle.cie.domain.progress.AbstractProgressGenerator - Error occurred in phase {Post Processing} execution.
com.oracle.cie.domain.security.external.ConfigSecurityException: oracle.security.opss.tools.lifecycle.LifecycleException: JPS-00027: There was an internal error: java.sql.SQLRecoverableException: Closed Connection
at oracle.security.opss.tools.lifecycle.cie.OpssSecurityConfiguration.end(OpssSecurityConfiguration.java:241)
at com.oracle.cie.domain.opss.SecurityConfigurationFactoryRunner.end(SecurityConfigurationFactoryRunner.java:171)
at com.oracle.cie.domain.progress.domain.generation.PostGenerationPhase.execute(PostGenerationPhase.java:156)
at com.oracle.cie.domain.progress.AbstractProgressGenerator.run(AbstractProgressGenerator.java:94)
at java.lang.Thread.run(Thread.java:750)
Caused by: oracle.security.opss.tools.lifecycle.LifecycleException: JPS-00027: There was an internal error: java.sql.SQLRecoverableException: Closed Connection
at oracle.security.opss.tools.lifecycle.ProductArtifactsConfigDelegate.end(ProductArtifactsConfigDelegate.java:688)
at oracle.security.opss.tools.lifecycle.ProductArtifactsConfigImpl.end(ProductArtifactsConfigImpl.java:361)
at oracle.security.opss.tools.lifecycle.cie.OpssSecurityConfiguration.end(OpssSecurityConfiguration.java:234)
... 4 more
Caused by: oracle.security.jps.service.policystore.PolicyStoreConnectivityException: JPS-00027: There was an internal error: java.sql.SQLRecoverableException: Closed Connection
at oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager.handleDatabaseException(JpsDBDataManager.java:2303)
at oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager.processJPAException(JpsDBDataManager.java:2808)
at oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager.internalRollbackTxn(JpsDBDataManager.java:2586)
at oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager.rollbackTransaction(JpsDBDataManager.java:2568)
at oracle.security.jps.internal.policystore.ldap.PermissionManagerImpl.modifyPermission(PermissionManagerImpl.java:730)
at oracle.security.jps.internal.tools.utility.destination.apibased.JpsDstPolicy$ParallelPermissionMigrator.migrate(JpsDstPolicy.java:3524)
at oracle.security.jps.internal.tools.utility.destination.apibased.JpsDstPolicy$PermissionMigratorThread.run(JpsDstPolicy.java:3558)
Caused by: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.7.v20190604-418f1a1c56): org.eclipse.persistence.exceptions.DatabaseException
Internal Exception: java.sql.SQLRecoverableException: Closed Connection

Exception:

oracle.security.opss.tools.lifecycle.LifecycleException: JPS-00027: There was an internal error: java.sql.SQLRecoverableException: Closed Connection

com.oracle.cie.domain.security.external.ConfigSecurityException: oracle.security.opss.tools.lifecycle.LifecycleException: JPS-00027: There was an internal error: java.sql.SQLRecoverableException: Closed Connection
at oracle.security.opss.tools.lifecycle.cie.OpssSecurityConfiguration.end(OpssSecurityConfiguration.java:241)
at com.oracle.cie.domain.opss.SecurityConfigurationFactoryRunner.end(SecurityConfigurationFactoryRunner.java:171)
at com.oracle.cie.domain.progress.domain.generation.PostGenerationPhase.execute(PostGenerationPhase.java:156)
at com.oracle.cie.domain.progress.AbstractProgressGenerator.run(AbstractProgressGenerator.java:94)
at java.lang.Thread.run(Thread.java:750)
Caused by: oracle.security.opss.tools.lifecycle.LifecycleException: JPS-00027: There was an internal error: java.sql.SQLRecoverableException: Closed Connection
at oracle.security.opss.tools.lifecycle.ProductArtifactsConfigDelegate.end(ProductArtifactsConfigDelegate.java:688)
at oracle.security.opss.tools.lifecycle.ProductArtifactsConfigImpl.end(ProductArtifactsConfigImpl.java:361)
at oracle.security.opss.tools.lifecycle.cie.OpssSecurityConfiguration.end(OpssSecurityConfiguration.java:234)
... 4 more
Caused by: oracle.security.jps.service.policystore.PolicyStoreConnectivityException: JPS-00027: There was an internal error: java.sql.SQLRecoverableException: Closed Connection

 

Changes

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!

In this Document
Symptoms
Changes
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.