My Oracle Support Banner

Spacewalk:Spacewalk-repo-sync Failed with Error "ORA-12537: TNS:connection closed" (Doc ID 2574137.1)

Last updated on JANUARY 25, 2021

Applies to:

Linux OS - Version Oracle Linux 7.0 with Unbreakable Enterprise Kernel [3.8.13] and later
Linux x86-64

Symptoms

Unable to sync the channels after upgrading spacewalk server to 2.7 and failed  with below error:

#spacewalk-repo-sync -p oraclelinux7-x86_64
Spacewalk 8804 2019/08/02 08:47:12 -04:00: ('Connection attempt failed', 12537, 'ORA-12537: TNS:connection closed\n')
Traceback (most recent call last):
  File "/usr/bin/spacewalk-repo-sync", line 257, in 
  sys.exit(abs(main() or 0))
  File "/usr/bin/spacewalk-repo-sync", line 131, in main
  d_chan_repo=reposync.getChannelRepo()
  File "/usr/lib/python2.7/site-packages/spacewalk/satellite_tools/reposync.py", line 192, in getChannelRepo

Below errors logged in /var/log/rhn/rhn_taskomatic_daemon.log

INFO | jvm 1 | 2019/08/02 08:39:28 | at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:44)
INFO | jvm 1 | 2019/08/02 08:39:28 | at com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask.run(BasicResourcePool.java:1814)
INFO | jvm 1 | 2019/08/02 08:39:28 | at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:696)
INFO | jvm 1 | 2019/08/02 08:39:28 | 2019-08-02 08:39:28,586 [C3P0PooledConnectionPoolManager[identityToken->10xjyv6a4mtkye833eqjj|6fd5741f]-HelperThread-#0] WARN com.mchange.v2.resourcepool.BasicResourcePool - Having failed to acquire a resource, com.mchange.v2.resourcepool.BasicResourcePool@18725aa6 is interrupting all Threads waiting on a resource to check out. Will try again in response to new client requests.
INFO | jvm 1 | 2019/08/02 08:40:00 | 2019-08-02 08:40:00,135 [DefaultQuartzScheduler_Worker-1] INFO com.redhat.rhn.taskomatic.task.ErrataCacheTask - In the queue: 1
INFO | jvm 1 | 2019/08/02 08:45:00 | 2019-08-02 08:45:00,103 [DefaultQuartzScheduler_Worker-1] ERROR org.quartz.core.ErrorLogger - An error occured while marking executed job complete. job= 'DEFAULT.auto-errata-default'
INFO | jvm 1 | 2019/08/02 08:45:00 | org.quartz.JobPersistenceException: Failed to obtain DB connection from data source 'rhnDs': java.sql.SQLException: ORA-12537: TNS:connection closed
INFO | jvm 1 | 2019/08/02 08:45:00 | [See nested exception: java.sql.SQLException: ORA-12537: TNS:connection closed
INFO | jvm 1 | 2019/08/02 08:45:00 | ]
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.quartz.impl.jdbcjobstore.JobStoreSupport.getConnection(JobStoreSupport.java:690)
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.quartz.impl.jdbcjobstore.JobStoreTX.getNonManagedTXConnection(JobStoreTX.java:69)
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.quartz.impl.jdbcjobstore.JobStoreSupport.executeInNonManagedTXLock(JobStoreSupport.java:3760)
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.quartz.impl.jdbcjobstore.JobStoreSupport.executeInNonManagedTXLock(JobStoreSupport.java:3725)
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.quartz.impl.jdbcjobstore.JobStoreSupport.triggeredJobComplete(JobStoreSupport.java:2957)
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.quartz.core.QuartzScheduler.notifyJobStoreJobComplete(QuartzScheduler.java:1789)
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.quartz.core.JobRunShell.run(JobRunShell.java:287)
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)
INFO | jvm 1 | 2019/08/02 08:45:00 | Caused by: java.sql.SQLException: ORA-12537: TNS:connection closed
INFO | jvm 1 | 2019/08/02 08:45:00 |
INFO | jvm 1 | 2019/08/02 08:45:00 | at oracle.jdbc.driver.T2CConnection.checkError(T2CConnection.java:777)
INFO | jvm 1 | 2019/08/02 08:45:00 | at oracle.jdbc.driver.T2CConnection.logon(T2CConnection.java:423)
INFO | jvm 1 | 2019/08/02 08:45:00 | at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:553)
INFO | jvm 1 | 2019/08/02 08:45:00 | at oracle.jdbc.driver.T2CConnection.<init>(T2CConnection.java:165)
INFO | jvm 1 | 2019/08/02 08:45:00 | at oracle.jdbc.driver.T2CDriverExtension.getConnection(T2CDriverExtension.java:53)
INFO | jvm 1 | 2019/08/02 08:45:00 | at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:528)
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.apache.commons.dbcp.DriverConnectionFactory.createConnection(DriverConnectionFactory.java:38)
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582)
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:1188)
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.java:108)
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.apache.commons.dbcp.BasicDataSource.getConnection(BasicDataSource.java:1046)
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.quartz.utils.PoolingConnectionProvider.getConnection(PoolingConnectionProvider.java:194)
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.quartz.utils.DBConnectionManager.getConnection(DBConnectionManager.java:109)
INFO | jvm 1 | 2019/08/02 08:45:00 | at org.quartz.impl.jdbcjobstore.JobStoreSupport.getConnection(JobStoreSupport.java:687)
INFO | jvm 1 | 2019/08/02 08:45:00 | ... 7 more
INFO | jvm 1 | 2019/08/02 08:57:00 | 2019-08-02 08:57:00,078 [DefaultQuartzScheduler_Worker-2] INFO com.redhat.rhn.taskomatic.task.ErrataCacheTask - In the queue: 1
STATUS | wrapper | 2019/08/02 08:57:42 | TERM trapped. Shutting down.
STATUS | wrapper | 2019/08/02 08:57:43 | <-- Wrapper Stopped


DB alert logs report the below errors:

2019-07-29T13:03:03.589953-04:00
ORA-00020: maximum number of processes (640) exceeded
ORA-20 errors will not be written to the alert log for
the next minute. Please look at trace files to see all
the ORA-20 errors.

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.