Concurrent Manager Fails to Start ; FNDSM Could not Establish Database Connection (Doc ID 1439853.1)

Last updated on SEPTEMBER 11, 2017

Applies to:

Oracle Concurrent Processing - Version 11.5.10.0 to 12.1.3 [Release 11.5 to 12.1]
Information in this document applies to any platform.

Symptoms

When attempting to start concurrent managers, it fails with the error below. Standard Managers are coming up after profile 'Concurrent:GSM Enabled'is set to 'No', but the OPP and Workflow Managers require the profile to be 'Yes' in order to start.

When the problem started, ORA-00060 (Deadlock) error was initially reported, however Ora-60 errors disappeared after applying <Patch 8724518> and <Patch 13560244>. The concurrent managers are still failing to start, it is down with the below errors.

 

 
ERROR 
List of errors encountered:
.............................................................................
_ 1 _
Routine AFPCSQ encountered an ORACLE error. ORA-28011: the account
will expire soon; change your password now
.
Review your error messages for the cause of the error. (=<POINTER>)
.............................................................................
List of errors encountered:
.............................................................................
_ 1 _
Routine AFPCAL received failure code while parsing or running your
concurrent program CPMGR
Review your concurrent request log file for more detailed information.
Make sure you are passing arguments in the correct format.
.............................................................................
:
remote_spawn called
FNDSM: usdsop returned result:145,0
09-MAR-2012 17:13:29 - Service Manager FNDSM_xxx starting on xxx
cpid=1080441, diag=Y, node=xxx
FNDSM: remote_init called
ospid=28685, result=0, logfile=/u02/oracle/prod/inst/apps/prod_xxx/logs/appl/conc/log/FNDSM1080441.mgr,twotask=prod
remote_spawn called
FNDSM: usdsop returned result:145,0
Servic Manager FNDSM_xxx could not establish database connection. afpsmccs/csm received error 145.
Routine AFPEIM encountered an error while starting concurrent manager STANDARD with library /u02/oracle/prod/apps/apps_st/appl/fnd/12.0.0/bin/FNDLIBR.
-------------FNDSM log --------------------------------------
FNDSM-xxx Concurrent Manager started : 09-MAR-2012 17:12:59
+---------------------------------------------------------------------------+
lang received: American_America
NLS_LANG is now: American_America.AL32UTF8
TWO_TASK received: GENUAT
09-MAR-2012 17:12:59 - Calling Function StartProcess in Cartridge AQCART for Service FNDCPGSC.
09-MAR-2012 17:12:59 - Function to call: afpsgcst
SIC:SICID=1139
SIC:Service Handle=FNDCPGSC
SIC:Cartridge Handle=AQCART
SIC:ContextInfo=
SIC:ServiceParamenters=SVC_WRITE_DIAG_TO_GSM_LOG=Y:\
SVC_CONTAINER_LOOP_SLEEP=10:SVC_CONTAINER_READ_TIMEOUT=10:
SVC_CONTAINER_LOG_LEVEL=4:SVC_COMP_MONITOR_LOOP_SLEEP=60:\
SVC_COMP_MONITOR_ONDEMAND_FREQ=300:SVC_COMP_MAX_ERROR_COUNT=10
SIC:DeveloperParameters=J:oracle.apps.fnd.cp.gsm.GSMSvcComponentContainer
SIC:AppsBasePath=FND_TOP
SIC:AppsEnvironment=
SIC:ServiceEnvironment=
SIC:ServiceManagerDiagnostic=Y
SIC:ServiceDiagnostic=4
SIC:ResourceConsumerGroup=
PC:PCID=1080366
PC:OSPID=999999
PC:Logfile=/u02/oracle/xxx/inst/apps/PROD_xxx/logs/appl/conc/log/FNDCPGSC1080366.txt
PC:ContextInfo=
PC:Status=Z
Unable to connect or reestablish the connection to the database.
09-MAR-2012 17:12:59 - Function Start_Process in AQCART (afpsgcst): No database connection
The call to function StartProcess in cartridge AQCART has failed.

     The error ORA-28011 is not displayed anywhere (ICM.log , alert.log).  Even when connecting through sqlplus apps/apps it works fine ; without throwing any ORA-28011 warning.  However ORA-28011 is flashed in Internal Concurrent Manager (ICM) log only once by ICM. However FNDSM can not display this ORA-28011 error in the log file.

Changes

Database profile settings were enabled for security as per Auditing requirement.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms