PFT 6.1.0.1 Allocation Process Hangs in Ongoing Status or Ends in Failed Status in Linux OS (Doc ID 1568698.1)

Last updated on AUGUST 07, 2017

Applies to:

Oracle Financial Services Profitability Management - Version 6.1.0.1 to 6.1.0.2 [Release 6]
Linux x86-64
Oracle Financial Services Analytical Applications (OFSAA)

Symptoms

In Oracle Financial Services Profitability Management (PFT) 6.1.0.1, when you run Allocations, the Allocations remain in a status of "Ongoing" and never complete or the Allocations immediately complete in a "Failed" status when they ran successfully in version 6.1 and/or 6.0.x.  The Allocation's "ofspa" processes may also hang on the server.

The following error is output to the $FIC_DB_HOME/log/RevAgent.log for the Allocation:

[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:41 EST 2013]Activation Manager:[AESCryptorImpl.handleJVM]->INFO: JVM created successfully...
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:41 EST 2013]Activation Manager:[LOG] Starting up.....
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:42 EST 2013]Activation Manager:ClsUSmsConnect::ClsUSmsConnect, Forming Login Info statement
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:42 EST 2013]Activation Manager:Sucssefully Connected to Config schema.
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:42 EST 2013]Activation Manager:Sucssefully Connected to Atomic Schema.
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:42 EST 2013]Activation Manager:Connection to database ATOMIC successful
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:42 EST 2013]Activation Manager:Running allocations with: 201437, 0, atomic, 20140928, 0.
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:42 EST 2013]Activation Manager:Parallel_DML ->
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:INFORM : Allocation Successful.
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:#
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:# A fatal error has been detected by the Java Runtime Environment:
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:#
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:# SIGSEGV (0xb) at pc=0x0000003f6b07046e, pid=7575, tid=47274797969136
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:#
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:# JRE version: 6.0_25-b06
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:# Java VM: Java HotSpot(TM) 64-Bit Server VM (20.0-b11 mixed mode linux-amd64 compressed oops)
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:# Problematic frame:
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:# C [libc.so.6+0x7046e] _dl_tls_get_addr_soft@@GLIBC_PRIVATE+0x7046e
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:#
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:# An error report file with more information is saved as:
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:# /oracle/app/OFSAAI/ficdb/bin/hs_err_pid7575.log
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:#
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:# If you would like to submit a bug report, please visit:
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:# http://java.sun.com/webapps/bugreport/crash.jsp
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:21:43 EST 2013]Activation Manager:#
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:22:55 EST 2013]Activation Manager:Host IP--> xx.xx.xx.xx
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:22:55 EST 2013]Activation Manager:HostIP... xx.xx.x.xx
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:22:55 EST 2013]Activation Manager:Port... xxxx
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:22:55 EST 2013]Activation Manager:[AESCryptorImpl.handleJVM]->INFO: JVM created successfully...
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:22:55 EST 2013]Activation Manager:[LOG] Starting up.....
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:22:56 EST 2013]Activation Manager:ClsUSmsConnect::ClsUSmsConnect, Forming Login Info statement
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:22:56 EST 2013]Activation Manager:Sucssefully Connected to Config schema.
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:22:56 EST 2013]Activation Manager:Sucssefully Connected to Atomic Schema.
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:22:56 EST 2013]Activation Manager:Connection to database ATOMIC successful
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:22:56 EST 2013]Activation Manager:Running allocations with: 201437, 0, atomic, 20140928, 0.
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:22:56 EST 2013]Activation Manager:Parallel_DML ->
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:22:56 EST 2013]Activation Manager:INFORM : Allocation Successful.
[AGENTLOG][Reveleus Agent][Fri Jun 28 21:23:43 EST 2013]Activation Manager:# [ timer expired, abort... ]


Additional, the $FIC_APP_HOME/icc/log/iccserver.log contains the following for an Ongoing process:

[21:02:47,684] - Query to mark task on-going: UPDATE batch_task SET v_task_status = ? WHERE v_batch_run_id = ? AND v_task_id = ? AND v_task_status = ?
[21:02:47,684] - Updated task OFSAAA_201437_EXEC_20140928_6.Task1 to O
[21:02:47,684] - triggering task
[21:02:47,684] - Request to trigger job: Job[INFODOM:OFSAAA][BATCHRUNID:OFSAAA_201437_EXEC_20140928_6][TASKID:Task1][INFODATE:20140928][COMPONENT:Allocation Engine][PROGID:ofspa][METHOD:main][PARAMETERS:201437^^OFSAA^^NULL]
[21:02:47,684] - Generated message to router: 000158##F##I##D##orint5frsaaiapp01##orint5frsaaiapp01##INofspa!!main!!NOFSAAA_201437_EXEC_20140928_6^^Allocation Engine^^Task1^^20140928^^201437^^OFSAA^^NULL##
[21:02:47,684] - Request to connect to router.
[21:02:47,684] - Stream to router not null. Not reconnecting.
[21:02:47,685] - Finished writing to router.
[21:02:47,685] - Waiting for task completions.
[21:05:47,781] - Cleaner Thread run..


The Allocation either never completes or fails immediately.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms