OFSAA 8.0.7.4 – Batches With Multiple Tasks Ran Multiple Times in Parallel Fails and No Logs Generated
(Doc ID 2873035.1)
Last updated on NOVEMBER 20, 2023
Applies to:
Oracle Financial Services Analytical Applications Infrastructure - Version 8.0.7.4.0 and laterInformation in this document applies to any platform.
Oracle Financial Services Asset Liability Management (ALM)
Oracle Financial Services Profitability Management (PFT)
Oracle Financial Services Funds Transfer Pricing (FTP)
Oracle Financial Services Analytical Application Infrastructure (OFSAAI)
Oracle Financial Services Enterprise Performance Management (EPM)
Symptoms
On 8.0.7.4.0 version when running batches with multiple Data Transformation tasks(> 100) in parallel, after some time, a failed message is received and the logs are not created on the server.
In order to fix the issue client need to stop the OFSAAI and the Web services and also to clear the cache.
The issue is happening after multiple runs in parallel and if OFSAAI services are not restarted between runs. Below are some errors in the backend services logs
SERVER_AM_LOG_TRACE_XXXXX.log
------------------
.......
[xx-09-21 12:55:21 +03 PM][INFO][BACKEND][OFSAA][AM_LOG_TRACE_XXXXXPP1] Thread 3 : Write - Written '211' bytes to the socket
[xx-09-21 12:55:21 +03 PM][WARN][BACKEND][OFSAA][AM_LOG_TRACE_XXXXXPP1] SocketClientImpl::Close : Call to Shutdown-RDWR Failed
[xx-09-21 12:55:21 +03 PM][SEVERE][BACKEND][OFSAA][AM_LOG_TRACE_XXXXXPP1] Sigchild Handler : Call to Waitpid - WNOWAIT Failed. ERRNO = 10 : msg = No child processes
[xx-09-21 12:55:21 +03 PM][INFO][BACKEND][OFSAA][AM_LOG_TRACE_XXXXXPP1] Sigchild Handler : Exit
[xx-09-21 12:55:21 +03 PM][SEVERE][BACKEND][OFSAA][AM_LOG_TRACE_XXXXXPP1] SocketClientImpl::Get_Error : ERRNO = 76 Error Message = Socket is not connected
[xx-09-21 12:55:21 +03 PM][SEVERE][BACKEND][OFSAA][AM_LOG_TRACE_XXXXXPP1] SocketClientImpl::Get_Error : Default case
[xx-09-21 12:55:21 +03 PM][INFO][BACKEND][OFSAA][AM_LOG_TRACE_XXXXXPP1] GlobalAccess::Lock_Reply : Success
.................
set('N')
[xx-09-21 06:33:50 +03 AM][INFO][BACKEND][OFSAA][AM_LOG_TRACE_XXXXXPP1] GlobalAccess::Lock_Request : Success
[xx-09-21 06:33:50 +03 AM][INFO][BACKEND][OFSAA][AM_LOG_TRACE_XXXXXPP1] GlobalAccess::Unlock_Request : Success
[xx-09-21 06:33:50 +03 AM][WARN][BACKEND][OFSAA][AM_LOG_TRACE_XXXXXPP1] Thread IO --1: Added Task to Queue
[xx-09-21 06:33:50 +03 AM][INFO][BACKEND][OFSAA][AM_LOG_TRACE_XXXXXPP1] GlobalAccess::Unlock_Request : Success
[xx-09-21 06:33:50 +03 AM][SEVERE][BACKEND][OFSAA][AM_LOG_TRACE_XXXXXPP1] PFE : Get_AllParameters returns non-empty list
[xx-09-21 06:33:50 +03 AM][INFO][BACKEND][OFSAA][AM_LOG_TRACE_XXXXXPP1] GlobalAccess::Lock_Active : Success
[xx-09-21 06:33:50 +03 AM][INFO][BACKEND][OFSAA][AM_LOG_TRACE_XXXXXPP1] GlobalAccess::Unlock_Active : Success
[xx-09-21 06:33:50 +03 AM][INFO][BACKEND][OFSAA][AM_LOG_TRACE_XXXXXPP1] GlobalAccess::Lock_Request : Success
SERVER_ROUTER_LOG_TRACE.log
------------------
.......
[xx-10-21 07:45:44 +03 AM][INFO][BACKEND][OFSAA][ROUTER_LOG_TRACE] Message for target ...000206##F##I##D##<IP ADDRESS>##<IP ADDRESS>##INDTServer!!main!!<BATCH NAME>^^Task6^^20210930^^<IP ADDRESS>,EDW,OFSAEPM,call_etl_program,'STG_CARDS_MAP_PHYSICAL'##
[xx-10-21 07:45:44 +03 AM][INFO][BACKEND][OFSAA][ROUTER_LOG_TRACE] Host to be connected ..
[xx-10-21 07:46:59 +03 AM][SEVERE][BACKEND][OFSAA][ROUTER_LOG_TRACE] Error connecting ...
[xx-10-21 07:46:59 +03 AM][SEVERE][BACKEND][OFSAA][ROUTER_LOG_TRACE] Error ...Connection timed out before a connection was made ...
Error ...
Changes
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Changes |
| Cause |
| Solution |
| References |