Workflow Process Manager Not Processing Records Due To Crash (Doc ID 1926540.1)

Last updated on MARCH 02, 2017

Applies to:

Siebel CRM - Version 8.1.1.5 [21229] and later
Information in this document applies to any platform.

Symptoms

On : 8.1.1.5 [21229] version, Siebel Workflow

We have a process for mass updating assets through order generation and auto asseting.
Upon creation of orders, the process will fail to be create all required records - i.e. after 1900 expected records, only 300 get created.

We have changed version of workflow on sunday but crashes began today at 2:00 am.
After reviewing log files we have spotted several component crashes on enterprise log along with crash.txt, .fdr:

ERROR
-----------------------

enterprise log:

ServerLog ProcessExit 1 0000188953f97070:0 2014-08-28 02:52:02 WfProcMgr 19488 SBL-OSD-02011 Process 19488 exited with error - Process exited because of a segment violation (SIGSEGV)
ServerLog ProcessExit 1 0000188953f97070:0 2014-08-28 02:52:03 WfProcMgr 20431 SBL-OSD-02011 Process 20431 exited with error - Process exited because of a segment violation (SIGSEGV)
ServerLog ProcessExit 1 0000188953f97070:0 2014-08-28 02:53:02 WfProcMgr 19395 SBL-OSD-02011 Process 19395 exited with error - Process exited because of a segment violation (SIGSEGV)
ServerLog ProcessExit 1 0000188953f97070:0 2014-08-28 02:53:07 WfProcMgr 20676 SBL-OSD-02011 Process 20676 exited with error - Process exited because of a segment violation (SIGSEGV)

crash.txt

PROCESS 20600 CRASHED AFTER RECEIVING SIGNAL 11 IN THREAD 1528310672!!!

Called from:
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsslcosd.so[0x558df941]
[0x55555400]
/lib/libc.so.6[0x4dc01115]
/lib/libc.so.6(cfree+0x59)[0x4dc01b09]
/u01/CRMprd/appl/crmappprd/siebsrvr/mw/lib/libmfc400su.so[0x55c047d3]
/u01/CRMprd/appl/crmappprd/siebsrvr/mw/lib/libmfc400su.so[0x55c04843]
/u01/CRMprd/appl/crmappprd/siebsrvr/mw/lib/libmfc400su.so(_ZN9CPtrArray7SetSizeEii+0x5b)[0x55ac12eb]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscdo90.so(_ZN15CSSOraSqlCursor9FreeBindsEv+0xc1)[0x5a6ea151]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscdo90.so(_ZN15CSSOraSqlCursorD0Ev+0x3f)[0x5a6e9c9f]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscfdm.so(_ZN16CSSLockSqlCursorD0Ev+0x79)[0x59977c49]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscfdm.so(_ZN9CSSSqlObj14CacheSqlCursorEP12CSSSqlCursorb+0x123)[0x599cd463]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscfdm.so(_ZN9CSSSqlObj7ExecuteEiii+0xa34)[0x599fdd34]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscfom.so(_ZN10CSSBusComp10SqlExecuteEiii+0x4e)[0x595da7de]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscacmbc.so(_ZN9CSSBCBase10SqlExecuteEiii+0xdce)[0x72d61bbe]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscfom.so(_ZN10CSSBusComp7ExecuteEiii+0xf06)[0x5959eaf6]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscafwsv.so(_ZN12CSSWfMonitor5FlushEv+0x13da)[0x721ab1da]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscafwsv.so(_ZN12CSSWfMonitor12CaptureDebugEP13CSSWfProcInst+0x89)[0x721a9de9]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscafwsv.so(_ZN12CSSWfMonitor7CaptureEP13CSSWfProcInst+0xe0)[0x721a9190]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscafwsv.so(_ZN16CSSWfCoordinator5StartEP11CSSWfEngineP13CSSWfProcInstPKtRbbbbS5_PK10CCFVariant+0x13c3)[0x7214d0d3]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscafwsv.so(_ZN11CSSWfEngine16RunSingleProcessEPK12CSSWfProcessP13CSSWfProcInstP10CSSBusCompPKtS8_bRK14CCFPropertySetRS9_RbR6CCFMapI10CCFElemPtrIvESG_ERi10WfInstTypePK10CCFVariantS8_+0x772)[0x72183f72]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscafwsv.so(_ZN11CSSWfEngine12StartProcessEPKtS1_S1_S1_S1_RK14CCFPropertySetRS2_Rb10WfInstTypeP13CSSWfBatchJobPK10CCFVariantS1_b+0x720)[0x72186240]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscafwsv.so(_ZN11CSSWfEngine14DoInvokeMethodEPKtRK14CCFPropertySetRS2_+0xc70)[0x72171350]
/u01/CRMprd/appl/crmappprd/siebsrvr/lib/libsscfom.so(_ZN10CSSService12InvokeMethodEPKtRK14CCFPropertySetRS2_+0x27a)[0x5957f4da]
\.
.
.


.csv for decoded .fdr

683549 1409216326 1528310672 Fdr_OBJMGR Object Manager FdrSub_OBJMGR_BC_WRT_REC BusComp Write Record 1992326064 1 Workflow Process Properties Instance Monitor
683550 1409216326 1528310672 Fdr_OBJMGR Object Manager FdrSub_OBJMGR_SQLOBJ_WRT_REC SqlObj Write Record 1990191824 0 Workflow Process Properties Instance Monitor 1-19A9I1H
683668 1409216326 1528310672 Fdr_DBC Database Connector FdrSub_DBC_END_TXN End Transaction 1967861328 0 ServerDataSrc
683714 1409216326 1528310672 Fdr_WORKFLOW WorkFlow FdrSub_WORKFLOW_MNTR_WRTE_INST Monitor Write Instance Data 557 0 1-18RCXVF 1-19A6UEB
683715 1409216326 1528310672 Fdr_OBJMGR Object Manager FdrSub_OBJMGR_BC_SET_QBE_SRCH BusComp QBE Search 1992383616 0 1-19A6UEC Id
683716 1409216326 1528310672 Fdr_OBJMGR Object Manager FdrSub_OBJMGR_BC_EXEC BusComp Execution 1992383616 0 Workflow Process Instance Monitor
683717 1409216326 1528310672 Fdr_OBJMGR Object Manager FdrSub_OBJMGR_BC_EMPTY_WS BusComp Empty WorkSet 1992383616 0 Workflow Process Instance Monitor
683718 1409216326 1528310672 Fdr_OBJMGR Object Manager FdrSub_OBJMGR_BC_REC_DSTR WorkSet Record Destruction 1992383616 -1931234112 Workflow Process Instance Monitor
683719 1409216326 1528310672 Fdr_OBJMGR Object Manager FdrSub_OBJMGR_BC_EMPTY_WS BusComp Empty WorkSet 1992383616 0 Workflow Process Instance Monitor
683720 1409216326 1528310672 Fdr_OBJMGR Object Manager FdrSub_OBJMGR_SQLOBJ_EXEC SqlObj Execution 1990075384 0 Workflow Process Instance Monitor
683723 1409216326 1528310672 Fdr_FDR Fdr Internal FdrSub_FDR_CRASH ** CRASHING THREAD ** 0 0



Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms