DEADLOCK Issue in PCM_OP_CUST_SET_STATUS While Disconnecting Service

(Doc ID 2367637.1)

Last updated on MARCH 05, 2018

Applies to:

Oracle Communications Billing and Revenue Management - Version 7.5.0.17.0 and later
Information in this document applies to any platform.

Symptoms

On BRM 7.5.0.17.0 version,

Consider the below scenario where DEADLOCK observed for PCM_OP_CUST_SET_STATUS opcode while disconnecting all services within an account having 45 services.

Scenario:
------------
- Here they have one Enterprise customer having 45 services. All these services are under same bill_unit.
- While running the collection, at last step, they are sending the disconnection order to BRM.
- The Order Management System(OSM) send disconnection order to Fusion Middleware(FMW) and FMW calls "PCM_OP_CUST_SET_STATUS" opcode in BRM.
- In this flow of 45 services, they observe a couple of call got passed and service got disconnected, but most of the rest got failed.
- For the rest calls, they are getting deadlock issue while trying to update the service detail in uniqueness table.
- From the logs it is clear that while updating uniqueness_t, it is taking account level lock and which is causing deadlock.

ERROR in cm.pinlog:
----------------------
E Wed Jan  3 10:01:41 2018  brm01  cm_o_00:6601  cm_utils.c(150):6358 2:soa01:JCAAdapter:0:DaemonWorkThread: '405' of WorkManager: 'wm/SOAWorkManager':62:1514973695:0:root.0.0.0.1:::
CM FM->DM input flist: opcode=PCM_OP_WRITE_FLDS, flags=0x40020020, errno=PIN_ERR_DEADLOCK:79
# number of field entries allocated 20, used 2
0 PIN_FLD_POID           POID [0] 0.0.0.1 /uniqueness 2835981237 0
0 PIN_FLD_EFFECTIVE_T  TSTAMP [0] (1514973697) Wed Jan  3 10:01:37 2018

E Wed Jan  3 10:01:41 2018  brm01  cm_o_00:6601  fm_cust_login.c:824 2:soa01:JCAAdapter:0:DaemonWorkThread: '405' of WorkManager: 'wm/SOAWorkManager':62:1514973695:0:root.0.0.0.1:::
fm_cust_login_apply_new error
<location=PIN_ERRLOC_DM:4 class=PIN_ERRCLASS_SYSTEM_DETERMINATE:1 errno=PIN_ERR_DEADLOCK:79>

<facility=0 msg_id=0 version=0>
E Wed Jan  3 10:01:41 2018  brm01  cm_o_00:6601  fm_cust_login.c:485 2:soa01:JCAAdapter:0:DaemonWorkThread: '405' of WorkManager: 'wm/SOAWorkManager':62:1514973695:0:root.0.0.0.1:::
op_cust_set_login error
<location=PIN_ERRLOC_DM:4 class=PIN_ERRCLASS_SYSTEM_DETERMINATE:1 errno=PIN_ERR_DEADLOCK:79>

<facility=0 msg_id=0 version=0>

E Wed Jan  3 10:01:41 2018  brm01  cm_o_00:6601  cm_utils.c(150):6358 2:soa01:JCAAdapter:0:DaemonWorkThread: '405' of WorkManager: 'wm/SOAWorkManager':62:1514973695:0:root.0.0.0.1:::
CM CM->FM input flist: opcode=PCM_OP_CUST_SET_LOGIN, flags=0x40000000, errno=PIN_ERR_DEADLOCK:79
# number of field entries allocated 20, used 6
0 PIN_FLD_POID           POID [0] 0.0.0.1 /account 2835615832 0
0 PIN_FLD_SERVICE_OBJ    POID [0] 0.0.0.1 /service/telco/prepaid 2835980725 8
0 PIN_FLD_PROGRAM_NAME    STR [0] "Changing MSISDN for service deactivation"
0 PIN_FLD_START_T      TSTAMP [0] (1514973697) Wed Jan  3 10:01:37 2018
0 PIN_FLD_END_T        TSTAMP [0] (1514973697) Wed Jan  3 10:01:37 2018
0 PIN_FLD_LOGINS        ARRAY [0] allocated 20, used 1
1     PIN_FLD_ALIAS_LIST    ARRAY [1] allocated 20, used 1
2         PIN_FLD_NAME            STR [0] "447000068088_1514973697"

dm_oracle.pinlog
-----------------------
E Wed Jan  3 09:32:40 2018  brm01  dm:17400  dm_subr.c(170):8964 2:soa02:JCAAdapter:0:DaemonWorkThread: '50' of WorkManager: 'wm/SOAWorkManager':62:1514971954:0:root.0.0.0.1:::
ORACLE error: do_sql_mr_select: PINStmtExecute: code 60, op 0
=ORA-00060: deadlock detected while waiting for resource
...
....
E Wed Jan  3 09:32:40 2018  brm01  dm:17400  dm_back.c(40):1625 2:soa02:JCAAdapter:0:DaemonWorkThread: '50' of WorkManager: 'wm/SOAWorkManager':62:1514971954:0:root.0.0.0.1:::
DMbe #32: process_op: op 5(PCM_OP_WRITE_FLDS), err 79(PIN_ERR_DEADLOCK)


STEPS
-----------------------
1. Create an account from Siebel with 50-60 service under one billing profile.
2. Disconnect all the services from Siebel.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms