Pin_inv_accts Fails In Pini_flist_grow On Very Large Invoice (Doc ID 880273.1)

Last updated on SEPTEMBER 21, 2016

Applies to:

Oracle Communications Billing and Revenue Management - Version 7.3.0.0.0 and later
Information in this document applies to any platform.

Goal

The users have an account with several hundred thousand events to create an invoice for, and
pin_inv_accts is failing.

The log indicates it is out of memory, but no matter how much users increase shared memory it fails
at the same place. The users are still under the system shared memory limit.

Here is a snippet of the cm log:

W Wed Aug 12 16:36:46 2009 xxxxx cm:1225 fm_inv_make_invoice.c:4606
1:istctap01:pin_inv_accts:1223:6:0:1250094151:0
STEP_NEXT: Processed 45 STEP
E Wed Aug 12 16:37:26 2009 xxxxx cm:1225 PcmMemPool.cpp(14):897
1:istctap01:pin_inv_accts:1223:6:0:1250094151:0
pin_malloc unable to allocate mem
E Wed Aug 12 16:37:26 2009 xxxxx cm:1225 pcmi.c(11):112
1:istctap01:pin_inv_accts:1223:6:0:1250094151:0
No memory for list in pini_flist_grow, newsize 20
E Wed Aug 12 16:37:26 2009 xxxxx cm:1225 pin_flist(63):1160
1:istctap01:pin_inv_accts:1223:6:0:1250094151:0
flist grow failed in pin_flist_create
E Wed Aug 12 16:37:26 2009 xxxxx cm:1225 pin_flist(63):3487
1:istctap01:pin_inv_accts:1223:6:0:1250094151:0
flist creation failed (1) in pin_flist_copy
E Wed Aug 12 16:37:26 2009 xxxxx cm:1225 pin_flist(63):930
1:istctap01:pin_inv_accts:1223:6:0:1250094151:0
flist copy failed (1) in pin_flist_fldval_copy
E Wed Aug 12 16:37:26 2009 xxxxx cm:1225 pin_flist(63):3563
1:istctap01:pin_inv_accts:1223:6:0:1250094151:0
bad pin_flist_fldval_copy in pin_flist_copy(1), type 9, fld 150995447
Received Signal 11

There is a stack trace as well.

Received Signal 11
1225: /opt/portal/systest2/7.3/opt/bin/cm
fe2cad7c waitid (0, 10c9, ffbfc600, 3)
fe2ba704 waitpid (10c9, ffbfc754, 0, 0, ffbfc7ac, fb597a80) + 60
fe2ad870 system (ffbfc8a8, fe347be4, 20000, 1, fe33e3c0, ffbfc7ac) + 2ec
ff2f1fcc printExceptionReport (b, 9800, 2, 5ab4, ff373150, f91cb858) + 240
ff02fc88 sigsegv_handler (b, 1480, 3a528, fe2bb558, ff06a188, 1400) + 34
fe2c6e78 __sighndlr (b, 0, ffbfcec8, ff02fc54, 0, 1) + c
fe2bb558 call_user_handler (b, 0, 0, 0, fe7f2a00, ffbfcec8) + 3b8
fe2bb72c sigacthandler (b, 0, ffbfcec8, fe347344, fe7f2a00, fe2572c0) + 4c
--- called from signal handler with signal 11 (SIGSEGV) ---
fe256b24 realfree (fb57ec48, deaf01, e7974, fe2571fc, 0, 0) + ec
fe2572c0 _free_unlocked (fe3472c4, 0, e71a0, fe347344, fe33e3c0, f91cb898) + b0
fe2571fc free (f91cb898, ff384550, e71e0, ff1af3d4, fe33e3c0, 9000) + 24
ff1b0768 __1cKPcmMemPoolMfreeFromPool6Mpv_v_ (3b888, 9000, f91cb898, 1deaf01, ff314738, ff373150)
+ 138
ff1af3d4 __1cLPcmMemGroupMFreeFromPool6FpvnPpcmmem_pool_ids__v_ (f91cb8b0, ff384550, 2, 1c3e4c,
ff384450, 0) + d8
ff1af030 pcmmem_free_poid (f91cb8b0, b21c, 1c415c, ff19baa0, ff373150, b000) + 48
ff1a5b04 pin_poid_destroy (f91cb8b0, ffbfdc20, 2, ffbfdb1c, 7, f91cb8b0) + 1c
ff19baa0 pini_flist_fldval_free (6, ffbfdb1c, ffbfdc20, 114, 18, ff19bbb0) + d0
ff19bed0 pin_flist_destroy (f91cb5c0, ffbfdc20, 2, ffbfdb1c, 0, ff373150) + bc
ff19bbb0 pini_flist_fldval_free (8, ffbfdc1c, ffbfdc20, 224, 20, ff19f79c) + 1e0
ff19bed0 pin_flist_destroy (f91ac9f8, ffbfdc20, 2, ffbfdc1c, 0, ff373150) + bc
ff19f79c pin_flist_copy_exclude (3f62b0, 0, 0, ffbfe73c, 7f812e30, ffbfdcc0) + 38c
ff19b83c pin_flist_fldval_copy (4b34f0, 9, bada5a38, ffbfdd88, ffbfe73c, 20) + 808
ff19f718 pin_flist_copy_exclude (19f210, 0, 4b34f0, ffbfe73c, 3f62b0, ffbfdd88) + 308
ff19f3f0 pin_flist_copy (19f210, ffbfe73c, ff030644, 7000, 1, ff070230) + c
ff16214c cm_pre_pcm_op (154370, 3ba, ffbfe31c, 0, 19f210, ffbfe394) + 14a8
ff17c7e0 pcm_op_ex (154370, 3ba, 0, 0, ffbfe73c, ffbfe394) + 3c8
ff17c3b4 pcm_op (154370, 3ba, 0, 19f210, ffbfe394, ffbfe73c) + 1c
fcbcf89c fm_inv_make_invoice_exec_opcode_prep_invoice (154370, 0, 19f210, ffbfe420, ffbfe73c,
1378) + 110
fcbcb018 fm_inv_make_invoice (154370, 0, 16b690, 154d28, ffbfe73c, 35c) + d90
fcbca210 op_inv_make_invoice (ff070230, 3b9, 0, 16b690, 154d28, ffbfe73c) + 100
ff02c100 cm_custom_ex (0, 0, 3b9, 0, 65b20, cd2a57bb) + 968
ff02b744 cm_custom (ff070230, 45468, 3b9, 0, 65b20, cd2a57bb) + b0
ff0299f4 cm_child (0, ff070230, 0, 3, 109a1, ff06f1dc) + 1254
ff037788 mainThread (fd8000d8, 15ca28, 153220, 1000, 153220, ffbfeaec) + 5fb8
00010994 main (1, ffbff3dc, ffbff3e4, 20c00, fe19b6c0, 0) + 8
00010974 _start (0, 0, 0, 0, 0, 0) + 108


Also see below error messages from pin_inv.pinlog:
E Tue Aug 11 20:37:21 2009 xxxxx  pin_inv_accts:20392 pin_inv_accts.c:1059
1:istctap01:cm:20129:1:1301:1250023003:1
PCM_OP_INV_MAKE_INVOICE error
<location=PIN_ERRLOC_POID:7 class=PIN_ERRCLASS_SYSTEM_DETERMINATE:1 errno=PIN_ERR_NO_MEM:1>
<field num=0:0,0 recid=0 reserved=0 reserved2=0 time(sec:usec)=0:0>
<facility=0 msg_id=0 version=0>
E Tue Aug 11 20:37:21 2009 xxxxx pin_inv_accts:20392 pin_inv_accts.c:1082
1:istctap01:cm:20129:1:1301:1250023003:1
Invoice processing failed. Poid Info : 0.0.0.1 /bill 41312830 3
E Tue Aug 11 20:37:21 2009 xxxxx  pin_inv_accts:20392 pin_inv_accts.c:1129
1:istctap01:cm:20129:1:1301:1250023003:1
pin_mta_worker_opcode_error
<location=PIN_ERRLOC_POID:7 class=PIN_ERRCLASS_SYSTEM_DETERMINATE:1 errno=PIN_ERR_NO_MEM:1>
<field num=0:0,0 recid=0 reserved=0 reserved2=0 time(sec:usec)=0:0>
<facility=0 msg_id=0 version=0>
E Tue Aug 11 20:37:21 2009 xxxxx  pin_inv_accts:20392 pin_mta.c:1034
1:istctap01:cm:20129:1:1301:1250023003:1
system error
<location=PIN_ERRLOC_POID:7 class=PIN_ERRCLASS_SYSTEM_DETERMINATE:1 errno=PIN_ERR_NO_MEM:1>
<field num=0:0,0 recid=0 reserved=0 reserved2=0 time(sec:usec)=0:0>
<facility=0 msg_id=0 version=0>
E Tue Aug 11 20:37:21 2009 xxxxx  pin_inv_accts:20392 pin_mta.c:1078
1:istctap01:cm:20129:1:1301:1250023003:1
pin_mta_worker error
<location=PIN_ERRLOC_POID:7 class=PIN_ERRCLASS_SYSTEM_DETERMINATE:1 errno=PIN_ERR_NO_MEM:1>
<field num=0:0,0 recid=0 reserved=0 reserved2=0 time(sec:usec)=0:0>
<facility=0 msg_id=0 version=0>

-------------------------------------------------------------------

How to resolve the shared memory problem in this situation?


Solution

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms