CCB - Customer Care and Billing V2.2.0 Submitjob process never returns, but Batch Job finishes successfully (Doc ID 1259344.1)

Last updated on JANUARY 13, 2015

Applies to:

Oracle Utilities Customer Care and Billing - Version: 2.2.0 and later   [Release: 2.2 and later ]
Information in this document applies to any platform.

Symptoms

We had a BUDMON process that kicked off from our scheduler, ran to completion within CAB, but the associated submitjob process never returned.

We are still trying to figure out the different quirks in the coherence based batch compared to the non-coherence based batch, so some of the things we're seeing may be totally unrelated, but this process experienced 2 issues.

First, this was a multi-threaded job, and we saw one of the threads end up with his thread pool released due to a timeout. The log message looked like this:

- 2010-09-08 16:34:31,047 [pool-1-thread-1] INFO (cobol.host.SocketThreadPool) Released bespoke COBOL thread pool due to timeout for batch instance id 2366109

Interestingly, the log message indicating that the thread pool was registered for this batch ID came 5 milliseconds before the messages indicating that the batchworker was preparing to remove work and close the log writers. 9 minutes later we received the thread pool release due to timeout message.

Additionally, this job experienced the following coherence related error:
- 2010-09-08 16:17:42,223 [Logger@9262617 3.5.2/463] ERROR (Coherence) 2010-09-08 16:17:42.221/423.302 Oracle Coherence GE 3.5.2/463 <Error> (thread=DistributedCache, member=5):
java.lang.IllegalStateException: Partition 253 does not exist at PartitionSplittingBackingMap{Name=SchedulerDaemon$Backup,Partitions=[66,67,88,89,90,91,92,93,94,95,96,150,151,152,153,154,155,156,157,159,160,218,223,224,225,226,227,228,229,230,231,232,233,234,235,236,237,238,239,240,241,242,243,244,245,246,247,248,249,250,251,252,]}; key=Binary(length=2, value=0x0100)


Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms