My Oracle Support Banner

UCM Batch Publish Subscribe is very slow when publishing more than 10000 records in one batch task (Doc ID 1962260.1)

Last updated on FEBRUARY 04, 2019

Applies to:

Siebel Universal Customer Master - Version 8.1.1.7 SIA [21238] and later
Information in this document applies to any platform.

Symptoms

On : 8.1.1.7 [21238] version, Siebel Workflow

BEHAVIOR
---------------

Customer was trying to publish 30,000 records in one batch task.

At the beginning of the task, the publishing for the data is quite fast and acceptable. However, after the task published over 10,000 records, the publishing of records after the 10,000 mark starts to slow down and take a long time to prepare the data in between each set/batch size.

Customer tested with different Batch Size parameters: 1, 10 (default), 50

The example results are:

a. Batch Size = 1, it was only able publish out 16,000 rows (there was a failure connecting to the external system after a while). But at the 16,000 row mark, it starts to take an average of 12-13 seconds in between each record being published:

WebSvcOutbound WSOutboundDbg 4 00000006546d1860:0 2014-11-20 19:56:25 Calling 'http://localhost:8180/HTTPTest/WriteToFile_ReturnXML.asp' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 00000006546d1860:0 2014-11-20 19:56:25 Completed outbound web service execution.

WebSvcOutbound WSOutboundDbg 4 00000006546d1860:0 2014-11-20 19:56:37 Calling 'http://localhost:8180/HTTPTest/WriteToFile_ReturnXML.asp' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 00000006546d1860:0 2014-11-20 19:56:37 Completed outbound web service execution.

WebSvcOutbound WSOutboundDbg 4 00000006546d1860:0 2014-11-20 19:56:50 Calling 'http://localhost:8180/HTTPTest/WriteToFile_ReturnXML.asp' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 00000006546d1860:0 2014-11-20 19:56:50 Completed outbound web service execution.

b. Batch Size = 10, it was only able publish out 16,000 rows (there was a failure connecting to the external system after a while). But at the 16,000 row mark, it starts to take an average of 30 seconds in between each batch of 10 records being published:

WebSvcOutbound WSOutboundDbg 4 00000006545d0b44:0 2014-11-08 08:06:54 Calling 'http://<hostname>/testsite/WriteToFile_ReturnXML.asp' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 00000006545d0b44:0 2014-11-08 08:06:55 Completed outbound web service execution.

WebSvcOutbound WSOutboundDbg 4 00000006545d0b44:0 2014-11-08 08:07:25 Calling 'http://<hostname>/testsite/WriteToFile_ReturnXML.asp' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 00000006545d0b44:0 2014-11-08 08:07:27 Completed outbound web service execution.

WebSvcOutbound WSOutboundDbg 4 00000006545d0b44:0 2014-11-08 08:08:00 Calling 'http://<hostname>/testsite/WriteToFile_ReturnXML.asp' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 00000006545d0b44:0 2014-11-08 08:08:01 Completed outbound web service execution.

WebSvcOutbound WSOutboundDbg 4 00000006545d0b44:0 2014-11-08 08:08:33 Calling 'http://<hostname>/testsite/WriteToFile_ReturnXML.asp' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 00000006545d0b44:0 2014-11-08 08:08:34 Completed outbound web service execution.

WebSvcOutbound WSOutboundDbg 4 00000006545d0b44:0 2014-11-08 08:09:09 Calling 'http://<hostname>/testsite/WriteToFile_ReturnXML.asp' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 00000006545d0b44:0 2014-11-08 08:09:10 Completed outbound web service execution.

WebSvcOutbound WSOutboundDbg 4 00000006545d0b44:0 2014-11-08 08:09:39 Calling 'http://<hostname>/testsite/WriteToFile_ReturnXML.asp' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 00000006545d0b44:0 2014-11-08 08:09:40 Completed outbound web service execution.

WebSvcOutbound WSOutboundDbg 4 00000006545d0b44:0 2014-11-08 08:10:08 Calling 'http://<hostname>/testsite/WriteToFile_ReturnXML.asp' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 00000006545d0b44:0 2014-11-08 08:10:08 Completed outbound web service execution.

c. Batch Size = 50, it was only able publish out 25,000 record area, it took an average a minute and half (90 seconds+) to do the outbound submission for every batch of 50 records:

WebSvcOutbound WSOutboundDbg 4 0000000654620acc:0 2014-11-12 03:03:57 Calling 'http://localhost:6666' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 0000000654620acc:0 2014-11-12 03:05:40 Completed outbound web service execution.

WebSvcOutbound WSOutboundDbg 4 0000000654620acc:0 2014-11-12 03:06:30 Calling 'http://localhost:6666' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 0000000654620acc:0 2014-11-12 03:07:59 Completed outbound web service execution.

WebSvcOutbound WSOutboundDbg 4 0000000654620acc:0 2014-11-12 03:09:00 Calling 'http://localhost:6666' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 0000000654620acc:0 2014-11-12 03:10:13 Completed outbound web service execution.

WebSvcOutbound WSOutboundDbg 4 0000000654620acc:0 2014-11-12 03:10:56 Calling 'http://localhost:6666' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 0000000654620acc:0 2014-11-12 03:12:33 Completed outbound web service execution.

WebSvcOutbound WSOutboundDbg 4 0000000654620acc:0 2014-11-12 03:13:23 Calling 'http://localhost:6666' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 0000000654620acc:0 2014-11-12 03:14:45 Completed outbound web service execution.

WebSvcOutbound WSOutboundDbg 4 0000000654620acc:0 2014-11-12 03:15:24 Calling 'http://localhost:6666' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 0000000654620acc:0 2014-11-12 03:16:40 Completed outbound web service execution.

WebSvcOutbound WSOutboundDbg 4 0000000654620acc:0 2014-11-12 03:17:18 Calling 'http://localhost:6666' using transport 'HTTP'
WebSvcOutbound WSOutboundTrace 3 0000000654620acc:0 2014-11-12 03:18:39 Completed outbound web service execution.

There clearly seems to be a throughput degradation over the course of time on the entire set of 30k rows.

Changes

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Changes
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.