My Oracle Support Banner

ECE GridSync Replicate Freezes With WARN Java.io.IOException: Buffer Has Reached Its Max Capacity (Doc ID 2998539.1)

Last updated on JANUARY 18, 2024

Applies to:

Oracle Communications BRM - Elastic Charging Engine - Version 11.3.0.7.0 and later
Information in this document applies to any platform.

Symptoms

On environment running Oracle Communications Elastic Charging Engine (ECE) 11.3.0.7.21 as 2 federated clusters in Active-Hot Disaster Recovery (DR) setup (PROD-MAIN and PROD-DR, in two different sites), it was observed that some of coherence partitions size was more than 2Gb. Because of this, federation replicateAll is freezing before completion and is not progressing. There are about 9 millions accounts to replicate, and around 40K accounts left when the buffer warning started (see the below warning logged in ecs log). Also it was impacting partition transfer and coherence was terminating BRMfederated service.

There is a warning observable in the ece server logs:

Based on heap dump, it was observed that even though environment was having very less sharing customers (600K out of 9M), the sharingCustomerState cache size (4Gb) was even more than customer and balance cache (< 2.8 gb). Up on querying associated key with specific subscriber in sharingCustomercache, more than 12K session entries were found each holding all balances /products information of all sharing accounts. At the same time, size of active session was just 64. This means that sharingCustomerState cache entries were not getting cleaned up or removed.

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.