GEO Data Loading Using Neustar Data Causes Java.lang.OutOfMemoryError: GC Overhead Limit Exceeded (Doc ID 2246036.1)

Last updated on MARCH 28, 2017

Applies to:

Oracle Adaptive Access Manager - Version 11.1.2.3.0 and later
Information in this document applies to any platform.

Symptoms

GEO data loading using Neustar data causes java.lang.OutOfMemoryError: GC overhead limit exceeded

After 15hrs of data loading, the script errors out with the following error.
INFO: 5989ms execution for executeQuery: SQLCall(INSERT INTO VCRYPT_IP_LOCATION_MAP (IP_RANGE_ID, ASN, CARRIER, CITY_CF, CITY_ID, CONNECTION_SPEED, CONNECTION_TYPE, COUNTRY_CF, COUNTRY_ID, CREATE_TIME, DMA, FROM_IP_ADDR, ROUTING_TYPE, IS_SPLIT, ISP_ID, METRO_ID, MSA, NOTES, PHONE_AREA, PMSA, REGION_ID, SEC_LEVEL_DOMAIN, STATE_CF, STATE_ID, TO_IP_ADDR, TOP_LEVEL_DOMAIN, UPDATE_TIME, ZIP_CODE) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))
Oct 23, 2015 4:39:47 AM com.bharosa.common.util.MTQueue
INFO: DatabaseWorkers: current queue size=49993, processed 204 in 60 seconds with per second=3.4, total till now=1546945, reseted 0 times
Oct 23, 2015 4:39:47 AM com.bharosa.common.toplink.OAAMPerformanceProfiler
INFO: 2808ms execution for executeQuery: SQLCall(INSERT INTO VCRYPT_IP_LOCATION_MAP (IP_RANGE_ID, ASN, CARRIER, CITY_CF, CITY_ID, CONNECTION_SPEED, CONNECTION_TYPE, COUNTRY_CF, COUNTRY_ID, CREATE_TIME, DMA, FROM_IP_ADDR, ROUTING_TYPE, IS_SPLIT, ISP_ID, METRO_ID, MSA, NOTES, PHONE_AREA, PMSA, REGION_ID, SEC_LEVEL_DOMAIN, STATE_CF, STATE_ID, TO_IP_ADDR, TOP_LEVEL_DOMAIN, UPDATE_TIME, ZIP_CODE) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))
Oct 23, 2015 4:40:07 AM com.bharosa.common.util.MTQueue
WARNING: Caught exception when executing callback in thread DatabaseWorkers_1
java.lang.OutOfMemoryError: GC overhead limit exceeded
  at java.util.IdentityHashMap.init(IdentityHashMap.java:261)
  at java.util.IdentityHashMap.(IdentityHashMap.java:223)
  at java.util.IdentityHashMap.(IdentityHashMap.java:273)
  at oracle.jdbc.driver.PhysicalConnection.updateSystemContext11(PhysicalConnection.java:7697)
  at oracle.jdbc.driver.PhysicalConnection.updateSystemContext(PhysicalConnection.java:7604)
  at oracle.jdbc.driver.OraclePreparedStatement.executeBatch(OraclePreparedStatement.java:13164)
  at oracle.jdbc.driver.OracleStatementWrapper.executeBatch(OracleStatementWrapper.java:248)
  at org.eclipse.persistence.platform.database.oracle.Oracle10Platform.executeBatch(Oracle10Platform.java:47)
  at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.executeJDK12BatchStatement(DatabaseAccessor.java:860)
  at org.eclipse.persistence.internal.databaseaccess.ParameterizedSQLBatchWritingMechanism.executeBatchedStatements(ParameterizedSQLBatchWritingMechanism.java:144)
  at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.writesCompleted(DatabaseAccessor.java:1707)
  at org.eclipse.persistence.internal.sessions.AbstractSession.writesCompleted(AbstractSession.java:3836)
  at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.writesCompleted(UnitOfWorkImpl.java:5520)
  at org.eclipse.persistence.internal.sessions.RepeatableWriteUnitOfWork.writeChanges(RepeatableWriteUnitOfWork.java:448)
  at org.eclipse.persistence.internal.jpa.EntityManagerImpl.flush(EntityManagerImpl.java:780)
  at com.bharosa.common.toplink.TopLink11gBaseDAO$InsertObjectAction.internalPerformAction(TopLink11gBaseDAO.java:780)
  at com.bharosa.common.toplink.TopLink11gBaseDAO$DBAction.performAction(TopLink11gBaseDAO.java:101)
  at com.bharosa.common.toplink.TopLink11gDBMgr.insert(TopLink11gDBMgr.java:392)
  at com.bharosa.vcrypt.dataaccess.impl.VCryptLocationDataAccessBaseImpl.createVIPLocationMap(VCryptLocationDataAccessBaseImpl.java:1068)
  at com.bharosa.common.newlocation.LocationDbRecord.execute(LocationDbRecord.java:134)
  at com.bharosa.common.newlocation.DbThreadCallBack.processRequest(IPLocationLoader.java:849)
  at com.bharosa.common.util.MTQueue.run(MTQueue.java:143)
  at java.lang.Thread.run(Thread.java:745

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms