'ODI-40761: Not enough memory to read the XML file' Signalled When Loading a Very Large XML File With The ODI 11.1.1.7 XML Driver External Database Feature (Doc ID 1552820.1)

Last updated on FEBRUARY 08, 2017

Applies to:

Oracle Data Integrator - Version 11.1.1.7.0 and later
Information in this document applies to any platform.

Symptoms

When attempting to load a very large XML file with the Oracle Data Integrator (ODI) version 11.1.1.7.0 XML driver using the external database feature with the following URL:

jdbc:snps:xml?f=c:\xml\Article.XML&s=ART_XML

and setting the following parameter in the PROPERTIES tab of the connection:

PropertyValue
driver oracle.jdbc.driver.OracleDriver
url jdbc:oracle:thin:@HOST:PORT:SID
user <USER_NAME>
password <ENCODED_PASSWORD>
schema

<USER_NAME>
drop_on_connect Y
create_tables AUTO
create_indexes Y
truncate_before_load Y
ids_in_db Y
drop_tables_on_drop_schema Y
use_prepared_statements Y
use_batch_update Y
batch_update_size 30
commit_periodically Y
num_inserts_before_commit 1000
reserve_chars_for_column 3
reserve_chars_for_table 3

 when testing the connection the following message is signalled:

ODI-40761: Not enough memory to read the XML file at com.sunopsis.jdbc.driver.xml.SnpsXmlFile.

Moreover, the trace file shows the following:

2013-05-02 08:17:42.214 NOTIFICATION Creating schema in memory
2013-05-02 08:17:42.229 NOTIFICATION ODI-15301 Wählen: Helper for HSQL
2013-05-02 08:17:42.229 NOTIFICATION Creating TablesTable
2013-05-02 08:17:42.229 NOTIFICATION Creating ID generator
2013-05-02 08:17:42.229 NOTIFICATION ID generator created
2013-05-02 08:17:42.354 NOTIFICATION Creating a data inserter which uses batch update and which commits periodically
2013-05-02 08:17:42.370 NOTIFICATION Accepting the XML model and creating the corresponding Relational model
2013-05-02 08:17:42.433 NOTIFICATION Validating model for the XML driver
2013-05-02 08:17:42.480 NOTIFICATION Locking XML file
2013-05-02 08:17:42.480 NOTIFICATION Synchronizing data from the file
2013-05-02 08:17:42.495 NOTIFICATION Reading data from filec:\xml\Article.XML

which seems to indicates that the loading of the XML is in memory and not in the external database.

Moreover, when attempting to use the other 2 methods to specifiy the data base properties:

  1. With a parameter file
  2. Adding parameters to the URL

for the external database feature, no problem is encountered.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms