My Oracle Support Banner

'ODI-40761: Not enough memory to read the XML file' Signalled When Loading a Very Large XML File With The ODI 11.1.1.7 XML Driver External Database Feature (Doc ID 1552820.1)

Last updated on FEBRUARY 08, 2017

Applies to:

Oracle Data Integrator - Version 11.1.1.7.0 and later
Information in this document applies to any platform.

Symptoms

When attempting to load a very large XML file with the Oracle Data Integrator (ODI) version 11.1.1.7.0 XML driver using the external database feature with the following URL:

jdbc:snps:xml?f=c:\xml\Article.XML&s=ART_XML

and setting the following parameter in the PROPERTIES tab of the connection:

PropertyValue
driver oracle.jdbc.driver.OracleDriver
url jdbc:oracle:thin:@HOST:PORT:SID
user <USER_NAME>
password <ENCODED_PASSWORD>
schema

<USER_NAME>
drop_on_connect Y
create_tables AUTO
create_indexes Y
truncate_before_load Y
ids_in_db Y
drop_tables_on_drop_schema Y
use_prepared_statements Y
use_batch_update Y
batch_update_size 30
commit_periodically Y
num_inserts_before_commit 1000
reserve_chars_for_column 3
reserve_chars_for_table 3

 when testing the connection the following message is signalled:

ODI-40761: Not enough memory to read the XML file at com.sunopsis.jdbc.driver.xml.SnpsXmlFile.

Moreover, the trace file shows the following:

2013-05-02 08:17:42.214 NOTIFICATION Creating schema in memory
2013-05-02 08:17:42.229 NOTIFICATION ODI-15301 Wählen: Helper for HSQL
2013-05-02 08:17:42.229 NOTIFICATION Creating TablesTable
2013-05-02 08:17:42.229 NOTIFICATION Creating ID generator
2013-05-02 08:17:42.229 NOTIFICATION ID generator created
2013-05-02 08:17:42.354 NOTIFICATION Creating a data inserter which uses batch update and which commits periodically
2013-05-02 08:17:42.370 NOTIFICATION Accepting the XML model and creating the corresponding Relational model
2013-05-02 08:17:42.433 NOTIFICATION Validating model for the XML driver
2013-05-02 08:17:42.480 NOTIFICATION Locking XML file
2013-05-02 08:17:42.480 NOTIFICATION Synchronizing data from the file
2013-05-02 08:17:42.495 NOTIFICATION Reading data from filec:\xml\Article.XML

which seems to indicates that the loading of the XML is in memory and not in the external database.

Moreover, when attempting to use the other 2 methods to specifiy the data base properties:

  1. With a parameter file
  2. Adding parameters to the URL

for the external database feature, no problem is encountered.

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.