How To Configure The EXTRA_OLH_CONF_PROPERTIES Option Of ODI "LKM Hive To Oracle OLH-OSCH" (Doc ID 2195066.1)

Last updated on MAY 12, 2017

Applies to:

Oracle Data Integrator - Version 12.2.1.0.0 and later
Information in this document applies to any platform.

Goal

When using Oracle Data Integration (ODI) on Oracle Big Data Appliance (BDA), ODI LKM Hive to Oracle OLH-OSCH is used for loading data from Hive to Oracle database.

If not fine tuned, the LKM could cause performance issues with a large feed from BDA to Oracle database, and the resulting Oracle Loader For Hadoop job can claim almost all available resources and choke all other jobs.

The performance issue can be resolved by creating a resource pool on Cloudera Manager (CM) and can target the job to this queue using OLH command line option:

-Dmapreduce.job.queuename=ODI

The purpose of this document is to show how to configure command line options using the EXTRA_OLH_CONF_PROPERTIES property of ODI LKM Hive to Oracle OLH-OSCH.

Solution

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms