Apache Spark Failures Are Ignored From ODI 12c LKM Spark to Hive Or LKM SQL to Spark (Doc ID 2227549.1)

Last updated on FEBRUARY 01, 2017

Applies to:

Oracle Data Integrator - Version 12.1.3.0.1 to 12.2.1.2.6 [Release 12c]
Information in this document applies to any platform.

Symptoms

In ODI 12.2.1, a mapping execution error occurs from one of the Apache Spark related KM's such as LKM Spark to Hive and LKM SQL to Spark, the error is treated as a warning and the ODI session still finishes successfully  instead of being in error state.

For example, the error stack below occurred on step "sparkPyExec" when executing a mapping using LKM Spark to Hive:

 

The execution of mapping was successful and step "sparkPyExec" is in status "Warning", even though the issue is related to permission denial for a specific user.

Changes

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms