My Oracle Support Banner

"ODIKM-SPARK-SYNC-10000: EKM Command Failed with Exception: java.lang.Exception: see Details and URL for more information. Rerunning as standalone or yarn-client may also provide more information" Error Thrown when Calling Spark Python Script from ODI 12c (Doc ID 2532964.1)

Last updated on MAY 09, 2023

Applies to:

Oracle Data Integrator - Version 12.2.1.3.0 to 12.2.1.3.221018 [Release 12c]
Oracle Data Integrator Cloud Service - Version 17.1.3 and later
Information in this document applies to any platform.

Symptoms

NOTE: In the example below, any details represent a fictitious sample (based upon made up data). Any similarity to actual persons, living or dead, is purely coincidental and not intended in any manner.

When attempting to run a command using the Oracle Data Integrator (ODI) 12c OdiOSCommand in a Package with a command similar to the following:

/opt/cloudera/parcels/CDH-5.12.1-1.cdh5.12.1.p0.3/lib/spark/bin/spark-submit --master yarn-client --deploy-mode cluster --py-files /tmp/pyspark_ext.py --executor-memory 1G --verbose --driver-memory 512M --executor-cores 1 --driver-cores 1 --num-executors 2 --queue default /tmp/Load_Hivetohive_Spark_Physical.py

... the following errors occurs:

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.