On Oracle Big Data Appliance Upgrade of Secure CDH Cluster from V3.0.* to V3.1.0 Fails on Oozie Cluster Validation Checks (Doc ID 1918694.1)

Last updated on NOVEMBER 08, 2022

Applies to:

Big Data Appliance Integrated Software - Version 3.0.1 and later
Linux x86-64

Symptoms

NOTE: In the examples that follow, user details, cluster names, hostnames, directory paths, filenames, etc. represent a fictitious sample (and are used to provide an illustrative example only). Any similarity to actual persons, or entities, living or dead, is purely coincidental and not intended in any manner.

On Oracle Big Data Appliance during upgrade of secure (Kerberos enabled) CDH Cluster from 3.0.* to 3.1 release, Oozie Cluster validation checks fail.

Running An Oozie Workflow Test
Actions
------------------------------------------------------------------------------------------------------------------------------------
ID                                                                            Status    Ext ID                 Ext Status Err Code
------------------------------------------------------------------------------------------------------------------------------------
0000000-140819112609702-oozie-oozi-W@:start:                                  OK        -                      OK         -
------------------------------------------------------------------------------------------------------------------------------------
0000000-140819112609702-oozie-oozi-W@pig-node                                 ERROR     job_1408472571075_0004 FAILED/KILLED-
------------------------------------------------------------------------------------------------------------------------------------
0000000-140819112609702-oozie-oozi-W@cleanup-node                             OK        -                      OK         -
------------------------------------------------------------------------------------------------------------------------------------
0000000-140819112609702-oozie-oozi-W@fail                                     OK        -                      OK         E0729
------------------------------------------------------------------------------------------------------------------------------------

Oozie failed

Checking the Oozie job logs (oozie:launcher:T=pig:W=combine-wf:A=pig-node:ID=0000000-140819112609702-oozie-oozi-W) in the HUE Job Browser reports below error

2014-08-19 11:42:27,489 WARN [main] org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:oracle (auth:SIMPLE) cause:java.io.IOException: Split class org.apache.oozie.action.hadoop.OozieLauncherInputFormat$EmptySplit not found
2014-08-19 11:42:27,490 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: Split class org.apache.oozie.action.hadoop.OozieLauncherInputFormat$EmptySplit not found
at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:362)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:403)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1554)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.OozieLauncherInputFormat$EmptySplit not found
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1803)
at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:360)
... 7 more

2014-08-19 11:42:27,494 INFO [main] org.apache.hadoop.mapred.Task: Runnning cleanup for the task
2014-08-19 11:42:27,498 WARN [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete hdfs://<CLUSTER_NAME>-ns/user/oracle/oozie-oozi/0000000-140819112609702-oozie-oozi-W/pig-node--pig/output/_temporary/1/_temporary/attempt_1408472571075_0004_m_000000_2

Cause

	To view full details, sign in with your My Oracle Support account.
	Don't have a My Oracle Support account? Click to get started!

In this Document

Symptoms

Cause

Solution

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.

On Oracle Big Data Appliance Upgrade of Secure CDH Cluster from V3.0.* to V3.1.0 Fails on Oozie Cluster Validation Checks (Doc ID 1918694.1)

Applies to:

Symptoms

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!