Oozie Workflow Error While Scheduling Hive Job

(Doc ID 1989490.1)

Last updated on OCTOBER 11, 2016

Applies to:

Big Data Appliance Integrated Software - Version 3.0.1 and later
Linux x86-64

Symptoms

Oozie hive workflow job fails with below error

JA017: Unknown hadoop job [job_1423700022452_0015] associated with action [0000011-150211191322657-oozie-oozi-W@testHiveAction]. Failing this action!

The error seems to be related to ACLs on the directory "/user/history/done_intermediate/****.n". The ACLs on this directory were set to the below value. These ACL's are NOT set manually

# hdfs dfs -getfacl /user/history/done_intermediate/***.n
# file: /user/history/done_intermediate/****.n
# owner: ****.n
# group: hadoop
user::rwx
user:hive:rwx
group::r-x
group:BIGG-D-POSALL-AD:rwx
group:BIGG-D-POSALL-RD:r-x
mask::rwx
other::---
default:user::rwx
default:user:hive:rwx
default:group::r-x
default:group:BIGG-D-POSALL-AD:rwx
default:group:BIGG-D-POSALL-RD:r-x
default:mask::rwx
default:other::---


Observed that ACLs were only set for some user directories under the path "/user/history/done_intermediate"

Removed the ACL's using below command

hdfs dfs -setfacl -b /user/history/done_intermediate/*****.n


After this the same workflow **worked** without any change. This is how the folder permissions look without ACLs

drwxrwx--- - ********.n hadoop /user/history/done_intermediate/*****.n

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms