My Oracle Support Banner

Oozie Workflow Error While Scheduling Hive Job (Doc ID 1989490.1)

Last updated on AUGUST 03, 2021

Applies to:

Big Data Appliance Integrated Software - Version 3.0.1 and later
Linux x86-64

Symptoms

NOTE: In the examples that follow, user details, cluster names, hostnames, directory paths, filenames, etc. represent a fictitious sample (and are used to provide an illustrative example only). Any similarity to actual persons, or entities, living or dead, is purely coincidental and not intended in any manner.

Oozie hive workflow job fails with below error

JA017: Unknown hadoop job [job_<##>] associated with action [<##>-oozie-oozi-W@<NAME>]. Failing this action!

The error seems to be related to ACLs on the directory "/user/history/done_intermediate/<ID>.n". The ACLs on this directory were set to the below value. These ACL's are not set manually

# hdfs dfs -getfacl /user/history/done_intermediate/<ID>.n
# file: /user/history/done_intermediate/<ID>.n
# owner: <ID>.n
# group: hadoop
user::rwx
user:hive:rwx
group::r-x
group:BIGG-D-POSALL-AD:rwx
group:BIGG-D-POSALL-RD:r-x
mask::rwx
other::---
default:user::rwx
default:user:hive:rwx
default:group::r-x
default:group:BIGG-D-POSALL-AD:rwx
default:group:BIGG-D-POSALL-RD:r-x
default:mask::rwx
default:other::---


Observed that ACLs were only set for some user directories under the path "/user/history/done_intermediate"

Removed the ACL's using below command

hdfs dfs -setfacl -b /user/history/done_intermediate/<ID>.n


After this the same workflow worked without any change. This is how the folder permissions look without ACLs

drwxrwx--- - <ID>.n hadoop /user/history/done_intermediate/<ID>.n

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!

In this Document
Symptoms
Cause
Solution


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.