My Oracle Support Banner

Sqoop Hcatalog/Hive Import into Partitioned Table Causes Error When Sentry is Enabled (Doc ID 1968525.1)

Last updated on NOVEMBER 27, 2019

Applies to:

Big Data Appliance Integrated Software - Version 3.1.0 and later
Linux x86-64

Symptoms

A Sqoop hcatalog command to import into a partitioned table results in a permissions error when sentry is enabled.

Error returned when importing into HCatalog table with partitions

15/02/03 09:49:49 INFO mapreduce.Job: Job job_1422914679712_0028 failed with state FAILED due to: Job commit failed: org.apache.hive.hcatalog.common.HCatException : 2006 : Error adding partition to metastore. Cause : org.apache.hadoop.security.AccessControlException: Permission denied. user=<USER> is not the owner of inode=dib_time_code=20140102
  at org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.checkOwner(DefaultAuthorizationProvider.java:169)
  at org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.checkPermission(DefaultAuthorizationProvider.java:157)
  at org.apache.sentry.hdfs.SentryAuthorizationProvider.checkPermission(SentryAuthorizationProvider.java:174)
  at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:138)
  at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:6286)

Trying to import into a Hive table fails with

Failed with exception MetaException(message:java.lang.NullPointerException)
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask


All the needed ACL's are setup correctly.

Ensured read and write on the target directory can be performed as the user executing the sqoop command but still error persists.

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.