Errors Accessing HBase from Hive via Oozie on Kerberos on BDA V3.0.1/CDH 5.0.1: Inserting HBase Table to Hive and Joining Hive-HBase and Hive Table (Doc ID 1952143.1)

Last updated on DECEMBER 10, 2014

Applies to:

Big Data Appliance Integrated Software - Version 3.0.1 and later
Linux x86-64

Symptoms

There are several scenarios accessing HBase from Hive via Oozie on Kerberos on BDA V3.0.1/CDH 5.0.1 which are representative of this problem.

1. Trying to insert a table from Hbase to Hive is failing in a Kerberos environment via an Oozie Hive action workflow.  For example a Hive action workflow on a secure cluster, that does an INSERT INTO <regular table> FROM <hbase table> as part of its script.  The output raises errors like:

ERROR org.apache.hadoop.hive.ql.Driver - FAILED: SemanticException Error while configuring input job properties org.apache.hadoop.hive.ql.parse.SemanticException: Error while configuring input job properties at org.apache.hadoop.hive.ql.optimizer.SimpleFetchOptimizer.transform(SimpleFetchOptimizer.java:94) at org.apache.hadoop.hive.ql.optimizer.Optimizer.optimize(Optimizer.java:146)
...
Caused by: java.lang.IllegalStateException: Error while configuring input job properties
...
Caused by: org.apache.hadoop.hbase.security.AccessDeniedException: org.apache.hadoop.hbase.security.AccessDeniedException:
Token generation only allowed for Kerberos authenticated clients
...
Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.security.AccessDeniedException): org.apache.hadoop.hbase.security.AccessDeniedException:
Token generation only allowed for Kerberos authenticated clients
 
or 
Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided ...

2. Joining a Hive-HBase handler table and a Hive table raises:

a) When run on the CLI:

Error: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask (state=08S01,code=2)

b) When run from Oozie:

Heart beat
Heart beat
Intercepting System.exit(2)

<<< Invocation of Main class completed <<<

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.Hive2Main], exit code [2]

Oozie Launcher failed, finishing Hadoop job gracefully

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms