After Enabling BDD V1.1.1 on a Secure BDA Cluster Fails Spark Gives Errors

(Doc ID 2091735.1)

Last updated on DECEMBER 24, 2015

Applies to:

Big Data Appliance Integrated Software - Version 4.3.0 and later
Linux x86-64

Symptoms

On a secure Oracle Big Data Appliance V4.3.0 cluster Hive and Spark errors are raised after enabling Oracle Big Data Discovery (BDD) V1.1.1 with 'bdacli enable bdd' fails.

Hive and Spark show the following error for running jobs that worked prior to the failure enabling BDD.

Traceback (most recent call last):
File "/home/<user>/<Name>.py", line 224, in <module>
rows = hiveCtx.sql("SELECT id, comment FROM <table>")
File "/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/spark/python/pyspark/sql/context.py", line 528, in sql
return DataFrame(self._ssql_ctx.sql(sqlQuery), self)
File "/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/spark/python/lib/py4j-0.8.2.1-src.zip/py4j/java_gateway.py", line 538, in __call__
File "/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/spark/python/lib/py4j-0.8.2.1-src.zip/py4j/protocol.py", line 300, in get_return_value
py4j.protocol.Py4JJavaError: An error occurred while calling o33.sql.
: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient

at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:511)
at org.apache.spark.sql.hive.HiveContext.sessionState$lzycompute(HiveContext.scala:229)
at org.apache.spark.sql.hive.HiveContext.sessionState(HiveContext.scala:225)

 



Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms