Hive Impersonation on BDCS with BDM Notebooks and Spark Fails with Errors: "...WARN security.UserGroupInformation: PriviledgedActionException...Authentication Failed..."
(Doc ID 2532441.1)
Last updated on FEBRUARY 06, 2020
Applies to:Big Data Cloud Service - Version 1.0 and later
Information in this document applies to any platform.
Using BDCS 4.11.4 and hive impersonation as Big Data Manager (BDM) user (bigdatamgr) fails with errors like:
This happens with BDM Notebooks and Spark2 shell when using impersonation. The errors happen even though the Cloudera Manager HDFS Service configuration for "hadoop.proxyuser.bigdatamgr.users" is set to a value of " * ". This setting is confirmed by logging in to Cloudera Manager (CM) -> click HDFS Service-> Configuration-> Service-Wide-Advanced-> Cluster-wide Advanced Configuration Snippet (Safety Valve) and using search terms "hadoop.proxyuser.bigdatamgr.users".
When accessing Spark from BigDataManager Notebook, or from the command line, as bigdatamgr user it works fine with impersonation turned OFF.
The problem is limited to spark and BDM when using impersonation with BDM user (bigdatamgr).
To view full details, sign in with your My Oracle Support account.
Don't have a My Oracle Support account? Click to get started!
In this Document