Spark Standalone Job from a Client/Edge BDA Node Raises "Could not connect to akka.tcp" and Fails to Connect to Spark Standalone Master on BDA V4.1/V4.2

(Doc ID 2016635.1)

Last updated on MARCH 12, 2018

Applies to:

Big Data Appliance Integrated Software - Version 4.1.0 and later
Linux x86-64


On BDA V4.1/V4.2 when Spark is configured in Standalone Mode (note that Spark on YARN is the default on BDA V4.2), Spark standalone jobs submitted from any client/edge node fail to connect to the Spark master.   Instead the jobs error out like below:



Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms