My Oracle Support Banner

Spark Standalone Job from a Client/Edge BDA Node Raises "Could not connect to akka.tcp" and Fails to Connect to Spark Standalone Master on BDA V4.1/V4.2 (Doc ID 2016635.1)

Last updated on MARCH 12, 2021

Applies to:

Big Data Appliance Integrated Software - Version 4.1.0 and later
Linux x86-64

Symptoms

NOTE: In the examples that follow, user details, cluster names, hostnames, directory paths, filenames, etc. represent a fictitious sample (and are used to provide an illustrative example only). Any similarity to actual persons, or entities, living or dead, is purely coincidental and not intended in any manner.

On BDA V4.1/V4.2 when Spark is configured in Standalone Mode (note that Spark on YARN is the default on BDA V4.2), Spark standalone jobs submitted from any client/edge node fail to connect to the Spark master.   Instead the jobs error out like below:

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.