My Oracle Support Banner

Running a Spark Job in Client Mode From a Non-BDA Edge Node Which Accesses the Spark Application Manager Web UI Fails with HTTP 500 (Doc ID 2368991.1)

Last updated on FEBRUARY 02, 2019

Applies to:

Big Data Appliance Integrated Software - Version 4.7.0 and later
Linux x86-64

Symptoms

When a Spark job is run in client mode from an edge node that is not on the BDA, accessing the Spark Application Manager Web UI fails with HTTP 500.

This makes it impossible to select the Application Master URL for spark applications running in client mode in order to view logs and monitor the progress of those applications.

For issues with Spark 2 jobs see: Running a Spark Job From a Non-BDA Edge Node Fails With: "ERROR shuffle.RetryingBlockFetcher: Exception while beginning fetch of 1 outstanding blocks" (Doc ID 2498643.1).

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution
 Options for Resolution
 Additional Considerations
 Workaround
 Workaround Steps
 Steps to Revert the iptables Rules
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.