My Oracle Support Banner

Running a Spark Job in Client Mode From a Non-BDA Edge Node Which Accesses the Spark Application Manager Web UI Fails with HTTP 500 (Doc ID 2368991.1)

Last updated on DECEMBER 17, 2022

Applies to:

Big Data Appliance Integrated Software - Version 4.7.0 and later
Linux x86-64


When a Spark job is run in client mode from an edge node that is not on the BDA, accessing the Spark Application Manager Web UI fails with HTTP 500.

This makes it impossible to select the Application Master URL for spark applications running in client mode in order to view logs and monitor the progress of those applications.

For issues with Spark 2 jobs see: Running a Spark Job From a Non-BDA Edge Node Fails With: "ERROR shuffle.RetryingBlockFetcher: Exception while beginning fetch of 1 outstanding blocks" (Doc ID 2498643.1).


To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!

In this Document
 Options for Resolution
 Additional Considerations
 Workaround Steps
 Steps to Revert the iptables Rules

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.