Running a Spark Job in Client Mode From a Non-BDA Edge Node Which Accesses the Spark Application Manager Web UI Fails with HTTP 500
(Doc ID 2368991.1)
Last updated on JULY 05, 2021
Big Data Appliance Integrated Software - Version 4.7.0 and later Linux x86-64
When a Spark job is run in client mode from an edge node that is not on the BDA, accessing the Spark Application Manager Web UI fails with HTTP 500.
This makes it impossible to select the Application Master URL for spark applications running in client mode in order to view logs and monitor the progress of those applications.
For issues with Spark 2 jobs see: Running a Spark Job From a Non-BDA Edge Node Fails With: "ERROR shuffle.RetryingBlockFetcher: Exception while beginning fetch of 1 outstanding blocks" (Doc ID 2498643.1).
To view full details, sign in with your My Oracle Support account.
Don't have a My Oracle Support account? Click to get started!