Running a Spark Job in Client Mode From a Non-BDA Edge Node Which Accesses the Spark Application Manager Web UI Fails with HTTP 500 (Doc ID 2368991.1)

Last updated on DECEMBER 17, 2022

Applies to:

Symptoms

When a Spark job is run in client mode from an edge node that is not on the BDA, accessing the Spark Application Manager Web UI fails with HTTP 500.

This makes it impossible to select the Application Master URL for spark applications running in client mode in order to view logs and monitor the progress of those applications.

For issues with Spark 2 jobs see: Running a Spark Job From a Non-BDA Edge Node Fails With: "ERROR shuffle.RetryingBlockFetcher: Exception while beginning fetch of 1 outstanding blocks" (Doc ID 2498643.1).

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.