Spark job in Yarn Cluster Mode Raises: java.io.IOException: Filesystem closed on the BDA
(Doc ID 1980886.1)
Last updated on MARCH 12, 2021
Applies to:Big Data Appliance Integrated Software - Version 3.0.1 and later
Running a Spark job in Yarn Cluster Mode Raises: java.io.IOException: Filesystem closed on the BDA.
The job runs successfully in the spark shell, but not through pyspark. The job is run as:
To view full details, sign in with your My Oracle Support account.
Don't have a My Oracle Support account? Click to get started!
In this Document