Spark 2 Frequently Asked Questions
(Doc ID 2337695.1)
Last updated on JANUARY 03, 2023
Applies to:
Big Data Appliance Integrated Software - Version 3.0.1 and laterLinux x86-64
Purpose
To provide answers to frequently asked questions for Spark 2.
Questions and Answers
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Purpose |
| Questions and Answers |
| Where can more information on Spark 2 version compatibility be found? |
| Why is Spark 2.0.2 only supported on BDA 4.7 and higher? |
| Can the Spark 1.6 service co-exist on the same cluster as Spark 2? |
| Do you need a different Spark 2 parcel for BDA 4.5/CDH 5.7, BDA 4.6/CDH 5.8, BDA 4.7/CDH 5.9? |
| Spark 2 needs Scala version 2.11 so does that need to be upgraded along with Spark 2? |
| What about Spark 2.1? Is installing that supported? |
| Is it possible to setup a Spark 2 client on an edge node and if so where are the rpms for that? |
| Is it possible submit Spark 2 jobs from Edge nodes? |
| On BDA 5.2/CDH 6.3.4 with Spark 2.4.0 can jobs be submitted from edge nodes (which are part of the cluster) running Scala 2.12.9 or higher? |
| Is Spark 3 supported on CDH 6? |
| What Spark version is compatible with Scala 2.12.9 or higher? |
| Is it possible to retain Spark 2 and install Spark 3 on a BDA 5.2 cluster without impacting the default Spark 2 that comes with CDH 6.3.4? |
| Can Spark or Scala be upgraded on CDH 6? |
| Are Spark2 Oozie actions supported? |
| References |