How to Install Spark 2 on BDA 4.7 and Higher (Doc ID 2235319.1)

Last updated on APRIL 12, 2022

Applies to:

Big Data Appliance Integrated Software - Version 4.7.0 and later
Linux x86-64

Purpose

This document provides details on how to install Spark 2 on the Oracle Big Data Appliance (BDA) 4.7 and higher releases.

This note uses an example of installing Spark 2.0.2.

Note: As per the Cloudera Spark 2 Requirements documentation although CDH 5.7, CDH 5.8, CDH 5.9, CDH 5.10 are supported only Cloudera Manager 5.8.3, 5.9 and higher are. Cloudera Manager 5.8.3 is not currently supported on the BDA. What this means is:

On BDA 4.5 | CDH 5.7.0-5.7.4 / CM 5.7.0 <= Unsupported CM version
On BDA 4.6 | CDH 5.8.0-5.8.3 / CM 5.8.1 <= Unsupported CM version
On BDA 4.7 | CDH 5.9.0 / CM 5.9.0 <= Supported CDH and CM version

Note: BDA V4.8 and higher fully supports Spark 2.