My Oracle Support Banner

How to Install Spark 2 on BDA 4.7 and Higher (Doc ID 2235319.1)

Last updated on MARCH 05, 2020

Applies to:

Big Data Appliance Integrated Software - Version 4.7.0 and later
Linux x86-64

Purpose

This document provides details on how to install Spark 2 on the Oracle Big Data Appliance (BDA)  4.7 and higher releases.

This note uses an example of installing Spark 2.0.2.

Note: As per the Cloudera Spark 2 Requirements documentation although CDH 5.7, CDH 5.8, CDH 5.9, CDH 5.10 are supported only Cloudera Manager 5.8.3, 5.9 and higher are.  Cloudera Manager 5.8.3 is not currently supported on the BDA.  What this means is:

On BDA 4.5 | CDH 5.7.0-5.7.4 / CM 5.7.0 <= Unsupported CM version
On BDA 4.6 | CDH 5.8.0-5.8.3 / CM 5.8.1 <= Unsupported CM version
On BDA 4.7 | CDH 5.9.0 / CM 5.9.0 <= Supported CDH and CM version

Note: BDA V4.8 and higher fully supports Spark 2.

Scope

Anyone installing Spark 2 on BDA 4.7 - 4.9.  On BDA V4.10 Spark 2 is installed by default.

Details

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Purpose
Scope
Details
 Overview
 Background
 Spark 2 Frequently Asked Questions
 Known Issues with Spark 2 Install
 Spark 2 Install Prerequisites
 Cluster Health Checks
 BDA Version Verification
 Password Verification
 Spark 2 Install
 Download and Install the CSD file
 Download the CSD file
 Install the CSD
 Add the Spark 2 parcel repository to Remote Parcel Repository URLs
 If you have internet access add the Spark 2 parcel repository to Remote Parcel Repository URLs in CM
 If you do not have internet access
 Download/Distribute/Activate the SPARK2 parcel to the cluster
 Add the Spark 2 Service to CM
 Post Install Steps
 Known Issues with Spark 2
References

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.