OCI Data Flow - Python Libraries NumPy and Pandas Fail to Import When Trying to Install PySpark API in OCI Data Flow
(Doc ID 2986656.1)
Last updated on NOVEMBER 13, 2023
Applies to:
Oracle Cloud Infrastructure Data Flow - Version N/A and laterInformation in this document applies to any platform.
In order to install PySpark API in OCI DataFlow additional libraries are needed.
This document refers to the particular situation where the Python libraries NumPy and Pandas fail to import.
Symptoms
Importing Python modules fail with the following error:
Changes
The error was encountered using the following environment variables:
Spark Version 3.2.1
Spark Oracle Deltalake Version 1.2.1
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
Symptoms |
Changes |
Cause |
Solution |