Spark Not Working On BDA With Error /opt/cloudera/parcels/.../parquet/lib/hadoop-yarn-api.jar (Too many open files) (Doc ID 2027150.1)

Last updated on JULY 20, 2015

Applies to:

Big Data Appliance Integrated Software - Version 4.1.0 and later
Linux x86-64

Symptoms

Spark is not working on newly installed BDA 4.2 cluster. 

Executing the following command:

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms