Running a spark-shell Command From a Edge Node Fails with Cannot run program "/etc/hadoop/conf.cloudera.yarn/" on BDA V4.3 and Higher

(Doc ID 2111307.1)

Last updated on FEBRUARY 29, 2016

Applies to:

Big Data Appliance Integrated Software - Version 4.3.0 and later
Linux x86-64


Running a spark-shell command from a client/edge node to a BDA V4.3 or higher BDA cluster fails with:

5/12/18 19:01:51 WARN net.ScriptBasedMapping: Exception running /etc/hadoop/conf.cloudera.yarn/ Cannot run program "/etc/hadoop/conf.cloudera.yarn/" (in directory "/root"): error=2, No such file or directory
  at java.lang.ProcessBuilder.start(
  at org.apache.hadoop.util.Shell.runCommand(
  at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(
Caused by: error=2, No such file or directory
  at java.lang.UNIXProcess.forkAndExec(Native Method)
  at java.lang.UNIXProcess.(
  at java.lang.ProcessImpl.start(
  at java.lang.ProcessBuilder.start(


This happens after the BDA was upgraded to a higher version of CDH than what is on the client/edge node.


Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms