My Oracle Support Banner

Job Errors During Restart of Cluster Services Report "File /opt/cloudera must be owned by root, but is owned by 495" (Doc ID 2354913.1)

Last updated on JANUARY 23, 2020

Applies to:

Big Data Appliance Integrated Software - Version 4.1.0 and later
Linux x86-64

Symptoms

NOTE: In the examples that follow, user details, cluster names, hostnames, directory paths, filenames, etc. represent a fictitious sample (and are used to provide an illustrative example only). Any similarity to actual persons, or entities, living or dead, is purely coincidental and not intended in any manner. 

While executing a long running job, job errors are encountered during the restart of cluster services.

The following error could be seen on most containers when cluster restart took place:

<TIMESTAMP> INFO mapreduce.Job: Task Id : attempt_<ATTEMPT_ID>, Status : FAILED
Container exited with a non-zero exit code 154
Exception when trying to cleanup container container_<CONTAINER_ID>: java.io.IOException: Problem signalling
container <CONTAINER_ID> with SIGTERM; output: and exitCode: 24
at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.signalContainer(LinuxContainerExecutor.java:489)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.cleanupContainer(ContainerLaunch.java:419)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher.handle(ContainersLauncher.java:139)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher.handle(ContainersLauncher.java:55)
at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:182)
at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:109)
at java.lang.Thread.run(Thread.java:748)
Caused by: ExitCodeException exitCode=24: File /opt/cloudera must be owned by root, but is owned by 495

The user 495 appears to be cloudera-scm.

The job running is temporarily impacted although it finishes after the new Resource Manager come online.

Note that while the symptoms are very similar to that reported in: BDA V4.1 Node Reprovision Fails at Step 10 StartHadoopServices Due to Failed NodeManager with: /opt/cloudera must be owned by root, but is owned by 494 (Doc ID 1987282.1) the underlying cause is not the same.

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!

In this Document
Symptoms
Cause
Solution
References

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.