My Oracle Support Banner

Upgrading Oracle Big Data Appliance from 2.5.0 to 3.0.1 Release Fails during Step 7 on Addyarn Can Not Log into Cloudera Manager (Doc ID 1910417.1)

Last updated on MAY 04, 2018

Applies to:

Big Data Appliance Integrated Software - Version 3.0.1 and later
Linux x86-64

Symptoms

The symptoms are:

1. When upgrading to BDA V3.0.1 from BDA 2.5 Step 7 of the Mammoth upgrade fails with:

Error [8425]: (//bdanode01.example.com//Stage[main]/Hadoop::Addyarn/Exec[add_yarn]/returns) change from notrun to 0 failed:
 /opt/oracle/BDAMammoth/bdaconfig/tmp/addyarn.sh &> /opt/oracle/BDAMammoth/bdaconfig/tmp/addyarn.out returned 1
instead of one of [0] at /opt/oracle/BDAMammoth/puppet/modules/hadoop/manifests/addyarn.pp:46

After this you can not log into Cloudera Manager (CM):

2.  From Node 3 checking the CM server status shows:

# service cloudera-scm-server status
  
cloudera-scm-server dead but pid file exists

3. The corresponding log file /var/log/cloudera-scm-server/cloudera-scm-server.log shows a connection problem:

...
2014-07-08 13:12:58,124  INFO [MainThread:config.ScheduledClusterStatsConfigUpdateListener@174] Initializing clusterstats schedule
2014-07-08 13:12:58,132  INFO [MainThread:config.ScheduledClusterStatsConfigUpdateListener@181] Nothing to do - clusterstats schedule is correct.
2014-07-08 13:12:58,150 ERROR [ParcelUpdateService:components.ParcelDownloaderImpl@391] Unable to retrieve remote parcel repository manifest
java.util.concurrent.ExecutionException: java.net.ConnectException: http://archive.cloudera.com/cdh5/parcels/latest/manifest.json
    at com.ning.http.client.providers.netty.NettyResponseFuture.abort(NettyResponseFuture.java:297)
    at com.ning.http.client.providers.netty.NettyConnectListener.operationComplete(NettyConnectListener.java:104)
    at org.jboss.netty.channel.DefaultChannelFuture.notifyListener(DefaultChannelFuture.java:399)
    ...
Caused by: java.net.ConnectException: http://archive.cloudera.com/cdh5/parcels/latest/manifest.json
    at com.ning.http.client.providers.netty.NettyConnectListener.operationComplete(NettyConnectListener.java:100)
    ...
Caused by: java.nio.channels.UnresolvedAddressException
    ...

4. addyarn.out shows:

Error : No output returned
Failed. Full error log in : /opt/oracle/BDAMammoth/bdaconfig/tmp/cm_commands.err
Error : No output returned
...
Timed out waiting for Cloudera Manager Server


The error in cm_commands.err is:

curl: (7) couldn't connect to host

5. The latest commands_<id>.outs file in /opt/oracle/BDAMammoth/bdaconfig/tmp shows:

{
  "id" : 7567,
  "name" : "Stop",
  "startTime" : "2014-07-08T17:44:00.625Z",
  "endTime" : "2014-07-08T17:44:00.625Z",
  "active" : false,
  "success" : false,
  "resultMessage" : "At least one role must be started.",
  "serviceRef" : {
    "serviceName" : "mgmt"
  },
  "children" : {
    "items" : [ ]
  }
}

  

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!

In this Document
Symptoms
Cause
Solution


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.