BDA Rolling Upgrade to BDA V4.3 Fails on Step 5 - Failed to upgrade cluster - Parcel is not Upgraded (Doc ID 2081795.1)

Last updated on NOVEMBER 24, 2015

Applies to:

Big Data Appliance Integrated Software - Version 4.3.0 and later
Linux x86-64

Symptoms

BDA rolling upgrade to BDA V4.3 from BDA V4.2 fails on Step 5.  The CDH parcel is not upgraded, upgrade fails.  For details on rolling upgrade see: Upgrading Oracle Big Data Appliance Cluster to V4.3 with Mammoth (Software Deployment Bundle) Release V4.3 Frequently Asked Questions (FAQ) (Doc ID 2080984.1).

The symptoms for the Step 5 rolling upgrade parcel failure are as below:


1. On a rolling upgrade to BDA V4.3 from BDA V4.2 Step 5 of the upgrade fails with:

************************************
Error [13256]: (//bdanode03.example.com//Stage[main]/Hadoop::Installcdhparcel/Exec[deployparcel]/returns)
change from notrun to 0 failed: /opt/oracle/BDAMammoth/bdaconfig/tmp/deployparcel.sh &>
/opt/oracle/BDAMammoth/bdaconfig/tmp/deployparcel_1447900904.out returned 1 instead of one of [0]
************************************


2. The /opt/oracle/BDAMammoth/bdaconfig/tmp/deployparcel_1447900904.out shows failures related to the parcel upgrade. Possible failure output can look like below.  Different failures are possible.

a) Example output:

Command 1355 finished after 600 seconds
Operation failed
Result Message is: "Failed to upgrade cluster"


b) Example output:

Error : Cannot upgrade because the version is already CDH 5.4.7.
Failed. Full error output in : /opt/oracle/BDAMammoth/bdaconfig/tmp/clusters_neoscl_commands_upgradeCdh.out
API Version used is v10


Where the associated /opt/oracle/BDAMammoth/bdaconfig/tmp/clusters_neoscl_commands_upgradeCdh.out shows:

 "message" : "Cannot upgrade because the version is already CDH 5.4.7."


3. Some of the parcel upgrade is in place:
a) 'dcli -C hadoop version' reports "Hadoop 2.6.0-cdh5.4.7" on each node.
b) From Cloudera Manager (CM), navigating to Home > <cluster_name> > shows the expected: CDH 5.4.7 Parcels.

4. However from CM, navigating to Hosts > Parcels > Parcel Usage, shows that the parcel upgrade is incomplete on one or more hosts. One or more hosts report a parcel status of:

"Multiple product versions running on a single host".

There are nodes in the cluster where the parcel upgrade is not complete. Although parcel upgrade may have been completed on some of the nodes as well.

For example:

a) Example of 3 nodes with "Multiple product versions running on a single host":

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms