BDA V4.2 Upgrade Fails at Step 5 during Hadoop::Installcdhparcel with "1 host(s) that cannot be reached. These hosts must be fixed,..." (Doc ID 2021471.1)

Last updated on JUNE 18, 2015

Applies to:

Big Data Appliance Integrated Software - Version 4.2.0 to 4.2.0 [Release 4.2]
Linux x86-64

Symptoms

The symptoms are:

1. During upgrade to BDA V4.2, the upgrade fails at step 5 with:

Error [11357]: (//bdanode03.example.com//Stage[main]/Hadoop::Installcdhparcel/Exec[deployparcel]/returns) change from notrun to 0 failed:
/opt/oracle/BDAMammoth/bdaconfig/tmp/deployparcel.sh &> /opt/oracle/BDAMammoth/bdaconfig/tmp/deployparcel_1434411153.out
returned 1 instead of one of [0]

 

2. Checking /opt/oracle/BDAMammoth/bdaconfig/tmp/deployparcel_1434411153.out shows that the parcel was distributed but not upgraded:

Parcel distribution finished after 370 seconds, Current date Mon Jun 15 19:11:17 CDT 2015
API Version used is v10
Succeeded. Output in : /opt/oracle/BDAMammoth/bdaconfig/tmp/clusters_bdaolc01_commands_upgradeCdh.out
Command ID is 24189

Command 24189 finished after 5 seconds
Operation failed
Result Message is:   "Failed to upgrade cluster: <a target=\"_blank\" href=\"/cmf/hardware/hosts?filterHeartbeatHealth=bad\">1 host(s) that cannot be reached</a>. These hosts must be fixed, decommissioned, or removed from the cluster before upgrade can proceed.",

 

3. Checking commands_24189.out shows a similar message:

{
 
"id" : 24189,
"name" : "UpgradeCluster",
"startTime" : "2015-06-16T00:11:17.317Z",
"endTime" : "2015-06-16T00:11:17.317Z",
"active" : false,
"success" : false,
"resultMessage" : "Failed to upgrade cluster:
1 host(s)
that cannot be reached. These hosts must be fixed, decommissioned,
or removed from the cluster before upgrade can proceed.",
"clusterRef" : {
   "clusterName" : "cluster"
 },
"children" : {
   "items" : [ ]
 }
}


4. In Cloudera Manager (CM) checking for hosts shows that  Node 4 did not have a heartbeat for 40 minutes.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms