HDFS is in Bad Health Due to Missing/Corrupt Blocks on BDA V4.1 (Doc ID 2042096.1)

Last updated on AUGUST 11, 2015

Applies to:

Big Data Appliance Integrated Software - Version 4.1.0 and later
Linux x86-64

Symptoms

Symptoms are as follows:

1. Cloudera Manager (CM) reports the hdfs service in bad health with an error indicating missing blocks above the critical threshold like:

146 missing blocks in the cluster. 607,920 total blocks in the cluster. Percentage missing blocks: 0.02%. Critical threshold: any.


2. Even after trying to workaround the problem by increasing the "DataNode Block Count Thresholds" as per the section: "Option 4: For upgrade only", in: Cloudera Manager shows "Concerning Health" for Some of the DataNodes on Oracle Big Data Appliance with "The DataNode has xxx,xxx blocks. Warning threshold: 200,000 block(s)." (Doc ID 1668414.1), bdacheckcluster reports: ERROR: Hadoop filesystem is not healthy.

  

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms