My Oracle Support Banner

HDFS is in Bad Health Due to Missing/Corrupt Blocks on BDA V4.1 (Doc ID 2042096.1)

Last updated on DECEMBER 05, 2019

Applies to:

Big Data Appliance Integrated Software - Version 4.1.0 and later
Linux x86-64

Symptoms

NOTE: In the examples that follow, user details, cluster names, hostnames, directory paths, filenames, etc. represent a fictitious sample (and are used to provide an illustrative example only). Any similarity to actual persons, or entities, living or dead, is purely coincidental and not intended in any manner.

  

Symptoms are as follows:

1. Cloudera Manager (CM) reports the hdfs service in bad health with an error indicating missing blocks above the critical threshold like:

146 missing blocks in the cluster. 607,920 total blocks in the cluster. Percentage missing blocks: 0.02%. Critical threshold: any.


2. Even after trying to workaround the problem by increasing the "DataNode Block Count Thresholds" as per the section: "Option 4: For upgrade only", in: Cloudera Manager shows "Concerning Health" for Some of the DataNodes on Oracle Big Data Appliance with "The DataNode has <NUM_BLOCKS> blocks. Warning threshold: 200,000 block(s)." (Doc ID 1668414.1), bdacheckcluster reports: ERROR: Hadoop filesystem is not healthy.

  

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.