My Oracle Support Banner

HDFS Balancer Can Not Rebalance HDFS Data on One BDA Cluster Node (Doc ID 2919097.1)

Last updated on JULY 20, 2024

Applies to:

Big Data Appliance Integrated Software - Version 4.13.0 and later
x86_64

Symptoms

The problem faced is that running the HDFS Balancer (by navigating in Cloudera Manager (CM): HDFS > Balancer), does not rebalance HDFS data on one cluster host. On the affected cluster host the amount of HDFS data does not rebalance, although the HDFS data is rebalanced on the remaining cluster hosts.

The Balancer logs show that data is being moved from the affected host, but the amount of HDFS data does not balance out as on the other cluster hosts. The Balancer logs report messages like below indicating that HDFS data is being moved:

Decided to move 10 GB bytes from <PRIVATE_IP_AFFECTED_HOST>:1004:DISK to <PRIVATE_IP_ANOTHER_HOST>:1004:DISK

The root file system is normal and there is no non-HDFS data on the HDFS disks.

Changes

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!

In this Document
Symptoms
Changes
Cause
Solution


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.