On Oracle Big Data Appliance BDA 4.1/CDH5.3.0, on Nodes with Disk/s Replaced Higher HDFS Usage Noticed Compared to Rest of the Nodes in the Cluster (Doc ID 2022604.1)

Last updated on OCTOBER 11, 2016

Applies to:

Big Data Appliance Integrated Software - Version 4.1.0 and later
Linux x86-64

Symptoms

On Oracle Big Data Appliance BDA 4.1/CDH 5.3 , replaced bad disks on 2 nodes. After disk replacement on those 2 nodes, > 90% usage is noticed wrdgs to HDFS data. Where as rest of the nodes in cluster report only 70% usage

Tried balancing the cluster with lowest threshold value but still the same issue

mkdir /tmp/balancer_log
nohup su hdfs -c "hdfs balancer -threshold 2" > /tmp/balancer_log/stderr.log 2> /tmp/balancer_log/stdout.log &

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms