My Oracle Support Banner

How to Remove a Disk from HDFS on Big Data Service with CDH Clusters (Doc ID 2933610.1)

Last updated on JULY 20, 2024

Applies to:

Big Data Service on OCI - Version N/A and later
Linux x86-64

Purpose

NOTE: In the examples that follow, user details, cluster names, hostnames, directory paths, filenames, etc. represent a fictitious sample (and are used to provide an illustrative example only). Any similarity to actual persons, or entities, living or dead, is purely coincidental and not intended in any manner. 

How to remove a disk From HDFS on Big Data Service (BDS) with CDH clusters.

Scope

Anyone needing to remove disk from HDFS for example to provide a dedicated disk for Kudu on a BDS with CDH cluster.

Details

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!

In this Document
Purpose
Scope
Details
 Background
 Solution
 Make sure the Hadoop Distributed File System is healthy and there are no Under-replicated blocks
 Review the DataNode Data Directories in Cloudera Manager (CM)
 One DataNode at a time, implement steps to override the directory for the disk that will be removed from HDFS
 Remove the DataNode Data Directory for the disk being removed from HDFS from the HDFS configuration


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.