Flume Channel Capacity Reached-Sending Data to an HDFS Sink Fails with "org.apache.flume.ChannelException: Unable to put batch on required channel: FileChannel <channel name> { dataDirs: [/data/flume/<channel name>] } " (Doc ID 2159085.1)

Last updated on JULY 12, 2016

Applies to:

Big Data Appliance Integrated Software - Version 4.3.0 and later
Linux x86-64

Symptoms

One of Flume's channels reaches 100% capacity. This causes the trigger for the Flume channel metric "channel_fill_percentage" to fire which brings the Flume service in CM into "bad" health.

The Kafka source sending data to an hdfs sink fails with:

 

org.apache.flume.ChannelException: Unable to put batch on required channel: FileChannel <channel name> { dataDirs: [/data/flume/<channel name>] } "

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms