My Oracle Support Banner

Avro File Transfered Using FLUME Avro Event Source And HDFS Sink Are Corrupted (Doc ID 1671979.1)

Last updated on NOVEMBER 08, 2022

Applies to:

Big Data Appliance Integrated Software - Version 2.2.1 and later
Information in this document applies to any platform.

Symptoms

An Avro file transfered to HDFS using FLUME Avro event source and HDFS sink with default avro_event serializer does not have the same data as the origianl Avro file. 

The files that is written into hdfs can be inspected, via hue's file manager, as an Avro file, however the file obtained as result of the flume transfer cannot be inspected via hue's file manager as an Avro file, so it is corrupted.

The file transfered to HDFS through flume client is also not recognized as an Avro file.

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!

In this Document
Symptoms
Cause
Solution


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.