Avro File Transfered Using FLUME Avro Event Source And HDFS Sink Are Corrupted (Doc ID 1671979.1)

Last updated on MAY 14, 2014

Applies to:

Big Data Appliance Integrated Software - Version 2.2.1 and later
Information in this document applies to any platform.

Symptoms

An Avro file transfered to HDFS using FLUME Avro event source and HDFS sink with default avro_event serializer does not have the same data as the origianl Avro file. 

The files that is written into hdfs can be inspected, via hue's file manager, as an Avro file, however the file obtained as result of the flume transfer cannot be inspected via hue's file manager as an Avro file, so it is corrupted.

The file transfered to HDFS through flume client is also not recognized as an Avro file.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms