Avro File Transfered Using FLUME Avro Event Source And HDFS Sink Are Corrupted
(Doc ID 1671979.1)
Last updated on NOVEMBER 08, 2022
Applies to:
Big Data Appliance Integrated Software - Version 2.2.1 and laterInformation in this document applies to any platform.
Symptoms
An Avro file transfered to HDFS using FLUME Avro event source and HDFS sink with default avro_event serializer does not have the same data as the origianl Avro file.
The files that is written into hdfs can be inspected, via hue's file manager, as an Avro file, however the file obtained as result of the flume transfer cannot be inspected via hue's file manager as an Avro file, so it is corrupted.
The file transfered to HDFS through flume client is also not recognized as an Avro file.
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
Symptoms |
Cause |
Solution |