My Oracle Support Banner

On BDA 4.13/CDH 5.15 and Higher Impala Queries to Parquet Files Raise "invalid file metadata at file offset. Error = couldn't deserialize thrift msg" (Doc ID 2585870.1)

Last updated on OCTOBER 01, 2019

Applies to:

Big Data Appliance Integrated Software - Version 4.13.0 and later
Linux x86-64

Symptoms

On BDA 4.13 / CDH 5.15 and higher,  error messages like below can be raised in Impala (via the CLI or in Hue) when querying tables stored as Parquet:

WARNINGS: File hdfs://<PATH> has invalid file metadata at file offset . Error = couldn't deserialize thrift msg: type:.

The error is random for different tables. And running "refresh <TABLE>" on the table to force a refresh of file metadata does not help.

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.