Hive Queries Failing with 'org.apache.hive.com.esotericsoftware.kryo.KryoException: Buffer underflow' Exception (Doc ID 1970542.1)

Last updated on OCTOBER 11, 2016

Applies to:

Big Data Appliance Integrated Software - Version 3.1.0 and later
Linux x86-64

Symptoms

On Oracle Big Data Appliance(BDA), Hive queries executed either from the command line or from Hue are failing with the following error:

Your query has the following error(s):
 Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
2015-02-10 03:08:38,745 FATAL [IPC Server handler 24 on 36854] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1423526287495_0060_m_000191_2 - exited : java.lang.RuntimeException: org.apache.hive.com.esotericsoftware.kryo.KryoException: Buffer underflow.
at org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:320)
at org.apache.hadoop.hive.ql.exec.Utilities.getMapWork(Utilities.java:259)
at org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:251)
at org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:378)
at org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:371)
at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:556)
at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.(MapTask.java:168)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:409)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: org.apache.hive.com.esotericsoftware.kryo.KryoException: Buffer underflow.
at org.apache.hive.com.esotericsoftware.kryo.io.Input.require(Input.java:181)
at org.apache.hive.com.esotericsoftware.kryo.io.Input.readVarInt(Input.java:355)
at org.apache.hive.com.esotericsoftware.kryo.Kryo.readReferenceOrNull(Kryo.java:809)
at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:670)
at org.apache.hadoop.hive.ql.exec.Utilities.deserializeObjectByKryo(Utilities.java:829)
at org.apache.hadoop.hive.ql.exec.Utilities.deserializePlan(Utilities.java:739)
at org.apache.hadoop.hive.ql.exec.Utilities.deserializePlan(Utilities.java:752)
at org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:292)

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms