Hive Query Fails with 'java.lang.OutOfMemoryError: GC overhead limit exceeded'

(Doc ID 1928744.1)

Last updated on OCTOBER 31, 2017

Applies to:

Big Data Appliance Integrated Software - Version 2.5.0 and later
Linux x86-64

Symptoms

Executing Hive query against a table with > 5Million rows from Hive Client shell fails with 'GC overhead limit exceeded' error. The same error will occur even when executing select count(*)

hive> select * from <Table_Name> limit 1;
Exception in thread "main" java.lang.OutOfMemoryError: GC overhead limit exceeded
  at java.util.Arrays.copyOf(Arrays.java:2367)
  at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:130)
.......
  at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:790)
  at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:684)
  at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:623)

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms