Pig Queries from the HUE UI Fail with "ERROR com.hadoop.compression.lzo.GPLNativeCodeLoader" on BDA 3.0.*

(Doc ID 1910502.1)

Last updated on JULY 24, 2014

Applies to:

Big Data Appliance Integrated Software - Version 3.0 and later
x86_64

Symptoms

1. Running a pig query in the Hue UI, on a Client/Edge server, or on a BDA server on BDA 3.0.* raises an error about lzo compression, like:

2014-07-11 14:12:53,913 [JobControl] ERROR com.hadoop.compression.lzo.GPLNativeCodeLoader -
Could not load native gpl library
java.lang.UnsatisfiedLinkError: /usr/lib/hadoop/lib/native/libgplcompression.so:
/usr/lib/hadoop/lib/native/libgplcompression.so: wrong ELF class:
 ELFCLASS64 (Possible cause: architecture word width mismatch)
       at java.lang.ClassLoader$NativeLibrary.load(Native Method)
       at java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1965)
       at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1890)
       at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1880)
       at java.lang.Runtime.loadLibrary0(Runtime.java:849)
       at java.lang.System.loadLibrary(System.java:1088)
       at com.hadoop.compression.lzo.GPLNativeCodeLoader.<clinit>(GPLNativeCodeLoader.java:32)
       at com.hadoop.compression.lzo.LzoCodec.<clinit>(LzoCodec.java:71)
       at java.lang.Class.forName0(Native Method)
       at java.lang.Class.forName(Class.java:270)
       at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:1834)
       at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1799)


2. Checking in Cloudera Manager (CM) shows the proper HDFS configuration with regards to compression codecs.

In Cloudera Manager:  hdfs > Configuration > View and Edit > Service-Wide > Compression Codecs  shows the following added correctly:

com.hadoop.compression.lzo.LzoCodec
com.hadoop.compression.lzo.LzopCodec



Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms