Pig Queries from the HUE UI Fail with "ERROR com.hadoop.compression.lzo.GPLNativeCodeLoader" on BDA 3.0.*
(Doc ID 1910502.1)
Last updated on NOVEMBER 12, 2019
Applies to:
Big Data Appliance Integrated Software - Version 3.0 and laterx86_64
Symptoms
1. Running a pig query in the Hue UI, on a Client/Edge server, or on a BDA server on BDA 3.0.* raises an error about lzo compression, like:
2014-07-11 14:12:53,913 [JobControl] ERROR com.hadoop.compression.lzo.GPLNativeCodeLoader -
Could not load native gpl library
java.lang.UnsatisfiedLinkError: /usr/lib/hadoop/lib/native/libgplcompression.so:
/usr/lib/hadoop/lib/native/libgplcompression.so: wrong ELF class:
ELFCLASS64 (Possible cause: architecture word width mismatch)
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1965)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1890)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1880)
at java.lang.Runtime.loadLibrary0(Runtime.java:849)
at java.lang.System.loadLibrary(System.java:1088)
at com.hadoop.compression.lzo.GPLNativeCodeLoader.<clinit>(GPLNativeCodeLoader.java:32)
at com.hadoop.compression.lzo.LzoCodec.<clinit>(LzoCodec.java:71)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:270)
at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:1834)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1799)
Could not load native gpl library
java.lang.UnsatisfiedLinkError: /usr/lib/hadoop/lib/native/libgplcompression.so:
/usr/lib/hadoop/lib/native/libgplcompression.so: wrong ELF class:
ELFCLASS64 (Possible cause: architecture word width mismatch)
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1965)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1890)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1880)
at java.lang.Runtime.loadLibrary0(Runtime.java:849)
at java.lang.System.loadLibrary(System.java:1088)
at com.hadoop.compression.lzo.GPLNativeCodeLoader.<clinit>(GPLNativeCodeLoader.java:32)
at com.hadoop.compression.lzo.LzoCodec.<clinit>(LzoCodec.java:71)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:270)
at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:1834)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1799)
2. Checking in Cloudera Manager (CM) shows the proper HDFS configuration with regards to compression codecs.
In Cloudera Manager: hdfs > Configuration > View and Edit > Service-Wide > Compression Codecs shows the following added correctly:
com.hadoop.compression.lzo.LzoCodec
com.hadoop.compression.lzo.LzopCodec
com.hadoop.compression.lzo.LzopCodec
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Cause |
| Solution |