Running BDS On Exadata Fails With "KUP-11504: error from external driver: oracle.hadoop.sql.xcat.common.XCatException" (Doc ID 2131274.1)

Last updated on NOVEMBER 02, 2017

Applies to:

Oracle Big Data SQL - Version 2.0 and later
Linux x86-64

Symptoms

Running the following BDS query from Exadata server failed with following error:

select * from t_answer, gives error:

ORA-29913: error in executing ODCIEXTTABLEOPEN callout
ORA-29400: data cartridge error
KUP-11504: error from external driver: oracle.hadoop.sql.xcat.common.XCatException : 1001 : Error getting splits document. Cause : java.lang.RuntimeException: Error in configuring object

Below errors were shown in the log4j trace log:

[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:16 DEBUG hadoop.XCatGetSplits: computeSplits driver type=hive
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:16 DEBUG hadoop.XCatHadoopUtil: XCatHadoopUtil.getInfm=mapred
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:16 DEBUG mapred.XCatMapredInfm: setInputPath=hdfs://<cluster_name>-ns/data/hive/warehouse/test
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:18 DEBUG hadoop.XCatInfm: listStatus numExpanded=0
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:18 DEBUG hadoop.XCatInfm: listStatus(final) file =hdfs://<cluster_name>-ns/data/hive/warehouse/test
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:18 ERROR sql.JXADDescribe: JXADDescribe.getInfo
oracle.hadoop.sql.xcat.common.XCatException : 1001 : Error getting splits document. Cause : java.lang.RuntimeException: Error in configuring object
at oracle.hadoop.sql.xcat.XCatInfo.getSplitsDoc(XCatInfo.java:430)
at oracle.hadoop.sql.JXADDescribe.getSplitsDoc(JXADDescribe.java:513)
at oracle.hadoop.sql.JXADDescribe._getInfo(JXADDescribe.java:380)
at oracle.hadoop.sql.JXADDescribe.getInfo(JXADDescribe.java:343)
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
at oracle.hadoop.sql.xcat.hadoop.mapred.XCatMapredInfm.computeBaseSplits(XCatMapredInfm.java:155)
at oracle.hadoop.sql.xcat.hadoop.XCatGetSplits.computeSplits(XCatGetSplits.java:506)
at oracle.hadoop.sql.xcat.XCatInfo.getSplits(XCatInfo.java:389)
at oracle.hadoop.sql.xcat.XCatInfo.getSplitsDoc(XCatInfo.java:419)
... 3 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
... 9 more
Caused by: java.lang.IllegalArgumentException: Compression codec com.hadoop.compression.lzo.LzoCodec not found.
at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:135)
at org.apache.hadoop.io.compress.CompressionCodecFactory.<init>(CompressionCodecFactory.java:175)
at org.apache.hadoop.mapred.TextInputFormat.configure(TextInputFormat.java:45)
... 14 more
Caused by: java.lang.ClassNotFoundException: Class com.hadoop.compression.lzo.LzoCodec not found
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2105)
at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:128)
... 16 more

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms