Running BDS On Exadata Fails With "KUP-11504: error from external driver: oracle.hadoop.sql.xcat.common.XCatException"
(Doc ID 2131274.1)
Last updated on NOVEMBER 08, 2022
Applies to:
Oracle Big Data SQL - Version 2.0 and laterLinux x86-64
Symptoms
NOTE: In the examples that follow, user details, cluster names, hostnames, directory paths, filenames, etc. represent a fictitious sample (and are used to provide an illustrative example only). Any similarity to actual persons, or entities, living or dead, is purely coincidental and not intended in any manner.
Running the following BDS query from Exadata server failed with following error:
select * from <Table>, gives error:
ORA-29913: error in executing ODCIEXTTABLEOPEN callout
ORA-29400: data cartridge error
KUP-11504: error from external driver: oracle.hadoop.sql.xcat.common.XCatException : 1001 : Error getting splits document. Cause : java.lang.RuntimeException: Error in configuring object
ORA-29913: error in executing ODCIEXTTABLEOPEN callout
ORA-29400: data cartridge error
KUP-11504: error from external driver: oracle.hadoop.sql.xcat.common.XCatException : 1001 : Error getting splits document. Cause : java.lang.RuntimeException: Error in configuring object
Below errors were shown in the log4j trace log:
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:16 DEBUG hadoop.XCatGetSplits: computeSplits driver type=hive
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:16 DEBUG hadoop.XCatHadoopUtil: XCatHadoopUtil.getInfm=mapred
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:16 DEBUG mapred.XCatMapredInfm: setInputPath=hdfs://<CLUSTER_NAME>-ns/data/hive/warehouse/test
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:18 DEBUG hadoop.XCatInfm: listStatus numExpanded=0
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:18 DEBUG hadoop.XCatInfm: listStatus(final) file =hdfs://<CLUSTER_NAME>-ns/data/hive/warehouse/test
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:18 ERROR sql.JXADDescribe: JXADDescribe.getInfo
oracle.hadoop.sql.xcat.common.XCatException : 1001 : Error getting splits document. Cause : java.lang.RuntimeException: Error in configuring object
at oracle.hadoop.sql.xcat.XCatInfo.getSplitsDoc(XCatInfo.java:430)
at oracle.hadoop.sql.JXADDescribe.getSplitsDoc(JXADDescribe.java:513)
at oracle.hadoop.sql.JXADDescribe._getInfo(JXADDescribe.java:380)
at oracle.hadoop.sql.JXADDescribe.getInfo(JXADDescribe.java:343)
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
at oracle.hadoop.sql.xcat.hadoop.mapred.XCatMapredInfm.computeBaseSplits(XCatMapredInfm.java:155)
at oracle.hadoop.sql.xcat.hadoop.XCatGetSplits.computeSplits(XCatGetSplits.java:506)
at oracle.hadoop.sql.xcat.XCatInfo.getSplits(XCatInfo.java:389)
at oracle.hadoop.sql.xcat.XCatInfo.getSplitsDoc(XCatInfo.java:419)
... 3 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
... 9 more
Caused by: java.lang.IllegalArgumentException: Compression codec com.hadoop.compression.lzo.LzoCodec not found.
at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:135)
at org.apache.hadoop.io.compress.CompressionCodecFactory.<init>(CompressionCodecFactory.java:175)
at org.apache.hadoop.mapred.TextInputFormat.configure(TextInputFormat.java:45)
... 14 more
Caused by: java.lang.ClassNotFoundException: Class com.hadoop.compression.lzo.LzoCodec not found
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2105)
at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:128)
... 16 more
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:16 DEBUG hadoop.XCatHadoopUtil: XCatHadoopUtil.getInfm=mapred
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:16 DEBUG mapred.XCatMapredInfm: setInputPath=hdfs://<CLUSTER_NAME>-ns/data/hive/warehouse/test
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:18 DEBUG hadoop.XCatInfm: listStatus numExpanded=0
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:18 DEBUG hadoop.XCatInfm: listStatus(final) file =hdfs://<CLUSTER_NAME>-ns/data/hive/warehouse/test
[4178B097_000000 describe.getInfo(2)] 16/04/14 08:38:18 ERROR sql.JXADDescribe: JXADDescribe.getInfo
oracle.hadoop.sql.xcat.common.XCatException : 1001 : Error getting splits document. Cause : java.lang.RuntimeException: Error in configuring object
at oracle.hadoop.sql.xcat.XCatInfo.getSplitsDoc(XCatInfo.java:430)
at oracle.hadoop.sql.JXADDescribe.getSplitsDoc(JXADDescribe.java:513)
at oracle.hadoop.sql.JXADDescribe._getInfo(JXADDescribe.java:380)
at oracle.hadoop.sql.JXADDescribe.getInfo(JXADDescribe.java:343)
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
at oracle.hadoop.sql.xcat.hadoop.mapred.XCatMapredInfm.computeBaseSplits(XCatMapredInfm.java:155)
at oracle.hadoop.sql.xcat.hadoop.XCatGetSplits.computeSplits(XCatGetSplits.java:506)
at oracle.hadoop.sql.xcat.XCatInfo.getSplits(XCatInfo.java:389)
at oracle.hadoop.sql.xcat.XCatInfo.getSplitsDoc(XCatInfo.java:419)
... 3 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
... 9 more
Caused by: java.lang.IllegalArgumentException: Compression codec com.hadoop.compression.lzo.LzoCodec not found.
at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:135)
at org.apache.hadoop.io.compress.CompressionCodecFactory.<init>(CompressionCodecFactory.java:175)
at org.apache.hadoop.mapred.TextInputFormat.configure(TextInputFormat.java:45)
... 14 more
Caused by: java.lang.ClassNotFoundException: Class com.hadoop.compression.lzo.LzoCodec not found
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2105)
at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:128)
... 16 more
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Cause |
| Solution |
| References |