"Thrift Protocol Error" Observed in ODI 12c when More Than 20 Hive Jobs are Executed in Parallel
(Doc ID 2467319.1)
Last updated on MAY 28, 2020
Applies to:
Oracle Data Integrator - Version 12.2.1.2.6 and laterInformation in this document applies to any platform.
Symptoms
Within an Oracle Data Integrator (ODI) environment on a Big Data Appliance (BDA), executing more than twenty Hive jobs in parallel using an agent results in the below error in the agent log:
[2018-08-02T13:41:20.021+08:00] [odi] [ERROR] [ODI-1217] [oracle.odi.runtime.AgentName: OracleDIAgent1] [oracle.odi.runtime.ExecPhase: ExecuteTask] [oracle.odi.runtime.OdiUser: SUPERVISOR] [oracle.odi.runtime.WrepName: <NAME>] [oracle.odi.runtime.ScenarioName: PKG_<NAME>] [oracle.odi.runtime.ScenarioVer: 003] [oracle.odi.runtime.EntityGuid: <GUID>] [oracle.odi.runtime.SessName: PKG_<NAME>] [oracle.odi.runtime.SessId: 18000] [oracle.odi.runtime.SessStep: 4/VAR_<NAME>/1] [oracle.odi.runtime.SessTask: 4.5/Variable,VAR_<NAME>,null] [oracle.odi.runtime.ExecHierarchy: 18029] Session PKG_<NAME> (18000) fails with return code 8000.[[
ODI-1217: Session PKG_<NAME> (18000) fails with return code 8000.
ODI-1226: Step VAR_<NAME> fails after 1 attempt(s).
ODI-1228: Task Variable-VAR_<NAME>- fails on the target connection <NAME>.
Caused By: java.sql.SQLException: [FMWGEN][Hive JDBC Driver]THRIFT protocol error.
at oracle.odi.jdbc.datasource.LoginTimeoutDatasourceAdapter.doGetConnection(LoginTimeoutDatasourceAdapter.java:144)
at oracle.odi.jdbc.datasource.LoginTimeoutDatasourceAdapter.getConnection(LoginTimeoutDatasourceAdapter.java:73)
at oracle.odi.core.datasource.dwgobject.support.OnConnectOnDisconnectDataSourceAdapter.getConnection(OnConnectOnDisconnectDataSourceAdapter.java:87)
at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:111)
at com.sunopsis.sql.SnpsConnection.createConnection(SnpsConnection.java:530)
at com.sunopsis.sql.SnpsConnection.connect(SnpsConnection.java:486)
at oracle.odi.runtime.agent.execution.VariableSessionTask.getExecutor(VariableSessionTask.java:232)
at oracle.odi.runtime.agent.execution.VariableSessionTask.processTask(VariableSessionTask.java:177)
at oracle.odi.runtime.agent.execution.SessionTask.doExecuteTask(SessionTask.java:117)
at oracle.odi.runtime.agent.execution.VariableSessionTask.doExecuteTask(VariableSessionTask.java:164)
at oracle.odi.runtime.agent.execution.AbstractSessionTask.execute(AbstractSessionTask.java:886)
...
Caused by: java.sql.SQLException: [FMWGEN][Hive JDBC Driver]THRIFT protocol error.
at weblogic.jdbc.hivebase.ddcp.b(Unknown Source)
at weblogic.jdbc.hivebase.ddcp.a(Unknown Source)
at weblogic.jdbc.hivebase.ddco.b(Unknown Source)
at weblogic.jdbc.hivebase.ddco.a(Unknown Source)
at weblogic.jdbc.hive.HiveImplConnection.a(Unknown Source)
at weblogic.jdbc.hive.HiveImplConnection.b(Unknown Source)
at weblogic.jdbc.hivebase.BaseConnection.b(Unknown Source)
at weblogic.jdbc.hivebase.BaseConnection.k(Unknown Source)
at weblogic.jdbc.hivebase.BaseConnection.b(Unknown Source)
at weblogic.jdbc.hivebase.BaseConnection.a(Unknown Source)
at weblogic.jdbc.hivebase.BaseDriver.connect(Unknown Source)
at oracle.odi.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriver(DriverManagerDataSource.java:412)
at oracle.odi.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriver(DriverManagerDataSource.java:385)
at oracle.odi.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriver(DriverManagerDataSource.java:352)
at oracle.odi.jdbc.datasource.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:331)
at oracle.odi.jdbc.datasource.LoginTimeoutDatasourceAdapter$ConnectionProcessor.run(LoginTimeoutDatasourceAdapter.java:228)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
Restarting the agent will mitigate the issue for a while, however, it will eventually return.
Changes
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
Symptoms |
Changes |
Cause |
Solution |
References |