"Thrift Protocol Error" Observed in ODI 12c when More Than 20 Hive Jobs are Executed in Parallel (Doc ID 2467319.1)

Last updated on MAY 28, 2020

Applies to:

Symptoms

Within an Oracle Data Integrator (ODI) environment on a Big Data Appliance (BDA), executing more than twenty Hive jobs in parallel using an agent results in the below error in the agent log:

[2018-08-02T13:41:20.021+08:00] [odi] [ERROR] [ODI-1217] [oracle.odi.runtime.AgentName: OracleDIAgent1] [oracle.odi.runtime.ExecPhase: ExecuteTask] [oracle.odi.runtime.OdiUser: SUPERVISOR] [oracle.odi.runtime.WrepName: <NAME>] [oracle.odi.runtime.ScenarioName: PKG_<NAME>] [oracle.odi.runtime.ScenarioVer: 003] [oracle.odi.runtime.EntityGuid: <GUID>] [oracle.odi.runtime.SessName: PKG_<NAME>] [oracle.odi.runtime.SessId: 18000] [oracle.odi.runtime.SessStep: 4/VAR_<NAME>/1] [oracle.odi.runtime.SessTask: 4.5/Variable,VAR_<NAME>,null] [oracle.odi.runtime.ExecHierarchy: 18029] Session PKG_<NAME> (18000) fails with return code 8000.[[
ODI-1217: Session PKG_<NAME> (18000) fails with return code 8000.
ODI-1226: Step VAR_<NAME> fails after 1 attempt(s).
ODI-1228: Task Variable-VAR_<NAME>- fails on the target connection <NAME>.
Caused By: java.sql.SQLException: [FMWGEN][Hive JDBC Driver]THRIFT protocol error.
  at oracle.odi.jdbc.datasource.LoginTimeoutDatasourceAdapter.doGetConnection(LoginTimeoutDatasourceAdapter.java:144)
  at oracle.odi.jdbc.datasource.LoginTimeoutDatasourceAdapter.getConnection(LoginTimeoutDatasourceAdapter.java:73)
  at oracle.odi.core.datasource.dwgobject.support.OnConnectOnDisconnectDataSourceAdapter.getConnection(OnConnectOnDisconnectDataSourceAdapter.java:87)
  at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:111)
  at com.sunopsis.sql.SnpsConnection.createConnection(SnpsConnection.java:530)
  at com.sunopsis.sql.SnpsConnection.connect(SnpsConnection.java:486)
  at oracle.odi.runtime.agent.execution.VariableSessionTask.getExecutor(VariableSessionTask.java:232)
  at oracle.odi.runtime.agent.execution.VariableSessionTask.processTask(VariableSessionTask.java:177)
  at oracle.odi.runtime.agent.execution.SessionTask.doExecuteTask(SessionTask.java:117)
  at oracle.odi.runtime.agent.execution.VariableSessionTask.doExecuteTask(VariableSessionTask.java:164)
  at oracle.odi.runtime.agent.execution.AbstractSessionTask.execute(AbstractSessionTask.java:886)
  ...
Caused by: java.sql.SQLException: [FMWGEN][Hive JDBC Driver]THRIFT protocol error.
  at weblogic.jdbc.hivebase.ddcp.b(Unknown Source)
  at weblogic.jdbc.hivebase.ddcp.a(Unknown Source)
  at weblogic.jdbc.hivebase.ddco.b(Unknown Source)
  at weblogic.jdbc.hivebase.ddco.a(Unknown Source)
  at weblogic.jdbc.hive.HiveImplConnection.a(Unknown Source)
  at weblogic.jdbc.hive.HiveImplConnection.b(Unknown Source)
  at weblogic.jdbc.hivebase.BaseConnection.b(Unknown Source)
  at weblogic.jdbc.hivebase.BaseConnection.k(Unknown Source)
  at weblogic.jdbc.hivebase.BaseConnection.b(Unknown Source)
  at weblogic.jdbc.hivebase.BaseConnection.a(Unknown Source)
  at weblogic.jdbc.hivebase.BaseDriver.connect(Unknown Source)
  at oracle.odi.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriver(DriverManagerDataSource.java:412)
  at oracle.odi.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriver(DriverManagerDataSource.java:385)
  at oracle.odi.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriver(DriverManagerDataSource.java:352)
  at oracle.odi.jdbc.datasource.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:331)
  at oracle.odi.jdbc.datasource.LoginTimeoutDatasourceAdapter$ConnectionProcessor.run(LoginTimeoutDatasourceAdapter.java:228)
  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

Restarting the agent will mitigate the issue for a while, however, it will eventually return. 

Changes

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.