The Performance of Oozie Workflow Jobs Degrades After a Few Days

(Doc ID 2394599.1)

Last updated on MAY 06, 2018

Applies to:

Big Data Appliance Integrated Software - Version 4.9.0 and later
Linux x86-64

Symptoms

On BDA V4.10/CDH 5.12.1 the performance of Oozie workflow jobs degrades after a few days.  The following is observed:


1. The Hiveserver2 logs show a significant lag between the time a Hive query is submitted to Hiveserver2 and the time a job is spun off with Yarn.

2. A look at the chart generated by the query in Cloudera Manager > Hive > Chart builder shows that after every restart of the Hiveserver2 service, the number of threads keeps increasing and does not go down.  This is observed with the following command in Chart Builder:

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms