The Performance of Oozie Workflow Jobs Degrades After a Few Days (Doc ID 2394599.1)

Last updated on SEPTEMBER 08, 2024

Applies to:

Symptoms

On BDA V4.10/CDH 5.12.1 the performance of Oozie workflow jobs degrades after a few days.  The following is observed:

1. The Hiveserver2 logs show a significant lag between the time a Hive query is submitted to Hiveserver2 and the time a job is spun off with Yarn.

2. A look at the chart generated by the query in Cloudera Manager > Hive > Chart builder shows that after every restart of the Hiveserver2 service, the number of threads keeps increasing and does not go down.  This is observed with the following command in Chart Builder:

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.