Pig Job on BDA 4.11 Fails with Error: "HCatException : 2012 : Moving of data failed during commit : Could not find a unique destination path for move ..."

(Doc ID 2379691.1)

Last updated on APRIL 04, 2018

Applies to:

Big Data Appliance Integrated Software - Version 4.11 and later
Linux x86-64

Symptoms

A certain Pig job fails when running it on a 6-node BDA 4.11 / CDH 5.13.1 cluster. This job had been working fine but started failing with errors like:


There have been no changes to the Pig script invoking the job, but the cluster was recently upgraded from BDA 4.6/CDH 5.8.0 to BDA 4.10/CDH 5.12.1 and finally to BDA 4.11/5.13.1.


Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms