In HDFS on Oracle Big Data Appliance getting "Could Not Open File For Appending (hadoop.hdfs.protocol.AlreadyBeingCreatedException)" (Doc ID 2121747.1)

Last updated on MARCH 31, 2016

Applies to:

Big Data Appliance Integrated Software - Version 4.3.0 and later
Linux x86-64

Symptoms

When we run the Abinitio (ETL tools) ingest Job, it fails with below error intermittently, for example it may fail 1 in 10 times that it is run:

could not open phase-log file for appending hadoop.hdfs.protocol.AlreadyBeingCreatedException) : Failed to create file (some file) for [DFSClient_NONMAPREDUCE_-some id] for client [some client IP] , because this file is already being created by [DFSClient_NONMAPREDUCE_1818157156_1308] on [some node IP]

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms