My Oracle Support Banner

Sqoop Import for Parquet Target with Hive Overwrite Option Fails with 'Metadata already exists for dataset' (Doc ID 2102209.1)

Last updated on NOVEMBER 08, 2022

Applies to:

Big Data Appliance Integrated Software - Version 4.0 to 4.2.0 [Release 4.0 to 4.2]
Linux x86-64

Goal

On Oracle Big Data Appliance 4.2 / CDH 5.4.0 , using Sqoop import command which imports Parquet data into a Hive table may fail if called a second time with --hive-overwrite option set.  The error looks like:

ERROR sqoop.Sqoop: Got exception running Sqoop: org.kitesdk.data.DatasetExistsException: Metadata already exists for dataset.

 

Solution

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Goal
Solution


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.