Sqoop is Not Working on BDA Nodes After Upgrading BDA to Version 4.1 and higher Fails with: ERROR: Detected incomplete Hadoop installation in /usr/lib/hadoop (Doc ID 1984423.1)

Last updated on MARCH 29, 2016

Applies to:

Big Data Appliance Integrated Software - Version 4.1.0 and later
Linux x86-64

Symptoms

After upgrading BDA to 4.1, the sqoop command is not working on BDA nodes and it fails with the following error:

$ sqoop eval --connect jdbc:oracle:thin:@//sde4-scan:1521/<XXXX> --username <user-name> --password <pw> --query "SELECT test_time,count(*) from <DB>.<TABLE> WHERE SRCE_SYS_ID=<id> group by test_time"

ERROR: Detected incomplete Hadoop installation in /usr/lib/hadoop. This is likely because you have not removed packages in a parcel environment, or you have a leftover /usr/lib/hadoop directory. If you are using parcels, please remove the /usr/lib/hadoop directory.
$ sqoop eval --connect jdbc:oracle:thin:@//sde4-scan:1521/<XXXX> --username <user-name> --password <pw> --query "SELECT test_time,count(*) from <DB>.<TABLE> WHERE SRCE_SYS_ID=<id> group by test_time"
ERROR: Detected incomplete Hadoop installation in /usr/lib/hadoop. This is likely because you have not removed packages in a parcel environment, or you have a leftover /usr/lib/hadoop directory. If you are using parcels, please remove the /usr/lib/hadoop directory.

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms