On Oracle Big Data Appliance BDR Replication Corrupts Target Hive Table

(Doc ID 2000461.1)

Last updated on OCTOBER 11, 2016

Applies to:

Big Data Appliance Integrated Software - Version 4.1.0 and later
Linux x86-64

Symptoms

BDR hive replication setup from CDH5.3.0 to CDH5.3.0 works first time.  Once data is added to source table then replication job corrupts target table.

- Source table is created as CTAS from partitioned table.
Test case is:
- Populate source table with data
- Run replication ( works ok, SELECT on target is ok )
- Add more data to source ( INSERT from partitioned source table )
- Run replication
On target:

select count(*) from <TableName>;
FAILED: NullPointerException null

Also error occurs depending on how data is loaded into source table.  If data is loaded via Hive LOAD statement issue doesn't occur. If via INSERT statement then select fails on target table.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms