My Oracle Support Banner

Target HDFS Doesn't Show The Correct String Value Even When Traill From MySQL Goldengate Source Contains Correct Data (Doc ID 2505424.1)

Last updated on FEBRUARY 20, 2020

Applies to:

Oracle GoldenGate - Version 12.3.0.1.2 and later
Information in this document applies to any platform.

Symptoms

On : 12.3.0.1.2 version, 2 - Non Oracle DB backend

ACTUAL BEHAVIOR
---------------
Target table doesn't show correct string after GG sync.

Source: mysql database on windows, OGG version: 12.3.0.1.2
Target: HDFS BDA 4.11, CDH5.13,Hadoop2.6,Hive1.1,OGG for BigData_Linux_x64_12.3.2.1.1

Using OGG to synchronize, there is below issue:
Source table column <col1> values were given 13, 14, 15, 16, but it shows other unknown values in target hdfs.


DDL of table in Source:
CREATE TABLE `<table>` (
  `col1` float NOT NULL,
  `col2` varchar(100) COLLATE utf8_bin DEFAULT NULL,
  `col3` float DEFAULT NULL,
  PRIMARY KEY (`col1`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8 COLLATE=utf8_bin

Target side external table created in hive:

CREATE EXTERNAL TABLE <aaa>.<table>(
 col1 string,
 col2 string,
 col3 timestamp,
 col4 string,
 col5 string,
 col6 double,
 col7 varchar(500),
 col8 double)
ROW FORMAT SERDE
 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe'
WITH SERDEPROPERTIES (
'separatorChar' = ',',
'quoteChar' = '\"',
'escapeChar' = '\\',
'serialization.encoding'='ISO-8859-1')
LOCATION
 '<directory>'
TBLPROPERTIES (
 'store.charset'='ISO-8859-1',
 'retrieve.charset'='ISO-8859-1');

Changes

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Changes
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.