HOWTO : Resolve TimesTen Errors TT0907 & TT16187 With Replication Agent Core Dump (Doc ID 782680.1)

Last updated on SEPTEMBER 22, 2016

Applies to:

Oracle TimesTen In-Memory Database - Version 7.0.0.0.0 to 7.0.3.0.0 [Release 7.0]
Information in this document applies to any platform.
***Checked for relevance on 31-Jan-2011***

***Checked for relevance on 26-Nov-2013***


Symptoms

-- Problem Statement:
Data divergence between two replicated data stores, meant that when the replication agent tried to apply replicated transactions against the subscriber, it encountered foreign key violations.

This caused them to encounter <bug:6415652> where the replication agent can core dump when handling a FK violation.

The agent would core dump, then on restart, it would core dump again.  (as it tried to handle the same transaction). This cycle continued until the subscriber datastore was re-created (duplicated) from the master.

These two issues a) data divergence and b) replication agent core dumping can be seen in the message log as follows:

a) Divergence:

04:42:47.10 Err : REP: 27049: CALLSCRN:receiver.c(9371): TT16084: Table: TT.TAB1. Failed to insert row for 'insert'
04:42:47.10 Err : REP: 27049: CALLSCRN:receiver.c(9371): TT907: TT0907: Unique constraint(T_CONST_1) violated at Rowid <0x00000000024ae478> -- file "ttree.c", lineno 4134, procedure "sbTtInsert"
04:42:47.10 Err : REP: 27049: CALLSCRN:receiver.c(5016): TT16187: Transaction 1215848204/556399; Error: transient 0, permanent 1

b) Replication agent exits:

05:05:36.20 Info: : 383: child 17793 gone, terminated with signal 11, core dumped
05:05:36.63 Info: : 383: New process (#367) has connected
05:05:36.63 Info: : 383: Repagent id 367 started for /opt/jnetx/TT/callscrn
05:05:36.63 Info: : 383: Repagent restarted.

 Stack traces taken from the core dumps written by the replication thread have appeared as follows:

----------------- lwp# 10 / thread# 10 --------------------
ffffffff7ee7ae8c sbValidateFkConstrTup (ffffffff6f778690, ffffffff6f778600,
ffffffff7f0903c0, ffffffff6f778678, 1,
ffffffff6f776a08) + 15c
ffffffff7e963a1c sb_tblValidateVioFkConstrQ (5250, ffffffff7f0903c0, 5248,
1000, 10027e630, 1) + 594
00000001000348b0 rxUpdFlush (8c400, 10027d480, 8c730, 1001577c0, 100329fc0,
540) + ad8
000000010002f3b4 rxRunTx (0, 1001577c0, 10027d480, 1002ddef0, 10027d530, 4)
+ a9c
000000010002e0f4 rxRunBatch (1002ddef0, 0, 8c000, 1001577c0, 0, 0) + 14c
000000010002df40 rxAck (8c000, 100054918, 10036a638, 8c400, 1001dcea8,
1002ddef0) + 298
0000000100029cd8 ServeRqst (1002ddef0, 1001dcea8, 1001577c0, 100369fa8,
1002ddef0, 8c088) + ff8
0000000100027cfc receiver (8c400, 100369f70, 8c000, ffffffffffffffff,
1001577c0, 1002ddef0) + 274
0000000100009e24 chaperone (1001dcea8, 3c00, 100050bb0, 0, 1001577c0,
10015c008) + 1bc ffffffff7e117c9c _lwp_start (0, 0, 0, 0, 0, 0)

Or in some cases:

----------------- lwp# 11 / thread# 11 --------------------
ffffffff7ee779c4 sbSmxColVioConstr (ffffffff67717508, 90, ffffffff67717478,
100299b80, 0, 67) + 224
ffffffff7ee780e4 sbSmxCheckAllConstr (ffffffff67715fa0, ffffffff7f0903c0,
74d, 0, 1, 67) + 5c4
ffffffff7e961708 sb_tblCheckAllConstrQ (5250, ffffffff26d37b80,
ffffffff7c4ff4a8, 0, 67, 0) + dd8^M 0000000100037b90 rxDelRow (8c400,
100694f20, 100694f30, ffffffff7c4ff528, ffffffff7c4ff688, 0) + 178
0000000100032c30 rxUpdTx (1003b1ba0, 0, 100694f20, 100694f30, 1, 0) + 868
000000010002ec34 rxRunTx (0, 1001577c0, 10025afa0, 1003b1ba0, 10025b050, 1)
+ 31c
000000010002e0f4 rxRunBatch (0, 0, 8c000, 1001577c0, 0, 0) + 14c
000000010002df40 rxAck (8c000, 100054918, 10043e2e8, 8c400, 1001dcea8,
1003b1ba0) + 298
0000000100029cd8 ServeRqst (1003b1ba0, 1001dcea8, 1001577c0, 10043dc58,
1003b1ba0, 8c088) + ff8^M 0000000100027cfc receiver (8c400, 10043dc20,
8c000, ffffffffffffffff, 1001577c0, 1003b1ba0) + 274
0000000100009e24 chaperone (1001dcea8, 3c00, 100050bb0, 0, 1001577c0,
10015c008) + 1bc^M ffffffff7e117c9c _lwp_start (0, 0, 0, 0, 0, 0)

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms