High rdbms ipc reply and DFS lock handle in 11gR2 RAC With XA Enabled Application (Doc ID 1361615.1)

Last updated on APRIL 11, 2017

Applies to:

Oracle Database - Enterprise Edition - Version 11.2.0.2 and later
Information in this document applies to any platform.

Symptoms

High rdbms ipc reply and DFS lock handle waits in the database after upgrading to 11gR2 when using XA enabled applications.

AWR Top Foreground Events

Event              Waits                Time(s)     Avg wait (ms)      %DB time        Wait Class
DB CPU             15,798                                               47.30
rdbms ipc reply    11,947,264           11,996       1                  35.91          Other
DFS lock handle    2,010,150            4,098        2                  12.27          Other

 
Systemstate and hang analyze shows that the user sessions are waiting for GTX processes to complete the global transactions.

Foreground session
---------------------
OSD pid info: Unix process pid: 27935, image: oracle@rac1
Short stack dump:
ksedsts()+404<-ksdxfstk()+44<-ksdxcb()+3756<-sspuser()+136<-__sighndlr()+12<-call_user_handler()+992<-_read()+12<-read()+96<-nttrd()+168
<-nsprecv()+444<-nsrdr()+156<-nsfull_pkt_rcv()+8716<-nsfull_brc()+108<-nioqrc()+404<-opikndf2()+696<-opitsk()+756<-opiino()+1000
<-opiodr()+1184<-opidrv()+1100<-sou2o()+92<-opimai_real()+304<-ssthrdmain()+320<-main()+308<-_start()+380

Current Wait Stack:
0: waiting for 'rdbms ipc reply'
from_process=0x66, timeout=0x384, =0x0
wait_id=230559 seq_num=33956 snap_id=1
wait times: snap=0.004182 sec, exc=0.004182 sec, total=0.004182 sec
wait times: max=2.000000 sec, heur=0.004466 sec
wait counts: calls=1 os=1
in_wait=1 iflags=0x5a8


PROCESS 102:  ==> pid is 0x66
---------------------
OSD pid info: Unix process pid: 18679, image: oracle@rac1 (GTX9)
Short stack dump:
ksedsts()+404<-ksdxfstk()+44<-ksdxcb()+3756<-sspuser()+136<-__sighndlr()+12<-call_user_handler()+992<-_syscall6()+32<-sskgpwwait()+240
<-ksliwat()+1924<-kslwait()+232<-ksarcv()+204<-ksbabs()+800<-ksbrdp()+1236<-opirip()+1008<-opidrv()+780<-sou2o()+92<-opimai_real()+516
<-ssthrdmain()+320<-main()+308<-_start()+380
Current Wait Stack:
0: waiting for 'DFS lock handle'
type|mode=0x42420005,
id1=0x962e0d2d, id2=0x9980d1da
wait_id=7082959 seq_num=5296 snap_id=1
wait times: snap=0.000724 sec, exc=0.000724 sec, total=0.000724 sec


type|mode=0x42420005 can be derived to BB enqueue in exclusive mode. The GTX processes are waiting to complete a lock covert operation on BB enqueue and that appears to be blocking user sessions which want to complete the distributed transactions.

Changes

Database upgraded to 11gR2

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms