Instance terminates with error "ORA-29770: LCK0 HUNG, LMHB TERMINATING THE INSTANCE" (Doc ID 1998445.1)

Last updated on JANUARY 04, 2017

Applies to:

Oracle Database - Enterprise Edition - Version 11.1.0.7 to 11.2.0.3 [Release 11.1 to 11.2]
Information in this document applies to any platform.

Symptoms

 


DB alert logs shows:

Sat Feb04 04:25:04 2015
Errors in file /u01/app/oracle/diag/rdbms/db1/db103/trace/db103_lmhb_28897.trc  (incident=504168):
ORA-29770: global enqueue process LMD0 (OSID 28819) is hung for more than 70 seconds
Errors in file /u01/app/oracle/diag/rdbms/db1/db103/trace/db103_lmhb_28897.trc  (incident=576001):
ORA-29770: global enqueue process LMD0 (OSID 28819) is hung for more than 70 seconds
Sat Feb04 04:25:16 2015
Errors in file /u01/app/oracle/diag/rdbms/db1/db103/trace/db103_lmhb_28897.trc  (incident=576002):
ORA-29770: global enqueue process LMD0 (OSID 28819) is hung for more than 70 seconds
Errors in file /u01/app/oracle/diag/rdbms/db1/db103/trace/db103_lmhb_28897.trc  (incident=576003):
ORA-29770: global enqueue process LMD0 (OSID 28819) is hung for more than 70 seconds
ERROR: Some process(s) is not making progress.
LMHB (ospid: 28897) is terminating the instance.
Please check LMHB trace file for more details.
Please also check the CPU load, I/O load and other system properties for anomalous behavior
ERROR: Some process(s) is not making progress.
LMHB (ospid: 28897): terminating the instance due to error 29770
Sat Feb04 04:25:23 2015
System state dump requested by (instance=3, osid=28897 (LMHB)), summary=[abnormal instance termination].
System State dumped to trace file /u01/app/oracle/diag/rdbms/db1/db103/trace/db103_diag_28773_20150404042523.trc
Sat Feb04 04:25:23 2015
Errors in file /u01/app/oracle/diag/rdbms/db1/db103/trace/db103_ora_5764.trc  (incident=576009):
ORA-29770: global enqueue process  (OSID ) is hung for more than  seconds

 


 
Trace file /u01/app/oracle/diag/rdbms/db1/db103/trace/db103_lmhb_28897.trc
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
ORACLE_HOME = /u01/app/oracle/product/11.2.0.4/rac_db_q1_0
System name: Linux
Node name: node1.na.ct.com
Release: 2.6.18-400.1.1.el5
Version: #1 SMP Sun Dec 14 06:01:17 EST 2014
Machine: x86_64
Instance name: db103
Redo thread mounted by this instance: 0 <none>
Oracle process number: 20
Unix process pid: 28897, image: oracle@node1.na.ct.com (LMHB)

*** 2015-02-04 04:25:23.377
2015-02-04 04:25:23.377: [ CSSCLNT]clssgsProcessGrkhEvent: dropping unexpected event type 21.
kgxgnpstat: received unknown event 21
kjgcr_poll: rcvd unknown event from GCR1 grp - (4)

*** 2015-02-04 04:25:23.377
kjgcr_grouplock: did not get lock yet

*** 2015-02-04 04:25:23.377
kjgcr_Main: Waited too long to acquire group lock (lock_retries=1). Taking action(id=10)

*** 2015-02-04 04:25:23.377
==============================
LMD0 (ospid: 28819) has not moved for 220 sec (1428139523.1428139303)
kjzduptcctx: Notifying DIAG for crash event
----- Abridged Call Stack Trace -----
ksedsts()+465<-kjzdssdmp()+267<-kjzduptcctx()+232<-kjzdicrshnfy()+63<-ksuitm()+5570<-kjgcr_KillInstance()+125<-kjgcr_Main()+3323<-kjfmlmhb_Main()+80<-ksbrdp()+1045<-opirip()+623<-opidrv()+603<-sou2o()+103<-opimai_real()+250<-ssthrdmain

()+265<-main()+201<-__libc_start_main()+244

----- End of Abridged Call Stack Trace -----

*** 2015-02-04 04:25:23.393
LMHB (ospid: 28897): terminating the instance due to error 29770
ksuitm: waiting up to [5] seconds before killing DIAG(28773)

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms