Shutdown Database Using Shutdown Immediate Hang Indefinitely (Doc ID 1666022.1)

Last updated on JULY 21, 2017

Applies to:

Oracle Database - Enterprise Edition - Version 11.2.0.2 to 11.2.0.2 [Release 11.2]
Information in this document applies to any platform.
***Checked for relevance on 21-Jul-2017***

Symptoms

Shutdown immediate hangs.

 

From the alert log file:

Fri Jan 03 18:00:26 2014
SMCO started with pid=32, OS id=22348
Mon Jan 06 08:35:32 2014
Shutting down instance (immediate)
Stopping background process SMCO
@ Shutting down instance: further logons disabled
License high water mark = 37
Mon Jan 06 08:40:32 2014
Active call for process 7807 user 'oracle' program 'oracle@eomsda10 (TNS V1-V3)'
SHUTDOWN: waiting for active calls to complete.
System State dumped to trace file
/oracle/db/omsdev10db/11.2.0.3/diag/rdbms/omsdev10/OMSDEV10/trace/OMSDEV10_ora_29367.trc

 

From the SystemState dump:

Here, the connection for process 7807 user caused the issue.

PROCESS 31: 
---------------------------------------- 
SO: 0x654506008, type: 2, owner: 0x0, flag: INIT/-/-/0x00 if: 0x3 c: 0x3 
proc=0x654506008, name=process, file=ksu.h LINE:12616 ID:, pg=0 
(process) Oracle pid:31, ser:3, calls cur/top: 0x6508d3490/0x6508d3490 
flags : (0x0) - 
..
..

(latch info) wait_event=0 bits=0 
Location from where call was made: ksu.h LINE:14136 ID:ksugetosstat: 
waiting for 38000ba80 ksuosstats global area level=8 <=============== waiting for latch 
Location from where latch is held: ksu.h LINE:14136 ID:ksugetosstat: 
..
possible holder pid = 28 ospid=7764 
on wait list for 38000ba80 
Process Group: DEFAULT, pseudo proc: 0x6565c1398 
O/S info: user: oracle, term: UNKNOWN, ospid: 7807 (DEAD) 
OSD pid info: Unix process pid: 7807, image: oracle@eomsda10 (TNS V1-V3) 
----------------------------------------

Process with OSPID 7807 is found to be dead. Its waiting for a latch which was held by process with ospid=7764

 

PROCESS 28: MMNL 
---------------------------------------- 
SO: 0x658587548, type: 2, owner: 0x0, flag: INIT/-/-/0x00 if: 0x3 c: 0x3 
proc=0x658587548, name=process, file=ksu.h LINE:12616 ID:, pg=0 
(process) Oracle pid:28, ser:1, calls cur/top: 0x6508d9fc8/0x6508d82c0 
flags : (0x3) DEAD 
flags2: (0x0), flags3: (0x10) 

(latch info) wait_event=0 bits=100 
holding (efd=4) 38000ba80 ksuosstats global area level=8 
<============ holding latch 
Location from where latch is held: ksu.h LINE:14136 ID:ksugetosstat: 
Context saved from call: 0 
state=busy [holder orapid=28] wlstate=free [value=0] 
waiters [orapid (seconds since: put on list, posted, alive check)]: 
7 (230923, 1389026433, 230923) 
31 (230884, 1389026433, 230884) 
38 (230282, 1389026433, 230282) 
waiter count=3 
Process Group: DEFAULT, pseudo proc: 0x6565c1398 
O/S info: user: oracle, term: UNKNOWN, ospid: 7764 (DEAD) 
OSD pid info: Unix process pid: 7764, image: oracle@eomsda10 (MMNL) 
----------------------------------------

And process MMNL (with ospid=7764 ) is holding the latch

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms