ASM crash at startup of cluster due to ACFS deadlock (Doc ID 1488121.1)

Last updated on SEPTEMBER 05, 2012

Applies to:

Oracle Server - Enterprise Edition - Version 11.2.0.3 and later
Information in this document applies to any platform.

Symptoms

While starting up cluster on multiple nodes,one of the cluster startup failed as ASM was crashed by PMON due ACFS rebuild failure.

Global Resource Directory frozen
Communication channels reestablished
Thu Aug 30 23:24:53 2012
* domain 0 valid = 1 according to instance 6
* domain 1 valid = 1 according to instance 6
Master broadcasted resource hash value bitmaps
Non-local Process blocks cleaned out
Thu Aug 30 23:24:53 2012
LMS 0: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
Set master node info
Submitted all remote-enqueue requests
Dwn-cvts replayed, VALBLKs dubious
All grantable enqueues granted
Submitted all GCS remote-cache requests
Fix write in gcs resources
Reconfiguration complete
Thu Aug 30 23:25:29 2012
ACFS ERROR: Cluster membership rebuild did not complete. Terminating ASM instance to avoid deadlock <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
Thu Aug 30 23:25:29 2012
PMON (ospid: 11914): terminating the instance due to error 15478
Thu Aug 30 23:25:29 2012
System state dump requested by (instance=9, osid=11914 (PMON)), summary=[abnormal instance termination].
System State dumped to trace file /apps/opt/grid/diag/asm/+asm/+ASM9/trace/+ASM9_diag_11927.trc
Dumping diagnostic data in directory=[cdmp_20120830232529], requested by (instance=9, osid=11914 (PMON)), summary=[abnormal instance termination].
Instance terminated by PMON, pid = 11914

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms