'srvctl start database' Causes All Instances to Shutdown in Case of Corrupted Controlfile Error (Doc ID 2086820.1)

Last updated on JANUARY 27, 2016

Applies to:

Oracle Database - Enterprise Edition - Version 12.1.0.2 and later
Information in this document applies to any platform.

Symptoms

We see srvctl start database makes all instances shutdown in case of Corrupted Controlfile error state.

srvctl status database -d RACDB, shows that the database is down on node1/node2/node3 (even though the database is UP)

crsctl status resource -t gives us this information:


ora.racdb.db
1 OFFLINE OFFLINE Corrupted Controlfile,STABLE
2 OFFLINE OFFLINE Corrupted Controlfile,STABLE
3 OFFLINE OFFLINE Corrupted Controlfile,STABLE

crsctl status resource ora.racdb.db -v gives us this information:


LAST_SERVER=rac2
STATE=OFFLINE
TARGET=OFFLINE
CARDINALITY_ID=2
RESTART_COUNT=0
FAILURE_COUNT=0
FAILURE_HISTORY=
ID=ora.roadbed.db 2 1
INCARNATION=1
LAST_RESTART=07/17/2015 20:58:56
LAST_STATE_CHANGE=07/22/2015 22:07:51
STATE_DETAILS=Corrupted Controlfile
INTERNAL_STATE=STABLE
INSTANCE_COUNT=3


In the alert log we see the following which is corresponding to above output LAST_STATE_CHANGE=07/22/2015 22:07:51

Wed Jul 22 22:07:50 2015
Hex dump of (file 0, block 9) in trace file /u1/acfsmounts/logs/diag/rdbms/roadbed/ROADBED1/trace/ROADBED1_ckpt_5426.trc
Corrupt block relative dba: 0x00000009 (file 0, block 9)
Fractured block found during control file block read
Data in bad block:
type: 21 format: 2 rdba: 0x00000009
last change scn: 0xffff.0517794f seq: 0x1 flg: 0x04
spare1: 0x0 spare2: 0x0 spare3: 0x0
consistency value in tail: 0x79511501
check value in block header: 0x5ba
computed block checksum: 0x1e
Control file block read for fixed table access has failed due to concurrent controlfile updates.
This is not a real data corruption. Please retry the query.
Errors in file /u1/acfsmounts/logs/diag/rdbms/racdb/RACDB1/trace/RACDB1_ckpt_5426.trc:
ORA-00202: control file: '+DISKGROUP1/racdb/controlfile/current.1765.804590923'
Errors in file /u1/acfsmounts/logs/diag/rdbms/racdb/RACDB1/trace/RACDB1_ckpt_5426.trc (incident=300292):
ORA-00227: corrupt block detected in control file: (block 9, # blocks 1)
ORA-00202: control file: '+DISKGROUP1/racdb/controlfile/current.1765.804590923'
Incident details in: /u1/acfsmounts/logs/diag/rdbms/racdb/RACDB1/incident/incdir_300292/RACDB1_ckpt_5426_i300292.trc
Wed Jul 22 22:07:57 2015

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms