rootupgrade.sh: PROC-26: [Insufficient quorum to open OCR devices] [0] (Doc ID 2227363.1)

Last updated on FEBRUARY 02, 2017

Applies to:

Oracle Database - Enterprise Edition - Version 12.1.0.2 to 12.1.0.2 [Release 12.1]
Information in this document applies to any platform.

Symptoms

Upgrading Grid Infrastructure from 11.2 to 12.1.0.2, rootupgrade.sh fails on node1: 

CRS-4123: Oracle High Availability Services has been started.
2016/12/11 12:05:12 CLSRSC-472: Attempting to export the OCR

2016/12/11 12:05:12 CLSRSC-482: Running command: 'ocrconfig -upgrade oracle oradba'

PROT-1: Failed to initialize ocrconfig
PROC-26: Error while accessing the physical storage Storage layer error [Insufficient quorum to open OCR devices] [0]
2016/12/11 12:05:13 CLSRSC-157: Failed to create Oracle Cluster Registry configuration

2016/12/11 12:05:13 CLSRSC-248: Failed to upgrade Oracle Clusterware Repository

Died at /orab/app/oracle/1210/gridinf/crs/install/crsupgrade.pm line 906.

 

ASM alert.log on node1 

GMON dismounting group 37 at 174 for pid 23, osid 9985
NOTE: Disk DG_NADCLPDBSCCMC2A_VOTE__0000 in mode 0x7f marked for de-assignment
NOTE: Disk DG_NADCLPDBSCCMC2A_VOTE__0001 in mode 0x7f marked for de-assignment
NOTE: Disk DG_NADCLPDBSCCMC2A_VOTE__0002 in mode 0x7f marked for de-assignment
NOTE: Disk DG_NADCLPDBSCCMC2A_VOTE__0003 in mode 0x7f marked for de-assignment
NOTE: Disk DG_NADCLPDBSCCMC2A_VOTE__0004 in mode 0x7f marked for de-assignment
SUCCESS: diskgroup DG_NADCLPDBSCCMC2A_VOTE_01 was dismounted
NOTE: cache deleting context for group DG_NADCLPDBSCCMC2A_VOTE_01 37/0xfab98400
SUCCESS: ALTER DISKGROUP ALL DISMOUNT /* asm agent *//* {0:0:15891} */
Sun Dec 11 12:02:17 2016

====>> the diskgroup was dismounted normally as part of stack stop from 11.2 home, diskgroup number 37

NOTE: cache registered group DG_NADCLPDBSCCMC2A_VOTE_01 38/0x6090142B
NOTE: cache began mount (first) of group DG_NADCLPDBSCCMC2A_VOTE_01 38/0x6090142B
Sun Dec 11 12:04:53 2016
.... 
NOTE: Assigning number (38,0) to disk (/dev/emcpowere1)
NOTE: Assigning number (38,1) to disk (/dev/emcpowera1)
....====>> the diskgroup is being mounted as part of stack start from 12.1 home, diskgroup number 38 instead of 37
Sun Dec 11 12:05:11 2016
NOTE: cache mounting group 36/0xFAA0142A (DG_CCONASP2_UNDO_TEMP_01) succeeded
NOTE: cache ending mount (success) of group DG_CCONASP2_UNDO_TEMP_01 number=36 incarn=0xfaa0142a
Sun Dec 11 12:05:11 2016
ERROR: GMON found another heartbeat for grp 38 (DG_NADCLPDBSCCMC2A_VOTE_01)
Sun Dec 11 12:05:11 2016
ERROR: GMON could not check any PST heartbeat (grp 38)
Sun Dec 11 12:05:11 2016
NOTE: cache dismounting (clean) group 38/0x6090142B (DG_NADCLPDBSCCMC2A_VOTE_01)
NOTE: messaging CKPT to quiesce pins Unix process pid: 38023, image: oracle@nadclpdbsccmc2a.unix.medcity.net (TNS V1)
....
NOTE: Disk DG_NADCLPDBSCCMC2A_VOTE__0004 in mode 0x7f marked for de-assignment
ERROR: diskgroup DG_NADCLPDBSCCMC2A_VOTE_01 was not mounted


Manual mount fails:

SQL> ALTER DISK GROUP DG_NADCLPDBSCCMC2A_VOTE_01 MOUNT;

ORA-15032: not all alterations performed
ORA-15017: diskgroup "DG_NADCLPDBSCCMC2A_VOTE_01" cannot be mounted
ORA-15003: diskgroup "DG_NADCLPDBSCCMC2A_VOTE_01" already mounted in another lock name space

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms