CRS cannot startup after node reboot, with errors opening raw OCR/VD on EMC, eg. "utopen:7:Failed To Open Ocr File/Disk" (Doc ID 1310396.1)

Last updated on OCTOBER 12, 2016

Applies to:

Oracle Database - Enterprise Edition - Version 10.2.0.1 to 11.2.0.2 [Release 10.2 to 11.2]
HP-UX Itanium

Symptoms

CRS will not start up after server reboot.
OCR and Voting disk are on raw devices and storage is on EMC.

Symptom details:
1. ocssd.log may show errors opening voting disk
And/Or errors opening OCR may be found in cssNN.log in $CRS_HOME/log/client:

Oracle Database 10g CRS Release 10.2.0.4.0 Production Copyright 1996, 2008 Oracle. All rights reserved.
2011-02-22 13:41:00.891: [ OCROSD][1]utopen:7:failed to open OCR file/disk /u01/oradata/ocr1 /u01/oradata/ocr2, errno=13, os err
string=Permission denied
2011-02-22 13:41:00.916: [ OCRRAW][1]proprinit: Could not open raw device
2011-02-22 13:41:00.918: [ default][1]a_init:7!: Backend init unsuccessful : [26]
2011-02-22 13:41:00.918: [ CSSCLNT][1]clsssinit: Unable to access OCR device in OCR init.



2. The oracle software owner cannot read from the EMC Luns for OCR/Vote disks :
$ dd if=/dev/rdsk/c25t0d4s1 of=/dev/null bs=1024 count=2000
=> THIS FAILS
But, the permissions are correct on the /dev/rdsk devices.

3. Root user CAN read from the EMC luns for OCR/Vote disks
# dd if=/dev/rdsk/c25t0d4s1 of=/dev/null bs=1024 count=2000
=> THIS SUCCEEDS

4. After root user has read from the disk with the above command, THEN the oracle software owner can read from it
# dd if=/dev/rdsk/c25t0d4s1 of=/dev/null bs=1024 count=2000
# exit
$ dd if=/dev/rdsk/c25t0d4s1 of=/dev/null bs=1024 count=2000
=> THIS SUCCEEDS!

Changes

The server was rebooted. Storage is on EMC.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms