ASM DEVICE ERROR - ORA-27041 ORA-15025 ORA-15081 FROM EMAGENT
(Doc ID 1533971.1)
Last updated on OCTOBER 22, 2023
Applies to:
Oracle Database Backup Service - Version N/A and laterOracle Database Exadata Express Cloud Service - Version N/A and later
Oracle Database Cloud Exadata Service - Version N/A and later
Oracle Database - Enterprise Edition - Version 11.2.0.3 and later
Oracle Database Cloud Schema Service - Version N/A and later
Information in this document applies to any platform.
Symptoms
1. All ASM diskgroups are currently mounted on all nodes except one node in RAC env.
2. All ASM diskgroups are firstly mounted on ASM instance startup but some of diskgroups ( not all ) are dismounted instantly with the following errors in ASM alert.logs
Thu Feb 28 15:01:25 2013
SUCCESS: diskgroup DATA01 was mounted
Thu Feb 28 15:01:40 2013
Errors in file /opt/oracle/diag/asm/+asm/+ASM2/trace/+ASM2_ora_10000.trc:
ORA-15025: could not open disk "/dev/asm/data1"
ORA-27041: unable to open file
Solaris-AMD64 Error: 13: Permission denied
..
WARNING: cache failed reading from group=1(DATA) fn=1 blk=5 count=4 from disk= 1(DATA01_0001) kfkist=0x20 status=0x02 file=kfc.c line=11555
Errors in file /opt/oracle/diag/asm/+asm/+ASM2/trace/+ASM2_ora_10000.trc:
ORA-15025: could not open disk "/dev/asm/data1"
ORA-27041: unable to open file
Solaris-AMD64 Error: 13: Permission denied
Additional information: 3
ORA-15080: synchronous I/O operation to a disk failed
ERROR: cache failed to read group=`(DATA) fn=1 blk=5 from disk(s): 1(DATA_0001)
Thu Feb 28 15:01:40 2013
SUCCESS: ALTER DISKGROUP DATA MOUNT /* asm agent *//* {0:7:4} */
Thu Feb 28 15:01:40 2013
NOTE: cache registered group DATA03 number=5 incarn=0xe1c6491a
NOTE: cache began mount (not first) of group DATA03 number=5 incarn=0xe1c6491a
ORA-15080: synchronous I/O operation to a disk failed
NOTE: cache initiating offline of disk 1 group DATA
NOTE: process _user29620_+asm2 (29620) initiating offline of disk 1.4042701571 (DATA01_0001) with mask 0x7e in group 3
WARNING: Disk 1 (DATA01_0001) in group 3 in mode 0x7f is now being taken offline on ASM inst 2
NOTE: initiating PST update: grp = 1, dsk = 43/0xf0f6bb03, mask = 0x6a, op = clear
Thu Feb 28 15:01:42 2013
GMON updating disk modes for group 1 at 79 for pid 125, osid 29620
ERROR: Disk 1 cannot be offlined, since diskgroup has external redundancy.
ERROR: too many offline disks in PST (grp 1)
SUCCESS: diskgroup DATA01 was mounted
Thu Feb 28 15:01:40 2013
Errors in file /opt/oracle/diag/asm/+asm/+ASM2/trace/+ASM2_ora_10000.trc:
ORA-15025: could not open disk "/dev/asm/data1"
ORA-27041: unable to open file
Solaris-AMD64 Error: 13: Permission denied
..
WARNING: cache failed reading from group=1(DATA) fn=1 blk=5 count=4 from disk= 1(DATA01_0001) kfkist=0x20 status=0x02 file=kfc.c line=11555
Errors in file /opt/oracle/diag/asm/+asm/+ASM2/trace/+ASM2_ora_10000.trc:
ORA-15025: could not open disk "/dev/asm/data1"
ORA-27041: unable to open file
Solaris-AMD64 Error: 13: Permission denied
Additional information: 3
ORA-15080: synchronous I/O operation to a disk failed
ERROR: cache failed to read group=`(DATA) fn=1 blk=5 from disk(s): 1(DATA_0001)
Thu Feb 28 15:01:40 2013
SUCCESS: ALTER DISKGROUP DATA MOUNT /* asm agent *//* {0:7:4} */
Thu Feb 28 15:01:40 2013
NOTE: cache registered group DATA03 number=5 incarn=0xe1c6491a
NOTE: cache began mount (not first) of group DATA03 number=5 incarn=0xe1c6491a
ORA-15080: synchronous I/O operation to a disk failed
NOTE: cache initiating offline of disk 1 group DATA
NOTE: process _user29620_+asm2 (29620) initiating offline of disk 1.4042701571 (DATA01_0001) with mask 0x7e in group 3
WARNING: Disk 1 (DATA01_0001) in group 3 in mode 0x7f is now being taken offline on ASM inst 2
NOTE: initiating PST update: grp = 1, dsk = 43/0xf0f6bb03, mask = 0x6a, op = clear
Thu Feb 28 15:01:42 2013
GMON updating disk modes for group 1 at 79 for pid 125, osid 29620
ERROR: Disk 1 cannot be offlined, since diskgroup has external redundancy.
ERROR: too many offline disks in PST (grp 1)
3. ASM trace files show this error comes from emagent spwaned with non grid user.
/opt/oracle/diag/asm/+asm/+ASM2/trace/+ASM2_ora_10000.trc:
*** 2013-02-28 15:01:40.195
*** MODULE NAME:(emagent_SQL_osm_cluster) 2013-02-28 15:01:40.195
*** ACTION NAME:(Volumes_Summary) 2013-02-28 15:01:40.195
kfk_debug_get_user_groups: uid:10005, euid:10002, gid:800, egid:500 <<<<<< effective user id is grid and effective group id is asmadmin and uid - 10005 is non-grid user
WARNING: failed to open a disk[/dev/asm/data1] <<<<<< With this privilege, all ASM devices owned by oracle:dba can not be read by emagent process.
ORA-15025: could not open disk "/dev/asm/data1"
ORA-27041: unable to open file
Solaris-AMD64 Error: 13: Permission denied
Additional information: 3
path:Unknown disk
incarnation:0xf0f6bb03 synchronous result:'I/O error'
subsys:Unknown library iop:0xfffffc7ffda0c000 bufp:0xfffffc7ffdb9ba00 osderr:0x0 osderr1:0x0
WARNING: cache failed reading from group=1(DATA) fn=1 blk=5 count=4 from disk= 1(DATA_0001) kfkist=0x20 status=0x02 file=kfc.c line=11555
WARNING: failed to open a disk[/dev/asm/data1]
ORA-15025: could not open disk "/dev/asm/data1"
ORA-27041: unable to open file
Solaris-AMD64 Error: 13: Permission denied
*** MODULE NAME:(emagent_SQL_osm_cluster) 2013-02-28 15:01:40.195
*** ACTION NAME:(Volumes_Summary) 2013-02-28 15:01:40.195
kfk_debug_get_user_groups: uid:10005, euid:10002, gid:800, egid:500 <<<<<< effective user id is grid and effective group id is asmadmin and uid - 10005 is non-grid user
WARNING: failed to open a disk[/dev/asm/data1] <<<<<< With this privilege, all ASM devices owned by oracle:dba can not be read by emagent process.
ORA-15025: could not open disk "/dev/asm/data1"
ORA-27041: unable to open file
Solaris-AMD64 Error: 13: Permission denied
Additional information: 3
path:Unknown disk
incarnation:0xf0f6bb03 synchronous result:'I/O error'
subsys:Unknown library iop:0xfffffc7ffda0c000 bufp:0xfffffc7ffdb9ba00 osderr:0x0 osderr1:0x0
WARNING: cache failed reading from group=1(DATA) fn=1 blk=5 count=4 from disk= 1(DATA_0001) kfkist=0x20 status=0x02 file=kfc.c line=11555
WARNING: failed to open a disk[/dev/asm/data1]
ORA-15025: could not open disk "/dev/asm/data1"
ORA-27041: unable to open file
Solaris-AMD64 Error: 13: Permission denied
Changes
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Changes |
| Cause |
| Solution |
| References |