My Oracle Support Banner

ORA-15066 Error During Rebalance After Adding Multiple Disks to a Diskgroup (Doc ID 2606100.1)

Last updated on NOVEMBER 18, 2019

Applies to:

Oracle Database - Enterprise Edition - Version 12.2.0.1 and later
Information in this document applies to any platform.

Symptoms

Below error result after adding multiple disks to a diskgroup at a time and diskgroup force dismounts further. Symptom generally seen when number of disks in a diskgroup is below 4096 and perform addition of multiple disks simultaneously.

ASM alert log from <ORACLE_BASE>/diag/asm/+asm/+ASM4/trace location have following messages:

2019-10-18T15:37:13.042001+05:30 start recovery: pdb 1, passed in flags x4 (domain enable 0)
NOTE: crash recovery of group <DGNAME1> will recover thread=1 ckpt=2295.7432 domain=1 inc#=2 instnum=4
2019-10-18T15:37:13.075940+05:30 Errors in file <ORACLE_BASE>/diag/asm/+asm/+ASM4/trace/+ASM4_rbal_19621.trc (incident=172962):
ORA-00600: internal error code, arguments: [kfgbPublishRecoveryTs::invalidpgactx], [0x9FFFFFFFFD2006C0], [1], [], [], [], [], [], [], [], [], []
Incident details in: <ORACLE_BASE>/diag/asm/+asm/+ASM4/incident/incdir_172962/+ASM4_rbal_19621_i172962.trc
.
2019-10-18T15:37:15.830446+05:30
Dumping diagnostic data in directory=[cdmp_20191018153715], requested by (instance=4, osid=28344 (RBAL)), summary=[incident=172962].
2019-10-18T15:37:17.559114+05:30
USER (ospid: 19621): terminating the instance due to error 488

Subsequent attempt to mount the disk group result following error

2019-10-20T07:55:36.941585+05:30
SQL> alter diskgroup <DGNAME1> mount
2019-10-20T07:55:36.977923+05:30
NOTE: cache registered group <DGNAME1> 1/0xCA368797
NOTE: cache began mount (first) of group <DGNAME1> 1/0xCA368797
2019-10-20T07:58:18.735200+05:30
NOTE: Assigning number (1,0) to disk
(/dev/<PATH>/<DISK>_0001)
NOTE: Assigning number (1,1) to disk
(/dev/<PATH>/<DISK>_0002)
...
NOTE: Assigning number (1,4019) to disk
(/dev/<PATH>/<DISK>_4020)
NOTE: Assigning number (1,4020) to disk
(/dev/<PATH>/<DISK>_4021)
NOTE: Assigning number (1,4097) to disk
(/dev/<PATH>/<DISK>_4098)
...
NOTE: cache opening disk 4096 of grp 1: <DGNAME1>_4096
path:/dev/<PATH>/<DISK>_4097
NOTE: cache opening disk 4097 of grp 1: <DGNAME1>_4097
path:/dev/<PATH>/<DISK>_4098
NOTE: cache opening disk 4098 of grp 1: <DGNAME1>_4098
path:/dev/<PATH>/<DISK>_4099
NOTE: cache opening disk 4099 of grp 1: <DGNAME1>_4099
path:/dev/<PATH>/<DISK>_4100
NOTE: cache opening disk 4100 of grp 1: <DGNAME1>_4100
path:/dev/<PATH>/<DISK>_4101
2019-10-20T07:58:27.584361+05:30
NOTE: cache mounting (first) external redundancy group 1/0xCA368797
(<DGNAME1>)
...
NOTE: initiating PST update: grp 1 (<DGNAME1>), dsk = 4097/0xf01698af,
mask = 0x6a, op = clear mandatory
2019-10-20T07:58:30.661137+05:30
GMON updating disk modes for group 1 at 63 for pid 34, osid 46856
ERROR: disk 4097(<DGNAME1>_4097) in group 1(<DGNAME1>) cannot be offlined because the disk group has external redundancy.
2019-10-20T07:58:30.702965+05:30
ERROR: too many offline disks in PST (grp 1)
...
NOTE: Disk <DGNAME1>_4096 in mode 0x7f marked for de-assignment
NOTE: Disk <DGNAME1>_4097 in mode 0x7f marked for de-assignment
NOTE: Disk <DGNAME1>_4098 in mode 0x7f marked for de-assignment
NOTE: Disk <DGNAME1>_4099 in mode 0x7f marked for de-assignment
NOTE: Disk <DGNAME1>_4100 in mode 0x7f marked for de-assignment
ERROR: diskgroup <DGNAME1> was not mounted
NOTE: cache deleting context for group <DGNAME1> 1/0xca368797
2019-10-20T07:58:32.055832+05:30
ORA-15032: not all alterations performed
ORA-15001: diskgroup "<DGNAME1>" does not exist or is not mounted
ORA-15001: diskgroup "1" does not exist or is not mounted

2019-10-20T07:58:32.056388+05:30
ERROR: alter diskgroup <DGNAME1> dismount force /* ASM SERVER:3392571287
*/
2019-10-20T07:58:32.057728+05:30
Errors in file
<ORACLE_BASE>/diag/asm/+asm/+ASM4/trace/+ASM4_b000_52868.trc:
ORA-00604: error occurred at recursive SQL level 1
ORA-15032: not all alterations performed
ORA-15001: diskgroup "<DGNAME1>" does not exist or is not mounted
ORA-15001: diskgroup "1" does not exist or is not mounted
2019-10-20T07:58:32.068839+05:30
ORA-15032: not all alterations performed
ORA-15066: offlining disk "<DGNAME1>_4097" in group "<DGNAME1>" may result in a data loss

2019-10-20T07:58:32.069230+05:30
ERROR: alter diskgroup <DGNAME1> mount
2019-10-20T08:00:24.273490+05:30
ASM Health Checker found 1 new failures
2019-10-20T08:54:28.417264+05:30

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.