ASM Provisioning String Has Junk Characters "kfdhdb.driver.provstr:ORCLDISKÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿ " (Doc ID 2088023.1)

Last updated on DECEMBER 19, 2015

Applies to:

Oracle Database - Enterprise Edition - Version 11.2.0.3 and later
Information in this document applies to any platform.

Symptoms

Due to storage issue,lost some disks from ASM failuregroup FG1.

Lun works properly after checked with SA team and all _DROPPED disks was added to diskgroups by command with force:

alter diskgroup DISKGROUPNAME add failgroup fg1 disk '/path/to/disk' force;

The rebalance is completed after issued  "alter diskgroup DIKSGROUPNAME check all" 

But kfed command return junk character for kfdhdb.driver.provstr

 

ASM Alert log

==========

 

ORA-15032: not all alterations performed
ORA-15017: diskgroup "DWH2PLOG" cannot be mounted
ORA-15063: ASM discovered an insufficient number of disks for diskgroup "DWH2PLOG"
ORA-15017: diskgroup "DWH2PDAT" cannot be mounted
ORA-15063: ASM discovered an insufficient number of disks for diskgroup "DWH2PDAT"
ORA-15017: diskgroup "CCV2PLOG" cannot be mounted
ORA-15063: ASM discovered an insufficient number of disks for diskgroup "CCV2PLOG"
ORA-15017: diskgroup "CCV2PDAT" cannot be mounted
ORA-15063: ASM disco

 

..

NOTE: [crsd.bin@wawplogvp2b1.pl.db.com (TNS V1-V3) 27117] opening OCR file
WARNING: failed to online diskgroup resource ora.IRBA2PLOG.dg (unable to communicate with CRSD/OHASD)
WARNING: failed to online diskgroup resource ora.IRBAODPDAT.dg (unable to communicate with CRSD/OHASD)
WARNING: failed to online diskgroup resource ora.IRBAODPLOG.dg (unable to communicate with CRSD/OHASD)
WARNING: failed to online diskgroup resource ora.WAWPLOGVP2CRS.dg (unable to communicate with CRSD/OHASD)

..

Tue Oct 13 23:32:36 2015
NOTE: process _user6034_+asm2 (6034) initiating offline of disk 0.2526599929 (IRBA2PLOG_0000) with mask 0x7e in group 8
NOTE: checking PST: grp = 8
Tue Oct 13 23:32:37 2015
Errors in file /applications/oracle/base/diag/asm/+asm/+ASM2/trace/+ASM2_ora_27188.trc:
ORA-27061: waiting for async I/Os failed
Linux-x86_64 Error: 5: Input/output error
Additional information: -1
Additional information: 4096
WARNING: Write Failed. group:11 disk:0 AU:134 offset:102400 size:4096
Errors in file /applications/oracle/base/diag/asm/+asm/+ASM2/trace/+ASM2_ora_27188.trc:
ORA-15080: synchronous I/O operation to a disk failed
WARNING: failed to write mirror side 1 of virtual extent 0 logical extent 0 of file 255 in group 11 on disk 0 allocation unit 134

..

NOTE: SMON starting instance recovery for group IRBA2PDAT domain 7 (mounted)WARNING: Disk 0 (IRBA2PLOG_0000) in group 8 in mode 0x7f is now being taken offline on ASM inst 2
GMON checking disk modes for group 9 at 30 for pid 29, osid 9193
NOTE: initiating PST update: grp = 8, dsk = 0/0x9698daf9, mask = 0x6a, op = clear
WARNING: Disk 0 (IRBAODPLOG_0000) in group 10 mode 0x7f is now being offlined
GMON checking disk modes for group 7 at 31 for pid 28, osid 9058
WARNING: Disk 0 (IRBAODPLOG_0000) in group 10 in mode 0x7f is now being taken offline on ASM inst 2
NOTE: initiating PST update: grp = 10, dsk = 0/0x9698db0a, mask = 0x6a, op = clear
GMON checking disk modes for group 11 at 32 for pid 33, osid 9587
NOTE: checking PST for grp 7 done

..

ARNING: Disk 13 (IRBA2PDAT_0013) in group 7 in mode 0x7f is now being taken offline on ASM inst 2
NOTE: cache initiating offline of disk 0 group IRBA2PDAT
NOTE: initiating PST update: grp = 7, dsk = 13/0x9698daf5, mask = 0x6a, op = clear
NOTE: cache initiating offline of disk 1 group IRBA2PDAT
NOTE: cache initiating offline of disk 2 group IRBA2PDAT
NOTE: cache initiating offline of disk 6 group IRBA2PDAT
NOTE: cache initiating offline of disk 8 group IRBA2PDAT
NOTE: cache initiating offline of disk 10 group IRBA2PDAT
NOTE: cache initiating offline of disk 12 group IRBA2PDAT
NOTE: cache initiating offline of disk 13 group IRBA2PDAT
NOTE: cache initiating offline of disk 14 group IRBA2PDAT

..

NOTE: process _smon_+asm2 (26983) initiating offline of disk 0.2526599910 (IRBA2PDAT_0000) with mask 0x7e in group 7
NOTE: process _smon_+asm2 (26983) initiating offline of disk 1.2526599912 (IRBA2PDAT_0001) with mask 0x7e in group 7
NOTE: process _smon_+asm2 (26983) initiating offline of disk 2.2526599914 (IRBA2PDAT_0002) with mask 0x7e in group 7
NOTE: process _smon_+asm2 (26983) initiating offline of disk 6.2526599916 (IRBA2PDAT_0006) with mask 0x7e in group 7
NOTE: process _smon_+asm2 (26983) initiating offline of disk 8.2526599917 (IRBA2PDAT_0008) with mask 0x7e in group 7
Tue Oct 13 23:32:39 2015
NOTE: process _b000_+asm2 (9590) initiating offline of disk 0.2526599946 (IRBAODPLOG_0000) with mask 0x7e in group 10
NOTE: process _smon_+asm2 (26983) initiating offline of disk 10.2526599921 (IRBA2PDAT_0010) with mask 0x7e in group 7
NOTE: process _smon_+asm2 (26983) initiating offline of disk 12.2526599927 (IRBA2PDAT_0012) with mask 0x7e in group 7
NOTE: checking PST: grp = 10
NOTE: process _smon_+asm2 (26983) initiating offline of disk 14.2526599924 (IRBA2PDAT_0014) with mask 0x7e in group 7
NOTE: checking PST: grp = 7

..

Tue Oct 13 23:36:25 2015
WARNING: Disk 0 (IRBA2PDAT_0000) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 1 (IRBA2PDAT_0001) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 2 (IRBA2PDAT_0002) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 6 (IRBA2PDAT_0006) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 8 (IRBA2PDAT_0008) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 10 (IRBA2PDAT_0010) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 12 (IRBA2PDAT_0012) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 13 (IRBA2PDAT_0013) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 14 (IRBA2PDAT_0014) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 0 (IRBA2PLOG_0000) in group 8 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 0 (IRBAODPDAT_0000) in group 9 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 1 (IRBAODPDAT_0001) in group 9 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 2 (IRBAODPDAT_0002) in group 9 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 3 (IRBAODPDAT_0003) in group 9 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 4 (IRBAODPDAT_0004) in group 9 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 5 (IRBAODPDAT_0005) in group 9 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 6 (IRBAODPDAT_0006) in group 9 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 0 (IRBAODPLOG_0000) in group 10 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 1 (IRBAODPLOG_0001) in group 10 will be dropped in: (12775) secs on ASM inst 2

************Disksgroups Are Mounted After Added Lost Disks ****************

Wed Oct 14 01:37:00 2015
SQL> alter diskgroup DMCPDAT mount
NOTE: cache registered group DMCPDAT number=1 incarn=0xe7e82a7a
NOTE: cache began mount (not first) of group DMCPDAT number=1 incarn=0xe7e82a7a
NOTE: Assigning number (1,3) to disk (/dev/WAWINORADB2A-B_DB_DMC_DATA_PROD-H_1_B_HA)
NOTE: Assigning number (1,0) to disk (/dev/WAWINORADB2A-B_DB_DMC_DATA_PROD-H_1_A_HA)
NOTE: Assigning number (1,1) to disk (/dev/WAWINORADB2A-B_DB_DMC_DATA_PROD-H_2_A_HA)
NOTE: Assigning number (1,2) to disk (/dev/WAWINORADB2A-B_DB_DMC_DATA_PROD-H_3_A_HA)
NOTE: Assigning number (1,4) to disk (/dev/WAWINORADB2A-B_DB_DMC_DATA_PROD-H_2_B_HA)
NOTE: Assigning number (1,5) to disk (/dev/WAWINORADB2A-B_DB_DMC_DATA_PROD-H_3_B_HA)

Wed Oct 14 01:37:04 2015
NOTE: diskgroup resource ora.DMCPDAT.dg is online
SUCCESS: alter diskgroup DMCPDAT mount

SQL> alter diskgroup DMCPLOG mount
NOTE: cache registered group DMCPLOG number=2 incarn=0x91182a7c
NOTE: cache began mount (not first) of group DMCPLOG number=2 incarn=0x91182a7c
NOTE: Assigning number (2,2) to disk (/dev/WAWINORADB2A-B_DB_DMC_LOGS_PROD-H_1_B_HA)
NOTE: Assigning number (2,0) to disk (/dev/WAWINORADB2A-B_DB_DMC_LOGS_PROD-H_1_A_HA)
NOTE: Assigning number (2,1) to disk (/dev/WAWINORADB2A-B_DB_DMC_LOGS_PROD-H_2_A_HA)
NOTE: Assigning number (2,3) to disk (/dev/WAWINORADB2A-B_DB_DMC_LOGS_PROD-H_2_B_HA)

Wed Oct 14 01:37:16 2015
NOTE: Instance updated compatible.asm to 11.2.0.0.0 for grp 2
SUCCESS: diskgroup DMCPLOG was mounted
Wed Oct 14 01:37:16 2015
NOTE: diskgroup resource ora.DMCPLOG.dg is online
SUCCESS: alter diskgroup DMCPLOG mount
NOTE: diskgroup resource ora.DMCPLOG.dg is updated

 

Kfed output

=========

### /dev/WAWINORADB2A-B_DB_SMOK2IRBA-CCIO_DATA_PROD-H_1_A_HA
kfbh.endian: 1 ; 0x000: 0x01
kfbh.hard: 130 ; 0x001: 0x82
kfbh.type: 1 ; 0x002: KFBTYP_DISKHEAD
kfbh.datfmt: 1 ; 0x003: 0x01
kfbh.block.blk: 0 ; 0x004: blk=0
kfbh.block.obj: 2147483662 ; 0x008: disk=14
kfbh.check: 3824931021 ; 0x00c: 0xe3fbd0cd
kfbh.fcn.base: 734129 ; 0x010: 0x000b33b1
kfbh.fcn.wrap: 0 ; 0x014: 0x00000000
kfbh.spare1: 0 ; 0x018: 0x00000000
kfbh.spare2: 0 ; 0x01c: 0x00000000
kfdhdb.driver.provstr:ORCLDISKEricEricEricEricEricEric ; 0x000: length=32             

..

### /dev/WAWINORADB2A-B_DB_SMOK2IRBA_DATA_PROD-H_1_A_HA
kfbh.endian: 1 ; 0x000: 0x01
kfbh.hard: 130 ; 0x001: 0x82
kfbh.type: 1 ; 0x002: KFBTYP_DISKHEAD
kfbh.datfmt: 1 ; 0x003: 0x01
kfbh.block.blk: 0 ; 0x004: blk=0
kfbh.block.obj: 2147483666 ; 0x008: disk=18
kfbh.check: 1722149640 ; 0x00c: 0x66a5eb08
kfbh.fcn.base: 28484983 ; 0x010: 0x01b2a577
kfbh.fcn.wrap: 0 ; 0x014: 0x00000000
kfbh.spare1: 0 ; 0x018: 0x00000000
kfbh.spare2: 0 ; 0x01c: 0x00000000
kfdhdb.driver.provstr:ORCLDISKÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿ ; 0x000: length=32

..

### /dev/WAWINORADB2A-B_DB_SMOK2IRBA-ODB_DATA_PROD-H_1_A_HA
kfbh.endian: 1 ; 0x000: 0x01
kfbh.hard: 130 ; 0x001: 0x82
kfbh.type: 1 ; 0x002: KFBTYP_DISKHEAD
kfbh.datfmt: 1 ; 0x003: 0x01
kfbh.block.blk: 0 ; 0x004: blk=0
kfbh.block.obj: 2147483664 ; 0x008: disk=16
kfbh.check: 962290252 ; 0x00c: 0x395b624c
kfbh.fcn.base: 0 ; 0x010: 0x00000000
kfbh.fcn.wrap: 0 ; 0x014: 0x00000000
kfbh.spare1: 0 ; 0x018: 0x00000000
kfbh.spare2: 0 ; 0x01c: 0x00000000
kfdhdb.driver.provstr:ORCLDISKEricEricEricEricEricEric ; 0x000: length=32

 ...

### /dev/WAWINORADB2A-B_DB_SMOK2IRBA-ODB_DATA_PROD-H_2_A_HA
kfbh.endian: 1 ; 0x000: 0x01
kfbh.hard: 130 ; 0x001: 0x82
kfbh.type: 1 ; 0x002: KFBTYP_DISKHEAD
kfbh.datfmt: 1 ; 0x003: 0x01
kfbh.block.blk: 0 ; 0x004: blk=0
kfbh.block.obj: 2147483665 ; 0x008: disk=17
kfbh.check: 960985678 ; 0x00c: 0x39477a4e
kfbh.fcn.base: 0 ; 0x010: 0x00000000
kfbh.fcn.wrap: 0 ; 0x014: 0x00000000
kfbh.spare1: 0 ; 0x018: 0x00000000
kfbh.spare2: 0 ; 0x01c: 0x00000000
kfdhdb.driver.provstr:ORCLDISKTTNOPNQOLOOPQPPRPPPNKMML ; 0x000: length=32

kfed repair command will not fix this issue .

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms