ORA-00600: [kfdvf_css]:: Cluster crash while votedisk replace hit asm rebalance on same diskgroup (Doc ID 1573088.1)

Last updated on OCTOBER 31, 2016

Applies to:

Oracle Database - Enterprise Edition - Version 11.2.0.2 to 11.2.0.3 [Release 11.2]
Information in this document applies to any platform.

Symptoms

While running voting disk replace was running ,Rebalance on same original diskgroup was triggered in-parallel.

Then,ASM started hanging and crashed with ORA-00600 with argument kfdvf_css.

Then while starting cluster ,cluster was trying removing voting disk due to replace operation and not getting the majority .

Cssd started crashing and resulted failure of cluster startup.

 

2013-07-23 10:29:05.409: [    CSSD][1081624896]clssnmFindVF: found VF by skid in the discovered queue
2013-07-23 10:29:05.409: [    CSSD][1081624896]clssnmFindVF: Duplicate voting file found in the queue of previously discovered disks queued(ORCL:OCRS_PPCRS103_001|[82738662-60d64fb8-bf1f26a2-5dfb3b6d]), found(ORCL:OCRS_PPCRS103_001|[82738662-60d64fb8-bf1f26a2-5dfb3b6d])
2013-07-23 10:29:05.409: [    CSSD][1081624896]clssnmvDiskCreate: Found a duplicate voting file with same file name and UID as the newly discovered disk ORCL:OCRS_PPCRS103_001. Rejecting the newly discovered disk.
2013-07-23 10:29:05.409: [    CSSD][1081624896]clssnmvDiskDestroy: removing the voting disk ORCL:OCRS_PPCRS103_001
2013-07-23 10:29:05.409: [   SKGFD][1081624896]Lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: closing handle 0x2aaab0253060 for disk :ORCL:OCRS_PPCRS103_001:

2013-07-23 10:29:05.409: [    CSSD][1081624896]clssnmvDiskVerify: discovered a potential voting file
2013-07-23 10:29:05.409: [   SKGFD][1081624896]Handle 0x2aaab0253060 from lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: for disk :ORCL:OCRS_PPCRS103_002:

2013-07-23 10:29:05.414: [    CSSD][1081624896]clssnmFindVF: found VF by skid in the discovered queue
2013-07-23 10:29:05.414: [    CSSD][1081624896]clssnmFindVF: Duplicate voting file found in the queue of previously discovered disks queued(ORCL:OCRS_PPCRS103_002|[7446716a-64124fba-bfbc0c22-50ab2a85]), found(ORCL:OCRS_PPCRS103_002|[7446716a-64124fba-bfbc0c22-50ab2a85])
2013-07-23 10:29:05.414: [    CSSD][1081624896]clssnmvDiskCreate: Found a duplicate voting file with same file name and UID as the newly discovered disk ORCL:OCRS_PPCRS103_002. Rejecting the newly discovered disk.
2013-07-23 10:29:05.414: [    CSSD][1081624896]clssnmvDiskDestroy: removing the voting disk ORCL:OCRS_PPCRS103_002

2013-07-23 10:31:26.798: [   SKGFD][1081624896]Handle 0x8670f0 from lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: for disk :ORCL:OCRS_PPCRS103_102:

2013-07-23 10:31:26.822: [    CSSD][1081624896]clssnmvDiskVerify: Successful discovery for disk ORCL:OCRS_PPCRS103_102, UID 3ed90702-74de4fe3-bf5dd48b-3e7d0f10, Pending CIN 0:0:1, Committed CIN 0:0:1
2013-07-23 10:31:26.822: [   SKGFD][1081624896]Lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: closing handle 0x8670f0 for disk :ORCL:OCRS_PPCRS103_102:

2013-07-23 10:31:26.822: [    CSSD][1081624896]clssnmvDiskVerify: Successful discovery of 3 disks
2013-07-23 10:31:26.822: [    CSSD][1081624896]clssnmCompleteInitVFDiscovery: Completing initial voting file discovery
2013-07-23 10:31:26.822: [    CSSD][1081624896]clssnmCompleteVFDiscovery: Completing voting file discovery
2013-07-23 10:31:26.822: [    CSSD][1081624896]clssnmvDiskStateChange: state from discovered to deconfigured disk ORCL:OCRS_PPCRS103_100
2013-07-23 10:31:26.822: [    CSSD][1081624896]clssnmvDiskStateChange: state from discovered to deconfigured disk ORCL:OCRS_PPCRS103_101
2013-07-23 10:31:26.822: [    CSSD][1081624896]clssnmvDiskStateChange: state from discovered to deconfigured disk ORCL:OCRS_PPCRS103_102
2013-07-23 10:31:26.822: [    CSSD][1081624896]clssnmvVerifyCommittedConfigVFs: Insufficient voting files found, found 0 of 0 configured, needed 1 voting files
2013-07-23 10:31:26.823: [    CSSD][1081624896]ASSERT clssnm1.c 3301
2013-07-23 10:31:26.823: [    CSSD][1081624896](:CSSNM00021:)clssnmCompleteVFDiscovery: Found 0 voting files, but 1 are required.  Terminating due to insufficient configured voting files
2013-07-23 10:31:26.823: [    CSSD][1081624896]###################################
2013-07-23 10:31:26.823: [    CSSD][1081624896]clssscExit: CSSD aborting from thread clssnmvDDiscThread
2013-07-23 10:31:26.823: [    CSSD][1081624896]###################################

File_name :: ocssd.log

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms