FAILS TO START ORA.CSSD WHEN UPGRADING GRID 12C ON NODE 1 (Doc ID 1917543.1)

Last updated on MAY 03, 2017

Applies to:

Oracle Database - Enterprise Edition - Version 12.1.0.1 and later
Information in this document applies to any platform.

Symptoms

 1)  GI rootupgrade.sh to 12c fails on node 1 with the following error.

[root@rws3010005 grid]# ./rootupgrade.sh
Performing root user operation.
:
:
OLR initialization - successful
2014/08/11 15:13:33 CLSRSC-329: Replacing Clusterware entries in file '/etc/inittab'

CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
2014/08/11 15:26:49 CLSRSC-115: Start of resource 'ora.cssd' failed

2014/08/11 15:26:49 CLSRSC-117: Failed to start Oracle Clusterware stack

2014/08/11 15:26:49 CLSRSC-244: Failed to start Cluster Synchronization Service in clustered mode

Died at /u01/app/12.1.0.2/grid/crs/install/crsupgrade.pm line 794.
The command '/u01/app/12.1.0.2/grid/perl/bin/perl -I/u01/app/12.1.0.2/grid/perl/lib -I/u01/app/12.1.0.2/grid/crs/install /u01/app/12.1.0.2/grid/crs/install/rootcrs.pl  -upgrade' execution failed




2) The CSSD log or trace shows No voting files found when it starts

- For 12.1.0.1 in $NEW_GRID_HOME/log/<hostname>/log/cssd/ocssd.log

- For 12.1.0.2 or higher  $ORACLE_BASE/crs/<hostname>/crs/trace/ocssd.trc

 

2014-08-11 15:15:48.063432 :    CSSD:1762603744: clssnmReadDiscoveryProfile: voting file discovery string()
2014-08-11 15:15:48.063436 :    CSSD:1762603744: clssnkInit: NK generic layer initializing.
2014-08-11 15:15:48.064234 :    CSSD:1113868608: clssscthrdmain: Starting thread clssnmvDDiscThread
2014-08-11 15:15:48.064555 :    GPNP:1113868608: clsgpnp_Init: [at clsgpnp0.c:654] '/u01/app/12.1.0.2/grid' in effect as GPnP home base.
2014-08-11 15:15:48.064562 :    GPNP:1113868608: clsgpnp_Init: [at clsgpnp0.c:708] GPnP pid=32209, cli=clsuGpnpg GPNP comp tracelevel=1, depcomp tracelevel=0, tlsrc:ORA_DAEMON_LOGGING_LEVELS, apitl:0, complog:1, tstenv:0, devenv:0, envopt:0, flags=2003
2014-08-11 15:15:48.067776 :    GPNP:1113868608: clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:402] Using FS Wallet Location : /u01/app/12.1.0.2/grid/gpnp/rws3010005/wallets/peer/

2014-08-11 15:15:48.067799 :    GPNP:1113868608: clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:414] Wallet readable. Path: /u01/app/12.1.0.2/grid/gpnp/rws3010005/wallets/peer/

2014-08-11 15:15:48.087224 :    GPNP:1113868608: clsgpnp_profileGetXmlAttrValVA: [at clsgpnp.c:3351] (:GPNP00135:)Didn't find attribute Mode in profile
2014-08-11 15:15:48.087244 :    GPNP:1113868608: clsgpnp_Term: [at clsgpnp0.c:1347] GPnP cli=clsuGpnpg
2014-08-11 15:15:48.088184 :    CLSF:1113868608: Allocated CLSF context
2014-08-11 15:15:48.088190 :    CSSD:1113868608: clssnmvDDiscThread: using discovery string  for initial discovery
2014-08-11 15:15:48.088199 :   SKGFD:1113868608: Discovery with str::

2014-08-11 15:15:48.088204 :   SKGFD:1113868608: UFS discovery with ::

2014-08-11 15:15:48.088210 :   SKGFD:1113868608: Execute glob on the string /dev/sd*                                   <<<<------ note the wrong discovery string
2014-08-11 15:15:48.088281 :   SKGFD:1113868608: OSS discovery with ::

2014-08-11 15:15:48.088985 :    CSSD:1113868608: clssnmvDiskVerify: Successful discovery of 0 disks
2014-08-11 15:15:48.088990 :    CSSD:1113868608: clssnmCompleteInitVFDiscovery: Completing initial voting file discovery
2014-08-11 15:15:48.088992 :    CSSD:1113868608: clssnmvFindInitialConfigs: No voting files found
2014-08-11 15:15:48.089052 :    CSSD:1113868608: (:CSSNM00070:)clssnmCompleteInitVFDiscovery: Voting file not found. Retrying discovery in 15 seconds

 

 4) The ASM discovery string is not set in GPNP profile.

<NEW_GRID_HOME>/bin/gpnptool get

<orcl:CSS-Profile id="css" DiscoveryString="+asm" LeaseDuration="400"/><orcl:ASM-Profile id="asm" DiscoveryString="" SPFile="+OCRVD_0508/rws0508-clu/asmparameterfile/registry.253.853222953"


 

Changes

 Upgrading GRID to 12c release

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms