12c GI root.sh Fails on Non-First Node: CRS-2883: Resource 'ora.cssdmonitor' failed during Clusterware stack start.

(Doc ID 1943173.1)

Last updated on MAY 01, 2016

Applies to:

Oracle Database - Enterprise Edition - Version 12.1.0.1 and later
Information in this document applies to any platform.

Symptoms

Executing 12c Grid Infrastructure root.sh on non-first node (second or other node), it fails with the following:

 

Command output

CRS-2883: Resource 'ora.cssdmonitor' failed during Clusterware stack start.
CRS-4406: Oracle High Availability Services synchronous start failed.
CRS-4000: Command Start failed, or completed with errors.
2014/11/07 21:31:30 CLSRSC-117: Failed to start Oracle Clusterware stack

Died at /u01/app/12.1.0.1/grid/crs/install/crsinstall.pm line 953.

 

<GI_HOME>/cfgtoollogs/crsconfig/rootcrs_<node>_<timestamp>.log

2014-11-07 21:07:57: Attempt to start the whole CRS stack
2014-11-07 21:07:57: Executing cmd: /u01/app/12.1.0.1/grid/bin/crsctl start crs -wait
2014-11-07 21:18:48: Command output:
> CRS-4123: Starting Oracle High Availability Services-managed resources
> CRS-2672: Attempting to start 'ora.mdnsd' on 'racnode2'
> CRS-2672: Attempting to start 'ora.evmd' on 'racnode2'
> CRS-2676: Start of 'ora.evmd' on 'racnode2' succeeded
> CRS-2676: Start of 'ora.mdnsd' on 'racnode2' succeeded
> CRS-2672: Attempting to start 'ora.gpnpd' on 'racnode2'
> CRS-2676: Start of 'ora.gpnpd' on 'racnode2' succeeded
> CRS-2672: Attempting to start 'ora.gipcd' on 'racnode2'
> CRS-2676: Start of 'ora.gipcd' on 'racnode2' succeeded
> CRS-2672: Attempting to start 'ora.cssdmonitor' on 'racnode2'
> CRS-2676: Start of 'ora.cssdmonitor' on 'racnode2' succeeded
> CRS-2672: Attempting to start 'ora.cssd' on 'racnode2'
> CRS-2672: Attempting to start 'ora.diskmon' on 'racnode2'
> CRS-2676: Start of 'ora.diskmon' on 'racnode2' succeeded
> CRS-2789: Cannot stop resource 'ora.diskmon' as it is not running on server 'racnode2'
> CRS-2883: Resource 'ora.cssdmonitor' failed during Clusterware stack start.
> CRS-4406: Oracle High Availability Services synchronous start failed.
> CRS-4000: Command Start failed, or completed with errors.
>End Command output
2014-11-07 21:18:48: The return value of blocking start of CRS: 1
2014-11-07 21:18:48: Failed to start the Oracle CRS stack
2014-11-07 21:18:48: Executing cmd: /u01/app/12.1.0.1/grid/bin/clsecho -p has -f clsrsc -m 117
2014-11-07 21:18:48: Command output:
> CLSRSC-117: Failed to start Oracle Clusterware stack
>End Command output
2014-11-07 21:18:48: Executing cmd: /u01/app/12.1.0.1/grid/bin/clsecho -p has -f clsrsc -m 117
2014-11-07 21:18:48: Command output:
> CLSRSC-117: Failed to start Oracle Clusterware stack
>End Command output
2014-11-07 21:18:48: CLSRSC-117: Failed to start Oracle Clusterware stack
2014-11-07 21:18:48: ###### Begin DIE Stack Trace ######
2014-11-07 21:18:48: Package File Line Calling
2014-11-07 21:18:48: --------------- -------------------- ---- ----------
2014-11-07 21:18:48: 1: main rootcrs.pl 211 crsutils::dietrap
2014-11-07 21:18:48: 2: crsinstall crsinstall.pm 953 main::__ANON__
2014-11-07 21:18:48: 3: crsinstall crsinstall.pm 869 crsinstall::start_cluster
2014-11-07 21:18:48: 4: crsinstall crsinstall.pm 284 crsinstall::prepare_to_start_clusterware
2014-11-07 21:18:48: 5: crsinstall crsinstall.pm 222 crsinstall::CRSInstall
2014-11-07 21:18:48: 6: main rootcrs.pl 334 crsinstall::new
2014-11-07 21:18:48: ####### End DIE Stack Trace #######

2014-11-07 21:18:48: ROOTCRS_STACK checkpoint has failed
2014-11-07 21:18:48: Running as user oracle: /u01/app/12.1.0.1/grid/bin/cluutil -ckpt -oraclebase /u01/app/oracle -writeckpt -name ROOTCRS_STACK -state FAIL
2014-11-07 21:18:48: s_run_as_user2: Running /bin/su oracle -c ' /u01/app/12.1.0.1/grid/bin/cluutil -ckpt -oraclebase /u01/app/oracle -writeckpt -name ROOTCRS_STACK -state FAIL '
2014-11-07 21:18:49: Removing file /tmp/qba-XaoyG
2014-11-07 21:18:49: Successfully removed file: /tmp/qba-XaoyG
2014-11-07 21:18:49: /bin/su successfully executed

 

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms