root script (root.sh or rootupgrade.sh) Fails as ora.ons Does not Come up (Doc ID 1259924.1)

Last updated on JANUARY 11, 2016

Applies to:

Oracle Database - Enterprise Edition - Version 11.2.0.1 and later
Information in this document applies to any platform.

Symptoms

11gR2 Grid Infrastructure root.sh/rootupgrade.sh fails as ora.ons doesn't come up:

2010-10-11 19:10:51: J2EE (OC4J) Container Resource Add ... passed ...
2010-10-11 19:10:51: starting nodeapps...
2010-10-11 19:10:51: DHCP_flag=0
2010-10-11 19:10:51: nodes_to_start=racnode1
2010-10-11 19:11:13: exit value of start nodeapps/vip is 2
2010-10-11 19:11:13: output for start nodeapps is  PRCR-1013 : Failed to start resource ora.ons PRCR-1064 : Failed to start resource ora.ons on node racnode1 CRS-5016: Process "/u01/app/11.2.0/grid/opmn/bin/onsctli" spawned by agent "/u01/app/11.2.0/grid/bin/oraagent.bin" for action "start" failed: details at "(:CLSN00010:)" in "/u01/app/11.2.0/grid/log/racnode1/agent/crsd/oraagent_grid/oraagent_grid.log" onsctl start: ons failed to start CRS-2674: Start of 'ora.ons' on 'racnode1' failed
2010-10-11 19:11:13: output of startnodeapp after removing already started mesgs is PRCR-1013 : Failed to start resource ora.ons PRCR-1064 : Failed to start resource ora.ons on node racnode1 CRS-5016: Process "/u01/app/11.2.0/grid/opmn/bin/onsctli" spawned by agent "/u01/app/11.2.0/grid/bin/oraagent.bin" for action "start" failed: details at "(:CLSN00010:)" in "/u01/app/11.2.0/grid/log/racnode1/agent/crsd/oraagent_grid/oraagent_grid.log" onsctl start: ons failed to start CRS-2674: Start of 'ora.ons' on 'racnode1' failed
2010-10-11 19:11:13: /u01/app/11.2.0/grid/bin/srvctl start nodeapps -n racnode1 ... failed
2010-10-11 19:10:58.841: [ora.ons][1800] [start] Utils:execCmd Running the binary from /u01/app/11.2.0/grid/opmn/bin/onsctli
2010-10-11 19:11:06.155: [ora.ons][1800] [start]
(:CLSN00010:)onsctl start: ons failed to start

2010-10-11 19:11:06.156: [ora.ons][1800] [start] (:CLSN00010:)Utils:execCmd scls_process_join() uret 2

2010-10-11 19:11:06.156: [ora.ons][1800] [start] Exception type=2 string=CRS-5016: Process "/u01/app/11.2.0/grid/opmn/bin/onsctli" spawned by agent "/u01/app/11.2.0/grid/bin/oraagent.bin" for action "start" failed: details at "(:CLSN00010:)" in "/u01/app/11.2.0/grid/log/racnode1/agent/crsd/oraagent_grid/oraagent_grid.log"

2010-10-11 19:11:06.159: [ora.ons][1800] [start] execCmd ret = 2
2010-10-11 19:11:06.159: [ora.ons][1800] [start]
(:CLSN00010:)onsctl start: ons failed to start

2010-10-11 19:11:06.159: [ora.ons][1800] [start] Exception type=2 string=onsctl start: ons failed to start

2010-10-11 19:11:06.160: [ora.ons][1800] [start] OnsAgent::start }
2010-10-11 19:11:06.160: [ora.ons][1800] [start] clsn_agent::start }
2010-10-11 19:11:06.160: [    AGFW][1800] Command: start for resource: ora.ons racnode1 1 completed with status: SUCCESS
2010-10-11 19:11:06.161: [    AGFW][1800] Executing command: check for resource: ora.ons racnode1 1
2010-10-11 19:11:06.162: [ora.ons][1800] [check] OnsAgent::check {
2010-10-11 19:11:06.162: [ora.ons][1800] [check] onsctl ping
2010-10-11 19:11:06.162: [ora.ons][1800] [check] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2010-10-11 19:11:06.162: [ora.ons][1800] [check] Utils:execCmd action = 3 flags = 6 ohome = /u01/app/11.2.0/grid/opmn/ cmdname = onsctli.
2010-10-11 19:11:06.163: [ora.ons][1800] [check] Utils:execCmd Running the binary from /u01/app/11.2.0/grid/opmn/bin/onsctli
2010-10-11 19:11:06.282: [ora.ons][1800] [check]
(:CLSN00010:)ons is not running ...

2010-10-11 19:11:06.282: [ora.ons][1800] [check] execCmd ret = 2
2010-10-11 19:11:06.283: [ora.ons][1800] [check]
(:CLSN00010:)ons is not running ...

2010-10-11 19:11:06.283: [ora.ons][1800] [check] return val = 1
2010-10-11 19:11:06.283: [ora.ons][1800] [check] OnsAgent::check }
2010-10-11 19:11:06.283: [    AGFW][1800] check for resource: ora.ons racnode1 1 completed with status: OFFLINE

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms