Oracle Restart:OL7.2: rootcrs -postpatch failed when starting OHASD (Doc ID 2419924.1)

scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap/patchwork/crs/install/rootcrs.pl -postpatch

/scratch/12.1.0/grid/perl/bin/perl -I/scratch/12.1.0/grid/perl/lib -I/scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap_den00mem/patchwork/crs/install
/scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap/patchwork/crs/install/rootcrs.pl -postpatch
2017-06-07 12:04:46,861 INFO [386] com.oracle.glcm.patch.auto.db.product.executor.PatchingStepExecutor - COMMAND
Looks like this: /scratch /12.1.0/grid/perl/bin/perl -I/scratch/12.1.0/grid/perl/lib -I/scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap/patchwork/crs/instal l
/scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap/patchwork/crs/install/rootcrs.pl -postpatch
2017-06-07 12:07:34,879 INFO [386] com.oracle.glcm.patch.auto.db.product.executor.GISystemCall - Is retry required=false
2017-06-07 12:07:34,880 INFO [386] com.oracle.glcm.patch.auto.db.product.executor.PatchingStepExecutor -
COMMAND EXECUTION FAILURE :
Using configuration parameter file:
/scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap/patchwork/crs/install/crsconfig_params
2017/06/07 12:04:53 CLSRSC-4015: Performing install or upgrade action for Oracle Trace File Analyzer (TFA) Collector.
2017/06/07 12:05:16 CLSRSC-4003: Successfully patched Oracle Trace File Analyzer (TFA) Collector.
2017/06/07 12:07:33 CLSRSC-117: Failed to start Oracle Clusterware stack

2017-06-07 12:04:46,861 INFO [386] com.oracle.glcm.patch.auto.db.product.executor.PatchingStepExecutor -
Executing command as root:
/scratch/12.1.0/grid/perl/bin/perl -I/scratch/12.1.0/grid/perl/lib -I/scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap/patchwork/crs/install
/scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap/patchwork/crs/install/rootcrs.pl -postpatch
2017/06/07 12:07:33 CLSRSC-117: Failed to start Oracle Clusterware stack

2017-06-07 12:05:33: Patch an existing configuration in OLR
2017-06-07 12:05:33: Executing cmd: /scratch/12.1.0/grid/bin/clscfg -localpatch
2017-06-07 12:05:33: Command output:
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
End Command output
2017-06-07 12:05:33: Successfully patched an existing configuration in OLR
2017-06-07 12:05:33: OHASD needs to be up for modifying resources
2017-06-07 12:05:33: Executing cmd: /scratch/12.1.0/grid/bin/crsctl start crs -noautostart
2017-06-07 12:07:33: Command output:
CRS-4124: Oracle High Availability Services startup failed.
CRS-4000: Command Start failed, or completed with errors.
End Command output
2017-06-07 12:07:33: Return value of start of CRS with '-noautostart': 1
2017-06-07 12:07:33: Failed to start OHASD only
2017-06-07 12:07:33: Executing cmd: /scratch/12.1.0/grid/bin/clsecho -p has -f clsrsc -m 117
2017-06-07 12:07:33: Executing cmd: /scratch/12.1.0/grid/bin/clsecho -p has -f clsrsc -m 117
2017-06-07 12:07:33: Command output:CLSRSC-117: Failed to start Oracle Clusterware stack
End Command output
2017-06-07 12:07:33: CLSRSC-117: Failed to start Oracle Clusterware stack
2017-06-07 12:07:33: ###### Begin DIE Stack Trace ######
2017-06-07 12:07:33: Package File Line
Calling
2017-06-07 12:07:33: --------------- -------------------- ---- ----------
2017-06-07 12:07:33: 1: main rootcrs.pl 267 crsutils::dietrap
2017-06-07 12:07:33: 2: crspatch crspatch.pm 912 main::__ANON__
2017-06-07 12:07:33: 3: crspatch crspatch.pm 1107 crspatch::performPostPatch
2017-06-07 12:07:33: 4: crspatch crspatch.pm 202 crspatch::crsPostPatch
2017-06-07 12:07:33: 5: main rootcrs.pl 276 crspatch::new
2017-06-07 12:07:33: ####### End DIE Stack Trace #######

2017-06-07 12:05:46.628 [CLSECHO(21216)]CRS-10001: CRS-10132: Oracle High Availability Service was restarted at least 10 times within the last 60 seconds. Stop auto-restarting Oracle High Availability Service.
2017-06-07 13:03:10.065 [CLSCFG(3305)]CRS-1810: Node-specific configuration for node node1 in Oracle Local Registry was patched to patch level 3457982140.
2017-06-07 13:03:21.220 [CLSECHO(3618)]CRS-10001: CRS-10132: Oracle High Availability Service was restarted at least 10 times within the last 60 seconds. Stop auto-restarting Oracle High Availability Service.

root 2480 1 0 05:21 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin exclusive

root 2504 30403 0 05:22 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin restart

root 2518 30403 0 05:22 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin restart

root 2531 30403 0 05:22 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin restart

root 2552 30403 0 05:22 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin restart

root 2570 30403 0 05:22 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin restart

root 2593 30403 0 05:22 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin restart

root 2606 30403 0 05:22 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin restart

/scratch/12.1.0/grid/bin/ohasd.bin restart root      6897  6845  0 19:33 pts/3    00:00:00 grep --color=auto ohasd 

 

root 6120 1 0 Jun26 ? 00:00:05 /scratch/12.1.0/grid/bin/ohasd.bin exclusive

root 11781 1 0 Jun23 ? 00:00:13 /scratch/12.1.0/grid/bin/ohasd.bin exclusive

root 12605 1 0 Jun25 ? 00:00:10 /scratch/12.1.0/grid/bin/ohasd.bin exclusive

root 13539 1 0 Jun24 ? 00:00:12 /scratch/12.1.0/grid/bin/ohasd.bin exclusive

root 17326 1 0 Jun23 ? 00:00:13 /scratch/12.1.0/grid/bin/ohasd.bin exclusive

root 19912 1 0 Jun23 ? 00:00:13 /scratch/12.1.0/grid/bin/ohasd.bin exclusive

root 22259 1 0 Jun23 ? 00:00:14 /scratch/12.1.0/grid/bin/ohasd.bin exclusive

 

ps -ef | grep ohasd 

root     30403     1  0 Jun12 ?        00:00:07 /bin/sh /etc/init.d/init.ohasd run >/dev/null 2>&1 </dev/null