Oracle Restart:OL7.2: rootcrs -postpatch failed when starting OHASD
(Doc ID 2419924.1)
Last updated on AUGUST 20, 2023
Applies to:
Oracle Database Cloud Schema Service - Version N/A and laterOracle Database Exadata Cloud Machine - Version N/A and later
Oracle Cloud Infrastructure - Database Service - Version N/A and later
Oracle Database Backup Service - Version N/A and later
Oracle Database Exadata Express Cloud Service - Version N/A and later
Information in this document applies to any platform.
Symptoms
The following error occurred while running rootcrs.sh -postpatch.
scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap/patchwork/crs/install/rootcrs.pl -postpatch
/scratch/12.1.0/grid/perl/bin/perl -I/scratch/12.1.0/grid/perl/lib -I/scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap_den00mem/patchwork/crs/install
/scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap/patchwork/crs/install/rootcrs.pl -postpatch
2017-06-07 12:04:46,861 INFO [386] com.oracle.glcm.patch.auto.db.product.executor.PatchingStepExecutor - COMMAND
Looks like this: /scratch /12.1.0/grid/perl/bin/perl -I/scratch/12.1.0/grid/perl/lib -I/scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap/patchwork/crs/instal l
/scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap/patchwork/crs/install/rootcrs.pl -postpatch
2017-06-07 12:07:34,879 INFO [386] com.oracle.glcm.patch.auto.db.product.executor.GISystemCall - Is retry required=false
2017-06-07 12:07:34,880 INFO [386] com.oracle.glcm.patch.auto.db.product.executor.PatchingStepExecutor -
COMMAND EXECUTION FAILURE :
Using configuration parameter file:
/scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap/patchwork/crs/install/crsconfig_params
2017/06/07 12:04:53 CLSRSC-4015: Performing install or upgrade action for Oracle Trace File Analyzer (TFA) Collector.
2017/06/07 12:05:16 CLSRSC-4003: Successfully patched Oracle Trace File Analyzer (TFA) Collector.
2017/06/07 12:07:33 CLSRSC-117: Failed to start Oracle Clusterware stack
opatchauto2017-06-07_11-52-17AM.log
Executing command as root:
/scratch/12.1.0/grid/perl/bin/perl -I/scratch/12.1.0/grid/perl/lib -I/scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap/patchwork/crs/install
/scratch/12.1.0/grid/OPatch/auto/dbtmp/bootstrap/patchwork/crs/install/rootcrs.pl -postpatch
2017/06/07 12:07:33 CLSRSC-117: Failed to start Oracle Clusterware stack
crspatch_node1_2017-06-07_12-04-47AM.log
2017-06-07 12:05:33: Executing cmd: /scratch/12.1.0/grid/bin/clscfg -localpatch
2017-06-07 12:05:33: Command output:
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
End Command output
2017-06-07 12:05:33: Successfully patched an existing configuration in OLR
2017-06-07 12:05:33: OHASD needs to be up for modifying resources
2017-06-07 12:05:33: Executing cmd: /scratch/12.1.0/grid/bin/crsctl start crs -noautostart
2017-06-07 12:07:33: Command output:
CRS-4124: Oracle High Availability Services startup failed.
CRS-4000: Command Start failed, or completed with errors.
End Command output
2017-06-07 12:07:33: Return value of start of CRS with '-noautostart': 1
2017-06-07 12:07:33: Failed to start OHASD only
2017-06-07 12:07:33: Executing cmd: /scratch/12.1.0/grid/bin/clsecho -p has -f clsrsc -m 117
2017-06-07 12:07:33: Executing cmd: /scratch/12.1.0/grid/bin/clsecho -p has -f clsrsc -m 117
2017-06-07 12:07:33: Command output:CLSRSC-117: Failed to start Oracle Clusterware stack
End Command output
2017-06-07 12:07:33: CLSRSC-117: Failed to start Oracle Clusterware stack
2017-06-07 12:07:33: ###### Begin DIE Stack Trace ######
2017-06-07 12:07:33: Package File Line
Calling
2017-06-07 12:07:33: --------------- -------------------- ---- ----------
2017-06-07 12:07:33: 1: main rootcrs.pl 267 crsutils::dietrap
2017-06-07 12:07:33: 2: crspatch crspatch.pm 912 main::__ANON__
2017-06-07 12:07:33: 3: crspatch crspatch.pm 1107 crspatch::performPostPatch
2017-06-07 12:07:33: 4: crspatch crspatch.pm 202 crspatch::crsPostPatch
2017-06-07 12:07:33: 5: main rootcrs.pl 276 crspatch::new
2017-06-07 12:07:33: ####### End DIE Stack Trace #######
alert.log
2017-06-07 13:03:10.065 [CLSCFG(3305)]CRS-1810: Node-specific configuration for node node1 in Oracle Local Registry was patched to patch level 3457982140.
2017-06-07 13:03:21.220 [CLSECHO(3618)]CRS-10001: CRS-10132: Oracle High Availability Service was restarted at least 10 times within the last 60 seconds. Stop auto-restarting Oracle High Availability Service.
ohasd.bin process is being running multiple times.
root 2480 1 0 05:21 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin exclusive
root 2504 30403 0 05:22 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin restart
root 2518 30403 0 05:22 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin restart
root 2531 30403 0 05:22 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin restart
root 2552 30403 0 05:22 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin restart
root 2570 30403 0 05:22 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin restart
root 2593 30403 0 05:22 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin restart
root 2606 30403 0 05:22 ? 00:00:01 /scratch/12.1.0/grid/bin/ohasd.bin restart
/scratch/12.1.0/grid/bin/ohasd.bin restart root 6897 6845 0 19:33 pts/3 00:00:00 grep --color=auto ohasd
The stale ohasd processes are running from days before the latest patch run
root 6120 1 0 Jun26 ? 00:00:05 /scratch/12.1.0/grid/bin/ohasd.bin exclusive
root 11781 1 0 Jun23 ? 00:00:13 /scratch/12.1.0/grid/bin/ohasd.bin exclusive
root 12605 1 0 Jun25 ? 00:00:10 /scratch/12.1.0/grid/bin/ohasd.bin exclusive
root 13539 1 0 Jun24 ? 00:00:12 /scratch/12.1.0/grid/bin/ohasd.bin exclusive
root 17326 1 0 Jun23 ? 00:00:13 /scratch/12.1.0/grid/bin/ohasd.bin exclusive
root 19912 1 0 Jun23 ? 00:00:13 /scratch/12.1.0/grid/bin/ohasd.bin exclusive
root 22259 1 0 Jun23 ? 00:00:14 /scratch/12.1.0/grid/bin/ohasd.bin exclusive
The previous service was still running.
ps -ef | grep ohasd
root 30403 1 0 Jun12 ? 00:00:07 /bin/sh /etc/init.d/init.ohasd run >/dev/null 2>&1 </dev/null
Changes
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
Symptoms |
Changes |
Cause |
Solution |
References |