Gen1:19c GI Upgrade Failed
(Doc ID 2864479.1)
Last updated on APRIL 29, 2024
Applies to:
Gen 1 Exadata Cloud at Customer (Oracle Exadata Database Cloud Machine) - Version N/A to N/AInformation in this document applies to any platform.
Symptoms
19c CRS upgrade failed in <Node1> with below errors.
//From crsupgrade_<Node1>_2022-04-21_09-00-36AM.log
2-04-21 09:00:36: crscfg_trace=1
2022-04-21 09:00:36: crscfg_trace_file=/u02/app/grid19/crsdata/<Node1>/crsconfig/crsupgrade_<Node1>_2022-04-21_09-00-36AM.log
2022-04-21 09:00:36: old_nodevips=
2022-04-21 09:00:36: osdfile=/u02/app/19.0.0.0/gridhome/crs/install/s_crsconfig_defs
2022-04-21 09:00:36: parameters_valid=1
2022-04-21 09:00:36: paramfile=/u02/app/19.0.0.0/gridhome/crs/install/crsconfig_params
2022-04-21 09:00:36: platform_family=unix
2022-04-21 09:00:36: pp_srvctl_trc_suff=0
2022-04-21 09:00:36: srvctl_trc_suff=0
2022-04-21 09:00:36: srvctl_trc_suff_pp=0
2022-04-21 09:00:36: stackStartLevel=11
2022-04-21 09:00:36: user_is_superuser=1
2022-04-21 09:00:36: ### Printing of configuration values complete ###
2022-04-21 09:00:36: Get the configured CRS home from olr.loc
2022-04-21 09:00:36: Either /etc/oracle/olr.loc does not exist or is not readable>>>>>>>>>>>>>>>>>>>>>>>>
2022-04-21 09:00:36: Make sure the file exists and it has read and execute access
2022-04-21 09:00:36: Get the configured CRS home from init.cssd
2022-04-21 09:00:36: Executing cmd: /u02/app/19.0.0.0/gridhome/bin/clsecho -p has -f clsrsc -m 324
2022-04-21 09:00:36: Executing cmd: /u02/app/19.0.0.0/gridhome/bin/clsecho -p has -f clsrsc -m 324
2022-04-21 09:00:36: Command output:
> CLSRSC-324: Could not open old init.cssd
>End Command output
2022-04-21 09:00:36: CLSRSC-324: Could not open old init.cssd
2022-04-21 09:00:36: ###### Begin DIE Stack Trace ######
2022-04-21 09:00:36: Package File Line Calling
2022-04-21 09:00:36: --------------- -------------------- ---- ----------
2022-04-21 09:00:36: 1: main rootcrs.pl 358 crsutils::dietrap
2022-04-21 09:00:36: 2: s_crsutils s_crsutils.pm 1489 main::__ANON__
2022-04-21 09:00:36: 3: crsutils crsutils.pm 10060 s_crsutils::s_getOldCrsHome
2022-04-21 09:00:36: 4: crsutils crsutils.pm 1494 crsutils::setConfiguredCRSHome
2022-04-21 09:00:36: 5: crsupgrade crsupgrade.pm 642 crsutils::new
2022-04-21 09:00:36: 6: main rootcrs.pl 371 crsupgrade::new
2022-04-21 09:00:36: ####### End DIE Stack Trace #######
2022-04-21 09:00:36: crscfg_trace_file=/u02/app/grid19/crsdata/<Node1>/crsconfig/crsupgrade_<Node1>_2022-04-21_09-00-36AM.log
2022-04-21 09:00:36: old_nodevips=
2022-04-21 09:00:36: osdfile=/u02/app/19.0.0.0/gridhome/crs/install/s_crsconfig_defs
2022-04-21 09:00:36: parameters_valid=1
2022-04-21 09:00:36: paramfile=/u02/app/19.0.0.0/gridhome/crs/install/crsconfig_params
2022-04-21 09:00:36: platform_family=unix
2022-04-21 09:00:36: pp_srvctl_trc_suff=0
2022-04-21 09:00:36: srvctl_trc_suff=0
2022-04-21 09:00:36: srvctl_trc_suff_pp=0
2022-04-21 09:00:36: stackStartLevel=11
2022-04-21 09:00:36: user_is_superuser=1
2022-04-21 09:00:36: ### Printing of configuration values complete ###
2022-04-21 09:00:36: Get the configured CRS home from olr.loc
2022-04-21 09:00:36: Either /etc/oracle/olr.loc does not exist or is not readable>>>>>>>>>>>>>>>>>>>>>>>>
2022-04-21 09:00:36: Make sure the file exists and it has read and execute access
2022-04-21 09:00:36: Get the configured CRS home from init.cssd
2022-04-21 09:00:36: Executing cmd: /u02/app/19.0.0.0/gridhome/bin/clsecho -p has -f clsrsc -m 324
2022-04-21 09:00:36: Executing cmd: /u02/app/19.0.0.0/gridhome/bin/clsecho -p has -f clsrsc -m 324
2022-04-21 09:00:36: Command output:
> CLSRSC-324: Could not open old init.cssd
>End Command output
2022-04-21 09:00:36: CLSRSC-324: Could not open old init.cssd
2022-04-21 09:00:36: ###### Begin DIE Stack Trace ######
2022-04-21 09:00:36: Package File Line Calling
2022-04-21 09:00:36: --------------- -------------------- ---- ----------
2022-04-21 09:00:36: 1: main rootcrs.pl 358 crsutils::dietrap
2022-04-21 09:00:36: 2: s_crsutils s_crsutils.pm 1489 main::__ANON__
2022-04-21 09:00:36: 3: crsutils crsutils.pm 10060 s_crsutils::s_getOldCrsHome
2022-04-21 09:00:36: 4: crsutils crsutils.pm 1494 crsutils::setConfiguredCRSHome
2022-04-21 09:00:36: 5: crsupgrade crsupgrade.pm 642 crsutils::new
2022-04-21 09:00:36: 6: main rootcrs.pl 371 crsupgrade::new
2022-04-21 09:00:36: ####### End DIE Stack Trace #######
root@<Node1> ~]# ls -lrt /etc/oracle/olr.loc
-rw-r--r-- 1 root oinstall 0 Apr 21 09:20 /etc/oracle/olr.loc>>>>>>>>Zero bytes
[root@<Node1> ~]# id grid
uid=1000(grid) gid=1001(oinstall) groups=1001(oinstall),1004(asmdba),1005(asmoper),1006(asmadmin)
//Earlier deconifg of 19c CRS home has nullified the olr/ocr files and also removed other files in /etc/oracle/
+Even after copying missing files from good node still the issues exists with below errors.
//rootcrs_<Node1>_2022-04-21_01-41-32PM.log
2
022-04-21 13:41:39: SUCCESS
2022-04-21 13:41:39: The 'ROOTCRS_STACK' status is SUCCESS
2022-04-21 13:41:39: Oracle Clusterware has already been successfully configured; hence exiting ...
2022-04-21 13:41:39: Executing cmd: /u01/app/18.1.0.0/grid/bin/clsecho -p has -f clsrsc -m 456
2022-04-21 13:41:39: Executing cmd: /u01/app/18.1.0.0/grid/bin/clsecho -p has -f clsrsc -m 456
2022-04-21 13:41:39: Command output:
> CLSRSC-456: The Oracle Grid Infrastructure has already been configured.
>End Command output
2022-04-21 13:41:39: CLSRSC-456: The Oracle Grid Infrastructure has already been configured.
PROCL-00041: Oracle Local Registry is incorrectly configured
clsu-00600: Internal Error [(:CLSUG00122:)] [5] [OLR error] [41] [Error retrieving olrconfig_loc property.]>>>>>>>>
CRS-4046: Invalid Oracle Clusterware configuration.
CRS-4000: Command Stop failed, or completed with errors.
PROCL-00041: Oracle Local Registry is incorrectly configured
clsu-00600: Internal Error [(:CLSUG00122:)] [5] [OLR error] [41] [Error retrieving olrconfig_loc property.]
CRS-4046: Invalid Oracle Clusterware configuration.
CRS-4000: Command Check failed, or completed with errors.
2022/04/21 09:52:38 CLSRSC-349: The Oracle Clusterware stack failed to stop>>>>>>
Died at /u02/app/19.0.0.0/gridhome/crs/install/crsdowngrade.pm line 1142.
The command '/u02/app/19.0.0.0/gridhome/perl/bin/perl -I/u02/app/19.0.0.0/gridhome/perl/lib -I/u02/app/19.0.0.0/gridhome/crs/install -I/u02/app/19.0.0.0/gridhome/xag /u02/app/19.0.0.0/gridhome/crs/install/rootcrs.pl -downgrade' execution failed.
2022-04-21 13:41:39: The 'ROOTCRS_STACK' status is SUCCESS
2022-04-21 13:41:39: Oracle Clusterware has already been successfully configured; hence exiting ...
2022-04-21 13:41:39: Executing cmd: /u01/app/18.1.0.0/grid/bin/clsecho -p has -f clsrsc -m 456
2022-04-21 13:41:39: Executing cmd: /u01/app/18.1.0.0/grid/bin/clsecho -p has -f clsrsc -m 456
2022-04-21 13:41:39: Command output:
> CLSRSC-456: The Oracle Grid Infrastructure has already been configured.
>End Command output
2022-04-21 13:41:39: CLSRSC-456: The Oracle Grid Infrastructure has already been configured.
PROCL-00041: Oracle Local Registry is incorrectly configured
clsu-00600: Internal Error [(:CLSUG00122:)] [5] [OLR error] [41] [Error retrieving olrconfig_loc property.]>>>>>>>>
CRS-4046: Invalid Oracle Clusterware configuration.
CRS-4000: Command Stop failed, or completed with errors.
PROCL-00041: Oracle Local Registry is incorrectly configured
clsu-00600: Internal Error [(:CLSUG00122:)] [5] [OLR error] [41] [Error retrieving olrconfig_loc property.]
CRS-4046: Invalid Oracle Clusterware configuration.
CRS-4000: Command Check failed, or completed with errors.
2022/04/21 09:52:38 CLSRSC-349: The Oracle Clusterware stack failed to stop>>>>>>
Died at /u02/app/19.0.0.0/gridhome/crs/install/crsdowngrade.pm line 1142.
The command '/u02/app/19.0.0.0/gridhome/perl/bin/perl -I/u02/app/19.0.0.0/gridhome/perl/lib -I/u02/app/19.0.0.0/gridhome/crs/install -I/u02/app/19.0.0.0/gridhome/xag /u02/app/19.0.0.0/gridhome/crs/install/rootcrs.pl -downgrade' execution failed.
//Tried even downgrade step from 19c and it doesn't helps.
Here we were not able to start the crs from earlier version(18c home)as well...
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Cause |
| Solution |