Grid Infrastructure Downgrade On Lastnode Failing with CLSRSC-503 (Doc ID 2174150.1)

Last updated on MAY 29, 2017

Applies to:

Oracle Database - Enterprise Edition - Version 12.1.0.2 and later
Information in this document applies to any platform.

Symptoms

Grid Infrastructure downgrade on lastnode failed while Dropping the Grid Infrastructure Management Repository database failed.

crsdowngrade_node1.log

==================

2016-08-18 14:41:35: Executing cmd: /bin/su oracle -c "/u01/app/12.1.0.2/grid/crs/install/dropdb /u01/app/12.1.0.2/grid"
2016-08-18 14:41:55: Command output:
> Starting the Grid Infrastructure Management Repository database
> Using PFILE='/u01/app/12.1.0.2/grid/dbs/init-dropmgmtdb.ora'
> Command output:
> SQL*Plus: Release 12.1.0.2.0 Production on Thu Aug 18 14:41:35 2016 Copyright (c) 1982, 2014, Oracle. All rights reserved. Connected to an idle instance. SQL> ORACLE instance started. Total System Global Area 788529152 bytes Fixed Size 3002920 bytes Variable Size 331353560 bytes Database Buffers 448790528 bytes Redo Buffers 5382144 bytes Database mounted. SQL> Disconnected from Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production With the Partitioning, Automatic Storage Management and Advanced Analytics options
> Starting the Grid Infrastructure Management Repository database succeeded
> Creating new pfile for the Management Repository database
>
> SQL*Plus: Release 12.1.0.2.0 Production on Thu Aug 18 14:41:55 2016
>
> Copyright (c) 1982, 2014, Oracle. All rights reserved.
>
>
> Connected to:
> Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
> With the Partitioning, Automatic Storage Management and Advanced Analytics options
>
> SQL>
> File created.
>
> SQL> Disconnected from Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
> With the Partitioning, Automatic Storage Management and Advanced Analytics options
> Succeeded in creating PFILE '/u01/app/12.1.0.2/grid/dbs/init-dropmgmtdbSAVED.ora'
> Dropping the Grid Infrastructure Management Repository database
> install_driver(Oracle) failed: Can't load '/u01/app/12.1.0.2/grid/perl/lib/site_perl/5.14.4/aix-thread-multi-64all/auto/DBD/Oracle/Oracle.so' for module DBD::Oracle: 0509-022 Cannot load module /u01/app/12.1.0.2/grid/perl/lib/site_perl/5.14.4/aix-thread-multi-64all/auto/DBD/Oracle/Oracle.so.
> 0509-150 Dependent module libclntsh.so could not be loaded.
> 0509-022 Cannot load module libclntsh.so.
> 0509-026 System error: A file or directory in the path name does not exist.
> 0509-022 Cannot load module /u01/app/12.1.0.2/grid/perl/lib/site_perl/5.14.4/aix-thread-multi-64all/auto/DBD/Oracle/Oracle.so.
> 0509-150 Dependent module /u01/app/12.1.0.2/grid/perl/lib/site_perl/5.14.4/aix-thread-multi-64all/auto/DBD/Oracle/Oracle.so could not be loaded. at /u01/app/12.1.0.2/grid/perl/lib/5.14.4/aix-thread-multi-64all/DynaLoader.pm line 190.
> at (eval 26) line 3
> Compilation failed in require at (eval 26) line 3.
> Perhaps a required shared library or dll isn't installed where expected
> at /u01/app/12.1.0.2/grid/crs/install/dropdb.pl line 59
> Dropping the Grid Infrastructure Management Repository database failed
>End Command output
2016-08-18 14:41:55: Failed to drop Management DB, return code of 'dropdb': 2
2016-08-18 14:41:55: Executing cmd: /u01/app/12.1.0.2/grid/bin/clsecho -p has -f clsrsc -m 503
2016-08-18 14:41:56: Executing cmd: /u01/app/12.1.0.2/grid/bin/clsecho -p has -f clsrsc -m 503
2016-08-18 14:41:56: Command output:
> CLSRSC-503: Deleting the Grid Infrastructure Management Repository database failed.
>End Command output
2016-08-18 14:41:56: CLSRSC-503: Deleting the Grid Infrastructure Management Repository database failed.
2016-08-18 14:41:56: ###### Begin DIE Stack Trace ######
2016-08-18 14:41:56: Package File Line Calling
2016-08-18 14:41:56: --------------- -------------------- ---- ----------
2016-08-18 14:41:56: 1: main rootcrs.pl 267 crsutils::dietrap
2016-08-18 14:41:56: 2: crsdeconfig crsdeconfig.pm 3016 main::__ANON__
2016-08-18 14:41:56: 3: crsdeconfig crsdeconfig.pm 2173 crsdeconfig::dropMgmtdbDowngrade
2016-08-18 14:41:56: 4: crsdeconfig crsdeconfig.pm 346 crsdeconfig::crsDowngrade
2016-08-18 14:41:56: 5: crsdeconfig crsdeconfig.pm 228 crsdeconfig::CRSDeconfig
2016-08-18 14:41:56: 6: main rootcrs.pl 276 crsdeconfig::new
2016-08-18 14:41:56: ####### End DIE Stack Trace #######

2016-08-18 14:41:56: checkpoint has failed

 

Changes

 Downgrade in process

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms