Service stop fail with ORA-04031 during GI upgrade due to low memory in shared pool (Doc ID 2056684.1)

Last updated on OCTOBER 31, 2015

Applies to:

Oracle Database - Enterprise Edition - Version 12.1.0.2 to 12.1.0.2 [Release 12.1]
Information in this document applies to any platform.

Symptoms

During GI upgrade to 12c, rootupgrade fails with below messages

2015/06/19 05:27:25 CLSRSC-469: Successfully set Oracle Clusterware and ASM to rolling migration mode

2015/06/19 05:27:25 CLSRSC-466: Starting shutdown of the current Oracle Grid Infrastructure stack

2015/06/19 05:29:19 CLSRSC-357: Failed to stop current Oracle Clusterware stack during upgrade

2015/06/19 05:29:19 CLSRSC-349: The Oracle Clusterware stack failed to stop

Died at /ora1/app/12.1.0.2/grid/crs/install/crsupgrade.pm line 3478.
The command '/ora1/app/12.1.0.2/grid/perl/bin/perl -I/ora1/app/12.1.0.2/grid/perl/lib -I/ora1/app/12.1.0.2/grid/crs/install /ora1/app/12.1.0.2/grid/crs/install/rootcrs.pl  -upgrade' execution failed


rootcrsrachost1.log shows

2015-06-19 05:27:25: Executing cmd: /ora1/app/12.1.0.1/grid/bin/crsctl stop crs -f
2015-06-19 05:29:19: Command output:
>  CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rachost1'
>  CRS-2673: Attempting to stop 'ora.crsd' on 'rachost1'
.
.
>  CRS-5017: The resource action "ora.orcl.orcl_svc.svc stop" encountered the following error:
>  ORA-04031: unable to allocate 3896 bytes of shared memory ("shared pool","BEGIN DBMS_SERVICE.STOP_SERV...","sga heap(1,0)","kglsim object batch") <<<<<<<<<
>  . For details refer to "(:CLSN00108:)" in "/ora1/app/12.1.0.1/grid/log/rachost1/agent/crsd/oraagent_oracle/oraagent_oracle.log".
>  CRS-2675: Stop of 'ora.orcl.orcl_svc.svc' on 'rachost1' failed <<<<<<<<<<<<<<<<<<<<<
.
.
2015-06-19 05:29:19: Executing cmd: /ora1/app/12.1.0.2/grid/bin/clsecho -p has -f clsrsc -m 357
2015-06-19 05:29:19: Command output:
>  CLSRSC-357: Failed to stop current Oracle Clusterware stack during upgrade
.
2015-06-19 05:29:19: ###### Begin DIE Stack Trace ######
2015-06-19 05:29:19:     Package         File                 Line Calling  
2015-06-19 05:29:19:     --------------- -------------------- ---- ----------
2015-06-19 05:29:19:  1: main            rootcrs.pl            267 crsutils::dietrap
2015-06-19 05:29:19:  2: crsupgrade      crsupgrade.pm        3478 main::__ANON__
2015-06-19 05:29:19:  3: crsupgrade      crsupgrade.pm        2736 crsupgrade::performpost112upg
2015-06-19 05:29:19:  4: crsupgrade      crsupgrade.pm         395 crsupgrade::queryClusterConfig
2015-06-19 05:29:19:  5: crsupgrade      crsupgrade.pm         326 crsupgrade::CRSUpgrade
2015-06-19 05:29:19:  6: main            rootcrs.pl            276 crsupgrade::new
2015-06-19 05:29:19: ####### End DIE Stack Trace #######

 

Changes

GI upgrade from 12.1.0.1 to 12.1.0.2

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms