opatchauto/datapatch: validate_con_names: PDB$SEED is not open (Doc ID 2199291.1)

Last updated on NOVEMBER 03, 2016

Applies to:

Oracle Database - Standard Edition - Version 12.1.0.2 and later
Information in this document applies to any platform.

Symptoms

Execution of opatchauto apply fails on node1 while applying 12.1.0.2 Jul2016 GI PSU:

validate_con_names: PDB$SEED is not open
catconInit: Unexpected error returned by validate_con_names for inclusive Container list

catconInit failed, exiting

<GI_HOME>/cfgtoollogs/opatchauto/opatchauto<timestamp>.log

Executing command as root:
/app/grid/product/12.1.0/grid/perl/bin/perl -I/app/grid/product/12.1.0/grid/perl/lib -I/app/grid/product/12.1.0/grid/OPatch/auto/dbtmp/bootstrap_se2rac1/patchwork/crs/install /app/grid/product/12.1.0/grid/OPatch/auto/dbtmp/bootstrap_se2rac1/patchwork/crs/install/rootcrs.pl -postpatch
2016-07-07 19:42:09,973 INFO [382] com.oracle.glcm.patch.auto.db.product.executor.GISystemCall - Is retry required=false
2016-07-07 19:42:09,991 INFO [382] com.oracle.glcm.patch.auto.db.product.executor.PatchingStepExecutor -
COMMAND EXECUTION FAILURE :
Using configuration parameter file: /app/grid/product/12.1.0/grid/OPatch/auto/dbtmp/bootstrap_se2rac1/patchwork/crs/install/crsconfig_params
2016/07/07 19:34:25 CLSRSC-4015: Performing install or upgrade action for Oracle Trace File Analyzer (TFA) Collector.

2016/07/07 19:35:40 CLSRSC-4003: Successfully patched Oracle Trace File Analyzer (TFA) Collector.
....

CRS-6016: Resource auto-start has completed for server se2rac1
CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources
CRS-4123: Oracle High Availability Services has been started.
Oracle Clusterware active version on the cluster is [12.1.0.2.0]. The cluster upgrade state is [ROLLING PATCH]. The cluster active patch level is [0].
SQL Patching tool version 12.1.0.2.0 on Thu Jul 7 19:41:51 2016
Copyright (c) 2015, Oracle. All rights reserved.

Connecting to database...OK
Note: Datapatch will only apply or rollback SQL fixes for PDBs
that are in an open state, no patches will be applied to closed PDBs.
Please refer to Note: Datapatch: Database 12c Post Patch SQL Automation
(Doc ID 1585822.1)

catconInit failed, exiting

Please refer to MOS Note 1609718.1 and/or the invocation log
/app/oracle/cfgtoollogs/sqlpatch/sqlpatch_26781_2016_07_07_19_41_51/sqlpatch_invocation.log
for information on how to resolve the above errors.

SQL Patching tool complete on Thu Jul 7 19:41:57 2016
2016/07/07 19:41:57 CLSRSC-488: Patching the Grid Infrastructure Management Repository database failed.


ERROR:
Died at /app/grid/product/12.1.0/grid/OPatch/auto/dbtmp/bootstrap_se2rac1/patchwork/crs/install/crspatch.pm line 998.

....

....

After fixing the cause of failure Run opatchauto resume with session id "NZE2"

]'}
2016-07-07 19:42:10,193 SEVERE [23] com.oracle.cie.wizard.internal.engine.WizardControllerEngine - Wizard error cause
com.oracle.cie.wizard.tasks.TaskExecutionException: OPATCHAUTO-68128: Patch action execution failed.
OPATCHAUTO-68128: Failed to execute patch actions for goal startup:startup
OPATCHAUTO-68128: Check the log for more information.
at com.oracle.glcm.patch.auto.wizard.silent.tasks.PatchActionTask.execute(PatchActionTask.java:106)
at com.oracle.cie.wizard.internal.cont.SilentTaskContainer$TaskRunner.run(SilentTaskContainer.java:97)
at java.lang.Thread.run(Thread.java:745)
Caused by: com.oracle.glcm.patch.auto.OPatchAutoException: OPATCHAUTO-68067: Patch action execution failed.
OPATCHAUTO-68067: Failed to execute patch action [com.oracle.glcm.patch.auto.db.integration.controller.action.crs.GIStartupAction
Patch Target : se2rac1->/app/grid/product/12.1.0/grid Type[crs]
Details: [
---------------------------Patching Failed---------------------------------
Command execution failed during patching in home: /app/grid/product/12.1.0/grid, host: se2rac1.
Command failed: /app/grid/product/12.1.0/grid/perl/bin/perl -I/app/grid/product/12.1.0/grid/perl/lib -I/app/grid/product/12.1.0/grid/OPatch/auto/dbtmp/bootstrap_se2rac1/patchwork/crs/install /app/grid/product/12.1.0/grid/OPatch/auto/dbtmp/bootstrap_se2rac1/patchwork/crs/install/rootcrs.pl -postpatch
.... 

OPATCHAUTO-68067: Check the details to determine the cause of the failure.
at com.oracle.glcm.patch.auto.action.PatchActionExecutor.execute(PatchActionExecutor.java:157)
at com.oracle.glcm.patch.auto.wizard.silent.tasks.PatchActionTask.execute(PatchActionTask.java:102)
... 2 more
2016-07-07 19:42:10,677 SEVERE [1] com.oracle.glcm.patch.auto.OPatchAuto - OPatchAuto failed.
com.oracle.glcm.patch.auto.OPatchAutoException: OPATCHAUTO-68061: The orchestration engine failed.
OPATCHAUTO-68061: The orchestration engine failed with return code 1
OPATCHAUTO-68061: Check the log for more details.
at com.oracle.glcm.patch.auto.OrchestrationEngineImpl.orchestrate(OrchestrationEngineImpl.java:40)
at com.oracle.glcm.patch.auto.OPatchAuto.orchestrate(OPatchAuto.java:752)
at com.oracle.glcm.patch.auto.OPatchAuto.orchestrate(OPatchAuto.java:358)
at com.oracle.glcm.patch.auto.OPatchAuto.orchestrate(OPatchAuto.java:304)
at com.oracle.glcm.patch.auto.OPatchAuto.main(OPatchAuto.java:140)
2016-07-07 19:42:10,678 INFO [1] com.oracle.cie.common.util.reporting.CommonReporter - Reporting console output : Message{id='null', message='OPATCHAUTO-68061: The orchestration engine failed.
OPATCHAUTO-68061: The orchestration engine failed with return code 1
OPATCHAUTO-68061: Check the log for more details.'}
2016-07-07 19:42:10,679 INFO [1] com.oracle.cie.common.util.reporting.CommonReporter - Reporting console output : Message{id='null', message='OPatchAuto failed.'}

 

<GI_HOME>/cfgtoollogs/crsconfig/crspatch_<node>_<timestamp>.log

2016-07-07 19:38:51: postpatch: first node to patch
2016-07-07 19:38:51: Attempt to stop Mgmt DB before disabling it
....
2016-07-07 19:39:15: Attempt to start Mgmt DB on the first node: se2rac1
2016-07-07 19:39:15: Invoking "/app/grid/product/12.1.0/grid/bin/srvctl start mgmtdb -n se2rac1"
2016-07-07 19:39:15: trace file=/app/grid/product/12.1.0/grid/cfgtoollogs/crsconfig/srvmcfg4.log
2016-07-07 19:39:15: Running as user grid: /app/grid/product/12.1.0/grid/bin/srvctl start mgmtdb -n se2rac1
2016-07-07 19:39:15: Invoking "/app/grid/product/12.1.0/grid/bin/srvctl start mgmtdb -n se2rac1" as user "grid"
2016-07-07 19:39:15: Executing /bin/su grid -c "/app/grid/product/12.1.0/grid/bin/srvctl start mgmtdb -n se2rac1"
2016-07-07 19:39:15: Executing cmd: /bin/su grid -c "/app/grid/product/12.1.0/grid/bin/srvctl start mgmtdb -n se2rac1"
2016-07-07 19:41:43: Executing cmd: /app/grid/product/12.1.0/grid/bin/srvctl status mgmtdb -S 1
2016-07-07 19:41:50: Command output:
> #@=result[0]: dbunique_name={_mgmtdb} inst_name={-MGMTDB} node_name={se2rac1} up={true} state_details={Open} internal_state={STABLE}
>End Command output
2016-07-07 19:41:50: Mgmtdb is running on node: se2rac1; local node: se2rac1
2016-07-07 19:41:50: Mgmtdb is running on the local node
2016-07-07 19:41:50: Starting to patch Mgmt DB ...
2016-07-07 19:41:50: Invoking "/app/grid/product/12.1.0/grid/sqlpatch/sqlpatch -db -MGMTDB"
2016-07-07 19:41:50: Running as user grid: /app/grid/product/12.1.0/grid/sqlpatch/sqlpatch -db -MGMTDB
2016-07-07 19:41:50: Invoking "/app/grid/product/12.1.0/grid/sqlpatch/sqlpatch -db -MGMTDB" as user "grid"
2016-07-07 19:41:50: Executing /bin/su grid -c "/app/grid/product/12.1.0/grid/sqlpatch/sqlpatch -db -MGMTDB"
2016-07-07 19:41:50: Executing cmd: /bin/su grid -c "/app/grid/product/12.1.0/grid/sqlpatch/sqlpatch -db -MGMTDB"
2016-07-07 19:41:57: Command output:
> SQL Patching tool version 12.1.0.2.0 on Thu Jul 7 19:41:51 2016
> Copyright (c) 2015, Oracle. All rights reserved.
>
> Connecting to database...OK
> Note: Datapatch will only apply or rollback SQL fixes for PDBs
> that are in an open state, no patches will be applied to closed PDBs.
> Please refer to Note: Datapatch: Database 12c Post Patch SQL Automation
> (Doc ID 1585822.1)
>
> catconInit failed, exiting
>
> Please refer to MOS Note 1609718.1 and/or the invocation log
> /app/oracle/cfgtoollogs/sqlpatch/sqlpatch_26781_2016_07_07_19_41_51/sqlpatch_invocation.log
> for information on how to resolve the above errors.
>
> SQL Patching tool complete on Thu Jul 7 19:41:57 2016
>End Command output
2016-07-07 19:41:57: Attempt to patch Mgmt DB failed
2016-07-07 19:41:57: Executing cmd: /app/grid/product/12.1.0/grid/bin/clsecho -p has -f clsrsc -m 488
2016-07-07 19:41:57: Executing cmd: /app/grid/product/12.1.0/grid/bin/clsecho -p has -f clsrsc -m 488
2016-07-07 19:41:58: Command output:
> CLSRSC-488: Patching the Grid Infrastructure Management Repository database failed.
>End Command output
2016-07-07 19:41:58: CLSRSC-488: Patching the Grid Infrastructure Management Repository database failed.

 

<ORACLE_BASE>/cfgtoollogs/sqlpatch/sqlpatch_<id>_<timestamp>/sqlpatch_invocation.log 

Connecting to database...OK
Note: Datapatch will only apply or rollback SQL fixes for PDBs
that are in an open state, no patches will be applied to closed PDBs.
Please refer to Note: Datapatch: Database 12c Post Patch SQL Automation
(Doc ID 1585822.1)
catcon: ALL catcon-related output will be written to /app/oracle/cfgtoollogs/sqlpatch/sqlpatch_26781_2016_07_07_19_41_51/sqlpatch_catcon__catcon_26781.lst
catcon: See /app/oracle/cfgtoollogs/sqlpatch/sqlpatch_26781_2016_07_07_19_41_51/sqlpatch_catcon_*.log files for output generated by scripts
catcon: See /app/oracle/cfgtoollogs/sqlpatch/sqlpatch_26781_2016_07_07_19_41_51/sqlpatch_catcon__*.lst files for spool files, if any
validate_con_names: PDB$SEED is not open
catconInit: Unexpected error returned by validate_con_names for inclusive Container list

catconInit failed, exiting

Please refer to MOS Note 1609718.1 and/or the invocation log
/app/oracle/cfgtoollogs/sqlpatch/sqlpatch_26781_2016_07_07_19_41_51/sqlpatch_invocation.log
for information on how to resolve the above errors.

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms