My Oracle Support Banner

EXACS:PDB delete/clone/create fails with error "DBAAS-60022" (Doc ID 2886855.1)

Last updated on NOVEMBER 16, 2022

Applies to:

Oracle Cloud Infrastructure - Exadata Cloud Service - Version N/A and later
Information in this document applies to any platform.

Symptoms

 //From pilot_2022-07-09_12-42-13-AM

INFO: [2022-07-09 00:42:26.923 UTC][pool-1-thread-1][DBCAExecutor.runDBCA:135] DBCA workflow timeout getting used is:1440
FINE: [2022-07-09 00:42:26.924 UTC][pool-1-thread-1][DefaultCommandExecutor.run:348] Checking for completion of operation on node:localnode
INFO: [2022-07-09 00:42:26.924 UTC][pool-40-thread-1][DefaultCommandExecutor$2.call:311] Command constructed for node (localnode):export LC_ALL=en_US.UTF-8;export TNS_ADMIN=/<ORACLE_HOME>/network/admin/<DB_NAME>;export ORACLE_HOME=/<ORACLE_HOME>;/var/opt/oracle/dbaastools/dbaasca/bin/dbca -silent -oui_internal -deletePluggableDatabase -sourceDB <DB_NAME> -pdbName <PDB_NAME> -skipPasswordComplexityCheck false -checkOnly -jreLoc /usr/java/jdk1.8.0_291-amd64/jre
INFO: [2022-07-09 00:42:26.924 UTC][pool-40-thread-1][DefaultCommandExecutor$2.call:312] Current retry count is :1
FINE: [2022-07-09 00:42:26.924 UTC][pool-40-thread-1][DirectChannel.execCommandImpl:84] Setting the environment variable:ORACLE_HOME value:/<ORACLE_HOME>
FINE: [2022-07-09 00:42:26.925 UTC][pool-40-thread-1][DirectChannel.execCommandImpl:84] Setting the environment variable:TNS_ADMIN value:/<ORACLE_HOME>/network/admin/<DB_NAME>
FINE: [2022-07-09 00:42:26.925 UTC][pool-40-thread-1][ChannelHelper.constructCommand:107] Setting the environment variable:ORACLE_HOME value:/<ORACLE_HOME>
FINE: [2022-07-09 00:42:26.925 UTC][pool-40-thread-1][ChannelHelper.constructCommand:107] Setting the environment variable:TNS_ADMIN value:/<ORACLE_HOME>/network/admin/<DB_NAME>
INFO: [2022-07-09 00:42:26.925 UTC][pool-40-thread-1][DirectChannel.execCommandImpl:96] Command [/bin/sh, -c, ORACLE_HOME=/<ORACLE_HOME>; TNS_ADMIN=/<ORACLE_HOME>/network/admin/<DB_NAME>; export LC_ALL=en_US.UTF-8;export TNS_ADMIN=/<ORACLE_HOME>/network/admin/<DB_NAME>;export ORACLE_HOME=/<ORACLE_HOME>;/var/opt/oracle/dbaastools/dbaasca/bin/dbca -silent -oui_internal -deletePluggableDatabase -sourceDB <DB_NAME> -pdbName <PDB_NAME> -skipPasswordComplexityCheck false -checkOnly -jreLoc /usr/java/jdk1.8.0_291-amd64/jre]
FINE: [2022-07-09 00:42:26.926 UTC][pool-40-thread-1][ExecutionProcessHandler.handleProcess:112] Waiting for completion of process operation with timeout (in minutes): 1440>>>>>>>>>>>>>>>>>>operation timeout
INFO: [2022-07-09 00:42:42.433 UTC][pool-1-thread-1][DefaultCommandExecutor.run:369] Updating exit status for node:localnode old exit code is:
INFO: [2022-07-09 00:42:42.433 UTC][pool-1-thread-1][DefaultCommandExecutor.run:371] ********Overall result for command execution:/var/opt/oracle/dbaastools/dbaasca/bin/dbca -silent -oui_internal -deletePluggableDatabase -sourceDB <DB_NAME> -pdbName <PDB_NAME> -skipPasswordComplexityCheck false -checkOnly -jreLoc /usr/java/jdk1.8.0_291-amd64/jre ******
INFO: [2022-07-09 00:42:42.433 UTC][pool-1-thread-1][DefaultCommandExecutor.run:372] Execution of /var/opt/oracle/dbaastools/dbaasca/bin/dbca -silent -oui_internal -deletePluggableDatabase -sourceDB <DB_NAME> -pdbName <PDB_NAME> -skipPasswordComplexityCheck false -checkOnly -jreLoc /usr/java/jdk1.8.0_291-amd64/jre script is successful on nodes : [localnode]

Execution status of succeeded node:localnode

Execution status of localnode is:true
Execution exit code of localnode is:0

INFO: [2022-07-09 00:42:42.433 UTC][pool-1-thread-1][DefaultCommandExecutor.run:373] ********End of overall result for command execution******
INFO: [2022-07-09 00:42:42.433 UTC][pool-1-thread-1][DBCAExecutor.runDBCA:153] Clear workflow timeout
INFO: [2022-07-09 00:42:42.433 UTC][pool-1-thread-1][DBCAExecutor.runDBCA:159] DBCA command was successful
INFO: [2022-07-09 00:42:42.434 UTC][pool-1-thread-1][CStateUtil.setProgress:375] Updating cstate progress for job:5b4d9d9c-ee29-48b0-b989-4ecc9cbdf3c8 to progress:33%
FINE: [2022-07-09 00:42:42.434 UTC][pool-1-thread-1][DefaultCommandExecutor.run:348] Checking for completion of operation on node:localnode
INFO: [2022-07-09 00:42:42.434 UTC][pool-42-thread-1][DefaultCommandExecutor$2.call:311] Command constructed for node (localnode):export LC_ALL=en_US.UTF-8;perl -I /var/opt/oracle/perl_lib -e 'use DBAAS::cstate;
my $cstate = cstate->new("{}");

 

//From dbaastools_2022-07-12_12-30-57-AM_288934.log

SEVERE: [2022-07-12 00:32:40.088 UTC][main][DBaaSToolsDriver.setup:292] Exception occurred. Updating cstate file with status as failed.
INFO: [2022-07-12 00:32:40.183 UTC][main][CStateJobUpdateTracker.updateStatus:118] Updating status for job: 454edd4c-f916-4ea4-b097-1c8942485d94 to : FAILED
INFO: [2022-07-12 00:32:40.205 UTC][main][ServiceJobUpdateTracker.updateStatus:245] Updating status for job: 454edd4c-f916-4ea4-b097-1c8942485d94 to : FAILED
INFO: [2022-07-12 00:32:40.213 UTC][main][ServiceJobUpdateTracker.updateStatus:208] Updating status for job: 454edd4c-f916-4ea4-b097-1c8942485d94 to : Failure
INFO: [2022-07-12 00:32:40.222 UTC][main][PilotPluginCommandProcessor.createResumeCommand:189]
************ To resume this failed session, run following command ************
dbaascli pdb delete --pdbName <PDB_NAME> --dbName <DB_NAME> --sessionID 628 --resume
******************************************************************************
SEVERE: [2022-07-12 00:32:40.224 UTC][main][AbstractErrorAdvisor.getDetailedMessage:105] [FATAL] [DBAAS-60022] Command '/var/opt/oracle/dbaastools/pilot/bin/pilot -plugin delete_pdb_cloud DBNAME="<DB_NAME>" PDBNAME="<PDB_NAME>" DBAASAPI_JOB_ID="454edd4c-f916-4ea4-b097-1c8942485d94" -J-Doracle.install.commons.pilot.log.enablePID=true -logLevel FINE -logDir /var/opt/oracle/log/<DB_NAME>/pdb/delete -silent -checkpointDir /var/opt/oracle/log/pilot_checkpoints -jreLoc /usr/java/jdk1.8.0_291-amd64/jre ' execution has failed on nodes [localnode].

---# Begin Stacktrace #---------------------------
ID: oracle.install.commons.util.exception.AbstractErrorAdvisor:169
oracle.dbcloud.common.lib.ExecutionException: [DBAAS-60022] Command '/var/opt/oracle/dbaastools/pilot/bin/pilot -plugin delete_pdb_cloud DBNAME="<DB_NAME>" PDBNAME="<PDB_NAME>" DBAASAPI_JOB_ID="454edd4c-f916-4ea4-b097-1c8942485d94" -J-Doracle.install.commons.pilot.log.enablePID=true -logLevel FINE -logDir /var/opt/oracle/log/<DB_NAME>/pdb/delete -silent -checkpointDir /var/opt/oracle/log/pilot_checkpoints -jreLoc /usr/java/jdk1.8.0_291-amd64/jre ' execution has failed on nodes [localnode].
at oracle.dbcloud.common.lib.cmd.DefaultCommandExecutor.run(DefaultCommandExecutor.java:378)
at oracle.dbcloud.common.lib.cmd.DefaultCommandExecutor.runAsUser(DefaultCommandExecutor.java:277)
at oracle.dblcm.sa.dbaastools.cmd.DBaasExecutorHelper.execute(DBaasExecutorHelper.java:66)
at oracle.dblcm.sa.dbaastools.cmd.PilotExecutor.execute(PilotExecutor.java:142)
at oracle.dblcm.sa.dbaastools.cmd.PilotPluginCommandProcessor.runPilotExecutor(PilotPluginCommandProcessor.java:124)
at oracle.dblcm.sa.dbaastools.cmd.PilotPluginCommandProcessor.processCommand(PilotPluginCommandProcessor.java:84)
at oracle.dblcm.sa.dbaastools.driver.DBaaSToolsDriver.setup(DBaaSToolsDriver.java:271)
at oracle.dblcm.sa.dbaastools.driver.DBaaSToolsApplication.run(DBaaSToolsApplication.java:171)
at oracle.install.commons.util.Application.startup(Application.java:1142)
at oracle.install.commons.util.Application.startup(Application.java:870)
at oracle.dblcm.sa.dbaastools.driver.DBaaSToolsApplication.startup(DBaaSToolsApplication.java:149)
at oracle.dblcm.sa.dbaastools.driver.DBaaSToolsApplication.main(DBaaSToolsApplication.java:180)

---# End Stacktrace #-----------------------------
INFO: [2022-07-12 00:32:40.306 UTC][main][AbstractErrorAdvisor.advise:52] Advice is ABORT
SEVERE: [2022-07-12 00:32:40.306 UTC][main][DefaultExceptionHandler.handleException:46] Unconditional Exit
INFO: [2022-07-12 00:32:40.307 UTC][main][ExitStatusSet.add:74] Adding ExitStatus FAILURE to the exit status set
~

 # dbaascli patch tools list

DBAAS CLI version 22.2.1.1.0
Executing command patch tools list
Checking Current tools on all nodes

xus01-u6quz1: Patchid : 22.2.1.1.0_220623.1310
No applicable tools patches are available

xus01-u6quz2: Patchid : 22.2.1.1.0_220623.1310>>>>>>>>>>>>>>>>>>>>June 26th version.
No applicable tools patches are available

 

//All Nodes have the same tools version

# rpm -qa --last|grep -i dbaastools_exa
dbaastools_exa-1.0-1+22.2.1.1.0_220623.1310.x86_64 Mon 04 Jul 2022 07:56:27 PM UTC

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.