REPAT: PDB: Can't Recover Complete Database Including All Pluggable Databases (Doc ID 2123037.1)

Last updated on MAY 04, 2016

Applies to:

Oracle Database - Enterprise Edition - Version 12.1.0.2 and later
Information in this document applies to any platform.

Symptoms

Trying to recover a dropped PDB but it's no longer in the xml list to add back.

CDB15A_pr00_9423.trc in CDB15A_pr00_9423.trc

Trace file /app/oracle/cdb/1210_db/diag/rdbms/cdb15a/CDB15A/trace/CDB15A_pr00_9423.trc
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Partitioning, Automatic Storage Management, OLAP, Advanced Analytics
and Real Application Testing options
ORACLE_HOME = /app/oracle/cdb/1210_db/product/12.1.0.2
System name: Linux
Node name: zuerich
Release: 3.8.13-68.3.4.el7uek.x86_64
Version: #2 SMP Tue Jul 14 14:59:15 PDT 2015
Machine: x86_64
Instance name: CDB15A
Redo thread mounted by this instance: 1
Oracle process number: 36
Unix process pid: 9423, image: oracle@zuerich (PR00)


*** 2016-02-18 18:36:10.311
*** SESSION ID:(9037.31592) 2016-02-18 18:36:10.311
*** CLIENT ID:() 2016-02-18 18:36:10.311
*** SERVICE NAME:() 2016-02-18 18:36:10.311
*** MODULE NAME:() 2016-02-18 18:36:10.311
*** CLIENT DRIVER:() 2016-02-18 18:36:10.311
*** ACTION NAME:() 2016-02-18 18:36:10.311
*** CONTAINER ID:(1) 2016-02-18 18:36:10.311
 
Started Parallel Media Recovery
Loading kcnibr

*** 2016-02-18 18:36:11.286
Dumping database incarnation table:
Resetlogs 0 scn and time: 0x0000.00000001 08/28/2015 15:10:38
Dumping PDB pathvec - index 0
  0000 : pdb 1, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 2, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 3, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 4, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 5, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 6, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 7, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 8, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 9, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 10, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 11, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 12, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 13, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 14, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 15, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 16, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 17, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 18, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 19, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 20, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 21, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 22, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 23, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 24, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 25, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 26, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 27, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 28, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 29, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 30, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 31, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 32, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 33, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 34, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 35, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 36, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 37, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 38, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 39, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 40, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 41, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 42, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0

Missing entry for PDB 43 so it cannot be added back in.


Dumping PDB pathvec - index 0
  0000 : pdb 44, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 45, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 46, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 47, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 48, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 49, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 50, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 51, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 52, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 53, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Dumping PDB pathvec - index 0
  0000 : pdb 54, dbinc 1, pdbinc 0
  db rls 0x0000.00000001 rlc 888937838
  incscn 0x0000.00000000 ts 0
  br scn 0x0000.00000000 ts 0
  er scn 0x0000.00000000 ts 0
Recovery target incarnation = 1, activation ID = 0
Influx buffer limit = 100000 min(50% x 6962826, 100000)

*** 2016-02-18 18:36:12.229
0 percent of recovery slaves are allocated for undo TBS.
Start recovery at thread 1 ckpt scn 13417901358962 logseq 0 block 0

*** 2016-02-18 18:36:12.564
Media Recovery add redo thread 1

*** 2016-02-18 18:36:15.598
kpdb_switchcbk_begin encountered ORA-65011.srcpdbid=1 destpdbid=43
ksedsts<-kpdbSwitch<-kpdbrcrt<-kcoapl_rcv_marker<-krr_do_media_recovery<-krddmr<-krd_logmerger_driver<-krp_slave_main<-ksvrdp<-opirip<-opidrv<-sou2o<-opimai_real<-ssthrdmain<-main<-__libc_start_main==== Redo read statistics for thread 1 ====
Total physical reads (from disk and memory): 790527Kb
-- Redo read_disk statistics --
Read rate (ASYNC): 783359Kb in 3.09s => 247.57 Mb/sec
Total redo bytes: 790527Kb Longest record: 33Kb, moves: 662/1787476 moved: 2Mb (0%)
Longest LWN: 2096Kb, reads: 73842
Last redo scn: 0x0c34.193e7f72 (13417901358962)
Change vector header moves = 238741/3592593 (6%)
----------------------------------------------

*** 2016-02-18 18:36:15.651
Media Recovery drop redo thread 1

*** 2016-02-18 18:36:15.672
Completed Media Recovery
Unloading kcnibr

*** 2016-02-18 18:36:15.721
Checking to start in-flux buffer recovery from SCN 3124.423526258 to SCN (non-inclusive) 3124.423526258
Influx recovery found in-flux buffers

*** 2016-02-18 18:36:15.721
Influx Media Recovery add redo thread 1 seq 0
Recovered data files to a consistent state at change 13417901358962
ORA-00283: recovery session canceled due to errors
ORA-65011: Pluggable database does not exist.
Logmerger exiting with ORA-283 exception

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms