Data Guard Broker Switchover fails With ORA-16665 using Active Data Guard (Doc ID 1323789.1)

Last updated on OCTOBER 12, 2016

Applies to:

Oracle Database - Enterprise Edition - Version 11.1.0.6 to 12.1.0.2 [Release 11.1 to 12.1]
Information in this document applies to any platform.
** checked for relevance '23-Nov-2015' **

Symptoms

In case you may want or need more about your current topic - please also access the Data Guard Community of Customers and Oracle Specialists directly via:
https://communities.oracle.com/portal/server.pt/community/high_availability_data_guard/302


There is a Data Guard Broker Configuration using Active Data Guard, ie. the Physical Standby Database is open READ ONLY while Log Transport Service (Managed Recovery) is active.
When trying to perform a Switchover using DGMGRL, this fails raising ORA-16665:

DGMGRL> switchover to '<Standby Database>';
Performing switchover NOW, please wait...
Error: ORA-16665: timeout waiting for the result from a database



In the DRC.LOG-Files you can find Entries like this:


Primary Database:

NSV1: Site <Standby Database> returned ORA-16665.
DMON: Database <Standby Database>  returned ORA-16665
for opcode = CTL_SWITCH, phase = TEARDOWN, req_id = 1.1.1410420311
Operation CTL_SWITCH canceled during phase 2, error = ORA-16665

Standby Database:

DMON: ORA-16662 network timeout in contacting database <Primary Database>. Killing NSV0
DMON: Database <Primary Database> returned ORA-16662
for opcode = CTL_SWITCH, phase = RESYNCH, req_id = 1.1.1410420311
DMON: ORA-16662 network timeout in contacting database <Primary Database>. Killing NSV0
DMON: Database <Primary Database> returned ORA-16662
for opcode = CTL_SWITCH, phase = RESYNCH, req_id = 1.1.1410420311
DMON: Freeing orphaned task 1.1.1410420311, opcode=CTL_SWITCH.
RSM0: HEALTH CHECK ERROR: ORA-16816: incorrect database role



In the ALERT.LOGs and DRC.LOGs you can see that the Switchover itself compelted, ie. the Primary Database has been switched into a Standby Database and the former Standby Database is now the Primary, but the Restart of the Databases to finally complete the Switchover does not happen.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms