Surviving Instance Crash when it is the Only Instance and the Local Network Interfaces All Fail
(Doc ID 2594153.1)
Last updated on JULY 20, 2024
Applies to:
Oracle Database - Enterprise Edition - Version 12.2.0.1 to 19.1.0.0.0 [Release 12.2 to 19]Information in this document applies to any platform.
Symptoms
When there is only one instance left running without working local network interfaces (private), that instance report following error when it tries to do instance recovery in parallel mode and crashes.
Instance alert log at <ORACLE_BASE>/diag/rdbms/<DBNAME>/<SID>/trace location have following message:
2016-09-29T23:10:16.512573-07:00
Recovery of Online Redo Log: Thread 2 Group 5 Seq 19 Reading mem 0
Mem# 0: +<DGNAME>/<DBNAME>/ONLINELOG/group_5.298.923196561
2016-09-29T23:10:16.526729-07:00
Completed redo application of 1.11MB
2016-09-29T23:10:16.537706-07:00
Completed instance recovery at
Thread 2: RBA 19.2853.16, nab 2853, scn 0x00000000005d6446
265 data blocks read, 395 data blocks written, 11 redo k-bytes read
2016-09-29T23:10:16.549367-07:00
Thread 2 advanced to log sequence 20 (thread recovery)
2016-09-29T23:10:23.994800-07:00
Errors in file
<ORACLE_BASE>/diag/rdbms/<DBNAME>/<SID>/trace/<SID>_qm03_27042.trc (incident=216442) (PDBNAME=CDB$ROOT):
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:if_not_found failed with status: 0
ORA-27301: OS failure message: Error 0
ORA-27302: failure occurred at: skgxpvaddr9
ORA-27303: additional information: requested interface <HAIP1> not found. Check output from ifconfig command
ORA-00603: ORACLE server session terminated by fatal error
ORA-27501: IPC error creating a port
ORA-27300: OS system dependent operation:port failed with status: 0
ORA-27301: OS failure message: Error 0
ORA-27302: failure occurred at: ipclw_udp_pi
ORA-27303: additional information: Failed to create send port.
Incident details in:
<ORACLE_BASE>/diag/rdbms/<DBNAME>/<SID>/incident/incdir_216442/<SID>_qm03_27042_i216442.trc
2016-09-29T23:10:26.475090-07:00
Errors in file
/TB/racusr/diag/rdbms/testdb/testdb1/trace/testdb1_p02p_4724.trc
(incident=230401):
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:port failed with status: 0
ORA-27301: OS failure message: Error 0
ORA-27302: failure occurred at: ipclw_udp_pi
ORA-27303: additional information: Failed to create send port.
Incident details in:
<ORACLE_BASE>/diag/rdbms/<DBNAME>/<SID>/incident/incdir_230401/testdb1_p02p_4724_i230401.trc
2016-09-29T23:10:27.364257-07:00
opidrv aborting process P02P ospid (4724) as a result of ORA-603
2016-09-29T23:10:27.413950-07:00
Process P02P died, see its trace file
Recovery of Online Redo Log: Thread 2 Group 5 Seq 19 Reading mem 0
Mem# 0: +<DGNAME>/<DBNAME>/ONLINELOG/group_5.298.923196561
2016-09-29T23:10:16.526729-07:00
Completed redo application of 1.11MB
2016-09-29T23:10:16.537706-07:00
Completed instance recovery at
Thread 2: RBA 19.2853.16, nab 2853, scn 0x00000000005d6446
265 data blocks read, 395 data blocks written, 11 redo k-bytes read
2016-09-29T23:10:16.549367-07:00
Thread 2 advanced to log sequence 20 (thread recovery)
2016-09-29T23:10:23.994800-07:00
Errors in file
<ORACLE_BASE>/diag/rdbms/<DBNAME>/<SID>/trace/<SID>_qm03_27042.trc (incident=216442) (PDBNAME=CDB$ROOT):
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:if_not_found failed with status: 0
ORA-27301: OS failure message: Error 0
ORA-27302: failure occurred at: skgxpvaddr9
ORA-27303: additional information: requested interface <HAIP1> not found. Check output from ifconfig command
ORA-00603: ORACLE server session terminated by fatal error
ORA-27501: IPC error creating a port
ORA-27300: OS system dependent operation:port failed with status: 0
ORA-27301: OS failure message: Error 0
ORA-27302: failure occurred at: ipclw_udp_pi
ORA-27303: additional information: Failed to create send port.
Incident details in:
<ORACLE_BASE>/diag/rdbms/<DBNAME>/<SID>/incident/incdir_216442/<SID>_qm03_27042_i216442.trc
2016-09-29T23:10:26.475090-07:00
Errors in file
/TB/racusr/diag/rdbms/testdb/testdb1/trace/testdb1_p02p_4724.trc
(incident=230401):
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:port failed with status: 0
ORA-27301: OS failure message: Error 0
ORA-27302: failure occurred at: ipclw_udp_pi
ORA-27303: additional information: Failed to create send port.
Incident details in:
<ORACLE_BASE>/diag/rdbms/<DBNAME>/<SID>/incident/incdir_230401/testdb1_p02p_4724_i230401.trc
2016-09-29T23:10:27.364257-07:00
opidrv aborting process P02P ospid (4724) as a result of ORA-603
2016-09-29T23:10:27.413950-07:00
Process P02P died, see its trace file
Changes
All the private interfaces are down on the surviving node
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Changes |
| Cause |
| Solution |
| References |