ORA-27302: Failure Occurred at: sskgxpsock and Node Crash When Restart the Remote Node
(Doc ID 2521311.1)
Last updated on JULY 20, 2024
Applies to:
Oracle Database - Enterprise Edition - Version 12.2.0.1 and laterInformation in this document applies to any platform.
Symptoms
When shutdown CRS on <nodename2> using 'crsctl stop crs' command, <nodename1> was also evicted. Below message report in ASM alert log on the <nodename2>
alert_+ASM2.log:
2019-03-07T14:22:34.497170+08:00
CLMN: delete dead process - failed
2019-03-07T14:24:37.636661+08:00
CKPT (ospid: 30736) waits for event 'kjudomdet wait for recovery domain detach' for 155 secs.
2019-03-07T14:24:47.561686+08:00
CKPT (ospid: 30736) waits for event 'kjudomdet wait for recovery domain detach' for 165 secs.
.
2019-03-07T14:25:27.653725+08:00
CKPT (ospid: 30736) waits for event 'kjudomdet wait for recovery domain detach' for 205 secs.
2019-03-07T14:25:36.165089+08:00
IPC Send timeout detected. Sender: ospid 30720 [<oracle>@<INSTANCE2> (LMON)] <===========IPC Send timeout detected
Receiver: inst 1 binc 2491184 ospid 12106
Communications reconfiguration: instance_number 1 by ospid 30720
Detected an inconsistent instance membership by instance 2
Evicting instance 1 from cluster <===================Evicting instance 1 from cluster
Waiting for instances to leave: 1
CLMN: delete dead process - failed
2019-03-07T14:24:37.636661+08:00
CKPT (ospid: 30736) waits for event 'kjudomdet wait for recovery domain detach' for 155 secs.
2019-03-07T14:24:47.561686+08:00
CKPT (ospid: 30736) waits for event 'kjudomdet wait for recovery domain detach' for 165 secs.
.
2019-03-07T14:25:27.653725+08:00
CKPT (ospid: 30736) waits for event 'kjudomdet wait for recovery domain detach' for 205 secs.
2019-03-07T14:25:36.165089+08:00
IPC Send timeout detected. Sender: ospid 30720 [<oracle>@<INSTANCE2> (LMON)] <===========IPC Send timeout detected
Receiver: inst 1 binc 2491184 ospid 12106
Communications reconfiguration: instance_number 1 by ospid 30720
Detected an inconsistent instance membership by instance 2
Evicting instance 1 from cluster <===================Evicting instance 1 from cluster
Waiting for instances to leave: 1
alert_+ASM1.log:
2019-03-07T14:21:28.984611+08:00
NOTE: timeout (306s) expired for orphan ownerid 0x10002 for client <INSTANCE2>:<DBNAME>:<CLUSTER NAME>; 309s elapsed
2019-03-07T14:25:36.507895+08:00
IPC Send timeout detected. Sender: ospid 12130 [<oracle>@<INSTANCE1>(RBAL)] <================IPC Send timeout detected.
Receiver: inst 2 binc 273543876 ospid 30722
2019-03-07T14:25:36.510107+08:00
IPC Send timeout to 2.0 inc 18 for msg type 8 from opid 25
2019-03-07T14:25:36.515795+08:00
Suppressed nested communications reconfiguration: instance_number 2
Detected an inconsistent instance membership by instance 2
Errors in file <ORACLE_BASE>/diag/asm/+asm/+ASM1/trace/+ASM1_lmon_12106.trc (incident=282521):
ORA-29740: evicted by instance number 2, group incarnation 20
Incident details in: <ORACLE_BASE>/diag/asm/+asm/+ASM1/incident/incdir_282521/+ASM1_lmon_12106_i282521.trc
NOTE: timeout (306s) expired for orphan ownerid 0x10002 for client <INSTANCE2>:<DBNAME>:<CLUSTER NAME>; 309s elapsed
2019-03-07T14:25:36.507895+08:00
IPC Send timeout detected. Sender: ospid 12130 [<oracle>@<INSTANCE1>(RBAL)] <================IPC Send timeout detected.
Receiver: inst 2 binc 273543876 ospid 30722
2019-03-07T14:25:36.510107+08:00
IPC Send timeout to 2.0 inc 18 for msg type 8 from opid 25
2019-03-07T14:25:36.515795+08:00
Suppressed nested communications reconfiguration: instance_number 2
Detected an inconsistent instance membership by instance 2
Errors in file <ORACLE_BASE>/diag/asm/+asm/+ASM1/trace/+ASM1_lmon_12106.trc (incident=282521):
ORA-29740: evicted by instance number 2, group incarnation 20
Incident details in: <ORACLE_BASE>/diag/asm/+asm/+ASM1/incident/incdir_282521/+ASM1_lmon_12106_i282521.trc
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Cause |
| Solution |