OID 12c: OID instance crashes intermittently with gsldhacHACallback Event error
(Doc ID 2685549.1)
Last updated on MARCH 23, 2023
Applies to:
Oracle Internet Directory - Version 12.2.1.3.0 and laterInformation in this document applies to any platform.
Symptoms
OID version: 12.2.1.3.0
OID service going down intermittently and noticed below error in node manager and OID logs.
<Apr 2, 2020 9:15:09 AM GMT> <INFO> <Instance <OID-COMPONENT-2> has changed state from RUNNING to STOPPED>
<Apr 2, 2020 9:15:09 AM GMT> <INFO> <IDM-DOMAIN-NAME> <OID-COMPONENT-2> <The server '<OID-COMPONENT-2>' with process id <PID> is no longer alive; waiting for the process to die.>
<Apr 2, 2020 9:15:09 AM GMT> <INFO> <The server '<OID-COMPONENT-2>' with process id <PID> is no longer alive; waiting for the process to die.>
<Apr 2, 2020 9:15:09 AM GMT> <INFO> <Instance <OID-COMPONENT-2> has changed state from STOPPED to RUNNING>
<Apr 2, 2020 9:15:09 AM GMT> <INFO> <IDM-DOMAIN-NAME> <OID-COMPONENT-2> <Server failed so attempting to restart (restart count = 2)>
<Apr 2, 2020 9:15:10 AM GMT> <WARNING> <Cannot start instance <OID-COMPONENT-2>. It is still alive.>
<Apr 2, 2020 9:15:10 AM GMT> <INFO> <IDM-DOMAIN-NAME> <OID-COMPONENT-2> <The server '<OID-COMPONENT-2>' is running now.>
<Apr 2, 2020 9:17:25 AM GMT> <INFO> <Instance <OID-COMPONENT-2> has changed state from RUNNING to STOPPED>
oidldapd logs with debug enabled:
[2020-04-02T09:15:09.696475+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [<TID>: <TID>] Main::[[
oidldapd: Release 12.2.1.3.0 - Production on wed apr 1 10:13:37 2020
Copyright (c) 1982, 2017 Oracle. All rights reserved.
Portions Copyright (c) 1992-1996, 1999, 2000, 2001, 2004, 2005, 2006, 2014, 2017 Regents of University of Michigan. All Rights Reserved.
]]
[2020-04-02T09:15:09.696540+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: Starting up the OiD Server, on node <HOSTNAME-1>
[2020-04-02T09:15:09.697257+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: Oid Server Connected to DB store via OIDDB connect string.
[2020-04-02T09:15:09.697714+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: OiD LDAP server started.
...............
...............
[2020-04-02T09:15:09.413066+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] gslarpsbPsearchListener: Connecting to remote communication port succeeded to PID 23182
[2020-04-02T09:15:09.429173+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] gslarpsbPsearchListener: Received remote port from PID <PID>
[2020-04-02T09:15:09.961964+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] gslarpsbPsearchListener: Received remote port from PID <PID>
[2020-04-02T09:15:09.503220+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] gslarpsbPsearchListener: Received remote port from PID <PID>
[2020-04-02T09:15:09.405513+00:00] [OID] [ERROR:8] [23207] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: In gsldhacHACallback, HA Callback Event
Thread Id: 16
Event type: 0
HA Source: <OCI_HA_INSTANCE>
Host name: <DATABASE-HOSTNAME>
Database name: <OID-DATABASE-NAME>
Instance name: <DB-INSTANCE-NAME>
Timestamp: 02-APR-20 11.51.46 AM +00:00
Service name: <DB-SERVICE-NAME>
HA status: UP
[2020-04-02T09:15:09.410436+00:00] [OID] [ERROR:8] [23207] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: [2020-04-02T10:51:46.410472+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: Recieved signal = 11, shutting down
[2020-04-02T09:15:09.410436+00:00] [OID] [ERROR:8] [23207] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: [2020-04-02T10:51:46.410472+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: Recieved signal = 11, shutting down
OID crashing intermittently with below stack dmp:
Dumping stack trace for OIDLDAPD (server) ...
calling caller argument values in hex
location (? means dubious value)
--------------------------------------------------------------------
gslusdsDumpStack() __sighandler() arg#1: ???? value=00000000 (ptr)
__sighandler() lwsfdsev() arg#1: ???? value=B1FCA1F8 (ptr)
lwsfdsev() lwsfdlv() arg#1: ???? value=00000000 (ptr)
lwsfdlv() lsfdlv() arg#1: ???? value=00000000 (ptr)
lsfdlv() lsfpv() arg#1: ???? value=00000000 (ptr)
lsfpv() gslusltLogTraceWithMsgId() arg#1: ???? value=00000000 (ptr)
gslusltLogTraceWithMsgId()gsldhacHACallback() arg#1: ???? value=00000000 (ptr)
gsldhacHACallback() kpueincbks() arg#1: ???? value=00000000 (ptr)
kpueincbks() kpuencb() arg#1: ???? value=00000000 (ptr)
kpuencb() kpueONSCallback() arg#1: ???? value=00000000 (ptr)
kpueONSCallback() ons_subscriber_onethreadcb() arg#1: ???? value=00000000 (ptr)
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
Symptoms |
Cause |
Solution |
References |