My Oracle Support Banner

OID 12c: OID instance crashes intermittently with gsldhacHACallback Event error (Doc ID 2685549.1)

Last updated on JULY 06, 2020

Applies to:

Oracle Internet Directory - Version 12.2.1.3.0 and later
Information in this document applies to any platform.

Symptoms

OID version: 12.2.1.3.0

OID service going down intermittently and noticed below error in node manager and OID logs.

Nodemanager log:
<Apr 2, 2020 9:15:09 AM GMT> <INFO> <Instance <OID-COMPONENT-2> has changed state from RUNNING to STOPPED>
<Apr 2, 2020 9:15:09 AM GMT> <INFO> <IDM-DOMAIN-NAME> <OID-COMPONENT-2> <The server '<OID-COMPONENT-2>' with process id <PID> is no longer alive; waiting for the process to die.>
<Apr 2, 2020 9:15:09 AM GMT> <INFO> <The server '<OID-COMPONENT-2>' with process id <PID> is no longer alive; waiting for the process to die.>
<Apr 2, 2020 9:15:09 AM GMT> <INFO> <Instance <OID-COMPONENT-2> has changed state from STOPPED to RUNNING>
<Apr 2, 2020 9:15:09 AM GMT> <INFO> <IDM-DOMAIN-NAME> <OID-COMPONENT-2> <Server failed so attempting to restart (restart count = 2)>
<Apr 2, 2020 9:15:10 AM GMT> <WARNING> <Cannot start instance <OID-COMPONENT-2>. It is still alive.>
<Apr 2, 2020 9:15:10 AM GMT> <INFO> <IDM-DOMAIN-NAME> <OID-COMPONENT-2> <The server '<OID-COMPONENT-2>' is running now.>
<Apr 2, 2020 9:17:25 AM GMT> <INFO> <Instance <OID-COMPONENT-2> has changed state from RUNNING to STOPPED>

 

oidldapd logs with debug enabled:

[2020-04-02T09:15:09.696475+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [<TID>: <TID>] Main::[[
oidldapd: Release 12.2.1.3.0 - Production on wed apr 1 10:13:37 2020
Copyright (c) 1982, 2017 Oracle. All rights reserved.
Portions Copyright (c) 1992-1996, 1999, 2000, 2001, 2004, 2005, 2006, 2014, 2017 Regents of University of Michigan. All Rights Reserved.
]]
[2020-04-02T09:15:09.696540+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: Starting up the OiD Server, on node <HOSTNAME-1>
[2020-04-02T09:15:09.697257+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: Oid Server Connected to DB store via OIDDB connect string.
[2020-04-02T09:15:09.697714+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: OiD LDAP server started.
...............
...............
[2020-04-02T09:15:09.413066+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] gslarpsbPsearchListener: Connecting to remote communication port succeeded to PID 23182
[2020-04-02T09:15:09.429173+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] gslarpsbPsearchListener: Received remote port from PID <PID>
[2020-04-02T09:15:09.961964+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] gslarpsbPsearchListener: Received remote port from PID <PID>
[2020-04-02T09:15:09.503220+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] gslarpsbPsearchListener: Received remote port from PID <PID>
[2020-04-02T09:15:09.405513+00:00] [OID] [ERROR:8] [23207] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: In gsldhacHACallback, HA Callback Event
Thread Id: 16
Event type: 0
HA Source: <OCI_HA_INSTANCE>
Host name: <DATABASE-HOSTNAME>
Database name: <OID-DATABASE-NAME>
Instance name: <DB-INSTANCE-NAME>
Timestamp: 02-APR-20 11.51.46 AM +00:00
Service name: <DB-SERVICE-NAME>
HA status: UP
[2020-04-02T09:15:09.410436+00:00] [OID] [ERROR:8] [23207] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: [2020-04-02T10:51:46.410472+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: Recieved signal = 11, shutting down
[2020-04-02T09:15:09.410436+00:00] [OID] [ERROR:8] [23207] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: [2020-04-02T10:51:46.410472+00:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <HOSTNAME-1>] [pid: <PID>] [tid: <TID>] Main:: Recieved signal = 11, shutting down

 

OID crashing intermittently with below stack dmp:

Dumping stack trace for OIDLDAPD (server) ...
calling caller argument values in hex
location (? means dubious value)
--------------------------------------------------------------------
gslusdsDumpStack() __sighandler() arg#1: ???? value=00000000 (ptr)
__sighandler() lwsfdsev() arg#1: ???? value=B1FCA1F8 (ptr)
lwsfdsev() lwsfdlv() arg#1: ???? value=00000000 (ptr)
lwsfdlv() lsfdlv() arg#1: ???? value=00000000 (ptr)
lsfdlv() lsfpv() arg#1: ???? value=00000000 (ptr)
lsfpv() gslusltLogTraceWithMsgId() arg#1: ???? value=00000000 (ptr)
gslusltLogTraceWithMsgId()gsldhacHACallback() arg#1: ???? value=00000000 (ptr)
gsldhacHACallback() kpueincbks() arg#1: ???? value=00000000 (ptr)
kpueincbks() kpuencb() arg#1: ???? value=00000000 (ptr)
kpuencb() kpueONSCallback() arg#1: ???? value=00000000 (ptr)
kpueONSCallback() ons_subscriber_onethreadcb() arg#1: ???? value=00000000 (ptr)

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.