OID 12c Intermittent oidldapd Processes Crash:Recieved signal = 11, shutting down. Stack Log (.dmp) Relevant Function: "gslsmukUpdateTopOp"
(Doc ID 2859582.1)
Last updated on APRIL 01, 2022
Applies to:
Oracle Internet Directory - Version 12.2.1.3.0 and laterInformation in this document applies to any platform.
Symptoms
Oracle Internet Directory (OID) 12c oidldapd crashes sometimes / intermittently.
After the event, clients ldap connections fail.
OID ldap server log shows:
[2021-06-09T09:23:59.677901+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] [ecid: <ecid>] ServerWorker (WRT):[[
BEGIN
ConnID:55150 mesgID:132148 OpID:132147 OpName:modify ConnIP:<IP address:port> ConnDN:<DN>
Recieved signal = 11, shutting down
BEGIN
ConnID:55150 mesgID:132148 OpID:132147 OpName:modify ConnIP:<IP address:port> ConnDN:<DN>
Recieved signal = 11, shutting down
Or it may occur during (custom) plugin(s) execution, for example:
Jun 08, 2021 11:50:46 PM java.util.logging.LogManager$RootLogger log
INFO: <plugin name> logger
Jun 09, 2021 9:23:59 AM java.util.logging.LogManager$RootLogger log
INFO: <plugin name> logger
[2021-06-09T09:23:59.677901+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] [ecid: <ecid>] ServerWorker (WRT):[[
BEGIN
ConnID:55150 mesgID:132148 OpID:132147 OpName:modify ConnIP:<IP address:port> ConnDN:<DN>
Recieved signal = 11, shutting down
END
]]
[2021-06-09T09:23:59.694661+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: WARNING : ServerController : Processing shutdown notification
INFO: <plugin name> logger
Jun 09, 2021 9:23:59 AM java.util.logging.LogManager$RootLogger log
INFO: <plugin name> logger
[2021-06-09T09:23:59.677901+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] [ecid: <ecid>] ServerWorker (WRT):[[
BEGIN
ConnID:55150 mesgID:132148 OpID:132147 OpName:modify ConnIP:<IP address:port> ConnDN:<DN>
Recieved signal = 11, shutting down
END
]]
[2021-06-09T09:23:59.694661+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: WARNING : ServerController : Processing shutdown notification
In the dispatch log file (oiddispd01-xxx.log) the following appears (it seems to kill all ldap processes and itself):
[2021-06-09T09:23:59.923618+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] ProcessDispatcher: WARNING : Got Shutdown notification from the server PID <pid>
[2021-06-09T09:24:04.928302+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] ProcessDispatcher: Force killing server PID <pid>
[2021-06-09T09:24:20.236379+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: Sent SIGTERM to process id = <pid>
[2021-06-09T09:24:20.236555+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: Sent SIGTERM to process id = <pid>
[2021-06-09T09:24:20.236601+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: Sent SIGTERM to process id = <pid>
[2021-06-09T09:24:20.737163+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: Killed process pid = <pid>
[2021-06-09T09:24:20.737296+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: Killed process pid = <pid>
[2021-06-09T09:24:20.737324+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: Killed process pid = <pid>
[2021-06-09T09:24:20.737990+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: WARNING : DispatcherController : OiD LDAP server exiting with status -1
[2021-06-09T09:24:04.928302+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] ProcessDispatcher: Force killing server PID <pid>
[2021-06-09T09:24:20.236379+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: Sent SIGTERM to process id = <pid>
[2021-06-09T09:24:20.236555+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: Sent SIGTERM to process id = <pid>
[2021-06-09T09:24:20.236601+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: Sent SIGTERM to process id = <pid>
[2021-06-09T09:24:20.737163+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: Killed process pid = <pid>
[2021-06-09T09:24:20.737296+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: Killed process pid = <pid>
[2021-06-09T09:24:20.737324+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: Killed process pid = <pid>
[2021-06-09T09:24:20.737990+02:00] [OID] [NOTIFICATION:16] [] [OIDLDAPD] [host: <hostname>] [pid: <pid>] [tid: <tid>] Main:: WARNING : DispatcherController : OiD LDAP server exiting with status -1
The oidctl.log shows:
[2021-06-09T09:24:00.767469+02:00] [OID] [NOTIFICATION:16] [] [] [host: <hostname>] [pid: <pid>] [tid: <tid>] OIDCTL:: gsldcnGetSesAndPID_exit: Ora-1403 : ORA-01403: no data found
The nodemanager then restarts the OID processes:
<Jun 9, 2021 9:24:20 AM CEST> <INFO> <Instance oid1 has changed state from RUNNING to STOPPED>
...
<Jun 9, 2021 9:24:39 AM CEST> <INFO> <Domain> <oid1> <The server 'oid1' is running now.>
...
<Jun 9, 2021 9:24:39 AM CEST> <INFO> <Domain> <oid1> <The server 'oid1' is running now.>
The corresponding stack log (oidldapd_stack00_<pid>.dmp) shows:
Changes
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Changes |
| Cause |
| Solution |
| References |