DS 5.x Hangs Frequently During Static Group Modifications (Doc ID 1329429.1)

Symptoms

The Directory Server will hang (ie. Not serving connection, replication halted, etc..) while the server modifies a large static group.  The modification can take several minutes and depends on the size of the static group.  Once the modified of the group completes, the server will start responding to requests again.

The following log snippet is an example of what may be observed in the logs when this issue occurs:

[08/Jun/2011:13:41:58 +0100] conn=628833 op=6 msgId=7 - MOD dn="uid=<UID>,ou=people,dc=<SUFFIX>"
[08/Jun/2011:13:44:16 +0100] conn=628882 op=-1 msgId=-1 - fd=363 slot=363 LDAPS connection from <IP_ADD> to <IP_ADD2>
[08/Jun/2011:13:44:16 +0100] conn=628882 op=-1 msgId=-1 - fd=365 slot=365 LDAPS connection from <IP_ADD> to <IP_ADD2>
[08/Jun/2011:13:44:16 +0100] conn=628882 op=-1 msgId=-1 - fd=367 slot=367 LDAPS connection from <IP_ADD> to <IP_ADD2>
[08/Jun/2011:13:44:16 +0100] conn=628882 op=-1 msgId=-1 - fd=369 slot=369 LDAPS connection from <IP_ADD> to <IP_ADD2>
...

Also, if pstacks are collected when the server is not responding, it will be observed that the server spending time in the dn normalization routines.  Below is an example of such a pstack:

-----------------  lwp# 111 / thread# 111  --------------------
  ffffffff7ee6e574 slapi_attr_basetype (10513c140, ffffffff64d1da30, 100, ffffffff64d1dce0, 13e86c, 1  001bd7e0) + 40 ffffffff7eeaf244 attr_syntax_get_by_name_plugin (10513c140,  ffffffff64d1dc00, ffffffff64d1dc10, fff  fffff64d1dc0c, 0, ffffffff7efeda88) + 2c
  ffffffff7ee72f38 normalize_ava_cb (0, ffffffff64d1dde8, ffffffff64d1dce8, ffffffff64d1dce0, 0, 1001  bd7e0) + 90
  ffffffff7ee73340 dn_normalize_set_rdn (133c91540, ffffffff64d1dde8, ffffffff7ee72ea8, 0, 1001bd7e0,   0) + 14
  ffffffff7ee74bd0 ldap_dn_normalize_count (ffffffff64d1e3a8, ffffffff64d1dde8, ffffffff7efeda88, 0,   ffffffff64d1e038, 1001bd7e0) + 200
  ffffffff7ee750d4 slapi_dn_strict_normalize (ffffffff64d1e3a8, ffffffff64d1e860, ffffffff6ffffffff64d1e3a8, 1, ffffffff7effe018, 0, 64, 19c7  e47f5) + 4
  ffffffff7920739c ???????? (ffffffff64d1e878, ffffffff64d1e860, ffffffff64d1e858, 0, ffffffff64d1e87  8, 1a40baa00)
  ffffffff79207484 ???????? (ffffffff64d1e860, ffffffff64d1e890, ffffffff64d1e890, a3, 0, ffffffff792  07438)
  ffffffff7ee8ade0 plugin_call_syntax_filter_ava_sv (ffffffff64d1e8a0, a3,  ffffffff64d1e858, 0, 0, 1a  40baa00) + 1c0
  ffffffff7ee6e7c8 slapi_attr_value_cmp (190ba0de0, 116450940, 1919cc8b0, 4, 1a40bc850, 129ef9db8) +  6c
  ffffffff7eead0a0 valuearray_find (190ba0de0, 12e5b0070, 116450940, 4def62e1, 4def62e3, 191db0070) +   30
  ffffffff7eeae8e4 valueset_update_csn_for_valuearray (190ba0de8, 190ba0de0, 19c420070, 4, 1a40bc850, 129ef9db8) + 354
  ffffffff7eeab0b4 entry_add_present_values_wsi (1b93c7540, 14ed38d80, 176550070, 1a40bc850, 1, 0) + c0
  ffffffff7eeab6e0 entry_replace_present_values_wsi (1b93c7540, 14ed38d80, 176550070, 1a40bc850, 1, 0) + 40
  ffffffff7eeab8cc entry_apply_mod_wsi (1b93c7540, 17bcc7270, 1a40bc850, 0, 2, 1052fa200) + 1bc
  ffffffff7eeabac4 entry_apply_mods_wsi_internal (1b93c7540, ffffffff64d1eed8, 0, 8, 0, 3248) + ac
  ffffffff76e61064 ldbm_back_modify_try (153d328c0, ffffffff64d1f05c, 0, ffffffff64d1f048, ffffffff64d1f040, 0) + 2ec
  ffffffff76e617ac ldbm_back_modify (153d328c0, 1003f13d8, 1003cac20, 1, 10fa9c, 1003f13d8) + 184 ffffffff7eeb5518 op_shared_modify (153d328c0, 0, 0,  0, 0, 0) + 588
  ffffffff7eeb4f1c modify_internal_pb (153d328c0, 138d14, ffffffff64d1f7d4, 0, 1, 1) + 1ac
  ffffffff76c31890 ???????? (16fbb3e78, 16fbb3e78, 153d39ee8, 997c4, 0, 2)
  ffffffff76c31c38 repl_trs_group_parse (153d32d68, 16fbb3e78, 2, 14af7c, 1, 0) + 218
  ffffffff76c26e18 repl_trs_extop_update_req (153d32d68, 4, 4, ffffffff76d8d550, ffffffff76d89610, ff  ffffff76c26cb0) + 168
  ffffffff7ee85404 plugin_call_exop_plugins (153d32d68, 15a1f8e70, ffffffff7efeda88, ffffffff7f021e38  , 38, 101010101010101) + cc
  ffffffff7ec2ee2c extended_core_pb (153d32d68, 1400, 1478, 1001c6380, 1001c6381, 19) + 234
  ffffffff7ec3cc6c dispatch_operation_core_pb (153d32d68, 153d32d68, 1000, 1010, ffffffff, 81) + 158
  ffffffff7ec27868 process_ldap_operation_using_core_api (ffffffff69805260, 153d3a670, 109, 77, 2, 1) + 188
  ffffffff7ec27b74 ldap_frontend_main_using_core_api (ffffffff69805260, 153d3a670, 2, 100ed08d8, 12e980070, ffffffff7ed56914) + fc
  ffffffff7ec28bbc generic_workerthreadmain (0, 0, 228, 0, 1, ffffffff69803840) + a4
  ffffffff7d634bf8 _pt_root (1002639f0, 1, 10958c, ffffffff7d741ef8, 3, 0) + d0
  ffffffff7f1d6488 _lwp_start (0, 0, 0, 0, 0, 0)

NOTE: The server can also be observed spending time in the DN Normalization functions during an LDAP modify:

normalize_ava_cb ()
dn_normalize_set_rdn ()
ldap_dn_normalize_count ()
slapi_dn_strict_normalize ()

Check if the user is a member of a large static group.

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.