How to fix "Too many in Long Time Queue" crashes on pod (Doc ID 2994398.1)

Last updated on JANUARY 30, 2024

Applies to:

Goal

MySQL NDB Cluster Data node crashes with "Error data: Too many in Long Time Queue":

Time: Friday 13 October 2023 - 07:29:31
Status: Temporary error, restart node
Message: Error in long time queue (Internal error, programming error or missing error message, please report a bug)
Error: 2336
Error data: Too many in Long Time Queue
Error object: mt.cpp
Program: ndbmtd
Pid: 1 thr: 7
Version: mysql-8.0.34 ndb-8.0.34
Trace file name: ndb_3_trace.log.1_t7
Trace file path: /var/lib/ndb/data/ndb_3_trace.log.1 [t1..t9]
***EOM***

These events may be also written into the Data node out log:

2023-10-16 19:53:10 [ndbd] INFO -- End Ndbd_mem_manager::dump
For help with below stacktrace consult:
https://dev.mysql.com/doc/refman/en/using-stack-trace.html
Also note that stack_bottom and thread_stack will always show up as zero.
stack_bottom = 0 thread_stack 0x0
/usr/sbin/ndbmtd(my_print_stacktrace(unsigned char const*, unsigned long)+0x41) [0x8ead11]
/usr/sbin/ndbmtd(ErrorReporter::handleError(int, char const*, char const*, NdbShutdownType)+0x33) [0x83ee33]
/usr/sbin/ndbmtd(senddelay(unsigned int, SignalHeader const*, unsigned int)+0x2b5) [0x8dafd5]
/usr/sbin/ndbmtd(Dbspj::releaseGlobal(Signal*)+0x16a) [0x67dfaa]
/usr/sbin/ndbmtd(SimulatedBlock::executeFunction_async(unsigned short, Signal*)+0x61) [0x8d7b21]
/usr/sbin/ndbmtd() [0x8d7e7f]
/usr/sbin/ndbmtd() [0x8dd016]
/usr/sbin/ndbmtd(mt_job_thread_main+0x4b9) [0x8e3089]
/usr/sbin/ndbmtd() [0x8a6f9a]
/lib64/libpthread.so.0(+0x81da) [0x7fe4fb00a1da]
/lib64/libc.so.6(clone+0x43) [0x7fe4f97bce73]
2023-10-16 19:53:17 [ndbd] INFO -- Too many in Long Time Queue
2023-10-16 19:53:17 [ndbd] INFO -- mt.cpp
2023-10-16 19:53:17 [ndbd] INFO -- Error handler shutting down system
2023-10-16 19:53:17 [ndbd] INFO -- Error handler shutdown completed - exiting

Solution

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.