OBIEE 11g: The OBI Server (nqsserver) Crashes|Core Dumps When Running An Analysis With A Huge Data Set (Doc ID 2106037.1)

Last updated on SEPTEMBER 28, 2016

Applies to:

Business Intelligence Server Enterprise Edition - Version 11.1.1.7.140415 and later
Information in this document applies to any platform.

Symptoms

The BI Server(nqsserver process) crashes when running reports that has huge data set.

The following Errors appear in the log file:

  [2016-02-06T00:16:35+09:00] [opmn] [WARNING:1] [660] [pm-process] Process Crashed: coreapplication_obis1~OracleBIServerComponent~coreapplication_obis1~1 (799576344:2524) - Restarting
  [2016-02-06T00:16:35+09:00] [opmn] [NOTIFICATION:1] [662] [pm-process] Starting Process: coreapplication_obis1~OracleBIServerComponent~coreapplication_obis1~1 (799576347:0)


In this specific case, there are two GDB stack traces of core files as follows:

 

  

Program terminated with signal 11, Segmentation fault.
(gdb) where
#0  KeyDesc::WideVarCharCompare (keyDesc=0x7f84d38ad618, field1=<value optimized out>, field2=0x0, null1=0x7f84e11f8078 "\004", null2=0x0)
    at server/Utility/Server/DataType/SUCompareType.cpp:740
#1  0x00007f875c9d4cee in KeySet::Compare (this=0x7f866ee1acc8, rec1=0x7f84e11f8078 "\004", rec2=0x0)
    at server/Utility/Server/DataType/SUKeyCompare.cpp:514
#2  0x00007f875c9c7b64 in InsertSet::InsertMergeSet (this=0x7f81d4994068, arg=<value optimized out>)
    at server/include/Utility/Generic/Portable/SUPHeapOwner.h:187
#3  0x00007f875c9c99c0 in SquareRootInsertMerger::PrepareForRetrieve (this=0x7f84d4c88490, maxBufferSize=164)
    at server/include/Utility/Generic/Portable/SUPHeapOwner.h:187
#4  0x00007f875c9cf57b in SqrtSorter::EndInput (this=0x7f84cf33d590) at server/include/Utility/Generic/Portable/SUPHeapOwner.h:116
#5  0x00007f87618965ea in NQSort::InitCursor (this=0x7f84dfb68cd0) at server/Query/Execution/List/Src/SQXNQSort.cpp:239
#6  0x00007f8761887348 in Producer::ExecuteOnce (this=0x7f84bae64000) at server/Query/Execution/List/Src/SQXNQExchange.cpp:563
#7  0x00007f875cbe37a5 in NQExecutionState::ExecuteSystemMain (this=0x7f852c216010)
    at server/Utility/Generic/NQThreads/SUGExecutionState.cpp:91
#8  0x00007f875cc274c1 in NQThreadJobBase::ExecuteSystemMain (this=0x7f852c216010) at server/Utility/Generic/NQThreads/SUGThreadJob.cpp:150
#9  0x00007f875cc28c94 in operator() (this=0x7f875037e810) at server/include/Utility/Generic/SUGRefCnt.h:128
#10 PoolThread::ExecuteUserMain (this=0x7f875037e810) at server/Utility/Generic/NQThreads/SUGThreadServerPool.cpp:474
#11 0x00007f875cbe37a5 in NQExecutionState::ExecuteSystemMain (this=0x7f875037e810)
    at server/Utility/Generic/NQThreads/SUGExecutionState.cpp:91
#12 0x00007f875cc260f9 in NQThread::ExecuteSystemMain (this=0x7f875037e810) at server/Utility/Generic/NQThreads/SUGThread.cpp:277
#13 0x00007f875cc25a1d in NQThread::ThreadMainEntry (pNQThread=0x7f875037e810) at server/Utility/Generic/NQThreads/SUGThread.cpp:252
#14 0x00000038c34079d1 in start_thread () from /lib64/libpthread.so.0
#15 0x00000038c2ce88fd in clone () from /lib64/libc.so.6

 

 

  

Program terminated with signal 6, Aborted.
(gdb) where
#0  0x0000003544e32625 in raise () from /lib64/libc.so.6
#1  0x0000003544e33d8d in abort () from /lib64/libc.so.6
#2  0x00000035516bea5d in __gnu_cxx::__verbose_terminate_handler() () from /usr/lib64/libstdc++.so.6
#3  0x00000035516bcbe6 in ?? () from /usr/lib64/libstdc++.so.6
#4  0x00000035516bcc13 in std::terminate() () from /usr/lib64/libstdc++.so.6
#5  0x00000035516bcc26 in ?? () from /usr/lib64/libstdc++.so.6
#6  0x00000035516bc2b3 in __cxa_call_unexpected () from /usr/lib64/libstdc++.so.6
#7  0x00007f0535674679 in SqrtSorter::SortRecord (this=0x7eff638e9150, record=0x7eff3aec47a0 "9")
    at server/Utility/Server/Sort/SUSqrtSorter.cpp:203
#8  0x00007f053a53b56c in NQSort::InitCursor (this=0x7efef7749710) at server/Query/Execution/List/Src/SQXNQSort.cpp:226
#9  0x00007f053a52c348 in Producer::ExecuteOnce (this=0x7efefbab2010) at server/Query/Execution/List/Src/SQXNQExchange.cpp:563
#10 0x00007f05358887a5 in NQExecutionState::ExecuteSystemMain (this=0x7efef74a4540)
    at server/Utility/Generic/NQThreads/SUGExecutionState.cpp:91
#11 0x00007f05358cc4c1 in NQThreadJobBase::ExecuteSystemMain (this=0x7efef74a4540) at server/Utility/Generic/NQThreads/SUGThreadJob.cpp:150
#12 0x00007f05358cdc94 in operator() (this=0x7f0529022810) at server/include/Utility/Generic/SUGRefCnt.h:128
#13 PoolThread::ExecuteUserMain (this=0x7f0529022810) at server/Utility/Generic/NQThreads/SUGThreadServerPool.cpp:474
#14 0x00007f05358887a5 in NQExecutionState::ExecuteSystemMain (this=0x7f0529022810)
    at server/Utility/Generic/NQThreads/SUGExecutionState.cpp:91
#15 0x00007f05358cb0f9 in NQThread::ExecuteSystemMain (this=0x7f0529022810) at server/Utility/Generic/NQThreads/SUGThread.cpp:277
#16 0x00007f05358caa1d in NQThread::ThreadMainEntry (pNQThread=0x7f0529022810) at server/Utility/Generic/NQThreads/SUGThread.cpp:252
#17 0x00000035456079d1 in start_thread () from /lib64/libpthread.so.0
#18 0x0000003544ee88fd in clone () from /lib64/libc.so.6

 

If you are encountering the same symptoms, then ensure your GDB stack traces match the above stack traces to ensure the solution is correct for you.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms