MetaSolv Solution Core Dump; Unexpected Signal : 11 (Doc ID 1118678.1)

Last updated on NOVEMBER 09, 2016

Applies to:

Oracle Communications MetaSolv Solution - Version 6.0.16 and later
Information in this document applies to any platform.
***Checked for relevance on 28-Jun-2013***
***Checked for relevance on 07-Jan-2015***

Symptoms

The WebLogic server where MetaSolv Solution is deployed intermittently crashes and produces a core dump after 30 to 45 minutes of running. Occasionally, the error occurs at startup.

Below is the content from the Hotspot Error log (hs_err_pidXXXX.log):

Unexpected Signal : 11 occurred at PC=0xFEFD5EA0
Function=[Unknown. Nearest: AsyncGetCallTrace+0x4E474]
Library=/opt/m6prod_int/bea/jdk142_08/jre/lib/sparc/server/libjvm.so

Current Java thread:
at COM.ibm.db2.jdbc.app.DB2PreparedStatement.SQLBindChar(Native Method)
at COM.ibm.db2.jdbc.app.DB2PreparedStatement.execute2(DB2PreparedStatement.java:1858)
- locked <0x89c777a0> (a COM.ibm.db2.jdbc.app.DB2ReusableConnection)
at COM.ibm.db2.jdbc.app.DB2PreparedStatement.execute(DB2PreparedStatement.java:3845)
at weblogic.jdbc.wrapper.PreparedStatement.execute(PreparedStatement.java:102)
at com.bea.wlw.runtime.core.control.DatabaseControlImpl.invoke(DatabaseControlImpl.jcs:2644)
at com.bea.wlw.runtime.core.dispatcher.DispMethod.invoke(DispMethod.java:377)
at com.bea.wlw.runtime.core.container.Invocable.invoke(Invocable.java:433)
at com.bea.wlw.runtime.core.container.Invocable.invoke(Invocable.java:406)
at com.bea.wlw.runtime.jcs.container.JcsProxy.invoke(JcsProxy.java:388)
at $Proxy13.getLocalProductInfo(Unknown Source)
at ProcessStarsSystem.ProcessStars_v2.constructLineAndPICDetails(ProcessStars_v2.jpd:335)
at ProcessStarsSystem.ProcessStars_v2_wf$ImplPerform16.invoke(ProcessStars_v2_wf.java:153)
at com.bea.wli.bpm.runtime.Perform.execute(Perform.java:32)
at com.bea.wli.bpm.runtime.Receive.messageDelivery(Receive.java:91)
at com.bea.wli.bpm.runtime.Receive.messageDeliveryAction(Receive.java:71)
at com.bea.wli.bpm.runtime.ProcessState.processMessage(ProcessState.java:176)
at ProcessStarsSystem.ProcessStars_v2_wf$_ProcessState.processMessage(ProcessStars_v2_wf.java:467)
at ProcessStarsSystem.ProcessStars_v2_wf.subscription(ProcessStars_v2_wf.java:447)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:324)
at com.bea.wlw.runtime.core.dispatcher.DispMethod.invoke(DispMethod.java:371)
at com.bea.wlw.runtime.core.container.Invocable.invoke(Invocable.java:433)
at com.bea.wlw.runtime.core.container.Invocable.invoke(Invocable.java:406)
at com.bea.wlw.runtime.core.container.Invocable.invoke(Invocable.java:249)
at com.bea.wlw.runtime.core.bean.BaseContainerBean.invokeBase(BaseContainerBean.java:224)
at com.bea.wlw.runtime.core.bean.SLSBContainerBean.invoke(SLSBContainerBean.java:109)
at com.bea.wlwgen.ProcessStarsSLSBContImpl.subscription(ProcessStarsSLSBContImpl.java:35)
at com.bea.wlwgen.StatelessContainer_viwwpp_ELOImpl.subscription(StatelessContainer_viwwpp_ELOImpl.java:207)
at com.bea.wlwgen.ProcessStarsSLSBContAdpt.invokeOnBean(ProcessStarsSLSBContAdpt.java:65)
at com.bea.wlw.runtime.core.bean.BaseDispatcherBean.runAsInvoke(BaseDispatcherBean.java:153)
at com.bea.wlw.runtime.core.bean.BaseDispatcherBean.invoke(BaseDispatcherBean.java:54)
at com.bea.wlw.runtime.core.bean.AsyncDispatcherBean.onMessage(AsyncDispatcherBean.java:248)
at weblogic.ejb20.internal.MDListener.execute(MDListener.java:400)
at weblogic.ejb20.internal.MDListener.transactionalOnMessage(MDListener.java:333)
at weblogic.ejb20.internal.MDListener.onMessage(MDListener.java:298)
at weblogic.jms.client.JMSSession.onMessage(JMSSession.java:2686)
at weblogic.jms.client.JMSSession.execute(JMSSession.java:2598)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:224)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:183)

Dynamic libraries:
0x10000 /opt/m6prod_int/bea/jdk142_08/jre/bin/java
0xff370000 /usr/lib/lwp/libthread.so.1
0xff3fa000 /usr/lib/libdl.so.1
0xff280000 /usr/lib/libc.so.1
0xff3a0000 /usr/platform/SUNW,Sun-Fire-V490/lib/libc_psr.so.1
0xfec00000 /opt/m6prod_int/bea/jdk142_08/jre/lib/sparc/server/libjvm.so
0xff240000 /usr/lib/libCrun.so.1
0xff220000 /usr/lib/libsocket.so.1
0xfeb00000 /usr/lib/libnsl.so.1
0xfeab0000 /usr/lib/libm.so.1
0xfebe0000 /usr/lib/libsched.so.1
0xfebc0000 /usr/lib/libmp.so.2
0xfea80000 /opt/m6prod_int/bea/jdk142_08/jre/lib/sparc/native_threads/libhpi.so
0xfea50000 /opt/m6prod_int/bea/jdk142_08/jre/lib/sparc/libverify.so
0xfea00000 /opt/m6prod_int/bea/jdk142_08/jre/lib/sparc/libjava.so
0xfe9e0000 /opt/m6prod_int/bea/jdk142_08/jre/lib/sparc/libzip.so
0x597d0000 /opt/m6prod_int/bea/jdk142_08/jre/lib/sparc/libnet.so
0x596b0000 /opt/m6prod_int/bea/weblogic81/server/lib/solaris/libweblogicunix1.so
0x59590000 /opt/m6prod_int/bea/jdk142_08/jre/lib/sparc/libnio.so
0x59570000 /usr/lib/librt.so.1
0x59540000 /usr/lib/libaio.so.1
0x59520000 /usr/lib/libmd5.so.1
0x58fe0000 /usr/lib/libsendfile.so.1
0x597a0000 /opt/m6prod_int/bea/jdk142_08/jre/lib/sparc/libioser12.so
0x59690000 /opt/m6prod_int/bea/jdk142_08/jre/lib/ext/sparc/libjbroker12.so
0x58fc0000 /usr/lib/libdoor.so.1
0x58ad0000 /opt/IBM/db2/V8.1/lib/libdb2jdbc.so.1
0x4e800000 /opt/IBM/db2/V8.1/lib/libdb2.so.1
0x4f600000 /opt/IBM/db2/V8.1/lib/libdb2g11n.so.1
0x58720000 /usr/lib/libresolv.so.2
0x58d10000 /opt/IBM/db2/V8.1/lib/libdb2install.so.1
0x58aa0000 /opt/IBM/db2/V8.1/lib/libdb2locale.so.1
0x4e580000 /opt/IBM/db2/V8.1/lib/libdb2osse.so.1
0x58330000 /opt/IBM/db2/V8.1/lib/libdb2genreg.so.1
0x58860000 /opt/IBM/db2/V8.1/lib/libdb2trcapi.so.1
0x58300000 /opt/IBM/db2/V8.1/lib/libdb2dascmn.so.1
0x58460000 /usr/lib/libpthread.so.1
0x57be0000 /usr/lib/libkstat.so.1
0x57bc0000 /usr/lib/libkvm.so.1
0x577d0000 /opt/IBM/db2/V8.1/lib/libdb2osse_db2.so.1
0x573d0000 /usr/lib/libelf.so.1
0x571d0000 /export/home/db2inst1/sqllib/lib32/icc/icclib/libicclib.so
0x4e400000 /export/home/db2inst1/sqllib/lib32/icc/osslib/libcrypto.so.0.9.7
0x57ba0000 /export/home/db2inst1/sqllib/security32/plugin/IBM/client/IBMOSauthclient.so
0x577b0000 /usr/platform/SUNW,Sun-Fire-V490/lib/libmd5_psr.so.1
0x571b0000 /usr/lib/nss_files.so.1
0x3f6c0000 /opt/m6prod_int/bea/weblogic81/server/lib/solaris/libstackdump.so
0x30700000 /opt/m6prod_int/bea/jdk142_08/jre/lib/sparc/libawt.so
0x38300000 /opt/m6prod_int/bea/jdk142_08/jre/lib/sparc/libmlib_image.so
0x34390000 /opt/m6prod_int/bea/jdk142_08/jre/lib/sparc/motif21/libmawt.so
0x29980000 /usr/lib/libXm.so.4
0x31110000 /usr/lib/libXt.so.4
0x3f3d0000 /usr/lib/libXext.so.0
0x3f6a0000 /usr/lib/libXtst.so.1
0x2f700000 /usr/lib/libX11.so.4
0x3eba0000 /usr/openwin/lib/libdps.so.5
0x3f3b0000 /usr/lib/libSM.so.6
0x3e3d0000 /usr/lib/libICE.so.6
0x3f390000 /opt/m6prod_int/bea/weblogic81/server/lib/solaris/libmuxer.so
0x3e3b0000 /usr/ucblib/libucb.so.1

Heap at VM Abort:
Heap
def new generation total 174720K, used 72787K [0x59800000, 0x664c0000, 0x73190000)
eden space 139776K, 38% used [0x59800000, 0x5cca9c48, 0x62080000)
from space 34944K, 53% used [0x642a0000, 0x6550b200, 0x664c0000)
to space 34944K, 0% used [0x62080000, 0x62080000, 0x642a0000)
tenured generation total 838912K, used 531656K [0x73190000, 0xa64d0000, 0xd9800000)
the space 838912K, 63% used [0x73190000, 0x938c2140, 0x938c2200, 0xa64d0000)
compacting perm gen total 262144K, used 120219K [0xd9800000, 0xe9800000, 0xf9800000)
the space 262144K, 45% used [0xd9800000, 0xe0d66f98, 0xe0d67000, 0xe9800000)

Local Time = Tue Jun 1 13:06:51 2010
Elapsed Time = 2903
#
# HotSpot Virtual Machine Error : 11
# Error ID : 4F530E43505002EF 01
# Please report this error at
# http://java.sun.com/cgi-bin/bugreport.cgi
#
# Java VM: Java HotSpot(TM) Server VM (1.4.2_08-b03 mixed mode)
#
# An error report file has been saved as hs_err_pid26723.log.
# Please refer to the file for further information.
#
/opt/m6prod_int/integration/startMSLVsingle.sh[62]: 26723 Abort(coredump)

Heap at VM Abort:
Heap
def new generation total 174720K, used 40856K [0x59800000, 0x664c0000, 0x73190000)
eden space 139776K, 20% used [0x59800000, 0x5b38e048, 0x62080000)
from space 34944K, 36% used [0x62080000, 0x62cd82c0, 0x642a0000)
to space 34944K, 0% used [0x642a0000, 0x642a0000, 0x664c0000)
tenured generation total 838912K, used 459326K [0x73190000, 0xa64d0000, 0xd9800000)
the space 838912K, 54% used [0x73190000, 0x8f21fb50, 0x8f21fc00, 0xa64d0000)
compacting perm gen total 262144K, used 100442K [0xd9800000, 0xe9800000, 0xf9800000)
the space 262144K, 38% used [0xd9800000, 0xdfa16990, 0xdfa16a00, 0xe9800000)

Local Time = Tue Jun 1 14:47:44 2010
Elapsed Time = 578
#
# The exception above was detected in native code outside the VM
#
# Java VM: Java HotSpot(TM) Server VM (1.4.2_08-b03 mixed mode)
#
# An error report file has been saved as hs_err_pid2330.log.
# Please refer to the file for further information.
#


Changes

The domain has a custom JDBC connection pool that connects to a DB2 database for integration purposes. The core dumps started to occur after upgrading the DB2 client on the Sun Solaris 9 machine from V7.1 to V8.1. 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms