OBIEE Servers Go Into a 'Warning' State in Admin Console And Become Unresposive (Doc ID 1588491.1)

Last updated on JANUARY 23, 2017

Applies to:

Business Intelligence Server Enterprise Edition - Version 11.1.1.5.0 BP3 and later
Information in this document applies to any platform.

Symptoms

In a clustered environment with 4 nodes, the BI servers go into a "warning" state. There are many stuck threads in an 'OK' state which is causing the servers to become unresponsive on an intermittent basis.

bi_server#.log file shows the following error when the problem is experienced:

(StuckThreadMaxTime) of "600" seconds. Stack trace:
Thread-1276 "[STUCK] ExecuteThread: '131' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, in native, suspended, priority=1, DAEMON> {
   jrockit.net.SocketNativeIO.readBytesPinned(SocketNativeIO.java:???)
   jrockit.net.SocketNativeIO.socketRead(SocketNativeIO.java:24)
   java.net.SocketInputStream.socketRead0(SocketInputStream.java:???)
   java.net.SocketInputStream.read(SocketInputStream.java:107)
   com.siebel.analytics.web.sawconnect.SAWConnection$NotifyInputStream.read(SAWConnection.java:165)
   java.io.BufferedInputStream.fill(BufferedInputStream.java:189)
   java.io.BufferedInputStream.read(BufferedInputStream.java:236)
   ^-- Holding lock: java.io.BufferedInputStream@194cfccc[thin lock]
   com.siebel.analytics.web.sawconnect.sawprotocol.SAWProtocol.readInt(SAWProtocol.java:188)
   com.siebel.analytics.web.sawconnect.sawprotocol.SAWProtocolInputStreamImpl.readChunkHeader(SAWProtocolInputStreamImpl.java:243)
   com.siebel.analytics.web.sawconnect.sawprotocol.SAWProtocolInputStreamImpl.startReadingNewMessage(SAWProtocolInputStreamImpl.java:49)
   com.siebel.analytics.web.sawconnect.SAWServletHttpBinding.forwardResponse(SAWServletHttpBinding.java:157)
   com.siebel.analytics.web.SAWBridge.processRequest(SAWBridge.java:132)
   com.siebel.analytics.web.SAWBridge.doGet(SAWBridge.java:214)
   javax.servlet.http.HttpServlet.service(HttpServlet.java:700)
   javax.servlet.http.HttpServlet.service(HttpServlet.java:815)
   weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:224)
   weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:108)
   weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:206)
   weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
   weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
   com.siebel.analytics.web.integration.HyperionCSSAuthenticatorFilter.doFilter(HyperionCSSAuthenticatorFilter.java:104)
   weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
   com.siebel.analytics.web.integration.ApplCoreSessionIntegrationFilter.doFilter(ApplCoreSessionIntegrationFilter.java:207)
   weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
   com.siebel.analytics.web.integration.LoadBalancerHTTPFilter.doFilter(LoadBalancerHTTPFilter.java:175)
   weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
   oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:111)
   oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:299)
   oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:405)
   oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:94)
   oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:98)
   oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:70)
   weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
   oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:86)
   weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
   weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3687)
   weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3681)
   weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:308)
   weblogic.security.service.SecurityManager.runAs(SecurityManager.java:116)
   weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2213)
   weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2135)
   weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1420)
   weblogic.work.ExecuteThread.execute(ExecuteThread.java:203)
   weblogic.work.ExecuteThread.run(ExecuteThread.java:170)
}

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms