Getting AdminServer Stuck Thread on NodeManager Classes When Starting Managed Server (Doc ID 1485380.1)

Last updated on AUGUST 09, 2017

Applies to:

Oracle WebLogic Server - Version 10.3 and later
Information in this document applies to any platform.
***Checked for relevance on 4-Dec-2015***

Symptoms

On a new WLS environment being just installed (with other OIM domains), when starting managed servers, the logs show some inconcistent error messages (stuck threads on Node Manager, Node Manager stating, server could not be started but then it starts anyway, etc.), and managed server cannot be started. For example, we see in the AdminServer logs:

####<Jul 30, 2012 4:31:44 PM CDT> <Error> <WebLogicServer> <smdca4h09> <AdminServer> <[ACTIVE] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <2bf707b00397edca:-420aa8fc:138d9af89e0:-8000-00000000000000ba> <1343683904644> <BEA-000337> <[STUCK] ExecuteThread: '6' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "600" seconds working on the request "weblogic.kernel.WorkManagerWrapper$1@57a7c2ca", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
java.net.SocketInputStream.socketRead0(Native Method)
java.net.SocketInputStream.read(SocketInputStream.java:129)
sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:264)
sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:306)
sun.nio.cs.StreamDecoder.read(StreamDecoder.java:158)
java.io.InputStreamReader.read(InputStreamReader.java:167)
java.io.BufferedReader.fill(BufferedReader.java:136)
java.io.BufferedReader.readLine(BufferedReader.java:299)
java.io.BufferedReader.readLine(BufferedReader.java:362)
weblogic.nodemanager.client.NMServerClient.checkResponse(NMServerClient.java:289)
weblogic.nodemanager.client.NMServerClient.checkResponse(NMServerClient.java:314)
weblogic.nodemanager.client.NMServerClient.start(NMServerClient.java:102)
weblogic.nodemanager.mbean.StartRequest.start(StartRequest.java:75)
weblogic.nodemanager.mbean.StartRequest.execute(StartRequest.java:47)
weblogic.kernel.WorkManagerWrapper$1.run(WorkManagerWrapper.java:63)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
>

In the Node Manager logs (Node Manager strange behavior: it states it CANNOT start the server, but few seconds later, server starts OK):

<Jul 30, 2012 4:21:31 PM> <WARNING> <Exception while starting server '<SERVER_NAME>'>
java.io.IOException: Server failed to start up. See server output log for more details.
at weblogic.nodemanager.server.AbstractServerManager.start(AbstractServerManager.java:200)
at weblogic.nodemanager.server.ServerManager.start(ServerManager.java:23)
at weblogic.nodemanager.server.Handler.handleStart(Handler.java:604)
at weblogic.nodemanager.server.Handler.handleCommand(Handler.java:121)
at weblogic.nodemanager.server.Handler.run(Handler.java:71)
at java.lang.Thread.run(Thread.java:662)
[... cut lines from IAM1 server ...]
<Jul 30, 2012 4:21:44 PM> <INFO> <PFRD> <WLS_DISCO> <Boot identity properties saved to "/opt/oracle/Middleware/user_projects/domains/PFRD/servers/SERVER_NAME/data/nodemanager/boot.properties">
<Jul 30, 2012 4:21:44 PM> <INFO> <PFRD> <WLS_DISCO> <Startup configuration properties saved to "/opt/oracle/Middleware/user_projects/domains/PFRD/servers/SERVER_NAME/data/nodemanager/startup.properties">
<Jul 30, 2012 4:21:44 PM> <INFO> <PFRD> <WLS_DISCO> <Rotated server output log to "/opt/oracle/Middleware/user_projects/domains/PFRD/servers/SERVER_NAME/logs/WLS_DISCO.out00050">
<Jul 30, 2012 4:21:44 PM> <INFO> <PFRD> <WLS_DISCO> <Server error log also redirected to server log>
<Jul 30, 2012 4:21:44 PM> <INFO> <PFRD> <WLS_DISCO> <Starting WebLogic server with command line: /opt/oracle/Middleware/user_projects/domains/PFRD/bin/startWebLogic.sh >
<Jul 30, 2012 4:21:44 PM> <INFO> <PFRD> <WLS_DISCO> <Working directory is '/opt/oracle/Middleware/user_projects/domains/PFRD'>
<Jul 30, 2012 4:21:44 PM> <INFO> <PFRD> <WLS_DISCO> <Rotated server output log to "/opt/oracle/Middleware/user_projects/domains/PFRD/servers/SERVER_NAME/logs/SERVER_NAME.out00051">
<Jul 30, 2012 4:21:44 PM> <INFO> <PFRD> <WLS_DISCO> <Server error log also redirected to server log>
<Jul 30, 2012 4:21:44 PM> <INFO> <PFRD> <WLS_DISCO> <Server output log file is '/opt/oracle/Middleware/user_projects/domains/PFRD/servers/SERVER_NAME/logs/SERVER_NAME.out'>

 

Changes

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms