Deployment Taking 1 Hour, then Apps Receiving 502 Or 503 Errors Post Deployment in WLS10.3.3

(Doc ID 1332708.1)

Last updated on NOVEMBER 05, 2016

Applies to:

Oracle Weblogic Server - Version: 10.3.3 and later   [Release: and later ]
Information in this document applies to any platform.

Symptoms

Application deployment takes more than an hour to deploy on WLS 10.3.3. Customer application was deployed with no issue with WLS 10.0MP1, but after upgrading to WLS10.3.3, the deployment hangs. Note that this issue occurred when the WebLogic Diagnostic Framework (WLDF) was in use.

Thread dumps taken during the hung deployment indicate that the deployment framework is waiting to lock an object that another customer application is holding. The following thread dumps show lock contention for the same object:

Thread-27" id=57 idx=0x114 tid=11840 prio=5 alive, in native, daemon
at java/net/PlainSocketImpl.socketAccept(Ljava/net/SocketImpl;)V(Native Method)
at java/net/PlainSocketImpl.accept(PlainSocketImpl.java:390)
^-- Holding lock: java/net/SocksSocketImpl@0x0000000180F19250[biased lock]
at java/net/ServerSocket.implAccept(ServerSocket.java:453)
at java/net/ServerSocket.accept(ServerSocket.java:421)
at com/i2/se/bd/util/socket/TSocket.accept(TSocket.java:135)
at com/i2/se/bd/util/socket/TServerManager.runServer(TServerManager.java:643)
at com/i2/se/bd/util/socket/TServerManager.run(TServerManager.java:717)
^-- Holding lock: java/lang/String@0x0000000191A16F48[thin lock]
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace

"[STANDBY] ExecuteThread: '4' for queue: 'weblogic.kernel.Default (self-tuning)'" id=51 idx=0x104 tid=5608 prio=5 alive, blocked, native_blocked, daemon
-- Blocked trying to get lock: java/lang/String@0x0000000191A16F48[thin lock]
at jrockit/vm/Threads.sleep(I)V(Native Method)
at jrockit/vm/Locks.waitForThinRelease(Locks.java:955)
at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1083)[optimized]
at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1005)[optimized]
at jrockit/vm/Locks.monitorEnter(Locks.java:2179)[optimized]
at weblogic/diagnostics/module/WLDFModule.activate(WLDFModule.java:284)
at weblogic/application/internal/flow/DeploymentCallbackFlow$2.next(DeploymentCallbackFlow.java:531)
at weblogic/application/utils/StateMachineDriver.nextState(StateMachineDriver.java:41)
at weblogic/application/internal/flow/DeploymentCallbackFlow.activate(DeploymentCallbackFlow.java:165)
at weblogic/application/internal/flow/DeploymentCallbackFlow.activate(DeploymentCallbackFlow.java:157)
at weblogic/application/internal/BaseDeployment$2.next(BaseDeployment.java:1267)
at weblogic/application/utils/StateMachineDriver.nextState(StateMachineDriver.java:41)
at weblogic/application/internal/BaseDeployment.activate(BaseDeployment.java:409)
at weblogic/application/internal/EarDeployment.activate(EarDeployment.java:58)
at weblogic/application/internal/DeploymentStateChecker.activate(DeploymentStateChecker.java:161)
at weblogic/deploy/internal/targetserver/AppContainerInvoker.activate(AppContainerInvoker.java:79)
at weblogic/deploy/internal/targetserver/operations/AbstractOperation.activate(AbstractOperation.java:569)
at weblogic/deploy/internal/targetserver/operations/ActivateOperation.activateDeployment(ActivateOperation.java:150)
at weblogic/deploy/internal/targetserver/operations/ActivateOperation.doCommit(ActivateOperation.java:116)
at weblogic/deploy/internal/targetserver/operations/AbstractOperation.commit(AbstractOperation.java:323)
at weblogic/deploy/internal/targetserver/DeploymentManager.handleDeploymentCommit(DeploymentManager.java:844)
at weblogic/deploy/internal/targetserver/DeploymentManager.activateDeploymentList(DeploymentManager.java:1253)
^-- Holding lock: java/util/ArrayList@0x0000000186374188[biased lock]
at weblogic/deploy/internal/targetserver/DeploymentManager.handleCommit(DeploymentManager.java:440)
at weblogic/deploy/internal/targetserver/DeploymentServiceDispatcher.commit(DeploymentServiceDispatcher.java:163)
at weblogic/deploy/service/internal/targetserver/DeploymentReceiverCallbackDeliverer.doCommitCallback(DeploymentReceiverCallbackDeliverer.java:195)
at weblogic/deploy/service/internal/targetserver/DeploymentReceiverCallbackDeliverer.access$100(DeploymentReceiverCallbackDeliverer.java:13)
at weblogic/deploy/service/internal/targetserver/DeploymentReceiverCallbackDeliverer$2.run(DeploymentReceiverCallbackDeliverer.java:68)
at weblogic/work/SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:528)[optimized]
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:201)[optimized]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:173)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms