EM 12c: Enterprise Manager 12c Cloud Control Agent Upload with emctl Fails with Errors: EMD upload error:full upload has failed; Upload Recent Sending Statistics; GC.Upload tid=39 RUNNABLE (Doc ID 1573011.1)

Last updated on JANUARY 06, 2017

Applies to:

Enterprise Manager Base Platform - Version 12.1.0.1.0 to 12.1.0.2.0 [Release 12.1]
Information in this document applies to any platform.

Symptoms

Enterprise Manager (EM) 12.1.0.2 Cloud Control system

The command: $/AGENT_INST/bin/emctl upload agent

fails with following message

Oracle Enterprise Manager Cloud Control 12c Release 2
Copyright (c) 1996, 2012 Oracle Corporation. All rights reserved.
---------------------------------------------------------------
EMD upload error:full upload has failed: Upload Recent Sending Statistics
________________________________
Channel=data send[ms]=364 fsz=5226

Avg send time=364.0 milliseconds
Backoff Event List
________________________________
Upload Failure List
_______________________________
Connection Event List
_____________________________
Upload timed out before completion.
Number of files to upload before the uploadNow call: 411, total size (MB): 1.5419331
Remaining number of files to upload: 414, total size (MB): 1.5455084 (TIMEOUT)

 

Thread dump / jstack for agent process id shows runnabel thread for upload thread

"GC.Upload[0]" tid=39 RUNNABLE (in native)
  java.net.SocketInputStream.socketRead0(Native Method)
  java.net.SocketInputStream.read(SocketInputStream.java:129)
  com.sun.net.ssl.internal.ssl.InputRecord.readFully(InputRecord.java:293)
  com.sun.net.ssl.internal.ssl.InputRecord.read(InputRecord.java:331)
com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:798)
  - locked <0x7ce0a25d> (a java.lang.Object)
com.sun.net.ssl.internal.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1138)
  - locked <0x7fc3c7b7> (a java.lang.Object)
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
...........
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)

oracle.sysman.gcagent.util.system.GCAThread$RunnableWrapper.run(GCAThread.java:141)
  java.lang.Thread.run(Thread.java:662)
Locked Synchronizers:
  - lock <0xe6d00e9> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)
  > Accumulated wait time (msec): 865666225 (7493 times)
  > Accumulated blocked time (msec): 201 (1397 times)

 

Note : To get jstack or thread dump  use  $AGENT_HOME/jdk/bin/jstack <agent process id>  or $kill -3 <agent process id>

 

 

Changes

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms