EM 12c: Enterprise Manager 12c Cloud Control OMS Loader Backlog is Increasing and Performance is Poor, Shows Message. LOADER ERROR: ERROR-800|Loader already processing this request (Doc ID 2227148.1)

Last updated on JUNE 21, 2017

Applies to:

Enterprise Manager Base Platform - Version 12.1.0.4.0 and later
Information in this document applies to any platform.

Symptoms

2 x Enterprise Manager (EM) 12.1.0.5.160719 Cloud Control OMS
1 x EM 12.1.0.2 repository database (Dataguard Configuration)
289 x EM 12.1.0.5.0 Agents

Enterprise Manager (EM) 12.1.0.5 Cloud Control OMS Loader backlog is rising.
Restart of the OMS results in upload of several thousand files with good Performance for about five to ten minutes.
After this time, loader performance decreases and the backlog starts growing again.

When the loader backlog increases, the OMS and Repository servers are 99% idle or nearly so.

The EM 12.1.0.4 OMS .../gc_inst/em/EMGC_OMS1/sysman/log/emoms_pbs.trc file shows loader errors for some of the agents:

2017-01-05 11:15:21,738 [GCLoader[severity] - https://host:3872/emd/main/] ERROR gcloader.DataLoader logp.251 - LOADER ERROR: Loader already procesing this request: tracking_key=508863.1482899750000 emd_url=https://host:3872/emd/main/ loadEntryGuid=405FD31C863B0E5FD8E59DC03846366D upload_type=severity stream_id=1
2017-01-05 11:15:21,740 [GCLoader[severity] - https://host:3872/emd/main/] ERROR gcloader.Receiver logp.251 - Upload failed: emdUrl=https://host:3872/emd/main/ trackingKey=508863.1482899750000 type=severity e=ERROR-800|Loader already procesing this request
ERROR-800|Loader already procesing this request
at oracle.sysman.core.pbs.gcloader.DataLoader.startUpload(DataLoader.java:1751)
at oracle.sysman.core.pbs.gcloader.RequestMapper.processAll(RequestMapper.java:122)
at oracle.sysman.core.pbs.gcloader.Receiver.processFile(Receiver.java:2297)
at oracle.sysman.core.pbs.gcloader.Receiver.doPost(Receiver.java:1979)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:301)
at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
at oracle.sysman.core.pbs.app.ContextInitFilter.chain(ContextInitFilter.java:293)
at oracle.sysman.core.pbs.app.ContextInitFilter.doFilter(ContextInitFilter.java:273)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:186)
...

 

And upload from those agents fails with this session errpr:

 

 

Changes

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms