EM 12c : Fetchlet Exception For EMD internal Metrics 'missing definition of internal metric z#SQL_Connection' Reported in gcagent_errors.log (Doc ID 1602434.1)

Last updated on FEBRUARY 04, 2015

Applies to:

Enterprise Manager Base Platform - Version 12.1.0.1.0 and later
Information in this document applies to any platform.

Symptoms

Getting FetchletException: missing definition of internal metric z#SQL_Connection  in agent logs and generating incidents.

$ ./emctl getmetric agent agent.oracle.com:3872,oracle_emd,z#SQL_ConnectionPool
Oracle Enterprise Manager Cloud Control 12c Release 3
Copyright (c) 1996, 2013 Oracle Corporation.  All rights reserved.
EMD getmetric error: java.lang.Error:
oracle.sysman.emSDK.agent.fetchlet.exception.FetchletException: missing definition of internal metric z#SQL_ConnectionPool

 

From AGENT_INST/sysman/log/gcagent.log

2013-10-31 11:25:56,821 [34:22672E03] INFO - >>> Reporting exception: oracle.sysman.emSDK.agent.client.exception.GetMetricDataException: java.lang.Error: oracle.sysman.emSDK.agent.fetchlet.exception.FetchletException: missing definition of internal metric z#SQL_ConnectionPool (request id 1) <<<
oracle.sysman.emSDK.agent.client.exception.GetMetricDataException: java.lang.Error: oracle.sysman.emSDK.agent.fetchlet.exception.FetchletException: missing definition of internal metric z#SQL_ConnectionPool
at oracle.sysman.gcagent.dispatch.cxl.GetMetricDataAction.satisfyRequest(GetMetricDataAction.java:285)
at oracle.sysman.gcagent.dispatch.ProcessRequestAction._call(ProcessRequestAction.java:134)
at oracle.sysman.gcagent.dispatch.ProcessRequestAction.call(ProcessRequestAction.java:95)
at oracle.sysman.gcagent.dispatch.InlineDispatchCoordinator.dispatchRequest(InlineDispatchCoordinator.java:229)
at oracle.sysman.gcagent.dispatch.DispatchRequestsAction.call(DispatchRequestsAction.java:110)
at oracle.sysman.gcagent.dispatch.DispatchRequestsAction.call(DispatchRequestsAction.java:50)
at oracle.sysman.gcagent.task.DiagWrappedAction.call(DiagWrappedAction.java:52)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at oracle.sysman.gcagent.task.SingleActionTask.run(SingleActionTask.java:76)
at oracle.sysman.gcagent.dispatch.DispatchRequestsTask.run(DispatchRequestsTask.java:64)
at oracle.sysman.gcagent.task.AbstractTemplateTask.call(AbstractTemplateTask.java:198)
at oracle.sysman.gcagent.task.AbstractTemplateTask.call(AbstractTemplateTask.java:49)
at oracle.sysman.gcagent.task.TaskFutureImpl$WrappedTask.accountedCall(TaskFutureImpl.java:574)
at oracle.sysman.gcagent.task.TaskFutureImpl$WrappedTask.call(TaskFutureImpl.java:613)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at oracle.sysman.gcagent.task.TaskFutureImpl.run1(TaskFutureImpl.java:357)
at oracle.sysman.gcagent.task.TaskFutureImpl.run(TaskFutureImpl.java:322)
at oracle.sysman.gcagent.task.executor.CurrentThreadExecutor.submit(CurrentThreadExecutor.java:76)
at oracle.sysman.gcagent.task.executor.CurrentThreadExecutor.submit(CurrentThreadExecutor.java:64)
at oracle.sysman.gcagent.dispatch.DispatchRequestsExecutor.submit(DispatchRequestsExecutor.java:82)
at oracle.sysman.gcagent.dispatch.RequestDispatcher.executeRequests(RequestDispatcher.java:2297)
at oracle.sysman.gcagent.dispatch.RequestDispatcher.dispatchRequests(RequestDispatcher.java:767)
at oracle.sysman.gcagent.comm.agent.http.TMClientProtocolServer.onServiceProtocol(TMClientProtocolServer.java:310)
at oracle.sysman.gcagent.comm.agent.http.HTTPRequestHandler.handle(HTTPRequestHandler.java:189)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113)
at oracle.sysman.gcagent.comm.agent.http.HTTPListener$EMDUrlHandler.handle(HTTPListener.java:742)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:933)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:871)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:245)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113)
at org.eclipse.jetty.server.Server.handle(Server.java:330)
at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:559)
at org.eclipse.jetty.server.HttpConnection$RequestHandler.content(HttpConnection.java:1007)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:839)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:203)
at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:406)
at org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:462)
at oracle.sysman.gcagent.comm.agent.http.HTTPListenerThreadPool$JobSleeve.run(HTTPListenerThreadPool.java:256)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436)
at oracle.sysman.gcagent.util.system.GCAThread$RunnableWrapper.run(GCAThread.java:184)
at java.lang.Thread.run(Thread.java:662)
Caused by: oracle.sysman.emSDK.agent.fetchlet.exception.FetchletException: RTMCollection: exception occurred: java.util.concurrent.ExecutionException: java.lang.Error: oracle.sysman.emSDK.agent.fetchlet.exception.FetchletException: missing definition of internal metric z#SQL_ConnectionPool
at oracle.sysman.gcagent.metadata.impl.collection.CollectionManager.executeCollectionTask(CollectionManager.java:3049)
at oracle.sysman.gcagent.target.interaction.execution.RTMCollection.getRTMRequestWithLogAccess(RTMCollection.java:448)
at oracle.sysman.gcagent.target.interaction.execution.RTMCollection.getRTMRequestWithLogAccess(RTMCollection.java:395)
at oracle.sysman.gcagent.target.interaction.execution.RTMCollection.getRTMRequest(RTMCollection.java:369)
at oracle.sysman.gcagent.target.interaction.execution.RTMCollection.getRTMRequest(RTMCollection.java:338)
at oracle.sysman.gcagent.dispatch.cxl.GetMetricDataAction.satisfyRequest(GetMetricDataAction.java:249)
... 43 more
Caused by: java.util.concurrent.ExecutionException: java.lang.Error: oracle.sysman.emSDK.agent.fetchlet.exception.FetchletException: missing definition of internal metric z#SQL_ConnectionPool
at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
at java.util.concurrent.FutureTask.get(FutureTask.java:83)
at oracle.sysman.gcagent.metadata.impl.collection.CollectionManager.executeCollectionTask(CollectionManager.java:3002)
... 48 more
Caused by: java.lang.Error: oracle.sysman.emSDK.agent.fetchlet.exception.FetchletException: missing definition of internal metric z#SQL_ConnectionPool
at oracle.sysman.gcagent.target.interaction.execution.FetchletFactory.getMetric(FetchletFactory.java:459)
at oracle.sysman.gcagent.target.interaction.execution.ExecuteTask.executeQueryDescriptor(ExecuteTask.java:1044)
at oracle.sysman.gcagent.target.interaction.execution.ExecuteTask.runTask(ExecuteTask.java:3879)
at oracle.sysman.gcagent.target.interaction.execution.ExecuteTask.call(ExecuteTask.java:5034)
at oracle.sysman.gcagent.target.interaction.execution.ExecuteTask.call(ExecuteTask.java:225)
at oracle.sysman.gcagent.task.ActionDriver.call(ActionDriver.java:57)
at oracle.sysman.gcagent.target.rowsource.TableRowSource._fetch_internal(TableRowSource.java:171)
at oracle.sysman.gcagent.target.rowsource.Rowsource._fetch(Rowsource.java:206)
at oracle.sysman.gcagent.target.rowsource.Rowsource.fetch(Rowsource.java:218)
at oracle.sysman.gcagent.target.interaction.execution.ExecuteTask.executeRSTree(ExecuteTask.java:3241)
at oracle.sysman.gcagent.target.interaction.execution.ExecuteTask.executeRSTree(ExecuteTask.java:3218)
at oracle.sysman.gcagent.target.interaction.execution.RTMCollection.getRTMRequest(RTMCollection.java:743)
at oracle.sysman.gcagent.target.interaction.execution.RTMCollection$RTMExecutor.call(RTMCollection.java:531)
at oracle.sysman.gcagent.target.interaction.execution.RTMCollection$RTMExecutor.call(RTMCollection.java:460)
at oracle.sysman.gcagent.task.DiagWrappedAction.call(DiagWrappedAction.java:52)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at oracle.sysman.gcagent.task.SingleActionTask.run(SingleActionTask.java:76)
at oracle.sysman.gcagent.task.AbstractTemplateTask.call(AbstractTemplateTask.java:198)
at oracle.sysman.gcagent.task.AbstractTemplateTask.call(AbstractTemplateTask.java:49)
at oracle.sysman.gcagent.task.executor.DiagWrappedTask.call(DiagWrappedTask.java:60)
at oracle.sysman.gcagent.task.TaskFutureImpl$WrappedTask.accountedCall(TaskFutureImpl.java:574)
at oracle.sysman.gcagent.task.TaskFutureImpl$WrappedTask.call(TaskFutureImpl.java:613)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at oracle.sysman.gcagent.task.TaskFutureImpl.run1(TaskFutureImpl.java:357)
at oracle.sysman.gcagent.task.TaskFutureImpl.run(TaskFutureImpl.java:322)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at oracle.sysman.gcagent.task.executor.TrackThreadFactory$1.run(TrackThreadFactory.java:54)
... 2 more
Caused by: oracle.sysman.emSDK.agent.fetchlet.exception.FetchletException: missing definition of internal metric z#SQL_ConnectionPool
at oracle.sysman.gcagent.metadata.impl.datacollection.InternalMetricFetchlet.getMetric(InternalMetricFetchlet.java:58)
at sun.reflect.GeneratedMethodAccessor3548.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at oracle.sysman.gcagent.util.channel.AgentMetricChannel.getMetric(AgentMetricChannel.java:80)
at oracle.sysman.gcagent.addon.fetchlet.agentmetric.AgentMetric.getMetric(AgentMetric.java:52)
at oracle.sysman.gcagent.target.interaction.execution.FetchletFactory.getMetric(FetchletFactory.java:425)
... 31 more
2013-10-31 11:25:58,080 [26:642FB6F2] INFO - ADR Incident created: Id=31, module=oracle.sysman.gcagent.target.interaction.execution.FetchletFactory, problemKey='java.lang.Error:oracle.sysman.gcagent.target.interaction.execution.FetchletFactory:459', direcotry=/opt/oracle/product/12.1.0/agent/agent_inst/diag/ofm/emagent/emagent/incident/incdir_31

 

 

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms