Several emagent Processes Spawned Starting Application Server Control 10.1.2.3.0 And AS Control Is Not Functional
(Doc ID 1229023.1)
Last updated on AUGUST 07, 2020
Applies to:
Oracle Fusion Middleware - Version 10.1.2.0.2 to 10.1.2.3.0 [Release AS10gR2]Oracle Solaris on SPARC (64-bit)
Symptoms
In an Application Server 10.1.2.3.0 installation on Solaris 10, when starting the Application Server Control (AS Control) the emagent process fails to start up successfully.
The AS Control home page URL can be reached but after providing the username and password the home page is displayed as blank. The following errors related to host metrics are repeated many times in the $ORACLE_HOME/sysman/log/emagent.trc file:
Date Time Thread-6016 ERROR engine: [<hostname>,<
In this Document
Checking with ps -ef | grep emagent there are several emagent processes instead of just of just one, which would be the expected output.
$ ps -ef|grep emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
<USER> <PID> <PID> <VAALUES> <ORACLE_HOME>/bin/emagent
Getting a pstack of the emagent processes show the following stack:
$ pstack <PID>
<PID>: /ORACLE_HOME/bin/emagent
<VALUE> _close (<VALUE>
<VALUE> snmeurm_close <VALUE>
<VALUE> snmejcp_Process_run_need_pipes <VALUE>
<VALUE> nmefos_executeCommand <VALUE>
<VALUE> nmefos_getLocalMetric <VALUE>
<VALUE> nmefoslt_getMetric <VALUE>
<VALUE> nmefmgr_getCLibMetric <VALUE>
<VALUE> nmefmgr_getMetricWithBlocking <VALUE>
<VALUE> nmeegd_computeResult <VALUE>
<VALUE> nmeegd_GetMetricData <VALUE>
<VALUE> nmeemcm_MetricCache_getMetric <VALUE>
<VALUE> nmee_MetricEngine_getMetricResult <VALUE>
<VALUE> nmecmc_MetricColl_collectMetric <VALUE>
<VALUE> nmecci_run <VALUE>
<VALUE> nmeuv_Vector_enumerate0 <VALUE>
<VALUE> nmecct_CollectionThread_run <VALUE>
<VALUE> nmesse_executeWork <VALUE>
<VALUE> nmttp_run <VALUE>
<VALUE> nmttp_runWorkerThread <VALUE>
<VALUE> _lwp_start <VALUE>
<VALUE> read <VALUE>
<VALUE> JVM_Read <VALUE>
<VALUE> Java_java_net_SocketInputStream_socketRead0 <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ <VALUE>
<VALUE> __1cKReflectionGinvoke6FnTinstanceKlassHandle_nMmethodHandle_nGHandle_inOobjArrayHandle_nJBasicType_4ipnGThread__pnHoopDesc__ <VALUE>
<VALUE> __1cKReflectionNinvoke_method6FpnHoopDesc_nGHandle_nOobjArrayHandle_pnGThread__2_ <VALUE>
<VALUE> JVM_InvokeMethod <VALUE>
<VALUE> Java_sun_reflect_NativeMethodAccessorImpl_invoke0 <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ <VALUE>
<VALUE> __1cRjni_invoke_static6FpnHJNIEnv__pnJJavaValue_pnI_jobject_nLJNICallType_pnK_jmethodID_pnSJNI_ArgumentPusher_pnGThread__v_ <VALUE>
<VALUE> jni_CallStaticObjectMethod <VALUE>
<VALUE> nmefmgr_getJNIfetchlet <VALUE>
<VALUE> nmefmgr_getMetricWithBlocking <VALUE>
<VALUE> nmeegd_computeResult <VALUE>
<VALUE> nmeegd_GetMetricData <VALUE>
<VALUE> nmeemcm_MetricCache_getMetric <VALUE>
<VALUE> nmee_MetricEngine_getMetricResult <VALUE>
<VALUE> nmecmc_MetricColl_collectMetric <VALUE>
<VALUE> nmecci_run <VALUE>
<VALUE> nmeuv_Vector_enumerate0 <VALUE>
<VALUE> nmecct_CollectionThread_run <VALUE>
<VALUE> nmesse_executeWork <VALUE>
<VALUE> nmttp_run <VALUE>
<VALUE> nmttp_runWorkerThread <VALUE>
<VALUE> _lwp_start <VALUE>
<PID>: /ORACLE_HOME/bin/emagent
<VALUE> _close (<VALUE>
<VALUE> snmeurm_close <VALUE>
<VALUE> snmejcp_Process_run_need_pipes <VALUE>
<VALUE> nmefos_executeCommand <VALUE>
<VALUE> nmefos_getLocalMetric <VALUE>
<VALUE> nmefoslt_getMetric <VALUE>
<VALUE> nmefmgr_getCLibMetric <VALUE>
<VALUE> nmefmgr_getMetricWithBlocking <VALUE>
<VALUE> nmeegd_computeResult <VALUE>
<VALUE> nmeegd_GetMetricData <VALUE>
<VALUE> nmeemcm_MetricCache_getMetric <VALUE>
<VALUE> nmee_MetricEngine_getMetricResult <VALUE>
<VALUE> nmecmc_MetricColl_collectMetric <VALUE>
<VALUE> nmecci_run <VALUE>
<VALUE> nmeuv_Vector_enumerate0 <VALUE>
<VALUE> nmecct_CollectionThread_run <VALUE>
<VALUE> nmesse_executeWork <VALUE>
<VALUE> nmttp_run <VALUE>
<VALUE> nmttp_runWorkerThread <VALUE>
<VALUE> _lwp_start <VALUE>
<VALUE> read <VALUE>
<VALUE> JVM_Read <VALUE>
<VALUE> Java_java_net_SocketInputStream_socketRead0 <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ <VALUE>
<VALUE> __1cKReflectionGinvoke6FnTinstanceKlassHandle_nMmethodHandle_nGHandle_inOobjArrayHandle_nJBasicType_4ipnGThread__pnHoopDesc__ <VALUE>
<VALUE> __1cKReflectionNinvoke_method6FpnHoopDesc_nGHandle_nOobjArrayHandle_pnGThread__2_ <VALUE>
<VALUE> JVM_InvokeMethod <VALUE>
<VALUE> Java_sun_reflect_NativeMethodAccessorImpl_invoke0 <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> ???????? <VALUE>
<VALUE> __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ <VALUE>
<VALUE> __1cRjni_invoke_static6FpnHJNIEnv__pnJJavaValue_pnI_jobject_nLJNICallType_pnK_jmethodID_pnSJNI_ArgumentPusher_pnGThread__v_ <VALUE>
<VALUE> jni_CallStaticObjectMethod <VALUE>
<VALUE> nmefmgr_getJNIfetchlet <VALUE>
<VALUE> nmefmgr_getMetricWithBlocking <VALUE>
<VALUE> nmeegd_computeResult <VALUE>
<VALUE> nmeegd_GetMetricData <VALUE>
<VALUE> nmeemcm_MetricCache_getMetric <VALUE>
<VALUE> nmee_MetricEngine_getMetricResult <VALUE>
<VALUE> nmecmc_MetricColl_collectMetric <VALUE>
<VALUE> nmecci_run <VALUE>
<VALUE> nmeuv_Vector_enumerate0 <VALUE>
<VALUE> nmecct_CollectionThread_run <VALUE>
<VALUE> nmesse_executeWork <VALUE>
<VALUE> nmttp_run <VALUE>
<VALUE> nmttp_runWorkerThread <VALUE>
<VALUE> _lwp_start <VALUE>
Changes
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Changes |
| Cause |
| Solution |
| References |