11g DBConsole Fails To Start With Message 'Initialization of FETCHLET MANAGER failure' (Doc ID 1298590.1)

Last updated on APRIL 06, 2017

Applies to:

Enterprise Manager for Oracle Database - Version 11.1.0.6 to 11.2.0.3 [Release 11.1 to 11.2]
Information in this document applies to any platform.
This note is applicable to Linux/UNIX platforms.

Symptoms

Starting 11g dbconsole service failed even after recreating configurations and repository.

kmes:/oracle/app/oracle/product/11g> /oracle/app/oracle/product/11g/db_1/bin/emctl start dbconsole
Oracle Enterprise Manager 11g Database Control Release 11.2.0.1.0
Copyright (c) 1996, 2009 Oracle Corporation. All rights reserved.
https://192.168.1.151:1158/em/console/aboutApplication
Starting Oracle Enterprise Manager 11g Database Control ............................................................................................. failed.
------------------------------------------------------------------
Logs are generated in directory /oracle/app/oracle/product/11g/db_1/192.168.1.151_MES/sysman/log

 

emagent.trc
2011-02-21 09:34:33,448 Thread-1 WARN http: nmehl_connect_internal: connect failed to (192.168.1.151:5500): Connection refused (error = 239)
2011-02-21 09:34:33,451 Thread-1 ERROR pingManager: nmepm_pingReposURL: Cannot connect to https://192.168.1.151:5500/em/upload/: retStatus=-1
2011-02-21 09:34:33,451 Thread-1 WARN main: clear collection state due to OMS_version difference
2011-02-21 09:34:33,470 Thread-1 WARN command: Job Subsystem Timeout set at 600 seconds
2011-02-21 09:34:33,537 Thread-1 ERROR fetchlets: Error when initializing C Logging Package for ECID generation.
2011-02-21 09:34:33,537 Thread-1 ERROR main: nmefmgr_initialize failed to initialize Fetchlet Manager

 

emagent.log
2011-02-21 09:34:33,407 Thread-1 Starting Agent 10.2.0.4.2 from /oracle/app/oracle/product/11g/db_1 (00701)
2011-02-21 09:34:33,537 Thread-1 <Agent Startup> : Initialization of FETCHLET MANAGER failure (00721)
2011-02-21 09:39:05,899 Thread-1 Starting Agent 10.2.0.4.2 from /oracle/app/oracle/product/11g/db_1 (00701)
2011-02-21 09:39:06,153 Thread-1 <Agent Startup> : Initialization of FETCHLET MANAGER failure (00721)
2011-02-22 10:08:31,732 Thread-1 Starting Agent 10.2.0.4.2 from /oracle/app/oracle/product/11g/db_1 (00701)
2011-02-22 10:08:31,981 Thread-1 <Agent Startup> : Initialization of FETCHLET MANAGER failure (00721)
2011-02-22 15:11:29,158 Thread-1 Starting Agent 10.2.0.4.2 from /oracle/app/oracle/product/11g/db_1 (00701)
2011-02-22 15:11:29,588 Thread-1 <Agent Startup> : Initialization of FETCHLET MANAGER failure (00721)



With the agent logs, we can find many technical documents which describe invalid hostname resolution can be the root cause of the symptom.

However, nslookup command returns expected values as following.

kmes:/tmp/rda> nslookup 192.168.1.151
Using /etc/hosts on: kmes

looking up FILES
Name: kmes
Address: 192.168.1.151

kmes:/tmp/rda> nslookup kmes
Using /etc/hosts on: kmes

looking up FILES
Name: kmes
Address: 192.168.1.151



Since we have reviewed all the data that could be collected at first glance, it is time to dump tusc (or strace) output from the command 'emctl start dbconsole'.

tusc output from 'emctl start dbconsole'
open("/etc/nsswitch.conf", O_RDONLY|0x800, 0666) ............................................................. = 9

ioctl(9, TCGETA, 0x9fffffffffffd620) ......................................................................... ERR#25 ENOTTY

read(9, "\n# \n# A n e x a m p l e ".., 8192) .......................................................... = 363
read(9, 0x600000000014ce68, 8192) ............................................................................ = 0
close(9) ..................................................................................................... = 0
open("/usr/lib/hpux64/libnss_dns.so.1", O_RDONLY|0x800, 0) ................................................... = 9
fstat(9, 0x9fffffffffffd090) ................................................................................. = 0
pread(9, "7fE L F 0202010101\0\0\0\0\0\0\0".., 1024, 0) ...................................................... = 1024
stat("/usr/lib/hpux64/dpd", 0x9fffffffffffc640) .............................................................. = 0
open("/usr/lib/hpux64/dpd/libnss_dns.so.1.bpd", O_RDONLY|0x800, 0) ........................................... ERR#2 ENOENT
getuid() ..................................................................................................... = 109 (109)
getgid() ..................................................................................................... = 106 (106)
mmap(NULL, 49808, PROT_READ|PROT_EXEC, MAP_SHARED|MAP_SHLIB, 9, 0) ........................................... = 0xc00000000bce0000
mmap(NULL, 816, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_SHLIB, 9, 65536) ....................................... = 0x9fffffffbf683000
close(9) ..................................................................................................... = 0
getuid() ..................................................................................................... = 109 (109)
getgid() ..................................................................................................... = 106 (106)
getuid() ..................................................................................................... = 109 (109)
getgid() ..................................................................................................... = 106 (106)
open("/oracle/app/oracle/product/11g/db_1/lib/libdl.so.1", O_RDONLY|0x800, 0) ................................ ERR#2 ENOENT
open("/oracle/app/oracle/product/11g/db_1/perl/lib/libdl.so.1", O_RDONLY|0x800, 0) ........................... ERR#2 ENOENT
open("/oracle/app/oracle/product/11g/db_1/oui/lib/hpunix/libdl.so.1", O_RDONLY|0x800, 0) ..................... ERR#2 ENOENT
open("/oracle/app/oracle/product/11g/db_1/jdk/jre/lib/IA64W/hotspot/libdl.so.1", O_RDONLY|0x800, 0) .......... ERR#2 ENOENT
open("/oracle/app/oracle/product/11g/db_1/jdk/jre/lib/IA64W/libdl.so.1", O_RDONLY|0x800, 0) .................. ERR#2 ENOENT
open("/oracle/app/oracle/product/11g/db_1/jdk/jre/lib/PA_RISC2.0W/hotspot/libdl.so.1", O_RDONLY|0x800, 0) .... ERR#2 ENOENT
open("/oracle/app/oracle/product/11g/db_1/jdk/jre/lib/PA_RISC2.0W/libdl.so.1", O_RDONLY|0x800, 0) ............ ERR#2 ENOENT
open("/oracle/app/oracle/product/11g/db_1/lib/libdl.so.1", O_RDONLY|0x800, 0) ................................ ERR#2 ENOENT
open("/oracle/app/oracle/product/11g/db_1/perl/lib/libdl.so.1", O_RDONLY|0x800, 0) ........................... ERR#2 ENOENT
open("/oracle/app/oracle/product/11g/db_1/lib32/libdl.so.1", O_RDONLY|0x800, 0) .............................. ERR#2 ENOENT
open("/oracle/app/oracle/product/11g/db_1/oui/lib/hpunix/libdl.so.1", O_RDONLY|0x800, 0) ..................... ERR#2 ENOENT
getuid() ..................................................................................................... = 109 (109)
getgid() ..................................................................................................... = 106 (106)
open("/usr/lib/hpux64/libdl.so.1", O_RDONLY|0x800, 0) ........................................................ = 9
fstat(9, 0x9fffffffffffcfa0) ................................................................................. = 0
read(9, "7fE L F 0202010101\0\0\0\0\0\0\0".., 64) ............................................................ = 64
close(9) ..................................................................................................... = 0
gettimeofday(0x9fffffffffffc580, NULL) ....................................................................... = 0
getpid() ..................................................................................................... = 3618 (3605)
open("/etc/resolv.conf", O_RDONLY|0x800, 0666) ............................................................... = 9
ioctl(9, TCGETA, 0x9fffffffffffc550) ......................................................................... ERR#25 ENOTTY

Changes

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms