lsnrctl fails with illegal instruction(coredump) (Doc ID 2449339.1)

Last updated on APRIL 17, 2023

Applies to:

Symptoms

ENV

-----

OS: Oracle Linux 7

DB: Single db

Listener_name: DEV

1. lsnrctl fails with the following errors evenif restart O/S:

$ lsnrctl
Illegal instruction(coredump)

$ lsnrctl stat DEV
Illegal instruction(coredump)

$ lsnrctl start DEV
Illegal instruction(coredump)

$ ps -ef | grep lsnr
oradev   16694 16653  0 16:26 pts/0    00:00:00 grep --color=auto lsnr

2. strace output :

$ strace -f -o lsnrctl2.strace lsnrctl start DEV

From lsnrctl2.strace

14539 execve("/APP/oracle/oradev/db/12.1.0/bin/lsnrctl", ["lsnrctl", "start", "DEV"], [/* 54 vars */]) = 0
14539 brk(0)                            = 0x1ba2000
14539 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f85c0f96000
14539 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory)
14539 open("/APP/oracle/oradev/db/12.1.0/lib/tls/x86_64/libclntsh.so.12.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
14539 stat("/APP/oracle/oradev/db/12.1.0/lib/tls/x86_64", 0x7ffcabeddb20) = -1 ENOENT (No such file or directory)
14539 open("/APP/oracle/oradev/db/12.1.0/lib/tls/libclntsh.so.12.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
14539 stat("/APP/oracle/oradev/db/12.1.0/lib/tls", 0x7ffcabeddb20) = -1 ENOENT (No such file or directory)
14539 open("/APP/oracle/oradev/db/12.1.0/lib/x86_64/libclntsh.so.12.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
14539 stat("/APP/oracle/oradev/db/12.1.0/lib/x86_64", 0x7ffcabeddb20) = -1 ENOENT (No such file or directory)
14539 open("/APP/oracle/oradev/db/12.1.0/lib/libclntsh.so.12.1", O_RDONLY|O_CLOEXEC) = 3
14539 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\240\231N\0\0\0\0\0"..., 832) = 832
14539 fstat(3, {st_mode=S_IFREG|0755, st_size=58772168, ...}) = 0

...

14539 munmap(0x7f85c0f93000, 4096)      = 0
14539 times(NULL)                       = 431652678
14539 open("/APP/oracle/oradev/db/12.1.0/rdbms/mesg/diaus.msb", O_RDONLY) = 3
14539 fcntl(3, F_SETFD, FD_CLOEXEC)     = 0
14539 lseek(3, 0, SEEK_SET)             = 0
14539 read(3, "\25\23\"\1\23\3\t\t\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 256) = 256
14539 lseek(3, 512, SEEK_SET)           = 512
14539 read(3, "\371\311\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 512) = 512
14539 lseek(3, 1024, SEEK_SET)          = 1024
14539 read(3, "\210\273\353\273\363\273\373\273\4\274\16\274\26\274!\274)\2741\274<\274G\274T\274_\274k\274t\274"..., 206) = 206
14539 open("/APP/oracle/oradev/db/12.1.0/nls/data/9idata/lx20001.nlb", O_RDONLY) = 4
14539 read(4, "\0\0\0\3\0\2\20\f9\33\0\0\215\21\0\0\0\0\0\0\2\0\0\0\0Z\1\0\0\0\0\0"..., 92) = 92
14539 read(4, "\1\0\37\0\t\0\2\0\0\0\0\0\0\0\0\0\0\0?\0\0\0\0\1\0\0\0\0\0\0\0\0"..., 6877) = 6877
14539 close(4)                          = 0
14539 uname({sys="Linux", node="oradbdev", ...}) = 0
14539 brk(0)                            = 0x1be9000
14539 brk(0x1c0c000)                    = 0x1c0c000
14539 stat("/etc/sysconfig/64bit_strstr_via_64bit_strstr_sse2_unaligned", {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
14539 stat("/APP/oracle/oradev/oradiag_oradev/diag/lsnrctl/oradbdev/oradbdev", 0x7ffcabedb030) = -1 ENOENT (No such file or directory)
14539 gettid()                          = 14539
14539 getrlimit(RLIMIT_NOFILE, {rlim_cur=4*1024, rlim_max=64*1024}) = 0
14539 openat(AT_FDCWD, "/proc/self/fd/", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 4
14539 getrlimit(RLIMIT_FSIZE, {rlim_cur=RLIM64_INFINITY, rlim_max=RLIM64_INFINITY}) = 0
14539 --- SIGILL {si_signo=SIGILL, si_code=ILL_ILLOPN, si_addr=0x7f85be3b1842} ---
14539 +++ killed by SIGILL (core dumped) +++

3. STACKX output:

++ STACKX User Guide (Doc ID 362791.1)

stackx core.7575 > stacktrace.txt

From stacktrace.txt

######################################################################
stackx core / stack trace extraction utility
version 1.3 (c) 2005, 2006, 2007 Oracle Corp. all rights reserved.
Reporting:  Fri Sep 14 11:09:08 KST 2018
Machine  :  oradbdev
OS Name  :  Linux
OS Ver   :  4.1.12-61.1.33.el7uek.x86_64
CPU Type :  64
Core file:  core.7575
Core date:  Sep 14 10:51
Tool(s)  :  /usr/bin/gdb
Program  :
Core extraction section follows
######################################################################
No executables found for lsnrctlstartDEV in corefile core.7575                                          >>>>>>>>>>>>>>>> No executables found for lsnrctl start DEV

Changes

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.