kdump failed to collect vmcore and complained OOM (Doc ID 1499238.1)

Last updated on JUNE 27, 2016

Applies to:

Linux OS - Version Oracle Linux 5.6 with Unbreakable Enterprise Kernel [2.6.32] and later
Information in this document applies to any platform.

Symptoms

Kdump process complained out of memory

Oct  8 09:44:38 localhost netconsole:: inserting netconsole module with arguments netconsole=6666@10.225.8.98/eth0,514@10.225.8.31/00:0C:29:EE:19:00  ----> Starting netconsole
<snip>
Oct  8 09:44:38 localhost kernel: netconsole: remote IP xxxx
<snip>
Oct  8 09:44:48 localhost kernel: SysRq : Show Memory      -----------> Then we tested the sysrq facility
<snip>
Oct  9 18:11:35 localhost gconfd (root-5195): Resolved address "xml:readwrite:/root/.gconf" to a writable configuration source at position 0     -----> Triggerred kdump
Oct  9 18:15:03 localhost syslogd 1.4.1: restart.           --------> Starting kexec, and IMG_0129.JPG indicates it's collecting vmcore
Oct  9 18:15:03 localhost kernel: klogd 1.4.1, log source = /proc/kmsg started.
Oct  9 18:15:03 localhost kernel: Initializing cgroup subsys cpuset
Oct  9 18:15:03 localhost kernel: Initializing cgroup subsys cpu
Oct  9 18:15:03 localhost kernel: Linux version 2.6.32-300.4.1.el5uek (mockbuild@ca-build56.us.oracle.com) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-50)) #1 SMP Fri Dec 23 03:13:22 EST 2011
Oct  9 18:15:03 localhost kernel: Command line: ro root=LABEL=/ rhgb quiet numa=off irqpoll maxcpus=1 reset_devices  memmap=exactmap memmap=640K@0K memmap=130416K@49792K elfcorehdr=180208K memmap=88K$3395044K memmap=252K#3395132K memmap=12488K$3395384K memmap=262144K$3670016K memmap=32768K$4161536K    --------> it's different from normal kernel
Oct  9 18:15:03 localhost kernel: KERNEL supported cpus:
<snip>
Oct  9 18:25:24 localhost kernel: Out of memory: kill process 3283 (S20kdump) score 1578 or a child              ----------> kdump failed due to out of memory
Oct  9 18:25:24 localhost kernel: Killed process 3293 (cp)
Oct  9 18:25:24 localhost kernel: cp: page allocation failure. order:0, mode:0x2005a
Oct  9 18:25:24 localhost kernel: Pid: 3293, comm: cp Not tainted 2.6.32-300.4.1.el5uek #1
Oct  9 18:25:24 localhost kernel: Call Trace:
<snip>
Oct  9 18:49:23 localhost init: Switching to runlevel: 0 ----------> failed and shutdown
Oct  9 18:52:44 localhost syslogd 1.4.1: restart.
Oct  9 18:52:44 localhost kernel: klogd 1.4.1, log source = /proc/kmsg started.
Oct  9 18:52:44 localhost kernel: Initializing cgroup subsys cpuset
Oct  9 18:52:44 localhost kernel: Initializing cgroup subsys cpu
Oct  9 18:52:44 localhost kernel: Linux version 2.6.32-300.4.1.el5uek (mockbuild@ca-build56.us.oracle.com) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-50)) #1 SMP Fri Dec 23 03:13:22 EST 2011
Oct  9 18:52:44 localhost kernel: Command line: ro root=LABEL=/ rhgb quiet crashkernel=128M@48M numa=off        ---------> normal kernel command line
~                                                                                                                                                       
 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms