Impala Daemon Crashes with Out of Memory Errors on BDA (Doc ID 2085184.1)

Last updated on DECEMBER 08, 2015

Applies to:

Big Data Appliance Integrated Software - Version 4.2.0 and later
Linux x86-64

Symptoms

The Impala daemon on one node of the cluster crashes with Out of Memory (OOM) errors.

/var/log/messages shows the OOM right before the Impalad crash:

Sep 29 16:53:47 bdanode0x kernel: [<ffffffff810c442a>] ? cpuset_print_task_mems_allowed+0xba/0xe0
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff81113d31>] dump_header+0x91/0x1e0
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff811137f6>] ? find_lock_task_mm+0x36/0x80
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff811144a5>] oom_kill_process+0x85/0x170
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff8111468e>] out_of_memory+0xfe/0x220
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff81119ae2>] __alloc_pages_slowpath+0x662/0x6e0
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff81114e1f>] ? zone_watermark_ok+0x1f/0x30
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff81119d7a>] __alloc_pages_nodemask+0x21a/0x230
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff81153dc6>] alloc_pages_current+0xb6/0x120
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff81110d67>] __page_cache_alloc+0xa7/0xc0
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff81111ccf>] filemap_fault+0x1af/0x4b0
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff81041079>] ? default_spin_lock_flags+0x9/0x10
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff811395c4>] __do_fault+0x54/0x4d0
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff810962e8>] ? hrtimer_try_to_cancel+0x48/0xe0
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff81139b27>] handle_pte_fault+0xe7/0x200
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff8151642e>] ? call_function_interrupt+0xe/0x20
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff81139d9b>] handle_mm_fault+0x15b/0x270
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff81510cd0>] do_page_fault+0x140/0x470
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff81096294>] ? hrtimer_start_range_ns+0x14/0x20
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff810a768c>] ? do_futex+0xec/0x1c0
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff810a77db>] ? sys_futex+0x7b/0x180
Sep 29 16:53:47 bdanode0x kernel: [<ffffffff8150d895>] page_fault+0x25/0x30

 

 

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms