Kernel Panic at "spin_lock+0x1e/0x25"

(Doc ID 1610915.1)

Last updated on MARCH 08, 2017

Applies to:

Linux OS - Version Oracle Linux 5.0 and later
Linux x86
Linux x86-64

Symptoms

The system crashes with a kernel panic at "spin_lock+0x1e/0x25":

...
d80dbst02 login: BUG: unable to handle kernel NULL pointer dereference at
(null)
IP: [<ffffffff8145737a>] _spin_lock+0xe/0x25
PGD 0
Oops: 0002 [#1] SMP
last sysfs file: /sys/block/xvda/xvda1/stat
CPU 0
Modules linked in: autofs4(U) i2c_dev(U) i2c_core(U) hidp(U) nfs(U)
fscache(U) nfs_acl(U) auth_rpcgss(U) rfcomm(U) l2cap(U) bluetooth(U)
rfkill(U) lockd(U) sunrpc(U) be2iscsi(U) ib_iser(U) rdma_cm(U) ib_cm(U)
iw_cm(U) ib_sa(U) ib_mad(U) ib_core(U) ib_addr(U) iscsi_tcp(U) bnx2i(U)
cnic(U) uio(U) ipv6(U) cxgb3i(U) libcxgbi(U) cxgb3(U) mdio(U) libiscsi_tcp(U)
libiscsi(U) scsi_transport_iscsi(U) parport_pc(U) lp(U) parport(U)
snd_seq_dummy(U) snd_seq_oss(U) snd_seq_midi_event(U) snd_seq(U)
snd_seq_device(U) snd_pcm_oss(U) snd_mixer_oss(U) joydev(U) snd_pcm(U)
snd_timer(U) snd(U) soundcore(U) snd_page_alloc(U) xen_netfront(U) pcspkr(U)
xen_blkfront(U)
Pid: 24, comm: kswapd0 Not tainted 2.6.32-300.27.1.el5uek #1
RIP: e030:[<ffffffff8145737a>]  [<ffffffff8145737a>] _spin_lock+0xe/0x25
RSP: e02b:ffff8800bb1539d0  EFLAGS: 00010246
RAX: 0000000000010000 RBX: 0000000000000000 RCX: 0000000000457608
RDX: 0000000000000001 RSI: 0000000000000000 RDI: 0000000000000000
RBP: ffff8800bb1539d0 R08: ffff880000008e40 R09: ffff88002f354818
R10: ffff8800bad293e0 R11: ffff88004e10c370 R12: ffffea000252ab90
R13: ffffffff81acb380 R14: ffffea000252ab90 R15: 0000000000000001
FS:  00007f4b153f46e0(0000) GS:ffff880002ef3000(0000) knlGS:0000000000000000
CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000000000000000 CR3: 0000000001001000 CR4: 0000000000002660
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process kswapd0 (pid: 24, threadinfo ffff8800bb152000, task ffff8800bb1505c0)
Stack:
 ffff8800bb1539f0 ffffffff810fa6c9 ffffffff810ecef3 0000000000000000
<0> ffff8800bb153a30 ffffffff810fb0fd 00000000004576a1 0000000000000000
<0> ffffea000252ab90 ffffffff81acb380 0000000000000001 ffff8800bb153e10
Call Trace:
 [<ffffffff810fa6c9>] page_lock_anon_vma+0x30/0x3b
 [<ffffffff810ecef3>] ? __inc_zone_page_state+0x1b/0x1e
 [<ffffffff810fb0fd>] try_to_unmap_anon+0x27/0xb8
 [<ffffffff810fb956>] try_to_unmap+0x4a/0x73
 [<ffffffff810e2de0>] shrink_page_list+0x1d9/0x5c9
 [<ffffffff811161a6>] ? __pfn_to_section+0x12/0x14
 [<ffffffff811161da>] ? lookup_page_cgroup+0x32/0x48
 [<ffffffff81114d85>] ? mem_cgroup_del_lru_list+0x22/0x6c
 [<ffffffff810e1d9c>] ? __isolate_lru_page+0x1c/0x81
 [<ffffffff810e2664>] ? isolate_pages_global+0x161/0x1ba
 [<ffffffff810e1a54>] ? page_lru_base_type+0xe/0x1a
 [<ffffffff810e2220>] ? clear_active_flags+0x37/0x76
 [<ffffffff810e35b2>] shrink_list+0x3e2/0x633
 [<ffffffff810e3aca>] shrink_zone+0x2c7/0x376
 [<ffffffff810e4e4d>] kswapd+0x3b7/0x516
 [<ffffffff810e2503>] ? isolate_pages_global+0x0/0x1ba
 [<ffffffff810432be>] ? need_resched+0x23/0x2d
 [<ffffffff81077024>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff814573c0>] ? _spin_unlock_irqrestore+0x16/0x18
 [<ffffffff810e4a96>] ? kswapd+0x0/0x516
 [<ffffffff81076c7b>] kthread+0x6e/0x76
 [<ffffffff81012dea>] child_rip+0xa/0x20
 [<ffffffff81011fd1>] ? int_ret_from_sys_call+0x7/0x1b
 [<ffffffff8101275d>] ? retint_restore_args+0x5/0x6
 [<ffffffff81012de0>] ? child_rip+0x0/0x20
Code: e5 0f 1f 44 00 00 ff 14 25 50 51 ab 81 3e 81 2f 00 00 00 01 74 05 e8 26
3c de ff c9 c3 55 48 89 e5 0f 1f 44 00 00 b8 00 00 01 00 <3e> 0f c1 07 0f b7
d0 c1 e8 10 39 c2 74 07 f3 90 0f b7 17 eb f5
RIP  [<ffffffff8145737a>] _spin_lock+0xe/0x25
 RSP <ffff8800bb1539d0>
CR2: 0000000000000000
---[ end trace 4e9828ca9443f6b2 ]---
Kernel panic - not syncing: Fatal exception
Pid: 24, comm: kswapd0 Tainted: G      D    2.6.32-300.27.1.el5uek #1
Call Trace:
 [<ffffffff81450289>] ? amd_64_threshold_cpu_callback+0x277/0x2a7
 [<ffffffff810579a2>] panic+0xa5/0x162
 [<ffffffff81450085>] ? amd_64_threshold_cpu_callback+0x73/0x2a7
 [<ffffffff8100ed2f>] ? xen_restore_fl_direct_end+0x0/0x1
 [<ffffffff814573c0>] ? _spin_unlock_irqrestore+0x16/0x18
 [<ffffffff810580f5>] ? release_console_sem+0x194/0x19d
 [<ffffffff81450289>] ? amd_64_threshold_cpu_callback+0x277/0x2a7
 [<ffffffff810583be>] ? console_unblank+0x6a/0x6f
 [<ffffffff8105766f>] ? print_oops_end_marker+0x23/0x25
 [<ffffffff81450289>] ? amd_64_threshold_cpu_callback+0x277/0x2a7
 [<ffffffff814582b6>] oops_end+0xb7/0xc7
 [<ffffffff810377aa>] no_context+0x1f1/0x200
 [<ffffffff81450289>] ? amd_64_threshold_cpu_callback+0x277/0x2a7
 [<ffffffff8103793c>] __bad_area_nosemaphore+0x183/0x1a6
 [<ffffffff810379e9>] bad_area_nosemaphore+0x13/0x15
 [<ffffffff81459743>] do_page_fault+0x15d/0x299
 [<ffffffff81232230>] ? cpumask_next+0x19/0x1b
 [<ffffffff814577c5>] page_fault+0x25/0x30
 [<ffffffff8145737a>] ? _spin_lock+0xe/0x25
 [<ffffffff810fa6c9>] page_lock_anon_vma+0x30/0x3b
 [<ffffffff810ecef3>] ? __inc_zone_page_state+0x1b/0x1e
 [<ffffffff810fb0fd>] try_to_unmap_anon+0x27/0xb8
 [<ffffffff810fb956>] try_to_unmap+0x4a/0x73
 [<ffffffff810e2de0>] shrink_page_list+0x1d9/0x5c9
 [<ffffffff811161a6>] ? __pfn_to_section+0x12/0x14
 [<ffffffff811161da>] ? lookup_page_cgroup+0x32/0x48
 [<ffffffff81114d85>] ? mem_cgroup_del_lru_list+0x22/0x6c
 [<ffffffff810e1d9c>] ? __isolate_lru_page+0x1c/0x81
 [<ffffffff810e2664>] ? isolate_pages_global+0x161/0x1ba
 [<ffffffff810e1a54>] ? page_lru_base_type+0xe/0x1a
 [<ffffffff810e2220>] ? clear_active_flags+0x37/0x76
 [<ffffffff810e35b2>] shrink_list+0x3e2/0x633
 [<ffffffff810e3aca>] shrink_zone+0x2c7/0x376
 [<ffffffff810e4e4d>] kswapd+0x3b7/0x516
 [<ffffffff810e2503>] ? isolate_pages_global+0x0/0x1ba
 [<ffffffff810432be>] ? need_resched+0x23/0x2d
 [<ffffffff81077024>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff814573c0>] ? _spin_unlock_irqrestore+0x16/0x18
 [<ffffffff810e4a96>] ? kswapd+0x0/0x516
 [<ffffffff81076c7b>] kthread+0x6e/0x76
 [<ffffffff81012dea>] child_rip+0xa/0x20
 [<ffffffff81011fd1>] ? int_ret_from_sys_call+0x7/0x1b
 [<ffffffff8101275d>] ? retint_restore_args+0x5/0x6
 [<ffffffff81012de0>] ? child_rip+0x0/0x20
...

 

The output from the vmcore analysis is as follows:

crash> bt
PID: 24     TASK: ffff8800bb1745c0  CPU: 0   COMMAND: "kswapd0"
#0 [ffff8800bb1776f0] panic at ffffffff81056b95
#1 [ffff8800bb1777e0] oops_end at ffffffff8143aca6
#2 [ffff8800bb177810] no_context at ffffffff8103670a
#3 [ffff8800bb177860] __bad_area_nosemaphore at ffffffff8103695d
#4 [ffff8800bb1778b0] bad_area_nosemaphore at ffffffff81036a0a
#5 [ffff8800bb1778c0] do_page_fault at ffffffff8143c133
#6 [ffff8800bb177920] page_fault at ffffffff8143a1b5
   [exception RIP: _spin_lock+14]
   RIP: ffffffff81439d6a  RSP: ffff8800bb1779d0  RFLAGS: 00010246
   RAX: 0000000000010000  RBX: 0000000000000000  RCX: 0000000000224604
   RDX: 0000000000000001  RSI: 0000000000000000  RDI: 0000000000000000
   RBP: ffff8800bb1779d0   R8: ffff880000008e40   R9: ffff88003c8dddd8
   R10: ffff8800bb1745f8  R11: 000000000021a20f  R12: ffffea000203de00
   R13: ffffffff81a9cf60  R14: ffffea000203de00  R15: 0000000000000001
   ORIG_RAX: ffffffffffffffff  CS: e030  SS: e02b
#7 [ffff8800bb1779d8] page_lock_anon_vma at ffffffff810f882d
#8 [ffff8800bb1779f8] try_to_unmap_anon at ffffffff810f9261
#9 [ffff8800bb177a38] try_to_unmap at ffffffff810f9aba
#10 [ffff8800bb177a58] shrink_page_list at ffffffff810e10c4
#11 [ffff8800bb177ba8] shrink_list at ffffffff810e1896
#12 [ffff8800bb177d18] shrink_zone at ffffffff810e1dae
#13 [ffff8800bb177dd8] kswapd at ffffffff810e3131
#14 [ffff8800bb177ee8] kthread at ffffffff8107573f
#15 [ffff8800bb177f48] kernel_thread at ffffffff81012dea

Engineered systems may also be affected from this problem.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms