UEK2 Kernel Panic on "RIP [<ffffffffa03cec5e>] nfs_increment_seqid+0x5e/0x70 [nfs]" .

(Doc ID 2308353.1)

Last updated on SEPTEMBER 20, 2017

Applies to:

Linux OS - Version Oracle Linux 6.1 with Unbreakable Enterprise Kernel [2.6.39] and later
Linux x86-64

Symptoms

Exalogic node installed with Oracle Linux Server release 6.7 and kernel version 2.6.39-400.264.1.el6uek.x86_64 was rebooted unexpectedly.

The below Call-traces and error been observed in /var/log/message 

Jul 17 16:15:01 localhost CROND[18176]: (root) CMD (/usr/sbin/ntpd -q -u ntp:ntp)
Jul 17 16:15:01 localhost ntpd[18176]: ntpd 4.2.6p5@1.2349-o Mon Jan 25 14:30:07 UTC 2016 (1)
Jul 17 16:15:01 localhost ntpd[18176]: proto: precision = 0.160 usec
Jul 17 16:15:01 localhost ntpd[18176]: 0.0.0.0 c01d 0d kern kernel time sync enabled
Jul 17 16:15:01 localhost ntpd[18176]: ntp_io: estimated max descriptors: 65536, initial socket boundary: 16
Jul 17 16:15:01 localhost ntpd[18176]: unable to bind to wildcard address 0.0.0.0 - another process may be running - EXITING
Jul 17 16:38:21 localhost kernel: nfs4_reclaim_open_state: Lock reclaim failed!
Jul 17 16:42:36 localhost kernel: imklog 5.8.10, log source = /proc/kmsg started.
Jul 17 16:42:36 localhost rsyslogd: [origin software="rsyslogd" swVersion="5.8.10" x-pid="1652" x-info="http://www.rsyslog.com"] start
Jul 17 16:42:36 localhost kernel: Initializing cgroup subsys cpuset
Jul 17 16:42:36 localhost kernel: Initializing cgroup subsys cpu
Jul 17 16:42:36 localhost kernel: Linux version 2.6.39-400.264.1.el6uek.x86_64 (mockbuild@x86-ol6-builder-06) (gcc version 4.4.6 20110731 (Red Hat 4.4.6-3) (GCC) ) #1 SMP Wed Aug 26 16:42:25 PDT 2015
Jul 17 16:42:36 localhost kernel: Command line: ro root=/dev/mapper/VolGroup00-LogVol00 rd_NO_LUKS LANG=en_US.UTF-8 rd_NO_MD SYSFONT=latarcyrheb-sun16 rd_LVM_LV=VolGroup01/LogVol01 rd_LVM_LV=VolGroup00/LogVol00 KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM console=ttyS0,9600n8 enable_fast_entropy audit=1
Jul 17 16:42:36 localhost kernel: BIOS-provided physical RAM map:
Jul 17 16:42:36 localhost kernel: BIOS-e820: 0000000000000000 - 000000000009e000 (usable)
Jul 17 16:42:36 localhost kernel: BIOS-e820: 000000000009e000 - 00000000000a0000 (reserved)
Jul 17 16:42:36 localhost kernel: BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)

vmcore logs :

------------[ cut here ]------------
kernel BUG at fs/nfs/nfs4state.c:931!
invalid opcode: 0000 [#1] SMP
CPU 3
Modules linked in: ovmapi nfs lockd fscache auth_rpcgss nfs_acl sunrpc rdma_ucm(U) ib_sdp(U) rdma_cm(U) iw_cm(U) ib_addr(U) bonding ib_ipoib(U) ib_cm(U) ipv6 ib_uverbs(U) ib_umad(U) mlx4_vnic(U) mlx4_vnic_helper(U) mlx4_ib(U) ib_sa(U) ib_mad(U) ib_core(U) mlx4_core(U) ppdev parport_pc parport microcode pcspkr i2c_piix4 i2c_core ext4 mbcache jbd2 xen_blkfront pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_wait_scan]

Pid: 438, comm: kworker/3:1 Not tainted 2.6.39-400.264.1.el6uek.x86_64 #1 Xen HVM domU
RIP: 0010:[<ffffffffa03cec5e>] [<ffffffffa03cec5e>] nfs_increment_seqid+0x5e/0x70 [nfs]
RSP: 0018:ffff8804ffb17c50 EFLAGS: 00010293
RAX: ffff8805dbb97620 RBX: ffff8804ffb17cf0 RCX: 000000000000001d
RDX: ffff8805dbb976f8 RSI: ffff8805d9ac0960 RDI: 00000000ffffd8e3
RBP: ffff8804ffb17c50 R08: ffff880416ac9030 R09: 0000000000000002
R10: 0000000000000001 R11: 0000000000000000 R12: ffff880416ac9030
R13: ffff8805ce613130 R14: ffffffffa03ca1c0 R15: ffff8805d67a5800
FS: 0000000000000000(0000) GS:ffff88060fc60000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000000783f7400c CR3: 00000005d9dcb000 CR4: 00000000001006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process kworker/3:1 (pid: 438, threadinfo ffff8804ffb16000, task ffff880440420040)
Stack:
ffff8804ffb17c60 ffffffffa03cec7e ffff8804ffb17cd0 ffffffffa03ca241
0000000000000000 00000000ffffd8e3 000000020000271d ffff880440420040
ffff880500000000 ffff88045dc08210 0000000000000000 00000002c1460e04
Call Trace:
[<ffffffffa03cec7e>] nfs_increment_lock_seqid+0xe/0x10 [nfs]
[<ffffffffa03ca241>] nfs4_xdr_dec_locku+0x81/0xa0 [nfs]
[<ffffffffa031305f>] rpcauth_unwrap_resp+0x9f/0xd0 [sunrpc]
[<ffffffffa03097e5>] ? rpc_verify_header+0x1d5/0x5f0 [sunrpc]
[<ffffffffa03ca1c0>] ? encode_opentype+0x140/0x140 [nfs]
[<ffffffffa0312170>] ? rpc_execute+0x50/0x50 [sunrpc]
[<ffffffffa0309d6e>] call_decode+0x16e/0x230 [sunrpc]
[<ffffffffa0311fb6>] __rpc_execute+0x66/0x1d0 [sunrpc]
[<ffffffffa0312170>] ? rpc_execute+0x50/0x50 [sunrpc]
[<ffffffffa031219a>] rpc_async_schedule+0x2a/0x40 [sunrpc]
[<ffffffff8108a7c6>] process_one_work+0x136/0x450
[<ffffffff8108bda0>] worker_thread+0x170/0x3c0
[<ffffffff8108bc30>] ? manage_workers+0x120/0x120
[<ffffffff81090fe6>] kthread+0x96/0xa0
[<ffffffff81517884>] kernel_thread_helper+0x4/0x10
[<ffffffff81090f50>] ? kthread_worker_fn+0x1a0/0x1a0
[<ffffffff81517880>] ? gs_change+0x13/0x13
Code: 00 00 48 d3 e2 f7 c2 01 68 05 00 75 ee 80 e6 04 74 e5 f6 40 08 01 75 e3 48 89 c6 48 c7 c7 d8 4f 3e a0 31 c0 e8 45 c8 13 e1 c9 c3 <0f> 0b eb fe 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 89
RIP [<ffffffffa03cec5e>] nfs_increment_seqid+0x5e/0x70 [nfs]
RSP <ffff8804ffb17c50>
---[ end trace fcf9843d4ee82de5 ]---

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms