Oracle Linux : Continuous node reboot with kernel BUG at fs/ocfs2/alloc.c:1760! (Doc ID 2662729.1)

Last updated on NOVEMBER 08, 2023

Applies to:

Symptoms

The continuous reboot of nodes with below call trace.

KERNEL: /share/linuxrpm/vmlinux_repo/64/4.1.12-112.14.15.el6uek.x86_64/vmlinux
DUMPFILE: vmcore-new
CPUS: 20 [OFFLINE: 19]
DATE: Fri Mar 6 08:05:55 2020
UPTIME: 00:04:21
LOAD AVERAGE: 0.78, 0.94, 0.45
TASKS: 854
NODENAME: node
RELEASE: 4.1.12-112.14.15.el6uek.x86_64
VERSION: #2 SMP Thu Feb 8 10:00:23 PST 2018
MACHINE: x86_64 (2294 Mhz)
MEMORY: 11.2 GB
PANIC: <strong>"kernel BUG at fs/ocfs2/alloc.c:2928!"</strong>
PID: 899
COMMAND: "kworker/u40:2"
TASK: ffff88033bec8e00 [THREAD_INFO: ffff880005a58000]
CPU: 4
STATE: TASK_RUNNING (PANIC)


<strong>[ 767.500117] kernel BUG at fs/ocfs2/alloc.c:1760!</strong>
[ 767.500122] invalid opcode: 0000 [#1] SMP
[ 767.500131] Modules linked in: ocfs2 jbd2 xen_netback xen_blkback
xen_gntalloc xen_gntdev xen_evtchn ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm
ocfs2_nodemanager ocfs2_stackglue configfs bnx2fc fcoe libfcoe libfc sunrpc
ipmi_devintf 8021q mrp garp bridge stp llc xsvhba scsi_transport_fc xve
xsvnic xscore ib_iser iscsi_tcp bonding ib_ipoib rdma_ucm ib_ucm ib_uverbs
ib_umad rdma_cm ib_cm iw_cm mlx4_ib ib_sa ib_mad ib_core ib_addr mlx4_core
xenfs xen_privcmd dm_round_robin dm_multipath iTCO_wdt iTCO_vendor_support
pcspkr i2c_i801 lpc_ich mfd_core cdc_ether usbnet mii ioatdma ipmi_ssif
i2c_core ipmi_si ipmi_msghandler sg ext3 jbd mbcache sd_mod ahci libahci
ixgbe dca ptp pps_core vxlan udp_tunnel ip6_udp_tunnel megaraid_sas
crc32c_intel be2iscsi bnx2i cnic uio cxgb4i cxgb4 cxgb3i libcxgbi ipv6 cxgb3
mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi wmi
dm_mirror dm_region_hash dm_log dm_mod scsi_dh_alua
[ 767.500333] CPU: 17 PID: 4302 Comm: kworker/u40:16 Not tainted 4.1.12-112.14.15.el6uek.x86_64 #2
[ 767.500341] Hardware name: Oracle Corporation ORACLE SERVER X5-2/ASM,MOTHERBOARD,1U, BIOS 30100400 12/26/2016
[ 767.500385] Workqueue: ocfs2_wq ocfs2_complete_recovery [ocfs2]
[ 767.500393] task: ffff88033df87000 ti: ffff880068fb0000 task.ti:ffff880068fb0000
[ 767.500400] RIP: e030:[&lt;ffffffffa07bb241&gt;] [&lt;ffffffffa07bb241&gt;] ocfs2_find_subtree_root+0x81/0x170 [ocfs2]
[ 767.500425] RSP: e02b:ffff880068fb35a8 EFLAGS: 00010296
[ 767.500431] RAX: 0000000000000096 RBX: 000000000073d908 RCX:0000000000000006
[ 767.500437] RDX: 0000000000000007 RSI: 0000000000000007 RDI:ffff8803576515d0
[ 767.500444] RBP: ffff880068fb3618 R08: 000000000000fffe R09:0000000000004566
[ 767.500450] R10: 0000000000000000 R11: 0000000000000000 R12:0000000000000002
[ 767.500457] R13: 0000000000000002 R14: ffff88033df87000 R15:ffff88033df87918
[ 767.500471] FS: 0000000000000000(0000) GS:ffff880357640000(0000) knlGS:0000000000000000
[ 767.500478] CS: e033 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 767.500484] CR2: 0000000000b5c008 CR3: 0000000001ada000 CR4:0000000000042660
[ 767.500492] Stack:
[ 767.500495] 00000000022ca50b ffff880200000002 ffff880000000002 000000000073d908
[ 767.500507] 000000000073d908 ffffffffa07b93ce ffff880068fb3618 000000000073d908
[ 767.500517] ffff8802d4b0b030 0000000000000000 ffff880068fb39a8 ffff8802f395de40
[ 767.500528] Call Trace:
[ 767.500547] [&lt;ffffffffa07b93ce&gt;] ? ocfs2_path_bh_journal_access+0x3e/0x40 [ocfs2]
[ 767.500570] [&lt;ffffffffa07c59f5&gt;] ocfs2_remove_rightmost_path+0x475/0x5e0 [ocfs2]
[ 767.500600] [&lt;ffffffffa07fb837&gt;] ? __ocfs2_journal_access+0x277/0x350 [ocfs2]
[ 767.500621] [&lt;ffffffffa07c6693&gt;] ocfs2_rotate_tree_left+0x3f3/0x4e0 [ocfs2]
[ 767.500643] [&lt;ffffffffa07c6d35&gt;] ocfs2_truncate_rec+0x5b5/0x860 [ocfs2]
[ 767.500663] [&lt;ffffffffa07bf0e7&gt;] ? __ocfs2_find_path+0x187/0x2d0 [ocfs2]
[ 767.500683] [&lt;ffffffffa07c129e&gt;] ? ocfs2_new_path+0x3e/0x70 [ocfs2]
[ 767.500704] [&lt;ffffffffa07c72f0&gt;] ocfs2_remove_extent+0x310/0x7c0 [ocfs2]
[ 767.500742] [&lt;ffffffffa083e4f9&gt;] ? ocfs2_metadata_cache_io_unlock+0x19/0x30 [ocfs2]
[ 767.500771] [&lt;ffffffffa07fb837&gt;] ? __ocfs2_journal_access+0x277/0x350 [ocfs2]
[ 767.500792] [&lt;ffffffffa07c7cdb&gt;] ocfs2_remove_btree_range+0x53b/0x7f0 [ocfs2]
[ 767.500812] [&lt;ffffffffa07bf0e7&gt;] ? __ocfs2_find_path+0x187/0x2d0 [ocfs2]
[ 767.500833] [&lt;ffffffffa07cab74&gt;] ocfs2_commit_truncate+0x1c4/0x760 [ocfs2]
[ 767.500862] [&lt;ffffffffa07fba30&gt;] ? ocfs2_journal_access_eb+0x20/0x20 [ocfs2]
[ 767.500875] [&lt;ffffffff8120fe83&gt;] ? __sb_end_write+0x33/0x70
[ 767.500900] [&lt;ffffffffa07f419e&gt;] ocfs2_truncate_for_delete+0xbe/0x380 [ocfs2]
[ 767.500925] [&lt;ffffffffa07f4aae&gt;] ocfs2_wipe_inode+0xee/0x620 [ocfs2]
[ 767.500948] [&lt;ffffffffa07f52c0&gt;] ocfs2_delete_inode+0x2e0/0x420 [ocfs2]
[ 767.500957] [&lt;ffffffff81237799&gt;] ?__inode_wait_for_writeback+0x69/0xc0
[ 767.500981] [&lt;ffffffffa07f5df8&gt;] ocfs2_evict_inode+0x28/0x60 [ocfs2]
[ 767.500990] [&lt;ffffffff812294bb&gt;] evict+0xab/0x1a0
[ 767.500998] [&lt;ffffffff812296a6&gt;] iput_final+0xf6/0x190
[ 767.501006] [&lt;ffffffff81229848&gt;] iput+0x108/0x120
[ 767.501029] [&lt;ffffffffa07fa0b9&gt;] ocfs2_recover_orphans+0x109/0x650 [ocfs2]
[ 767.501052] [&lt;ffffffffa07fa80e&gt;] ocfs2_complete_recovery+0x20e/0x580 [ocfs2]
[ 767.501062] [&lt;ffffffff810a28c9&gt;] process_one_work+0x159/0x4c0
[ 767.501070] [&lt;ffffffff8100c3d2&gt;] ? check_events+0x12/0x20
[ 767.501077] [&lt;ffffffff810a3480&gt;] worker_thread+0x120/0x490
[ 767.501085] [&lt;ffffffff816ecd20&gt;] ? __schedule+0x250/0x630
[ 767.501092] [&lt;ffffffff810a3360&gt;] ? maybe_create_worker+0x120/0x120
[ 767.501099] [&lt;ffffffff810a3360&gt;] ? maybe_create_worker+0x120/0x120
[ 767.501107] [&lt;ffffffff810a8f4e&gt;] kthread+0xce/0xf0
[ 767.501115] [&lt;ffffffff810a8e80&gt;] ? kthread_freezable_should_stop+0x70/0x70^M^
[ 767.501138] Code: 48 83 c4 48 5b 41 5c 41 5d 41 5e 41 5f c9 c3 49 bd 00 00
00 00 00 00 00 10 4c 85 2d aa 71 f3 ff 74 09 4c 85 2d e1 92 f3 ff 74 08 &lt;0f&gt;
0b eb fe 0f 0b eb fe 65 8b 0d e0 1e 85 5f 65 4c 8b 34 25 00
[ 767.501222] RIP [&lt;ffffffffa07bb241&gt;] <strong>ocfs2_find_subtree_root+0x81/0x170 [ocfs2]</strong>
[ 767.501244] RSP &lt;ffff880068fb35a8&gt;
[ 767.501704] ---[ end trace d198c4c3ae67356c ]---
[ 767.522979] Kernel panic - not syncing: Fatal exception
[ 767.523014] Kernel Offset: disabled

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.