My Oracle Support Banner

Oracle Linux: Exadata Server Crash with "Kernel panic - not syncing: Unexpected ODLM enabled state " "Kernel memory overwrite attempt detected to SLUB object 'acfs_buffer_cache_4k' (offset 0, size 4096)!" (Doc ID 2683582.1)

Last updated on JUNE 30, 2020

Applies to:

Linux OS - Version Oracle Linux 7.7 with Unbreakable Enterprise Kernel [4.14.35] and later
Linux x86-64

Symptoms

Log from vmcore has this call stack.

[ 176.879406] Bad or missing usercopy whitelist? Kernel memory overwrite attempt detected to SLUB object 'acfs_buffer_cache_4k' (offset 0, size 4096)!
[ 176.879414] ------------[ cut here ]------------
[ 176.879419] WARNING: CPU: 14 PID: 62385 at mm/usercopy.c:81 usercopy_warn+0x8e/0xa6
[ 176.879419] Modules linked in: oracleacfs(PO) oracleadvm(PO) oracleoks(PO) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfsv3 target_core_mod nfs_acl nfs lockd grace sunrpc fscache scsi_transport_iscsi ipmi_poweroff ipmi_ssif bonding ib_umad mlx5_ib iTCO_wdt iTCO_vendor_support vfat fat skx_edac intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc aesni_intel crypto_simd mlx5_core glue_helper cryptd mlxfw ipmi_si ipmi_devintf ipmi_msghandler pcc_cpufreq ioatdma wmi shpchp i2c_i801 lpc_ich dm_multipath rds_rdma resilient_rdmaip ib_ipoib rds rdma_ucm rdma_cm sg binfmt_misc iw_cm ib_cm ib_uverbs fuse ib_core ip_tables xfs libcrc32c sd_mod ahci igb libahci megaraid_sas bnxt_en libata crc32c_intel ptp pps_core i2c_algo_bit dca dm_mirror dm_region_hash
[ 176.879457] dm_log dm_mod
[ 176.879459] CPU: 14 PID: 62385 Comm: apx_vi00_+apx2 Tainted: P O 4.14.35-1902.5.1.4.el7uek.x86_64 #2
[ 176.879460] Hardware name: Oracle Corporation ORACLE SERVER X8-2/ASM,MB,X8-2, BIOS 51020500 08/26/2019
[ 176.879460] task: ffff9046d4060000 task.stack: ffffb1eeb92c0000
[ 176.879462] RIP: 0010:usercopy_warn+0x8e/0xa6
[ 176.879463] RSP: 0018:ffffb1eeb92c3a88 EFLAGS: 00010246
[ 176.879463] RAX: 0000000000000088 RBX: ffffffffba1e8845 RCX: 0000000000000000
[ 176.879464] RDX: 0000000000000000 RSI: ffff90aa409969c8 RDI: ffff90aa409969c8
[ 176.879464] RBP: ffffb1eeb92c3aa8 R08: 0000000000000000 R09: 0000000000000a8d
[ 176.879465] R10: 0000000000000004 R11: 0000000000000a8c R12: 0000000000001000
[ 176.879465] R13: ffff91143eda1000 R14: 0000000000000000 R15: 0000000000000000
[ 176.879466] FS: 00007f0e5c2ba3c0(0000) GS:ffff90aa40980000(0000) knlGS:0000000000000000
[ 176.879467] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 176.879467] CR2: 00000000682cfcc0 CR3: 00000063fa3d8006 CR4: 00000000007606e0
[ 176.879468] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 176.879468] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 176.879469] PKRU: 55555554
[ 176.879469] Call Trace:
[ 176.879474] __check_heap_object+0xb8/0x11b
[ 176.879475] __check_object_size+0xe3/0x1bc
[ 176.879494] KsCopyinTSD+0x40/0x60 [oracleoks]
[ 176.879520] Asmuio_copyinoutData+0x98/0x138 [oracleadvm]
[ 176.879528] Asmuio_complete+0xc32/0xd84 [oracleadvm]
[ 176.879535] Asm_userIoCtlIoctl+0x265/0x13ce [oracleadvm]
[ 176.879540] ? rds_next_incoming+0x71/0x90 [rds]
[ 176.879542] ? rds_recvmsg+0xb3/0x620 [rds]
[ 176.879550] AsmIoctl+0xab6/0x2779 [oracleadvm]
[ 176.879557] ? AsmIoctl+0xab6/0x2779 [oracleadvm]
[ 176.879560] ? ___sys_recvmsg+0x163/0x1e6
[ 176.879570] asmIoctl_int.isra.26+0x1c6/0x424 [oracleadvm]
[ 176.879579] asmIoctl+0x13/0x15 [oracleadvm]
[ 176.879581] blkdev_ioctl+0x878/0x912
[ 176.879583] block_ioctl+0x41/0x45
[ 176.879585] do_vfs_ioctl+0xaa/0x602
[ 176.879589] ? __audit_syscall_entry+0xac/0xef
[ 176.879591] ? syscall_trace_enter+0x1ce/0x2b8
[ 176.879593] SyS_ioctl+0x79/0x84
[ 176.879594] do_syscall_64+0x79/0x1b9
[ 176.879597] entry_SYSCALL_64_after_hwframe+0x169/0x0
[ 176.879598] RIP: 0033:0x7f0e57d1c2f7
[ 176.879598] RSP: 002b:00007ffe1a059498 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 176.879599] RAX: ffffffffffffffda RBX: 00000000c0807683 RCX: 00007f0e57d1c2f7
[ 176.879600] RDX: 00007ffe1a059690 RSI: 00000000c0807683 RDI: 000000000000002a
[ 176.879601] RBP: 00007ffe1a059510 R08: 0000000000000083 R09: 00007ffe1a059690
[ 176.879601] R10: 0000000000000083 R11: 0000000000000246 R12: 0000000000000000
[ 176.879602] R13: 0000000000000083 R14: 00007f0e5c1a17f8 R15: 00007ffe1a059538
[ 176.879603] Code: 1d ba 48 0f 45 f2 4c 89 44 24 10 48 89 c2 48 89 4c 24 08 48 89 1c 24 4d 89 d8 4c 89 d1 48 c7 c7 a8 88 1e ba 31 c0 e8 65 e6 e7 ff <0f> 0b 48 83 c4 18 5b 5d c3 49 c7 c1 f1 74 1f ba 4c 89 cb 4d 89


[2984845.447554] Kernel panic - not syncing: Unexpected ODLM enabled state !
[2984845.455277] CPU: 61 PID: 62444 Comm: oks_comm Tainted: P W O 4.14.35-1902.5.1.4.el7uek.x86_64 #2
[2984845.466555] Hardware name: Oracle Corporation ORACLE SERVER X8-2/ASM,MB,X8-2, BIOS 51020500 08/26/2019
[2984845.477340] Call Trace:
[2984845.480320] dump_stack+0x63/0x7f
[2984845.484285] panic+0xe8/0x24d
[2984845.487867] __KsPanic+0xb3/0xc0 [oracleoks]
[2984845.492938] ? DLM_LOG+0x5a/0x80 [oracleoks]
[2984845.497989] odlm_process_message+0x158e/0x2bf0 [oracleoks]
[2984845.504522] ? DLM_LOG+0x5a/0x80 [oracleoks]
[2984845.509578] odlm_msg+0xa1/0x130 [oracleoks]
[2984845.514620] odlm_comm_worker+0x6a7/0xc20 [oracleoks]
[2984845.520616] ? odlm_inline_msg+0x10/0x10 [oracleoks]
[2984845.526473] KsKthreadRun+0x4c/0x90 [oracleoks]
[2984845.531832] kthread+0x105/0x138
[2984845.535725] ? KsDelayThreadCommon+0xc0/0xc0 [oracleoks]
[2984845.542045] ? kthread_bind+0x20/0x15
[2984845.546406] ret_from_fork+0x24/0x49   
 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.