My Oracle Support Banner

Oracle Linux : Server Running Oracle Database With ASM ACFS Crashes With "RIP: 0010: kill_rules+0x14/0x160" (Doc ID 2615274.1)

Last updated on DECEMBER 20, 2019

Applies to:

Linux OS - Version Oracle Linux 6.0 and later
Linux x86-64

Symptoms

An Oracle Linux server running Oracle Database with ASM/ACFS crashes with the following message. 
Crash analysis of the vmcore dump file denotes the following :

crash64> sys
KERNEL: vmlinux
DUMPFILE:
re [PARTIAL DUMP]
CPUS: 96
DATE: Thu Sep 26 12:43:32 2019
UPTIME: 40 days, 02:03:34
LOAD AVERAGE: 3.12, 3.31, 3.73
TASKS: 6904
NODENAME:
RELEASE: 4.1.12-124.28.3.el7uek.x86_64
VERSION: #2 SMP Tue Jun 11 00:43:49 PDT 2019
MACHINE: x86_64 (2100 Mhz)
MEMORY: 1534.7 GB
PANIC: "general protection fault: 0000 [#1] SMP "
crash64> log
[6051952.149592] AFDK-00010: AFD log opened at location /u01/app/grid/crsdata/edubdbamysql801/afd/afd.log.8.
[6218820.631249] BUG: unable to handle kernel paging request at 00000002738dabb6
[6218820.638541] IP: [<ffffffff81139e64>] kill_rules+0x14/0x160
[6218820.644341] PGD 80000008c1277067 PUD 0
[6218820.648508] Oops: 0000 [#1] SMP
[6218820.652114] Dumping ftrace buffer:
[6218820.655834] (ftrace buffer empty)
[6218820.659740] Modules linked in: dell_rbu rds oracleacfs(PO) oracleadvm(PO) oracleoks(PO) mpt3sas raid_class scsi_transport_sas mptctl mptbase oracleafd(PO) ipmi_devintf nfsv3 nfs_acl nfs lockd grace fscache bonding coretemp kvm crct10dif_pclmul ipmi_ssif crc32_pclmul ghash_clmulni_intel dcdbas aesni_intel lrw dm_queue_length gf128mul glue_helper ablk_helper cryptd sg pcspkr shpchp wmi ipmi_si ipmi_msghandler acpi_cpufreq acpi_pad acpi_power_meter dm_multipath binfmt_misc auth_rpcgss sunrpc ip_tables xfs libcrc32c ixgbe mdio vxlan igb ip6_udp_tunnel udp_tunnel ptp sd_mod qla2xxx crc32c_intel scsi_transport_fc i2c_algo_bit pps_core ahci i2c_core dca libahci megaraid_sas libata dm_mirror dm_region_hash dm_log dm_mod [last unloaded: dell_rbu]
[6218820.728043] CPU: 34 PID: 207608 Comm: java Tainted: P O 4.1.12-124.26.10.el7uek.x86_64 #2
[6218820.737829] Hardware name: Dell Inc. PowerEdge R740/0JMK61, BIOS 1.6.13 12/17/2018
[6218820.745790] task: ffff881fe3bd7000 ti: ffff8804bda08000 task.ti: ffff8804bda08000
[6218820.753667] RIP: 0010:[<ffffffff81139e64>] [<ffffffff81139e64>] kill_rules+0x14/0x160
[6218820.762008] RSP: 0018:ffff8804bda0be80 EFLAGS: 00010282
[6218820.767602] RAX: ffff881fe3bd7000 RBX: 00000002738dabc6 RCX: 0000000000000001
[6218820.775132] RDX: 0000000000000001 RSI: fffffffffffffe00 RDI: 00000002738dab96
[6218820.782665] RBP: ffff8804bda0bea0 R08: ffff8804bda0bd98 R09: 0000000000000246
[6218820.790196] R10: 0000000000000000 R11: 0000000000000000 R12: 00000002738dab96
[6218820.797735] R13: ffff8803a24cbaf8 R14: 00000002738dabb6 R15: 00007f0fb60df7b0
[6218820.805266] FS: 00007f0fb60e0700(0000) GS:ffff881ffce40000(0000) knlGS:0000000000000000
[6218820.813754] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[6218820.819790] CR2: 00000002738dabb6 CR3: 00000018087e0000 CR4: 0000000000360670
[6218820.827319] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[6218820.834850] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[6218820.842379] Stack:
[6218820.844688] 00000002738dabc6 00000002738dab96 ffff8803a24cbaf8 00007f102e14fd60
[6218820.852573] ffff8804bda0bed0 ffffffff8113b9e4 0000000000000000 ffff8803a24cb800
[6218820.860458] 00007f102851b200 ffff881fe3bd7000 ffff8804bda0bf10 ffffffff81137e60
[6218820.868333] Call Trace:
[6218820.871077] [<ffffffff8113b9e4>] audit_kill_trees+0x34/0x90
[6218820.877025] [<ffffffff81137e60>] __audit_syscall_exit+0xa0/0x280
[6218820.883407] [<ffffffff81028b66>] syscall_trace_leave+0xc6/0x150
[6218820.889700] [<ffffffff81756a7e>] int_very_careful+0x1b/0x24
[6218820.895646] Code: 80 48 c7 c6 40 ae 13 81 48 89 e5 e8 d7 83 fb ff 5d c3 0f 1f 44 00 00 0f 1f 44 00 00 55 48 89 e5 41 56 4c 8d 77 20 41 55 41 54 53 <4c> 8b 67 20 49 8b 04 24 4d 39 f4 49 8d 9c 24 b8 fe ff ff 4c 8d
[6218820.916629] RIP [<ffffffff81139e64>] kill_rules+0x14/0x160
[6218820.922508] RSP <ffff8804bda0be80>
[6218820.926285] CR2: 00000002738dabb6

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.