My Oracle Support Banner

OL6: System Panic with "show_vfsmnt" (Doc ID 2573986.1)

Last updated on AUGUST 09, 2019

Applies to:

Linux OS - Version Oracle Linux 6.0 and later
Linux x86
Linux x86-64

Symptoms

Exadata node got crashed with below call trace:

SYS:


KERNEL: /share/linuxrpm/vmlinux_repo/64/nano/4.1.12-61.47.1.el6uek.x86_64/vmlinux
DUMPFILE: ./127.0.0.1-2019-07-23-11_01_17/<HOSTNAME>.vmcore [PARTIAL DUMP]
CPUS: 20
DATE: Tue Jul 23 09:00:22 2019
UPTIME: 21 days, 17:41:31
LOAD AVERAGE: 7.51, 7.84, 7.96
TASKS: 8987
NODENAME: <HOSTNAME>
RELEASE: 4.1.12-61.47.1.el6uek.x86_64
VERSION: #2 SMP Fri Jun 23 19:43:18 PDT 2017
MACHINE: x86_64 (2194 Mhz)
MEMORY: 511.9 GB
PANIC: "BUG: unable to handle kernel NULL pointer dereference at 0000000000000080"

LOG:

[1879961.015475] device ib0 entered promiscuous mode
[1879961.048149] device bondeth0 left promiscuous mode
[1879961.048160] device eth4 left promiscuous mode
[1879961.048463] device eth5 left promiscuous mode
[1879961.501989] device ib0 left promiscuous mode
[1879962.128722] BUG: unable to handle kernel NULL pointer dereference at 0000000000000080
[1879962.138102] IP: [<ffffffff8124489a>] show_vfsmnt+0x3a/0x190
[1879962.144735] PGD 48e1483067 PUD 4b4a0fa067 PMD 0
[1879962.150315] Oops: 0000 [#1] SMP
[1879962.154326] Modules linked in: mpt3sas scsi_transport_sas raid_class oracleacfs(PO) oracleadvm(PO) oracleoks(PO) ip_vs nf_conntrack libcrc32c nfsd auth_rpcgss ipmi_poweroff ipmi_devintf nfsv3 nfs_acl nfs fscache lockd sunrpc grace bonding rds_rdma rds ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad mlx4_ib mlx4_core bnx2i cnic uio cxgb4i libcxgbi cxgb4 ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ipv6 dm_round_robin dm_multipath fuse iTCO_wdt iTCO_vendor_support sb_edac edac_core i2c_i801 lpc_ich mfd_core sg ixgbe dca ptp pps_core vxlan udp_tunnel ip6_udp_tunnel mdio ipmi_ssif i2c_core ipmi_si ipmi_msghandler wmi acpi_pad ext4 jbd2 mbcache2 sd_mod ahci libahci megaraid_sas dm_mirror dm_region_hash dm_log dm_mod
[1879962.233843] CPU: 12 PID: 315332 Comm: lsof Tainted: P O 4.1.12-61.47.1.el6uek.x86_64 #2
[1879962.244655] Hardware name: Oracle Corporation ORACLE SERVER X6-2/ASM,MOTHERBOARD,1U, BIOS 38080000 05/08/2017
[1879962.256320] task: ffff885a45b18e00 ti: ffff88060d350000 task.ti: ffff88060d350000
[1879962.265266] RIP: 0010:[<ffffffff8124489a>] [<ffffffff8124489a>] show_vfsmnt+0x3a/0x190
[1879962.274805] RSP: 0018:ffff88060d353d48 EFLAGS: 00010286
[1879962.281130] RAX: 0000000000000000 RBX: ffff885203898180 RCX: ffff88060d353cd4
[1879962.289672] RDX: 0000000000077cb8 RSI: ffff880e9af4be00 RDI: ffff885203898180
[1879962.298211] RBP: ffff88060d353d88 R08: ffff88060d353d48 R09: 0000000000000faa
[1879962.306757] R10: ffffffff8196118d R11: ffff887f639b1800 R12: ffff887f639b1820
[1879962.315300] R13: ffff88169c63d000 R14: 0000000000001000 R15: ffff88060d353de0
[1879962.323833] FS: 00007ff23442a7a0(0000) GS:ffff883f7fb80000(0000) knlGS:0000000000000000
[1879962.333444] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[1879962.340310] CR2: 0000000000000080 CR3: 00000048e6b6f000 CR4: 00000000003406e0
[1879962.348896] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[1879962.357449] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[1879962.365984] Stack:
[1879962.368620] ffff887f639b1820 ffff880e9af4be00 ffff887f639b1800 ffff8807ed6a0b00
[1879962.377525] ffff885203898180 ffff887f639b1888 0000000000001000 ffff88060d353de0
[1879962.386437] ffff88060d353d98 ffffffff812243d6 ffff88060d353e18 ffffffff8122a25b
[1879962.395326] Call Trace:
[1879962.398491] [<ffffffff812243d6>] m_show+0x16/0x20
[1879962.404235] [<ffffffff8122a25b>] seq_read+0xbb/0x400
[1879962.410267] [<ffffffff81204df4>] __vfs_read+0x34/0x100
[1879962.416496] [<ffffffff812aa089>] ? security_file_permission+0x89/0x90
[1879962.424186] [<ffffffff81204f1d>] ? rw_verify_area+0x5d/0xe0
[1879962.430898] [<ffffffff81205038>] vfs_read+0x98/0xe0
[1879962.436836] [<ffffffff81222ba3>] ? __fdget+0x13/0x20
[1879962.442868] [<ffffffff81205a96>] SyS_read+0x56/0xd0
[1879962.448901] [<ffffffff810257a1>] ? syscall_trace_leave+0xf1/0x160
[1879962.456202] [<ffffffff8169db6e>] system_call_fastpath+0x12/0x71
[1879962.463302] Code: e0 4c 89 6d e8 4c 89 75 f0 4c 89 7d f8 0f 1f 44 00 00 49 89 f4 48 8b 36 48 89 fb 4c 89 65 c0 48 89 75 c8 4c 8b 6e 68 49 8b 45 30 <48> 8b 80 80 00 00 00 48 85 c0 0f 84 16 01 00 00 ff d0 85 c0 41
[1879962.486151] RIP [<ffffffff8124489a>] show_vfsmnt+0x3a/0x190
[1879962.492878] RSP <ffff88060d353d48>
[1879962.497156] CR2: 0000000000000080

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.