My Oracle Support Banner

Nvme Based mdadm Devices Showing Degraded Status (Doc ID 2555887.1)

Last updated on MAY 24, 2020

Applies to:

Linux OS - Version Oracle Linux 6.9 with Unbreakable Enterprise Kernel [4.1.12] and later
Linux x86-64

Symptoms

Software raid disks frequently became in degraded mode.

Output from:

# cat /proc/mdstat
/dev/md24:
 Container : /dev/md/imsm1, member 0
 Raid Level : raid1
 Array Size : 262144000 (250.00 GiB 268.44 GB)
Used Dev Size : 262144000 (250.00 GiB 268.44 GB)
 Raid Devices : 2
Total Devices : 1

 State : active, degraded <
Active Devices : 1
Working Devices : 1
Failed Devices : 0
Spare Devices : 0


 UUID : xxxxxxxx:xxxxxxxx:xxxxxxxx:xxxxxxxx
 Number Major Minor RaidDevice State
 - 0 0 0 removed
 0 259 5 1 active sync /dev/nvme0n1

 

From dmesg output:

[3247695.002637] ------------[ cut here ]------------
[3247695.002656] WARNING: CPU: 83 PID: 5968 at drivers/nvme/host/pci.c:539 nvme_setup_prps+0x2f8/0x360 [ksplice_td0cdsll_nvme_new]()
[3247695.002658] Invalid SGL for payload:14336 nents:5
[3247695.002659] Modules linked in: rpcsec_gss_krb5 auth_rpcgss nfsv4 ...
...
... nvme nvme_core xhci_pci xhci_hcd dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ksplice_td0cdsll_nvme_old]
[3247695.002813] CPU: 83 PID: 5968 Comm: kworker/83:1H Tainted: P O 4.1.12-94.7.8.el6uek.x86_64 #2
[3247695.002814] Hardware name: Oracle Corporation ORACLE SERVER X7-8/SMOD TOP LEVEL ASSY, BIOS 47017600 10/06/2017
[3247695.002822] Workqueue: kblockd blk_mq_run_work_fn
[3247695.002823] 0000000000000000 ffff88be8bbdfab8 ffffffff816b4c5d ffff88be8bbdfb08
[3247695.002825] 000000000000021b ffff88be8bbdfaf8 ffffffff81088315 ffff88be8bbdfb28
[3247695.002827] 0000000000000002 00000000fffff800 0000000000000800 000002d1c8254000
[3247695.002829] Call Trace:
[3247695.002838] [<ffffffff816b4c5d>] dump_stack+0x63/0x86
[3247695.002845] [<ffffffff81088315>] warn_slowpath_common+0x95/0xe0
[3247695.002847] [<ffffffff81088416>] warn_slowpath_fmt+0x46/0x50
[3247695.002851] [<ffffffffa15d62f8>] nvme_setup_prps+0x2f8/0x360 [ksplice_td0cdsll_nvme_new]
[3247695.002854] [<ffffffffa15d648f>] nvme_map_data+0x12f/0x2a0 [ksplice_td0cdsll_nvme_new]
[3247695.002867] [<ffffffffa0027f42>] nvme_queue_rq+0x182/0x210 [nvme]
[3247695.002869] [<ffffffff813024b8>] __blk_mq_run_hw_queue+0x208/0x3b0
[3247695.002871] [<ffffffff813026a2>] blk_mq_run_work_fn+0x12/0x20
[3247695.002874] [<ffffffff810a31a1>] process_one_work+0x151/0x4b0
[3247695.002875] [<ffffffff810a3620>] worker_thread+0x120/0x480
[3247695.002877] [<ffffffff816b4fe0>] ? __schedule+0x250/0x660
[3247695.002878] [<ffffffff810a3500>] ? process_one_work+0x4b0/0x4b0
[3247695.002880] [<ffffffff810a3500>] ? process_one_work+0x4b0/0x4b0
[3247695.002882] [<ffffffff810a87fe>] kthread+0xce/0xf0
[3247695.002884] [<ffffffff810a8730>] ? kthread_freezable_should_stop+0x70/0x70
[3247695.002886] [<ffffffff816b9cd2>] ret_from_fork+0x42/0x70
[3247695.002888] [<ffffffff810a8730>] ? kthread_freezable_should_stop+0x70/0x70
[3247695.002890] ---[ end trace e4649dead6dd2fb8 ]---

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.