Exadata X7-8 Compute Node: Multiple mdadm devices in degraded state. (Doc ID 2685748.1)

Last updated on JULY 27, 2020

Applies to:

Symptoms

+ There were some issues with booting/cabling and pcie cards on this server which were replaced.
+ Post replacement, server booted-up however, two MD devices - md123 and md124 - reported degraded.

--------------

[root@node6 ~]# mdadm --detail /dev/md123 <<------------------
/dev/md123:
Container : /dev/md/imsm0, member 0
Raid Level : raid1
Array Size : 262144000 (250.00 GiB 268.44 GB)
Used Dev Size : 262144000 (250.00 GiB 268.44 GB)
Raid Devices : 2
Total Devices : 1

State : active, degraded <<------------------
Active Devices : 1
Working Devices : 1
Failed Devices : 0
Spare Devices : 0

UUID : 327bacf3:099584b1:4bee1588:592a549d
Number Major Minor RaidDevice State
- 0 0 0 removed
0 259 7 1 active sync /dev/nvme0n1

[root@node6 ~]# mdadm --detail /dev/md124 <<------------------
/dev/md124:
Container : /dev/md/imsm0, member 1
Raid Level : raid1
Array Size : 2863467520 (2730.82 GiB 2932.19 GB)
Used Dev Size : 2863467776 (2730.82 GiB 2932.19 GB)
Raid Devices : 2
Total Devices : 1

State : active, degraded <<------------------
Active Devices : 1
Working Devices : 1
Failed Devices : 0
Spare Devices : 0

UUID : 5e374a15:890cb3e1:5c3b9105:c7e37966
Number Major Minor RaidDevice State
- 0 0 0 removed
0 259 7 1 active sync /dev/nvme0n1

[root@node6 ~]#

----------------

+ mdadm scan confirms that both flash devices (nvme0n1 and nvme2n1) are part of container imsm0

---------
[root@node6 ~]# mdadm --detail --scan --verbose
ARRAY /dev/md/imsm0 level=container num-devices=2 metadata=imsm UUID=977a9dad:ac7ea59b:30d6c2ae:9f7ee38c
devices=/dev/nvme0n1,/dev/nvme2n1
ARRAY /dev/md/imsm1 level=container num-devices=2 metadata=imsm UUID=11ee3e78:48dd07d7:0341d821:eb78198a
devices=/dev/nvme1n1,/dev/nvme3n1
ARRAY /dev/md/34_0 level=raid1 num-devices=2 container=/dev/md/imsm1 member=0 UUID=f5ca5c28:b1008c36:ca2194ff:4e4722c9
devices=/dev/nvme1n1,/dev/nvme3n1
ARRAY /dev/md/25_0 level=raid1 num-devices=2 container=/dev/md/imsm0 member=1 UUID=5e374a15:890cb3e1:5c3b9105:c7e37966
devices=/dev/nvme0n1
ARRAY /dev/md/24_0 level=raid1 num-devices=2 container=/dev/md/imsm0 member=0 UUID=327bacf3:099584b1:4bee1588:592a549d
devices=/dev/nvme0n1
---------

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.