ExtremeIO Filesystem Going Into Read-Only After Running Partprobe or After Running Sosreport (Doc ID 2543196.1)

Last updated on OCTOBER 20, 2022

Applies to:

Symptoms

 Server using ExtremeIO are experiencing production failures after adding new LUNs and running partprobe, or also after running sosreport, because their /u01 filesystem is going Read-only.

Below are the errors from the messages file showing the filesystem going Read-only:

Apr 2 11:09:06 <HOST> kernel: blk_cloned_rq_check_limits: over max size limit.
Apr 2 11:09:06 <HOST> kernel: device-mapper: multipath: Failing path 71:208.
Apr 2 11:09:06 <HOST> kernel: blk_update_request: I/O error, dev dm-6, sector 150479440
Apr 2 11:09:06 <HOST> kernel: Buffer I/O error on dev dm-37, logical block 18809674, lost sync page write
Apr 2 11:09:06 <HOST> kernel: Aborting journal on device dm-37.
Apr 2 11:09:06 <HOST> kernel: blk_update_request: I/O error, dev dm-6, sector 150476800
Apr 2 11:09:06 <HOST> kernel: Buffer I/O error on dev dm-37, logical block 18809344, lost sync page write
Apr 2 11:09:06 <HOST> kernel: JBD: Error -5 detected when updating journal superblock for dm-37.
Apr 2 11:09:06 <HOST> kernel: EXT3-fs (dm-37): error: ext3_journal_start_sb: Detected aborted journal
Apr 2 11:09:06 <HOST> kernel: EXT3-fs (dm-37): error: remounting filesystem read-only
Apr 2 11:09:25 <HOST> kernel: EXT3-fs (dm-37): warning: dx_probe: Corrupt dir inode 278530, running e2fsck is recommended.

Below are OracleAFD logging an -EIO due to the path failures:

Apr 2 11:09:22 <HOST> multipathd: mpathq: remaining active paths: 0
Apr 2 11:09:22 <HOST> multipathd: sddp: mark as failed
Apr 2 11:09:22 <HOST> multipathd: mpathz: remaining active paths: 0
Apr 2 11:09:23 <HOST> kernel: AFDK-00017: AFD log file write error: File name '/u01/app/oracle/crsdata/<HOST>/afd/afd.log.0'
Apr 2 11:09:23 <HOST> kernel: AFDK-00008: terminating AFD logging
Apr 2 11:09:23 <HOST> kernel: F 4354992.969/190402150923 ocssd.bin[42634] AFD:IO Error: reqAddr=00007f40f40f0f08 reqStart=458769 reqSize=1 on maj/min=249/26 status=0x2e err=-5
Apr 2 11:09:23 <HOST> kernel: F 4354992.993/190402150923 parted[22562] oracleafd:18:0939:[22308] Write IO to ASM managed device [Repeat:2]: [249] [22]
Apr 2 11:09:23 <HOST> kernel: F 4354992.993/190402150923 parted[22562] oracleafd:18:0939:Write IO to ASM managed device: [249] [27]

Apr 10 09:50:57 <HOST> kernel: F 4454262.528/190410135057 partprobe[56539] oracleafd:18:0939:Write IO to ASM managed device: [249] [41]
Apr 10 09:58:35 <HOST> kernel: F 4294875.619/190410135835 partprobe[49335] oracleafd:18:0939:Write IO to ASM managed device: [249] [19]

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.