Exadata V2: Flash Disks Show Status "Unknown" Thru the "List Physicaldisk" Command. (Doc ID 1176161.1)

Last updated on JULY 19, 2012

Applies to:

Oracle Exadata Hardware - Version 11.2.0.1 to 11.2.0.1 [Release 11.2]
Information in this document applies to any platform.

Symptoms

"List Physicaldisk" command reports "unknown" status on all the flash DOMs:

CellCLI> list physicaldisk
34:0 JK1151YAJ2GV4Z normal
34:1 JK1151YAJ0HZ7Z normal
34:2 JK1151YAJ3WBKZ normal
34:3 JK11D1YAJ2HGDZ normal
34:4 JK1151YAJ3WENZ normal
34:5 JK11D1YAJ2HGTZ normal
34:6 JK1151YAJ2G5YZ normal
34:7 JK1151YAHVLS4Z normal
34:8 JK1151YAJ2GP9Z normal
34:9 JK1151YAJ3W0DZ normal
34:10 JK1151YAJ3WB1Z normal
34:11 JK11D1YAJ28ZRZ normal
[10:0:0:0] 5080020000c3770FMOD0 unknown
[10:0:1:0] 5080020000c3770FMOD1 unknown
[10:0:2:0] 5080020000c3770FMOD2 unknown
[10:0:3:0] 5080020000c3770FMOD3 unknown
[11:0:0:0] 5080020000c3638FMOD0 unknown
[11:0:1:0] 5080020000c3638FMOD1 unknown
[11:0:2:0] 5080020000c3638FMOD2 unknown
[11:0:3:0] 5080020000c3638FMOD3 unknown
[12:0:0:0] 5080020000c35baFMOD0 unknown
[12:0:1:0] 5080020000c35baFMOD1 unknown
[12:0:2:0] 5080020000c35baFMOD2 unknown
[12:0:3:0] 5080020000c35baFMOD3 unknown
[9:0:0:0] 5080020000c3666FMOD0 unknown
[9:0:1:0] 5080020000c3666FMOD1 unknown
[9:0:2:0] 5080020000c3666FMOD2 unknown
[9:0:3:0] 5080020000c3666FMOD3 unknown

Changes

1) All the 16 flash disks DOMs are present:

root@cel01:~ [root@ccppcel01 ~]# lsscsi | grep MARVELL
[9:0:0:0] disk ATA MARVELL SD88SA02 D20R /dev/sdn
[9:0:1:0] disk ATA MARVELL SD88SA02 D20R /dev/sdo
[9:0:2:0] disk ATA MARVELL SD88SA02 D20R /dev/sdp
[9:0:3:0] disk ATA MARVELL SD88SA02 D20R /dev/sdq
[10:0:0:0] disk ATA MARVELL SD88SA02 D20R /dev/sdr
[10:0:1:0] disk ATA MARVELL SD88SA02 D20R /dev/sds
[10:0:2:0] disk ATA MARVELL SD88SA02 D20R /dev/sdt
[10:0:3:0] disk ATA MARVELL SD88SA02 D20R /dev/sdu
[11:0:0:0] disk ATA MARVELL SD88SA02 D20R /dev/sdv
[11:0:1:0] disk ATA MARVELL SD88SA02 D20R /dev/sdw
[11:0:2:0] disk ATA MARVELL SD88SA02 D20R /dev/sdx
[11:0:3:0] disk ATA MARVELL SD88SA02 D20R /dev/sdy
[12:0:0:0] disk ATA MARVELL SD88SA02 D20R /dev/sdz
[12:0:1:0] disk ATA MARVELL SD88SA02 D20R /dev/sdaa
[12:0:2:0] disk ATA MARVELL SD88SA02 D20R /dev/sdab
[12:0:3:0] disk ATA MARVELL SD88SA02 D20R /dev/sdac



2) Also,all the 16 flashdisks DOMs are present:

root@cel01:~ [root@ccppcel01 ~]# flash_dom -l

Aura Firmware Update Utility, Version 1.2.0

Copyright (c) 2009 Sun Microsystems, Inc. All rights reserved..
.
U.S. Government Rights - Commercial Software. Government users are subject
to the Sun Microsystems, Inc. standard license agreement and
applicable provisions of the FAR and its supplements.
.
Use is subject to license terms.
.
This distribution may include materials developed by third parties.
.
Sun, Sun Microsystems, the Sun logo, Sun StorageTek and ZFS are trademarks
or registered trademarks of Sun Microsystems, Inc. or its subsidiaries,
in the U.S. and other countries.



HBA# Port Name Chip Vendor/Type/Rev MPT Rev Firmware Rev IOC

1. /proc/mpt/ioc0 LSI Logic SAS1068E B3 105 011b0300 0

Current active firmware version is 011b0300 (1.27.03)
Firmware image's version is MPTFW-01.27.03.00-IT
x86 BIOS image's version is MPTBIOS-6.26.00.00 (2008.10.14)
FCode image's version is MPT SAS FCode Version 1.00.49 (2007.09.21)


D# B___T Type Vendor Product Rev
1. 0 0 Disk ATA MARVELL SD88SA02 D20R
2. 0 1 Disk ATA MARVELL SD88SA02 D20R
3. 0 2 Disk ATA MARVELL SD88SA02 D20R
4. 0 3 Disk ATA MARVELL SD88SA02 D20R




2. /proc/mpt/ioc1 LSI Logic SAS1068E B3 105 011b0300 0

Current active firmware version is 011b0300 (1.27.03)
Firmware image's version is MPTFW-01.27.03.00-IT
x86 BIOS image's version is MPTBIOS-6.26.00.00 (2008.10.14)
FCode image's version is MPT SAS FCode Version 1.00.49 (2007.09.21)


D# B___T Type Vendor Product Rev
1. 0 0 Disk ATA MARVELL SD88SA02 D20R
2. 0 1 Disk ATA MARVELL SD88SA02 D20R
3. 0 2 Disk ATA MARVELL SD88SA02 D20R
4. 0 3 Disk ATA MARVELL SD88SA02 D20R



.
3. /proc/mpt/ioc2 LSI Logic SAS1068E B3 105 011b0300 0

Current active firmware version is 011b0300 (1.27.03)
Firmware image's version is MPTFW-01.27.03.00-IT
x86 BIOS image's version is MPTBIOS-6.26.00.00 (2008.10.14)
FCode image's version is MPT SAS FCode Version 1.00.49 (2007.09.21)


D# B___T Type Vendor Product Rev
1. 0 0 Disk ATA MARVELL SD88SA02 D20R
2. 0 1 Disk ATA MARVELL SD88SA02 D20R
3. 0 2 Disk ATA MARVELL SD88SA02 D20R
4. 0 3 Disk ATA MARVELL SD88SA02 D20R




4. /proc/mpt/ioc3 LSI Logic SAS1068E B3 105 011b0300 0

Current active firmware version is 011b0300 (1.27.03)
Firmware image's version is MPTFW-01.27.03.00-IT
x86 BIOS image's version is MPTBIOS-6.26.00.00 (2008.10.14)
FCode image's version is MPT SAS FCode Version 1.00.49 (2007.09.21)


D# B___T Type Vendor Product Rev
1. 0 0 Disk ATA MARVELL SD88SA02 D20R
2. 0 1 Disk ATA MARVELL SD88SA02 D20R
3. 0 2 Disk ATA MARVELL SD88SA02 D20R
4. 0 3 Disk ATA MARVELL SD88SA02 D20R




3) Sixteen flashcache are currently present and have content:

root@cel01:~ [root@cel01 ~]# cellcli -e list FLASHCACHE detail
name: cel01_FLASHCACHE
cellDisk:
FD_00_cel01,FD_01_cel01,FD_02_cel01,FD_03_cel01,FD_04_cel01,
FD_05_cel01,FD_06_cel01,FD_07_cel01,FD_08_cel01,FD_09_cel01,
FD_10_cel01,FD_11_cel01,FD_12_cel01,FD_13_cel01,FD_14_cel01,
FD_15_cel01
creationTime: 2010-04-13T23:27:33+00:00
id: 86d7a324-2f79-4964-939b-d253c94a6b4a
size: 365.25G
status: normal

root@cel01:~ [root@cel01 ~]# cellcli -e list FLASHCACHECONTENT |
wc -l
3668




4) The 16 flash disks are showing the state = normal thru the "list lun" command:

[root@cel01 ~]# cellcli -e list lun where diskType=FlashDisk
1_0 1_0 normal
1_1 1_1 normal
1_2 1_2 normal
1_3 1_3 normal
2_0 2_0 normal
2_1 2_1 normal
2_2 2_2 normal
2_3 2_3 normal
4_0 4_0 normal
4_1 4_1 normal
4_2 4_2 normal
4_3 4_3 normal
5_0 5_0 normal
5_1 5_1 normal
5_2 5_2 normal
5_3 5_3 normal

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms