zpool mirrors' phys_path's do not match what luxadm says they should be

Last updated on OCTOBER 18, 2016

Applies to:

Symptoms

The phys-path properly in zfs vdev labels can be mismatched with the actual device path of LUNs.

A mirrored rpool is created by 2 luns.

# zpool status rpool
  pool: rpool
 state: ONLINE
 scan: scrub repaired 0 in 0h38m with 0 errors on Tue Sep  8 08:34:41 2015
config:

        NAME                         STATE     READ WRITE CKSUM
        rpool                        ONLINE       0     0     0
          mirror-0                   ONLINE       0     0     0
            c5t50000973001C0DA5d1s0  ONLINE       0     0     0
            c3t50000973001C0D98d2s0  ONLINE       0     0     0

From luxadm, 2 luns are each connected to qlc@2 and qlc@1 respectively.

/devices/ssm@0,0/pci@18,600000/SUNW,qlc@2/fp@0,0/ssd@w50000973001c0d98,2:c,raw
    LUN path port WWN:          50000973001c0d98
    Host controller port WWN:   2100001b320a40ed
    Path status:                O.K.
  /dev/rdsk/c5t50000973001C0DA5d2s2
 
/devices/ssm@0,0/pci@19,700000/SUNW,qlc@1/fp@0,0/ssd@w50000973001c0da5,2:c,raw
    LUN path port WWN:          50000973001c0da5
    Host controller port WWN:   2100001b320ac8ec
    Path status:                O.K.
  /dev/rdsk/c3t50000973001C0D98d2s2
 


zdb -l does not show the correct information.

$ zdb-l_c3t50000973001C0D98d2s0
------------------------------------------
LABEL 0
------------------------------------------
    timestamp: 1441713363 UTC: Tue Sep  8 07:56:03 2015
    version: 32
    name: 'rpool'
    state: 0
    txg: 290221
    pool_guid: 6264376628155019830
    hostid: 2228564512
    hostname: 'msprd291'
    top_guid: 10593415798769271199
    guid: 10146342404523902092
    vdev_children: 1
    vdev_tree:
        type: 'mirror'
        id: 0
        guid: 10593415798769271199
        whole_disk: 0
        metaslab_array: 27
        metaslab_shift: 29
        ashift: 9
        asize: 95026151424
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 5500042453682738581
            path: '/dev/dsk/c5t50000973001C0DA5d1s0'
            devid: 'id1,ssd@n60000970000195701795533032364331/a'
            phys_path:'/ssm@0,0/pci@19,700000/SUNW,qlc@1/fp@0,0/ssd@w50000973001c0da5,1:a'
            whole_disk: 0
            DTL: 315
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 10146342404523902092
            path: '/dev/dsk/c3t50000973001C0D98d2s0'
            devid: 'id1,ssd@n60000970000195701795533032364332/a'
            phys_path:'/ssm@0,0/pci@19,700000/SUNW,qlc@1/fp@0,0/ssd@w50000973001c0da5,2:a'
            whole_disk: 0
            DTL: 2742
            create_txg: 4
------------------------------------------
The label on the other disk looks the same as this one.

The phys_path on the label shows that both luns are on qlc@1

Changes

Cause