[OmniOS-discuss] Same hardware show different cfgadm?

steve at linuxsuite.org steve at linuxsuite.org
Tue Feb 24 16:55:44 UTC 2015


  Howdy!

          I have 2 identical zfs storage configurations consisting of
OmniOS v11 r151004
on

         Dell R710 server
         LSI - SAS9201-16e: attached to 16 bay Rackable JBOD
         LSI -  SAS9200-8e : attached to 45 bay Supermicro JBOD

       Things seem to work fine, but there are very different outputs
for cfgadm. There are 53 JBOD disks total with 10 raidz zpools + 3 hot
spares.
There are 5 system disks on the main Dell 710

All pools function ok. Disks are all 3TB SAS

 cfgadm shows very different information..

root at zfs-1:~# cfgadm
Ap_Id                          Type         Receptacle   Occupant    
Condition
c1                             scsi-bus     connected    configured   unknown
c3                             scsi-sas     connected    unconfigured unknown
c4                             scsi-sas     connected    configured   unknown
c6                             scsi-sas     connected    configured   unknown
c7                             scsi-sas     connected    configured   unknown
c8                             scsi-sas     connected    unconfigured unknown
[snip]

root at zfs-2:~# cfgadm
Ap_Id                          Type         Receptacle   Occupant    
Condition
c0                             scsi-sas     connected    configured   unknown
c1                             scsi-bus     connected    configured   unknown
c2                             scsi-sas     connected    unconfigured unknown
c3                             scsi-sas     connected    unconfigured unknown
c4                             scsi-sas     connected    configured   unknown
c5                             scsi-sas     connected    configured   unknown
[snip]


             A more complete listing is even stranger..  ( see below for
complete output )

root at zfs-1:~# cfgadm -al |grep dsk |wc -l
32

root at zfs-2:~# cfgadm -al|grep dsk|wc -l
53

     Why do some disks show up as

c5::w5000c50055c9a011,0        disk-path    connected    configured   unknown

and others as

c5::dsk/c5t5000CCA03E202671d0  disk         connected    configured   unknown


       However, format command sees all disks and can access them normally...

        Ideas? Does this matter? Why does cfgadm show such different configs?

          thanx - steve

root at zfs-1:~# cfgadm -al
Ap_Id                          Type         Receptacle   Occupant    
Conditionc5::w5000c50055c9a011,0        disk-path    connected   
configured   unknown

c1                             scsi-bus     connected    configured   unknown
c1::dsk/c1t0d0                 disk         connected    configured   unknown
c1::dsk/c1t1d0                 disk         connected    configured   unknown
c1::dsk/c1t2d0                 disk         connected    configured   unknown
c1::dsk/c1t4d0                 disk         connected    configured   unknown
c1::dsk/c1t5d0                 disk         connected    configured   unknown
c3                             scsi-sas     connected    unconfigured unknown
c4                             scsi-sas     connected    configured   unknown
c4::dsk/c4t5000CCA01A7C4FE5d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA01A7CD8A1d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA01A7CDFB5d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA01A72D899d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA01A72DDDDd0  disk         connected    configured   unknown
c4::es/ses0                    ESI          connected    configured   unknown
c4::smp/expd0                  smp          connected    configured   unknown
c4::w5000c50041a6ab01,0        disk-path    connected    configured   unknown
c4::w5000c50041aafa81,0        disk-path    connected    configured   unknown
c4::w5000c50041ac4e3d,0        disk-path    connected    configured   unknown
c4::w5000c50041e9e081,0        disk-path    connected    configured   unknown
c4::w5000c50041f2f09d,0        disk-path    connected    configured   unknown
c4::w5000c50055a24fc1,0        disk-path    connected    configured   unknown
c4::w5000c50055a25a01,0        disk-path    connected    configured   unknown
c4::w5000c50055a25e99,0        disk-path    connected    configured   unknown
c4::w5000c50055a259b9,0        disk-path    connected    configured   unknown
c4::w5000c50055c9bed5,0        disk-path    connected    unconfigured unknown
c4::w5000c50055c66abd,0        disk-path    connected    configured   unknown
c4::w5000c50055ca227d,0        disk-path    connected    configured   unknown
c4::w5000c50055ca363d,0        disk-path    connected    unconfigured unknown
c4::w5000c50055e66c29,0        disk-path    connected    configured   unknown
c4::w5000c50055e75ad1,0        disk-path    connected    unconfigured unknown
c4::w5000c50055e7546d,0        disk-path    connected    configured   unknown
c4::w5000c500423b5e9d,0        disk-path    connected    unconfigured unknown
c4::w5000c500423da1bd,0        disk-path    connected    unconfigured unknown
c4::w5000c500423e977d,0        disk-path    connected    configured   unknown
c4::w5000c500424c5e29,0        disk-path    connected    configured   unknown
c4::w5000c5004198a2c5,0        disk-path    connected    configured   unknown
c6                             scsi-sas     connected    configured   unknown
c6::dsk/c6t5000CCA03E1E5FF5d0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E1F33D9d0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E09BFB1d0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E014A2Dd0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E15B6F1d0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E20AF2Dd0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E20AF3Dd0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E167AFDd0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E167B7Dd0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E167B29d0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E172A05d0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E210B6Dd0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E0626F1d0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E012635d0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E113475d0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E126771d0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E167559d0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E167649d0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E168005d0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E168141d0  disk         connected    configured   unknown
c6::dsk/c6t5000CCA03E212455d0  disk         connected    configured   unknown
c6::es/ses1                    ESI          connected    configured   unknown
c6::smp/expd1                  smp          connected    configured   unknown
c7                             scsi-sas     connected    configured   unknown
c7::dsk/c7t5000CCA03E2126E1d0  disk         connected    configured   unknown
c7::es/ses2                    ESI          connected    configured   unknown
c7::smp/expd2                  smp          connected    configured   unknown
c7::w5000c50055c9bed5,0        disk-path    connected    configured   unknown
c7::w5000c50055ca39e9,0        disk-path    connected    configured   unknown
c7::w5000c50055ca363d,0        disk-path    connected    configured   unknown
c7::w5000c50055e7b4d5,0        disk-path    connected    unconfigured unknown
c7::w5000c50055e75ad1,0        disk-path    connected    configured   unknown
c7::w5000c50055e77a25,0        disk-path    connected    configured   unknown
c7::w5000c50055e75671,0        disk-path    connected    configured   unknown
c7::w5000c50055e75679,0        disk-path    connected    configured   unknown
c7::w5000c500423b5e9d,0        disk-path    connected    configured   unknown
c7::w5000c500423da1bd,0        disk-path    connected    configured   unknown
c7::w5000c500423dd3d9,0        disk-path    connected    configured   unknown
c8                             scsi-sas     connected    unconfigured unknown
usb8/1                         unknown      empty        unconfigured ok
usb8/2                         unknown      empty        unconfigured ok
usb9/1                         unknown      empty        unconfigured ok
usb9/2                         unknown      empty        unconfigured ok
usb10/1                        unknown      empty        unconfigured ok
usb10/2                        unknown      empty        unconfigured ok
usb10/3                        usb-hub      connected    configured   ok
usb10/3.1                      unknown      empty        unconfigured ok
usb10/3.2                      unknown      empty        unconfigured ok
usb10/3.3                      unknown      empty        unconfigured ok
usb10/4                        unknown      empty        unconfigured ok
usb11/1                        unknown      empty        unconfigured ok
usb11/2                        usb-device   connected    configured   ok
usb12/1                        unknown      empty        unconfigured ok
usb12/2                        unknown      empty        unconfigured ok
usb13/1                        unknown      empty        unconfigured ok
usb13/2                        unknown      empty        unconfigured ok
usb13/3                        unknown      empty        unconfigured ok
usb13/4                        unknown      empty        unconfigured ok


root at zfs-2:~# cfgadm -al
Ap_Id                          Type         Receptacle   Occupant    
Condition
c0                             scsi-sas     connected    configured   unknown
c0::dsk/c0t5000CCA01A7E89F5d0  disk         connected    configured   unknown
c0::dsk/c0t5000CCA01A80A9CDd0  disk         connected    configured   unknown
c0::dsk/c0t5000CCA01A80AB65d0  disk         connected    configured   unknown
c0::dsk/c0t5000CCA01A886801d0  disk         connected    configured   unknown
c0::dsk/c0t5000CCA01ABC7339d0  disk         connected    configured   unknown
c0::dsk/c0t5000CCA01ABC9445d0  disk         connected    configured   unknown
c0::dsk/c0t5000CCA01ABC9535d0  disk         connected    configured   unknown
c0::dsk/c0t5000CCA03E1AA175d0  disk         connected    configured   unknown
c0::dsk/c0t5000CCA03E11FABDd0  disk         connected    configured   unknown
c0::dsk/c0t5000CCA03E210E5Dd0  disk         connected    configured   unknown
c0::dsk/c0t5000CCA03E0622C5d0  disk         connected    configured   unknown
c0::es/ses2                    ESI          connected    configured   unknown
c0::smp/expd2                  smp          connected    configured   unknown
c1                             scsi-bus     connected    configured   unknown
c1::dsk/c1t0d0                 disk         connected    configured   unknown
c1::dsk/c1t1d0                 disk         connected    configured   unknown
c1::dsk/c1t3d0                 disk         connected    configured   unknown
c1::dsk/c1t4d0                 disk         connected    configured   unknown
c1::dsk/c1t5d0                 disk         connected    configured   unknown
c2                             scsi-sas     connected    unconfigured unknown
c3                             scsi-sas     connected    unconfigured unknown
c4                             scsi-sas     connected    configured   unknown
c4::dsk/c4t5000CCA01A58FD39d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E0B00B5d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E1C4401d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E1E4A51d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E1EFECDd0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E0065B5d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E167AF9d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E167B45d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E167BA9d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E167C0Dd0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E167C49d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E167CA1d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E167D71d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E215DCDd0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E1676E9d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E16708Dd0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E16767Dd0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E16807Dd0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E21594Dd0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E167269d0  disk         connected    configured   unknown
c4::dsk/c4t5000CCA03E167801d0  disk         connected    configured   unknown
c4::es/ses0                    ESI          connected    configured   unknown
c4::smp/expd0                  smp          connected    configured   unknown
c5                             scsi-sas     connected    configured   unknown
c5::dsk/c5t5000CCA01A7D4D85d0  disk         connected    configured   unknown
c5::dsk/c5t5000CCA01A7E0499d0  disk         connected    configured   unknown
c5::dsk/c5t5000CCA01A7F5F69d0  disk         connected    configured   unknown
c5::dsk/c5t5000CCA01A80E98Dd0  disk         connected    configured   unknown
c5::dsk/c5t5000CCA01A807E75d0  disk         connected    configured   unknown
c5::dsk/c5t5000CCA01AD9C2F9d0  disk         connected    configured   unknown
c5::dsk/c5t5000CCA01AD331EDd0  disk         connected    configured   unknown
c5::dsk/c5t5000CCA01ADAF64Dd0  disk         connected    configured   unknown
c5::dsk/c5t5000CCA01ADDCBF9d0  disk         connected    configured   unknown
c5::dsk/c5t5000CCA03E1FD499d0  disk         connected    configured   unknown
c5::dsk/c5t5000CCA03E19F571d0  disk         connected    configured   unknown
c5::dsk/c5t5000CCA03E00745Dd0  disk         connected    configured   unknown
c5::dsk/c5t5000CCA03E202671d0  disk         connected    configured   unknown
c5::dsk/c5t5000CCA03E216269d0  disk         connected    configured   unknown
c5::dsk/c5t5000CCA03E227781d0  disk         connected    configured   unknown
c5::dsk/c5t5000CCA03E726699d0  disk         connected    configured   unknown
c5::es/ses1                    ESI          connected    configured   unknown
c5::smp/expd1                  smp          connected    configured   unknown
c5::w5000c50055c9a011,0        disk-path    connected    configured   unknown
c5::w5000c50055c9ffb9,0        disk-path    connected    configured   unknown
c5::w5000c50055e6a5c9,0        disk-path    connected    configured   unknown
c5::w5000c50055e6664d,0        disk-path    connected    configured   unknown
c5::w5000c5005596543d,0        disk-path    connected    configured   unknown
usb8/1                         unknown      empty        unconfigured ok
usb8/2                         unknown      empty        unconfigured ok
usb9/1                         unknown      empty        unconfigured ok
usb9/2                         unknown      empty        unconfigured ok
usb10/1                        unknown      empty        unconfigured ok
usb10/2                        unknown      empty        unconfigured ok
usb10/3                        usb-hub      connected    configured   ok
usb10/3.1                      unknown      empty        unconfigured ok
usb10/3.2                      unknown      empty        unconfigured ok
usb10/3.3                      unknown      empty        unconfigured ok
usb10/4                        unknown      empty        unconfigured ok
usb11/1                        unknown      empty        unconfigured ok
usb11/2                        usb-device   connected    configured   ok
usb12/1                        unknown      empty        unconfigured ok
usb12/2                        unknown      empty        unconfigured ok
usb13/1                        unknown      empty        unconfigured ok
usb13/2                        unknown      empty        unconfigured ok
usb13/3                        unknown      empty        unconfigured ok
usb13/4                        unknown      empty        unconfigured ok





More information about the OmniOS-discuss mailing list