[OmniOS-discuss] Same hardware show different cfgadm?
Mark
mark0x01 at gmail.com
Wed Feb 25 07:23:58 UTC 2015
Do you have single or dual path enclosures?
Are the disks SAS or Sata?
It looks like it is seeing some of the disks on two paths, but not all.
c4::w5000c50055ca363d,0 disk-path
c7::w5000c50055ca363d,0 disk-path
Mark.
On 25/02/2015 5:55 a.m., steve at linuxsuite.org wrote:
>
> Howdy!
>
> I have 2 identical zfs storage configurations consisting of
> OmniOS v11 r151004
> on
>
> Dell R710 server
> LSI - SAS9201-16e: attached to 16 bay Rackable JBOD
> LSI - SAS9200-8e : attached to 45 bay Supermicro JBOD
>
> Things seem to work fine, but there are very different outputs
> for cfgadm. There are 53 JBOD disks total with 10 raidz zpools + 3 hot
> spares.
> There are 5 system disks on the main Dell 710
>
> All pools function ok. Disks are all 3TB SAS
>
> cfgadm shows very different information..
>
> root at zfs-1:~# cfgadm
> Ap_Id Type Receptacle Occupant
> Condition
> c1 scsi-bus connected configured unknown
> c3 scsi-sas connected unconfigured unknown
> c4 scsi-sas connected configured unknown
> c6 scsi-sas connected configured unknown
> c7 scsi-sas connected configured unknown
> c8 scsi-sas connected unconfigured unknown
> [snip]
>
> root at zfs-2:~# cfgadm
> Ap_Id Type Receptacle Occupant
> Condition
> c0 scsi-sas connected configured unknown
> c1 scsi-bus connected configured unknown
> c2 scsi-sas connected unconfigured unknown
> c3 scsi-sas connected unconfigured unknown
> c4 scsi-sas connected configured unknown
> c5 scsi-sas connected configured unknown
> [snip]
>
>
> A more complete listing is even stranger.. ( see below for
> complete output )
>
> root at zfs-1:~# cfgadm -al |grep dsk |wc -l
> 32
>
> root at zfs-2:~# cfgadm -al|grep dsk|wc -l
> 53
>
> Why do some disks show up as
>
> c5::w5000c50055c9a011,0 disk-path connected configured unknown
>
> and others as
>
> c5::dsk/c5t5000CCA03E202671d0 disk connected configured unknown
>
>
> However, format command sees all disks and can access them normally...
>
> Ideas? Does this matter? Why does cfgadm show such different configs?
>
> thanx - steve
>
> root at zfs-1:~# cfgadm -al
> Ap_Id Type Receptacle Occupant
> Conditionc5::w5000c50055c9a011,0 disk-path connected
> configured unknown
>
> c1 scsi-bus connected configured unknown
> c1::dsk/c1t0d0 disk connected configured unknown
> c1::dsk/c1t1d0 disk connected configured unknown
> c1::dsk/c1t2d0 disk connected configured unknown
> c1::dsk/c1t4d0 disk connected configured unknown
> c1::dsk/c1t5d0 disk connected configured unknown
> c3 scsi-sas connected unconfigured unknown
> c4 scsi-sas connected configured unknown
> c4::dsk/c4t5000CCA01A7C4FE5d0 disk connected configured unknown
> c4::dsk/c4t5000CCA01A7CD8A1d0 disk connected configured unknown
> c4::dsk/c4t5000CCA01A7CDFB5d0 disk connected configured unknown
> c4::dsk/c4t5000CCA01A72D899d0 disk connected configured unknown
> c4::dsk/c4t5000CCA01A72DDDDd0 disk connected configured unknown
> c4::es/ses0 ESI connected configured unknown
> c4::smp/expd0 smp connected configured unknown
> c4::w5000c50041a6ab01,0 disk-path connected configured unknown
> c4::w5000c50041aafa81,0 disk-path connected configured unknown
> c4::w5000c50041ac4e3d,0 disk-path connected configured unknown
> c4::w5000c50041e9e081,0 disk-path connected configured unknown
> c4::w5000c50041f2f09d,0 disk-path connected configured unknown
> c4::w5000c50055a24fc1,0 disk-path connected configured unknown
> c4::w5000c50055a25a01,0 disk-path connected configured unknown
> c4::w5000c50055a25e99,0 disk-path connected configured unknown
> c4::w5000c50055a259b9,0 disk-path connected configured unknown
> c4::w5000c50055c9bed5,0 disk-path connected unconfigured unknown
> c4::w5000c50055c66abd,0 disk-path connected configured unknown
> c4::w5000c50055ca227d,0 disk-path connected configured unknown
> c4::w5000c50055ca363d,0 disk-path connected unconfigured unknown
> c4::w5000c50055e66c29,0 disk-path connected configured unknown
> c4::w5000c50055e75ad1,0 disk-path connected unconfigured unknown
> c4::w5000c50055e7546d,0 disk-path connected configured unknown
> c4::w5000c500423b5e9d,0 disk-path connected unconfigured unknown
> c4::w5000c500423da1bd,0 disk-path connected unconfigured unknown
> c4::w5000c500423e977d,0 disk-path connected configured unknown
> c4::w5000c500424c5e29,0 disk-path connected configured unknown
> c4::w5000c5004198a2c5,0 disk-path connected configured unknown
> c6 scsi-sas connected configured unknown
> c6::dsk/c6t5000CCA03E1E5FF5d0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E1F33D9d0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E09BFB1d0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E014A2Dd0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E15B6F1d0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E20AF2Dd0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E20AF3Dd0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E167AFDd0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E167B7Dd0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E167B29d0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E172A05d0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E210B6Dd0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E0626F1d0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E012635d0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E113475d0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E126771d0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E167559d0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E167649d0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E168005d0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E168141d0 disk connected configured unknown
> c6::dsk/c6t5000CCA03E212455d0 disk connected configured unknown
> c6::es/ses1 ESI connected configured unknown
> c6::smp/expd1 smp connected configured unknown
> c7 scsi-sas connected configured unknown
> c7::dsk/c7t5000CCA03E2126E1d0 disk connected configured unknown
> c7::es/ses2 ESI connected configured unknown
> c7::smp/expd2 smp connected configured unknown
> c7::w5000c50055c9bed5,0 disk-path connected configured unknown
> c7::w5000c50055ca39e9,0 disk-path connected configured unknown
> c7::w5000c50055ca363d,0 disk-path connected configured unknown
> c7::w5000c50055e7b4d5,0 disk-path connected unconfigured unknown
> c7::w5000c50055e75ad1,0 disk-path connected configured unknown
> c7::w5000c50055e77a25,0 disk-path connected configured unknown
> c7::w5000c50055e75671,0 disk-path connected configured unknown
> c7::w5000c50055e75679,0 disk-path connected configured unknown
> c7::w5000c500423b5e9d,0 disk-path connected configured unknown
> c7::w5000c500423da1bd,0 disk-path connected configured unknown
> c7::w5000c500423dd3d9,0 disk-path connected configured unknown
> c8 scsi-sas connected unconfigured unknown
> usb8/1 unknown empty unconfigured ok
> usb8/2 unknown empty unconfigured ok
> usb9/1 unknown empty unconfigured ok
> usb9/2 unknown empty unconfigured ok
> usb10/1 unknown empty unconfigured ok
> usb10/2 unknown empty unconfigured ok
> usb10/3 usb-hub connected configured ok
> usb10/3.1 unknown empty unconfigured ok
> usb10/3.2 unknown empty unconfigured ok
> usb10/3.3 unknown empty unconfigured ok
> usb10/4 unknown empty unconfigured ok
> usb11/1 unknown empty unconfigured ok
> usb11/2 usb-device connected configured ok
> usb12/1 unknown empty unconfigured ok
> usb12/2 unknown empty unconfigured ok
> usb13/1 unknown empty unconfigured ok
> usb13/2 unknown empty unconfigured ok
> usb13/3 unknown empty unconfigured ok
> usb13/4 unknown empty unconfigured ok
>
>
> root at zfs-2:~# cfgadm -al
> Ap_Id Type Receptacle Occupant
> Condition
> c0 scsi-sas connected configured unknown
> c0::dsk/c0t5000CCA01A7E89F5d0 disk connected configured unknown
> c0::dsk/c0t5000CCA01A80A9CDd0 disk connected configured unknown
> c0::dsk/c0t5000CCA01A80AB65d0 disk connected configured unknown
> c0::dsk/c0t5000CCA01A886801d0 disk connected configured unknown
> c0::dsk/c0t5000CCA01ABC7339d0 disk connected configured unknown
> c0::dsk/c0t5000CCA01ABC9445d0 disk connected configured unknown
> c0::dsk/c0t5000CCA01ABC9535d0 disk connected configured unknown
> c0::dsk/c0t5000CCA03E1AA175d0 disk connected configured unknown
> c0::dsk/c0t5000CCA03E11FABDd0 disk connected configured unknown
> c0::dsk/c0t5000CCA03E210E5Dd0 disk connected configured unknown
> c0::dsk/c0t5000CCA03E0622C5d0 disk connected configured unknown
> c0::es/ses2 ESI connected configured unknown
> c0::smp/expd2 smp connected configured unknown
> c1 scsi-bus connected configured unknown
> c1::dsk/c1t0d0 disk connected configured unknown
> c1::dsk/c1t1d0 disk connected configured unknown
> c1::dsk/c1t3d0 disk connected configured unknown
> c1::dsk/c1t4d0 disk connected configured unknown
> c1::dsk/c1t5d0 disk connected configured unknown
> c2 scsi-sas connected unconfigured unknown
> c3 scsi-sas connected unconfigured unknown
> c4 scsi-sas connected configured unknown
> c4::dsk/c4t5000CCA01A58FD39d0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E0B00B5d0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E1C4401d0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E1E4A51d0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E1EFECDd0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E0065B5d0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E167AF9d0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E167B45d0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E167BA9d0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E167C0Dd0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E167C49d0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E167CA1d0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E167D71d0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E215DCDd0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E1676E9d0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E16708Dd0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E16767Dd0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E16807Dd0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E21594Dd0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E167269d0 disk connected configured unknown
> c4::dsk/c4t5000CCA03E167801d0 disk connected configured unknown
> c4::es/ses0 ESI connected configured unknown
> c4::smp/expd0 smp connected configured unknown
> c5 scsi-sas connected configured unknown
> c5::dsk/c5t5000CCA01A7D4D85d0 disk connected configured unknown
> c5::dsk/c5t5000CCA01A7E0499d0 disk connected configured unknown
> c5::dsk/c5t5000CCA01A7F5F69d0 disk connected configured unknown
> c5::dsk/c5t5000CCA01A80E98Dd0 disk connected configured unknown
> c5::dsk/c5t5000CCA01A807E75d0 disk connected configured unknown
> c5::dsk/c5t5000CCA01AD9C2F9d0 disk connected configured unknown
> c5::dsk/c5t5000CCA01AD331EDd0 disk connected configured unknown
> c5::dsk/c5t5000CCA01ADAF64Dd0 disk connected configured unknown
> c5::dsk/c5t5000CCA01ADDCBF9d0 disk connected configured unknown
> c5::dsk/c5t5000CCA03E1FD499d0 disk connected configured unknown
> c5::dsk/c5t5000CCA03E19F571d0 disk connected configured unknown
> c5::dsk/c5t5000CCA03E00745Dd0 disk connected configured unknown
> c5::dsk/c5t5000CCA03E202671d0 disk connected configured unknown
> c5::dsk/c5t5000CCA03E216269d0 disk connected configured unknown
> c5::dsk/c5t5000CCA03E227781d0 disk connected configured unknown
> c5::dsk/c5t5000CCA03E726699d0 disk connected configured unknown
> c5::es/ses1 ESI connected configured unknown
> c5::smp/expd1 smp connected configured unknown
> c5::w5000c50055c9a011,0 disk-path connected configured unknown
> c5::w5000c50055c9ffb9,0 disk-path connected configured unknown
> c5::w5000c50055e6a5c9,0 disk-path connected configured unknown
> c5::w5000c50055e6664d,0 disk-path connected configured unknown
> c5::w5000c5005596543d,0 disk-path connected configured unknown
> usb8/1 unknown empty unconfigured ok
> usb8/2 unknown empty unconfigured ok
> usb9/1 unknown empty unconfigured ok
> usb9/2 unknown empty unconfigured ok
> usb10/1 unknown empty unconfigured ok
> usb10/2 unknown empty unconfigured ok
> usb10/3 usb-hub connected configured ok
> usb10/3.1 unknown empty unconfigured ok
> usb10/3.2 unknown empty unconfigured ok
> usb10/3.3 unknown empty unconfigured ok
> usb10/4 unknown empty unconfigured ok
> usb11/1 unknown empty unconfigured ok
> usb11/2 usb-device connected configured ok
> usb12/1 unknown empty unconfigured ok
> usb12/2 unknown empty unconfigured ok
> usb13/1 unknown empty unconfigured ok
> usb13/2 unknown empty unconfigured ok
> usb13/3 unknown empty unconfigured ok
> usb13/4 unknown empty unconfigured ok
>
>
>
> _______________________________________________
> OmniOS-discuss mailing list
> OmniOS-discuss at lists.omniti.com
> http://lists.omniti.com/mailman/listinfo/omnios-discuss
>
More information about the OmniOS-discuss
mailing list