[OmniOS-discuss] Debating Swapping 2TB with 4TB drives in RaidZ2 or Create new Vol and clone

[Rob Logan]

>> Just curious what you would do in my situation, replace the drives or build a new vDev and why?

I attach both 4T drives to the 2T mirrored pair, 
when its done resilvering, I detach the org 2T drives and 
add them to the 1T mirrored pair, when that’s done, I use
to add the smallest disk pair as a new vdev, but now I toss
them in the trash to minimize the number of devices.

This takes way too much wall clock time, but only a few mins
every night for three nights. my 512e drives are living fine 
in the 512n ashift=9 pool.

rob at nas:~# zpool history z | head
History for 'z':
2012-01-04.21:26:14 zpool create zz c4t7d0 c4t2d0 c5t5d0 c4t0d0 c7t2d0
2012-01-04.21:27:10 zfs set compression=on zz
2012-01-04.21:27:39 zfs recv -vd zz
2012-01-04.21:31:37 zfs recv -vd zz
2012-01-04.21:38:35 zfs recv -vd zz
rob at nas:~# zpool iostat -v
               capacity     operations    bandwidth
pool        alloc   free   read  write   read  write
----------  -----  -----  -----  -----  -----  -----
rpool       7.30G   132G      0      0    756  1.72K
  mirror    7.30G   132G      0      0    756  1.72K
    c7t0d0s0      -      -      0      0    663  1.73K
    c4t6d0s0      -      -      0      0    664  1.73K
----------  -----  -----  -----  -----  -----  -----
z           7.28T  2.69T     12      3  1.18M   115K
  mirror    1.94T  1.69T      3      0   302K  25.1K
    c7t1d0      -      -      0      3  17.6K   338K
    c7t3d0      -      -      0      3  17.6K   338K
  mirror    1.80T  10.8G      1      0   164K  16.3K
    c5t2d0      -      -      1      0   150K  16.3K
    c4t2d0      -      -      1      0   150K  16.3K
  mirror    1.06T   772G      2      0   220K  18.3K
    c4t7d0      -      -      0      1  11.1K   189K
    c5t7d0      -      -      0      1  11.1K   189K
  mirror     925G  3.14G      1      0  78.7K  6.02K
    c4t0d0      -      -      0      0  73.6K  6.04K
    c5t0d0      -      -      0      0  73.7K  6.04K
  mirror    1.58T   237G      4      1   444K  49.3K
    c4t5d0      -      -      2      0   316K  49.0K
    c5t5d0      -      -      0      2  24.5K   286K
----------  -----  -----  -----  -----  -----  -----

rob at nas:~# hd
                                                                         
Device    Serial        Vendor   Model             Rev  Temperature     
------    ------        ------   -----             ---- -----------     
c4t0d0p0  WMATV00864xx  ATA      WDC WD1001FALS-0  0K05 36 C (96 F)
c4t2d0p0  H7JR0C7006xx  ATA      SAMSUNG HD204UI   0001 28 C (82 F)
c4t5d0p0  WMC3005796xx  ATA      WDC WD20EFRX-68A  0A80 29 C (84 F)
c4t6d0p0  WCAMR24049xx  ATA      WDC WD3200JD-00K  5J08 0 C (32 F)
c4t7d0p0  H7J90B9245xx  ATA      SAMSUNG HD204UI   0001 27 C (80 F)
c5t0d0p0  WMATV00783xx  ATA      WDC WD1001FALS-0  0K05 36 C (96 F)
c5t2d0p0  H7JD5B1029xx  ATA      SAMSUNG HD204UI   0001 27 C (80 F)
c5t5d0p0  WMC3005605xx  ATA      WDC WD20EFRX-68A  0A80 29 C (84 F)
c5t7d0p0  H7JD5B1029xx  ATA      SAMSUNG HD204UI   0001 25 C (77 F)
c7t0d0p0  WMAP419728xx  ATA      WDC WD1500AHFD-0  7QR5 33 C (91 F)
c7t1d0p0  WCC4E03420xx  ATA      WDC WD40EFRX-68W  0A80 30 C (86 F)
c7t3d0p0  WCC4E04257xx  ATA      WDC WD40EFRX-68W  0A80 30 C (86 F)
c7t4d0p0  H7J9HBA008xx  ATA      SAMSUNG HD204UI   0001 25 C (77 F)

rob at nas:~# zdb | grep ashift
            ashift: 9
            ashift: 9
            ashift: 9
            ashift: 9
            ashift: 9
            ashift: 9