[OmniOS-discuss] zfs pool 100% busy, disks less than 10%

Rune Tipsmark rt at steait.net
Fri Oct 31 06:33:32 UTC 2014


Hi all,

Hope someone can help me get this pool running as it should, I am seeing something like 200-300 MB/sec max which is much much less than I want to see...

11 mirrored vdevs... 2 spares and 2 SLOG devices, 192gb ram in host...

Why is this pool showing near 100% busy when the underlying disks are doing nothing at all....


  pool: pool04
state: ONLINE
  scan: scrub repaired 0 in 0h0m with 0 errors on Fri Oct 31 06:37:30 2014
config:

        NAME                       STATE     READ WRITE CKSUM
        pool04                     ONLINE       0     0     0
          mirror-0                 ONLINE       0     0     0
            c4t5000C50055FC9533d0  ONLINE       0     0     0
            c4t5000C50055FE6A63d0  ONLINE       0     0     0
          mirror-1                 ONLINE       0     0     0
            c4t5000C5005708296Fd0  ONLINE       0     0     0
            c4t5000C5005708351Bd0  ONLINE       0     0     0
          mirror-2                 ONLINE       0     0     0
            c4t5000C500570858EFd0  ONLINE       0     0     0
            c4t5000C50057085A6Bd0  ONLINE       0     0     0
          mirror-3                 ONLINE       0     0     0
            c4t5000C50057086307d0  ONLINE       0     0     0
            c4t5000C50057086B67d0  ONLINE       0     0     0
          mirror-4                 ONLINE       0     0     0
            c4t5000C500570870D3d0  ONLINE       0     0     0
            c4t5000C50057089753d0  ONLINE       0     0     0
          mirror-5                 ONLINE       0     0     0
            c4t5000C500625B7EA7d0  ONLINE       0     0     0
            c4t5000C500625B8137d0  ONLINE       0     0     0
          mirror-6                 ONLINE       0     0     0
            c4t5000C500625B8427d0  ONLINE       0     0     0
            c4t5000C500625B86E3d0  ONLINE       0     0     0
          mirror-7                 ONLINE       0     0     0
            c4t5000C500625B886Fd0  ONLINE       0     0     0
            c4t5000C500625BB773d0  ONLINE       0     0     0
          mirror-8                 ONLINE       0     0     0
            c4t5000C500625BC2C3d0  ONLINE       0     0     0
            c4t5000C500625BD3EBd0  ONLINE       0     0     0
          mirror-9                 ONLINE       0     0     0
            c4t5000C50062878C0Bd0  ONLINE       0     0     0
            c4t5000C50062878C43d0  ONLINE       0     0     0
          mirror-10                ONLINE       0     0     0
            c4t5000C50062879687d0  ONLINE       0     0     0
            c4t5000C50062879707d0  ONLINE       0     0     0
        logs
          c10d0                    ONLINE       0     0     0
          c11d0                    ONLINE       0     0     0
        spares
          c4t5000C50062879723d0    AVAIL
          c4t5000C50062879787d0    AVAIL


                    extended device statistics
    r/s    w/s   kr/s   kw/s wait actv wsvc_t asvc_t  %w  %b device
    0.0  337.0    0.0 21899.1  0.0  0.0    0.0    0.0   0   0 c10d0
    0.0  337.0    0.0 21835.1  0.0  0.0    0.0    0.0   0   0 c11d0
  149.0  249.0 7723.2 7032.7  0.0  0.0    0.0    0.0   0   0 c12d0
  144.0  295.0 6766.2 6955.7  0.0  0.0    0.0    0.0   0   0 c14d0
  154.0  311.0 9241.6 6445.7  0.0  0.0    0.0    0.0   0   0 c15d0
  150.0  263.0 7939.2 6096.7  0.0  0.0    0.0    0.0   0   0 c13d0
  597.0 1118.0 31670.2 26530.9  5.8  0.4    3.4    0.2   5   8 pool03
    0.0 1382.9    0.0 78460.7 11.4  1.7    8.3    1.3   5  97 pool04
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 rpool
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 c7t0d0
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 c7t1d0
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 c7t4d0
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 c7t5d0
    0.0   25.0    0.0 1043.5  0.0  0.0    0.0    1.3   0   3 c4t5000C50055FE6A63d0
    0.0   69.0    0.0 1478.4  0.0  0.0    0.0    0.7   0   4 c4t5000C5005708351Bd0
    0.0   41.0    0.0 1261.9  0.0  0.0    0.0    0.7   0   3 c4t5000C50057086B67d0
    0.0   37.0    0.0 2146.4  0.0  0.0    0.0    0.8   0   3 c4t5000C500570858EFd0
    0.0   37.0    0.0 2146.4  0.0  0.0    0.0    1.2   0   4 c4t5000C50057085A6Bd0
    0.0   69.0    0.0 1478.4  0.0  0.1    0.0    0.8   0   5 c4t5000C5005708296Fd0
    0.0   26.0    0.0 1868.9  0.0  0.0    0.0    1.2   0   3 c4t5000C50057089753d0
    0.0   27.0    0.0 1868.9  0.0  0.0    0.0    1.0   0   3 c4t5000C500570870D3d0
    0.0   39.0    0.0 1261.9  0.0  0.0    0.0    0.7   0   3 c4t5000C50057086307d0
    0.0   25.0    0.0 1043.5  0.0  0.0    0.0    1.3   0   3 c4t5000C50055FC9533d0
    0.0   26.0    0.0 2103.9  0.0  0.0    0.0    0.8   0   2 c4t5000C50062878C43d0
    0.0   15.0    0.0 1074.0  0.0  0.0    0.0    1.9   0   3 c4t5000C500625B886Fd0
    0.0   15.0    0.0 1044.0  0.0  0.0    0.0    1.6   0   2 c4t5000C500625BD3EBd0
    0.0   15.0    0.0 1044.0  0.0  0.0    0.0    2.6   0   4 c4t5000C500625BC2C3d0
    0.0   15.0    0.0 1074.0  0.0  0.0    0.0    1.3   0   2 c4t5000C500625BB773d0
    0.0   59.0    0.0 1388.4  0.0  0.0    0.0    0.6   0   3 c4t5000C500625B8427d0
    0.0   44.0    0.0 1849.9  0.0  0.0    0.0    0.8   0   3 c4t5000C500625B8137d0
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 c4t5000C50062879723d0
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 c4t5000C50062879787d0
    0.0   28.0    0.0 2103.9  0.0  0.0    0.0    1.0   0   3 c4t5000C50062879707d0
    0.0   56.0    0.0 1388.4  0.0  0.0    0.0    0.6   0   4 c4t5000C500625B86E3d0
    0.0   43.0    0.0 1849.9  0.0  0.0    0.0    0.8   0   3 c4t5000C500625B7EA7d0
    0.0   26.0    0.0 2103.9  0.0  0.0    0.0    1.1   0   3 c4t5000C50062878C0Bd0
    0.0   28.0    0.0 2103.9  0.0  0.0    0.0    1.2   0   3 c4t5000C50062879687d0

NAME    PROPERTY              VALUE                  SOURCE
pool04  type                  filesystem             -
pool04  creation              Fri Oct 31  6:31 2014  -
pool04  used                  358G                   -
pool04  available             38.5T                  -
pool04  referenced            175G                   -
pool04  compressratio         1.71x                  -
pool04  mounted               yes                    -
pool04  quota                 none                   default
pool04  reservation           none                   default
pool04  recordsize            128K                   default
pool04  mountpoint            /pool04                default
pool04  sharenfs              off                    default
pool04  checksum              on                     default
pool04  compression           lz4                    local
pool04  atime                 off                    local
pool04  devices               on                     default
pool04  exec                  on                     default
pool04  setuid                on                     default
pool04  readonly              off                    default
pool04  zoned                 off                    default
pool04  snapdir               hidden                 default
pool04  aclmode               discard                default
pool04  aclinherit            restricted             default
pool04  canmount              on                     default
pool04  xattr                 on                     default
pool04  copies                1                      default
pool04  version               5                      -
pool04  utf8only              off                    -
pool04  normalization         none                   -
pool04  casesensitivity       sensitive              -
pool04  vscan                 off                    default
pool04  nbmand                off                    default
pool04  sharesmb              off                    default
pool04  refquota              none                   default
pool04  refreservation        358G                   local
pool04  primarycache          all                    default
pool04  secondarycache        all                    default
pool04  usedbysnapshots       0                      -
pool04  usedbydataset         175G                   -
pool04  usedbychildren        2.53M                  -
pool04  usedbyrefreservation  183G                   -
pool04  logbias               latency                default
pool04  dedup                 off                    default
pool04  mlslabel              none                   default
pool04  sync                  always                 local
pool04  refcompressratio      1.71x                  -
pool04  written               175G                   -
pool04  logicalused           300G                   -
pool04  logicalreferenced     300G                   -
pool04  filesystem_limit      none                   default
pool04  snapshot_limit        none                   default
pool04  filesystem_count      none                   default
pool04  snapshot_count        none                   default
pool04  redundant_metadata    all                    default

Br,
Rune

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://omniosce.org/ml-archive/attachments/20141031/b0fc51ae/attachment-0001.html>


More information about the OmniOS-discuss mailing list