[OmniOS-discuss] zfs pool 100% busy, disks less than 10%
Filip Marvan
filip.marvan at aira.cz
Fri Oct 31 11:25:01 UTC 2014
Hi,
what devices are you using as SLOG? As you have "sync=always" on that pool,
performance of SLOG device will be crucial for write speed on your pool.
I can see that one of your disk is very busy
0.0 1382.9 0.0 78460.7 11.4 1.7 8.3 1.3 5 97 pool04
Is that SLOG? Maybe that is the problem.
Filip Marvan
------------------
Date: Fri, 31 Oct 2014 06:33:32 +0000
From: Rune Tipsmark <rt at steait.net>
To: "omnios-discuss at lists.omniti.com"
<omnios-discuss at lists.omniti.com>
Subject: [OmniOS-discuss] zfs pool 100% busy, disks less than 10%
Message-ID: <4153d29f2b3a42349a5b701edfb06e92 at EX1301.steait.net>
Content-Type: text/plain; charset="us-ascii"
Hi all,
Hope someone can help me get this pool running as it should, I am seeing
something like 200-300 MB/sec max which is much much less than I want to
see...
11 mirrored vdevs... 2 spares and 2 SLOG devices, 192gb ram in host...
Why is this pool showing near 100% busy when the underlying disks are doing
nothing at all....
pool: pool04
state: ONLINE
scan: scrub repaired 0 in 0h0m with 0 errors on Fri Oct 31 06:37:30 2014
config:
NAME STATE READ WRITE CKSUM
pool04 ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
c4t5000C50055FC9533d0 ONLINE 0 0 0
c4t5000C50055FE6A63d0 ONLINE 0 0 0
mirror-1 ONLINE 0 0 0
c4t5000C5005708296Fd0 ONLINE 0 0 0
c4t5000C5005708351Bd0 ONLINE 0 0 0
mirror-2 ONLINE 0 0 0
c4t5000C500570858EFd0 ONLINE 0 0 0
c4t5000C50057085A6Bd0 ONLINE 0 0 0
mirror-3 ONLINE 0 0 0
c4t5000C50057086307d0 ONLINE 0 0 0
c4t5000C50057086B67d0 ONLINE 0 0 0
mirror-4 ONLINE 0 0 0
c4t5000C500570870D3d0 ONLINE 0 0 0
c4t5000C50057089753d0 ONLINE 0 0 0
mirror-5 ONLINE 0 0 0
c4t5000C500625B7EA7d0 ONLINE 0 0 0
c4t5000C500625B8137d0 ONLINE 0 0 0
mirror-6 ONLINE 0 0 0
c4t5000C500625B8427d0 ONLINE 0 0 0
c4t5000C500625B86E3d0 ONLINE 0 0 0
mirror-7 ONLINE 0 0 0
c4t5000C500625B886Fd0 ONLINE 0 0 0
c4t5000C500625BB773d0 ONLINE 0 0 0
mirror-8 ONLINE 0 0 0
c4t5000C500625BC2C3d0 ONLINE 0 0 0
c4t5000C500625BD3EBd0 ONLINE 0 0 0
mirror-9 ONLINE 0 0 0
c4t5000C50062878C0Bd0 ONLINE 0 0 0
c4t5000C50062878C43d0 ONLINE 0 0 0
mirror-10 ONLINE 0 0 0
c4t5000C50062879687d0 ONLINE 0 0 0
c4t5000C50062879707d0 ONLINE 0 0 0
logs
c10d0 ONLINE 0 0 0
c11d0 ONLINE 0 0 0
spares
c4t5000C50062879723d0 AVAIL
c4t5000C50062879787d0 AVAIL
extended device statistics
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
0.0 337.0 0.0 21899.1 0.0 0.0 0.0 0.0 0 0 c10d0
0.0 337.0 0.0 21835.1 0.0 0.0 0.0 0.0 0 0 c11d0
149.0 249.0 7723.2 7032.7 0.0 0.0 0.0 0.0 0 0 c12d0
144.0 295.0 6766.2 6955.7 0.0 0.0 0.0 0.0 0 0 c14d0
154.0 311.0 9241.6 6445.7 0.0 0.0 0.0 0.0 0 0 c15d0
150.0 263.0 7939.2 6096.7 0.0 0.0 0.0 0.0 0 0 c13d0
597.0 1118.0 31670.2 26530.9 5.8 0.4 3.4 0.2 5 8 pool03
0.0 1382.9 0.0 78460.7 11.4 1.7 8.3 1.3 5 97 pool04
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 rpool
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c7t0d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c7t1d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c7t4d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c7t5d0
0.0 25.0 0.0 1043.5 0.0 0.0 0.0 1.3 0 3
c4t5000C50055FE6A63d0
0.0 69.0 0.0 1478.4 0.0 0.0 0.0 0.7 0 4
c4t5000C5005708351Bd0
0.0 41.0 0.0 1261.9 0.0 0.0 0.0 0.7 0 3
c4t5000C50057086B67d0
0.0 37.0 0.0 2146.4 0.0 0.0 0.0 0.8 0 3
c4t5000C500570858EFd0
0.0 37.0 0.0 2146.4 0.0 0.0 0.0 1.2 0 4
c4t5000C50057085A6Bd0
0.0 69.0 0.0 1478.4 0.0 0.1 0.0 0.8 0 5
c4t5000C5005708296Fd0
0.0 26.0 0.0 1868.9 0.0 0.0 0.0 1.2 0 3
c4t5000C50057089753d0
0.0 27.0 0.0 1868.9 0.0 0.0 0.0 1.0 0 3
c4t5000C500570870D3d0
0.0 39.0 0.0 1261.9 0.0 0.0 0.0 0.7 0 3
c4t5000C50057086307d0
0.0 25.0 0.0 1043.5 0.0 0.0 0.0 1.3 0 3
c4t5000C50055FC9533d0
0.0 26.0 0.0 2103.9 0.0 0.0 0.0 0.8 0 2
c4t5000C50062878C43d0
0.0 15.0 0.0 1074.0 0.0 0.0 0.0 1.9 0 3
c4t5000C500625B886Fd0
0.0 15.0 0.0 1044.0 0.0 0.0 0.0 1.6 0 2
c4t5000C500625BD3EBd0
0.0 15.0 0.0 1044.0 0.0 0.0 0.0 2.6 0 4
c4t5000C500625BC2C3d0
0.0 15.0 0.0 1074.0 0.0 0.0 0.0 1.3 0 2
c4t5000C500625BB773d0
0.0 59.0 0.0 1388.4 0.0 0.0 0.0 0.6 0 3
c4t5000C500625B8427d0
0.0 44.0 0.0 1849.9 0.0 0.0 0.0 0.8 0 3
c4t5000C500625B8137d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0
c4t5000C50062879723d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0
c4t5000C50062879787d0
0.0 28.0 0.0 2103.9 0.0 0.0 0.0 1.0 0 3
c4t5000C50062879707d0
0.0 56.0 0.0 1388.4 0.0 0.0 0.0 0.6 0 4
c4t5000C500625B86E3d0
0.0 43.0 0.0 1849.9 0.0 0.0 0.0 0.8 0 3
c4t5000C500625B7EA7d0
0.0 26.0 0.0 2103.9 0.0 0.0 0.0 1.1 0 3
c4t5000C50062878C0Bd0
0.0 28.0 0.0 2103.9 0.0 0.0 0.0 1.2 0 3
c4t5000C50062879687d0
NAME PROPERTY VALUE SOURCE
pool04 type filesystem -
pool04 creation Fri Oct 31 6:31 2014 -
pool04 used 358G -
pool04 available 38.5T -
pool04 referenced 175G -
pool04 compressratio 1.71x -
pool04 mounted yes -
pool04 quota none default
pool04 reservation none default
pool04 recordsize 128K default
pool04 mountpoint /pool04 default
pool04 sharenfs off default
pool04 checksum on default
pool04 compression lz4 local
pool04 atime off local
pool04 devices on default
pool04 exec on default
pool04 setuid on default
pool04 readonly off default
pool04 zoned off default
pool04 snapdir hidden default
pool04 aclmode discard default
pool04 aclinherit restricted default
pool04 canmount on default
pool04 xattr on default
pool04 copies 1 default
pool04 version 5 -
pool04 utf8only off -
pool04 normalization none -
pool04 casesensitivity sensitive -
pool04 vscan off default
pool04 nbmand off default
pool04 sharesmb off default
pool04 refquota none default
pool04 refreservation 358G local
pool04 primarycache all default
pool04 secondarycache all default
pool04 usedbysnapshots 0 -
pool04 usedbydataset 175G -
pool04 usedbychildren 2.53M -
pool04 usedbyrefreservation 183G -
pool04 logbias latency default
pool04 dedup off default
pool04 mlslabel none default
pool04 sync always local
pool04 refcompressratio 1.71x -
pool04 written 175G -
pool04 logicalused 300G -
pool04 logicalreferenced 300G -
pool04 filesystem_limit none default
pool04 snapshot_limit none default
pool04 filesystem_count none default
pool04 snapshot_count none default
pool04 redundant_metadata all default
Br,
Rune
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<https://omniosce.org/ml-archive/attachments/20141031/b0fc5
1ae/attachment.html>
------------------------------
Subject: Digest Footer
_______________________________________________
OmniOS-discuss mailing list
OmniOS-discuss at lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss
------------------------------
End of OmniOS-discuss Digest, Vol 31, Issue 39
**********************************************
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 6247 bytes
Desc: not available
URL: <https://omniosce.org/ml-archive/attachments/20141031/19b34a69/attachment.bin>
More information about the OmniOS-discuss
mailing list