[OmniOS-discuss] Network throughout 1GB/sec

[Ergi Thanasko]

Hi Gea,
Your property values are a bit off, here is what  i got from EMC
https://community.emc.com/docs/DOC-39156

  *   ipadm set-prop –p send_buf =2097152 tcp
  *   ipadm set-prop –p recv_buf=2097152 tcp
  *   ipadm set-prop –p max_buf=16777216 tcp
  *   ipadm set-prop –p _cwnd_max=8388608 tcp

also the power of 2 in twenty is 1048576.

Can you confirm that the set-prop -p values should the 2 in the power of 20 and 21st
[cid:449A210A-451D-40E1-97EA-98BA5E7FA558 at fios-router.home]

On Sep 16, 2016, at 12:57 PM, Guenther Alka <alka at hfg-gmuend.de<mailto:alka at hfg-gmuend.de>> wrote:

I have made some investigations into 10G and found that 300-400MB/s is expected with default settings. Improvements are possible up to 1000MB/s via mtu 9000 and if you increase ip buffers ex
max_buf=4097152 tcp
send_buf=2048576 tcp
recv_buf=2048576 tcp,

NFS lockd servers (ex 1024), NFS number of threads (ex 64) and NFS transfer size (ex 1048576)

http://napp-it.org/doc/downloads/performance_smb2.pdf


Gea

Am 16.09.2016 um 19:43 schrieb Ergi Thanasko:
Hi all,
We have a a few servers  conected via 10g nic  LACP, some of them have  4nic and some have 6nic in a link aggregation mode. We been moving a lot of data around and we are trying to get the maximum performance. I have seen zpool can deliver  2-3GB accumulated  throughput. Iperf does about 600-800MB/sec between those two servers.
Given  the hardware that we have and the zpool performance,   we expected   to see some serious data transfer rates  however we only see around 200-300MB/sec average  using rsync or copy paste over NFS.  Standard MTU 1500 and nfs block size.  I want to ask the community what to do get some higher throughout and the application level. I hear ZFS send/receive   or ZFS shadow does work faster but it does snapshots. Out data (Terabytes) is constantly evolving   and we prefer something in the nature of rsync  but to utilize the network hardware.

If Anyone has a hardware setup that can see 1GB/sec  throughput  and does not mind sharing?
Any software  that  use multithreads  sessions to move data around  zfs friendly? We do not mind getting going with a commercial solution like camvault or veeam if they work.

Thank you for your time



_______________________________________________
OmniOS-discuss mailing list
OmniOS-discuss at lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss

_______________________________________________
OmniOS-discuss mailing list
OmniOS-discuss at lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://omniosce.org/ml-archive/attachments/20161013/d9805b10/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ErgiThanasko.png
Type: image/png
Size: 7910 bytes
Desc: ErgiThanasko.png
URL: <https://omniosce.org/ml-archive/attachments/20161013/d9805b10/attachment-0001.png>