[OmniOS-discuss] Ang: Re: zfs send via SRP or other RDMA enabled protocol

[Johan Kragsterman]

-----"OmniOS-discuss" <omnios-discuss-bounces at lists.omniti.com> skrev: -----
Till: David Bomba <turbo124 at gmail.com>
Från: Rune Tipsmark 
Sänt av: "OmniOS-discuss" 
Datum: 2014-11-02 07:55
Kopia: "omnios-discuss at lists.omniti.com" <omnios-discuss at lists.omniti.com>
Ärende: Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol

Sounds sensible, how do I do that?

I tried creating a view for a thin lu with my other zfs box, but how do I detect it?





First of all, if you run IB, forget the iscsi stuff, it's only creating un unnecessary IP layer that you don't need, and adds latency to your application.

Did you create SRP target service using COMSTAR?

# svcadm enable -r ibsrp/target

What's the output of "srptadm list-target" ?(on storage box), or you can also use "stmfadm list-target -v"

Do you got all necessary IB stuff, like a storage manager(OpenSM), in place? HCA ports shows up in dladm show-link?

If so, your host system should discover it as a local disk, just with "format", if you have created a view with the right eui.xxxxxxxxxxxx for the initiator HCA.


Rgrds Johan




 

I also stumbled across something else interesting, wondering if its possible to set up two identical boxes and create a pool with local/remote disks as per this article http://www.ssec.wisc.edu/~scottn/Lustre_ZFS_notes/lustre_zfs_srp_mirror.html

 

Br,

Rune

 

From: David Bomba [mailto:turbo124 at gmail.com] 
Sent: Saturday, November 01, 2014 6:01 PM
To: Rune Tipsmark
Cc: omnios-discuss at lists.omniti.com
Subject: Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol

 

I usually mount a iSer target and perform ZFS send to the target. This was the best way to exploit the rdma bandwidth to its full potential. 

 

 

On 2 Nov 2014, at 11:45 am, Rune Tipsmark <rt at steait.net> wrote:

 

Hi  all,

 

Is it possible to do zfs send/recv via SRP or some other RMDA enabled protocol? IPoIB is really slow, about 50 MB/sec between two boxes, no disks are more than 10-15% busy.

 

If not, is there a way I can aggregate say 8 or 16  IPoIB partitions and push throughput to a more reasonable speed…

 

Br,

Rune













_______________________________________________
OmniOS-discuss mailing list
OmniOS-discuss at lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss

 

_______________________________________________
OmniOS-discuss mailing list
OmniOS-discuss at lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss