[OmniOS-discuss] Illumos and Infiniband

[Ian Kaufman]

On my systems, the X-2 cards claim 32 gbps. I sued IPoIB, and have
seen transfers NFS transfers over 6 gbps and snapshot send/receive as
high as 1.8 gbps while the system was simultaneously utilized during
cluster computation.

Ian

On Wed, Jan 29, 2014 at 11:17 AM, David Bomba <turbo124 at gmail.com> wrote:
> Hi Chris,
>
> We have an environment running OmniOS with both ConnectX and ConnectX-2
> cards. The Hermon and Tavor drivers work very well.
>
> The only problem we had was that the CX-2 cards would only sync at 20gb/s.
> We export Comstar iSER targets and they have been rock solid for us for over
> a year.
>
> Dave
>
>
> On 30 January 2014 05:38, Chris Zembower <zembower at criterion.com> wrote:
>>
>>
>> Hello,
>>
>> I'm trying to dig up some information on Illumos (or Solaris)
>> compatibility with the Mellanox ConnectX-3 VPI HCA. From what I can gather,
>> the Hermon driver (for 1st-gen ConnectX) may work with this hardware with
>> tweaking, but I can't seem to confirm that.
>>
>> OmniOS is my server OS of choice (I have several systems running), but the
>> necessity of a working IB fabric here has led me to implement a ZFS on Linux
>> box for this particular purpose. I'm currently using LIO/targetcli to export
>> block SRP targets, and I'm not happy with it at all. Really wishing I had
>> Comstar for this.
>>
>> Anyone here using IB with OmniOS? Anyone aware of a roadmap or active
>> development of new IB drivers? Why isn't there an Illumos OFED port
>> happening? No interest? It's thriving on the Linux side of the world...
>>
>> Please don't lecture me on the merits of 10GbE/FC over Infiniband, I've
>> heard it all. :-)
>>
>> Any insights or suggestions are very much appreciated!
>>
>> Best,
>> Chris
>>
>> _______________________________________________
>> OmniOS-discuss mailing list
>> OmniOS-discuss at lists.omniti.com
>> http://lists.omniti.com/mailman/listinfo/omnios-discuss
>>
>
>
> _______________________________________________
> OmniOS-discuss mailing list
> OmniOS-discuss at lists.omniti.com
> http://lists.omniti.com/mailman/listinfo/omnios-discuss
>



-- 
Ian Kaufman
Research Systems Administrator
UC San Diego, Jacobs School of Engineering ikaufman AT ucsd DOT edu