[OmniOS-discuss] infiniband

[David Bomba]

I have the exact same issue Ian.

I have multiple XenServers connected to OmniOS storage units. Under
specific circumstances, I get iscsi disconnects which prove fatal for the
XenServer host guests. These machines run a mixed bag of ConnectX and
ConnectX-2 cards

I have managed to get the system stable, but with severe compromises.

Previously using 10Gb cards, I didnt have any problems what so ever.

On 24 October 2014 11:07, Ian Kaufman <ikaufman at eng.ucsd.edu> wrote:

> I have had an issue with the Hermon driver and Mellanox ConnectX2 QDR
> cards. On one system, I saw this in the log:
>
> massive02-a hermon: [ID 492207 kern.info] hermon1: CQE RNR retry
> counter exceeded
>
> and the card went offline. Now, the interface does not even come up.
> Three other identical systems are fine, as are two other systems with
> the same card running Illumian 1.0a. I haven't found a way to reset
> the RNR counter.
>
> Ian
>
> On Thu, Oct 23, 2014 at 4:49 PM, Michael Rasmussen <mir at miras.org> wrote:
> > On Thu, 23 Oct 2014 19:25:47 -0400
> > Dan McDonald <danmcd at omniti.com> wrote:
> >
> >>
> >> Only older cards.
> >>
> > By older cards do you the mean only 10 gbps cards?
> >
> >> > It is these cards I had in mind:
> >> > Voltaire 500 EX-D Dual Port Host Channel Adapter PCIe 20Gbps DDR
> >> > InfiniBand Card
> >>
> >> Do you know the PCI ID of that card?  I can double-check, but I'm
> guessing the answer will be no.
> >>
> >> Dan
> >>
> > prtconf -v from Solaris 11.1
> >
> https://forums.servethehome.com/index.php?threads/connectx-vpi-infiniband-card-and-solaris-11-1.3211/
> >
> > --
> > Hilsen/Regards
> > Michael Rasmussen
> >
> > Get my public GnuPG keys:
> > michael <at> rasmussen <dot> cc
> > http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xD3C9A00E
> > mir <at> datanom <dot> net
> > http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE501F51C
> > mir <at> miras <dot> org
> > http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE3E80917
> > --------------------------------------------------------------
> > /usr/games/fortune -es says:
> > [Sir Stafford Cripps] has all the virtues I dislike and none of the
> > vices I admire.
> >                 -- Winston Churchill
> >
> > _______________________________________________
> > OmniOS-discuss mailing list
> > OmniOS-discuss at lists.omniti.com
> > http://lists.omniti.com/mailman/listinfo/omnios-discuss
> >
>
>
>
> --
> Ian Kaufman
> Research Systems Administrator
> UC San Diego, Jacobs School of Engineering ikaufman AT ucsd DOT edu
> _______________________________________________
> OmniOS-discuss mailing list
> OmniOS-discuss at lists.omniti.com
> http://lists.omniti.com/mailman/listinfo/omnios-discuss
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://omniosce.org/ml-archive/attachments/20141024/ae23753e/attachment-0001.html>