[OmniOS-discuss] SolarFlare SFXGE with OmniOS

[Doug Hughes]

the default sfxge.conf doesn't even include the capability to use jumbo
frames until you edit it and reboot, so that's silly. Enabling them by
default in the sfxge.conf doesn't hurt and allows you to use jumbo or not
when the time comes.
Other  info tidbits
a default inter_moderation of 100 seems to be good for most NFS workloads.
default is 30.

the sfxge parent lines for rx_scale_count are good for most multi-cpu
systems, but people will need to change the pci device ID for things that
aren't a 5162 (which is what we by and large use)

We generally use rxq_size=2048, but that's our choice. It may not be right
for any particular. I'd suggest leaving it as default and am leaving it
commented out like the above.

by default large receiver offload is disabled. There seems to be no super
good reason for this (except maybe for the high frequency onboot guys), so
I enable it by default.

add_drv sets up appropriate permissions and aliases:
add_drv -m '* 0600 root sys' -i '"pciex1924,703" "pciex1924,710"
"pciex1924,803"

sfxge.conf attached



On Thu, Sep 25, 2014 at 3:39 PM, Saso Kiselkov <skiselkov.ml at gmail.com>
wrote:

> On 9/25/14, 9:35 PM, Doug Hughes wrote:
> > With non-debug driver:
> > 9.71 gbits/sec inbound
> > 8.54 gbits/sec outboudn
> >
> > 512k tcp window size. same 10g switch stack, but I can't guarantee that
> > it's not traversing the stack 40g link between the two stack members.
> > one side is a Sol10U10 box, the other is this x4440 running OmniOS.
> > Both have Solarflare cards setup in LACP to the switch stack.
> >
> > I'd say this is ok to release/bundle!
> >
> > (I'd be happy to volunteer a sfxge.conf for this, also we should use the
> > Solaris postinstall or a variant of it to do the correct add-drv and
> > driver_aliases stuff.)
>
> Great. If you have customizations to sfxge.conf that are supposed to be
> included, post 'em. Illumos doesn't really deal with packaging, so bit
> is going to be dealt with by the distro maintainers.
>
> Cheers,
> --
> Saso
> _______________________________________________
> OmniOS-discuss mailing list
> OmniOS-discuss at lists.omniti.com
> http://lists.omniti.com/mailman/listinfo/omnios-discuss
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://omniosce.org/ml-archive/attachments/20140925/2fe7fdcf/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: sfxge.conf
Type: application/octet-stream
Size: 9213 bytes
Desc: not available
URL: <https://omniosce.org/ml-archive/attachments/20140925/2fe7fdcf/attachment-0001.obj>