[OmniOS-discuss] infiniband

[Rune Tipsmark]

Nope, just a subnet manager...

I would do something like this

dladm create-part -l ibp0 -P 0xFFFF pFFFF.ibp0
dladm create-part -l ibp0 -P 0xFFFF pFFFF.ibp2
dladm create-part -l ibp0 -P 0xFFFF pFFFF.ibp4
dladm create-part -l ibp0 -P 0xFFFF pFFFF.ibp6
dladm create-part -l ibp1 -P 0xFFFF pFFFF.ibp1
dladm create-part -l ibp1 -P 0xFFFF pFFFF.ibp3
dladm create-part -l ibp1 -P 0xFFFF pFFFF.ibp5
dladm create-part -l ibp1 -P 0xFFFF pFFFF.ibp7

ipadm create-if pFFFF.ibp0
ipadm create-if pFFFF.ibp1
ipadm create-if pFFFF.ibp2
ipadm create-if pFFFF.ibp3
ipadm create-if pFFFF.ibp4
ipadm create-if pFFFF.ibp5
ipadm create-if pFFFF.ibp6
ipadm create-if pFFFF.ibp7

ipadm create-addr -T static -a 10.98.0.10 pFFFF.ibp0/ipv4
ipadm create-addr -T static -a 10.99.0.10 pFFFF.ibp1/ipv4
ipadm create-addr -T static -a 10.98.0.12 pFFFF.ibp2/ipv4
ipadm create-addr -T static -a 10.99.0.12 pFFFF.ibp3/ipv4
ipadm create-addr -T static -a 10.98.0.14 pFFFF.ibp4/ipv4
ipadm create-addr -T static -a 10.99.0.14 pFFFF.ibp5/ipv4
ipadm create-addr -T static -a 10.98.0.16 pFFFF.ibp6/ipv4
ipadm create-addr -T static -a 10.99.0.16 pFFFF.ibp7/ipv4


-----Original Message-----
From: OmniOS-discuss [mailto:omnios-discuss-bounces at lists.omniti.com] On Behalf Of Michael Rasmussen
Sent: Wednesday, November 12, 2014 3:48 PM
To: omnios-discuss at lists.omniti.com
Subject: Re: [OmniOS-discuss] infiniband

How exactly do you configure this?
Is a switch required?

On Wed, 12 Nov 2014 23:19:24 +0000
Rune Tipsmark <rt at steait.net> wrote:

> Multipath, round robin.
> You can create multiple IPoIB partitions... if you want 4 on each port
> 
> dladm create-part -l ibp0 -P 0xFFFF pFFFF.ibp0 dladm create-part -l 
> ibp0 -P 0xFFFF pFFFF.ibp2 dladm create-part -l ibp0 -P 0xFFFF 
> pFFFF.ibp4 dladm create-part -l ibp0 -P 0xFFFF pFFFF.ibp6 dladm 
> create-part -l ibp1 -P 0xFFFF pFFFF.ibp1 dladm create-part -l ibp1 -P 
> 0xFFFF pFFFF.ibp3 dladm create-part -l ibp1 -P 0xFFFF pFFFF.ibp5 dladm 
> create-part -l ibp1 -P 0xFFFF pFFFF.ibp7
> 
> 
> -----Original Message-----
> From: Michael Rasmussen [mailto:mir at miras.org]
> Sent: Wednesday, November 12, 2014 3:00 PM
> To: Rune Tipsmark
> Subject: Re: [OmniOS-discuss] infiniband
> 
> On Wed, 12 Nov 2014 22:35:46 +0000
> Rune Tipsmark <rt at steait.net> wrote:
> 
> > 
> > Did you try creating more partitions say 4 partitions to see if it performs better than 2? I see about twice the speed using round robin with two paths instead of just a single path.
> > 
> What do you mean by partitions?
> By two paths do you mean multipath or bonding?
> 


--
Hilsen/Regards
Michael Rasmussen

Get my public GnuPG keys:
michael <at> rasmussen <dot> cc
http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xD3C9A00E
mir <at> datanom <dot> net
http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE501F51C
mir <at> miras <dot> org
http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE3E80917
--------------------------------------------------------------
/usr/games/fortune -es says:
index, n.:
	Alphabetical list of words of no possible interest where an
	alphabetical list of subjects with references ought to be.