[OmniOS-discuss] LSI 9300-16i SAS and OmniOS?

Tue Sep 6 13:18:06 UTC 2016

Hi,

I have an new system with a LSI 9300-16i in slot3 of a X10DRi-T4+
motherboard on a 6G-Backplane.
In my short tests with barmetal OmniOS there were no problems. But I
would use VMware-virtualized OmniOS with passthrough LSI-HBA. And here
I have massive problems... The disks/pools crash after a short time
with low load.
I testet the HBA in another PCIe-slot - I havn´t seen any problems, but
I havn´t looked into the logfile.

Supermicro recommended to set jumper JI2C1 and JI2C2 to
2-3 - but they were set to this already. So I set the jumper to 1-2.
Now disks/pools crash still earlier.

The HBA gets very hot, but I testet it also with "special" airflow -
the same....

I attached the logfile...

What does it mean "FastPath":
----
Sep  6 15:07:05 test-san1 scsi: [ID 243001 kern.info]   w5000cca24200d4fd FastPath Capable and Enabled
Sep  6 15:07:05 test-san1 scsi: [ID 243001 kern.info]   w4433221106000000 FastPath Capable but Disabled
Sep  6 15:07:05 test-san1 scsi: [ID 243001 kern.info]   w5000cca24200d4c9 FastPath Capable and Enabled
Sep  6 15:07:05 test-san1 scsi: [ID 243001 kern.info]   w5000cca2426fff85 FastPath Capable and Enabled
Sep  6 15:07:05 test-san1 scsi: [ID 243001 kern.info]   w5000cca24200d33d FastPath Capable and Enabled
Sep  6 15:07:05 test-san1 scsi: [ID 243001 kern.info]   w5000cca24200d4c9 FastPath Capable and Enabled
----
and later:
----
Sep  6 15:10:19 test-san1 scsi: [ID 107833 kern.warning] WARNING: /pci at 0,0/pci15ad,7a0 at 18/pci1000,3130 at 0 (mpt_sas19):
Sep  6 15:10:19 test-san1       MPT Firmware Fault, code: 5854
Sep  6 15:10:21 test-san1 scsi: [ID 365881 kern.info] /pci at 0,0/pci15ad,7a0 at 18/pci1000,3130 at 0 (mpt_sas19):
Sep  6 15:10:21 test-san1       MPT Firmware version v12.0.0.0 (SAS3008)
Sep  6 15:10:21 test-san1 scsi: [ID 365881 kern.info] /pci at 0,0/pci15ad,7a0 at 18/pci1000,3130 at 0 (mpt_sas19):
Sep  6 15:10:21 test-san1       mpt_sas19 SAS 3 Supported
Sep  6 15:10:21 test-san1 scsi: [ID 365881 kern.info] /pci at 0,0/pci15ad,7a0 at 18/pci1000,3130 at 0 (mpt_sas19):
Sep  6 15:10:21 test-san1       mpt19: IOC Operational.
Sep  6 15:10:28 test-san1 scsi: [ID 243001 kern.info]   w4433221100000000 FastPath Capable but Disabled
Sep  6 15:10:28 test-san1 last message repeated 1 time
Sep  6 15:10:28 test-san1 scsi: [ID 243001 kern.info]   w4433221101000000 FastPath Capable but Disabled
Sep  6 15:10:28 test-san1 last message repeated 1 time
Sep  6 15:10:29 test-san1 scsi: [ID 243001 kern.info]   w4433221102000000 FastPath Capable but Disabled
Sep  6 15:10:29 test-san1 last message repeated 1 time
Sep  6 15:10:29 test-san1 scsi: [ID 243001 kern.info]   w4433221103000000 FastPath Capable but Disabled
Sep  6 15:10:29 test-san1 last message repeated 1 time
Sep  6 15:10:29 test-san1 scsi: [ID 243001 kern.info]   w4433221106000000 FastPath Capable but Disabled
Sep  6 15:10:29 test-san1 last message repeated 1 time
Sep  6 15:10:29 test-san1 scsi: [ID 243001 kern.info]   w4433221107000000 FastPath Capable but Disabled
Sep  6 15:10:29 test-san1 last message repeated 1 time
Sep  6 15:10:31 test-san1 scsi: [ID 107833 kern.warning] WARNING: /pci at 0,0/pci15ad,7a0 at 18/pci1000,3130 at 0 (mpt_sas19):
Sep  6 15:10:31 test-san1       MPT Firmware Fault, code: 5854
Sep  6 15:10:32 test-san1 scsi: [ID 365881 kern.info] /pci at 0,0/pci15ad,7a0 at 18/pci1000,3130 at 0 (mpt_sas19):
Sep  6 15:10:32 test-san1       MPT Firmware version v12.0.0.0 (SAS3008)
Sep  6 15:10:32 test-san1 scsi: [ID 365881 kern.info] /pci at 0,0/pci15ad,7a0 at 18/pci1000,3130 at 0 (mpt_sas19):
Sep  6 15:10:32 test-san1       mpt_sas19 SAS 3 Supported
Sep  6 15:10:32 test-san1 scsi: [ID 365881 kern.info] /pci at 0,0/pci15ad,7a0 at 18/pci1000,3130 at 0 (mpt_sas19):
Sep  6 15:10:32 test-san1       mpt19: IOC Operational.
Sep  6 15:10:40 test-san1 scsi: [ID 243001 kern.info]   w4433221100000000 FastPath Capable but Disabled
Sep  6 15:10:40 test-san1 scsi: [ID 243001 kern.info]   w4433221101000000 FastPath Capable but Disabled
Sep  6 15:10:40 test-san1 scsi: [ID 243001 kern.info]   w4433221102000000 FastPath Capable but Disabled
Sep  6 15:10:40 test-san1 scsi: [ID 243001 kern.info]   w4433221103000000 FastPath Capable but Disabled
Sep  6 15:10:41 test-san1 scsi: [ID 243001 kern.info]   w4433221106000000 FastPath Capable but Disabled
Sep  6 15:10:41 test-san1 scsi: [ID 243001 kern.info]   w4433221107000000 FastPath Capable but Disabled
----

For information:
pool1 6x SATA-SSD Raidz2
pool2 4x SAS-HDD 2 mirrored vdev with SATA-SSD l2arc

I hope anybody has any useful hints...

PS:
Tonight I want to test with only one HDD...

Frank

Sunday, September 4, 2016, 4:46:45 PM, you wrote:

BF> On Sun, 4 Sep 2016, Peter Tribble wrote:

>> On Sat, Sep 3, 2016 at 10:42 PM, Bob Friesenhahn <
>> bfriesen at simple.dallas.tx.us> wrote:
>>
>>> Is the LSI 9300-16i SAS support in OmniOS known to be robust?
>>>
>>> I am planning to use it with the SuperMicro SC836BA-R920B 3U case and
>>> Supermicro X10DRi-T4+ motherboard to build a storage server.
>>>
>>> Is there anything about this HBA and motherboard that might cause an issue?
>>>
>>
>> Should be good. We're using that X10DRi-T4+ motherboard with the LSI
>> 9300-8i HBA (in the 2U chassis,
>> where the 16i wouldn't fit), and everything has worked perfectly so far.

BF> That is good to hear.  I did not see any hardware on the motherboard 
BF> which is not supported by OmniOS.

BF> Something which is not clear to me (or to my computer builder) is if 
BF> using a 12gb SAS HBA and 12gb SAS disks with a passive backplane 
BF> described by SuperMicro as being 3g/6g might cause issues.  It is not 
BF> clear if the end devices somehow detect that the chassis is certified 
BF> for 6g or if they will use 12g and possibly work just fine, or 
BF> encounter issues.  The signalling and cables for 6g and 12g are the 
BF> same, but with 12g using a higher clocking rate.

BF> Bob

-- 
Best regards,
 Frank                            mailto:info.fmo at gmx.de

---
Diese E-Mail wurde von Avast Antivirus-Software auf Viren geprüft.
https://www.avast.com/antivirus
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: messages-test-san.txt
URL: <https://omniosce.org/ml-archive/attachments/20160906/473c3aa0/attachment-0001.txt>