[OmniOS-discuss] OmniOS Panic on high ZFS Write Load

[Rune Tipsmark]

SAS expander and 9 western digital WD4003FZEX
Now with 10 Seagate ST4000NM0023 instead things seem to work much better.

/Rune


-----Original Message-----
From: Dan McDonald [mailto:danmcd at omniti.com] 
Sent: Friday, May 16, 2014 10:41 AM
To: Rune Tipsmark
Cc: omnios-discuss at lists.omniti.com
Subject: Re: [OmniOS-discuss] OmniOS Panic on high ZFS Write Load


On May 16, 2014, at 12:57 PM, Rune Tipsmark <rt at steait.net> wrote:

> Hi guys,
> 
> After having tried various distros as mentioned and after having tried SLC and MLC PCI-E devices as well as SSD disks I think I actually found the issue.
> 
> Previously I had a bunch of SATA disks connected to my SAS controller as well as a bunch of SAS disks... now that I removed the SATA disks and only have SAS disks left I have not been able to reproduce the issue (regardless the fact I didn't even use the SAS controller for some tests that crashes). Very weird and what a waste of a few hundred hours of reinstalling/testing, swapping cables, switches, memory, messing with bios settings and what have we.
> 
> I now have two stable pools which each write a reasonable ~430 MB/sec with sync=always on without crashing.
> 
> Lesson - stay far away from SATA disks on LSI 9207-4i4e

Were you using a JBOD or other expander?  I've *heard* you can direclty attach SATA disks to an mpt_sas board if you're careful.

But generally speaking, it's operationally foolish to attach SATA drives anywhere other than to dedicated SATA ports.

Thanks,
Dan