[OmniOS-discuss] zfs+iscsi+ha

[Mark Adams]

Hi All,

I'm looking at omnios to evaluate what I bet many people have tried before,
an HA zfs setup for proxmox (using their zfs over iscsi)

My setup is as follows:

san1 and san2 running debian stretch, using pacemaker LIO to export DRBD
device

zfshead1 and zfshead2 running omnios, as iscsi initiator, mounting a disk
from each shelf in a mirror, then exporting from ZFS volume to proxmox.

heartbeat is installed in omnios as per Igors work.

https://icicimov.github.io/blog/high-availability/ZFS-storage-with-OmniOS-and-iSCSI/

Now, this all works seemingly OK. The problem comes, when I fail over
between the "sans" in pacemaker. If I only have 1 iscsi target mounted in
omnios, then it all works ok, however if I have more than 1 ZFS immediately
faults. I can see the following in the log:

WARNING: iscsi session(5) is unable to offline obsolete logical unit 1

then

WARNING: iscsi driver unable to online lun

Which to me, means its tried to restart the iscsi connection and failed?
Again, this only happens after I add more than 1 target. A single target
seems to work fine.

I tried to use ERL mode 2 but it seems omnios doesn't support this as
initiator.

Has anyone got any ideas about this? Or any pointers?

Also let me know if you need more info.

Thanks,
Mark
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://omniosce.org/ml-archive/attachments/20171024/c95cf27e/attachment.html>