[OmniOS-discuss] Fibre Target problems

Mark mark0x01 at gmail.com
Thu Sep 11 07:57:09 UTC 2014 

I have a Supermicro X7DWN+ based server with 24 x 4Tb SAS disks on a LSI 
6G IT mode hba.

After configuring a bunch of 10Tb Luns and presenting to a Win2012 
server, write is very slow < 6 Mb/sec, and writing causes the Fc link to 
drop repeatedly.
Reads reach about 400Mb/sec.

OmniOS version is r151006_057.

I've tried two different 4G and an 8G QLogic adapters, via switch or 
direct, but there is no change in behaviour. Only 1 HBA and path.

The odd thing is the exact same hardware and os setup (fct, zpool etc.) 
works well with OI or Solaris 11/11, with writes getting around 4-500 
Mb/sec.
I had to start with OI147 and work up, as the later text installer is 
very buggy. Upgrading OI with qlt installed fails.

I'm at a bit of a loss as to a likely cause.

Anyone have any pointers ?


Some details and log:

HBA Port WWN: 2100001b320aba27
         Port Mode: Target
         Port ID: 10100
         OS Device Name: Not Applicable
         Manufacturer: QLogic Corp.
         Model: QLE2460
         Firmware Version: 5.2.1
         FCode/BIOS Version: N/A
         Serial Number: not available
         Driver Name: COMSTAR QLT
         Driver Version: 20100505-1.05
         Type: F-port
         State: online
         Supported Speeds: 1Gb 2Gb 4Gb
         Current Speed: 4Gb
         Node WWN: 2000001b320aba27
         Link Error Statistics:
                 Link Failure Count: 0
                 Loss of Sync Count: 0
                 Loss of Signal Count: 0
                 Primitive Seq Protocol Error Count: 0
                 Invalid Tx Word Count: 4
                 Invalid CRC Count: 0



prtconf

value='ISP2432-based 4Gb Fibre Channel to PCI Express HBA'
name='subsystem-name' type=string items=1
value='unknown subsystem'
Device Minor Nodes:dev=(3,1)
dev_path=/pci at 0,0/pci8086,4027 at 7/pci8086,3500 at 0/pci8086,3510 at 0/pci1077,137 at 0:qlt1

echo "*stmf_trace_buf/s" | mdb -k

0xffffff090f7c0000:             qlt1,0:0001318: iport is ffffff090f1921b8

:0003718: Imported the LU 600144f09cdd9224000053f56a5c0005
:0003719: Imported the LU 600144f09cdd9224000053f56a5d0006
:0003721: Imported the LU 600144f09cdd9224000053f56a5d0007
:0003722: Imported the LU 600144f09cdd9224000053f56a5e0008
:0003725: Imported the LU 600144f09cdd9224000053f56a5e0009
:0003726: Imported the LU 600144f09cdd9224000053f56a5f000a
:0003728: Imported the LU 600144f09cdd9224000053f56a5f000b
qlt1,0:0003815: Async event 8010 mb1=f8e8 mb2=c108, mb3=0, mb5=3362, mb6=0
qlt1,0:0003815: Async event 8011 mb1=3 mb2=c108, mb3=0, mb5=3362, mb6=0
qlt1,0:0003815: port state change from 0 to e
qlt1,0:0003815: Async event 8014 mb1=ffff mb2=6, mb3=0, mb5=3362, mb6=0
qlt1,0:0003815: Posting unsol ELS 3 (PLOGI) rp_id=e8 lp_id=ef
qlt1,0:0003815: Rcvd PLOGI with wrong lportid ef, expecting 0. Killing ELS.
qlt1,0:0003815: port state change from e to 4
qlt1,0:0004216: Posting unsol ELS 3 (PLOGI) rp_id=e8 lp_id=ef
qlt1,0:0004216: Processing unsol ELS 3 (PLOGI) rp_id=e8
qlt1,0:0004216: Posting unsol ELS 20 (PRLI) rp_id=e8 lp_id=ef
qlt1,0:0004216: Processing unsol ELS 20 (PRLI) rp_id=e8
qlt1,0:7247736: Posting unsol ELS 5 (LOGO) rp_id=e8 lp_id=ef
qlt1,0:7247736: Processing unsol ELS 5 (LOGO) rp_id=e8
qlt1,0:7247736: handling LOGO rp_id e8. Triggering cleanup
:7248836: fct_port_shutdown: port-ffffff090f1920b8, fct_process_logo: 
unable to clean up I/O. iport-ffffff090f1921b8, icmd-ffffff0931089a00
qlt1,0:7248836: port state change from 4 to 11
:7248836: fct_port_shutdown: port-ffffff090f1920b8, fct_process_logo: 
unable to clean up I/O. iport-ffffff090f1921b8, icmd-ffffff0931089a00
qlt1,0:7248836: port state change from 11 to 11
:7248836: fct_port_shutdown: port-ffffff090f1920b8, fct_process_logo: 
unable to clean up I/O. iport-ffffff090f1921b8, icmd-ffffff0931089a00
qlt1,0:7248936: port state change from 11 to 11
:7248936: fct_port_shutdown: port-ffffff090f1920b8, fct_process_logo: 
unable to clean up I/O. iport-ffffff090f1921b8, icmd-ffffff0931089a00
qlt1,0:7249036: port state change from 11 to 11
:7249036: fct_port_shutdown: port-ffffff090f1920b8, fct_process_logo: 
unable to clean up I/O. iport-ffffff090f1921b8, icmd-ffffff0931089a00
qlt1,0:7249136: port state change from 11 to 11
qlt1,0:7249136: Killing ELS 5 cond 1
qlt1,0:7249136: Processing sol ELS 5 (LOGO) rp_id=e8
qlt1,0:7249136: handling LOGO rp_id e8. Triggering cleanup
qlt1,0:7249236: port state change from 11 to 11
qlt1,0:7249336: port state change from 11 to 11
qlt1,0:7249336: port state change from 11 to 11
qlt1,0:7249436: port state change from 11 to 11
qlt1,0:7249536: port state change from 11 to 11
qlt1,0:7249536: handling LOGO rp_id e8, waiting for cmds to drain
qlt1,0:7249636: port state change from 11 to 11
qlt1,0:7249736: port state change from 11 to 11
qlt1,0:7249836: port state change from 11 to 11
qlt1,0:7249936: port state change from 11 to 11
qlt1,0:7250036: port state change from 11 to 11
qlt1,0:7250136: port state change from 11 to 11
qlt1,0:7250236: port state change from 11 to 11
:7250236: fct_port_shutdown: port-ffffff090f1920b8, fct_process_logo: 
unable to clean up I/O. iport-ffffff090f1921b8, icmd-ffffff091c5549d0
qlt1,0:7250336: port state change from 11 to 11
:7250336: fct_port_shutdown: port-ffffff090f1920b8, fct_process_logo: 
unable to clean up I/O. iport-ffffff090f1921b8, icmd-ffffff091c5549d0
qlt1,0:7250336: port state change from 11 to 11
:7250336: fct_port_shutdown: port-ffffff090f1920b8, fct_process_logo: 
unable to clean up I/O. iport-ffffff090f1921b8, icmd-ffffff091c5549d0
qlt1,0:7250436: port state change from 11 to 11
:7250436: fct_port_shutdown: port-ffffff090f1920b8, fct_process_logo: 
unable to clean up I/O. iport-ffffff090f1921b8, icmd-ffffff091c5549d0
qlt1,0:7250536: port state change from 11 to 11
:7250536: fct_port_shutdown: port-ffffff090f1920b8, fct_process_logo: 
unable to clean up I/O. iport-ffffff090f1921b8, icmd-ffffff091c5549d0
qlt1,0:7250636: port state change from 11 to 11
:7250636: fct_port_shutdown: port-ffffff090f1920b8, fct_process_logo: 
unable to clean up I/O. iport-ffffff090f1921b8, icmd-ffffff091c5549d0
qlt1,0:7250736: port state change from 11 to 11
:7250736: fct_port_shutdown: port-ffffff090f1920b8, fct_process_logo: 
unable to clean up I/O. iport-ffffff090f1921b8, icmd-ffffff091c5549d0
qlt1,0:7250836: port state change from 11 to 11
:7250836: fct_port_shutdown: port-ffffff090f1920b8, fct_process_logo: 
unable to clean up I/O. iport-ffffff090f1921b8, icmd-ffffff091c5549d0
qlt1,0:7250936: port state change from 11 to 11
:7250936: fct_port_shutdown: port-ffffff090f1920b8, fct_process_logo: 
unable to clean up I/O. iport-ffffff090f1921b8, icmd-ffffff091c5549d0
qlt1,0:7251136: port state change from 11 to 11
:7251136: fct_port_shutdown: port-ffffff090f1920b8, fct_process_logo: 
unable to clean up I/O. iport-ffffff090f1921b8, icmd-ffffff091c5549d0
qlt1,0:7251236: port state change from 11 to 11

More information about the OmniOS-discuss mailing list