[OmniOS-discuss] r151008 stmf crash

Mon Dec 23 20:07:18 UTC 2013

I am not very well versed in this area, but I have the core dump from 
the crash.  I can upload it if someone wants to take a more detailed look.

Here is what I have so far:

/usr/bin/mdb -k unix.0 vmcore.0
Loading modules: [ unix genunix specfs dtrace mac cpu.generic uppc apix 
scsi_vhci zfs mpt_sas sd ip hook neti sockfs arp usba stmf stmf_sbd md 
lofs random idm smbsrv nfs cpc kvm crypto ufs logindmux ptm nsmb ]
 > ::status
debugging crash dump vmcore.0 (64-bit) from stor2
operating system: 5.11 omnios-6de5e81 (i86pc)
image uuid: 1be881fe-834b-c1dd-b5ec-f528b9d6f1f9
panic message:
BAD TRAP: type=e (#pf Page fault) rp=ffffff007a4908d0 addr=8 occurred in 
module "stmf" due to a NULL pointer dereference
dump content: kernel pages only

 > ::stack
stmf_remove_lu_from_session+0x7c(ffffff11586f3920, ffffff116f40e1b8, 
ffffff1169658580, ffffff11801698b8)
stmf_update_sessions_per_ve+0x118(ffffff1180169888, ffffff1169658580, 0)
stmf_session_lu_unmapall+0x55(ffffff1169658580)
stmf_svc+0x111(0)
taskq_thread+0x2d0(ffffff1157404a08)
thread_start+8()

 > ::msgbuf
MESSAGE
ISA-device: asy0
asy0 is /pci at 0,0/isa at 1f/asy at 1,3f8
ISA-device: asy1
asy1 is /pci at 0,0/isa at 1f/asy at 1,2f8
pseudo-device: stmf0
stmf0 is /pseudo/stmf at 0
pseudo-device: ucode0
ucode0 is /pseudo/ucode at 0
npe1 at root: space 78 offset 0
npe1 is /pci at 78,0
mpt_sas2 at mpt_sas0: scsi-iport v0
mpt_sas2 is /pci at 0,0/pci8086,3c06 at 2,2/pci15d9,691 at 0/iport at v0
/pci at 0,0/pci8086,3c06 at 2,2/pci15d9,691 at 0/iport at v0 (mpt_sas2) online
ISA-device: pit_beep0
pit_beep0 is /pci at 0,0/isa at 1f/pit_beep
pseudo-device: pseudo1
pseudo1 is /pseudo/zconsnex at 1
pseudo-device: fct0
fct0 is /pseudo/fct at 0
pseudo-device: dcpc0
dcpc0 is /pseudo/dcpc at 0
pseudo-device: dtrace0
dtrace0 is /pseudo/dtrace at 0
pseudo-device: fasttrap0
fasttrap0 is /pseudo/fasttrap at 0
pseudo-device: fbt0
fbt0 is /pseudo/fbt at 0
pseudo-device: lockstat0
lockstat0 is /pseudo/lockstat at 0
pseudo-device: profile0
profile0 is /pseudo/profile at 0
pseudo-device: sdt0
sdt0 is /pseudo/sdt at 0
pseudo-device: systrace0
systrace0 is /pseudo/systrace at 0
pseudo-device: fcsm0
fcsm0 is /pseudo/fcsm at 0
pseudo-device: kvm0
kvm0 is /pseudo/kvm at 0
pseudo-device: fcp0
fcp0 is /pseudo/fcp at 0
pseudo-device: llc10
llc10 is /pseudo/llc1 at 0
pseudo-device: lofi0
lofi0 is /pseudo/lofi at 0
pseudo-device: ramdisk1024
ramdisk1024 is /pseudo/ramdisk at 1024
pseudo-device: pool0
pool0 is /pseudo/pool at 0
IP Filter: v4.1.9, running.
pseudo-device: fssnap0
fssnap0 is /pseudo/fssnap at 0
pseudo-device: nsmb0
nsmb0 is /pseudo/nsmb at 0
pseudo-device: bpf0
bpf0 is /pseudo/bpf at 0
NOTICE: igb0 unregistered
NOTICE: ixgbe1 unregistered
NOTICE: igb1 unregistered
NOTICE: igb2 unregistered
NOTICE: igb3 unregistered
pseudo-device: stmf0
stmf0 is /pseudo/stmf at 0
pseudo-device: devinfo0
devinfo0 is /pseudo/devinfo at 0
ISA-device: asy0
asy0 is /pci at 0,0/isa at 1f/asy at 1,3f8
ISA-device: asy1
asy1 is /pci at 0,0/isa at 1f/asy at 1,2f8
pseudo-device: fct0
fct0 is /pseudo/fct at 0
pseudo-device: dcpc0
dcpc0 is /pseudo/dcpc at 0
pseudo-device: fbt0
fbt0 is /pseudo/fbt at 0
pseudo-device: lockstat0
lockstat0 is /pseudo/lockstat at 0
pseudo-device: profile0
profile0 is /pseudo/profile at 0
pseudo-device: sdt0
sdt0 is /pseudo/sdt at 0
pseudo-device: systrace0
systrace0 is /pseudo/systrace at 0
pseudo-device: fcsm0
fcsm0 is /pseudo/fcsm at 0
pseudo-device: kvm0
kvm0 is /pseudo/kvm at 0
pseudo-device: fcp0
fcp0 is /pseudo/fcp at 0
NOTICE: igb0 registered
NOTICE: igb0: igb 2.3.8-ish
smp0 at mpt_sas1: target-port w500304800096a33f
smp0 is 
/pci at 0,0/pci8086,3c06 at 2,2/pci15d9,691 at 0/iport at f/smp at w500304800096a33f
sd3 at scsi_vhci0: unit-address g50015178f363f417: f_sym
sd3 is /scsi_vhci/disk at g50015178f363f417
pseudo-device: llc10
llc10 is /pseudo/llc1 at 0
pseudo-device: lofi0
lofi0 is /pseudo/lofi at 0
pseudo-device: ramdisk1024
ramdisk1024 is /pseudo/ramdisk at 1024
pseudo-device: ucode0
ucode0 is /pseudo/ucode at 0
pseudo-device: pm0
pm0 is /pseudo/pm at 0
pseudo-device: fssnap0
fssnap0 is /pseudo/fssnap at 0
NOTICE: igb1 registered
NOTICE: igb1: igb 2.3.8-ish
pseudo-device: nsmb0
nsmb0 is /pseudo/nsmb at 0
pseudo-device: bpf0
bpf0 is /pseudo/bpf at 0
NOTICE: igb2 registered
NOTICE: igb2: igb 2.3.8-ish
NOTICE: igb3 registered
NOTICE: igb3: igb 2.3.8-ish
NOTICE: ixgbe1 registered
NOTICE: ixgbe1: Intel 10Gb Ethernet, ixgbe 1.1.7

panic[cpu11]/thread=ffffff007a490c40:
BAD TRAP: type=e (#pf Page fault) rp=ffffff007a4908d0 addr=8 occurred in 
module "stmf" due to a NULL pointer dereference

sched:
#pf Page fault
Bad kernel fault at addr=0x8
pid=0, pc=0xfffffffff7df504c, sp=0xffffff007a4909c0, eflags=0x10202
cr0: 8005003b<pg,wp,ne,et,ts,mp,pe> cr4: 
426f8<osxsav,vmxe,xmme,fxsr,pge,mce,pae,pse,de>
cr2: 8
cr3: bc00000
cr8: 0

         rdi: ffffff11696587f0 rsi:         ffffffff rdx:               37
         rcx:                0  r8: ffffff115799fa80  r9: ffffff007d537c40
         rax: 1000000100000000 rbx: ffffff116f40e1b8 rbp: ffffff007a490a20
         r10: fffffffffbcf3990 r11:                0 r12: ffffff1169658580
         r13:                0 r14: ffffff11801698b8 r15: ffffff19fb7c77d8
         fsb: fffffd7fff0b0240 gsb: ffffff11579b6540 ds:               4b
          es:               4b  fs:                0 gs:                0
         trp:                e err:                0 rip: fffffffff7df504c
          cs:               30 rfl:            10202 rsp: ffffff007a4909c0
          ss:               38

ffffff007a4907b0 unix:die+df ()
ffffff007a4908c0 unix:trap+db3 ()
ffffff007a4908d0 unix:cmntrap+e6 ()
ffffff007a490a20 stmf:stmf_remove_lu_from_session+7c ()
ffffff007a490ab0 stmf:stmf_update_sessions_per_ve+118 ()
ffffff007a490af0 stmf:stmf_session_lu_unmapall+55 ()
ffffff007a490b60 stmf:stmf_svc+111 ()
ffffff007a490c20 genunix:taskq_thread+2d0 ()
ffffff007a490c30 unix:thread_start+8 ()

syncing file systems...
  done
dumping to /dev/zvol/dsk/rpool/dump, offset 65536, content: kernel

Happy Holidays!!

Geoff