[Xen-API] XCP 1.1 and broadcom iscsi offloading

[Sébastien Riccio <sr@xxxxxxxxxxxxxxx>]

Hi,

I'm currently trying to get Broadcom NIC's iscsi offloading feature 
working on an xcp 1.1 box.
As the stock xcp 1.1 kernel doesn't contain the cnic/bnx2i I've build 
them from latest driver package I've downloaded on Broadcom's site.
For this I've used a modded DDK vm for XenServer 5.6 sp2 where I've 
installed the xcp 1.1 kernel header files.
The building worked like a charm.

Then, I've installed the modules on my xcp 1.1 box, rebooted and 
everything went fine.
I've manually loaded the bnx2i driver, so far so good.

Broadcom NetXtreme II iSCSI Driver bnx2i v2.7.0.4i (Nov 01, 2011)
iscsi: registered transport (bnx2i)
scsi4 : Broadcom Offload iSCSI Initiator
bnx2i [05:00.01]: ISCSI_INIT passed
scsi5 : Broadcom Offload iSCSI Initiator
bnx2i [05:00.00]: ISCSI_INIT passed
scsi6 : Broadcom Offload iSCSI Initiator
bnx2i [03:00.01]: ISCSI_INIT passed
scsi7 : Broadcom Offload iSCSI Initiator
bnx2i [03:00.00]: ISCSI_INIT passed
scsi8 : Broadcom Offload iSCSI Initiator
bnx2i [01:00.01]: ISCSI_INIT passed
scsi9 : Broadcom Offload iSCSI Initiator
bnx2i [01:00.00]: ISCSI_INIT passed

The target discoveries went good too, using iscsiadm, but then when I 
issue an iscsiadm -m node --login, it seems to break the kernel:

------------[ cut here ]------------
kernel BUG at 
/usr/src/redhat/BUILD/kernel-2.6.32.12/linux-2.6.32.12-0.7.1.xs1.sc.1.0.327.170596xen/arch/x86/include/mach-xen/asm/maddr_32.h:36!
invalid opcode: 0000 [#1] SMP
last sysfs file: /sys/class/uio/uio5/event
Modules linked in: iscsi_tcp libiscsi_tcp bnx2i cnic uio lockd sunrpc 
libiscsi scsi_transport_iscsi bridge stp llc binfmt_misc video output 
sbs sbshc fan container battery ac dm_multipath scsi_dh parport_pc lp 
parport nvram joydev sr_mod cdrom evdev usb_storage usb_libusual usbhid 
sg thermal button processor thermal_sys bnx2x mdio bnx2 rtc_cmos 
rtc_core rtc_lib 8250_pnp tpm_tis 8250 tpm tpm_bios serial_core pcspkr 
fbcon tileblit font bitblit softcursor dm_snapshot dm_zero dm_mirror 
dm_region_hash dm_log dm_mod ide_gd_mod megaraid_sas sd_mod scsi_mod 
ext3 jbd uhci_hcd ohci_hcd ehci_hcd usbcore [last unloaded: libiscsi_tcp]
Pid: 9625, comm: brcm_iscsiuio Not tainted 
(2.6.32.12-0.7.1.xs1.sc.1.0.327.170596xen #1) PowerEdge M610
EIP: 0061:[<c017a245>] EFLAGS: 00010206 CPU: 3
EIP is at remap_pfn_range+0x3f5/0x4a0
EAX: 0002f800 EBX: 80000000 ECX: 00000000 EDX: 000dd800
ESI: dd800037 EDI: 80000000 EBP: ee007ee0 ESP: ee007e7c
 DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0069
Process brcm_iscsiuio (pid: 9625, ti=ee006000 task=ed4263f0 
task.ti=ee006000)
Stack:
 ee820ba8 004ef2d7 00000000 000dd800 b386a000 ed200010 b3d6a000 b3d6a000
<0> e9411200 c019de61 d5c67000 000dd800 c1563aec eb858ce0 eea58027 00000004
<0> fff4c796 b3d69fff b3d69fff 00029f96 eb0d7358 b3a00000 00000037 80000000
Call Trace:
 [<c019de61>] ? do_path_lookup+0x31/0x60
 [<f04795b7>] ? uio_mmap+0x107/0x110 [uio]
 [<c017fc6b>] ? mmap_region+0x24b/0x3a0
 [<c018008e>] ? do_mmap_pgoff+0x2ce/0x2f0
 [<c0171fd6>] ? sys_mmap_pgoff+0xd6/0x100
 [<c01044e1>] ? syscall_call+0x7/0xb
Code: 45 b0 08 89 4d ac e9 b1 fc ff ff b8 ea ff ff ff 83 c4 58 5b 5e 5f 
5d c3 81 4b 18 00 00 00 40 89 4b 48 e9 57 fc ff ff 0f 0b eb fe <0f> 0b 
eb fe 0f 0b eb fe 31 c0 eb d9 8b 55 c0 8b 4d c4 8b 45 ac
EIP: [<c017a245>] remap_pfn_range+0x3f5/0x4a0 SS:ESP 0069:ee007e7c
---[ end trace 394852ab47647f02 ]---
bnx2x 0000:05:00.0: eth4: reset NL count
bnx2x 0000:05:00.1: eth5: reset NL count
bnx2x 0000:05:00.0: eth4: reset NL count
bnx2x 0000:05:00.1: eth5: reset NL count
bnx2x 0000:05:00.0: eth4: reset NL count


Anyone having experience with iscsi offloading on xcp 1.1 ? Or having an 
idea ?
Thanks :)

Cheers,
Sébastien

_______________________________________________
Xen-api mailing list
Xen-api@xxxxxxxxxxxxx
http://lists.xen.org/cgi-bin/mailman/listinfo/xen-api