[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-devel] Multi-bridged PCIe devices (Was: Re: iommuu/vt-d issues with LSI MegaSAS (PERC5i))



On Fri, Dec 13, 2013 at 11:13:11AM +0000, Jan Beulich wrote:
> >>> On 11.12.13 at 22:30, Konrad Rzeszutek Wilk <konrad.wilk@xxxxxxxxxx> 
> >>> wrote:
> > On Wed, Dec 11, 2013 at 09:15:17PM +0000, Gordan Bobic wrote:
> >> On 12/11/2013 06:32 PM, Konrad Rzeszutek Wilk wrote:
> >> >Interestingly enough I just hit this with my brand-new Haswell CPU and
> >> >new motherboard when passing in a capture card. It shows:
> >> >
> >> >     +-1c.5-[07-09]----00.0-[08-09]--+-01.0-[09]--+-08.0  Brooktree 
> >> > Corporation Bt878 Video 
> > Capture
> >> >            |                               |            +-08.1  
> >> > Brooktree 
> > Corporation Bt878 Audio Capture
> >> >            |                               |            +-09.0  
> >> > Brooktree 
> > Corporation Bt878 Video Capture
> >> >            |                               |            +-09.1  
> >> > Brooktree 
> > Corporation Bt878 Audio Capture
> >> >            |                               |            +-0a.0  
> >> > Brooktree 
> > Corporation Bt878 Video Capture
> >> >            |                               |            +-0a.1  
> >> > Brooktree 
> > Corporation Bt878 Audio Capture
> >> >            |                               |            +-0b.0  
> >> > Brooktree 
> > Corporation Bt878 Video Capture
> >> >            |                               |            \-0b.1  
> >> > Brooktree 
> > Corporation Bt878 Audio Capture
> >> >            |                               \-03.0  Texas Instruments 
> > TSB43AB22A IEEE-1394a-2000 Controller (PHY/Link) [iOHCI-Lynx]
> >> >
> >> >And Xen says:
> >> >(XEN) [VT-D]iommu.c:885: iommu_fault_status: Fault Overflow
> >> >(XEN) [VT-D]iommu.c:887: iommu_fault_status: Primary Pending Fault
> >> >(XEN) [VT-D]iommu.c:865: DMAR:[DMA Read] Request device [0000:08:00.0] 
> >> >fault 
> > addr 36aa3000, iommu reg = ffff82c3ffd53000
> >> >(XEN) DMAR:[fault reason 02h] Present bit in context entry is clear
> >> >(XEN) print_vtd_entries: iommu ffff83083d4939b0 dev 0000:08:00.0 gmfn 
> >> >36aa3
> >> >(XEN)     root_entry = ffff83083d47e000
> >> >(XEN)     root_entry[8] = 72569a001
> >> >(XEN)     context = ffff83072569a000
> >> >(XEN)     context[0] = 0_0
> >> >(XEN)     ctxt_entry[0] not present
> >> >(XEN) [VT-D]iommu.c:885: iommu_fault_status: Fault Overflow
> >> >(XEN) [VT-D]iommu.c:887: iommu_fault_status: Primary Pending Fault
> >> >(XEN) [VT-D]iommu.c:865: DMAR:[DMA Read] Request device [0000:08:00.0] 
> >> >fault 
> > addr 36aa3000, iommu reg = ffff82c3ffd53000
> >> >
> >> >
> >> >Oddly enough it was working fine in a box with an AMD IOMMU. But
> >> >to be fair - that machine was running with Xen 4.1.
> >> >
> >> >The hack I developed: 
> > http://lists.xen.org/archives/html/xen-devel/2010-06/msg00093.html 
> >> >ends up with this:
> >> >
> >> >(XEN) alloc_pdev: unknown type: 0000:08:00.0
> >> >(XEN) [VT-D]iommu.c:1484: d0:unknown(0): 0000:08:00.0
> >> >(XEN) [VT-D]iommu.c:1888: d0: context mapping failed
> >> >
> >> >(FYI, this Xen 4.3.1)
> >> >
> >> >Let me retry on the AMD box with the same version of Xen.
> >> 
> >> I may be wrong, but this doesn't look like the same problem (phantom
> >> PCI device on the bus). Or am I missing something?
> > 
> > It is. A phantom device as well.
> 
> Nothing in what you posted confirms this (because it doesn't
> show what the upstream bridge(s) is/are).

Ooops. Here is an output from lspci -v and lspci -vt

00:00.0 Host bridge: Intel Corporation 4th Gen Core Processor DRAM Controller 
(rev 06)
        Subsystem: Super Micro Computer Inc Device 0805
        Flags: bus master, fast devsel, latency 0
        Capabilities: [e0] Vendor Specific Information: Len=0c <?>

00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor 
PCI Express x16 Controller (rev 06) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
        I/O behind bridge: 0000e000-0000efff
        Memory behind bridge: f0d00000-f0dfffff
        Capabilities: [88] Subsystem: Intel Corporation Device 2010
        Capabilities: [80] Power Management version 3
        Capabilities: [90] MSI: Enable+ Count=1/1 Maskable- 64bit-
        Capabilities: [a0] Express Root Port (Slot+), MSI 00
        Capabilities: [100] Virtual Channel
        Capabilities: [140] Root Complex Link
        Capabilities: [d94] #19
        Kernel driver in use: pcieport

00:01.1 PCI bridge: Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor 
PCI Express x8 Controller (rev 06) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
        I/O behind bridge: 0000d000-0000dfff
        Memory behind bridge: f0c00000-f0cfffff
        Capabilities: [88] Subsystem: Intel Corporation Device 2010
        Capabilities: [80] Power Management version 3
        Capabilities: [90] MSI: Enable+ Count=1/1 Maskable- 64bit-
        Capabilities: [a0] Express Root Port (Slot+), MSI 00
        Capabilities: [100] Virtual Channel
        Capabilities: [140] Root Complex Link
        Capabilities: [d94] #19
        Kernel driver in use: pcieport

00:02.0 VGA compatible controller: Intel Corporation Xeon E3-1200 v3/4th Gen 
Core Processor Integrated Graphics Controller (rev 06) (prog-if 00 [VGA 
controller])
        Subsystem: Intel Corporation Device 2010
        Flags: bus master, fast devsel, latency 0, IRQ 77
        Memory at f0000000 (64-bit, non-prefetchable) [size=4M]
        Memory at e0000000 (64-bit, prefetchable) [size=256M]
        I/O ports at f000 [size=64]
        Expansion ROM at <unassigned> [disabled]
        Capabilities: [90] MSI: Enable+ Count=1/1 Maskable- 64bit-
        Capabilities: [d0] Power Management version 2
        Capabilities: [a4] PCI Advanced Features
        Kernel driver in use: i915

00:03.0 Audio device: Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor 
HD Audio Controller (rev 06)
        Subsystem: Intel Corporation Device 2010
        Flags: fast devsel, IRQ 16
        Memory at f0e34000 (64-bit, non-prefetchable) [size=16K]
        Capabilities: [50] Power Management version 2
        Capabilities: [60] MSI: Enable- Count=1/1 Maskable- 64bit-
        Capabilities: [70] Express Root Complex Integrated Endpoint, MSI 00

00:14.0 USB controller: Intel Corporation 8 Series/C220 Series Chipset Family 
USB xHCI (rev 04) (prog-if 30 [XHCI])
        Subsystem: Super Micro Computer Inc Device 0805
        Flags: bus master, medium devsel, latency 0, IRQ 71
        Memory at f0e20000 (64-bit, non-prefetchable) [size=64K]
        Capabilities: [70] Power Management version 2
        Capabilities: [80] MSI: Enable+ Count=1/8 Maskable- 64bit+
        Kernel driver in use: xhci_hcd

00:16.0 Communication controller: Intel Corporation 8 Series/C220 Series 
Chipset Family MEI Controller #1 (rev 04)
        Subsystem: Super Micro Computer Inc Device 0805
        Flags: bus master, fast devsel, latency 0, IRQ 78
        Memory at f0e40000 (64-bit, non-prefetchable) [size=16]
        Capabilities: [50] Power Management version 3
        Capabilities: [8c] MSI: Enable+ Count=1/1 Maskable- 64bit+
        Kernel driver in use: mei_me

00:16.3 Serial controller: Intel Corporation 8 Series/C220 Series Chipset 
Family KT Controller (rev 04) (prog-if 02 [16550])
        Subsystem: Super Micro Computer Inc Device 0805
        Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 19
        I/O ports at f0e0 [size=8]
        Memory at f0e3e000 (32-bit, non-prefetchable) [size=4K]
        Capabilities: [c8] Power Management version 3
        Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
        Kernel driver in use: serial

00:19.0 Ethernet controller: Intel Corporation Ethernet Connection I217-LM (rev 
04)
        Subsystem: Super Micro Computer Inc Device 153a
        Flags: bus master, fast devsel, latency 0, IRQ 84
        Memory at f0e00000 (32-bit, non-prefetchable) [size=128K]
        Memory at f0e3d000 (32-bit, non-prefetchable) [size=4K]
        I/O ports at f080 [size=32]
        Capabilities: [c8] Power Management version 2
        Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
        Capabilities: [e0] PCI Advanced Features
        Kernel driver in use: e1000e

00:1a.0 USB controller: Intel Corporation 8 Series/C220 Series Chipset Family 
USB EHCI #2 (rev 04) (prog-if 20 [EHCI])
        Subsystem: Super Micro Computer Inc Device 0805
        Flags: bus master, medium devsel, latency 0, IRQ 16
        Memory at f0e3c000 (32-bit, non-prefetchable) [size=1K]
        Capabilities: [50] Power Management version 2
        Capabilities: [58] Debug port: BAR=1 offset=00a0
        Capabilities: [98] PCI Advanced Features
        Kernel driver in use: ehci-pci

00:1b.0 Audio device: Intel Corporation 8 Series/C220 Series Chipset High 
Definition Audio Controller (rev 04)
        Subsystem: Super Micro Computer Inc Device 0805
        Flags: fast devsel, IRQ 22
        Memory at f0e30000 (64-bit, non-prefetchable) [size=16K]
        Capabilities: [50] Power Management version 2
        Capabilities: [60] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [70] Express Root Complex Integrated Endpoint, MSI 00
        Capabilities: [100] Virtual Channel

00:1c.0 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI 
Express Root Port #1 (rev d4) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
        I/O behind bridge: 0000c000-0000cfff
        Memory behind bridge: f0b00000-f0bfffff
        Capabilities: [40] Express Root Port (Slot+), MSI 00
        Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
        Capabilities: [90] Subsystem: Super Micro Computer Inc Device 0805
        Capabilities: [a0] Power Management version 3
        Kernel driver in use: pcieport

00:1c.1 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI 
Express Root Port #2 (rev d4) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
        I/O behind bridge: 0000b000-0000bfff
        Memory behind bridge: f0a00000-f0afffff
        Capabilities: [40] Express Root Port (Slot+), MSI 00
        Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
        Capabilities: [90] Subsystem: Super Micro Computer Inc Device 0805
        Capabilities: [a0] Power Management version 3
        Kernel driver in use: pcieport

00:1c.3 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI 
Express Root Port #4 (rev d4) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=00, secondary=05, subordinate=05, sec-latency=0
        I/O behind bridge: 0000a000-0000afff
        Memory behind bridge: f0900000-f09fffff
        Capabilities: [40] Express Root Port (Slot+), MSI 00
        Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
        Capabilities: [90] Subsystem: Super Micro Computer Inc Device 0805
        Capabilities: [a0] Power Management version 3
        Kernel driver in use: pcieport

00:1c.4 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI 
Express Root Port #5 (rev d4) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=00, secondary=06, subordinate=06, sec-latency=0
        I/O behind bridge: 00009000-00009fff
        Memory behind bridge: f0800000-f08fffff
        Capabilities: [40] Express Root Port (Slot+), MSI 00
        Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
        Capabilities: [90] Subsystem: Super Micro Computer Inc Device 0805
        Capabilities: [a0] Power Management version 3
        Kernel driver in use: pcieport

00:1c.5 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI 
Express Root Port #6 (rev d4) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=00, secondary=07, subordinate=09, sec-latency=0
        Memory behind bridge: f0400000-f05fffff
        Capabilities: [40] Express Root Port (Slot+), MSI 00
        Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
        Capabilities: [90] Subsystem: Super Micro Computer Inc Device 0805
        Capabilities: [a0] Power Management version 3
        Kernel driver in use: pcieport

00:1c.6 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI 
Express Root Port #7 (rev d4) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=00, secondary=0a, subordinate=0a, sec-latency=0
        Memory behind bridge: f0700000-f07fffff
        Capabilities: [40] Express Root Port (Slot+), MSI 00
        Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
        Capabilities: [90] Subsystem: Super Micro Computer Inc Device 0805
        Capabilities: [a0] Power Management version 3
        Kernel driver in use: pcieport

00:1c.7 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI 
Express Root Port #8 (rev d4) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=00, secondary=0b, subordinate=0b, sec-latency=0
        I/O behind bridge: 00008000-00008fff
        Memory behind bridge: f0600000-f06fffff
        Capabilities: [40] Express Root Port (Slot+), MSI 00
        Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
        Capabilities: [90] Subsystem: Super Micro Computer Inc Device 0805
        Capabilities: [a0] Power Management version 3
        Kernel driver in use: pcieport

00:1d.0 USB controller: Intel Corporation 8 Series/C220 Series Chipset Family 
USB EHCI #1 (rev 04) (prog-if 20 [EHCI])
        Subsystem: Super Micro Computer Inc Device 0805
        Flags: bus master, medium devsel, latency 0, IRQ 23
        Memory at f0e3b000 (32-bit, non-prefetchable) [size=1K]
        Capabilities: [50] Power Management version 2
        Capabilities: [58] Debug port: BAR=1 offset=00a0
        Capabilities: [98] PCI Advanced Features
        Kernel driver in use: ehci-pci

00:1f.0 ISA bridge: Intel Corporation C226 Series Chipset Family Server 
Advanced SKU LPC Controller (rev 04)
        Subsystem: Super Micro Computer Inc Device 0805
        Flags: bus master, medium devsel, latency 0
        Capabilities: [e0] Vendor Specific Information: Len=0c <?>
        Kernel driver in use: lpc_ich

00:1f.2 SATA controller: Intel Corporation 8 Series/C220 Series Chipset Family 
6-port SATA Controller 1 [AHCI mode] (rev 04) (prog-if 01 [AHCI 1.0])
        Subsystem: Super Micro Computer Inc Device 0805
        Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 69
        I/O ports at f0d0 [size=8]
        I/O ports at f0c0 [size=4]
        I/O ports at f0b0 [size=8]
        I/O ports at f0a0 [size=4]
        I/O ports at f060 [size=32]
        Memory at f0e3a000 (32-bit, non-prefetchable) [size=2K]
        Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
        Capabilities: [70] Power Management version 3
        Capabilities: [a8] SATA HBA v1.0
        Kernel driver in use: ahci

00:1f.3 SMBus: Intel Corporation 8 Series/C220 Series Chipset Family SMBus 
Controller (rev 04)
        Subsystem: Super Micro Computer Inc Device 0805
        Flags: medium devsel, IRQ 18
        Memory at f0e39000 (64-bit, non-prefetchable) [size=256]
        I/O ports at f040 [size=32]
        Kernel driver in use: i801_smbus

00:1f.6 Signal processing controller: Intel Corporation 8 Series Chipset Family 
Thermal Management Controller (rev 04)
        Subsystem: Super Micro Computer Inc Device 0805
        Flags: bus master, fast devsel, latency 0, IRQ 5
        Memory at f0e38000 (64-bit, non-prefetchable) [size=4K]
        Capabilities: [50] Power Management version 3
        Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-

01:00.0 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet 
Controller (rev 06)
        Subsystem: Intel Corporation PRO/1000 PT Dual Port Server Adapter
        Flags: bus master, fast devsel, latency 0, IRQ 79
        Memory at f0da0000 (32-bit, non-prefetchable) [size=128K]
        Memory at f0d80000 (32-bit, non-prefetchable) [size=128K]
        I/O ports at e020 [size=32]
        Expansion ROM at f0d60000 [disabled] [size=128K]
        Capabilities: [c8] Power Management version 2
        Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
        Capabilities: [e0] Express Endpoint, MSI 00
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [140] Device Serial Number 00-15-17-ff-ff-3e-24-4c
        Kernel driver in use: e1000e

01:00.1 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet 
Controller (rev 06)
        Subsystem: Intel Corporation PRO/1000 PT Dual Port Server Adapter
        Flags: bus master, fast devsel, latency 0, IRQ 80
        Memory at f0d40000 (32-bit, non-prefetchable) [size=128K]
        Memory at f0d20000 (32-bit, non-prefetchable) [size=128K]
        I/O ports at e000 [size=32]
        Expansion ROM at f0d00000 [disabled] [size=128K]
        Capabilities: [c8] Power Management version 2
        Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
        Capabilities: [e0] Express Endpoint, MSI 00
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [140] Device Serial Number 00-15-17-ff-ff-3e-24-4c
        Kernel driver in use: e1000e

02:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2008 
PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 02)
        Subsystem: LSI Logic / Symbios Logic Device 3020
        Flags: bus master, fast devsel, latency 0, IRQ 17
        I/O ports at d000 [size=256]
        Memory at f0cc0000 (64-bit, non-prefetchable) [size=16K]
        Memory at f0c80000 (64-bit, non-prefetchable) [size=256K]
        Expansion ROM at f0c00000 [disabled] [size=512K]
        Capabilities: [50] Power Management version 3
        Capabilities: [68] Express Endpoint, MSI 00
        Capabilities: [d0] Vital Product Data
        Capabilities: [a8] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [c0] MSI-X: Enable+ Count=15 Masked-
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [138] Power Budgeting <?>
        Capabilities: [150] Single Root I/O Virtualization (SR-IOV)
        Capabilities: [190] Alternative Routing-ID Interpretation (ARI)
        Kernel driver in use: mpt2sas

03:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection
        Subsystem: Intel Corporation Gigabit CT Desktop Adapter
        Flags: bus master, fast devsel, latency 0, IRQ 16
        Memory at f0bc0000 (32-bit, non-prefetchable) [size=128K]
        Memory at f0b00000 (32-bit, non-prefetchable) [size=512K]
        I/O ports at c000 [size=32]
        Memory at f0be0000 (32-bit, non-prefetchable) [size=16K]
        Expansion ROM at f0b80000 [disabled] [size=256K]
        Capabilities: [c8] Power Management version 2
        Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [e0] Express Endpoint, MSI 00
        Capabilities: [a0] MSI-X: Enable+ Count=5 Masked-
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [140] Device Serial Number 00-1b-21-ff-ff-61-49-00
        Kernel driver in use: pciback

04:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection
        Subsystem: Intel Corporation Gigabit CT Desktop Adapter
        Flags: bus master, fast devsel, latency 0, IRQ 17
        Memory at f0ac0000 (32-bit, non-prefetchable) [size=128K]
        Memory at f0a00000 (32-bit, non-prefetchable) [size=512K]
        I/O ports at b000 [size=32]
        Memory at f0ae0000 (32-bit, non-prefetchable) [size=16K]
        Expansion ROM at f0a80000 [disabled] [size=256K]
        Capabilities: [c8] Power Management version 2
        Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [e0] Express Endpoint, MSI 00
        Capabilities: [a0] MSI-X: Enable+ Count=5 Masked-
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [140] Device Serial Number 68-05-ca-ff-ff-02-4c-71
        Kernel driver in use: pciback

05:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection 
(rev 03)
        Subsystem: Super Micro Computer Inc Device 1533
        Flags: fast devsel, IRQ 19
        Memory at f0900000 (32-bit, non-prefetchable) [disabled] [size=512K]
        I/O ports at a000 [disabled] [size=32]
        Memory at f0980000 (32-bit, non-prefetchable) [disabled] [size=16K]
        Capabilities: [40] Power Management version 3
        Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
        Capabilities: [70] MSI-X: Enable- Count=5 Masked-
        Capabilities: [a0] Express Endpoint, MSI 00
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [140] Device Serial Number 00-25-90-ff-ff-86-c7-57
        Capabilities: [1a0] Transaction Processing Hints
        Kernel driver in use: pciback

06:00.0 Ethernet controller: Intel Corporation 82572EI Gigabit Ethernet 
Controller (Copper) (rev 06)
        Subsystem: Intel Corporation PRO/1000 PT Desktop Adapter
        Flags: fast devsel, IRQ 16
        Memory at f0840000 (32-bit, non-prefetchable) [disabled] [size=128K]
        Memory at f0820000 (32-bit, non-prefetchable) [disabled] [size=128K]
        I/O ports at 9000 [disabled] [size=32]
        Expansion ROM at f0800000 [disabled] [size=128K]
        Capabilities: [c8] Power Management version 2
        Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [e0] Express Endpoint, MSI 00
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [140] Device Serial Number 00-1b-21-ff-ff-00-37-02
        Kernel driver in use: pciback

07:00.0 PCI bridge: Tundra Semiconductor Corp. Device 8113 (rev 01) (prog-if 01 
[Subtractive decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=07, secondary=08, subordinate=09, sec-latency=32
        Memory behind bridge: f0400000-f05fffff
        Capabilities: [60] Subsystem: Super Micro Computer Inc Device 0805
        Capabilities: [a0] Power Management version 3

08:01.0 PCI bridge: Hint Corp HB6 Universal PCI-PCI bridge (non-transparent 
mode) (rev 11) (prog-if 00 [Normal decode])
        Physical Slot: 2
        Flags: bus master, medium devsel, latency 32
        Bus: primary=08, secondary=09, subordinate=09, sec-latency=32
        Memory behind bridge: f0400000-f04fffff
        Capabilities: [80] Power Management version 2
        Capabilities: [90] CompactPCI hot-swap <?>

08:03.0 FireWire (IEEE 1394): Texas Instruments TSB43AB22A IEEE-1394a-2000 
Controller (PHY/Link) [iOHCI-Lynx] (prog-if 10 [OHCI])
        Subsystem: Super Micro Computer Inc Device 0805
        Physical Slot: 4
        Flags: medium devsel, IRQ 16
        Memory at f0504000 (32-bit, non-prefetchable) [size=2K]
        Memory at f0500000 (32-bit, non-prefetchable) [size=16K]
        Capabilities: [44] Power Management version 2

09:08.0 Multimedia video controller: Brooktree Corporation Bt878 Video Capture 
(rev 11)
        Subsystem: Device aa00:1460
        Flags: medium devsel, IRQ 18
        Memory at f0407000 (32-bit, prefetchable) [disabled] [size=4K]
        Capabilities: [44] Vital Product Data
        Capabilities: [4c] Power Management version 2
        Kernel driver in use: pciback

09:08.1 Multimedia controller: Brooktree Corporation Bt878 Audio Capture (rev 
11)
        Subsystem: Device aa00:1460
        Flags: medium devsel, IRQ 18
        Memory at f0406000 (32-bit, prefetchable) [disabled] [size=4K]
        Capabilities: [44] Vital Product Data
        Capabilities: [4c] Power Management version 2
        Kernel driver in use: pciback

09:09.0 Multimedia video controller: Brooktree Corporation Bt878 Video Capture 
(rev 11)
        Subsystem: Device aa01:1461
        Flags: medium devsel, IRQ 19
        Memory at f0405000 (32-bit, prefetchable) [disabled] [size=4K]
        Capabilities: [44] Vital Product Data
        Capabilities: [4c] Power Management version 2
        Kernel driver in use: pciback

09:09.1 Multimedia controller: Brooktree Corporation Bt878 Audio Capture (rev 
11)
        Subsystem: Device aa01:1461
        Flags: medium devsel, IRQ 19
        Memory at f0404000 (32-bit, prefetchable) [disabled] [size=4K]
        Capabilities: [44] Vital Product Data
        Capabilities: [4c] Power Management version 2
        Kernel driver in use: pciback

09:0a.0 Multimedia video controller: Brooktree Corporation Bt878 Video Capture 
(rev 11)
        Subsystem: Device aa02:1462
        Flags: medium devsel, IRQ 16
        Memory at f0403000 (32-bit, prefetchable) [disabled] [size=4K]
        Capabilities: [44] Vital Product Data
        Capabilities: [4c] Power Management version 2
        Kernel driver in use: pciback

09:0a.1 Multimedia controller: Brooktree Corporation Bt878 Audio Capture (rev 
11)
        Subsystem: Device aa02:1462
        Flags: medium devsel, IRQ 16
        Memory at f0402000 (32-bit, prefetchable) [disabled] [size=4K]
        Capabilities: [44] Vital Product Data
        Capabilities: [4c] Power Management version 2
        Kernel driver in use: pciback

09:0b.0 Multimedia video controller: Brooktree Corporation Bt878 Video Capture 
(rev 11)
        Subsystem: Device aa03:1463
        Flags: medium devsel, IRQ 17
        Memory at f0401000 (32-bit, prefetchable) [disabled] [size=4K]
        Capabilities: [44] Vital Product Data
        Capabilities: [4c] Power Management version 2
        Kernel driver in use: pciback

09:0b.1 Multimedia controller: Brooktree Corporation Bt878 Audio Capture (rev 
11)
        Subsystem: Device aa03:1463
        Flags: medium devsel, IRQ 17
        Memory at f0400000 (32-bit, prefetchable) [disabled] [size=4K]
        Capabilities: [44] Vital Product Data
        Capabilities: [4c] Power Management version 2
        Kernel driver in use: pciback

0a:00.0 USB controller: Renesas Technology Corp. uPD720202 USB 3.0 Host 
Controller (rev 02) (prog-if 30 [XHCI])
        Subsystem: Super Micro Computer Inc Device 0805
        Flags: bus master, fast devsel, latency 0, IRQ 18
        Memory at f0700000 (64-bit, non-prefetchable) [size=8K]
        Capabilities: [50] Power Management version 3
        Capabilities: [70] MSI: Enable- Count=1/8 Maskable- 64bit+
        Capabilities: [90] MSI-X: Enable+ Count=8 Masked-
        Capabilities: [a0] Express Endpoint, MSI 00
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [150] Latency Tolerance Reporting
        Kernel driver in use: xhci_hcd

0b:00.0 SATA controller: ASMedia Technology Inc. ASM1062 Serial ATA Controller 
(rev 01) (prog-if 01 [AHCI 1.0])
        Subsystem: Super Micro Computer Inc Device 0805
        Flags: bus master, fast devsel, latency 0, IRQ 70
        I/O ports at 8050 [size=8]
        I/O ports at 8040 [size=4]
        I/O ports at 8030 [size=8]
        I/O ports at 8020 [size=4]
        I/O ports at 8000 [size=32]
        Memory at f0600000 (32-bit, non-prefetchable) [size=512]
        Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit-
        Capabilities: [78] Power Management version 3
        Capabilities: [80] Express Legacy Endpoint, MSI 00
        Capabilities: [100] Virtual Channel
        Kernel driver in use: ahci

-[0000:00]-+-00.0  Intel Corporation 4th Gen Core Processor DRAM Controller
           +-01.0-[01]--+-00.0  Intel Corporation 82571EB Gigabit Ethernet 
Controller
           |            \-00.1  Intel Corporation 82571EB Gigabit Ethernet 
Controller
           +-01.1-[02]----00.0  LSI Logic / Symbios Logic SAS2008 PCI-Express 
Fusion-MPT SAS-2 [Falcon]
           +-02.0  Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor 
Integrated Graphics Controller
           +-03.0  Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor HD 
Audio Controller
           +-14.0  Intel Corporation 8 Series/C220 Series Chipset Family USB 
xHCI
           +-16.0  Intel Corporation 8 Series/C220 Series Chipset Family MEI 
Controller #1
           +-16.3  Intel Corporation 8 Series/C220 Series Chipset Family KT 
Controller
           +-19.0  Intel Corporation Ethernet Connection I217-LM
           +-1a.0  Intel Corporation 8 Series/C220 Series Chipset Family USB 
EHCI #2
           +-1b.0  Intel Corporation 8 Series/C220 Series Chipset High 
Definition Audio Controller
           +-1c.0-[03]----00.0  Intel Corporation 82574L Gigabit Network 
Connection
           +-1c.1-[04]----00.0  Intel Corporation 82574L Gigabit Network 
Connection
           +-1c.3-[05]----00.0  Intel Corporation I210 Gigabit Network 
Connection
           +-1c.4-[06]----00.0  Intel Corporation 82572EI Gigabit Ethernet 
Controller (Copper)
           +-1c.5-[07-09]----00.0-[08-09]--+-01.0-[09]--+-08.0  Brooktree 
Corporation Bt878 Video Capture
           |                               |            +-08.1  Brooktree 
Corporation Bt878 Audio Capture
           |                               |            +-09.0  Brooktree 
Corporation Bt878 Video Capture
           |                               |            +-09.1  Brooktree 
Corporation Bt878 Audio Capture
           |                               |            +-0a.0  Brooktree 
Corporation Bt878 Video Capture
           |                               |            +-0a.1  Brooktree 
Corporation Bt878 Audio Capture
           |                               |            +-0b.0  Brooktree 
Corporation Bt878 Video Capture
           |                               |            \-0b.1  Brooktree 
Corporation Bt878 Audio Capture
           |                               \-03.0  Texas Instruments TSB43AB22A 
IEEE-1394a-2000 Controller (PHY/Link) [iOHCI-Lynx]
           +-1c.6-[0a]----00.0  Renesas Technology Corp. uPD720202 USB 3.0 Host 
Controller
           +-1c.7-[0b]----00.0  ASMedia Technology Inc. ASM1062 Serial ATA 
Controller
           +-1d.0  Intel Corporation 8 Series/C220 Series Chipset Family USB 
EHCI #1
           +-1f.0  Intel Corporation C226 Series Chipset Family Server Advanced 
SKU LPC Controller
           +-1f.2  Intel Corporation 8 Series/C220 Series Chipset Family 6-port 
SATA Controller 1 [AHCI mode]
           +-1f.3  Intel Corporation 8 Series/C220 Series Chipset Family SMBus 
Controller
           \-1f.6  Intel Corporation 8 Series Chipset Family Thermal Management 
Controller
> 
> >> As far as I can tell, the original problem was arising on cards that
> >> are PCIe, but based on a PCIX chipset, i.e. with a PCIe-PCIX bridge.
> >> Xen wasn't the only thing affected in my case - bare metal Linux
> >> kernel was also having problems with intel-iommu=1 in the kernel
> >> boot parameters. If might be worth trying that with your card to see
> >> what happens. If bare metal Linux with intel-iommu=1 works for your
> >> card, it's probably not the same problem (of course it could be
> >> similar/related).
> > 
> > That is a similar problem here. Except that I have a PCI devices and
> > it goes over an PCIe bridge (I think).
> 
> As said above - to see that's the case would require to see more
> lspci output than what you provided.
> 
> >> Out of interest, I noticed recently there is a xen parameter
> >> "pci-phantom", but I haven't been able to find documentation for it.
> >> Can you point me in the right direction? Does it, perchance, allow
> >> specifying the PCI slot ID of a phantom device so that IOMMU doesn't
> >> freak out when a seemingly non-existant device starts trying to do
> >> DMA?
> > 
> > I forgot about it!
> > 
> > t 4e3c592c93d7dbe02ca36878457515d30fe931d2
> > Author: Jan Beulich <jbeulich@xxxxxxxx>
> > Date:   Mon Jan 7 12:58:09 2013 +0100
> > 
> >     IOMMU: add option to specify devices behaving like ones using phantom 
> > functions
> 
> Note the term "functions" here: This is about a feature of the PCI
> spec that some devices apparently use without declaring they do.
> This has nothing to do with entire devices being invisible, in order
> for there to be phantom functions there always has to be an
> ordinary device at function 0.
> 
> Jan

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
http://lists.xen.org/xen-devel


 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.