[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-devel] Regression with Xen 4.4 when booting with AMD IOMMU on TA890FXE BIOSTAR



Thursday, December 19, 2013, 7:25:20 PM, you wrote:

> Hey,

> With Xen 4.1, 4.2 and 4.3 it boots fine (albeit it complains about the
> IOMMU a bit -see attached). With Xen 4.4 it blows up:
> (the xen-syms is at http://darnok.org/xen/xen-syms.gz)

> This is with commit a0070f7a5ad8652c74c685a0ee5f10215402279d
> "x86/memshr: fix preemption in relinquish_shared_pages()" though
> I hadn't run Xen 4.4 on this box before so the issue might have
> happend much earlier.
>     

> Also something is off with SRAT.

> PXELINUX 3.82 2009-06-09  Copyright (C) 1994-2009 H. Peter Anvin et al
> boot: 
> Loading xen.gz... ok
> Loading vmlinuz... ok
> Loading initramfs.cpio.gz... ok
>  Xen 4.4-unstable
> (XEN) Xen version 4.4-unstable (konrad@(none)) (gcc (GCC) 4.4.4 20100503 (Red 
> Hat 4.4.4-2)) debug=y Thu Dec 1a0070f7-dirty
> (XEN) Console output is synchronous.
> (XEN) Bootloader: unknown
> (XEN) Command line: sync_console iommu=verbose console=vga,com1 
> com1=115200,8n1,0xD800,0 conring_size=2097152 loglvl=all guest_loglvl=all 
> dom0_mem_max=max:6GB,2G
> (XEN) Video information:
> (XEN)  VGA is text mode 80x25, font 8x16
> (XEN)  VBE/DDC methods: V2; EDID transfer time: 1 seconds
> (XEN) Disc information:
> (XEN)  Found 1 MBR signatures
> (XEN)  Found 1 EDD information structures
> (XEN) Xen-e820 RAM map:
> (XEN)  0000000000000000 - 000000000009b400 (usable)
> (XEN)  000000000009b400 - 00000000000a0000 (reserved)
> (XEN)  00000000000e2000 - 0000000000100000 (reserved)
> (XEN)  0000000000100000 - 00000000cffb0000 (usable)
> (XEN)  00000000cffb0000 - 00000000cffbe000 (ACPI data)
> (XEN)  00000000cffbe000 - 00000000cffe0000 (ACPI NVS)
> (XEN)  00000000cffe0000 - 00000000d0000000 (reserved)
> (XEN)  00000000fff00000 - 0000000100000000 (reserved)
> (XEN)  0000000100000000 - 0000000230000000 (usable)
> (XEN) ACPI: RSDP 000FB380, 0024 (r2 ACPIAM)
> (XEN) ACPI: XSDT CFFB0100, 0064 (r1 071610 XSDT1756 20100716 MSFT       97)
> (XEN) ACPI: FACP CFFB0290, 00F4 (r4 071610 FACP1756 20100716 MSFT       97)
> (XEN) ACPI: DSDT CFFB0450, 4D0D (r2  89FAD 89FAD716        1 INTL 20051117)
> (XEN) ACPI: FACS CFFBE000, 0040
> (XEN) ACPI: APIC CFFB0390, 007C (r2 071610 APIC1756 20100716 MSFT       97)
> (XEN) ACPI: MCFG CFFB0410, 003C (r1 071610 OEMMCFG  20100716 MSFT       97)
> (XEN) ACPI: OEMB CFFBE040, 0072 (r1 071610 OEMB1756 20100716 MSFT       97)
> (XEN) ACPI: SRAT CFFBA450, 0108 (r3 AMD    FAM_F_10        2 AMD         1)
> (XEN) ACPI: HPET CFFBA560, 0038 (r1 071610 OEMHPET  20100716 MSFT       97)
> (XEN) ACPI: IVRS CFFBA5A0, 00B8 (r1  AMD     RD890S   202031 AMD         0)
> (XEN) ACPI: SSDT CFFBA660, 0DA4 (r1 A M I  POWERNOW        1 AMD         1)
> (XEN) System RAM: 8191MB (8387884kB)
(XEN) SRAT: PXM 0 ->> APIC 0 -> Node 0
(XEN) SRAT: PXM 0 ->> APIC 1 -> Node 0
(XEN) SRAT: PXM 0 ->> APIC 2 -> Node 0
> (XEN) SRAT:000000
> (XEN) NUMA: Allocated memnodemap from 229329000 - 22932c000
> (XEN) NUMA: Using 8 for the hash shift.
> (XEN) Domain heap initialised
> (XEN) found SMP MP-table at 000ff780
> (XEN) DMI present.
> (XEN) Using APIC driver default
> (XEN) ACPI: PM-Timer IO Port: 0x808
> SLEEP INFO: pm1x_cnt[804,0], pm1x_evt[800,0]
> (XEN) ACPI:             wakeup_vec[cffbe00c], vec_size[20]
> (XEN) ACPI: Local APIC address 0xfee00000
> (XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
> (XEN) Processor #0 0:10 APIC version 16
> (XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
> (XEN) Processor #1 0:10 APIC version 16
> (XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x02] enabled)
> (XEN) Processor #2 0:10 APIC version 16
> (XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x03] enabled)
> (XEN) Processor #3 0:10 APIC version 16
> (XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x04] enabled)
> (XEN) Processor #4 0:10 APIC version 16
> (XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x05] enabled)
> (XEN) Processor #5 0:10 APIC version 16
> (XEN) ACPI: IOAPIC (id[0x06] address[0xfec00000] gsi_base[0])
> (XEN) IOAPIC[0]: apic_id 6, version 33, address 0xfec00000, GSI 0-23
> (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
> (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level)
> (XEN) ACPI: IRQ0 used by override.
> (XEN) ACPI: IRQ2 used by override.
> (XEN) ACPI: IRQ9 used by override.
> (XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
> (XEN) ACPI: HPET id: 0x8300 base: 0xfed00000
> (XEN) ERST table was not found
> (XEN) Using ACPI (MADT) for SMP configuration information
> (XEN) SMP: Allowing 6 CPUs (0 hotplug CPUs)
> (XEN) IRQ limits: 24 GSI, 1144 MSI/MSI-X
> (XEN) Using scheduler: SMP Credit Scheduler (credit)
> (XEN) Detected 3000.222 MHz processor.
> (XEN) Initing memory sharing.
> (XEN) AMD Fam10h machine check reporting enabled
> (XEN) P: base e0000000 segment 0000 buses 00 - ff
> (XEN) PCI: Not using MCFG for segment 0000 bus 00-ff
> (XEN) AMD-Vi: IOMMU 0 Enabled.
> (XEN) I/O virtualisation enabled
> (XEN)  - Dom0 mode: Relaxed
> (XEN) Interrupt remapping enabled
> (XEN) ENABLING IO-APIC IRQs
> (1
> (XEN) ..MP-BIOS bug: 8254 timer not connected to IO-APIC
> (XEN) ...trying to set up timer (IRQ0) through the 8259A ...  failed. works.
> (XEN) Platform timer is 14.318MHz HPET
> (XEN) Allocated console ring of 1048576 KiB.
> (XEN) HVM: ASIDs enabled.
> (XEN) SVM: Supported advanced features:
> (XEN)  - Nestesizes: 4kB, 2MB, 1GB
> (XEN) HVM: PVH mode not supported on this platform
> (XEN) microcode: CPU1 collect_cpu_info: patch_id=0x10000bf
> (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 0, device id = 0xa0, fault add140, 
> flags = 0x8
> (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 0, device id = 0xa0, fault address = 
> 0xfdf8010140, flags = 0x8
> (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 0, device id = 0xa0, fault address = 
> 0xfdf8010140, flags = 0x8
> (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 0, device id = 0xa0, fault address = 
> 0xfdf8010140, flags = 0x8
> (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 0, device id = 0xa0, fault address = 
> 0xfdf8010140, flags = 0x8
> (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 0, device id = 0xa0, fault address = 
> 0xfdf8010140, flags = 0x8
> (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 0, device id = 0xa0, fault address = 
> 0xfdf8010140, flags = 0x8
> (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 0, device id = 0xa0, fault address = 
> 0xfdf8010140, flags = 0x8
> (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 0, device id = 0xa0, fault address = 
> 0xfdf8010140, flags = 0x8
> (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 0, device id = 0xa0, fault address = 
> 0xfdf8010140, flags = 0x8
> (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 0, device id = 0xa0, fault address = 
> 0xfdf8010140, flags = 0x8
> (XEN) microcode: CPU2 collect_cpu_info: patch_id=0x10000bf
> (XEN) microcode: CPU3 collect_cpu_info: patch_id=0x10000bf
> (XEN) microcode: CPU4 collect_cpu_info: patch_id=0x10000bf
> (XEN) Brought up 6 CPUs
> (XEN) microcode: CPU5 collect_cpu_info: patch_id=0x10000bf
> (XEN) Assertion 'get_rte_index(rte) == offset' failed at iommu_intr.c:188
> (XEN) ----[ Xen-4.4-unstable  x86_64  debug=y  Tainted:    C ]----
> (XEN) CPU:    0
> (XEN) RIP:    e008:[<ffff82d080153581>] 
> amd_iommu_ioapic_update_ire+0x44e/0x600
> (XEN) RFLAGS: 0000000000010002   CONTEXT: hypervisor
> (XEN) rax: ffff8302292f2004   rbx: 0000000000000015   rcx: 0000000000000000
> (XEN) rdx: 0000000000000000   rsi: 0000000000000000   rdi: ffff82d0802f7e88
> (XEN) rbp: ffff82d0802cfd88   rsp: ffff82d0802cfca8   r8:  ffff8302292ccf34
> (XEN) r9:  0000000000000000   r10: 000000000000000f   r11: ffff82d080232320
> (XEN) r12: 0000000000000000   r13: 0000000000000014   r14: 0000000000000001
> (XEN) r15: ffff8302292cc380   cr0: 000000008005003b   cr4: 00000000000006f0
> (XEN) cr3: 00000000cfc80000   cr2: 0000000000000000
> (XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: 0000   cs: e008
> (XEN) Xen stack trace from rsp=ffff82d0802cfca8:
> (XEN)    ffff82d0802cfcd8 01ff82d0802cfcc0 0000000000000046 0000001400000000
> (XEN)    ffff82d080250700 ffff82d0802cfdb0 ffff82d08024c200 0000000000000200
> (XEN)    0000000000000001 ffff8302292e0070 0100000000000000 0000000100000002
> (XEN)    ffff82d0802cfd48 0000000129320600 ffff830200000001 0000001529280000
> (XEN)    0000000000000000 0000000000205000 0100000000010000 ffff82d08016bad1
> (XEN)    0000000000010000 0000000000000000 0000000000000000 ffff830229277940
> (XEN)    ffff82d08026fca4 0000000000000002 ffff82cffffff010 0000000000000000
> (XEN)    ffff82d0802cfd98 ffff82d080144c21 ffff82d0802cfdf8 ffff82d080166908
> (XEN)    ffff82d0802cfdb8 0000000000000292 ffff830229280000 0100000000000006
> (XEN)    ffff83000006efb0 0000000000000002 ffff830229280000 0000000000000000
> (XEN)    ffff82d08026cca0 0000000000000000 ffff82d0802cfe38 ffff82d080166ac6
> (XEN)    ffff82d0802cfe18 0000000000000006 ffff83000006efb0 ffff83022931a7f0
> (XEN)    ffff83000006eef0 ffff83022931a7f0 ffff82d0802cfe48 ffff82d0802a6827
> (XEN)    ffff82d0802cff08 ffff82d0802a5fcf 0000000000000000 ffff82d08024bebe
> (XEN)    0000000001281000 0000000000211d00 0000000000000000 ffff8300ffffffff
> (XEN)    ffff82d000000005 ffff83000006eef0 ffff83000006efb0 0000000000000005
> (XEN)    ffff82d000000002 ffff830000000006 0000000800000000 000000010000006e
> (XEN)    0000000000000003 00000000000002f8 0000000000000000 0000000000000000
> (XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)    0000000000000000 ffff82d0801000b5 0000000000000000 0000000000000000
> (XEN) Xen call trace:
> (XEN)    [<ffff82d080153581>] amd_iommu_ioapic_update_ire+0x44e/0x600
> (XEN)    [<ffff82d080144c21>] iommu_update_ire_from_apic+0x29/0x2b
> (XEN)    [<ffff82d080166908>] set_ioapic_affinity_irq+0xa5/0x1d6
> (XEN)    [<ffff82d080166ac6>] setup_ioapic_dest+0x8d/0xc0
> (XEN)    [<ffff82d0802a6827>] smp_cpus_done+0x51/0x61
> (XEN)    [<ffff82d0802a5fcf>] __start_xen+0x2706/0x2a41
> (XEN)    [<ffff82d0801000b5>] __high_start+0xa1/0xa3
> (XEN) 
> (XEN) 
> (XEN) ****************************************
> (XEN) Panic on CPU 0:
> (XEN) Assertion 'get_rte_index(rte) == offset' failed at iommu_intr.c:188
> (XEN) ****************************************
> (XEN) 
> (XEN) Reboot in five seconds...

Hmm do you have the latest bios ?

I have another board but the same chipset (890fx), i think it's at least 
missing one IOAPIC for
some reason ... i have got:

(XEN) ACPI: IOAPIC (id[0x06] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 6, version 33, address 0xfec00000, GSI 0-23
(XEN) ACPI: IOAPIC (id[0x07] address[0xfec20000] gsi_base[24])
(XEN) IOAPIC[1]: apic_id 7, version 33, address 0xfec20000, GSI 24-55
(XEN) Enabling APIC mode:  Flat.  Using 2 I/O APICs

you:
> (XEN) ACPI: IOAPIC (id[0x06] address[0xfec00000] gsi_base[0])
> (XEN) IOAPIC[0]: apic_id 6, version 33, address 0xfec00000, GSI 0-23
> (XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
> (XEN) ENABLING IO-APIC IRQs
> (1
> (XEN) ..MP-BIOS bug: 8254 timer not connected to IO-APIC
> (XEN) ...trying to set up timer (IRQ0) through the 8259A ...  failed. works.

perhaps a log from a boot with:  "lapic=debug apic_verbosity=debug apic=debug 
iommu=on,verbose,debug,amd-iommu-debug" would
give some more data for Suravee/Jan.

--
Sander


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
http://lists.xen.org/xen-devel


 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.