[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-API] XCP 1.5: Missing IOMMU- support


  • To: "xen-api@xxxxxxxxxxxxx" <xen-api@xxxxxxxxxxxxx>
  • From: Jóhann Ármann Fannberg <johannf@xxxxxxxxxx>
  • Date: Thu, 06 Sep 2012 09:32:01 +0000
  • Authentication-results: smtp-out-01.simnetpro.is; dkim=neutral (message not signed) header.i=none
  • Delivery-date: Thu, 06 Sep 2012 09:33:17 +0000
  • List-id: User and development list for XCP and XAPI <xen-api.lists.xen.org>

Hello James,

the dmesg-logs apparently look identical before and after the upgrade.

SmartVirtualization is the only reference to virtualization I have found in the bios menus (have not found any mention of vt-d). This item was probably not in the original bios, but came in somewhere in the upgrade history. It was already existing in the f13- version before my last upgrade. I've not found any hidden menus with relevant options.

Your suggestion seems likely, as the "table is not found" is the only negative message before "I/O virtualisation disabled" message. Does this indicate that this table is entirely missing from the bios, or is it somehow difficult to find for the kernel?

Below is the more detailed dmesg- log.


James, thanks for the effort,

Johann.

-------------------------------------------------------------------------------------------------------------------
[root@xenserver-jafi7 ~]# xe host-dmesg
(XEN) Bad console= option ''
 __  __            _  _    _   _
 \ \/ /___ _ __   | || |  / | / |
  \  // _ \ '_ \  | || |_ | | | |
  /  \  __/ | | | |__   _|| |_| |
 /_/\_\___|_| |_|    |_|(_)_(_)_|

(XEN) Xen version 4.1.1 (root@xxxxxxxxxxxxxxxx) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-46)) Mon Feb 6 19:01:42 EST 2012
(XEN) Latest ChangeSet: unavailable
(XEN) Bootloader: SYSLINUX 4.02 2010-07-21
(XEN) Command line: iommu=verbose loglvl=all mem=1024M dom0_max_vcpus=4 dom0_mem=752M lowmem_emergency_pool=1M crashkernel=64M@32M console= vga=mode-0x0311
(XEN) Video information:
(XEN)  VGA is graphics mode 640x480, 16 bpp
(XEN)  VBE/DDC methods: V2; EDID transfer time: 1 seconds
(XEN) Disc information:
(XEN)  Found 8 MBR signatures
(XEN)  Found 6 EDD information structures
(XEN) Truncating RAM from 25952256kB to 1048576kB
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 000000000009e000 (usable)
(XEN)  000000000009f800 - 00000000000a0000 (reserved)
(XEN)  00000000000f0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 0000000040000000 (usable)
(XEN)  0000000040000000 - 00000000cfde0000 (unusable)
(XEN)  00000000cfde0000 - 00000000cfee0000 (reserved)
(XEN)  00000000cfee0000 - 00000000cfee1000 (ACPI NVS)
(XEN)  00000000cfee1000 - 00000000cfef0000 (ACPI data)
(XEN)  00000000cfef0000 - 00000000cff00000 (reserved)
(XEN)  00000000f4000000 - 00000000f8000000 (reserved)
(XEN)  00000000fec00000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000000630000000 (unusable)
(XEN) Kdump: 64MB (65536kB) at 0x2000000
(XEN) System RAM: 1023MB (1048184kB)
(XEN) ACPI: RSDP 000F7380, 0014 (r0 GBT   )
(XEN) ACPI: RSDT CFEE1040, 0040 (r1 GBT    GBTUACPI 42302E31 GBTU 1010101)
(XEN) ACPI: FACP CFEE10C0, 0074 (r1 GBT    GBTUACPI 42302E31 GBTU 1010101)
(XEN) ACPI: DSDT CFEE1180, 4A86 (r1 GBT    GBTUACPI     1000 MSFT 100000C)
(XEN) ACPI: FACS CFEE0000, 0040
(XEN) ACPI: HPET CFEE5E00, 0038 (r1 GBT    GBTUACPI 42302E31 GBTU       98)
(XEN) ACPI: MCFG CFEE5E80, 003C (r1 GBT    GBTUACPI 42302E31 GBTU 1010101)
(XEN) ACPI: EUDS CFEE5EC0, 0470 (r1 GBT 0             0)
(XEN) ACPI: TAMG CFEE6330, 0B3A (r1 GBT    GBT   B0 5455312E BG 53450101)
(XEN) ACPI: APIC CFEE5C80, 012C (r1 GBT    GBTUACPI 42302E31 GBTU 1010101)
(XEN) ACPI: SSDT CFEE6E80, 2804 (r1  INTEL PPM RCM  80000001 INTL 20061109)
(XEN) No NUMA configuration found
(XEN) Faking a node at 0000000000000000-0000000040000000
(XEN) Domain heap initialised DMA width 32 bits
(XEN) found SMP MP-table at 000f5c80
(XEN) DMI 2.4 present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x408
(XEN) ACPI: ACPI SLEEP INFO: pm1x_cnt[404,0], pm1x_evt[400,0]
(XEN) ACPI:                  wakeup_vec[cfee000c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
(XEN) Processor #0 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
(XEN) Processor #2 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
(XEN) Processor #4 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
(XEN) Processor #6 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x01] enabled)
(XEN) Processor #1 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x03] enabled)
(XEN) Processor #3 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x05] enabled)
(XEN) Processor #5 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
(XEN) Processor #7 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x08] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x09] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x0a] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x0b] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x0c] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x0d] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x0e] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x0f] disabled)
(XEN) ACPI: LAPIC_NMI (acpi_id[0x00] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x02] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x03] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x04] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x05] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x06] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x07] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x08] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x09] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0a] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0b] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0c] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0d] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0e] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0f] dfl dfl lint[0x1])
(XEN) ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
(XEN) ACPI: HPET id: 0x8086a201 base: 0xfed00000
(XEN) PCI: MCFG configuration 0: base f4000000 segment 0 buses 0 - 63
(XEN) PCI: MCFG area at f4000000 reserved in E820
(XEN) Table is not found!
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) IRQ limits: 24 GSI, 1528 MSI/MSI-X
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2664.830 MHz processor.
(XEN) Initing memory sharing.
(XEN) mce_intel.c:1162: MCA Capability: BCAST 1 SER 0 CMCI 1 firstbank 0 extended MCE MSR 0
(XEN) Intel machine check reporting enabled
(XEN) I/O virtualisation disabled
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) Platform timer is 14.318MHz HPET
(XEN) Allocated console ring of 64 KiB.
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Extended Page Tables (EPT)
(XEN)  - Virtual-Processor Identifiers (VPID)
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN) EPT supports 2MB super page.
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging detected and enabled.
(XEN) Brought up 8 CPUs
(XEN) Testing NMI watchdog --- CPU#0 okay. CPU#1 okay. CPU#2 okay. CPU#3 okay. CPU#4 okay. CPU#5 okay. CPU#6 okay. CPU#7 okay.
(XEN) HPET: 4 timers in total, 0 timers will be used for broadcast
(XEN) ACPI sleep modes: S3
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) *** LOADING DOMAIN 0 ***
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 32-bit, PAE, lsb, paddr 0x100000 -> 0x5f5000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN) Dom0 alloc.: 000000003d000000->000000003e000000 (186617 pages to be allocated)
(XEN)  Init. ramdisk: 000000003f4f9000->000000003fbff800
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: 00000000c0100000->00000000c05f5000
(XEN)  Init. ramdisk: 00000000c05f5000->00000000c0cfb800
(XEN)  Phys-Mach map: 00000000c0cfc000->00000000c0db8000
(XEN)  Start info:    00000000c0db8000->00000000c0db84b4
(XEN)  Page tables:   00000000c0db9000->00000000c0dc7000
(XEN)  Boot stack:    00000000c0dc7000->00000000c0dc8000
(XEN)  TOTAL:         00000000c0000000->00000000c1000000
(XEN)  ENTRY ADDRESS: 00000000c0100000
(XEN) Dom0 has maximum 4 VCPUs
(XEN) Scrubbing Free RAM: ..done.
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 216kB init memory.
(XEN) __csched_vcpu_acct_start: setting dom 0 as the privileged domain
(XEN) PCI add device 00:00.0
(XEN) PCI add device 00:01.0
(XEN) PCI add device 00:03.0
(XEN) PCI add device 00:07.0
(XEN) PCI add device 00:10.0
(XEN) PCI add device 00:10.1
(XEN) PCI add device 00:11.0
(XEN) PCI add device 00:11.1
(XEN) PCI add device 00:13.0
(XEN) PCI add device 00:14.0
(XEN) PCI add device 00:14.1
(XEN) PCI add device 00:14.2
(XEN) PCI add device 00:15.0
(XEN) PCI add device 00:1a.0
(XEN) PCI add device 00:1a.1
(XEN) PCI add device 00:1a.2
(XEN) PCI add device 00:1a.7
(XEN) PCI add device 00:1b.0
(XEN) PCI add device 00:1c.0
(XEN) PCI add device 00:1c.1
(XEN) PCI add device 00:1c.4
(XEN) PCI add device 00:1c.5
(XEN) PCI add device 00:1d.0
(XEN) PCI add device 00:1d.1
(XEN) PCI add device 00:1d.2
(XEN) PCI add device 00:1d.7
(XEN) PCI add device 00:1e.0
(XEN) PCI add device 00:1f.0
(XEN) PCI add device 00:1f.2
(XEN) PCI add device 00:1f.3
(XEN) PCI add device 00:1f.5
(XEN) PCI add device 01:00.0
(XEN) PCI add device 01:00.1
(XEN) PCI add device 02:00.0
(XEN) PCI add device 02:00.1
(XEN) PCI add device 03:00.0
(XEN) PCI add device 03:00.1
(XEN) PCI add device 05:00.0
(XEN) PCI add device 05:00.1
(XEN) PCI add device 06:00.0
(XEN) PCI add device 07:00.0
(XEN) PCI add device 08:06.0
(XEN) allocated vector a0 for irq 16
(XEN) allocated vector a8 for irq 17
(XEN) PCI add device 00:1f.2
(XEN) PCI add device 00:1f.5
(XEN) PCI add device 01:00.1
(XEN) PCI add device 05:00.1
(XEN) PCI add device 00:1a.7
(XEN) allocated vector b0 for irq 18
(XEN) PCI add device 00:1d.7
(XEN) allocated vector b8 for irq 23
(XEN) PCI add device 00:1a.0
(XEN) PCI add device 00:1a.1
(XEN) allocated vector c0 for irq 21
(XEN) PCI add device 00:1a.2
(XEN) PCI add device 00:1d.0
(XEN) PCI add device 00:1d.1
(XEN) allocated vector c8 for irq 19
(XEN) PCI add device 00:1d.2
(XEN) PCI add device 01:00.0
(XEN) PCI add device 05:00.0
(XEN) PCI add device 00:1f.2
(XEN) PCI add device 00:1f.5
(XEN) PCI add device 01:00.1
(XEN) PCI add device 05:00.1
(XEN) PCI add device 00:1f.3
(XEN) PCI add device 00:1f.2
(XEN) PCI add device 00:1f.5
(XEN) PCI add device 01:00.1
(XEN) PCI add device 05:00.1
(XEN) no cpu_id for acpi_id 8
(XEN) no cpu_id for acpi_id 9
(XEN) no cpu_id for acpi_id 10
(XEN) no cpu_id for acpi_id 11
(XEN) no cpu_id for acpi_id 12
(XEN) no cpu_id for acpi_id 13
(XEN) no cpu_id for acpi_id 14
(XEN) no cpu_id for acpi_id 15
(XEN) PCI add device 08:06.0
(XEN) PCI add device 06:00.0
(XEN) PCI add device 07:00.0
(XEN) PCI add device 05:00.1

-------------------------------------------------------------------------------------------------------------------


Þann 5.9.2012 16:54, skrifaði James Bulpin:
Hi Johann,

With Xen 4.x iommu support is enabled by default so no additional boot args are 
needed.

It looks like Xen didn't find the ACPI DMAR (IOMMU) table - that would usually indicate a 
lack of support in the BIOS for VT-d. Was that trace from a boot before you upgraded to 
the latest BIOS? If so please can you post a Xen boot trace with the latest BIOS. To get 
maximum info please add "iommu=verbose loglvl=all" to the Xen part of the boot 
command line in /boot/extlinux.conf, e.g.:

label xe
   # XenServer
   kernel mboot.c32
   append /boot/xen.gz iommu=verbose loglvl=all mem=1024G dom0_max_vcpus=4 
dom0_mem=752M lowmem_emergency_pool=1M crashkernel=64M@32M console= 
vga=mode-0x0311 --- /boot/vmlinuz-2.6-xen root=LABEL=root-lpnwoiab ro 
xencons=hvc console=hvc0 console=tty0 quiet vga=785 splash --- 
/boot/initrd-2.6-xen.img

What is "SmartVirtualization" - is that Gigabyte/Award speak for VT-d/IOMMU? In 
my experience most BIOS setup programs have an explicit VT-d option (usually disabled by 
default).

Regards,
James

-----Original Message-----
From: xen-api-bounces@xxxxxxxxxxxxx [mailto:xen-api-
bounces@xxxxxxxxxxxxx] On Behalf Of Jóhann Ármann Fannberg
Sent: 05 September 2012 13:01
To: xen-api@xxxxxxxxxxxxx
Subject: Re: [Xen-API] XCP 1.5: Missing IOMMU- support

Furhter info:

Found Bios version f13s at Gigabyte- site that supposedly should
support
VT-d (in ESXi?), but it has not helped.

Is there need to specify IOMMU support in Ggrub.conf for XCP 1.5 (Xen
4.1.1)? If so, how do I go about it? Can't find /boot/grub/grup.conf.


Kind regards,

Johann.

Þann 4.9.2012 17:24, skrifaði Jóhann Ármann Fannberg:
My Hardware/Firmware

Gigabyte GA EX58 UD5 Bios version f13 (AwardBIOS) (newest)

CPU: I7

SmartVirtualization is enabled in Bios.


Xen-dmesg output:

[root@xenserver-jafi7 ~]# xe host-dmesg
(XEN) Bad console= option ''
...
(XEN) Freed 216kB init memory.
(XEN) __csched_vcpu_acct_start: setting dom 0 as the privileged
domain

Seems to me that both CPU and Chipset are listed as supporting VT-d,
but motherboard (bios) is not listed as such.

Anyhting that can be done? Can I gather further info?

Regards,

Johann.




_______________________________________________
Xen-api mailing list
Xen-api@xxxxxxxxxxxxx
http://lists.xen.org/cgi-bin/mailman/listinfo/xen-api

-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 2012.0.2197 / Virus Database: 2437/5250 - Release Date: 09/05/12



_______________________________________________
Xen-api mailing list
Xen-api@xxxxxxxxxxxxx
http://lists.xen.org/cgi-bin/mailman/listinfo/xen-api


 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.