Xen project Mailing List

On Sun, Aug 16, 2015 at 12:19 AM, Zir Blazer <zir_blazer@xxxxxxxxxxx> wrote:

Also, adding to the last mail. On page 43 it also says...

Intel VT-d superpage: support of Intel VT-d superpage (2 MB, 1 GB) for the default Intel VT-d engine (that covers all devices except IGD)
IGD Intel VT-d engine does not support superpage and BIOS should disable superpage in default Intel VT-d engine when iGFX is enabled

Basically, it seems that your Motherboard behavior is the correct one. On my Supermicro X10SAT I have IOMMU 0 with 4 KB and IOMMU 1 with 4 KB, 2 MB, 1 GB.

I was also expecting that VT-d supporting Chipsets like C226 had also an extra DMA Remapping Engine. Otherwise I don't know what's the point on Chipset VT-d support at all since it seems that you can rely just on the Processor.

Date: Sat, 15 Aug 2015 22:17:26 -0400
From: bhimberg@xxxxxxxxx
To: xen-users@xxxxxxxxxxxxx
Subject: Re: [Xen-users] VT-d superpages (2MB, 1GB) and the intel iGPU

Make that page 43:
http://www.intel.com/content/dam/www/public/us/en/documents/datasheets/xeon-e3-1200v3-vol-1-datasheet.pdf

On Sat, Aug 15, 2015 at 10:12 PM, Ben Himberg <bhimberg@xxxxxxxxx> wrote:
So I have a Tyan c226 with a 1246v3 Xeon. I noticed many users have something like this in their xl dmesg:

(XEN) Intel VT-d iommu 0 supported page sizes: 4kB.
(XEN) Intel VT-d iommu 1 supported page sizes: 4kB, 2MB, 1GB.

Now as I understand it VT-d for this processor/chipset has two iommu engines: 1 for the GPU, 1 for the rest of the system. When the iGPU is enabled the specification states that the default engine may 'should' disable large page support and look like this:

(XEN) Intel VT-d iommu 0 supported page sizes: 4kB.
(XEN) Intel VT-d iommu 1 supported page sizes: 4kB.

Which is exactly what I get with my board. Furthermore, shared EPT, snoop control are also disabled when the iGPU is enabled (basically the bios/xen default to the common standards between the two iommu engines).

Kudos to Tyan for implementing their bios properly. The question though: why do many of you seem to have both engines enabled AND have large pages enabled on the default (listed second) engine? When I disable my iGPU I get the following:

(XEN) Intel VT-d iommu 0 supported page sizes: 4kB, 2MB, 1GB.
(XEN) Intel VT-d Snoop Control enabled.
(XEN) Intel VT-d Dom0 DMA Passthrough not enabled.
(XEN) Intel VT-d Queued Invalidation enabled.
(XEN) Intel VT-d Interrupt Remapping enabled.
(XEN) Intel VT-d Shared EPT tables enabled.

And when I enable it:
(XEN) Intel VT-d iommu 0 supported page sizes: 4kB.
(XEN) Intel VT-d iommu 1 supported page sizes: 4kB.
(XEN) Intel VT-d Snoop Control not enabled.
(XEN) Intel VT-d Dom0 DMA Passthrough not enabled.
(XEN) Intel VT-d Queued Invalidation enabled.
(XEN) Intel VT-d Interrupt Remapping enabled.
(XEN) Intel VT-d Shared EPT tables not enabled.

My understanding is that large pages are important for PCIE transfers, and I'm building this box to basically run an OpenCL headless server for my simulations. Is there any way I can enable large page sizes on the default (second) iommu engine AND keep the iGPU enabled?

For reference, check page 46 of the following for intels thoughts:
http://www.intel.com/content/dam/www/public/us/en/documents/datasheets/xeon-e3-1200v3-vol-1-datasheet.pdf

_______________________________________________ Xen-users mailing list Xen-users@xxxxxxxxxxxxx http://lists.xen.org/xen-users