[Xen-devel] Xen 4.6 Development Update (2 WEEKS TO FREEZE, important information in preamble)

[<wei.liu2@xxxxxxxxxx>]

(Note, please trim your quotes when replying, and also trim the CC list if
necessary. You might also consider changing the subject line of your reply to
"Status of FOO (Was: Xen 4.6 Development Update (X months reminder)")

Hi all

We are now more than 5 months into 4.6 development window. This is an email to
keep track of all the patch series I gathered. It is by no means complete and /
or acurate. Feel free to reply this email with new projects or correct my
misunderstanding.

= Timeline =

We are planning on a 9-month release cycle, but we could also release a bit
earlier if everything goes well (no blocker, no critical bug).

* Development start: 6 Jan 2015
<=== We are here ===>
* Feature Freeze: 10 Jul 2015
* RCs: TBD
* Release Date: 9 Oct 2015 (could release earlier)

= Reporting blockers =

Note that there is now a blocker section. If you think any bugs / regressions
should become blocker, please reply to this email (but do trim the CC list).

= Requesting for freeze exception =

If you patch series doesn't make it before the freeze, but you think it would
be good for Xen if it's in, you can request for freeze exception.

To request freeze exception, send an email to xen-devel, probably with subject
line "Requesting for freeze exception for FOO".

That email should:
1. clarify the state of patch series / feature.
2. explain why it needs to be in this release (benefits).
3. explain why it doesn't break things (risks).
4. CC relevant maintainers and release manager.

The general rules of thumb of granting freeze exception:
1. the patch series is in shape, only pending a few minor tweaks.
2. the patch series is endorsed by maintainer(s).

There are other criteria that we need to agree on. Those need to be discussed
case by case.

= Missing the freeze =

Some features are going to miss the freeze. You can continue to work on your
patch series and post to xen-devel and hopefully it will be ready to apply once
new development window opens. But as most core maintainers will be focusing on
bug fixes during freeze, turnaround time might be longer.

= Bug Fixes =

Bug fixes can be checked in without a freeze exception throughout the
freeze, unless the maintainer thinks they are particularly high
risk.  In later RC's, we may even begin rejecting bug fixes if the
broken functionality is small and the risk to other functionality is
high.

Document changes can go in anytime if the maintainer is OK with it.

The RCs and release will of course depend on stability and bugs, and
will therefore be fairly unpredictable.

= Prognosis =

The states are: none -> fair -> ok -> good -> done

none - nothing yet
fair - still working on it, patches are prototypes or RFC
ok   - patches posted, acting on review
good - some last minute pieces
done - all done, might have bugs


== Blocker ==

== Hypervisor ==

*  Alternate p2m: support multiple copies of host p2m (ok)
  -  Ed White

*  Improve RTDS scheduler (ok)
   Change RTDS from quantum driven to event driven
  -  Dagaen Golomb, Meng Xu, Chong Li

*  Credit2: introduce per-vcpu soft affinity (good)
  -  Justin T. Weaver

*  Credit2: introduce per-vcpu hard affinity (fair)
  -  Justin T. Weaver

*  sndif: add API for para-virtual sound (fair)
   v7 posted
  -  Oleksandr Dmytryshyn

*  gnttab: improve scalability (good)
  -  David Vrabel

*  Use ticket lock in hypervisor (good)
  -  David Vrabel

*  Xen multiboot2-EFI support (ok)
   See http://lists.xen.org/archives/html/xen-devel/2015-01/msg03962.html
    http://lists.xen.org/archives/html/xen-devel/2015-01/msg03982.html
  -  Daniel Kiper

*  Credit2 production ready (none)
   cpu reservation
  -  George Dunlap

*  VM event patches (none)
   Add support for XSETBV vm_events,
   Support hybernating guests
   Support for VMCALL-based vm_events
  -  Razvan Cojocaru

=== Hypervisor X86 ===

*  x86/MSI-X: XSA-120, 128..131 follow-up (ok)
  -  Jan Beulich

*  Intel Cache Allocation Technology (good)
  -  Chao Peng

*  Intel GVT-g (none)
   requires refactoring ioreq-server, fixing 16-byte MMIO emulation
   and optional PV IOMMU support
  -  Yu, Zhang

*  Porting Intel P-state driver to Xen (fair)
  -  Wang, Wei

*  VT-d Posted-interrupt (PI) (good)
   v2 posted
  -  Wu, Feng

*  Support controlling the max C-state sub-state (fair)
   v3 posted
  -  Ross Lagerwall

*  IOMMU ABI for guests to map their DMA regions (fair)
  -  Malcolm Crossley

*  RMRR fix (fair)
   RFC posted
  -  Tiejun Chen

*  VPMU - 'perf' support in Xen (good)
   v21 posted
   Need reviews/final ack.
  -  Boris Ostrovsky

*  PVH domU (fair)
   RFC posted
  -  Elena Ufimtseva

=== Hypervisor ARM ===

*  ITS support (fair )
  -  Vijaya Kumar K

*  Add ACPI support for arm64 on Xen (fair)
   RFC posted
  -  Parth Dixit

*  ARM remote processor iommu module (GPUs + IPUs) (fair)
   v3 posted
  -  Andrii Tseglytskyi

*  ARM VM save/restore/live migration (none)
   Need to rebased against migrationv2 - no code posted.
  -  None

*  ARM GICv2m support (none)
  -  Suravee Suthikulanit

*  ARM PCI passthrough (fair)
  -  Manish Jaggi

*  ARM GICv2 on GICv3 support (none)
  -  Julien Grall
  -  Vijay Kilari

== Xen toolstack ==

*  Split libxc into multiple libraries (fair)
  -  Ian Campbell

*  Migration v2 (libxl) (fair)
  -  Andrew Cooper

*  toolstack-based approach to pvhvm guest kexec (fair)
   also contains hypervisor side change, v6
  -  Vitaly Kuznetsov

*  libxl: cancelling asynchronous operations (fair)
   RFC posted
  -  Ian Jackson

*  VMware tools support (ok)
  -  Don Slutz

*  Blktap2 support (fair)
  -  George Dunlap

*  pvscsi in libxl (fair)
  -  Juergen Gross and Olaf

*  COarse-grain LOck-stepping Virtual Machines in Xen (ok)
   RFC v5 posted
  -  Wen Congyang
  -  Gui Jianfeng
  -  Yang Hongyang
  -  Dong, Eddie

*  tmem migrationv2 patches. (none)
  -  Bob Liu & Andrew Cooper & David Vrabel

*  snapshot API extension (checkpointing disk) (fair)
   v10
  -  Chunyan Liu

*  PVH - Migration of PVH DomUs. (none)
   Depends on migration2 code
   v1 posted
  -  Roger Pau Monné

*  PVH - Migration of guests from a PVH dom0  (fair)
   Depends on migration2 code
  -  Roger Pau Monné

== QEMU ==

*  Restrict QEMU
  -  Stefano Stabellini

*  Linux-based QEMU upstream stub domain (fair)
   RFC posted
  -  Eric Shelton

*  Using qemu-upstream in a stubdomain (none)
   Will use rump kernels.
  -  Wei Liu

*  Intel IGD PCI GPU passthrough (ok)
   v5 posted
  -  Chen, Tiejun

== Linux ==

*  VPMU - 'perf' support in Linux (ok)
   Depends on Xen patches
   Acked by David Vrabel
  -  Boris Ostrovsky

*  vNUMA in Linux (ok)
   v6 posted
  -  Wei Liu

*  COLO Agent in Linux (fair)
  -  Gui Jianfeng
  -  Yang Hongyang
  -  Dong, Eddie

*  ARM64 - support 64K guest (none)
  -  Julien Grall

== OpenStack ==

== FreeBSD ==

*  PVH FreeBSD dom0 (ok)
   FreeBSD 11 goal. Toolstack side done in Xen 4.5
  -  Roger Pau Monné

== Other OSes (MiniOS, QNX) ==

*  ARM - MiniOS (fair)
   v7 posted
  -  Thomas Leonard

*  PV drivers for automotive kernels (fair)
  -  Artem Mygaiev

== OSSTEST ==

*  OSSTest: libvirt migration (fair)
  -  Wei Liu

*  OSSTest: performance test (fair)
  -  Dario Faggioli

*  CPU pool test case (fair)
  -  Dario Faggioli

*  Add a FreeBSD host (fair)
  -  Roger Pau Monné

*  Nested virt test case

*  v8 posted (fair)
  -  Robert Hu

== Deferred ==

*  HVM USB support in libxl (fair)
   depend on PV USB support
  -  George Dunlap

*  PV USB support in libxl (fair)
  -  Chunyan Liu

*  HT enabled with credit has 7.9 per perf drop. (none)
   kernbench demonstrated it
   http://www.gossamer-threads.com/lists/xen/devel/339409
   This has existed since credit1 introduction.
  -  Dario Faggioli

*  ucode=scan also scan compressed initramfs (none)
  -  Konrad Rzeszutek Wilk

*  adjust log buffer based on memmap size (none)
  -  Konrad Rzeszutek Wilk

*  Further tmem cleanups/fixes (fair)
  -  Bob Liu

*  1TB slow destruction (ok)
  -  Bob Liu

*  cpuid leveling (none)
   
http://xenbits.xen.org/people/andrewcoop/feature-levelling/feature-levelling-D.pdf
  -  Andrew Cooper

*  Convert tasklet to per-cpu tasklets (fair)
   RFC posted
  -  Konrad Rzeszutek Wilk

*  Xen Boot Information (xbi) (ok)
   Dependency for GRUB2 + EFI work
   http://lists.xen.org/archives/html/xen-devel/2014-10/msg02068.html
   v4, No go for full patchset. Only some of the patches.
   No ARM EFI hardware (yet) available to test them.
  -  Daniel Kiper

*  Linux ARM - Device assigment usage in Linux code (arch/arm) non-PCI (none)
   Depends on Xen pieces which are on the Xen 4.6 list.
  -  Julien Grall

== Completed ==

*  Import xenanalyze in tree (done)
  -  Olaf Hering

*  OSSTest: upgrade to Debian Jessie (none)
  -  Wei Liu

*  OSSTest: stubdom test case (fair)
  -  Wei Liu

*  Remus using migration-v2 (good)
   RFC posted - depends on v6 of 'New Migration'
  -  Yang Hongyang

*  setup CI loop for OpenStack (fair)
  -  Anthony Perard

*  Display IO topology when PXM data is available (good)
   v7 posted
  -  Boris Ostrovsky

*  ARM: reenable support 32-bit userspace running in 64-bit guest (good)
   v2 posted
  -  Ian Campbell

*  Mem_access for ARM (good)
   v15 posted
  -  Tamas K Lengyel

*  Clean-up of mem-event subsystem (good)
   v9 posted
  -  Tamas K Lengyel

*  New Migration (v2). (good)
   v9 (libxc)
   git://xenbits.xen.org/people/andrewcoop/xen.git
   Seems that it might need to slip or we run v1 alongside v2.
  -  Andrew Cooper & David Vrabel

*  libxl: add qxl vga interface support for upstream qemu (fair)
  -  Fabio Fantoni

*  ARM - passthrough of non-PCI (ok)
  -  Julien Grall

*  Intel PML (Page Modification Logging) for Xen (good)
   v1 posted
  -  Kai Huang

*  Regression in PCI passthrough of INTx legacy devices can trigger list 
corruption (good)
   Sander reported it. Two different types of patches available.
  -  Konrad Rzeszutek Wilk

*  HVM guest NUMA (SRAT) (good)
   See vNUMA in Xen toolstack
  -  Wei Liu

*  vNUMA in Xen toolstack (good)
   v8 posted
  -  Wei Liu

*  Intel memory bandwidth monitoring for VMs (fair)
   v9 posted
  -  Chao Peng

*  ARM - SMMU resync of Linux's one (ok)
  -  Julien Grall

*  Add support for Xilinx ZynqMP SoC (fair)
  -  Edgar E. Iglesias

*  Add support for Huawei hip04-d01 platform (ok)
  -  Frediano Ziglio

*  Thunder X platform support (ok)
  -  Vijay Kilari

*  Splitting off mini-os (done)
  -  Wei Liu

*  OVMF on ARM (done)
   v4 posted
  -  Ard Biesheuvel

*  Update Xen tree to use upstream OVMF (done)
  -  Anthony PERARD

*  Enable vTPM subsystem on TPM 2.0 (done)
  -  Xu, Quan

*  SPICE support improvement (done)
  -  Fabio Fantoni

*  arm: introduce basic Renesas R-Car Gen2 platform support (done)
   v5 posted
  -  Oleksandr Tyshchenko


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
http://lists.xen.org/xen-devel