[Xen-devel] [OSSTEST PATCH 00/62] Update to Debian stable (stretch)

[Ian Jackson <ian.jackson@xxxxxxxxxxxxx>]

This, finally, is the series to update osstest to Debian stretch.
This is very urgent because Debian have been removing parts of jessie
from their servers, in a rather unhelpful and not entirely controlled
manner.  Consequently, currently osstest is not reliable with jessie.

I am going to push this series to osstest pretest immediately without
waiting for acks/reviews/etc.  I expect it to trip two regressions in
the osstest push gate, which I will force push.

One effect of this series is to put into service the two ThunderX
arm64 machines, rochester[01], which are supportable in stretch but
not jessie.

There seem to be a number of outstanding problems which I decided were
not blockers:

 * test-amd64-amd64-xl-qcow2 fails because the xvd driver fails to
   freeze during the Linux guest suspend.  This seems to be a real bug
   of some kind and needs investigation.

 * I experienced difficulties with the 4 Arndale devboards: high
   probability guest start failures.  For now I have marked those
   nodes as unsuitable for use with stretch, which will, effectively,
   take them out of service - and leave us with a lack of armhf
   capacity.  It is possible that this problem is due to the
   ifupdown-hotplug issue, now addressed, so I plan to retest.

 * The serial output from the new rochester arm64 machines is missing
   some of the grub bootloader messages (and this is detected by one
   of the examine jobs).  I may need help from someone familiar with
   these machines' hardware/firmware.

 * stretch did not appear to work properly on joubertin[01] and
   merlot[01] (x86 boxes).  I have marked them to be not used with
   stretch.  They will need to be retested and the problems
   investigated (if indeed the problems still remain after other fixes
   which are now in this series).

 * I have two bug reports / patches to go upstream to Debian: a boot
   ordering bug with ifupdown and udev, and a bug in fishdescriptor.

There are a couple of occurrences in this series of changes which
break things followed by patches to fix them up.  I have not bothered
squashing/reorganising those.

Ian Jackson (41):
  power: Fix uninitialised variable warning
  Debian: Fix http:// url for bugs.xenproject.org
  contents_make_cpio: Include symlinks
  contents_make_cpio: Make files owned by root
  overlay-persistent-net: Copy from jessie
  persistent-net: Add overlay on installed systems >= stretch
  persistent-net: Add overlay in installer >= stretch
  ts-host-install: Break out $persistent_net_rules
  ts-host-install: Unconditionally mkdir -p /etc/udev/rules.d
  ts-host-install: Put canary in 70-persistent-net.rules
  persistent-net: Include initramfs script to copy to target
  persistent-net: Set net.ifnames=0 in di_installcmdline_core
  ts-kernel-build: Enable some additional drivers for Thunder-X
  TestSupport: Move `stashed files' and `next_unique_name' earlier
  TestSupport: Move `target_somefile_getleaf' earlier
  TestSupport: target_somefile_leaf rename and change a variable
  TestSupport: Provide target_getfile_root_stash
  ts-guests-nbd-mirror: Use target_getfile_root_stash
  preseed_base: chmod ssh host private keys to placate sshd
  preseed_base: break out debian_overlays_fixup_cmd
  ts-debian-fixup: Use debian_overlays_fixup_cmd
  preseed_hook_command: allow specifying di keys other than preseed/*
  preseed_hook_installscript: Use partman/early_command, not preseed/
  Debian: preseed_hook_installscript: New $atonce option
  Debian: partman scripts: Run right away too
  Debian: set partman-lvm/device_remove_lvm_span
  Debian: Add reference to bug numbers for erase-other-disks
  dm restrict audit: actually install right package for fishdescriptor
  Debian: Move preseed_backports_packages earlier
  dm restrict audit: actually install fishdescriptor in host
  dm restrict audit: always install (some) chiark-scripts
  target_install_packages: Consistently use qw(...) rather than '...'
  ts-xen-install: Install libpciaccess0
  ts-debian-hvm-install: Honour linux_boot_append target var
  make-flight: shadow test: Disable kpti in guests
  platforms: Pass suite to get_arch_platforms
  platforms: Honour suite in get_arch_platforms
  dm restrict, fishdescriptor: Update to a fixed chiark-scripts
  Debian: Fix /lib/udev/ifupdown-hotplug to not run if / is ro
  Debian: Fix /lib/udev/ifupdown-hotplug in guests from debootstrap
  production-config-cambridge: Provide TftpDiVersion_stretch

Julien Grall (2):
  stretch: Use chainloading when booting using GRUB on Arm64
  ts-xen-build: Enable ITS driver in Xen

Wei Liu (19):
  gitignore: ignore vim swap file
  ts-xen-build-prep: only install w3c-dtd-xhtml for suites <Stretch
  ts-xen-build-prep: install packages for suites >jessie
  ts-xen-install: install some packages on stretch
  Debian.pm: use sysvinit-core instead of systemd
  ts-leak-check: suppress systemd-shim, which leaks in stretch
  ts-host-install: don't use the new nic naming scheme
  ts-debian-fixup: merge origin extra= to our own if necessary
  ts-debian-fixup: append noresume
  ts-xen-build-prep: install e2fslibs-dev
  ts-guests-nbd-mirror: make it work with stretch
  Extend workaround `clk_ignore_unused' to stretch
  adjust how to skip bootloader installation for arm32, in Stretch
  ts-debian-di-install: use gho to pick d-i
  make-flight: guest should use jessie to test pvgrub
  Drop rumprun tests
  ts-guests-nbd-mirror: use target_{get,put}file_root to transfter cfg
  ts-kernel-build: disable host1x, which doesn't build
  Switch to Debian Stretch

 .gitignore                                         |   1 +
 Osstest.pm                                         |   2 +-
 Osstest/Debian.pm                                  | 205 ++++++++++++++-------
 Osstest/HostDB/Executive.pm                        |  10 +-
 Osstest/HostDB/Static.pm                           |   4 +-
 Osstest/RumpRun.pm                                 |  68 -------
 Osstest/TestSupport.pm                             | 115 ++++++------
 Osstest/Toolstack/rumprun.pm                       |  33 ----
 allow.all                                          |   1 -
 allow.rumprun                                      |   1 -
 ap-common                                          |   7 -
 ap-fetch-version                                   |   4 -
 ap-fetch-version-old                               |   5 -
 ap-print-url                                       |   3 -
 ap-push                                            |   5 -
 cr-daily-branch                                    |   9 -
 cri-common                                         |   1 -
 cri-getplatforms                                   |   2 +-
 crontab                                            |   4 +-
 daily-cron-email-real--rumpuserxen                 |   4 -
 daily-cron-email-real-bisectcomplete--rumpuserxen  |   4 -
 make-flight                                        |  48 +----
 mfi-common                                         |  37 ----
 overlay-persistent-net/etc/init.d/udev-finish      |  22 +++
 .../etc/udev/rule_generator.functions              | 113 ++++++++++++
 .../etc/udev/rules.d/73-usb-net-by-mac.rules       |   0
 .../etc/udev/rules.d/75-net-description.rules      |   0
 .../udev/rules.d/75-persistent-net-generator.rules | 143 ++++++++++++++
 overlay-persistent-net/etc/udev/udev-finish        |   9 +
 overlay-persistent-net/etc/udev/write_net_rules    | 152 +++++++++++++++
 .../lib/udev/rule_generator.functions              |   1 +
 overlay-persistent-net/lib/udev/udev-finish        |   1 +
 overlay-persistent-net/lib/udev/write_net_rules    |   1 +
 production-config                                  |   3 +
 production-config-cambridge                        |   1 +
 sg-run-job                                         |  26 ---
 ts-debian-di-install                               |   4 +-
 ts-debian-fixup                                    |  23 ++-
 ts-debian-hvm-install                              |   3 +
 ts-guests-nbd-mirror                               |  51 ++++-
 ts-host-install                                    |  23 ++-
 ts-kernel-build                                    |  14 ++
 ts-leak-check                                      |   1 +
 ts-rumprun-bake                                    |  88 ---------
 ts-rumprun-build                                   | 103 -----------
 ts-rumprun-demo-build                              |  67 -------
 ts-rumprun-demo-setup                              |  54 ------
 ts-rumprun-demo-xenstorels                         | 113 ------------
 ts-rumprun-test-prep                               |  37 ----
 ts-xen-build                                       |   4 +
 ts-xen-build-prep                                  |  16 +-
 ts-xen-install                                     |  12 +-
 52 files changed, 803 insertions(+), 855 deletions(-)
 delete mode 100644 Osstest/RumpRun.pm
 delete mode 100644 Osstest/Toolstack/rumprun.pm
 delete mode 100644 allow.rumprun
 delete mode 100644 daily-cron-email-real--rumpuserxen
 delete mode 100644 daily-cron-email-real-bisectcomplete--rumpuserxen
 create mode 100755 overlay-persistent-net/etc/init.d/udev-finish
 create mode 100644 overlay-persistent-net/etc/udev/rule_generator.functions
 create mode 100644 
overlay-persistent-net/etc/udev/rules.d/73-usb-net-by-mac.rules
 create mode 100644 
overlay-persistent-net/etc/udev/rules.d/75-net-description.rules
 create mode 100644 
overlay-persistent-net/etc/udev/rules.d/75-persistent-net-generator.rules
 create mode 100755 overlay-persistent-net/etc/udev/udev-finish
 create mode 100755 overlay-persistent-net/etc/udev/write_net_rules
 create mode 120000 overlay-persistent-net/lib/udev/rule_generator.functions
 create mode 120000 overlay-persistent-net/lib/udev/udev-finish
 create mode 120000 overlay-persistent-net/lib/udev/write_net_rules
 delete mode 100755 ts-rumprun-bake
 delete mode 100755 ts-rumprun-build
 delete mode 100755 ts-rumprun-demo-build
 delete mode 100755 ts-rumprun-demo-setup
 delete mode 100755 ts-rumprun-demo-xenstorels
 delete mode 100755 ts-rumprun-test-prep

-- 
2.11.0


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxxx
https://lists.xenproject.org/mailman/listinfo/xen-devel