[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

More than 4 network devices with HVM?


  • To: xen-users@xxxxxxxxxxxxxxxxxxxx
  • From: Tom <tom-42@xxxxxx>
  • Date: Sat, 23 Aug 2025 10:56:12 +0200
  • Delivery-date: Sat, 23 Aug 2025 08:57:06 +0000
  • List-id: Xen user discussion <xen-users.lists.xenproject.org>
  • Ui-outboundreport: notjunk:1;M01:P0:m0bu1HKhsfY=;C8M9hGWMYyY3391p2yOHpyLsoRh CF9c8WEjpBppqh6bGp/U/t0j2n9hcXs9DCzWobr2hKU3F0U+XtkL2S7gg/SUoWjIeg77b02cd Jy8pwQHmFZ/MYYcGRquNMfUW0rMqiVw0dx0UKitPnSvx0Bwckn42GArDttE2ha2ewvYgy7Isf dTan40LVTzaiGwX77psPuUlCuv8/q6q1vUggIDZc6xWTVETP4K9UdHwEp0SUWuUcU89rVs7/K vO1wx0wBYLug+WaUYc843KFZ/huH3B96K93t5DRxhMDwsUL8pl62qyuoY0id1vjkoN26mHXYc /SgHiWHJ+WKoZL/XpFFN0KIFS1M8LnsnIqNG/MgB8LQh+Vz577+3NJvW0ufCejHgAC5zx9fEr WUK2PQbvEosxDWbKUUypS9gpC4hTpWJrr1nXE/R4t0eGwzeWI0Xe9icZLV4uysUZPiZudpmVT CTZqlswrnsxebZYxKaqNLjisS8jiUgy0WhXQ8f0OLCARa65JTuhOfmaKlAB8egDKqzZHB96y3 DfYtjWfDCJ3uLbcoVLRLv/v7FO38wElcrnDOpiaT6ngsVDy6RHDFmDAF9h/RB2J+NIBHj+XpS IoNOK9xV8Q/DxIperNjr1VmM5hAbTNchAkZBjR6ha5/UGY8GuQaeAUcaBFx3MPILZDNDdm0Zh Z7FoehqQpPmj9vtSQQroc6+sY9rE6lLutfq2VZzxiYstfsnsoAYsq7Qo1AuYNX5EEKFiuguA1 2VDvIUWzIYQLRLIJ7C9rWW/3a1XyGtM07BFkC2IJiPz0Qvg0x1tJ3m3J++U/seLlRA4p/9Q7N rLy6y+hw/9SkvQEfTb0MENSfL09z9/GdqQYa19G2qedl9Q/ibk/REOy5ApdoPcDZBHjFAAFcp ezS3KFqii24yLaDHwB/cJ0/hV/Nxu1jgSPBAYmXG7qxjG6fEFBCy/TTccM8JtNDhFK8V8WZan EW8eq8BWLfi/TZymyT8+D80PUW2Qhcv7jQbv8wR04928WuxvxxX81lRhkd+7VnGkcLziMMEK/ EPvfurwQzuKhKqN6An0vnxW54ZbSrgLIe91LUjZmTxbB2tC8U6NnYBe1mNN1OjhJFcIR9An+u z9eTvOYzd2nXZgThAIpNTrpnhMG/ZdVaOEvsvgZzfdFnhf0l8Bbybcr4vRfqQdQ6gmMj8Etqu IPMKJqjdz66PhfxpWy9U0oNNo3gbQkY6hbSVsnG/m1YXoPSJeFymX/AsvgoFv6TevJGZtCbzJ L3kU51dixHhg8zKsiM3McNz6rTG3h4mADXYFRroEoCcAZfNO2TABLDaMbd7U3VtZvGt3f09lm ammEKQog7OWeOqsjlFO8241GvFRGhzeilioPLYXA2elUqFZqOAECd+9aps0WksFH9GJolmJZz vaDKe/qlr1vBFZeahEvv0BZ94VbnRy3sTGMyL5K5hGcunlqTnzjBtwtagblaj/0KoyS7uK0Jo Svb6Q5GCJg8mBzP/2Et0GtW1H7irmXZXmZrZd5pY9U7HlvwI6lJed8K+w1KQ5OAput/2qbzKv TRAeko8dmlcpyfYvuk9rwPku3a7KAJGe1NmXa3UWuX69htbP50/J6A7ds/KWtC/IhawiBKbGI hYbcu6ptXqSI/dAfO3POFGwgpDiJRzGFjw4GuucyHjJQdNOJCNmheWopGWwQ4PsbkgJqzml0G Mm0LsJ4qMFg9K0gY16YMYxPSyD6p0GeS6Ms2xirMDOeT+SDqaRBdXoSq6Tj5lvjtwKcAp3jYN AK3rfeNYk1TCavP3RXPajmdCNWvtIpuWv1Sa2lW+ye76wtt02KV/5mrL9AxWoi0SN19XomTwi FNKqMb7uUWQQt1zC93boen+Soc4bvBZYknO8kgs6pgfw4edzj6E8xnKjg3rybxtvrzpXTscmu KN13vEHbFd2M8PagnHyoEa4SMvPtf/qhOZipXEBdXpV/yuRJfRYFCvHm10ed2lsZMQ1kNXOw6 rLSzZ0f9F4LDLQ1uWucz9FfstjAG3Z2/FOMohkOQL6UuTNoOLjWx1UapKpnmvTwPZfbH1TlPk +XOuzCP6QTV8cpg6+0K3f4yS6oO59WSTr9567+U1o6V+Yghc6J/6Sda0VprmS+IJZB/m6qsR3 zTgl+H+tFdOpPuSuSvDohoU2A5r/ycgLpSZ88FuWCRc8bc7njJB6uowwups4Pz+g7aS0YCpZ+ tWRufW1tdrybLBnRpOjUBkeUV3KhzszSukxcMvc0ZsjfVoTbQ3Vv4tJVSkKJvx/P3MBuiIceb CKrggtvFux4V4aq/ysrHK7o4zZfTbg1wPcTwBbGClMLoGdKsedQaadiktNy1XXKtfyTv0QeYE dBUxm1AtVaXZKxHfkwxaKG3YRxHllzgUcxDj5MblOFv2wz3t/2BL3qXYHAejy/gr/GAsa4gAg BbybfV5QWjjYvvqkFFz1e2DIgQC7VbdvLckKeZYewa+r4beseH/BP5MQ39Ds6zrZ5mSjKM7fI WYD5J8EozIpOPEc2S4/EwrcQp5F3GRy8g1DuK7gwuOSUxpM9ENX9hUg0NqXfjD4FcS93ggWQC VuQP1Y/7l4+qxsd6QJjmLk246Z2o1vdpoPPxXYYUXaF8jR0RdZBWq9JC2fPkQckoRUIcIGVmA UEg4CLCzryLGESFvEuooGdYfvufeb/I8UqVRN5/eCY0RcCLEtD3qPKKqSKur/qOKI5eoPm81v kEhGnBvQEBaEeneIBEY86aPeh6zj3fHvCNLgCG0SrAL6n0Nn4Z6K2VxQdOcLQioXBp3k4N1IP bNidQKvEkOR2zu+TuWok7tKUkxc2fwouB2nvLIW8K3psPWMXPF18KuKklg+J9FteDvyL8HIV5 fiq2Q3u8I6SSt1+E5RHy4dUzV+5gjFJBoB23yDl4rQBJ3l25FqHoFuWNnHM3zAj9aK0y+Ryae uHKaphVeGom5/3JHc40DWQeBgYXlbr28CYEbQ28lbQL9nhHuBG/YxA+2cm+BdPAzkUqrkpXcx 0VVnbyC9MsExRc5PwFqBnYluY0Py51pAkf94ELb4A8yOvUU0/UyY/FDW3nlTpr7l3VelqI8iP fvSPsvGTnwmZbDJoUxEnjuSDQWzZwhTxlxPQmSh/m4lg4rkIQtj/i1+1ugkhIKz7aw2Y3C1YF 8OOu+RLsWpXg9CZ7JbIRN7ZB0WXaO4GyiYpDC/VKDYjZuFz5r7emdR8NulgNsB939X1mbDJRY sMfMIe6iZaTeZtGDZ/0ieokOLzJitRYn/ywd5y8CE6BHvpgmQeByMrVPZ+9dabWrxXTNDPFPk BdRgEsIb9F63mkwtxw0K1GBG2So8X5PrbbJ2w0cVnQB9SOrEf6uLipQUmBEaV5r9ZzIh2kOPa OgpwDD3MumSJ06Gav7n19wNL28zXlsYmeSqeuzeC164k0B7BESmZ+/Yt9g93wFyAhhg3SCAGG gIU9tg3yNU2877/FQsTVrKtDjvzkuCjyBVGxjBeGYRCDaf0AGf0S5wsLoSe/q+JIwEQhYbFRA BNmvtBEKlbotQrpFZVUyMF+1fnO4HboC+S83Pa/pRe3cGhM+I6mtRug3wTy8LF+BGuMZDZRbx afUhg+tTAS9o3EfM39qSrKhBFIqYwFjDBGndHVx1RoJdYUeyHKnyikszMehJ0SEy62KSItpuB QosGg5dEOGsQIHYYReoKlS37/RXNCoyNuKaLJUAT79dDTGzmvoRioJDcKnerYLWcXKrw/tYjv kO+pGooeBrdcQMVF1Sq+hQ974a9KRUpcEioaRManFiTF9y3wJp0+X5I5F6lPSxAHHL1DwN2jU 7docG4Vo+Lsh8w/cNv6tfxF0ebJgyEFoPWXF1xd0hqFktpsfAz/RzIywwXvwhnCgTYvxamV+f +A3FcJa3P9lAL2/ExGiYqtdHzCaB6q9nC/bLjkfqkw/9HzcyW1HCXquZasBf+Mfa1m8pN8LXG wDGeUv7uHrUFiaWRz2FsHd9Hoqlhe9fDY/1OvE4aMaXzSJNnziT+tUSkmVSqsAE40H1Eg0Kd4 KT5FqO83HbxexxpFueYtK6DlEG9/xqVacyKcnFoxz73AZ0tAd9IGOIhKH0MvrpCYUznTnnLcy 4UKM6USAtf3kXOU19GIuZqUuZpDh24w3SYDYbo8lxj0OI3fl6cz6YkeKlZ0Xduzh7tJg2uPew WRqNdUMaUgSlIbx2CbJBayZShPP8IaZd/s9Dl5kUQTHl0w+3aOuJNG/Hcb+9YOilbexLI/T8d PbcZNCDWYOGUUY/Mf3ZwLKSXkGClJ/iTmdNYJ1uXKtyM+Ck+FLQkF9qM+sN2PyXMXZIjxtQ0c zaq7pLVosinIwa3qu/8r/E2kA04TkzrYv88cRWTiB1LbQMqFeQe3s6IWNNZdyxazxzAuU81rJ iGcQ3Qh7/m+iECy3qv0kNHJJsuvsfhX9BGWJ+6czRB+ohRYsLZXJN17LOLIxZ2w6om1ztwY2N Rasn73e5uPV0ZCmmWQr/J5YQOsF0neceSb2vAbfjnZZ3ZNfEADuzA7E02zSjkEEvuC1uh3Y0v FtXtR+HDYnJRNFqayC21VZCZkVsXIpJge/zuQXMusBluk+TZxi5uMx4z8e4O0ivqss9kMuRvf pUYUvDMyVshWXxwx6ZtMCJm2U0ChXynLetM87ljy3p7SNJw6HSAwLMHVE3VUfOcJ8mWbYBTJw uxLaPPgWDH24pACQeT6E5fnEfqSOi/Rd/xrVz

Hi experts,

I tried to start a HVM qcow2 under Xen 4.20.1-pre (packaged for Debian 13), which uses up to 6 vmxnet3 network devices.

The VM refuses to start:

libxl: error: libxl_dm.c:3387:device_model_spawn_outcome: Domain 57:domain 57 
device model: spawn failed (rc=-3)
libxl: error: libxl_dm.c:3607:device_model_postconfig_done: Domain 57:Post DM 
startup configs failed, rc=-3
libxl: error: libxl_create.c:1957:domcreate_devmodel_started: Domain 57:device 
model did not start: -3
libxl: error: libxl_aoutils.c:646:libxl__kill_xs_path: Device Model already 
exited
libxl: error: libxl_xshelp.c:206:libxl__xs_read_mandatory: xenstore read 
failed: `/libxl/57/type': No such file or directory
libxl: warning: libxl_dom.c:49:libxl__domain_type: unable to get domain type 
for domid=57, assuming HVM
libxl: error: libxl_domain.c:1616:domain_destroy_domid_cb: Domain 
57:xc_domain_destroy failed: No such process
libxl: error: libxl_domain.c:1133:domain_destroy_callback: Domain 57:Unable to 
destroy guest
libxl: error: libxl_domain.c:1060:domain_destroy_cb: Domain 57:Destruction of 
domain failed

I remember patching qemu 7.2 years ago with a dirty hack found in the net, allocating more memory during VM startup, which was working fine for Xen version 4.14 (Debian 12) at this time.

Just for the curious, the qemu patch:

--- a/hw/i386/xen/xen-hvm.c
+++ b/hw/i386/xen/xen-hvm.c
@@ -266,6 +266,7 @@
     unsigned long nr_pfn;
     xen_pfn_t *pfn_list;
     int i;
+    xc_dominfo_t info;

     if (runstate_check(RUN_STATE_INMIGRATE)) {
         /* RAM already populated in Xen */
@@ -288,6 +289,17 @@
         pfn_list[i] = (ram_addr >> TARGET_PAGE_BITS) + i;
     }

+    /* increase maxmem before calling xc_domain_populate_physmap */
+    /* 
https://patchwork.ozlabs.org/project/qemu-devel/patch/alpine.DEB.2.02.1411251742280.14135@xxxxxxxxxxxxxxxxxxxxxxx/
 */
+    if ((xc_domain_getinfo(xen_xc, xen_domid, 1, &info) != 1)
+         || (info.domid != xen_domid)) {
+        hw_error("xc_domain_getinfo failed");
+    }
+    if (xc_domain_setmaxmem(xen_xc, xen_domid, info.max_memkb +
+                            (nr_pfn * XC_PAGE_SIZE / 1024)) < 0) {
+        hw_error("xc_domain_setmaxmem failed");
+    }
+
     if (xc_domain_populate_physmap_exact(xen_xc, xen_domid, nr_pfn, 0, 0, 
pfn_list)) {
         error_setg(errp, "xen: failed to populate ram at " RAM_ADDR_FMT,
                    ram_addr);

That same patch is not working with qemu 10 and Xen 4.20: some old interfaces were removed, and the Xen parts in the source were reorganized quite a bit. This is probably a good thing, so let's forget about the dirty patch above. ;-)


Am I doing something wrong in the first place? Is there a solution to the "bug", not allowing more than 4 vmxnet3 per HVM? Any chance to get a HVM with 5+ network interfaces started on Xen 4.20?

Kind regards
Tom



 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.