Re: xl create/save throwing errors

[Petr Beneš <w1benny@xxxxxxxxx>]

On Thu, Feb 20, 2025 at 9:14 AM Jan Beulich <jbeulich@xxxxxxxx> wrote:
>
> Just one thing - to (hopefully) get a better understanding of the origin of
> those errors, you may want to increase verbosity of the "xl save", e.g.
> "xl -vvv save".
>
> Jan

Here's an output of this command, that failed:
xl -vvv save win10-18362-103 /opt/ramdisk/vms/clones/win10-18362-103/state

libxl: debug: libxl_domain.c:2295:libxl_retrieve_domain_configuration:
Domain 90:ao 0x555eef6f1bd0: create: how=(nil) callback=(nil)
poller=0x555eef6fca50
libxl: debug: libxl_domain.c:2311:libxl_retrieve_domain_configuration:
Domain 90:ao 0x555eef6f1bd0: inprogress: poller=0x555eef6fca50,
flags=i
libxl: debug: libxl_qmp.c:1884:libxl__ev_qmp_send: Domain 90: ev
0x555eef6feeb0, cmd 'query-cpus-fast'
libxl: debug: libxl_qmp.c:1324:qmp_ev_lock_aquired: Domain
90:Connecting to /var/run/xen/qmp-libxl-90
libxl: debug: libxl_qmp.c:1699:qmp_ev_handle_message: Domain 90:QEMU
version: 8.0.4
libxl: debug: libxl_domain.c:2587:retrieve_domain_configuration_end:
Domain 90:No vtpm from xenstore
libxl: debug: libxl_domain.c:2587:retrieve_domain_configuration_end:
Domain 90:No vusb from xenstore
libxl: debug: libxl_domain.c:2587:retrieve_domain_configuration_end:
Domain 90:No vusb from xenstore
libxl: debug: libxl_domain.c:2587:retrieve_domain_configuration_end:
Domain 90:No pci from xenstore
libxl: debug: libxl_domain.c:2587:retrieve_domain_configuration_end:
Domain 90:No vdispl from xenstore
libxl: debug: libxl_domain.c:2587:retrieve_domain_configuration_end:
Domain 90:No vsnd from xenstore
libxl: debug: libxl_qmp.c:1920:libxl__ev_qmp_dispose: Domain 90: ev
0x555eef6feeb0
libxl: debug: libxl_event.c:2067:libxl__ao_complete: ao
0x555eef6f1bd0: complete, rc=0
libxl: debug: libxl_event.c:2036:libxl__ao__destroy: ao 0x555eef6f1bd0: destroy
Saving to /opt/ramdisk/vms/clones/win10-18362-103/state new xl format
(info 0x3/0x0/1793)
libxl: debug: libxl_domain.c:508:libxl_domain_suspend: Domain 90:ao
0x555eef6f66d0: create: how=(nil) callback=(nil) poller=0x555eef6fca50
libxl: debug: libxl.c:721:libxl__fd_flags_modify_save: fnctl F_GETFL
flags for fd 14 are 0x8001
libxl: debug: libxl.c:729:libxl__fd_flags_modify_save: fnctl F_SETFL
of fd 14 to 0x8001
libxl: debug: libxl_domain.c:536:libxl_domain_suspend: Domain 90:ao
0x555eef6f66d0: inprogress: poller=0x555eef6fca50, flags=i
libxl-save-helper: debug: starting save: Success
xc: detail: fd 14, dom 90, flags 0, hvm 1
xc: info: Saving domain 90, type x86 HVM
libxl: debug: libxl_qmp.c:1884:libxl__ev_qmp_send: Domain 90: ev
0x555eef703608, cmd 'xen-set-global-dirty-log'
libxl: debug: libxl_qmp.c:1324:qmp_ev_lock_aquired: Domain
90:Connecting to /var/run/xen/qmp-libxl-90
libxl: debug: libxl_qmp.c:1699:qmp_ev_handle_message: Domain 90:QEMU
version: 8.0.4
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x555eef703590: deregister unregistered
libxl: debug: libxl_qmp.c:1920:libxl__ev_qmp_dispose: Domain 90: ev
0x555eef703608
libxl: debug: libxl_dom_suspend.c:190:domain_suspend_callback_common:
Domain 90:Calling xc_domain_shutdown on HVM domain
libxl: debug: libxl_dom_suspend.c:300:domain_suspend_common_wait_guest:
Domain 90:wait for the guest to suspend
libxl: debug: libxl_event.c:812:libxl__ev_xswatch_register: watch
w=0x555eef702bf0 wpath=@releaseDomain token=3/0: register slotnum=3
libxl: debug: libxl_event.c:750:watchfd_callback: watch
w=0x555eef702bf0 wpath=@releaseDomain token=3/0: event
epath=@releaseDomain
libxl: debug: libxl_dom_suspend.c:348:suspend_common_wait_guest_check:
Domain 90:guest we were suspending has shut down with unexpected
reason code 3
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x555eef702bd8: deregister unregistered
libxl: debug: libxl_event.c:849:libxl__ev_xswatch_deregister: watch
w=0x555eef702bf0 wpath=@releaseDomain token=3/0: deregister slotnum=3
libxl: debug: libxl_qmp.c:1920:libxl__ev_qmp_dispose:  ev 0x555eef702c68
xc: error: save callback suspend() failed: 0: Internal error
xc: error: Save failed (0 = Success): Internal error
libxl: debug: libxl_qmp.c:1884:libxl__ev_qmp_send: Domain 90: ev
0x555eef703608, cmd 'xen-set-global-dirty-log'
libxl: debug: libxl_qmp.c:1324:qmp_ev_lock_aquired: Domain
90:Connecting to /var/run/xen/qmp-libxl-90
libxl: debug: libxl_qmp.c:1699:qmp_ev_handle_message: Domain 90:QEMU
version: 8.0.4
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x555eef703590: deregister unregistered
libxl: debug: libxl_qmp.c:1920:libxl__ev_qmp_dispose: Domain 90: ev
0x555eef703608
libxl-save-helper: debug: complete r=-1: Success
libxl: error: libxl_stream_write.c:347:libxl__xc_domain_save_done:
Domain 90:saving domain: domain responded to suspend request: Success
libxl: debug: libxl.c:748:libxl__fd_flags_restore: fnctl F_SETFL of fd
14 to 0x8001
libxl: debug: libxl_event.c:2067:libxl__ao_complete: ao
0x555eef6f66d0: complete, rc=-3
libxl: debug: libxl_event.c:2036:libxl__ao__destroy: ao 0x555eef6f66d0: destroy
Failed to save domain, resuming domain
libxl: debug: libxl_domain.c:184:libxl_domain_resume: Domain 90:ao
0x555eef702050: create: how=(nil) callback=(nil) poller=0x555eef6fca50
libxl: debug: libxl_qmp.c:1884:libxl__ev_qmp_send: Domain 90: ev
0x555eef6ff208, cmd 'cont'
libxl: debug: libxl_domain.c:192:libxl_domain_resume: Domain 90:ao
0x555eef702050: inprogress: poller=0x555eef6fca50, flags=i
libxl: debug: libxl_qmp.c:1324:qmp_ev_lock_aquired: Domain
90:Connecting to /var/run/xen/qmp-libxl-90
libxl: debug: libxl_qmp.c:1699:qmp_ev_handle_message: Domain 90:QEMU
version: 8.0.4
libxl: debug: libxl_qmp.c:1920:libxl__ev_qmp_dispose: Domain 90: ev
0x555eef6ff208
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x555eef6ff378: deregister unregistered
xc: error: Dom 90 not suspended: (shutdown 4, reason 3): Internal error
libxl: error: libxl_dom_suspend.c:661:domain_resume_done: Domain
90:xc_domain_resume failed: Invalid argument
libxl: debug: libxl_event.c:2067:libxl__ao_complete: ao
0x555eef702050: complete, rc=-3
libxl: debug: libxl_event.c:2036:libxl__ao__destroy: ao 0x555eef702050: destroy
xencall:buffer: debug: total allocations:69 total releases:69
xencall:buffer: debug: current allocations:0 maximum allocations:2
xencall:buffer: debug: cache current size:2
xencall:buffer: debug: cache hits:51 misses:2 toobig:16
xencall:buffer: debug: total allocations:0 total releases:0
xencall:buffer: debug: current allocations:0 maximum allocations:0
xencall:buffer: debug: cache current size:0
xencall:buffer: debug: cache hits:0 misses:0 toobig:0