[Xen-devel] save / migrate not working on gentoo?

[tdc <tdc@xxxxxxxxxxxx>]

Hi all,
I've tested several versions of Xen (2.0, 2.0.3, 2.0-testing, unstable) 
on different machines (VIA C3, PIII, AMD XP), all running up-to-date 
gentoo system and I'm unable to migrate (or even save) domains on any of 
those machines.
Currently I'm making tests mainly on the Athlon box, on which I've tried 
two GCC versions - 3.3.5 at first, later I've recompiled glibc and then 
Xen 2.0.3 with gcc 3.4.2; still no luck.
xend is running, xfrd is running, all requirements are installed 
(twisted 1.3, ip, brctl), virt-1 domain is running against local 'file' 
based VBDs.
# xm dmesg | grep version
Xen version 2.0.3 (root@here) (gcc version 3.4.2 (Gentoo Linux 3.4.2-r2, 
ssp-3.4.1-1, pie-8.7.6.5
)) Tue Jan 18 21:14:17 CET 2005

# xm list
Name              Id  Mem(MB)  CPU  State  Time(s)  Console
Domain-0           0       91    0  r----  138106.9
virt-1             2      127    0  -b---      7.9    9602

# xm save virt-1 virt-1.save
Error: Error: [Failure instance: Traceback: 
xen.xend.XendError.XendError, save failed
# xm migrate virt-1 localhost
Error: Error: [Failure instance: Traceback: 
xen.xend.XendError.XendError, migrate failed
Logs for the 'save' attempt are attached. Any hints?

TIA
Dave

25601 [INF] XFRD> Accepted connection from 127.0.0.1:1115 on 2
25667 [INF] XFRD> Xfr service for 127.0.0.1:1115
[DEBUG] Conn_init> flags=1
[DEBUG] Conn_init> write stream...
[DEBUG] stream_init>mode=w flags=1 compress=0
[DEBUG] stream_init> unbuffer...
[DEBUG] stream_init< err=0
[DEBUG] Conn_init> read stream...
[DEBUG] stream_init>mode=r flags=1 compress=0
[DEBUG] stream_init> unbuffer...
[DEBUG] stream_init< err=0
[DEBUG] Conn_sxpr>
(xfr.hello 1 0)[DEBUG] Conn_sxpr< err=0
[DEBUG] Conn_sxpr>
(xfr.save 2 "(domain (id 2) (name virt-1) (memory 127) (maxmem 131072) (state 
-b---) (cpu 0) (cpu_time 7.66579571) (up_time 45.2437880039) (start_time 
1106262818.13) (console (status listening) (id 13) (domain 2) (local_port 13) 
(remote_port 1) (console_port 9602)) (devices (vif (idx 0) (vif 0) (mac 
aa:00:00:2a:f6:2a) (evtchn 17 4) (index 0)) (vbd (idx 0) (vdev 2049) (device 
1792) (mode w) (dev sda1) (uname file:/xen/virt-1) (node /dev/loop0) (index 0)) 
(vbd (idx 1) (vdev 2050) (device 1793) (mode w) (dev sda2) (uname 
file:/xen/virt-1.swap) (node /dev/loop1) (index 1))) (config (vm (name virt-1) 
(memory 128) (image (linux (kernel /boot/vmlinuz-2.6.10-xenU) (ip 
192.168.0.31:1.2.3.4:192.168.0.1:255.255.254.0:gentoo:eth0:off) (root 
'/dev/sda1 ro'))) (device (vbd (uname file:/xen/virt-1) (dev sda1) (mode w))) 
(device (vbd (uname file:/xen/virt-1.swap) (dev sda2) (mode w))) (device (vif 
(mac aa:00:00:2a:f6:2a))))))" /xen/virt-1.save)[DEBUG] Conn_sxpr< err=0
[1106262863.378546] xc_linux_save start 2

xc_linux_save start 2

network start bridge=xen-br0 netdev=eth0 antispoof=no
VIRTUAL MEMORY ARRANGEMENT:
 Loaded kernel: c0100000->c0451144
 Init. ramdisk: c0452000->c0452000
 Phys-Mach map: c0452000->c0472000
 Page tables:   c0472000->c0475000
 Start info:    c0475000->c0476000
 Boot stack:    c0476000->c0477000
 TOTAL:         c0000000->c0800000
 ENTRY ADDRESS: c0100000
/dev/loop: Is a directory
/dev/loop: Is a directory
ioctl: LOOP_SET_FD: Device or resource busy
vif-bridge up vif=vif2.0 domain=virt-1 mac=aa:00:00:2a:f6:2a bridge=xen-br0
recv_fe_driver_status> {'status': 1}

recv_fe_driver_status>

recv_fe_interface_connect {'tx_shmem_frame': 17426, 'rx_shmem_frame': 18698, 
'handle': 0}
sync_session> <type 'str'> 1 ['save', ['id', '1'], ['state', 'begin'], 
['domain', '2'], ['file', '/xen/virt-1.save']]
Started to connect self= <xen.xend.XendMigrate.XfrdClientFactory instance at 
0xb76c34cc> connector= <twisted.internet.tcp.Connector instance at 0xb76c34ec>
buildProtocol> IPv4Address(TCP, 'localhost', 8002)
***request> (domain (id 2) (name virt-1) (memory 127) (maxmem 131072) (state 
-b---) (cpu 0) (cpu_time 7.66579571) (up_time 45.2407670021) (start_time 
1106262818.13) (console (status listening) (id 13) (domain 2) (local_port 13) 
(remote_port 1) (console_port 9602)) (devices (vif (idx 0) (vif 0) (mac 
aa:00:00:2a:f6:2a) (evtchn 17 4) (index 0)) (vbd (idx 0) (vdev 2049) (device 
1792) (mode w) (dev sda1) (uname file:/xen/virt-1) (node /dev/loop0) (index 0)) 
(vbd (idx 1) (vdev 2050) (device 1793) (mode w) (dev sda2) (uname 
file:/xen/virt-1.swap) (node /dev/loop1) (index 1))) (config (vm (name virt-1) 
(memory 128) (image (linux (kernel /boot/vmlinuz-2.6.10-xenU) (ip 
192.168.0.31:1.2.3.4:192.168.0.1:255.255.254.0:gentoo:eth0:off) (root 
'/dev/sda1 ro'))) (device (vbd (uname file:/xen/virt-1) (dev sda1) (mode w))) 
(device (vbd (uname file:/xen/virt-1.swap) (dev sda2) (mode w))) (device (vif 
(mac aa:00:00:2a:f6:2a))))))
***request> begin
xfr_err> ['xfr.err', '0']
xfr_err> <type 'str'> 0
Xfrd>connectionLost> [Failure instance: Traceback: 
twisted.internet.error.ConnectionDone, Connection was closed cleanly.
]
XfrdSaveInfo>connectionLost> [Failure instance: Traceback: 
twisted.internet.error.ConnectionDone, Connection was closed cleanly.
]
XfrdInfo>connectionLost> [Failure instance: Traceback: 
twisted.internet.error.ConnectionDone, Connection was closed cleanly.
]
Error> save failed
Error> calling errback
***cbremove> [Failure instance: Traceback: xen.xend.XendError.XendError, save 
failed
]
***_delete_session> 1
clientConnectionLost> connector= <twisted.internet.tcp.Connector instance at 
0xb76c34ec> reason= [Failure instance: Traceback: 
twisted.internet.error.ConnectionDone, Connection was closed cleanly.
]

[2005-01-21 00:13:24 xend] INFO (SrvDaemon:607) Xend Daemon started
[2005-01-21 00:13:24 xend] INFO (XendRoot:91) EVENT> xend.start 0
[2005-01-21 00:13:38 xend] DEBUG (XendDomainInfo:720) init_domain> Created 
domain=2 name=virt-1 memory=128
[2005-01-21 00:13:38 xend] INFO (console:92) Created console id=13 domain=2 
port=9602
[2005-01-21 00:13:38 xend] DEBUG (XendDomainInfo:1130) Creating vbd dom=2 
uname=file:/xen/virt-1
[2005-01-21 00:13:38 xend] DEBUG (blkif:146) Connecting blkif 
<BlkifBackendInterface 2 0>
[2005-01-21 00:13:38 xend] DEBUG (XendDomainInfo:1130) Creating vbd dom=2 
uname=file:/xen/virt-1.swap
[2005-01-21 00:13:38 xend] DEBUG (blkif:146) Connecting blkif 
<BlkifBackendInterface 2 0>
[2005-01-21 00:13:38 xend] DEBUG (XendDomainInfo:1107) Creating vif dom=2 vif=0 
mac=aa:00:00:2a:f6:2a
[2005-01-21 00:13:38 xend] INFO (XendRoot:91) EVENT> xend.console.create [13, 
2, 9602]
[2005-01-21 00:13:38 xend] INFO (XendRoot:91) EVENT> xend.domain.create 
['virt-1', '2']
[2005-01-21 00:13:38 xend] INFO (XendRoot:91) EVENT> xend.domain.unpause 
['virt-1', '2']
[2005-01-21 00:13:42 xend] DEBUG (blkif:192) Connecting blkif to event channel 
<BlkifBackendInterface 2 0> ports=16:3
[2005-01-21 00:14:23 xend] INFO (XendMigrate:370) Save BEGIN: ['save', ['id', 
'1'], ['state', 'begin'], ['domain', '2'], ['file', '/xen/virt-1.save']]
[2005-01-21 00:14:23 xend] INFO (XendRoot:91) EVENT> xend.domain.save 
['virt-1', '2', 'begin', ['save', ['id', '1'], ['state', 'begin'], ['domain', 
'2'], ['file', '/xen/virt-1.save']]]
[2005-01-21 00:14:23 xend] INFO (XendMigrate:390) Save ERROR: ['save', ['id', 
'1'], ['state', 'error'], ['domain', '2'], ['file', '/xen/virt-1.save']]
[2005-01-21 00:14:23 xend] INFO (XendRoot:91) EVENT> xend.domain.save 
['virt-1', '2', 'error', ['save', ['id', '1'], ['state', 'error'], ['domain', 
'2'], ['file', '/xen/virt-1.save']]]