[Xen-users] migration, domU crash on destination dom0

[Nicola Bianchi <nbianchi@xxxxxxxxx>]

Hi,
I've 2 dom0 machine with slackware 10.2 and xen-3.0-testing istalled 
from source.
When I try to migrate a domU between the 2 dom0 machine I've problem.

The migration seem to work because, at the end, the domU migrate form a 
machine to the other but the domU crash and reboot before...
In the log of the source dom0 machine I've this error:

###
....
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) netbuf race: iter 
4, pfn 2822. mfn ffffffff
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) netbuf race: iter 
4, pfn 2823. mfn ffffffff
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) netbuf race: iter 
4, pfn 2824. mfn ffffffff
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) netbuf race: iter 
4, pfn 2825. mfn ffffffff
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) netbuf race: iter 
4, pfn 2826. mfn ffffffff
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) netbuf race: iter 
4, pfn 2827. mfn ffffffff
....
[2006-04-27 14:08:47 xend] DEBUG (XendCheckpoint:80) [xc_save]: 
/usr/lib/xen/bin/xc_save 11 18 6 0 0 1
[2006-04-27 14:08:47 xend] ERROR (XendCheckpoint:227) Had 0 unexplained 
entries in p2m table
[2006-04-27 14:08:52 xend] DEBUG (XendCheckpoint:200) suspend
[2006-04-27 14:08:52 xend] DEBUG (XendCheckpoint:83) In saveInputHandler 
suspend
[2006-04-27 14:08:52 xend] DEBUG (XendCheckpoint:85) Suspending 6 ...
[2006-04-27 14:08:52 xend.XendDomainInfo] DEBUG (XendDomainInfo:877) 
XendDomainInfo.handleShutdownWatch
 2: sent 56, skipped 0, delta 20ms, dom0 35%, target 0%, sent 91Mb/s, 
dirtied 0Mb/s 0 pages
 3: sent 0, skipped 0, Start last iterationpoint:227) Saving memory 
pages: iter 3   0%
[2006-04-27 14:08:52 xend.XendDomainInfo] DEBUG (XendDomainInfo:877) 
XendDomainInfo.handleShutdownWatch
[2006-04-27 14:08:52 xend.XendDomainInfo] INFO (XendDomainInfo:836) 
Domain has shutdown: name=migrating-slack-1 id=6 reason=suspend.
[2006-04-27 14:08:52 xend] INFO (XendCheckpoint:88) Domain 6 suspended.
[2006-04-27 14:08:52 xend] DEBUG (XendCheckpoint:91) Written done
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) SUSPEND shinfo 
00000bd6 eip c01013a7 edx 00010b08
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) delta 18ms, dom0 
100%, target 0%, sent 0Mb/s, dirtied 136Mb/s 75 pages
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) 4: sent 75, 
skipped 0, delta 21ms, dom0 95%, target 0%, sent 117Mb/s, dirtied 
117Mb/s 75 pages
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) Total pages sent= 
12387 (0.86x)
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) (of which 0 were 
fixups)
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) All memory is saved
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) Save exit rc=0
[2006-04-27 14:08:52 xend.XendDomainInfo] DEBUG (XendDomainInfo:1335) 
XendDomainInfo.destroyDomain(6)
###

and on the destination dom0 machine:

####

[2006-04-27 14:08:47 xend.XendDomainInfo] DEBUG (XendDomainInfo:253) 
XendDomainInfo.restore(['domain', ['domid', '6'], ['uuid', 
'404d7c42-5c61-502f-1108-6b50d4d942f8'], ['ssidref', '0'], ['vcpus', 
'1'], ['vcpu_avail', '1'], ['cpu_weight', '1.0'], ['memory', '48'], 
['maxmem', '48'], ['name', 'slack-1'], ['on_poweroff', 'destroy'], 
['on_reboot', 'restart'], ['on_crash', 'restart'], ['image', ['linux', 
['kernel', '/boot/vmlinuz-2.6.16-xen'], ['ip', 
'192.168.168.222:1.2.3.4:192.168.168.1:255.255.255.0:virtual:eth0:no'], 
['root', '/dev/sda1 ro'], ['args', '3']]], ['device', ['vif', 
['backend', '0'], ['script', 'vif-bridge'], ['mac', 
'00:16:3e:56:c2:5f']]], ['device', ['vbd', ['backend', '0'], ['dev', 
'sda1'], ['uname', 'file:/vds/root_fs'], ['mode', 'w']]], ['state', 
'-b----'], ['shutdown_reason', 'poweroff'], ['cpu_time', '2.020679711'], 
['online_vcpus', '1'], ['up_time', '199.204096079'], ['start_time', 
'1146139528.13'], ['store_mfn', '68359'], ['console_mfn', '68358']])
[2006-04-27 14:08:47 xend.XendDomainInfo] DEBUG (XendDomainInfo:284) 
parseConfig: config is ['domain', ['domid', '6'], ['uuid', 
'404d7c42-5c61-502f-1108-6b50d4d942f8'], ['ssidref', '0'], ['vcpus', 
'1'], ['vcpu_avail', '1'], ['cpu_weight', '1.0'], ['memory', '48'], 
['maxmem', '48'], ['name', 'slack-1'], ['on_poweroff', 'destroy'], 
['on_reboot', 'restart'], ['on_crash', 'restart'], ['image', ['linux', 
['kernel', '/boot/vmlinuz-2.6.16-xen'], ['ip', 
'192.168.168.222:1.2.3.4:192.168.168.1:255.255.255.0:virtual:eth0:no'], 
['root', '/dev/sda1 ro'], ['args', '3']]], ['device', ['vif', 
['backend', '0'], ['script', 'vif-bridge'], ['mac', 
'00:16:3e:56:c2:5f']]], ['device', ['vbd', ['backend', '0'], ['dev', 
'sda1'], ['uname', 'file:/vds/root_fs'], ['mode', 'w']]], ['state', 
'-b----'], ['shutdown_reason', 'poweroff'], ['cpu_time', '2.020679711'], 
['online_vcpus', '1'], ['up_time', '199.204096079'], ['start_time', 
'1146139528.13'], ['store_mfn', '68359'], ['console_mfn', '68358']]
[2006-04-27 14:08:47 xend.XendDomainInfo] DEBUG (XendDomainInfo:380) 
parseConfig: result is {'ssidref': 0, 'uuid': 
'404d7c42-5c61-502f-1108-6b50d4d942f8', 'on_crash': 'restart', 
'on_reboot': 'restart', 'image': ['linux', ['kernel', 
'/boot/vmlinuz-2.6.16-xen'], ['ip', 
'192.168.168.222:1.2.3.4:192.168.168.1:255.255.255.0:virtual:eth0:no'], 
['root', '/dev/sda1 ro'], ['args', '3']], 'on_poweroff': 'destroy', 
'cpus': None, 'name': 'slack-1', 'backend': [], 'vcpus': 1, 
'cpu_weight': 1.0, 'vcpu_avail': 1, 'memory': 48, 'device': [('vif', 
['vif', ['backend', '0'], ['script', 'vif-bridge'], ['mac', 
'00:16:3e:56:c2:5f']]), ('vbd', ['vbd', ['backend', '0'], ['dev', 
'sda1'], ['uname', 'file:/vds/root_fs'], ['mode', 'w']])], 'bootloader': 
None, 'cpu': None, 'maxmem': 48}
[2006-04-27 14:08:47 xend.XendDomainInfo] DEBUG (XendDomainInfo:1164) 
XendDomainInfo.construct: None 0
[2006-04-27 14:08:47 xend.XendDomainInfo] DEBUG (XendDomainInfo:671) 
Storing VM details: {'ssidref': '0', 'uuid': 
'404d7c42-5c61-502f-1108-6b50d4d942f8', 'on_reboot': 'restart', 'image': 
"(linux (kernel /boot/vmlinuz-2.6.16-xen) (ip 
192.168.168.222:1.2.3.4:192.168.168.1:255.255.255.0:virtual:eth0:no) 
(root '/dev/sda1 ro') (args 3))", 'on_poweroff': 'destroy', 'name': 
'slack-1', 'vcpus': '1', 'vcpu_avail': '1', 'memory': '48', 'on_crash': 
'restart', 'maxmem': '48'}
[2006-04-27 14:08:47 xend] DEBUG (DevController:103) DevController: 
writing {'backend-id': '0', 'mac': '00:16:3e:56:c2:5f', 'handle': '0', 
'state': '1', 'backend': '/local/domain/0/backend/vif/7/0'} to 
/local/domain/7/device/vif/0.
[2006-04-27 14:08:47 xend] DEBUG (DevController:105) DevController: 
writing {'mac': '00:16:3e:56:c2:5f', 'state': '1', 'handle': '0', 
'script': '/etc/xen/scripts/vif-bridge', 'frontend-id': '7', 'domain': 
'slack-1', 'frontend': '/local/domain/7/device/vif/0'} to 
/local/domain/0/backend/vif/7/0.
[2006-04-27 14:08:47 xend] DEBUG (DevController:103) DevController: 
writing {'virtual-device': '2049', 'backend-id': '0', 'state': '1', 
'backend': '/local/domain/0/backend/vbd/7/2049'} to 
/local/domain/7/device/vbd/2049.
[2006-04-27 14:08:47 xend] DEBUG (DevController:105) DevController: 
writing {'domain': 'slack-1', 'frontend': 
'/local/domain/7/device/vbd/2049', 'dev': 'sda1', 'state': '1', 
'params': '/vds/root_fs', 'mode': 'w', 'frontend-id': '7', 'type': 
'file'} to /local/domain/0/backend/vbd/7/2049.
[2006-04-27 14:08:47 xend.XendDomainInfo] DEBUG (XendDomainInfo:696) 
Storing domain details: {'console/port': '2', 'name': 'slack-1', 
'console/limit': '1048576', 'vm': 
'/vm/404d7c42-5c61-502f-1108-6b50d4d942f8', 'domid': '7', 
'cpu/0/availability': 'online', 'memory/target': '49152', 'store/port': '1'}
[2006-04-27 14:08:47 xend] DEBUG (balloon:126) Balloon: free 175; need 
57; done.
[2006-04-27 14:08:47 xend] DEBUG (XendCheckpoint:148) [xc_restore]: 
/usr/lib/xen/bin/xc_restore 11 4 7 14336 1 2
[2006-04-27 14:08:47 xend] ERROR (XendCheckpoint:227) xc_linux_restore 
start: max_pfn = 3800
[2006-04-27 14:08:47 xend] ERROR (XendCheckpoint:227) Increased domain 
reservation by e000 KB
[2006-04-27 14:08:47 xend] ERROR (XendCheckpoint:227) Reloading memory 
pages:   0%
[2006-04-27 14:08:52 xend] DEBUG (XendCheckpoint:200) store-mfn 49283
[2006-04-27 14:08:52 xend] DEBUG (XendCheckpoint:200) console-mfn 49282
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) Received all pages 
(0 races)
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:2100%
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) Memory reloaded.
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) Decreased 
reservation by 2048 pages
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) Domain ready to be 
built.
[2006-04-27 14:08:52 xend] ERROR (XendCheckpoint:227) Restore exit with rc=0
[2006-04-27 14:08:52 xend.XendDomainInfo] DEBUG (XendDomainInfo:648) 
XendDomainInfo.completeRestore
[2006-04-27 14:08:52 xend.XendDomainInfo] DEBUG (XendDomainInfo:696) 
Storing domain details: {'console/ring-ref': '49282', 'console/port': 
'2', 'name': 'slack-1', 'console/limit': '1048576', 'vm': 
'/vm/404d7c42-5c61-502f-1108-6b50d4d942f8', 'domid': '7', 
'cpu/0/availability': 'online', 'memory/target': '49152', 
'store/ring-ref': '49283', 'store/port': '1'}
[2006-04-27 14:08:52 xend.XendDomainInfo] DEBUG (XendDomainInfo:877) 
XendDomainInfo.handleShutdownWatch
[2006-04-27 14:08:52 xend.XendDomainInfo] DEBUG (XendDomainInfo:658) 
XendDomainInfo.completeRestore done
[2006-04-27 14:08:54 xend.XendDomainInfo] WARNING (XendDomainInfo:819) 
Domain has crashed: name=slack-1 id=7.
[2006-04-27 14:08:54 xend.XendDomainInfo] DEBUG (XendDomainInfo:1335) 
XendDomainInfo.destroyDomain(7)
..... and new machine boot log!
####

the strange part is "Domain has crashed: name=slack-1 id=7."

Sometime the migration completly fails beacuse I can connect to the new 
console but the domU system is freezed and I must restart the VM with 
"xm reboot slack-1".
You know this problem?

byebye
        nick

--
Nicola Bianchi
System Administrator


_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users