[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-devel] Test report for xen-unstable and qemu-xen



And domain dies, migration not completed:
[ 1826.587110] PM: late freeze of devices complete after 0.048 msecs
[ 1826.591220] ------------[ cut here ]------------
[ 1826.591220] kernel BUG at
/build/buildd-linux_3.2.41-2-amd64-Wvc92F/linux-3.2.41/drivers/xen/events.c:1489!
[ 1826.591220] invalid opcode: 0000 [#1] SMP
[ 1826.591220] CPU 0
[ 1826.591220] Modules linked in: xenfs snd_pcm snd_page_alloc
snd_timer snd coretemp soundcore crc32c_intel evdev
ghash_clmulni_intel joydev pcspkr cryptd ext3 mbcache jbd xen_netfront
xen_blkfront
[ 1826.591220]
[ 1826.591220] Pid: 6, comm: migration/0 Not tainted 3.2.0-4-amd64 #1
Debian 3.2.41-2
[ 1826.591220] RIP: e030:[<ffffffff8121c4e2>]  [<ffffffff8121c4e2>]
xen_irq_resume+0xbd/0x28b
[ 1826.591220] RSP: e02b:ffff88001ae99d20  EFLAGS: 00010082
[ 1826.591220] RAX: ffffffffffffffef RBX: 0000000000000000 RCX: 0000000000000001
[ 1826.591220] RDX: 0000000000000000 RSI: 00000000deadbeef RDI: 00000000deadbeef
[ 1826.591220] RBP: 0000000000000000 R08: ffff88001f026e00 R09: ffff88001ae99d48
[ 1826.591220] R10: 0000000000013780 R11: 0000000000013780 R12: 0000000000000010
[ 1826.591220] R13: 0000000000010dd0 R14: 0000000000010d70 R15: 0000000000000000
[ 1826.591220] FS:  00007f8d6f4907a0(0000) GS:ffff88001fc00000(0000)
knlGS:0000000000000000
[ 1826.591220] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 1826.591220] CR2: 00007f51210a1e60 CR3: 00000000032af000 CR4: 0000000000002660
[ 1826.591220] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1826.591220] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 1826.591220] Process migration/0 (pid: 6, threadinfo
ffff88001ae98000, task ffff88001ae8e0c0)
[ 1826.591220] Stack:
[ 1826.591220]  0000000000013780 0000000000000000 ffff880000000000
0000000000010d70
[ 1826.591220]  0000160000000000 0000000000000000 ffff88001affbddc
ffffffff810050a2
[ 1826.591220]  0000000000013780 ffffea000009f0b8 ffffffff810043e3
ffff88001affbe40
[ 1826.591220] Call Trace:
[ 1826.591220]  [<ffffffff810050a2>] ? xen_mc_issue+0x3e/0x50
[ 1826.591220]  [<ffffffff810043e3>] ? arch_local_irq_restore+0x7/0x8
[ 1826.591220]  [<ffffffff8121ca3b>] ? xen_suspend+0x73/0x8b
[ 1826.591220]  [<ffffffff81087d89>] ? stop_machine_cpu_stop+0x89/0xc3
[ 1826.591220]  [<ffffffff81087d00>] ? queue_stop_cpus_work+0xa5/0xa5
[ 1826.591220]  [<ffffffff81087b5a>] ? cpu_stopper_thread+0xea/0x177
[ 1826.591220]  [<ffffffff810359d7>] ? arch_local_irq_enable+0x7/0x8
[ 1826.591220]  [<ffffffff81039854>] ? finish_task_switch+0x88/0xb9
[ 1826.591220]  [<ffffffff8134c634>] ? __schedule+0x5ac/0x5c3
[ 1826.591220]  [<ffffffff81087a70>] ? cpu_stop_signal_done+0x2a/0x2a
[ 1826.591220]  [<ffffffff8105f321>] ? kthread+0x76/0x7e
[ 1826.591220]  [<ffffffff81354ab4>] ? kernel_thread_helper+0x4/0x10
[ 1826.591220]  [<ffffffff81352b73>] ? int_ret_from_sys_call+0x7/0x1b
[ 1826.591220]  [<ffffffff8134dcbc>] ? retint_restore_args+0x5/0x6
[ 1826.591220]  [<ffffffff81354ab0>] ? gs_change+0x13/0x13
[ 1826.591220] Code: 74 79 44 89 e7 e8 77 ee ff ff 39 e8 74 02 0f 0b
48 8d 74 24 28 bf 01 00 00 00 89 6c 24 28 89 5c 24 2c e8 19 ec ff ff
85 c0 74 02 <0f> 0b 8b 44 24 30 44 89 e7 89 44 24 14 e8 58 e9 ff ff 0f
b7 4c
[ 1826.591220] RIP  [<ffffffff8121c4e2>] xen_irq_resume+0xbd/0x28b
[ 1826.591220]  RSP <ffff88001ae99d20>
[ 1826.591220] ---[ end trace 60605833d257c851 ]---
[ 1826.591220] ------------[ cut here ]------------
[ 1826.591220] WARNING: at
/build/buildd-linux_3.2.41-2-amd64-Wvc92F/linux-3.2.41/kernel/time/timekeeping.c:265
ktime_get+0x1e/0x86()
[ 1826.591220] Modules linked in: xenfs snd_pcm snd_page_alloc
snd_timer snd coretemp soundcore crc32c_intel evdev
ghash_clmulni_intel joydev pcspkr cryptd ext3 mbcache jbd xen_netfront
xen_blkfront
[ 1826.591220] Pid: 0, comm: swapper/0 Tainted: G      D
3.2.0-4-amd64 #1 Debian 3.2.41-2
[ 1826.591220] Call Trace:
[ 1826.591220]  [<ffffffff81046a55>] ? warn_slowpath_common+0x78/0x8c
[ 1826.591220]  [<ffffffff81066447>] ? ktime_get+0x1e/0x86
[ 1826.591220]  [<ffffffff8106c21b>] ? tick_nohz_stop_sched_tick+0x61/0x327
[ 1826.591220]  [<ffffffff8100d210>] ? cpu_idle+0x72/0xf2
[ 1826.591220]  [<ffffffff816abb36>] ? start_kernel+0x3b8/0x3c3
[ 1826.591220]  [<ffffffff816ad4d9>] ? xen_start_kernel+0x412/0x418
[ 1826.591220] ---[ end trace 60605833d257c852 ]---

2013/5/14 Vasiliy Tolstov <v.tolstov@xxxxxxxxx>:
> Dom0:
> linux 3.9.0
>
> xen:
> latest from git
>
> domain config (plain):
> name='"21-10887"'
> kernel='"/usr/lib/xen/boot/pv-grub-x86_64.gz"'
> vif='["mac=00:16:3e:00:20:3b,ip=62.76.191.124"]'
> disk='["phy:/dev/disk/vbd/21-885,xvda,w"]'
> memory=512
> maxmem=4096
> vcpus=7
> maxvcpus=7
> cpu_cap=700
> cpu_weight=512
> vfb='["type=vnc,vnclisten=0.0.0.0,vncpasswd=0a7cwrZEb9"]'
> extra='"(hd0,0)/boot/grub/menu.lst root=/dev/xvda1 selinux=1
> enforcing=0 iommu=soft earlyprintk=xen console=hvc0"'
> on_restart='"destroy"'
> cpuid='"host,x2apic=0,aes=0,xsave=0,avx=0"'
>
> domain config from xl list -l:
> [
>     {
>         "domid": 1,
>         "config": {
>             "c_info": {
>                 "type": "pv",
>                 "hap": "<default>",
>                 "oos": "<default>",
>                 "ssidref": 0,
>                 "name": "21-10887",
>                 "uuid": "0657b941-07b6-457f-8bcf-9488bd8e2827",
>                 "xsdata": {
>
>                 },
>                 "platformdata": {
>
>                 },
>                 "poolid": 0,
>                 "run_hotplug_scripts": "True"
>             },
>             "b_info": {
>                 "max_vcpus": 7,
>                 "avail_vcpus": [
>                     0,
>                     1,
>                     2,
>                     3,
>                     4,
>                     5,
>                     6
>                 ],
>                 "cpumap": [
>
>                 ],
>                 "nodemap": [
>
>                 ],
>                 "numa_placement": "<default>",
>                 "tsc_mode": "default",
>                 "max_memkb": 4194304,
>                 "target_memkb": 524288,
>                 "video_memkb": -1,
>                 "shadow_memkb": 39936,
>                 "rtc_timeoffset": 0,
>                 "exec_ssidref": 0,
>                 "localtime": "<default>",
>                 "disable_migrate": "<default>",
>                 "cpuid": [
>                     {
>                         "leaf": 1,
>                         "ecx": "xxx0x00xxx0xxxxxxxxxxxxxxxxxxxxx"
>                     }
>                 ],
>                 "blkdev_start": null,
>                 "device_model_version": null,
>                 "device_model_stubdomain": "<default>",
>                 "device_model": null,
>                 "device_model_ssidref": 0,
>                 "extra": [
>
>                 ],
>                 "extra_pv": [
>
>                 ],
>                 "extra_hvm": [
>
>                 ],
>                 "sched_params": {
>                     "sched": "unknown",
>                     "weight": 512,
>                     "cap": -1,
>                     "period": -1,
>                     "slice": -1,
>                     "latency": -1,
>                     "extratime": -1
>                 },
>                 "ioports": [
>
>                 ],
>                 "irqs": [
>
>                 ],
>                 "iomem": [
>
>                 ],
>                 "claim_mode": "False",
>                 "u": {
>                     "kernel": "/usr/lib/xen/boot/pv-grub-x86_64.gz",
>                     "slack_memkb": -1,
>                     "bootloader": null,
>                     "bootloader_args": [
>
>                     ],
>                     "cmdline": "(hd0,0)/boot/grub/menu.lst
> root=/dev/xvda1 selinux=1 enforcing=0 iommu=soft earlyprintk=xen
> console=hvc0",
>                     "ramdisk": null,
>                     "e820_host": "<default>"
>                 }
>             },
>             "disks": [
>                 {
>                     "backend_domid": 0,
>                     "backend_domname": null,
>                     "pdev_path": "/dev/disk/vbd/21-885",
>                     "vdev": "xvda",
>                     "backend": "unknown",
>                     "format": "raw",
>                     "script": null,
>                     "removable": 0,
>                     "readwrite": 1,
>                     "is_cdrom": 0
>                 }
>             ],
>             "nics": [
>                 {
>                     "backend_domid": 0,
>                     "backend_domname": null,
>                     "devid": 0,
>                     "mtu": 0,
>                     "model": null,
>                     "mac": "00:16:3e:00:20:3b",
>                     "ip": "62.76.191.124",
>                     "bridge": null,
>                     "ifname": null,
>                     "script": "/etc/xen/scripts/vif-route",
>                     "nictype": null,
>                     "rate_bytes_per_interval": 0,
>                     "rate_interval_usecs": 0,
>                     "gatewaydev": null
>                 }
>             ],
>             "pcidevs": [
>
>             ],
>             "vfbs": [
>                 {
>                     "backend_domid": 0,
>                     "backend_domname": null,
>                     "devid": 0,
>                     "vnc": {
>                         "enable": "<default>",
>                         "listen": "0.0.0.0",
>                         "passwd": "0a7cwrZEb9",
>                         "display": 0,
>                         "findunused": "<default>"
>                     },
>                     "sdl": {
>                         "enable": "<default>",
>                         "opengl": "<default>",
>                         "display": null,
>                         "xauthority": null
>                     },
>                     "keymap": null
>                 }
>             ],
>             "vkbs": [
>                 {
>                     "backend_domid": 0,
>                     "backend_domname": null,
>                     "devid": 0
>                 }
>             ],
>             "vtpms": [
>
>             ],
>             "on_poweroff": "destroy",
>             "on_reboot": "restart",
>             "on_watchdog": "destroy",
>             "on_crash": "destroy"
>         }
>     }
> ]
>
> Issues:
> Very slow migration speed. Domain tries to migrate is about 30 minutes
> and nothing happened
> I'm migrate via infiniband 40 Gb/s
>
> Progress is:
> xl migrate --debug 21-10887 192.168.25.28
> the global config option vifscript is deprecated, please switch to
> vif.default.script
> the global config option vifscript is deprecated, please switch to
> vif.default.script
> migration target: Ready to receive domain.
> Saving to migration stream new xl format (info 0x0/0x0/587)
> Loading new save file <incoming migration stream> (new xl fmt info 
> 0x0/0x0/587)
>  Savefile contains xl domain config
> xc: progress: Reloading memory pages: 53248/1048576    5%
> xc: progress: Reloading memory pages: 105472/1048576   10%
> xc: progress: Reloading memory pages: 157621/1048576   15%
>
> --
> Vasiliy Tolstov,
> e-mail: v.tolstov@xxxxxxxxx
> jabber: vase@xxxxxxxxx



-- 
Vasiliy Tolstov,
e-mail: v.tolstov@xxxxxxxxx
jabber: vase@xxxxxxxxx

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
http://lists.xen.org/xen-devel


 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.