[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Xen-devel] Re: Post 2.6.21 pv-ops kernels hang Nahelem systems when domU is started - BUG: soft lockup - CPU#0 stuck for 61s! [swapper:0]


  • To: xen-devel@xxxxxxxxxxxxxxxxxxx
  • From: Bruce Edge <bruce.edge@xxxxxxxxx>
  • Date: Thu, 30 Sep 2010 09:56:37 -0700
  • Delivery-date: Thu, 30 Sep 2010 09:58:43 -0700
  • Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=r3dEmKN19VKrFRlEQBv1AD3ZkqypI50mvRw/GSJhzXqhodsCHMEYMkxfeI4f0cFh5D 2NkLft2Tj9JVnrXQ/t3FHs1+wycuB5zAwsqF9OEtDWxYXZy2jor96oWgS8HNU4bxeZtq 7eVpBzT04TL7Wh7PsUH1WwcTDhAYl2bz4aQvo=
  • List-id: Xen developer discussion <xen-devel.lists.xensource.com>

On Thu, Sep 30, 2010 at 7:31 AM, Bruce Edge <bruce.edge@xxxxxxxxx> wrote:
> I didn't report this earlier as I thought it must have been my fault
> as I pruned out a lot of modules from the pvops kernel. With the .23
> release and the same behavior with the same config that was working
> with 2.6.32.18, I felt I needed to report this now as I don't think
> it's my fault anymore.
>
> The dom0 boot's OK, bu hangs as soon as a pvops domU is started. The
> HVM domU is OK.
>
> On the domU I get:
>
> ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
> Ââ dpm-domu 6.0.15-01, with Linux 2.6.32.23-3-rollback-to-18-config    â
> Ââ Memory test (memtest86+) Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â â
> Ââ Memory test (memtest86+, serial console 115200) Â Â Â Â Â Â Â Â Â Â Â Ââ
> Ââ Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Ââ
> Ââ Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Ââ
> Ââ Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Ââ
> Ââ Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Ââ
> Ââ Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Ââ
> Âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
> Â Â Use the ^ and v keys to select which entry is highlighted.
> Â Â Press enter to boot the selected OS, 'e' to edit the
> Â Â commands before booting, 'a' to modify the kernel arguments
> Â Â before booting, or 'c' for a command line.
>
>
> Started domain dpm (id=1)
>
>
>
> The Dom0 console shows:
>
> (XEN) tmem: all pools frozen for all domains
> (XEN) tmem: all pools thawed for all domains
> (XEN) tmem: all pools frozen for all domains
> (XEN) tmem: all pools thawed for all domains
> mapping kernel into physical memory
> about to get started...
>
> <one minute passes...>
>
> [46287.941296] BUG: soft lockup - CPU#0 stuck for 61s! [swapper:0]
> [46353.441235] BUG: soft lockup - CPU#0 stuck for 61s! [swapper:0] one
> more of these every 60 sec.
> [46418.941235] BUG: soft lockup - CPU#0 stuck for 61s! [swapper:0]
>
>
> This is consistent with xen 4.1 and Â4.0.2rc1pre
>
> Kernel config and boot log attached.
>
> -Bruce
>

The xen console is still responsive. Attached is the '*' dump from xen
4.0.2.rc1pre after the dom0 hangs with the:
BUG: soft lockup - CPU#0 stuck for 61s! [swapper:0]
error.

Many of the CPUs have hpet_broadcast_exit on the stack. Is this
related to this patch:
http://lists.xensource.com/archives/html/xen-devel/2010-09/msg00556.html

Here are the CPU states:

(XEN) *** Dumping CPU0 host state: ***
(XEN) ----[ Xen-4.0.2-rc1-pre  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    0
(XEN) RIP:    e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010246   CONTEXT: hypervisor
(XEN) rax: 0000000000000000   rbx: 0000000000000080   rcx: 0000000000000000
(XEN) rdx: 0000000000000000   rsi: 000000000000000a   rdi: 0000000000000000
(XEN) rbp: ffff82c480367f28   rsp: ffff82c480367da8   r8:  0000000000010000
(XEN) r9:  000000000000ffff   r10: ffff83011fce0000   r11: 0000000000000400
(XEN) r12: ffff82c480375408   r13: ffff82c480367f28   r14: ffff82c480133ca0
(XEN) r15: ffff82c480380288   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 00000000c73ec000   cr2: ffff880035648fe8
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: 0000   cs: e008
(XEN) Xen stack trace from rsp=ffff82c480367da8:
(XEN)    0000000000000080 ffff82c4801111e2 ffff82c4802297c0 0000000000000065
(XEN)    ffff82c480375408 ffff82c480110818 0000008650a60b55 ffff82c4802298a0
(XEN)    000000000000002a ffff82c480367f28 ffff82c480367f28 ffff82c4801108d0
(XEN)    ffff82c480226de0 ffff82c480226e58 0000000000000296 ffff82c480135166
(XEN)    ffff82c48025e240 2a00000000000292 ffff82c480380260 ffff82c480226de0
(XEN)    ffff82c480367f28 0000000000000001 ffff82c480367f28 ffff82c48013472e
(XEN)    0000000000000005 ffff82c48025e9c0 0000000000000005 ffff82c48037a980
(XEN)    ffff83011fd80300 ffff82c480159632 ffff8300df772000 ffff82c400000000
(XEN)    ffff82c480367f28 ffff82c480367ed8 ffff82c480367f28 0000000000000000
(XEN)    ffff83011fd80334 ffff82c48037e980 ffff82c48037a980 ffff82c48011d77e
(XEN)    0000000000000246 ffff880010310040 ffff8800103089d0 00000000000001f4
(XEN)    ffff880035739e30 0000000000000000 0000000000000001 ffff82c480152400
(XEN)    0000000000000001 0000000000000000 ffff880035739e30 00000000000001f4
(XEN)    ffff8800103089d0 ffff880010310040 0000000000000001 0000000000000000
(XEN)    0000000000000001 0000000000000001 000000000000b018 0000000000000018
(XEN)    ffff880010305000 0000000000000000 ffff880010310040 000000f100000000
(XEN)    ffffffff8103b826 000000000000e033 0000000000000286 ffff880010308990
(XEN)    000000000000e02b 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 ffff8300df772000
(XEN) Xen call trace:
(XEN)    [<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c4801111e2>] dump_registers+0x52/0x110
(XEN)    [<ffff82c480110818>] run_all_keyhandlers+0x78/0xa0
(XEN)    [<ffff82c4801108d0>] handle_keypress+0x90/0xe0
(XEN)    [<ffff82c480135166>] serial_rx_interrupt+0x66/0xe0
(XEN)    [<ffff82c48013472e>] ns16550_interrupt+0x6e/0xd0
(XEN)    [<ffff82c480159632>] do_IRQ+0x562/0x6b0
(XEN)    [<ffff82c48011d77e>] __do_softirq+0x6e/0x90
(XEN)    [<ffff82c480152400>] common_interrupt+0x20/0x30
(XEN)
(XEN) *** Dumping CPU0 guest state: ***
(XEN) ----[ Xen-4.0.2-rc1-pre  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    0
(XEN) RIP:    e033:[<ffffffff8103b826>]
(XEN) RFLAGS: 0000000000000286   EM: 1   CONTEXT: pv guest
(XEN) rax: 000000000000b018   rbx: ffff880010310040   rcx: 0000000000000018
(XEN) rdx: ffff880010305000   rsi: 0000000000000000   rdi: ffff880010310040
(XEN) rbp: ffff8800103089d0   rsp: ffff880010308990   r8:  0000000000000001
(XEN) r9:  0000000000000001   r10: 0000000000000000   r11: 0000000000000001
(XEN) r12: 00000000000001f4   r13: ffff880035739e30   r14: 0000000000000000
(XEN) r15: 0000000000000001   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 00000000c73ec000   cr2: 00000000025fdd30
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: e02b   cs: e033
(XEN) Guest stack trace from rsp=ffff880010308990:
(XEN)    0000000000000001 00000000ffffffff 0000000000000001 0000000000000000
(XEN)    0000000000000000 ffff880035739e30 0000000000000000 0000000000000001
(XEN)    ffff8800103089e0 ffffffff81010d21 ffff8800103089f0 ffffffff8101c329
(XEN)    ffff880010308a10 ffffffff81098aed ffffffff818c0028 0000000000000000
(XEN)    ffff880010308a30 ffffffff81098b62 ffffffff818c5420 0000000000000002
(XEN)    ffff880010308b10 ffffffff810a9569 ffff880010308a50 0000000000000000
(XEN)    ffffffff818c5458 ffffffff00000001 ffff880010308ae0 00000039c3e99100
(XEN)    ffff880010315360 ffff880010308ae0 ffffffff818c5bf8 000000000000001d
(XEN)    ffff880010308ae0 ffffffff8103b84f 0000000000000001 ffffffffffffffff
(XEN)    0000000000000001 0000000000000001 ffffffff810106cd ffff880010308b40
(XEN)    ffffffff81010f42 0000000000000001 0000000000000000 ffffffff818c5420
(XEN)    0000000000000002 0000000000000000 0000000000000000 0000000000000000
(XEN)    ffff880010308b90 ffffffff810aa974 0000000000000000 ffffffff810e1502
(XEN)    0000000000000000 0000000000000000 0000000000000008 0000000000000154
(XEN)    00000000000003a0 0000000000000000 ffffffff81010f2f ffff880035739e18
(XEN)    ffff880035739e30 00000000000001dd 0000000000000001 0000000000000100
(XEN)    ffff880010308bc0 ffffffff815e1796 ffffffff810e1502 ffffffff815e15cb
(XEN)    ffff880035739da8 ffff880035739e18 ffff880010308bf0 ffffffff810e1502
(XEN)    0000000000000000 ffffffffff57a000 0000000000000000 0000000000000001
(XEN)    ffff880010308c70 ffffffff813af4bb ffffffff000001dd 00000000001d3150
(XEN)
(XEN) *** Dumping CPU1 host state: ***
(XEN) ----[ Xen-4.0.2-rc1-pre  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    1
(XEN) RIP:    e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010002   CONTEXT: hypervisor
(XEN) rax: ffff82c480111130   rbx: ffff82c48037a980   rcx: 0000000000000001
(XEN) rdx: 0000000000000080   rsi: 0000000000000002   rdi: 0000000000000000
(XEN) rbp: 0000000000000000   rsp: ffff83011fd67d88   r8:  0000000000000000
(XEN) r9:  0000000000000000   r10: 0000000000000001   r11: 0000000000000001
(XEN) r12: 0000000000d6d991   r13: 0000000000b516c5   r14: ffff82c48038df00
(XEN) r15: ffff82c48038de00   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 00000000df56c000   cr2: 0000000000000000
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: 0000   cs: e008
(XEN) Xen stack trace from rsp=ffff83011fd67d88:
(XEN)    ffff82c48037a980 ffff82c48016ccd2 ffff82c48025e9c0 ffff82c48016d3ef
(XEN)    ffff82c48025e9c0 ffff83010c827a90 ffff83010c827b20 ffff82c4801470ba
(XEN)    ffff82c48038de00 ffff82c48038df00 0000000000b516c5 0000000000d6d991
(XEN)    ffff83010c827b20 ffff83010c827a90 0000000000000001 0000000000000001
(XEN)    0000000000000000 0000000000000000 0000000000000002 0000000000000000
(XEN)    0000000000000240 0000000000000002 0000000000002000 000000fb00000000
(XEN)    ffff82c48018bda0 000000000000e008 0000000000000297 ffff83011fd67e78
(XEN)    0000000000000000 0000000000d6d991 ffff82c48018de9a ffff83011fd67f28
(XEN)    ffff82c480260110 ffff82c48037aa00 ffff82c48037aa00 ffffffffffffffff
(XEN)    ffff82c48037a980 0000000000000000 0000000000000000 000000018037a980
(XEN)    00001c8d0013b80a 000000fb00000000 ffff83011fd67f28 ffff82c48025eb00
(XEN)    ffff83011fd67f28 0000000000000001 ffff82c48038df00 ffff82c48038de00
(XEN)    ffff82c48014f0ce 0000000000000001 ffff83011fd67f28 0000000000000001
(XEN)    2bba2bbafc00fc00 7a7a7a7ab77cb77c a6bda6bd1ae41ae4 a075a075a050a050
(XEN)    3fa83fa8cb99cb99 7d577d57ea63ea63 62b062b0236e236e 39553955eb31eb31
(XEN)    2bba2bbafc00fc00 7a7a7a7ab77cb77c a6bda6bd1ae41ae4 ad47ad4796419641
(XEN)    259025908d148d14 f5e0f5e0c975c975 b872b872c2f1c2f1 06090609afa8afa8
(XEN)    cec2cec257315731 2d292d29b2b0b2b0 eb25eb2561486148 ad47ad4796419641
(XEN)    259025908d148d14 f5e0f5e0c975c975 b872b872c2f1c2f1 06090609afa8afa8
(XEN)    cec2cec257315731 2d292d2900000001 ffff8300df55e000
(XEN) Xen call trace:
(XEN)    [<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c48016ccd2>] __smp_call_function_interrupt+0x82/0x90
(XEN)    [<ffff82c48016d3ef>] smp_call_function_interrupt+0x4f/0x90
(XEN)    [<ffff82c4801470ba>] call_function_interrupt+0x2a/0x30
(XEN)    [<ffff82c48018bda0>] hpet_broadcast_exit+0x0/0x160
(XEN)    [<ffff82c48018de9a>] acpi_processor_idle+0x24a/0x820
(XEN)    [<ffff82c48014f0ce>] idle_loop+0x2e/0x90
(XEN)
(XEN) *** Dumping CPU1 guest state: ***
(XEN) No guest context (CPU is idle).
(XEN)
(XEN) *** Dumping CPU2 host state: ***
(XEN) ----[ Xen-4.0.2-rc1-pre  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    2
(XEN) RIP:    e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010002   CONTEXT: hypervisor
(XEN) rax: ffff82c480111130   rbx: ffff82c48037a980   rcx: 0000000000000001
(XEN) rdx: 0000000000000100   rsi: 0000000000000023   rdi: 0000000000000000
(XEN) rbp: 0000000000000000   rsp: ffff83011fd57d38   r8:  ffff8800042c3000
(XEN) r9:  0000000000000000   r10: ffff82c480200f20   r11: 0000000000000246
(XEN) r12: 0000000000000002   r13: ffffffff818bfd6f   r14: ffffffffffffffda
(XEN) r15: 0000000000000010   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 0000000109fb7000   cr2: ffff88000438b000
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: e010   cs: e008
(XEN) Xen stack trace from rsp=ffff83011fd57d38:
(XEN)    ffff82c48037a980 ffff82c48016ccd2 ffff82c48025e9c0 ffff82c48016d3ef
(XEN)    ffff82c48037a980 ffff83011fcfa000 0000000000000023 ffff82c4801470ba
(XEN)    0000000000000010 ffffffffffffffda ffffffff818bfd6f 0000000000000002
(XEN)    0000000000000023 ffff83011fcfa000 0000000000000246 ffff82c480200f20
(XEN)    0000000000000000 ffff8800042c3000 ffff8300df77c000 0000000000000000
(XEN)    ffff83011fd73fe0 0000000000000023 ffff8300df772000 000000fb00000000
(XEN)    ffff82c480107450 000000000000e008 0000000000000296 ffff83011fd57e28
(XEN)    000000000000e010 ffff82c480262100 ffff83010c95cf70 ffff8300c7624000
(XEN)    0000003a639c3914 ffff83010c95a180 ffff83010c95a000 ffff82c4801078ff
(XEN)    ffffffff818bfd08 ffffffff818bfd48 0000000000000000 ffff82c480107f64
(XEN)    ffff8300c7624000 0000000001c9c380 ffff82c480262100 ffff82c48011f5d7
(XEN)    ffff8300c7624000 0000000001c9c380 0000000000004000 ffff82c48037aa80
(XEN)    ffffffffffffffff ffff82c48037a980 ffff830100000002 ffff82c48037e980
(XEN)    ffff82c48037a980 ffff82c48011d770 0000000000000001 ffff8300c7624000
(XEN)    ffffffff818bfd48 0000000000000000 ffffffff818bfd6f ffff880000000000
(XEN)    0000000000000010 ffff82c4801eb169 0000000000000010 ffff880000000000
(XEN)    ffffffff818bfd6f 0000000000000000 ffffffff818bfd48 ffffffff818bfd08
(XEN)    0000000000000246 ffffffff818d0958 0000000000000000 ffff8800042c3000
(XEN)    0000000000000020 ffffffff8100940a 0000000000000800 ffffffff818bfd08
(XEN)    0000000000000004 0000010000000000 ffffffff8100940a 000000000000e033
(XEN) Xen call trace:
(XEN)    [<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c48016ccd2>] __smp_call_function_interrupt+0x82/0x90
(XEN)    [<ffff82c48016d3ef>] smp_call_function_interrupt+0x4f/0x90
(XEN)    [<ffff82c4801470ba>] call_function_interrupt+0x2a/0x30
(XEN)    [<ffff82c480107450>] evtchn_set_pending+0x10/0x1a0
(XEN)    [<ffff82c4801078ff>] evtchn_send+0xcf/0x140
(XEN)    [<ffff82c480107f64>] do_event_channel_op+0x5f4/0x1000
(XEN)    [<ffff82c48011f5d7>] timer_softirq_action+0x227/0x370
(XEN)    [<ffff82c48011d770>] __do_softirq+0x60/0x90
(XEN)    [<ffff82c4801eb169>] syscall_enter+0xa9/0xae
(XEN)
(XEN) *** Dumping CPU2 guest state: ***
(XEN) ----[ Xen-4.0.2-rc1-pre  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    2
(XEN) RIP:    e033:[<ffffffff8100940a>]
(XEN) RFLAGS: 0000000000000246   EM: 1   CONTEXT: pv guest
(XEN) rax: 0000000000000020   rbx: ffffffff818bfd08   rcx: ffffffff8100940a
(XEN) rdx: 0000000000000800   rsi: ffffffff818bfd08   rdi: 0000000000000004
(XEN) rbp: ffffffff818bfd48   rsp: ffffffff818bfcc0   r8:  ffff8800042c3000
(XEN) r9:  0000000000000000   r10: ffffffff818d0958   r11: 0000000000000246
(XEN) r12: 0000000000000000   r13: ffffffff818bfd6f   r14: ffff880000000000
(XEN) r15: 0000000000000010   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 0000000109fb7000   cr2: 0000000000000000
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: e02b   cs: e033
(XEN) Guest stack trace from rsp=ffffffff818bfcc0:
(XEN)    0000000000000009 ffffffff818bfd6f ffffffff813e375e ffffffff00000000
(XEN)    ffffffff818bfcec ffffffffffffffff 0000000000c46deb 0000003332373638
(XEN)    3d5d956d9796447f 0000000000000002 ffffffff818bfe6f ffffffff817db37f
(XEN)    0000000000000010 0000000000000022 0000000000000010 0000000000000000
(XEN)    ffffffff81c46def ffffffff818bfdb8 ffffffff813e26c1 0000006cffffffff
(XEN)    0000000000000000 302e30202020205b 2e205d3030303030 0000000000000000
(XEN)    3d5d956d9796447f ffffffff810106cd ffffffff81920c60 ffffffff8198fe98
(XEN)    00000000000014ef 0000000000000032 00000000ffffffff ffffffff818bfde8
(XEN)    ffffffff8106b5f5 0000000000001521 0000000000001521 0000000000001521
(XEN)    0000000000000000 ffffffff818bfe08 ffffffff8106b65a 0000000000000035
(XEN)    00000000ffffeadf ffffffff818bfe38 ffffffff8106bba4 ffffffff81c85943
(XEN)    0000000000000035 ffffffff818bfe68 0000000000000034 ffffffff818bfed8
(XEN)    ffffffff8106c176 ffffffff818bfe76 0000000000000200 0000000f825ba990
(XEN)    ffffffff818bfe77 302e30202020205b 00205d3030303030 ffffffff818bfea8
(XEN)    ffffffff810a6123 ffffffff00000000 ffffffff827090c0 ffffffffffffffff
(XEN)    3d5d956d9796447f ffffffff818bfeb8 ffffffff81bb0540 ffffffff81bb3d60
(XEN)    0000000000000000 ffffffffffffffff 0000000000000000 ffffffff818bff38
(XEN)    ffffffff815ddc14 ffffffff00000010 ffffffff818bff48 ffffffff818bff08
(XEN)    0000000000000000 ffffffffffffffff 0000000000008000 0000000000000000
(XEN)    0000000000000000 0000000000000002 0000000000000000 ffffffff818bff48
(XEN)
(XEN) *** Dumping CPU3 host state: ***
(XEN) ----[ Xen-4.0.2-rc1-pre  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    3
(XEN) RIP:    e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010002   CONTEXT: hypervisor
(XEN) rax: ffff82c480111130   rbx: ffff82c48037a980   rcx: 0000000000000001
(XEN) rdx: 0000000000000180   rsi: 0000000000000002   rdi: 0000000000000000
(XEN) rbp: 0000000000000000   rsp: ffff83011fd47d88   r8:  0000000000000000
(XEN) r9:  0000000000000001   r10: ffff82c480380450   r11: 0000000000000000
(XEN) r12: 0000000000ff1ba8   r13: 00000000009cb9d0   r14: ffff82c48038e100
(XEN) r15: ffff82c48038de00   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 00000000df56c000   cr2: 0000000000000000
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: 0000   cs: e008
(XEN) Xen stack trace from rsp=ffff83011fd47d88:
(XEN)    ffff82c48037a980 ffff82c48016ccd2 ffff82c48025e9c0 ffff82c48016d3ef
(XEN)    00000000007f31db ffff83010c826e00 ffff83010c826ec0 ffff82c4801470ba
(XEN)    ffff82c48038de00 ffff82c48038e100 00000000009cb9d0 0000000000ff1ba8
(XEN)    ffff83010c826ec0 ffff83010c826e00 0000000000000000 ffff82c480380450
(XEN)    0000000000000001 0000000000000000 0000000000000002 0000000000000000
(XEN)    0000000000000240 0000000000000002 0000000000006000 000000fb00000000
(XEN)    ffff82c48018bda0 000000000000e008 0000000000000297 ffff83011fd47e78
(XEN)    0000000000000000 0000000000ff1ba8 ffff82c48018de9a 0000000000000000
(XEN)    ffff82c480264110 ffff82c48037ab00 0000000000000100 ffff82c48037a980
(XEN)    ffff82c480171a24 0000000000000000 0000000000000000 00000000ffffffff
(XEN)    00000d11000b53c2 000000f900000000 ffff83011fd47f28 ffff82c48025eb00
(XEN)    ffff83011fd47f28 0000000000000003 ffff82c48038e100 ffff82c48038de00
(XEN)    ffff82c48014f0ce 0000000000000003 ffff83011fd47f28 0000000000000003
(XEN)    2bba2bbafc00fc00 7a7a7a7ab77cb77c 59425942e51be51b 5f8a5f8a5faf5faf
(XEN)    c057c05734663466 7d577d57ea63ea63 62b062b0236e236e c6aac6aa14ce14ce
(XEN)    2bba2bbafc00fc00 7a7a7a7ab77cb77c 59425942e51be51b ad47ad4796419641
(XEN)    259025908d148d14 0a1f0a1f368a368a 478d478d3d0e3d0e 06090609afa8afa8
(XEN)    cec2cec257315731 2d292d29b2b0b2b0 14da14da9eb79eb7 ad47ad4796419641
(XEN)    259025908d148d14 0a1f0a1f368a368a 478d478d3d0e3d0e 06090609afa8afa8
(XEN)    cec2cec257315731 2d292d2900000003 ffff8300df778000
(XEN) Xen call trace:
(XEN)    [<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c48016ccd2>] __smp_call_function_interrupt+0x82/0x90
(XEN)    [<ffff82c48016d3ef>] smp_call_function_interrupt+0x4f/0x90
(XEN)    [<ffff82c4801470ba>] call_function_interrupt+0x2a/0x30
(XEN)    [<ffff82c48018bda0>] hpet_broadcast_exit+0x0/0x160
(XEN)    [<ffff82c48018de9a>] acpi_processor_idle+0x24a/0x820
(XEN)    [<ffff82c480171a24>] local_time_calibration+0x1b4/0x1c0
(XEN)    [<ffff82c48014f0ce>] idle_loop+0x2e/0x90
(XEN)
(XEN) *** Dumping CPU3 guest state: ***
(XEN) No guest context (CPU is idle).
(XEN)
(XEN) *** Dumping CPU4 host state: ***
(XEN) ----[ Xen-4.0.2-rc1-pre  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    4
(XEN) RIP:    e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010002   CONTEXT: hypervisor
(XEN) rax: ffff82c480111130   rbx: ffff82c48037a980   rcx: 0000000000000001
(XEN) rdx: 0000000000000200   rsi: 0000000000000002   rdi: 0000000000000000
(XEN) rbp: 0000000000000000   rsp: ffff83011fd37d88   r8:  0000000000000000
(XEN) r9:  0000000000000001   r10: ffff82c480380480   r11: 0000000000000000
(XEN) r12: 00000000000d89ca   r13: 00000000009cb9c1   r14: ffff82c48038e200
(XEN) r15: ffff82c48038de00   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 00000000df56c000   cr2: 0000000000000000
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: 0000   cs: e008
(XEN) Xen stack trace from rsp=ffff83011fd37d88:
(XEN)    ffff82c48037a980 ffff82c48016ccd2 ffff82c48025e9c0 ffff82c48016d3ef
(XEN)    0000000000c0267b ffff83010c8257d0 ffff83010c825890 ffff82c4801470ba
(XEN)    ffff82c48038de00 ffff82c48038e200 00000000009cb9c1 00000000000d89ca
(XEN)    ffff83010c825890 ffff83010c8257d0 0000000000000000 ffff82c480380480
(XEN)    0000000000000001 0000000000000000 0000000000000002 0000000000000000
(XEN)    0000000000000240 0000000000000002 0000000000008000 000000fb00000000
(XEN)    ffff82c48018bda0 000000000000e008 0000000000000297 ffff83011fd37e78
(XEN)    0000000000000000 00000000000d89ca ffff82c48018de9a ffff83011fd37f28
(XEN)    ffff82c480266110 ffff82c48037ab80 0000000000000100 ffff82c48037a980
(XEN)    ffff82c480171a24 0000000000000000 0000000000000000 00000000ffffffff
(XEN)    00000d110007429f 000000f900000000 ffff83011fd37f28 ffff82c48025eb00
(XEN)    ffff83011fd37f28 0000000000000004 ffff82c48038e200 ffff82c48038de00
(XEN)    ffff82c48014f0ce 0000000000000004 ffff83011fd37f28 0000000000000004
(XEN)    2bba2bbafc00fc00 7a7a7a7ab77cb77c a6bda6bd1ae41ae4 5f8a5f8a5faf5faf
(XEN)    3fa83fa8cb99cb99 82a882a8159c159c 9d4f9d4fdc91dc91 c6aac6aa14ce14ce
(XEN)    2bba2bbafc00fc00 7a7a7a7ab77cb77c a6bda6bd1ae41ae4 ad47ad4796419641
(XEN)    259025908d148d14 0a1f0a1f368a368a b872b872c2f1c2f1 f9f6f9f650575057
(XEN)    313d313da8cea8ce d2d6d2d64d4f4d4f 14da14da9eb79eb7 ad47ad4796419641
(XEN)    259025908d148d14 0a1f0a1f368a368a b872b872c2f1c2f1 f9f6f9f650575057
(XEN)    313d313da8cea8ce d2d6d2d600000004 ffff8300df2fa000
(XEN) Xen call trace:
(XEN)    [<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c48016ccd2>] __smp_call_function_interrupt+0x82/0x90
(XEN)    [<ffff82c48016d3ef>] smp_call_function_interrupt+0x4f/0x90
(XEN)    [<ffff82c4801470ba>] call_function_interrupt+0x2a/0x30
(XEN)    [<ffff82c48018bda0>] hpet_broadcast_exit+0x0/0x160
(XEN)    [<ffff82c48018de9a>] acpi_processor_idle+0x24a/0x820
(XEN)    [<ffff82c480171a24>] local_time_calibration+0x1b4/0x1c0
(XEN)    [<ffff82c48014f0ce>] idle_loop+0x2e/0x90
(XEN)
(XEN) *** Dumping CPU4 guest state: ***
(XEN) No guest context (CPU is idle).
(XEN)
(XEN) *** Dumping CPU5 host state: ***
(XEN) ----[ Xen-4.0.2-rc1-pre  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    5
(XEN) RIP:    e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010002   CONTEXT: hypervisor
(XEN) rax: ffff82c480111130   rbx: ffff82c48037a980   rcx: 0000000000000001
(XEN) rdx: 0000000000000280   rsi: 0000000000000002   rdi: 0000000000000000
(XEN) rbp: 0000000000000000   rsp: ffff83011fd2fd88   r8:  0000000000000000
(XEN) r9:  0000000000000001   r10: ffff82c4803804b0   r11: 0000000000000001
(XEN) r12: 00000000001bf94f   r13: 0000000000b52901   r14: ffff82c48038e300
(XEN) r15: ffff82c48038de00   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 00000000df56c000   cr2: 0000000000000000
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: 0000   cs: e008
(XEN) Xen stack trace from rsp=ffff83011fd2fd88:
(XEN)    ffff82c48037a980 ffff82c48016ccd2 ffff82c48025e9c0 ffff82c48016d3ef
(XEN)    0000000000b516c1 ffff83010c824340 ffff83010c824400 ffff82c4801470ba
(XEN)    ffff82c48038de00 ffff82c48038e300 0000000000b52901 00000000001bf94f
(XEN)    ffff83010c824400 ffff83010c824340 0000000000000001 ffff82c4803804b0
(XEN)    0000000000000001 0000000000000000 0000000000000002 0000000000000000
(XEN)    0000000000000240 0000000000000002 000000000000a000 000000fb00000000
(XEN)    ffff82c48018bda0 000000000000e008 0000000000000297 ffff83011fd2fe78
(XEN)    0000000000000000 00000000001bf94f ffff82c48018de9a ffff83011fd2ff28
(XEN)    ffff82c480268110 ffff82c48037ac00 ffff82c48037ac00 ffffffffffffffff
(XEN)    ffff82c48037a980 0000000000000000 0000000000000000 000000008037a980
(XEN)    0000176e000fb957 000000f900000000 ffff83011fd2ff28 ffff82c48025eb00
(XEN)    ffff83011fd2ff28 0000000000000005 ffff82c48038e300 ffff82c48038de00
(XEN)    ffff82c48014f0ce 0000000000000005 ffff83011fd2ff28 0000000000000005
(XEN)    1b7b1b7b2a942a94 18b218b203b603b6 87498749052d052d 2acd2acd93f393f3
(XEN)    aedaaeda2e372e37 6dc46dc4351e351e da8cda8c28222822 96c296c2dc7bdc7b
(XEN)    1b7b1b7b2a942a94 18b218b203b603b6 87498749052d052d d800d8005a1d5a1d
(XEN)    b4e2b4e268ba68ba 1a8c1a8ce9f7e9f7 004e004ec9bdc9bd a99ea99e98e298e2
(XEN)    01fc01fc7e5a7e5a 4fe14fe1067a067a cad1cad17e817e81 d800d8005a1d5a1d
(XEN)    b4e2b4e268ba68ba 1a8c1a8ce9f7e9f7 004e004ec9bdc9bd a99ea99e98e298e2
(XEN)    01fc01fc7e5a7e5a 4fe14fe100000005 ffff8300df2f8000
(XEN) Xen call trace:
(XEN)    [<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c48016ccd2>] __smp_call_function_interrupt+0x82/0x90
(XEN)    [<ffff82c48016d3ef>] smp_call_function_interrupt+0x4f/0x90
(XEN)    [<ffff82c4801470ba>] call_function_interrupt+0x2a/0x30
(XEN)    [<ffff82c48018bda0>] hpet_broadcast_exit+0x0/0x160
(XEN)    [<ffff82c48018de9a>] acpi_processor_idle+0x24a/0x820
(XEN)    [<ffff82c48014f0ce>] idle_loop+0x2e/0x90
(XEN)
(XEN) *** Dumping CPU5 guest state: ***
(XEN) No guest context (CPU is idle).
(XEN)
(XEN) *** Dumping CPU6 host state: ***
(XEN) ----[ Xen-4.0.2-rc1-pre  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    6
(XEN) RIP:    e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010002   CONTEXT: hypervisor
(XEN) rax: ffff82c480111130   rbx: ffff82c48037a980   rcx: 0000000000000001
(XEN) rdx: 0000000000000300   rsi: 0000000000000002   rdi: 0000000000000000
(XEN) rbp: 0000000000000000   rsp: ffff83011fd1fd88   r8:  0000000000000000
(XEN) r9:  0000000000000000   r10: 0000000000000001   r11: 0000000000000001
(XEN) r12: 00000000002a17c9   r13: 0000000000c54ce7   r14: ffff82c48038e400
(XEN) r15: ffff82c48038de00   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 00000000df56c000   cr2: 0000000000000000
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: 0000   cs: e008
(XEN) Xen stack trace from rsp=ffff83011fd1fd88:
(XEN)    ffff82c48037a980 ffff82c48016ccd2 ffff82c48025e9c0 ffff82c48016d3ef
(XEN)    0000000000c534c2 ffff83010c824b60 ffff83010c824bf0 ffff82c4801470ba
(XEN)    ffff82c48038de00 ffff82c48038e400 0000000000c54ce7 00000000002a17c9
(XEN)    ffff83010c824bf0 ffff83010c824b60 0000000000000001 0000000000000001
(XEN)    0000000000000000 0000000000000000 0000000000000002 0000000000000000
(XEN)    0000000000000240 0000000000000002 000000000000c000 000000fb00000000
(XEN)    ffff82c48018bda0 000000000000e008 0000000000000297 ffff83011fd1fe78
(XEN)    0000000000000000 00000000002a17c9 ffff82c48018de9a ffff83011fd1ff28
(XEN)    ffff82c48026a110 ffff82c48037ac80 ffff82c48037ac80 ffffffffffffffff
(XEN)    ffff82c48037a980 0000000000000000 0000000000000000 000000018037a980
(XEN)    000001fe00000149 000000f900000000 ffff83011fd1ff28 ffff82c48025eb00
(XEN)    ffff83011fd1ff28 0000000000000006 ffff82c48038e400 ffff82c48038de00
(XEN)    ffff82c48014f0ce 0000000000000006 ffff83011fd1ff28 0000000000000006
(XEN)    e484e484d56bd56b 18b218b203b603b6 87498749052d052d d532d5326c0c6c0c
(XEN)    aedaaeda2e372e37 6dc46dc4351e351e da8cda8c28222822 693d693d23842384
(XEN)    e484e484d56bd56b 18b218b203b603b6 87498749052d052d 27ff27ffa5e2a5e2
(XEN)    b4e2b4e268ba68ba e573e57316081608 ffb1ffb136423642 56615661671d671d
(XEN)    fe03fe0381a581a5 4fe14fe1067a067a cad1cad17e817e81 27ff27ffa5e2a5e2
(XEN)    b4e2b4e268ba68ba e573e57316081608 ffb1ffb136423642 56615661671d671d
(XEN)    fe03fe0381a581a5 4fe14fe100000006 ffff8300df776000
(XEN) Xen call trace:
(XEN)    [<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c48016ccd2>] __smp_call_function_interrupt+0x82/0x90
(XEN)    [<ffff82c48016d3ef>] smp_call_function_interrupt+0x4f/0x90
(XEN)    [<ffff82c4801470ba>] call_function_interrupt+0x2a/0x30
(XEN)    [<ffff82c48018bda0>] hpet_broadcast_exit+0x0/0x160
(XEN)    [<ffff82c48018de9a>] acpi_processor_idle+0x24a/0x820
(XEN)    [<ffff82c48014f0ce>] idle_loop+0x2e/0x90
(XEN)
(XEN) *** Dumping CPU6 guest state: ***
(XEN) No guest context (CPU is idle).
(XEN)
(XEN) *** Dumping CPU7 host state: ***
(XEN) ----[ Xen-4.0.2-rc1-pre  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    7
(XEN) RIP:    e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010002   CONTEXT: hypervisor
(XEN) rax: ffff82c480111130   rbx: ffff82c48037a980   rcx: 0000000000000001
(XEN) rdx: 0000000000000380   rsi: 0000000000000002   rdi: 0000000000000000
(XEN) rbp: 0000000000000000   rsp: ffff83011fd0fd88   r8:  0000000000000000
(XEN) r9:  0000000000000000   r10: 0000000000000001   r11: 0000000000000001
(XEN) r12: 0000000000383753   r13: 0000000000ff1bcd   r14: ffff82c48038e500
(XEN) r15: ffff82c48038de00   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 00000000df56c000   cr2: 0000000000000000
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: 0000   cs: e008
(XEN) Xen stack trace from rsp=ffff83011fd0fd88:
(XEN)    ffff82c48037a980 ffff82c48016ccd2 ffff82c48025e9c0 ffff82c48016d3ef
(XEN)    ffff82c48025e9c0 ffff830108823520 ffff8301088235b0 ffff82c4801470ba
(XEN)    ffff82c48038de00 ffff82c48038e500 0000000000ff1bcd 0000000000383753
(XEN)    ffff8301088235b0 ffff830108823520 0000000000000001 0000000000000001
(XEN)    0000000000000000 0000000000000000 0000000000000002 0000000000000000
(XEN)    0000000000000240 0000000000000002 000000000000e000 000000fb00000000
(XEN)    ffff82c48018bda0 000000000000e008 0000000000000297 ffff83011fd0fe78
(XEN)    0000000000000000 0000000000383753 ffff82c48018de9a ffff83011fd0ff28
(XEN)    ffff82c48026c110 ffff82c48037ad00 ffff82c48037ad00 ffffffffffffffff
(XEN)    ffff82c48037a980 0000000000000000 0000000000000000 000000018037a980
(XEN)    000008720009ee92 000000f900000000 ffff83011fd0ff28 ffff82c48025eb00
(XEN)    ffff83011fd0ff28 0000000000000007 ffff82c48038e500 ffff82c48038de00
(XEN)    ffff82c48014f0ce 0000000000000007 ffff83011fd0ff28 0000000000000007
(XEN)    1b7b1b7b2a942a94 18b218b203b603b6 87498749052d052d d532d5326c0c6c0c
(XEN)    51255125d1c8d1c8 6dc46dc4351e351e 25732573d7ddd7dd 693d693d23842384
(XEN)    1b7b1b7b2a942a94 18b218b203b603b6 87498749052d052d d800d8005a1d5a1d
(XEN)    b4e2b4e268ba68ba 1a8c1a8ce9f7e9f7 ffb1ffb136423642 a99ea99e98e298e2
(XEN)    01fc01fc7e5a7e5a b01eb01ef985f985 cad1cad17e817e81 d800d8005a1d5a1d
(XEN)    b4e2b4e268ba68ba 1a8c1a8ce9f7e9f7 ffb1ffb136423642 a99ea99e98e298e2
(XEN)    01fc01fc7e5a7e5a b01eb01e00000007 ffff8300df774000
(XEN) Xen call trace:
(XEN)    [<ffff82c480111131>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c48016ccd2>] __smp_call_function_interrupt+0x82/0x90
(XEN)    [<ffff82c48016d3ef>] smp_call_function_interrupt+0x4f/0x90
(XEN)    [<ffff82c4801470ba>] call_function_interrupt+0x2a/0x30
(XEN)    [<ffff82c48018bda0>] hpet_broadcast_exit+0x0/0x160
(XEN)    [<ffff82c48018de9a>] acpi_processor_idle+0x24a/0x820
(XEN)    [<ffff82c48014f0ce>] idle_loop+0x2e/0x90
(XEN)

-Bruce

Attachment: screenlog.10
Description: Binary data

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel

 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.