Re: [Xen-users] BUG: soft lockup - CPU#1 stuck for XXs!

[Michele Castigliego <subcomandante@xxxxxxxxxxx>]

Attached to this email there is sar -A output.
At 15:50 the system have had the soft lockup issue.


Tnx

Il giorno ven, 17/07/2009 alle 16.22 -0400, Peter Booth ha scritto:
> Can you attach sar -A output for the DomU?
> 
> Sent from my iPhone
> 
> On Jul 17, 2009, at 11:21 AM, Michele Castigliego <subcomandante@xxxxxxxxxxx 
>  > wrote:
> 
> > Hi all,
> > I'm having an issue on a fully virtualized DomU (Lenny with
> > 2.6.26-2-686) saying "BUG: soft lockup" on several daemons (apache2,
> > etc..) several times a day. Most of the time the guest does not freeze
> > but sometimes yes.
> > DomU is a bit loaded due to a website with a lot of users.
> >
> > Dom0 is Lenny 2.6.26-1-xen-686, xen-hypervisor-3.2-1-i386.
> >
> > Is this a well known problem? I cannot find any useful info on
> > Internet...
> >
> > Regards,
> > Michele Castigliego
> >
> >
> >
> > This is the DomU config:
> > kernel = '/usr/lib/xen-3.2-1/boot/hvmloader'
> > builder = 'hvm'
> > memory = '1024'
> > device_model='/usr/lib/xen-3.2-1/bin/qemu-dm'
> > # Disks
> > disk = [ 'file:/dfs/virtual/images/domu.img,ioemu:hda,w']
> > # Hostname
> > name = 'casshern'
> > vcpus=2
> >
> > # Networking
> > vif = ['type=ioemu, mac=xx:xx:xx:xx:xx:xx, model=rtl8139, bridge=br0']
> >
> > usbdevice="tablet"
> >
> > # Behaviour
> > # boot on floppy (a), hard disk (c) or CD-ROM (d)
> > # default: hard disk, cd-rom, floppy
> > boot='c'
> > vnc=1
> > vncviewer=1
> > vncunused=0
> > vnclisten="0.0.0.0"
> > vncdisplay=11
> > sdl=0
> > stdvga=0
> > serial='pty'
> >
> >
> >
> > I post below dmesg output example:
> > [218595.260615] BUG: soft lockup - CPU#1 stuck for 79s!  
> > [apache2:29210]
> > [218595.260615] Modules linked in: ipv6 loop joydev usbhid hid
> > ff_memless parport_pc parport serio_raw psmouse snd_pcsp snd_pcm
> > snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core evdev ext3  
> > jbd
> > mbcache ide_disk ata_generic libata scsi_mod dock 8139cp  
> > ide_pci_generic
> > floppy uhci_hcd 8139too mii usbcore piix ide_core thermal processor  
> > fan
> > thermal_sys
> > [218595.260615]
> > [218595.260615] Pid: 29210, comm: apache2 Tainted: G        W
> > (2.6.26-2-686 #1)
> > [218595.260615] EIP: 0060:[<c02b979b>] EFLAGS: 00000246 CPU: 1
> > [218595.260615] EIP is at _spin_unlock_irqrestore+0x7/0x10
> > [218595.260615] EAX: 00000246 EBX: 0001c218 ECX: 00080262 EDX:  
> > 00000246
> > [218595.260615] ESI: f7986be0 EDI: 00000246 EBP: f7986800 ESP:  
> > d3129df0
> > [218595.260615]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
> > [218595.260615] CR0: 8005003b CR2: b699fcc0 CR3: 37ac9000 CR4:  
> > 000006d0
> > [218595.260615] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3:  
> > 00000000
> > [218595.260615] DR6: ffff0ff0 DR7: 00000400
> > [218595.260615]  [<f883456b>] ? rtl8139_start_xmit+0xe7/0x10d  
> > [8139too]
> > [218595.260615]  [<c0258bb4>] ? dev_hard_start_xmit+0x1eb/0x24f
> > [218595.260615]  [<c0266c2a>] ? __qdisc_run+0xa8/0x17c
> > [218595.260615]  [<c025ad33>] ? dev_queue_xmit+0x19f/0x2bc
> > [218595.260615]  [<c0276525>] ? ip_finish_output+0x1c5/0x1fc
> > [218595.260615]  [<c02760b3>] ? ip_local_out+0x15/0x17
> > [218595.260615]  [<c0276ad5>] ? ip_queue_xmit+0x25b/0x29d
> > [218595.260615]  [<c01190c9>] ? hrtick_start_fair+0x82/0x12c
> > [218595.260615]  [<c0285010>] ? tcp_transmit_skb+0x6a2/0x6d5
> > [218595.260615]  [<c0285b39>] ? tcp_retransmit_skb+0x41f/0x515
> > [218595.260615]  [<c028781b>] ? tcp_write_timer+0x0/0x629
> > [218595.260615]  [<c0287ca4>] ? tcp_write_timer+0x489/0x629
> > [218595.260615]  [<c028781b>] ? tcp_write_timer+0x0/0x629
> > [218595.260615]  [<c01296bf>] ? run_timer_softirq+0x11a/0x17c
> > [218595.260615]  [<c028781b>] ? tcp_write_timer+0x0/0x629
> > [218595.260615]  [<c01265d9>] ? __do_softirq+0x66/0xd3
> > [218595.260615]  [<c012668b>] ? do_softirq+0x45/0x53
> > [218595.260615]  [<c0126942>] ? irq_exit+0x35/0x67
> > [218595.260615]  [<c01101c9>] ? smp_apic_timer_interrupt+0x6b/0x76
> > [218595.260615]  [<c0104364>] ? apic_timer_interrupt+0x28/0x30
> > [218595.260615]  [<c02b0000>] ? aer_probe+0x7d/0xff
> > [218595.260615]  =======================
> > [220760.234273] BUG: soft lockup - CPU#1 stuck for 83s! [swapper:0]
> > [220760.234273] Modules linked in: ipv6 loop joydev usbhid hid
> > ff_memless parport_pc parport serio_raw psmouse snd_pcsp snd_pcm
> > snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core evdev ext3  
> > jbd
> > mbcache ide_disk ata_generic libata scsi_mod dock 8139cp  
> > ide_pci_generic
> > floppy uhci_hcd 8139too mii usbcore piix ide_core thermal processor  
> > fan
> > thermal_sys
> > [220760.234273]
> > [220760.234273] Pid: 0, comm: swapper Tainted: G        W  
> > (2.6.26-2-686
> > #1)
> > [220760.234273] EIP: 0060:[<f8841928>] EFLAGS: 00000282 CPU: 1
> > [220760.234273] EIP is at ide_do_request+0x2d3/0x81b [ide_core]
> > [220760.234273] EAX: 0000000e EBX: f8853acc ECX: f8853a80 EDX:  
> > f7809e40
> > [220760.234273] ESI: f8853acc EDI: f7809e40 EBP: f78b199c ESP:  
> > f7475cbc
> > [220760.234273]  DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068
> > [220760.234273] CR0: 8005003b CR2: b6dad000 CR3: 03223000 CR4:  
> > 000006d0
> > [220760.234273] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3:  
> > 00000000
> > [220760.234273] DR6: ffff0ff0 DR7: 00000400
> > [220760.234273]  [<f8841310>] ? ide_end_request+0x56/0x5f [ide_core]
> > [220760.234273]  [<f8845927>] ? task_end_request+0x40/0x51 [ide_core]
> > [220760.234273]  [<f88420d6>] ? ide_intr+0x174/0x19b [ide_core]
> > [220760.234273]  [<c015209e>] ? handle_IRQ_event+0x23/0x51
> > [220760.234273]  [<c015328f>] ? handle_edge_irq+0xbf/0xfa
> > [220760.234273]  [<c0105f3a>] ? do_IRQ+0x4d/0x63
> > [220760.234273]  [<c01042a7>] ? common_interrupt+0x23/0x28
> > [220760.234273]  [<c02b979b>] ? _spin_unlock_irqrestore+0x7/0x10
> > [220760.234273]  [<f883456b>] ? rtl8139_start_xmit+0xe7/0x10d  
> > [8139too]
> > [220760.234273]  [<c0258bb4>] ? dev_hard_start_xmit+0x1eb/0x24f
> > [220760.234273]  [<c0266c2a>] ? __qdisc_run+0xa8/0x17c
> > [220760.234273]  [<c025ad33>] ? dev_queue_xmit+0x19f/0x2bc
> > [220760.234273]  [<c0276525>] ? ip_finish_output+0x1c5/0x1fc
> > [220760.234273]  [<c02760b3>] ? ip_local_out+0x15/0x17
> > [220760.234273]  [<c0276ad5>] ? ip_queue_xmit+0x25b/0x29d
> > [220760.234273]  [<c0134566>] ? ktime_get+0xd/0x21
> > [220760.234273]  [<c0119132>] ? hrtick_start_fair+0xeb/0x12c
> > [220760.234273]  [<c0285010>] ? tcp_transmit_skb+0x6a2/0x6d5
> > [220760.234273]  [<c01360bc>] ? getnstimeofday+0x37/0xbc
> > [220760.234273]  [<c0285b39>] ? tcp_retransmit_skb+0x41f/0x515
> > [220760.234273]  [<c028781b>] ? tcp_write_timer+0x0/0x629
> > [220760.234273]  [<c0287ca4>] ? tcp_write_timer+0x489/0x629
> > [220760.234273]  [<c011b6c5>] ? try_to_wake_up+0xe8/0xf1
> > [220760.234273]  [<c028781b>] ? tcp_write_timer+0x0/0x629
> > [220760.234273]  [<c01296bf>] ? run_timer_softirq+0x11a/0x17c
> > [220760.234273]  [<c028781b>] ? tcp_write_timer+0x0/0x629
> > [220760.234273]  [<c01265d9>] ? __do_softirq+0x66/0xd3
> > [220760.234273]  [<c012668b>] ? do_softirq+0x45/0x53
> > [220760.234273]  [<c0126942>] ? irq_exit+0x35/0x67
> > [220760.234273]  [<c0105f3f>] ? do_IRQ+0x52/0x63
> > [220760.234273]  [<c0102656>] ? default_idle+0x0/0x53
> > [220760.234273]  [<c01042a7>] ? common_interrupt+0x23/0x28
> > [220760.234273]  [<c0102656>] ? default_idle+0x0/0x53
> > [220760.234273]  [<c0114d68>] ? native_safe_halt+0x2/0x3
> > [220760.234273]  [<c0102683>] ? default_idle+0x2d/0x53
> > [220760.234273]  [<c01025ce>] ? cpu_idle+0xab/0xcb
> > [220760.234273]  =======================
> >
> >
> >
> > _______________________________________________
> > Xen-users mailing list
> > Xen-users@xxxxxxxxxxxxxxxxxxx
> > http://lists.xensource.com/xen-users
> 
> _______________________________________________
> Xen-users mailing list
> Xen-users@xxxxxxxxxxxxxxxxxxx
> http://lists.xensource.com/xen-users

Attachment: sar.txt
Description: Text document

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users