[Xen-bugs] [Bug 460] New: Machine reboots after 5 hours of continous creation/destruction of a single VM

[bugzilla-daemon@xxxxxxxxxxxxxxxxxxx]

http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=460

           Summary: Machine reboots after 5 hours of continous
                    creation/destruction of a single VM
           Product: Xen
           Version: 2.0
          Platform: x86
        OS/Version: Linux-2.6
            Status: NEW
          Severity: blocker
          Priority: P1
         Component: Unspecified
        AssignedTo: xen-bugs@xxxxxxxxxxxxxxxxxxx
        ReportedBy: maiden1134@xxxxxxxxx


Detailed summary:  
Using XEN 2.07 on an AMD Opteron machine (FC3 minimal install), I ran a simple 
bash script that uses "xm" to create a new VM, sleep for 30 seconds, lists the 
VM, shuts down the same VM and lastly sleeps for 30 seconds/destroys the VM 
just in case. The loop is repeated 1 million times. After about 5 hours of 
operation, the machine rebooted on its own (I assume there was some sort of 
really bad crash in the kernel). I do not see any error messages in xend's log 
or the message log. This is 100% reproducable (3 out of 3 runs - although it 
takes several hours for the problem to appear).

I originally hit this problem with an application I had developed that creates 
and shuts down VMs under XEN using "xm". After running the application for 
about 10 hours, the machine rebooted on its own. I figured it was something 
related to XEN so that's when I created the test script described above and 
ran it overnight. It appears that something is going wrong most likely during 
creation/destruction of a VM. The funny thing is that it appears to be dying 
almost after the same amount of time between different runs (about 5 hours).

The script I used was the following (the VM I used boots and shuts down within 
30 seconds):
for (( i=0; i<1000000; i=i+1 ))
do
   xm create myvm.cfg
   sleep 30
   xm list
   xm shutdown myvm
   sleep 30
   xm destroy myvm
done

myvm.cfg VM config file (any VM boot image will do, bind it 
to /dev/loop1: "losetup <image file> /dev/loop1"):

name="myvm"
kernel="/boot/vmlinuz-2.6.11.12-xenU"
ramdisk="/boot/initrd-fc3.img"
memory=768
maxmem=768
cpu=0
hostname="myvm"
disk=[
     'phy:/dev/loop1,/dev/hda1,w'
     ]
nics=3
vif=[
    'mac=f2:00:03:01:01:00',
    'mac=f2:00:03:01:01:01',
    'mac=f2:00:03:01:01:02'
    ]
root="/dev/hda1"
 

Hardware details:

CPU info:
processor       : 0
vendor_id       : AuthenticAMD
cpu family      : 15
model           : 5
model name      : AMD Opteron(tm) Processor 240
stepping        : 1
cpu MHz         : 1394.577
cache size      : 1024 KB
fdiv_bug        : no
hlt_bug         : yes
f00f_bug        : no
coma_bug        : no
fpu             : yes
fpu_exception   : yes
cpuid level     : 1
wp              : yes
flags           : fpu tsc msr pae mce cx8 apic mtrr mca cmov pat pse36 clflush 
mmx fxsr sse sse2 pni syscall nx mmxext lm 3dnowext 3dnow
bogomips        : 2785.28

hwconf:
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] AMD-8111 ACPI"
vendorId: 1022
deviceId: 746b
subVendorId: 1022
subDeviceId: 746b
pciType: 1
pcidom:    0
pcibus:  0
pcidev:  7
pcifn:  3
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] AMD-8111 LPC"
vendorId: 1022
deviceId: 7468
subVendorId: 1022
subDeviceId: 7468
pciType: 1
pcidom:    0
pcibus:  0
pcidev:  7
pcifn:  0
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] AMD-8111 PCI"
vendorId: 1022
deviceId: 7460
subVendorId: 0000
subDeviceId: 0000
pciType: 1
pcidom:    0
pcibus:  0
pcidev:  6
pcifn:  0
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] AMD-8111 SMBus 2.0"
vendorId: 1022
deviceId: 746a
subVendorId: 1022
subDeviceId: 746a
pciType: 1
pcidom:    0
pcibus:  0
pcidev:  7
pcifn:  2
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] AMD-8131 PCI-X Bridge"
vendorId: 1022
deviceId: 7450
subVendorId: 0000
subDeviceId: 0000
pciType: 1
pcidom:    0
pcibus:  0
pcidev:  b
pcifn:  0
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] AMD-8131 PCI-X Bridge"
vendorId: 1022
deviceId: 7450
subVendorId: 0000
subDeviceId: 0000
pciType: 1
pcidom:    0
pcibus:  0
pcidev:  a
pcifn:  0
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] AMD-8131 PCI-X IOAPIC"
vendorId: 1022
deviceId: 7451
subVendorId: 1022
subDeviceId: 7451
pciType: 1
pcidom:    0
pcibus:  0
pcidev:  b
pcifn:  1
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] AMD-8131 PCI-X IOAPIC"
vendorId: 1022
deviceId: 7451
subVendorId: 1022
subDeviceId: 7451
pciType: 1
pcidom:    0
pcibus:  0
pcidev:  a
pcifn:  1
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map"
vendorId: 1022
deviceId: 1101
subVendorId: 0000
subDeviceId: 0000
pciType: 1
pcidom:    0
pcibus:  0
pcidev: 19
pcifn:  1
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map"
vendorId: 1022
deviceId: 1101
subVendorId: 0000
subDeviceId: 0000
pciType: 1
pcidom:    0
pcibus:  0
pcidev: 18
pcifn:  1
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller"
vendorId: 1022
deviceId: 1102
subVendorId: 0000
subDeviceId: 0000
pciType: 1
pcidom:    0
pcibus:  0
pcidev: 19
pcifn:  2
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller"
vendorId: 1022
deviceId: 1102
subVendorId: 0000
subDeviceId: 0000
pciType: 1
pcidom:    0
pcibus:  0
pcidev: 18
pcifn:  2
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport 
Technology Configuration"
vendorId: 1022
deviceId: 1100
subVendorId: 0000
subDeviceId: 0000
pciType: 1
pcidom:    0
pcibus:  0
pcidev: 19
pcifn:  0
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport 
Technology Configuration"
vendorId: 1022
deviceId: 1100
subVendorId: 0000
subDeviceId: 0000
pciType: 1
pcidom:    0
pcibus:  0
pcidev: 18
pcifn:  0
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Miscellaneous 
Control"
vendorId: 1022
deviceId: 1103
subVendorId: 0000
subDeviceId: 0000
pciType: 1
pcidom:    0
pcibus:  0
pcidev: 19
pcifn:  3
-
class: OTHER
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Miscellaneous 
Control"
vendorId: 1022
deviceId: 1103
subVendorId: 0000
subDeviceId: 0000
pciType: 1
pcidom:    0
pcibus:  0
pcidev: 18
pcifn:  3
-
class: NETWORK
bus: PCI
detached: 0
device: eth1
driver: tg3
desc: "Broadcom Corporation NetXtreme BCM5704 Gigabit Ethernet"
network.hwaddr: 00:E0:81:52:78:6D
vendorId: 14e4
deviceId: 1648
subVendorId: 14e4
subDeviceId: 1644
pciType: 1
pcidom:    0
pcibus:  2
pcidev:  9
pcifn:  1
-
class: NETWORK
bus: PCI
detached: 0
device: eth0
driver: tg3
desc: "Broadcom Corporation NetXtreme BCM5704 Gigabit Ethernet"
network.hwaddr: 00:E0:81:52:78:6C
vendorId: 14e4
deviceId: 1648
subVendorId: 14e4
subDeviceId: 1644
pciType: 1
pcidom:    0
pcibus:  2
pcidev:  9
pcifn:  0
-
class: MOUSE
bus: PSAUX
detached: 0
device: input/mice
driver: generic3ps/2
desc: "ImPS/2 Generic Wheel Mouse"
-
class: CDROM
bus: IDE
detached: 0
device: hdc
driver: ignore
desc: "CDU5211"
-
class: VIDEO
bus: PCI
detached: 0
driver: Card:ATI Mach64
desc: "ATI Technologies Inc Rage XL"
vendorId: 1002
deviceId: 4752
subVendorId: 1002
subDeviceId: 8008
pciType: 1
pcidom:    0
pcibus:  3
pcidev:  6
pcifn:  0
-
class: FLOPPY
bus: MISC
detached: 0
device: fd0
driver: unknown
desc: "3.5" 1.44MB floppy drive"
-
class: HD
bus: IDE
detached: 0
device: hda
driver: ignore
desc: "WDC WD800BB-00CAA1"
physical: 16383/16/63
logical: 65535/16/63
-
class: HD
bus: IDE
detached: 0
device: hdb
driver: ignore
desc: "WDC WD205BA"
physical: 16383/16/63
logical: 39770/16/63
-
class: KEYBOARD
bus: PSAUX
detached: 0
driver: ignore
desc: "AT Translated Set 2 keyboard"
-
class: USB
bus: PCI
detached: 0
driver: ohci-hcd
desc: "Advanced Micro Devices [AMD] AMD-8111 USB"
vendorId: 1022
deviceId: 7464
subVendorId: 1022
subDeviceId: 7464
pciType: 1
pcidom:    0
pcibus:  3
pcidev:  0
pcifn:  1
-
class: USB
bus: PCI
detached: 0
driver: ohci-hcd
desc: "Advanced Micro Devices [AMD] AMD-8111 USB"
vendorId: 1022
deviceId: 7464
subVendorId: 1022
subDeviceId: 7464
pciType: 1
pcidom:    0
pcibus:  3
pcidev:  0
pcifn:  0
-
class: IDE
bus: PCI
detached: 0
driver: unknown
desc: "Advanced Micro Devices [AMD] AMD-8111 IDE"
vendorId: 1022
deviceId: 7469
subVendorId: 1022
subDeviceId: 7469
pciType: 1
pcidom:    0
pcibus:  0
pcidev:  7
pcifn:  1

-- 
Configure bugmail: 
http://bugzilla.xensource.com/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

_______________________________________________
Xen-bugs mailing list
Xen-bugs@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-bugs