[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-users] Re: Problem with HVM domU and virtual disk image



On 6/19/2011 10:26 AM, Roger Pau Monnà wrote:
Just as a note in case someone comes up with the same issue, donât try
to install Ubuntu as HVM (11.04 amd64), it will fail to recognize the
hard disk and network card (at least in my case), Iâve lost almost a
week thinking it was a problem with Xen, and it turned out to be a
Ubuntu specific issue. Debian and FreeBSD work well under HVM.

Nod, I saw the same thing, and I hope they fix it in the next release. To work around it, you have to disable at least ACPI and possibly APIC, and set xen_platform_pci = 0 in the domU cfg. There's also some trickery that must be done during the install process to kill hung processes. All in all, it's a painful experience.

Debian Squeeze also doesn't install perfectly under HVM, IIRC, but just due to a glitch in the installer, and everything works fine after it's set up.

-John

Regards, Roger

2011/6/17 Roger Pau MonnÃ<roger.pau@xxxxxxxxxxxxx>:
Hello,

I'm trying to create a HVM machine with a Virtual Disk Image (created
using dd if=/dev/zero of=virtualdisk-root.img bs=1k seek=2048k
count=1) and attach it to a HVM domU using the following template:

#  -*- mode: python; -*-

import os, re

arch_libdir = 'lib'
arch = os.uname()[4]
if os.uname()[0] == 'Linux' and re.search('64', arch):
    arch_libdir = 'lib64'

kernel = "/usr/lib/xen/boot/hvmloader"

builder='hvm'

memory = 1024

name = "Ubuntu11"

vcpus=1

vif = [ 'type=ioemu, bridge=eth1' ]

disk = [ 'file:/home/xen/ubuntu-server.img,sda,w',
'file:/home/xen/ubuntu.iso,hdc:cdrom,w' ]
# I have to use sda because if I put hda the installer doesn't find the disk

device_model = '/usr/' + arch_libdir + '/xen/bin/qemu-dm'

boot="dc"

vnc=1
vnclisten="0.0.0.0"
vncpasswd='XXXX'

serial='pty'

localtime=1
usb=1
usbdevice='tablet'
keymap='es'

With this template I'm able to install the system to the disk, the
problem comes when I later on remove the CDROM (hdc) and try to boot
from sda. If I change the disk line to:

disk = [ 'file:/home/xen/ubuntu-server.img,sda,w' ]

The domU starts and closes, almost immediately. This is what xend says:

[2011-06-17 22:50:27 1925] DEBUG (XendDomainInfo:92)
XendDomainInfo.create(['vm', ['name', 'Ubuntu11'], ['memory', 1024],
['vcpus', 1], ['on_xend_start', 'ignore'], ['on_xend_stop', 'ignore'],
['image', ['hvm', ['kernel', '/usr/lib/xen/boot/hvmloader'],
['videoram', 4], ['device_model', '/usr/lib64/xen/bin/qemu-dm'],
['pae', 1], ['vcpus', 1], ['boot', 'c'], ['fda', ''], ['fdb', ''],
['timer_mode', 1], ['localtime', 0], ['serial', 'pty'], ['stdvga', 0],
['isa', 0], ['nographic', 0], ['soundhw', ''], ['vnc', 1],
['vncunused', 1], ['vnclisten', '0.0.0.0'], ['sdl', 0], ['xauthority',
'/root/.Xauthority'], ['rtc_timeoffset', 0], ['monitor', 0], ['acpi',
1], ['apic', 1], ['usb', 0], ['usbdevice', 'tablet'], ['keymap',
'es'], ['pci', []], ['hpet', 0], ['guest_os_type', 'default'], ['hap',
1], ['opengl', 1], ['cpuid', []], ['cpuid_check', []], ['viridian',
0], ['pci_msitranslate', 1], ['vpt_align', 1], ['pci_power_mgmt', 0],
['xen_platform_pci', 1], ['vncpasswd', 'XXXXXXXX']]], ['s3_integrity',
1], ['device', ['vbd', ['uname', 'file:/home/xen/ubuntu.img'], ['dev',
'sda'], ['mode', 'w']]], ['device', ['vif', ['bridge', 'eth1'],
['type', 'ioemu']]]])
[2011-06-17 22:50:27 1925] DEBUG (XendDomainInfo:2304)
XendDomainInfo.constructDomain
[2011-06-17 22:50:27 1925] DEBUG (balloon:166) Balloon: 49260500 KiB
free; need 4096; done.
[2011-06-17 22:50:27 1925] DEBUG (XendDomain:453) Adding Domain: 20
[2011-06-17 22:50:27 1925] DEBUG (XendDomainInfo:2505)
XendDomainInfo.initDomain: 20 256
[2011-06-17 22:50:27 1925] DEBUG (image:320) Stored a VNC password for
vfb access
[2011-06-17 22:50:27 1925] DEBUG (image:813) args: boot, val: c
[2011-06-17 22:50:27 1925] DEBUG (image:813) args: fda, val: None
[2011-06-17 22:50:27 1925] DEBUG (image:813) args: fdb, val: None
[2011-06-17 22:50:27 1925] DEBUG (image:813) args: soundhw, val: None
[2011-06-17 22:50:27 1925] DEBUG (image:813) args: localtime, val: 0
[2011-06-17 22:50:27 1925] DEBUG (image:813) args: serial, val: ['pty']
[2011-06-17 22:50:27 1925] DEBUG (image:813) args: std-vga, val: 0
[2011-06-17 22:50:27 1925] DEBUG (image:813) args: isa, val: 0
[2011-06-17 22:50:27 1925] DEBUG (image:813) args: acpi, val: 1
[2011-06-17 22:50:27 1925] DEBUG (image:813) args: usb, val: 0
[2011-06-17 22:50:27 1925] DEBUG (image:813) args: usbdevice, val: tablet
[2011-06-17 22:50:27 1925] INFO (image:749) Need to create platform
device.[domid:20]
[2011-06-17 22:50:27 1925] DEBUG (XendDomainInfo:2529)
_initDomain:shadow_memory=0x0, memory_static_max=0x40000000,
memory_static_min=0x0.
[2011-06-17 22:50:27 1925] DEBUG (balloon:166) Balloon: 49259088 KiB
free; need 1065984; done.
[2011-06-17 22:50:27 1925] INFO (image:173) buildDomain os=hvm dom=20 vcpus=1
[2011-06-17 22:50:27 1925] DEBUG (image:866) domid          = 20
[2011-06-17 22:50:27 1925] DEBUG (image:867) image          =
/usr/lib/xen/boot/hvmloader
[2011-06-17 22:50:27 1925] DEBUG (image:868) store_evtchn   = 2
[2011-06-17 22:50:27 1925] DEBUG (image:869) memsize        = 1024
[2011-06-17 22:50:27 1925] DEBUG (image:870) target         = 1024
[2011-06-17 22:50:27 1925] DEBUG (image:871) vcpus          = 1
[2011-06-17 22:50:27 1925] DEBUG (image:872) acpi           = 1
[2011-06-17 22:50:27 1925] DEBUG (image:873) apic           = 1
[2011-06-17 22:50:28 1925] INFO (XendDomainInfo:2168) createDevice:
vfb : {'vncunused': 1, 'other_config': {'vncunused': 1, 'vncpasswd':
'XXXXXXXX', 'vnclisten': '0.0.0.0', 'vnc': '1'}, 'vnc': '1', 'uuid':
'67fcbd39-211e-49d3-3cab-d2d708cb8241', 'vnclisten': '0.0.0.0',
'vncpasswd': 'XXXXXXXX'}
[2011-06-17 22:50:28 1925] DEBUG (DevController:95) DevController:
writing {'state': '1', 'backend-id': '0', 'backend':
'/local/domain/0/backend/vfb/20/0'} to /local/domain/20/device/vfb/0.
[2011-06-17 22:50:28 1925] DEBUG (DevController:97) DevController:
writing {'vncunused': '1', 'domain': 'Ubuntu11', 'frontend':
'/local/domain/20/device/vfb/0', 'uuid':
'67fcbd39-211e-49d3-3cab-d2d708cb8241', 'frontend-id': '20',
'vnclisten': '0.0.0.0', 'vncpasswd': 'XXXXXXXX', 'state': '1',
'online': '1', 'vnc': '1'} to /local/domain/0/backend/vfb/20/0.
[2011-06-17 22:50:28 1925] INFO (XendDomainInfo:2168) createDevice:
vbd : {'uuid': '8bc3e9f1-98f5-23f2-e35e-45a9926f2620', 'bootable': 1,
'driver': 'paravirtualised', 'dev': 'sda', 'uname':
'file:/home/xen/ubuntu.img', 'mode': 'w'}
[2011-06-17 22:50:28 1925] DEBUG (DevController:95) DevController:
writing {'backend-id': '0', 'virtual-device': '2048', 'device-type':
'disk', 'state': '1', 'backend':
'/local/domain/0/backend/vbd/20/2048'} to
/local/domain/20/device/vbd/2048.
[2011-06-17 22:50:28 1925] DEBUG (DevController:97) DevController:
writing {'domain': 'Ubuntu11', 'frontend':
'/local/domain/20/device/vbd/2048', 'uuid':
'8bc3e9f1-98f5-23f2-e35e-45a9926f2620', 'bootable': '1', 'dev': 'sda',
'state': '1', 'params': '/home/xen/ubuntu.img', 'mode': 'w', 'online':
'1', 'frontend-id': '20', 'type': 'file'} to
/local/domain/0/backend/vbd/20/2048.
[2011-06-17 22:50:28 1925] INFO (XendDomainInfo:2168) createDevice:
vif : {'bridge': 'eth1', 'mac': '00:16:3e:1f:f1:2e', 'type': 'ioemu',
'uuid': 'da093635-8d57-83fe-ac90-1b9457b9851e'}
[2011-06-17 22:50:28 1925] DEBUG (DevController:95) DevController:
writing {'state': '1', 'backend-id': '0', 'backend':
'/local/domain/0/backend/vif/20/0'} to /local/domain/20/device/vif/0.
[2011-06-17 22:50:28 1925] DEBUG (DevController:97) DevController:
writing {'bridge': 'eth1', 'domain': 'Ubuntu11', 'handle': '0',
'uuid': 'da093635-8d57-83fe-ac90-1b9457b9851e', 'script':
'/etc/xen/scripts/vif-bridge', 'mac': '00:16:3e:1f:f1:2e',
'frontend-id': '20', 'state': '1', 'online': '1', 'frontend':
'/local/domain/20/device/vif/0', 'type': 'ioemu'} to
/local/domain/0/backend/vif/20/0.
[2011-06-17 22:50:28 1925] INFO (image:394) spawning device models:
/usr/lib64/xen/bin/qemu-dm ['/usr/lib64/xen/bin/qemu-dm', '-d', '20',
'-domain-name', 'Ubuntu11', '-videoram', '4', '-k', 'es', '-vnc',
'0.0.0.0:0,password', '-vncunused', '-vcpus', '1', '-boot', 'c',
'-serial', 'pty', '-acpi', '-usbdevice', 'tablet', '-net',
'nic,vlan=1,macaddr=00:16:3e:1f:f1:2e,model=rtl8139', '-net',
'tap,vlan=1,ifname=tap20.0,bridge=eth1', '-M', 'xenfv']
[2011-06-17 22:50:28 1925] INFO (image:443) device model pid: 8604
[2011-06-17 22:50:28 1925] INFO (image:531) waiting for sentinel_fifo
[2011-06-17 22:50:28 1925] DEBUG (XendDomainInfo:3060) Storing VM
details: {'on_xend_stop': 'ignore', 'shadow_memory': '9', 'uuid':
'5966a28d-b2e1-2581-f2f7-ca4a512334a7', 'on_reboot': 'restart',
'start_time': '1308343828.26', 'on_poweroff': 'destroy',
'bootloader_args': '', 'on_xend_start': 'ignore', 'on_crash':
'restart', 'xend/restart_count': '0', 'vcpus': '1', 'vcpu_avail': '1',
'bootloader': '', 'image': '(hvm (kernel ) (timer_mode 1) (videoram 4)
(vnc 1) (vpt_align 1) (nographic 0) (hpet 0) (rtc_timeoffset 0)
(guest_os_type default) (vnclisten 0.0.0.0) (loader
/usr/lib/xen/boot/hvmloader) (pci ()) (pci_msitranslate 1) (apic 1)
(sdl 0) (serial pty) (xen_platform_pci 1) (hap 1) (monitor 0) (opengl
1) (device_model /usr/lib64/xen/bin/qemu-dm) (boot c) (pci_power_mgmt
0) (vncpasswd XXXXXX) (keymap es) (usbdevice tablet) (pae 1) (stdvga
0) (usb 0) (xauthority /root/.Xauthority) (isa 0) (viridian 0) (acpi
1) (vncunused 1) (localtime 0) (notes (SUSPEND_CANCEL 1)))', 'name':
'Ubuntu11'}
[2011-06-17 22:50:28 1925] DEBUG (XendDomainInfo:1622) Storing domain
details: {'console/port': '3', 'name': 'Ubuntu11', 'console/limit':
'1048576', 'store/port': '2', 'vm':
'/vm/5966a28d-b2e1-2581-f2f7-ca4a512334a7', 'domid': '20',
'image/suspend-cancel': '1', 'cpu/0/availability': 'online',
'memory/target': '1048576',
'control/platform-feature-multiprocessor-suspend': '1',
'store/ring-ref': '1044476', 'console/type': 'ioemu'}
[2011-06-17 22:50:28 1925] DEBUG (DevController:95) DevController:
writing {'state': '1', 'backend-id': '0', 'backend':
'/local/domain/0/backend/console/20/0'} to
/local/domain/20/device/console/0.
[2011-06-17 22:50:28 1925] DEBUG (DevController:97) DevController:
writing {'domain': 'Ubuntu11', 'frontend':
'/local/domain/20/device/console/0', 'uuid':
'354c5dd6-e79f-d2f1-4a95-123ca39de153', 'frontend-id': '20', 'state':
'1', 'location': '3', 'online': '1', 'protocol': 'vt100'} to
/local/domain/0/backend/console/20/0.
[2011-06-17 22:50:28 1925] DEBUG (XendDomainInfo:1709)
XendDomainInfo.handleShutdownWatch
[2011-06-17 22:50:28 1925] DEBUG (DevController:139) Waiting for devices vif.
[2011-06-17 22:50:28 1925] DEBUG (DevController:144) Waiting for 0.
[2011-06-17 22:50:28 1925] DEBUG (DevController:629)
hotplugStatusCallback /local/domain/0/backend/vif/20/0/hotplug-status.
[2011-06-17 22:50:28 1925] DEBUG (DevController:643) hotplugStatusCallback 1.
[2011-06-17 22:50:28 1925] DEBUG (DevController:139) Waiting for devices vkbd.
[2011-06-17 22:50:28 1925] DEBUG (DevController:139) Waiting for
devices ioports.
[2011-06-17 22:50:28 1925] DEBUG (DevController:139) Waiting for devices tap.
[2011-06-17 22:50:28 1925] DEBUG (DevController:139) Waiting for
devices console.
[2011-06-17 22:50:28 1925] DEBUG (DevController:144) Waiting for 0.
[2011-06-17 22:50:28 1925] DEBUG (DevController:139) Waiting for devices vscsi.
[2011-06-17 22:50:28 1925] DEBUG (DevController:139) Waiting for devices vbd.
[2011-06-17 22:50:28 1925] DEBUG (DevController:144) Waiting for 2048.
[2011-06-17 22:50:28 1925] DEBUG (DevController:629)
hotplugStatusCallback
/local/domain/0/backend/vbd/20/2048/hotplug-status.
[2011-06-17 22:50:28 1925] DEBUG (DevController:629)
hotplugStatusCallback
/local/domain/0/backend/vbd/20/2048/hotplug-status.
[2011-06-17 22:50:28 1925] DEBUG (DevController:643) hotplugStatusCallback 1.
[2011-06-17 22:50:28 1925] DEBUG (DevController:139) Waiting for devices irq.
[2011-06-17 22:50:28 1925] DEBUG (DevController:139) Waiting for devices vfb.
[2011-06-17 22:50:28 1925] DEBUG (DevController:139) Waiting for devices pci.
[2011-06-17 22:50:28 1925] DEBUG (DevController:139) Waiting for devices vtpm.
[2011-06-17 22:50:28 1925] INFO (XendDomain:1182) Domain Ubuntu11 (20) unpaused.
[2011-06-17 22:50:29 1925] INFO (XendDomainInfo:1903) Domain has
shutdown: name=Ubuntu11 id=20 reason=poweroff.
[2011-06-17 22:50:29 1925] DEBUG (XendDomainInfo:2732)
XendDomainInfo.destroy: domid=20
[2011-06-17 22:50:29 1925] DEBUG (XendDomainInfo:2207) Destroying device model
[2011-06-17 22:50:29 1925] INFO (image:556) Ubuntu11 device model terminated
[2011-06-17 22:50:29 1925] DEBUG (XendDomainInfo:2214) Releasing devices
[2011-06-17 22:50:29 1925] DEBUG (XendDomainInfo:2227) Removing vif/0
[2011-06-17 22:50:29 1925] DEBUG (XendDomainInfo:1134)
XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2011-06-17 22:50:29 1925] DEBUG (XendDomainInfo:2227) Removing console/0
[2011-06-17 22:50:29 1925] DEBUG (XendDomainInfo:1134)
XendDomainInfo.destroyDevice: deviceClass = console, device =
console/0
[2011-06-17 22:50:29 1925] DEBUG (XendDomainInfo:2227) Removing vbd/2048
[2011-06-17 22:50:29 1925] DEBUG (XendDomainInfo:1134)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/2048
[2011-06-17 22:50:29 1925] DEBUG (XendDomainInfo:2227) Removing vfb/0
[2011-06-17 22:50:29 1925] DEBUG (XendDomainInfo:1134)
XendDomainInfo.destroyDevice: deviceClass = vfb, device = vfb/0
[2011-06-17 22:50:29 1925] DEBUG (XendDomainInfo:2212) No device model
[2011-06-17 22:50:29 1925] DEBUG (XendDomainInfo:2214) Releasing devices

And qemu log:

domid: 20
qemu: the number of cpus is 1
config qemu network with xen bridge for  tap20.0 eth1
Watching /local/domain/0/device-model/20/logdirty/next-active
Watching /local/domain/0/device-model/20/command
char device redirected to /dev/pts/3
qemu_map_cache_init nr_buckets = 10000 size 4194304
shared page at pfn feffd
buffered io page at pfn feffb
Guest uuid = 5966a28d-b2e1-2581-f2f7-ca4a512334a7
Time offset set 0
populating video RAM at ff000000
mapping video RAM from ff000000
Register xen platform.
Done register platform.
xs_read(/vm/5966a28d-b2e1-2581-f2f7-ca4a512334a7/log-throttling): read error
platform_fixed_ioport: changed ro/rw state of ROM memory area. now is rw state.
xs_read(/local/domain/0/device-model/20/xen_extended_power_mgmt): read error
I/O request not ready: 0, ptr: 0, port: 0, data: 0, count: 0, size: 0
cirrus vga map change while on lfb mode
mapping vram to f0000000 - f0400000
platform_fixed_ioport: changed ro/rw state of ROM memory area. now is rw state.
platform_fixed_ioport: changed ro/rw state of ROM memory area. now is ro state.

If I replace sda with hda the domU boots the kernel, but cannot find
root disk and drops to initramfs, if I take a look at the devices in
/dev, there doesn't seem to be any kind of Disk (no hda, sda, or
xvda). Can someone give a hand with this? I've been struggling with
this issue for some time, and I cannot seem to be able to figure out
how to solve it.

Thanks and regards, Roger.

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users


_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users


 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.