[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-users] xl create argument issue with disk config



Thanks for the advice!

I can find the new device in xenstore-ls, but the OS code cannot read it out. Is it possible to *remove* some xenstore nodes, if the code is too wrong?

I can see that the new devices are created, from xenstore-ls.

Below is the output from one run of Ethos OS, with xl -vvv. It will crash and destroy the domain, so I won't see xenstore stuff afterwards. But it looks to me that the devices are added.
Note that I added code to read vif1, vif0, then vbd, and got output below. (My apology if I dumped too much stuff here.)

Reading xenstore nodes:

device/vif/1 StatusNotFound
device/vif/0 StatusOk
device/vbd StatusOk


[yl@torpedo test]$ sudo -E ethosRun client
ethosRun console client netInterface=
shadowdaemon -l 11112 -r 11112 -d client/rootfs
netInterfaceBind: local ip/port xxxxx
tunneCreateIncoming: successfully created tunnel
 ÂcryptoKeyType = CryptoKeyNone ÂtunnelId = 0x0
 Âlocal  Âmac = 00:00:00:00:00:00  Âip = xxxxxxxx  Âudp = 11112  isOdd = 1
 Âremote  mac = 00:00:00:00:00:00  Âip = 169.254.2.1  Âudp = 11112  Ânonce = 0
 ÂidPublicKey    Â= 0000000000000000000000000000000000000000000000000000000000000000
 Âlocal.publicKey  Â= 0000000000000000000000000000000000000000000000000000000000000000
 Âremote.publicKey  = 0000000000000000000000000000000000000000000000000000000000000000
 ÂsymmetricKey    = 0000000000000000000000000000000000000000000000000000000000000000Â
OK: ethosNetUp has already run
xl -vvv create /dev/null -p vif=['mac=aa:00:00:00:00:01,ip=169.254.2.1','mac=aa:00:00:00:00:02,ip=169.254.2.2'] kernel='/var/lib/xen/images/ethos.x86_64.elf' name='client.ethos' ramdisk='/var/lib/xen/images/initialStore.x86_64.tar' memory='256' disk=['file:/home/yl/test/disk.img,sda,w'] >
Waiting for Ethos to start...
Parsing config from /dev/null
libxl: verbose: libxl_create.c:130:libxl__domain_build_info_setdefault: qemu-xen is unavailable, use qemu-xen-traditional instead: No such file or directory
libxl: debug: libxl_create.c:1246:do_domain_create: ao 0x17eb050: create: how=(nil) callback=(nil) poller=0x17eaaa0 Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â
libxl: debug: libxl_device.c:257:libxl__device_disk_set_backend: Disk vdev=sda spec.backend=unknown                                                                      Â
libxl: debug: libxl_device.c:197:disk_try_backend: Disk vdev=sda, backend phy unsuitable as phys path not a block devic                                                            Âe                                                                                                                       Â
libxl: debug: libxl_device.c:212:disk_try_backend: Disk vdev=sda, backend tap unsuitable because blktap not available                                                             Â
libxl: debug: libxl_device.c:296:libxl__device_disk_set_backend: Disk vdev=sda, using backend qdisk                                                                      Â
libxl: debug: libxl_create.c:699:initiate_domain_create: running bootloader                                                                                  Â
libxl: debug: libxl_bootloader.c:327:libxl__bootloader_run: no bootloader configured, using user supplied kernel                                                               ÂÂ
libxl: debug: libxl_event.c:608:libxl__ev_xswatch_deregister: watch w=0x17e9338: deregister unregistered                                                                   ÂÂ
libxl: debug: libxl_numa.c:478:libxl__get_numa_candidate: New best NUMA placement candidate found: nr_nodes=1, nr_cpus= Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â8, nr_vcpus=9, free_memkb=479 Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â
libxl: detail: libxl_dom.c:195:numa_place_domain: NUMA placement candidate with 1 nodes, 8 cpus and 479 KB free selecte                                                            Âd                                                                                                                       Â
domainbuilder: detail: xc_dom_allocate: cmdline=" sd.port=11112 .mac=fe:ff:ff:ff:ff:ff .ip=xxxxxxxx ÂipShadowDaemo                                                            Ân=169.254.2.1 ipNetwork=169.254.2.2", features="(null)"                                                                                            Â
libxl: debug: libxl_dom.c:341:libxl__build_pv: pv kernel mapped 0 path /var/lib/xen/images/ethos.x86_64.elf                                                                  Â
                                                                                                                       Â
domainbuilder: detail: xc_dom_kernel_file: filename="/var/lib/xen/images/ethos.x86_64.elf" Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â ÂÂ
domainbuilder: detail: xc_dom_malloc_filemap  Â: 690 kB                                                                                           ÂÂ
domainbuilder: detail: xc_dom_ramdisk_file: filename="/var/lib/xen/images/initialStore.x86_64.tar" Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â ÂÂ
domainbuilder: detail: xc_dom_malloc_filemap  Â: 700 kB                                                                                           ÂÂ
domainbuilder: detail: xc_dom_boot_xen_init: ver 4.3, caps xen-3.0-x86_64 xen-3.0-x86_32p                                                                           Â
domainbuilder: detail: xc_dom_parse_image: called                                                                                               Â
domainbuilder: detail: xc_dom_find_loader: trying multiboot-binary loader ... Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â
domainbuilder: detail: loader probe failed                                                                                                  ÂÂ
domainbuilder: detail: xc_dom_find_loader: trying Linux bzImage loader ... Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â ÂÂ
domainbuilder: detail: xc_dom_probe_bzimage_kernel: kernel is not a bzImage                                                                                  Â
domainbuilder: detail: loader probe failed                                                                                                  ÂÂ
domainbuilder: detail: xc_dom_find_loader: trying ELF-generic loader ... Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â ÂÂ
domainbuilder: detail: loader probe OK Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â ÂÂ
xc: detail: elf_parse_binary: phdr: paddr=0xffffffff80000000 memsz=0x30643c                                                                                  Â
xc: detail: elf_parse_binary: memory: 0xffffffff80000000 -> 0xffffffff8030643c                                                                                ÂÂ
xc: detail: elf_xen_parse: __xen_guest: "GUEST_OS=Ethos,XEN_VER=xen-3.0,VIRT_BASE=0xffffffff80000000,ELF_PADDR_OFFSET=0 Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Âxffffffff80000000,VIRT_ENTRY=0xffffffff80000000,HYPERCALL_PAGE=0x2,BSD_SYMTAB=yes,LOADER=generic" Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â
xc: detail: elf_xen_parse_guest_info: GUEST_OS="Ethos" Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â ÂÂ
xc: detail: elf_xen_parse_guest_info: XEN_VER="xen-3.0" Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â
xc: detail: elf_xen_parse_guest_info: VIRT_BASE="0xffffffff80000000" Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â ÂÂ
xc: detail: elf_xen_parse_guest_info: ELF_PADDR_OFFSET="0xffffffff80000000" Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â
xc: detail: elf_xen_parse_guest_info: VIRT_ENTRY="0xffffffff80000000"
xc: detail: elf_xen_parse_guest_info: HYPERCALL_PAGE="0x2"
xc: detail: elf_xen_parse_guest_info: BSD_SYMTAB="yes"
xc: detail: elf_xen_parse_guest_info: LOADER="generic"
xc: detail: elf_xen_addr_calc_check: addresses:
xc: detail:   virt_base    Â= 0xffffffff80000000
xc: detail: Â Â elf_paddr_offset = 0xffffffff80000000
xc: detail:   virt_offset   Â= 0x0
xc: detail:   virt_kstart   Â= 0xffffffff80000000
xc: detail:   virt_kend    Â= 0xffffffff80320f40
xc: detail:   virt_entry    = 0xffffffff80000000
xc: detail:   p2m_base     = 0xffffffffffffffff
domainbuilder: detail: xc_dom_load_elf_symtab/parse: bsd_symtab_start=ffffffff80320f40, kernel.end=0xffffffff80320f40 -- symtab=0xffffffff80320f44, maxaddr=0xffffffff80321288
domainbuilder: detail: xc_dom_load_elf_symtab: h=10 symtab, size=0xe5e0, maxaddr=0xffffffff8032f868
domainbuilder: detail: xc_dom_load_elf_symtab: h=11 strtab, size=0xc170, maxaddr=0xffffffff8033b9d8
domainbuilder: detail: xc_dom_parse_elf_kernel: xen-3.0-x86_64: 0xffffffff80000000 -> 0xffffffff8033b9d8
domainbuilder: detail: xc_dom_mem_init: mem 256 MB, pages 0x10000 pages, 4k each
domainbuilder: detail: xc_dom_mem_init: 0x10000 pages
domainbuilder: detail: xc_dom_boot_mem_init: called
domainbuilder: detail: x86_compat: guest xen-3.0-x86_64, address size 64
domainbuilder: detail: xc_dom_malloc      Â: 512 kB
domainbuilder: detail: xc_dom_build_image: called
domainbuilder: detail: xc_dom_alloc_segment:  kernel    : 0xffffffff80000000 -> 0xffffffff8033c000 Â(pfn 0x0 + 0x33c pages)
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x0+0x33c at 0x7f4ebd1c3000
xc: detail: elf_load_binary: phdr 0 at 0x7f4ebd1c3000 -> 0x7f4ebd254f14
xc: detail: elf_load_bsdsyms: shdr 9 at 0x7f4ebfa050af -> 0x7f4ebd4c9788
xc: detail: elf_load_bsdsyms: shdr 10 at 0x7f4ebfa05418 -> 0x7f4ebd4c97f0
xc: detail: elf_load_bsdsyms: shdr 11 at 0x7f4ebfa139f8 -> 0x7f4ebd4d7dd0
domainbuilder: detail: xc_dom_load_elf_symtab/load: bsd_symtab_start=ffffffff80320f40, kernel.end=0xffffffff8033c000 -- symtab=0xffffffff80320f44, maxaddr=0xffffffff80321288
domainbuilder: detail: xc_dom_load_elf_symtab: h=10 symtab, size=0xe5e0, maxaddr=0xffffffff8032f868
domainbuilder: detail: xc_dom_load_elf_symtab: h=11 strtab, size=0xc170, maxaddr=0xffffffff8033b9d8
domainbuilder: detail: xc_dom_alloc_segment:  ramdisk   Â: 0xffffffff8033c000 -> 0xffffffff803eb000 Â(pfn 0x33c + 0xaf pages)
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x33c+0xaf at 0x7f4ebd114000
domainbuilder: detail: xc_dom_alloc_segment:  phys2mach  Â: 0xffffffff803eb000 -> 0xffffffff8046b000 Â(pfn 0x3eb + 0x80 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x3eb+0x80 at 0x7f4ebd094000
domainbuilder: detail: xc_dom_alloc_page  :  start info  : 0xffffffff8046b000 (pfn 0x46b)
domainbuilder: detail: xc_dom_alloc_page  :  xenstore   : 0xffffffff8046c000 (pfn 0x46c)
domainbuilder: detail: xc_dom_alloc_page  :  console   Â: 0xffffffff8046d000 (pfn 0x46d)
domainbuilder: detail: nr_page_tables: 0x0000ffffffffffff/48: 0xffff000000000000 -> 0xffffffffffffffff, 1 table(s)
domainbuilder: detail: nr_page_tables: 0x0000007fffffffff/39: 0xffffff8000000000 -> 0xffffffffffffffff, 1 table(s)
domainbuilder: detail: nr_page_tables: 0x000000003fffffff/30: 0xffffffff80000000 -> 0xffffffffbfffffff, 1 table(s)
domainbuilder: detail: nr_page_tables: 0x00000000001fffff/21: 0xffffffff80000000 -> 0xffffffff807fffff, 4 table(s)
domainbuilder: detail: xc_dom_alloc_segment: Â page tables Â: 0xffffffff8046e000 -> 0xffffffff80475000 Â(pfn 0x46e + 0x7 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x46e+0x7 at 0x7f4ebfa2f000
domainbuilder: detail: xc_dom_alloc_page  :  boot stack  : 0xffffffff80475000 (pfn 0x475)
domainbuilder: detail: xc_dom_build_image Â: virt_alloc_end : 0xffffffff80476000
domainbuilder: detail: xc_dom_build_image Â: virt_pgtab_end : 0xffffffff80800000
domainbuilder: detail: xc_dom_boot_image: called
domainbuilder: detail: arch_setup_bootearly: doing nothing
domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_64 <= matches
domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_32p
domainbuilder: detail: xc_dom_update_guest_p2m: dst 64bit, pages 0x10000
domainbuilder: detail: clear_page: pfn 0x46d, mfn 0x1c19ef
domainbuilder: detail: clear_page: pfn 0x46c, mfn 0x1cd72c
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x46b+0x1 at 0x7f4ebfa38000
domainbuilder: detail: start_info_x86_64: called
domainbuilder: detail: setup_hypercall_page: vaddr=0xffffffff80002000 pfn=0x2
domainbuilder: detail: domain builder memory footprint
domainbuilder: detail: Â Âallocated
domainbuilder: detail:    malloc       : 542 kB
domainbuilder: detail:    anon mmap     Â: 0 bytes
domainbuilder: detail: Â Âmapped
domainbuilder: detail:    file mmap     Â: 1390 kB
domainbuilder: detail:    domU mmap     Â: 4556 kB
domainbuilder: detail: arch_setup_bootlate: shared_info: pfn 0x0, mfn 0xac88f
domainbuilder: detail: shared_info_x86_64: called
domainbuilder: detail: vcpu_x86_64: called
domainbuilder: detail: vcpu_x86_64: cr3: pfn 0x46e mfn 0x1c19ee
domainbuilder: detail: launch_vm: called, ctxt=0x7ffc7c047990
domainbuilder: detail: xc_dom_release: called
libxl: debug: libxl_device.c:257:libxl__device_disk_set_backend: Disk vdev=sda spec.backend=qdisk
libxl: debug: libxl_device.c:257:libxl__device_disk_set_backend: Disk vdev=sda spec.backend=qdisk
libxl: debug: libxl_device.c:257:libxl__device_disk_set_backend: Disk vdev=sda spec.backend=qdisk
libxl: debug: libxl_device.c:257:libxl__device_disk_set_backend: Disk vdev=sda spec.backend=qdisk
libxl: debug: libxl_device.c:257:libxl__device_disk_set_backend: Disk vdev=sda spec.backend=qdisk
libxl: debug: libxl_dm.c:1228:libxl__spawn_local_dm: Spawning device-model /usr/lib/xen/bin/qemu-dm with arguments:
libxl: debug: libxl_dm.c:1230:libxl__spawn_local_dm: Â /usr/lib/xen/bin/qemu-dm
libxl: debug: libxl_dm.c:1230:libxl__spawn_local_dm: Â -d
libxl: debug: libxl_dm.c:1230:libxl__spawn_local_dm: Â 15
libxl: debug: libxl_dm.c:1230:libxl__spawn_local_dm: Â -domain-name
libxl: debug: libxl_dm.c:1230:libxl__spawn_local_dm: Â client.ethos
libxl: debug: libxl_dm.c:1230:libxl__spawn_local_dm: Â -vnc
libxl: debug: libxl_dm.c:1230:libxl__spawn_local_dm: Â none
libxl: debug: libxl_dm.c:1230:libxl__spawn_local_dm: Â -nographic
libxl: debug: libxl_dm.c:1230:libxl__spawn_local_dm: Â -M
libxl: debug: libxl_dm.c:1230:libxl__spawn_local_dm: Â xenpv
libxl: debug: libxl_event.c:559:libxl__ev_xswatch_register: watch w=0x17e9570 wpath=/local/domain/0/device-model/15/state token=3/0: register slotnum=3
libxl: debug: libxl_create.c:1259:do_domain_create: ao 0x17eb050: inprogress: poller=0x17eaaa0, flags=i
libxl: debug: libxl_event.c:503:watchfd_callback: watch w=0x17e9570 wpath=/local/domain/0/device-model/15/state token=3/0: event epath=/local/domain/0/device-model/15/state
Bootstrapping Ethos...
Ethos kernel version: 0.9.11 (Master event loop)
Ethos build info: Â Â Nov Â7 201523:02:234.8.3 20140911 (Red Hat 4.8.3-7)
start_info: Â Â ffffffff8046b000
 nr_pages:   65536
 shared_inf:  ac88f000
 pt_base:   Âffffffff8046e000
 mod_start:  Â0xffffffff8033c000
 mod_len:   Â716800
 flags:    Â0x0
 cmd_line:   sd.port=11112
 stack:   Âffffffff801bfa50-ffffffff801c1a50
sd.port=11112
sd.mac=fe:ff:ff:ff:ff:ff
sd.ip=xxxxxxxx
ipShadowDaemon=169.254.2.1
ipNetwork=169.254.2.2
 _text:    Âffffffff80000000
 _etext:    ffffffff80077000
 _edata:    ffffffff80091f14
 stack start: Âffffffff801bfa50
 _end:     ffffffff8030643c
 First free, but mapped, pfn:  475
 Fitst unmapped pfn:      Â800
 Total RAM pages:        10000
 Total RAM pages used for PTs: Â7
 KERN_START           ffffffff80000000
 KERN_END            ffffffffffffffff
 Max number of mapped pfns:   0x7ffff
 Mappable pages: 0x475-0x10000  Âunmapped pages: 0x10000-0x10000
Mapping memory range 0xffffffff80800000 - 0xffffffff90000000
walked initially mapped pages
mapped rest of pages
MM: archPageTablePopulate completed
MM: walk all mapped vm
MM: walked
MM: Initializing xtype from ffffffff804f1000 to ffffffff90000000
 handles ... MM: Umapped pages from 0x10000000-0x10000000
physicalInfoInit: ÂmaxMappedPfn = 10000 Â Â maxPfn = 10000
Buffered console enabled.
libxl: debug: libxl_event.c:503:watchfd_callback: watch w=0x17e9570 wpath=/local/domain/0/device-model/15/state token=3/0: event epath=/local/domain/0/device-model/15/state
                          Âlibxl: debug: libxl_event.c:596:libxl__ev_xswatch_deregister: watch w=0x17e9570 wpath=/local/domain/0/device-model/15/state token=3/0: deregister slotnum=3
                                            Âlibxl: debug: libxl_event.c:608:libxl__ev_xswatch_deregister: watch w=0x17e9570: deregister unregistered
                                     libxl: debug: libxl_event.c:559:libxl__ev_xswatch_register: watch w=0x17ee308 wpath=/local/domain/0/backend/vif/15/0/state token=3/1: register slotnum=3
                                                     Âlibxl: debug: libxl_event.c:559:libxl__ev_xswatch_register: watch w=0x17eeef8 wpath=/local/domain/0/backend/vif/15/1/state token=2/2: register slotnum=2
          Âlibxl: debug: libxl_event.c:503:watchfd_callback: watch w=0x17ee308 wpath=/local/domain/0/backend/vif/15/0/state token=3/1: event epath=/local/domain/0/backend/vif/15/0/state
                                      libxl: debug: libxl_event.c:643:devstate_watch_callback: backend /local/domain/0/backend/vif/15/0/state wanted state 2 ok
                                       libxl: debug: libxl_event.c:596:libxl__ev_xswatch_deregister: watch w=0x17ee308 wpath=/local/domain/0/backend/vif/15/0/state token=3/1: deregister slotnum=3
                                                         Âlibxl: debug: libxl_event.c:608:libxl__ev_xswatch_deregister: watch w=0x17ee308: deregister unregistered
                                                  libxl: debug: libxl_device.c:959:device_hotplug: calling hotplug script: /etc/xen/scripts/vif-ethos online
                                           Âlibxl: debug: libxl_event.c:472:watchfd_callback: watch epath=/local/domain/0/backend/vif/15/0/state token=3/1: empty slot
                                             libxl: debug: libxl_event.c:503:watchfd_callback: watch w=0x17eeef8 wpath=/local/domain/0/backend/vif/15/1/state token=2/2: event epath=/local/domain/0/backend/vif/15/1/state
             libxl: debug: libxl_event.c:643:devstate_watch_callback: backend /local/domain/0/backend/vif/15/1/state wanted state 2 ok
              libxl: debug: libxl_event.c:596:libxl__ev_xswatch_deregister: watch w=0x17eeef8 wpath=/local/domain/0/backend/vif/15/1/state token=2/2: deregister slotnum=2
                                Âlibxl: debug: libxl_event.c:608:libxl__ev_xswatch_deregister: watch w=0x17eeef8: deregister unregistered
                         libxl: debug: libxl_device.c:959:device_hotplug: calling hotplug script: /etc/xen/scripts/vif-ethos online
                  Âlibxl: debug: libxl_event.c:472:watchfd_callback: watch epath=/local/domain/0/backend/vif/15/1/state token=2/2: empty slot
                    success
                       Âsuccess
                           libxl: debug: libxl_event.c:1737:libxl__ao_progress_report: ao 0x17eb050: progress report: ignored
                Âlibxl: debug: libxl_event.c:1569:libxl__ao_complete: ao 0x17eb050: complete, rc=0
                                                         libxl: debug: libxl_event.c:1541:libxl__ao__destroy: ao 0x17eb050: destroy
                                  ÂDaemon running with PID 16633
                                                 XEN_GRANT_ frames:
    MFN = 0x23fadd
    MFN = 0x23e927
    MFN = 0x23f130
    MFN = 0x23fbe8
    MFN = 0x199f7c
    MFN = 0x199f7b
    MFN = 0x199f7a
    MFN = 0x199f79
    Mapping foreign machine frame = 0x23fadd
    Mapping foreign machine frame = 0x23e927
    Mapping foreign machine frame = 0x23f130
    Mapping foreign machine frame = 0x23fbe8
    Mapping foreign machine frame = 0x199f7c
    Mapping foreign machine frame = 0x199f7b
    Mapping foreign machine frame = 0x199f7a
    Mapping foreign machine frame = 0x199f79
xenGrantTable mapped at ffffffff80e60000.
NR_GRANT_ENTRIES: 4096
Initializing events ...
Âevent allocator ... ÂreadyEvents list ... ÂterminatedKernelEvents list ... Âtimer list ... done.
XenStore channel on 0x8046c000, evtchn Â0x1
Initializing network interfaces ...
device/vif/1 StatusNotFound
device/vif/0 StatusOk
device/vbd StatusOk
    backend: /local/domain/0/backend/vif/15/0
    NET_TX_RING_SIZE: 256
    NET_RX_RING_SIZE: 256
done.

---------------------------
eth0:
---------------------------
MAC: aa:00:00:00:00:01
Backend: /local/domain/0/backend/vif/15/0
Event-Channel: 4

shadow daemon remote/local ip address 169.254.2.1/xxxxxxxx
shadow daemon remote/local udp port: 11112
tunneCreateOutgoing: successfully created tunnel
 ÂcryptoKeyType = CryptoKeyNone ÂtunnelId = 0x0
 Âlocal  Âmac = aa:00:00:00:00:01  Âip = 169.254.2.1  Âudp = 11112  isOdd = 0
 Âremote  mac = fe:ff:ff:ff:ff:ff  Âip = xxxxxxxx  Âudp = 11112  Ânonce = 1
 ÂidPublicKey    Â= 0000000000000000000000000000000000000000000000000000000000000000
 Âlocal.publicKey  Â= 0000000000000000000000000000000000000000000000000000000000000000
 Âremote.publicKey  = 0000000000000000000000000000000000000000000000000000000000000000
 ÂsymmetricKey    = 0000000000000000000000000000000000000000000000000000000000000000Â
shadowdaemonConnectionId = 2
Adding ARP entry: 169.254.2.1 f0:7e:40:00:00:00
Adding ARP entry: 169.254.2.2 f0:7e:40:00:00:00
received shadowdaemon ping
             received shadowdaemon ping reply, status StatusOk
Initializing file system ... xc: debug: hypercall buffer: total allocations:520 total releases:520
                                                 xc: debug: hypercall buffer: current allocations:0 maximum allocations:4
                         Âxc: debug: hypercall buffer: cache current size:4
                                                  xc: debug: hypercall buffer: cache hits:508 misses:4 toobig:8
                     cannot open directory /auth/directoryService
Initializing file system ... cannot open directory /auth/host
fileSystemReadTypeGraph: ÂtypeCount=421
done.
done.
randomInit done
authInit done
directoryCacheInit done
 Âinitializing minimalt..._initMinimalt: Âbegin
ASSERTION FAILED: interface < netInterfaceCount at kernel/net/xenNet.c:164.
Terminating Ethos Kernel
Backtrace:Â
[0xffffffff80023342] mixinExit + 12
libxl: error: libxl_dm.c:1328:libxl__destroy_device_model: Device Model already exited
libxl: error: libxl_dom.c:1518:userdata_path: unable to find domain info for domain 15: No such file or directory
libxl: error: libxl.c:1476:devices_destroy_cb: xc_domain_destroy failed for 15
libxl: error: libxl.c:1347:domain_destroy_callback: unable to destroy guest with domid 15
libxl: error: libxl.c:1274:domain_destroy_cb: destruction of domain 15 failed
destroy failed (rc=-3)
client aborted


###########################################################################

If I pause the OS right after starting it, then I can get the following from xenstore-ls -fp (only showing stuff related to this domain, since there are stuff with other destroyed domains):

/local/domain/0/backend/qdisk/16 = "" Â (r0)
/local/domain/0/backend/qdisk/16/2048 = "" Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/frontend = "/local/domain/16/device/vbd/2048" Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/params = "aio:/home/yl/test/disk.img" Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/frontend-id = "16" Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/ Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/removable = "0" Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/bootable = "1" Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/state = "2" Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/dev = "sda" Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/type = "qdisk" Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/mode = "w" Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/device-type = "disk" Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/feature-barrier = "1" Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/info = "0" Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/sector-size = "512" Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/sectors = "8192" Â (n0,r16)
/local/domain/0/backend/qdisk/16/2048/hotplug-status = "connected" Â (n0,r16)

/local/domain/0/backend/vif/16 = "" Â (r0)
/local/domain/0/backend/vif/16/0 = "" Â (n0,r16)
/local/domain/0/backend/vif/16/0/frontend = "/local/domain/16/device/vif/0" Â (n0,r16)
/local/domain/0/backend/vif/16/0/frontend-id = "16" Â (n0,r16)
/local/domain/0/backend/vif/16/0/ Â (n0,r16)
/local/domain/0/backend/vif/16/0/state = "2" Â (n0,r16)
/local/domain/0/backend/vif/16/0/script = "/etc/xen/scripts/vif-ethos" Â (n0,r16)
/local/domain/0/backend/vif/16/0/mac = "aa:00:00:00:00:01" Â (n0,r16)
/local/domain/0/backend/vif/16/0/ip = "169.254.2.1" Â (n0,r16)
/local/domain/0/backend/vif/16/0/bridge = "xenbr0" Â (n0,r16)
/local/domain/0/backend/vif/16/0/handle = "0" Â (n0,r16)
/local/domain/0/backend/vif/16/0/type = "vif" Â (n0,r16)
/local/domain/0/backend/vif/16/0/feature-sg = "1" Â (n0,r16)
/local/domain/0/backend/vif/16/0/feature-gso-tcpv4 = "1" Â (n0,r16)
/local/domain/0/backend/vif/16/0/feature-gso-tcpv6 = "1" Â (n0,r16)
/local/domain/0/backend/vif/16/0/feature-ipv6-csum-offload = "1" Â (n0,r16)
/local/domain/0/backend/vif/16/0/feature-rx-copy = "1" Â (n0,r16)
/local/domain/0/backend/vif/16/0/feature-rx-flip = "0" Â (n0,r16)
/local/domain/0/backend/vif/16/0/feature-split-event-channels = "1" Â (n0,r16)
/local/domain/0/backend/vif/16/0/multi-queue-max-queues = "8" Â (n0,r16)
/local/domain/0/backend/vif/16/0/hotplug-status = "connected" Â (n0,r16)
/local/domain/0/backend/vif/16/1 = "" Â (n0,r16)
/local/domain/0/backend/vif/16/1/frontend = "/local/domain/16/device/vif/1" Â (n0,r16)
/local/domain/0/backend/vif/16/1/frontend-id = "16" Â (n0,r16)
/local/domain/0/backend/vif/16/1/ Â (n0,r16)
/local/domain/0/backend/vif/16/1/state = "2" Â (n0,r16)
/local/domain/0/backend/vif/16/1/script = "/etc/xen/scripts/vif-ethos" Â (n0,r16)
/local/domain/0/backend/vif/16/1/mac = "aa:00:00:00:00:02" Â (n0,r16)
/local/domain/0/backend/vif/16/1/ip = "169.254.2.2" Â (n0,r16)
/local/domain/0/backend/vif/16/1/bridge = "xenbr0" Â (n0,r16)
/local/domain/0/backend/vif/16/1/handle = "1" Â (n0,r16)
/local/domain/0/backend/vif/16/1/type = "vif" Â (n0,r16)
/local/domain/0/backend/vif/16/1/feature-sg = "1" Â (n0,r16)
/local/domain/0/backend/vif/16/1/feature-gso-tcpv4 = "1" Â (n0,r16)
/local/domain/0/backend/vif/16/1/feature-gso-tcpv6 = "1" Â (n0,r16)
/local/domain/0/backend/vif/16/1/feature-ipv6-csum-offload = "1" Â (n0,r16)
/local/domain/0/backend/vif/16/1/feature-rx-copy = "1" Â (n0,r16)
/local/domain/0/backend/vif/16/1/feature-rx-flip = "0" Â (n0,r16)
/local/domain/0/backend/vif/16/1/feature-split-event-channels = "1" Â (n0,r16)
/local/domain/0/backend/vif/16/1/multi-queue-max-queues = "8" Â (n0,r16)
/local/domain/0/backend/vif/16/1/hotplug-status = "connected" Â (n0,r16)


On Mon, Nov 16, 2015 at 4:01 AM, Ian Campbell <ian.campbell@xxxxxxxxxx> wrote:
On Sun, 2015-11-15 at 18:06 -0600, Yaohua Li wrote:
> Hi
>
> I am trying to add disk vbd for "Ethos" OS running on x86_64. It did not
> have disk device before but I am adding one and writing file system for
> it.
>
> Below is the arguments we use to start. Since a Python script is used to
> start xen domain, the below is an array of strings, rather than a single
> string. Note that "disk" argument is the newly added thing.
>
> ['xl', 'create', '/dev/null', '-p',
> "vif=['mac=aa:00:00:00:00:01,ip=169.254.2.1','mac=aa:00:00:00:00:02,ip=16
> 9.254.2.2']", "disk=['file:/home/yl/test/disk.img,sda,rw']",
> "kernel='/var/lib/xen/images/ethos.x86_64.elf'", "name='client.ethos'",
> "ramdisk='/var/lib/xen/images/initialStore.x86_64.tar'", "memory='256'",
> " "extra=' sd.port=11112 .mac=fe:ff:ff:ff:ff:ff
> .ip=xxxxxxxx ÂipShadowDaemon=169.254.2.1 ipNetwork=169.254.2.2'"]
>
> We have been using 2 vif devices for a long time with no problem. But
> after adding "disk" configuration
> (disk=['file:/home/yl/test/disk.img,sda,rw']), the OS cannot find vif1
> but only vif0, with the code below.Â
>
> Â Â ASSERT(0==netInterfaceCount);
>
> Â Â while (status == StatusOk)
> Â Â Â Â {
> Â Â Â Â Â Â sprint(path, "device/vif/%d", netInterfaceCount);
> Â Â Â Â Â Â status = xenbus_read(XBT_NIL, path, &str);
>
> Â Â Â Â Â Â if (status == StatusOk)
> Â Â Â Â Â Â Â Â {
> Â Â Â Â Â Â Â Â Â Â xfree(str);
> Â Â Â Â Â Â Â Â Â Â ++netInterfaceCount;
> Â Â Â Â Â Â Â Â }
> Â Â Â Â }
>
> Is the configuration itself correct?

It seems to be, or at least I can't spot any obvious problem.

>Â Or could it be some bug in the OS code?

Right now that seems most likely. When you say "cannot find" do you mean it
is not finding the xenstore node or is it failing to create the device
after having found it in xenstore?

You can look at the contents of xensto with "xenstore-ls -fp" and see if
the devices are created. You should also look at the logs under
/var/log/xen and see if there is anything there.Â

You may also want to make xl more verbose e.g. "xl -vvv create /dev/null
...etc...".

Ian.



_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxx
http://lists.xen.org/xen-users

 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.