Re: [Xen-users] Xen 3.0.0 + RAID + LVM + CentOS = problem

[Taneli Leppä <taneli@xxxxxxxxxx>]

Hi,

Vincent Hanquez wrote:
> On Fri, Dec 09, 2005 at 10:48:38AM +0200, Taneli Leppä wrote:
> > Yes, the disks are detected fine on the same devices (/dev/sda and
> > /dev/sdb) on both kernels (regular and Xen dom0 flavor). 
> please provide full dmesg (regular and dom0) and your hardware specs
> (motherboard/chipset and raid cards will do)
Here's the output from serial console (the error messages I posted
earlier don't seem to appear in the serial console output, however
they are visible in the real console output):

 __  __            _____  ___   ___
 \ \/ /___ _ __   |___ / / _ \ / _ \
  \  // _ \ '_ \    |_ \| | | | | | |
  /  \  __/ | | |  ___) | |_| | |_| |
 /_/\_\___|_| |_| |____(_)___(_)___/

 http://www.cl.cam.ac.uk/netos/xen
 University of Cambridge Computer Laboratory

 Xen version 3.0.0 (rread@xxxxxxxxxxxxxxxxxxxx) (gcc version 3.4.3 
20050227 (Red Hat 3.4.3-22.1)) Sun Dec  4 10:31:20 PST 2005
 Latest ChangeSet: unavailable

(XEN) Physical RAM map:
(XEN)  0000000000000000 - 000000000009fc00 (usable)
(XEN)  000000000009fc00 - 00000000000a0000 (reserved)
(XEN)  00000000000e0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 00000000dfe50000 (usable)
(XEN)  00000000dfe50000 - 00000000dfee9000 (ACPI NVS)
(XEN)  00000000dfee9000 - 00000000dfeed000 (usable)
(XEN)  00000000dfeed000 - 00000000dfeff000 (ACPI data)
(XEN)  00000000dfeff000 - 00000000dff00000 (usable)
(XEN) System RAM: 3581MB (3667920kB)
(XEN) Xen heap: 10MB (10580kB)
(XEN) PAE disabled.
(XEN) found SMP MP-table at 000fe680
(XEN) DMI 2.3 present.
(XEN) Using APIC driver default
(XEN) ACPI: RSDP (v000 INTEL                                 ) @ 0x000fe020
(XEN) ACPI: RSDT (v001 INTEL  D945PSN  0x00000032 MSFT 0x01000013) @ 
0xdfefde48
(XEN) ACPI: FADT (v001 INTEL  D945PSN  0x00000032 MSFT 0x01000013) @ 
0xdfefcf10
(XEN) ACPI: MADT (v001 INTEL  D945PSN  0x00000032 MSFT 0x01000013) @ 
0xdfefce10
(XEN) ACPI: WDDT (v001 INTEL  D945PSN  0x00000032 MSFT 0x01000013) @ 
0xdfef7f90
(XEN) ACPI: MCFG (v001 INTEL  D945PSN  0x00000032 MSFT 0x01000013) @ 
0xdfef7f10
(XEN) ACPI: ASF! (v032 INTEL  D945PSN  0x00000032 MSFT 0x01000013) @ 
0xdfefcd10
(XEN) ACPI: SSDT (v001 INTEL     CpuPm 0x00000032 MSFT 0x01000013) @ 
0xdfefdc10
(XEN) ACPI: SSDT (v001 INTEL   Cpu0Ist 0x00000032 MSFT 0x01000013) @ 
0xdfefda10
(XEN) ACPI: SSDT (v001 INTEL   Cpu1Ist 0x00000032 MSFT 0x01000013) @ 
0xdfefd810
(XEN) ACPI: SSDT (v001 INTEL   Cpu2Ist 0x00000032 MSFT 0x01000013) @ 
0xdfefd610
(XEN) ACPI: SSDT (v001 INTEL   Cpu3Ist 0x00000032 MSFT 0x01000013) @ 
0xdfefd410
(XEN) ACPI: DSDT (v001 INTEL  D945PSN  0x00000032 MSFT 0x01000013) @ 
0x00000000
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
(XEN) Processor #0 15:4 APIC version 20
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
(XEN) Processor #1 15:4 APIC version 20
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x82] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x83] disabled)
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x02] dfl dfl lint[0x1])
(XEN) ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) Initializing CPU#0
(XEN) Detected 3400.170 MHz processor.
(XEN) Using scheduler: Simple EDF Scheduler (sedf)
(XEN) CPU: Trace cache: 12K uops, L1 D cache: 16K
(XEN) CPU: L2 cache: 2048K
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU0: Intel(R) Pentium(R) 4 CPU 3.40GHz stepping 03
(XEN) Booting processor 1/1 eip 90000
(XEN) Initializing CPU#1
(XEN) CPU: Trace cache: 12K uops, L1 D cache: 16K
(XEN) CPU: L2 cache: 2048K
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU1: Intel(R) Pentium(R) 4 CPU 3.40GHz stepping 03
(XEN) Total of 2 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN) ..TIMER: vector=0x31 pin1=2 pin2=-1
(XEN) checking TSC synchronization across 2 CPUs: passed.
(XEN) Platform timer is 1.193MHz PIT
(XEN) Brought up 2 CPUs
(XEN) mtrr: v2.0 (20020519)
(XEN) *** LOADING DOMAIN 0 ***
(XEN) Xen-ELF header found: 
'GUEST_OS=linux,GUEST_VER=2.6,XEN_VER=xen-3.0,VIRT_BASE=0xC0000000,PAE=no,LOADER=generic'
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   03000000->04000000 (870742 pages to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: c0100000->c04752c0
(XEN)  Init. ramdisk: c0476000->c06c7600
(XEN)  Phys-Mach map: c06c8000->c0a1e558
(XEN)  Start info:    c0a1f000->c0a20000
(XEN)  Page tables:   c0a20000->c0a24000
(XEN)  Boot stack:    c0a24000->c0a25000
(XEN)  TOTAL:         c0000000->c0c00000
(XEN)  ENTRY ADDRESS: c0100000
(XEN) Initrd len 0x251600, start at 0xc0476000
(XEN) Scrubbing Free RAM: ....................................done.
(XEN) Xen trace buffers: disabled
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch 
input to Xen).
Linux version 2.6.12.6-xen3_2.1_rhel4.1 (root@xendev2) (gcc version 
3.4.4 20050721 (Red Hat 3.4.4-2)) #1 SMP Thu Dec 8 16:55:39 EET 2005
BIOS-provided physical RAM map:
 Xen: 0000000000000000 - 00000000d5956000 (usable)
2593MB HIGHMEM available.
832MB LOWMEM available.
found SMP MP-table at 000fe680
DMI 2.3 present.
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x82] disabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x83] disabled)
ACPI: LAPIC_NMI (acpi_id[0x01] dfl dfl lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x02] dfl dfl lint[0x1])
ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Enabling APIC mode:  Flat.  Using 1 I/O APICs
Using ACPI (MADT) for SMP configuration information
IRQ lockup detection disabled
Allocating PCI resources starting at dff00000 (gap: dff00000:20100000)
Built 1 zonelists
Kernel command line: root=/dev/Storage/RootFS ro maxcpus=1 com1=9600,8n1
Initializing CPU#0
PID hash table entries: 4096 (order: 12, 65536 bytes)
Xen reported: 3400.170 MHz processor.
Console: colour VGA+ 80x25
Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
Software IO TLB enabled:
 Aperture:     64 megabytes
 Bus range:    0x0000000040000000 - 0x0000000044000000
 Kernel range: 0x00000000c2be6000 - 0x00000000c6be6000
vmalloc area: f4800000-fb7fe000, maxmem 34000000
Memory: 3393280k/3507544k available (2184k kernel code, 104760k 
reserved, 883k data, 184k init, 2655576k highmem)
Checking if this processor honours the WP bit even in supervisor mode... Ok.
Security Framework v1.0.0 initialized
SELinux:  Disabled at boot.
Capability LSM initialized
Mount-cache hash table entries: 512
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 2048K
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Checking 'hlt' instruction... disabled
ENABLING IO-APIC IRQs
Brought up 1 CPUs
checking if image is initramfs... it is
Freeing initrd memory: 2373k freed
NET: Registered protocol family 16
PCI: Using MMCONFIG
ACPI: Subsystem revision 20050309
ACPI: Interpreter enabled
ACPI: Using IOAPIC for interrupt routing
ACPI: PCI Root Bridge [PCI0] (0000:00)
PCI: Probing PCI hardware (bus 00)
PCI: Ignoring BAR0-3 of IDE controller 0000:00:1f.1
PCI: Transparent bridge - 0000:00:1e.0
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 7 9 10 *11 12)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 7 9 10 *11 12)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 7 9 10 *11 12)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 7 9 10 *11 12)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 7 9 10 11 12) *0, disabled.
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 7 9 10 11 12) *0, disabled.
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 7 *9 10 11 12)
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 7 9 *10 11 12)
Linux Plug and Play Support v0.97 (c) Adam Belay
xen_mem: Initialising balloon driver.
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: Using ACPI for IRQ routing
PCI: If a device doesn't work, try "pci=routeirq".  If it helps, post a 
report
Grant table initialized
Number of CPUs sharing cache didn't match any known set of CPUs
Number of CPUs sharing cache didn't match any known set of CPUs
IA-32 Microcode Update Driver: v1.14-xen <tigran@xxxxxxxxxxx>
highmem bounce pool size: 64 pages
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
Initializing Cryptographic API
isapnp: Scanning for PnP cards...
isapnp: No Plug & Play device found
PNP: No PS/2 controller found. Probing ports directly.
serio: i8042 AUX port at 0x60,0x64 irq 12
serio: i8042 KBD port at 0x60,0x64 irq 1
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered
RAMDISK driver initialized: 16 RAM disks of 8192K size 1024 blocksize
Xen virtual console successfully installed as ttyS0
Event-channel device installed.
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
ICH7: IDE controller at PCI slot 0000:00:1f.1
ACPI: PCI Interrupt 0000:00:1f.1[A] -> GSI 18 (level, low) -> IRQ 18
ICH7: chipset revision 1
ICH7: not 100% native mode: will probe irqs later
    ide0: BM-DMA at 0x30b0-0x30b7, BIOS settings: hda:pio, hdb:DMA
hdb: HL-DT-STDVD-ROM GDR8164B, ATAPI CD/DVD-ROM drive
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
hdb: ATAPI 52X DVD-ROM drive, 256kB Cache, UDMA(33)
Uniform CD-ROM driver Revision: 3.20
ide-floppy driver 0.99.newide
ACPI: PCI Interrupt 0000:00:1d.7[A] -> GSI 23 (level, low) -> IRQ 23
ehci_hcd 0000:00:1d.7: Intel Corporation I/O Controller Hub EHCI USB
ehci_hcd 0000:00:1d.7: debug port 1
ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1d.7: irq 23, io mem 0xe8304000
ehci_hcd 0000:00:1d.7: USB 2.0 initialized, EHCI 1.00, driver 10 Dec 2004
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 8 ports detected
mice: PS/2 mouse device common for all mice
NET: Registered protocol family 2
IP: routing cache hash table of 32768 buckets, 256Kbytes
TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
TCP bind hash table entries: 65536 (order: 7, 524288 bytes)
TCP: Hash tables configured (established 524288 bind 65536)
NET: Registered protocol family 8
NET: Registered protocol family 20
Freeing unused kernel memory: 184k freed
scsi_mod: no version for "struct_module" found: kernel tainted.
SCSI subsystem initialized
ACPI: PCI Interrupt 0000:00:1f.2[B] -> GSI 19 (level, low) -> IRQ 19
ata1: SATA max UDMA/133 cmd 0x30C8 ctl 0x30E6 bmdma 0x30A0 irq 19
ata2: SATA max UDMA/133 cmd 0x30C0 ctl 0x30E2 bmdma 0x30A8 irq 19
input: AT Translated Set 2 keyboard on isa0060/serio0
ata1: dev 0 ATA, max UDMA/133, 488397168 sectors: lba48
ata1: dev 0 configured for UDMA/133
scsi0 : ata_piix
ata2: dev 0 ATA, max UDMA/133, 488397168 sectors: lba48
ata2: dev 0 configured for UDMA/133
scsi1 : ata_piix
  Vendor: ATA       Model: ST3250823AS       Rev: 3.03
  Type:   Direct-Access                      ANSI SCSI revision: 05
SCSI device sda: 488397168 512-byte hdwr sectors (250059 MB)
SCSI device sda: drive cache: write back
SCSI device sda: 488397168 512-byte hdwr sectors (250059 MB)
SCSI device sda: drive cache: write back
 sda: sda1 sda2 sda3
Attached scsi disk sda at scsi0, channel 0, id 0, lun 0
  Vendor: ATA       Model: ST3250823AS       Rev: 3.03
  Type:   Direct-Access                      ANSI SCSI revision: 05
SCSI device sdb: 488397168 512-byte hdwr sectors (250059 MB)
SCSI device sdb: drive cache: write back
SCSI device sdb: 488397168 512-byte hdwr sectors (250059 MB)
SCSI device sdb: drive cache: write back
 sdb: sdb1 sdb2 sdb3
Attached scsi disk sdb at scsi1, channel 0, id 0, lun 0
device-mapper: 4.4.0-ioctl (2005-01-12) initialised: dm-devel@xxxxxxxxxx
md: md driver 0.90.1 MAX_MD_DEVS=256, MD_SB_DISKS=27
md: raid1 personality registered as nr 3
Kernel panic - not syncing: Attempted to kill init!
 (XEN) Domain 0 shutdown: rebooting machine.

Hardware configuration:

- Intel Pentium 4 3.4 GHz
- Intel D945P motherboard
- 4GB DDR2 memory
- 2 250GB Seagate SATA drives
- Radeon X300SE

Software setup:

- CentOS 4.2 w/ all updates
- Software RAID1
- LVM2 on /dev/md* devices
- Boots directly from "Linux raid autodetect" partition
- Separate small partition for /boot

Partition table from /dev/sda:

Disk /dev/sda: 250.0 GB, 250059350016 bytes
255 heads, 63 sectors/track, 30401 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1          33      265041   fd  Linux raid 
autodetect
/dev/sda2              34         555     4192965   82  Linux swap
/dev/sda3             556       30401   239737995   fd  Linux raid 
autodetect
I guess the error code is ENODEV. I guess it looks a bit like
it's not seeing the disks properly even thought the boot messages
claims so.

Is there a easy way to boot to the initrd shell and look things
from there? I tried root=/dev/ram0 init=/bin/nash but with no luck.

--
  Taneli Leppä         | Crasman Co Ltd
  <taneli@xxxxxxxxxx>  | <http://www.crasman.fi/>

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users