Re: [Xen-devel] Kernel 3.7.[12] - irq 16: nobody cared

[Steven Haigh <netwiz@xxxxxxxxx>]

On 16/01/2013 8:42 PM, Jan Beulich wrote:
> > > > On 15.01.13 at 18:15, Steven Haigh <netwiz@xxxxxxxxx> wrote:
> > I'm not 100% sure how to do this. I haven't been able to find a method
> > to cause the problem to happen... It just does - and it seems random
> > when it does happen. Part of the problem with running the system without
> > the hypervisor in place is that I can't replicate any kind of workload
> > that would normally trigger the problem.
> That's pretty odd - there need to be almost 100,000 unhandled
> interrupts within a tenth of a second, so there _must_ be
> something triggering this if the device is otherwise working fine.
>
> You're not by chance passing through to a guest any other
> device using the same IRQ?
Hi Jan,

I don't pass any devices at all to any DomU's. All guests are PV Linux 
systems, all EL6. The only thing each DomU has is a disk, a network 
interface, and 2 x vcpus.
So far, I have:
# uptime
 20:50:40 up 1 day,  1:11,  1 user,  load average: 0.36, 0.17, 0.13

As I mentioned, I moved the sata card to the second 16x PCIe slot in the 
mainboard - which changed the IRQ from 16 to 19. Currently I see:
# grep sata_mv /proc/interrupts
 19:   21243495  xen-pirq-ioapic-level  sata_mv

Which is interestingly more than the onboard SATA ports:
# grep ahci /proc/interrupts
 50:    9004117  xen-pirq-msi       ahci

I'm not sure if this will give any further info:
# xm dmesg
 __  __            _  _    ____    _    _       _  __
 \ \/ /___ _ __   | || |  |___ \  / |  / |  ___| |/ /_
  \  // _ \ '_ \  | || |_   __) | | |__| | / _ \ | '_ \
  /  \  __/ | | | |__   _| / __/ _| |__| ||  __/ | (_) |
 /_/\_\___|_| |_|    |_|(_)_____(_)_|  |_(_)___|_|\___/

(XEN) Xen version 4.2.1 (mockbuild@xxxxxxxxx) (gcc (GCC) 4.4.6 20120305 
(Red Hat 4.4.6-4)) Wed Dec 19 01:32:40 EST 2012
(XEN) Latest ChangeSet: unavailable
(XEN) Bootloader: GNU GRUB 0.97
(XEN) Command line: dom0_mem=1024M cpufreq=xen dom0_max_vcpus=1 
dom0_vcpus_pin
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: none; EDID transfer time: 0 seconds
(XEN)  EDID info not retrieved because no DDC retrieval method detected
(XEN) Disc information:
(XEN)  Found 2 MBR signatures
(XEN)  Found 3 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 000000000009d800 (usable)
(XEN)  000000000009d800 - 00000000000a0000 (reserved)
(XEN)  00000000000e0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 0000000020000000 (usable)
(XEN)  0000000020000000 - 0000000020200000 (reserved)
(XEN)  0000000020200000 - 0000000040000000 (usable)
(XEN)  0000000040000000 - 0000000040200000 (reserved)
(XEN)  0000000040200000 - 00000000dbb1b000 (usable)
(XEN)  00000000dbb1b000 - 00000000dc3c7000 (reserved)
(XEN)  00000000dc3c7000 - 00000000dc647000 (ACPI NVS)
(XEN)  00000000dc647000 - 00000000dc64c000 (ACPI data)
(XEN)  00000000dc64c000 - 00000000dc68f000 (ACPI NVS)
(XEN)  00000000dc68f000 - 00000000dcdca000 (usable)
(XEN)  00000000dcdca000 - 00000000dcfdd000 (reserved)
(XEN)  00000000dcfdd000 - 00000000dd000000 (usable)
(XEN)  00000000dd800000 - 00000000dfa00000 (reserved)
(XEN)  00000000f8000000 - 00000000fc000000 (reserved)
(XEN)  00000000fec00000 - 00000000fec01000 (reserved)
(XEN)  00000000fed00000 - 00000000fed04000 (reserved)
(XEN)  00000000fed1c000 - 00000000fed20000 (reserved)
(XEN)  00000000fee00000 - 00000000fee01000 (reserved)
(XEN)  00000000ff000000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 000000021f600000 (usable)
(XEN) ACPI: RSDP 000F0490, 0024 (r2 ALASKA)
(XEN) ACPI: XSDT DC629070, 0064 (r1 ALASKA    A M I  1072009 AMI 10013)
(XEN) ACPI: FACP DC632928, 00F4 (r4 ALASKA    A M I  1072009 AMI 10013)
(XEN) ACPI: DSDT DC629170, 97B8 (r2 ALASKA    A M I       12 INTL 20051117)
(XEN) ACPI: FACS DC645F80, 0040
(XEN) ACPI: APIC DC632A20, 0072 (r3 ALASKA    A M I  1072009 AMI 10013)
(XEN) ACPI: MCFG DC632A98, 003C (r1 ALASKA    A M I  1072009 MSFT       97)
(XEN) ACPI: HPET DC632AD8, 0038 (r1 ALASKA    A M I  1072009 AMI.        5)
(XEN) ACPI: SSDT DC632B10, 036D (r1 SataRe SataTabl     1000 INTL 20091112)
(XEN) ACPI: SSDT DC632E80, 09AA (r1  PmRef  Cpu0Ist     3000 INTL 20051117)
(XEN) ACPI: SSDT DC633830, 0A92 (r1  PmRef    CpuPm     3000 INTL 20051117)
(XEN) ACPI: MATS DC6342C8, 0034 (r2 ALASKA    A M I        2 wx2        0)
(XEN) System RAM: 8116MB (8310872kB)
(XEN) Domain heap initialised
(XEN) ACPI: 32/64X FACS address mismatch in FADT - 
dc645f80/0000000000000000, using 32
(XEN) Processor #0 6:10 APIC version 21
(XEN) Processor #2 6:10 APIC version 21
(XEN) Processor #4 6:10 APIC version 21
(XEN) Processor #6 6:10 APIC version 21
(XEN) IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
(XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
(XEN) Table is not found!
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 3303.320 MHz processor.
(XEN) Initing memory sharing.
(XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7
(XEN) I/O virtualisation disabled
(XEN) Enabled directed EOI with ioapic_ack_old on!
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using old ACK method
(XEN) Platform timer is 14.318MHz HPET
(XEN) Allocated console ring of 16 KiB.
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Extended Page Tables (EPT)
(XEN)  - Virtual-Processor Identifiers (VPID)
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN)  - Unrestricted Guest
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) detected
(XEN) HVM: HAP page sizes: 4kB, 2MB
(XEN) Brought up 4 CPUs
(XEN) *** LOADING DOMAIN 0 ***
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x1d87000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000210000000->0000000214000000 (236799 pages 
to be allocated)
(XEN)  Init. ramdisk: 000000021d2ff000->000000021f5ff800
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff81000000->ffffffff81d87000
(XEN)  Init. ramdisk: ffffffff81d87000->ffffffff84087800
(XEN)  Phys-Mach map: ffffffff84088000->ffffffff84288000
(XEN)  Start info:    ffffffff84288000->ffffffff842884b4
(XEN)  Page tables:   ffffffff84289000->ffffffff842ae000
(XEN)  Boot stack:    ffffffff842ae000->ffffffff842af000
(XEN)  TOTAL:         ffffffff80000000->ffffffff84400000
(XEN)  ENTRY ADDRESS: ffffffff81745210
(XEN) Dom0 has maximum 1 VCPUs
(XEN) Scrubbing Free RAM: 
......................................................................done.
(XEN) Initial low memory virq threshold set at 0x4000 pages.
(XEN) Std. Loglevel: Errors and warnings
(XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch 
input to Xen)
(XEN) Freed 252kB init memory.
(XEN) no cpu_id for acpi_id 5
(XEN) no cpu_id for acpi_id 6
(XEN) no cpu_id for acpi_id 7
(XEN) no cpu_id for acpi_id 8

--
Steven Haigh

Email: netwiz@xxxxxxxxx
Web: http://www.crc.id.au
Phone: (03) 9001 6090 - 0412 935 897
Fax: (03) 8338 0299

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
http://lists.xen.org/xen-devel