[Xen-devel] [PATCH OSSTEST] sg-run-job: Repeat rumpuserxen-demo-xenstorels test 150 times

[Ian Campbell <ian.campbell@xxxxxxxxxx>]

(Was: Re: [osstest test] 50423: regressions - FAIL)

On Fri, 2015-04-17 at 11:10 +0100, Ian Campbell wrote:
> On Thu, 2015-04-16 at 21:36 +0000, osstest service user wrote:
> > flight 50423 osstest real [real]
> > http://logs.test-lab.xenproject.org/osstest/logs/50423/
> > 
> > Regressions :-(
> > 
> > Tests which did not succeed and are blocking,
> > including tests which could not be run:
> >  test-amd64-amd64-rumpuserxen-amd64 15 
> > rumpuserxen-demo-xenstorels/xenstorels.repeat fail REGR. vs. 50331
> 
> The previous pass of this must have been spurious. We should crank the
> number of repetitions I think.

I thought I'd sent such a patch, but no sign of it in the relevant
folders. Here's another.

I'm unsure if the testid should change, I think not in which case this
will take a force push to clear the is-a-regression-ness.

8<------------

From b6ec9b81503b8e0a4fb3c529290e2da82b7421a4 Mon Sep 17 00:00:00 2001
From: Ian Campbell <ian.campbell@xxxxxxxxxx>
Date: Fri, 17 Apr 2015 11:01:29 +0100
Subject: [PATCH] sg-run-job: Repeat rumpuserxen-demo-xenstorels test 150
times

With 50 we are still seeing occasional spurious passes.

Looking at some logs the current 50 iterations takes around 4 minutes
to run (3-4s per iteration).

I think we can justify spending 10 minutes running this test, which is
150x4s.

Signed-off-by: Ian Campbell <ian.campbell@xxxxxxxxxx>
---
 sg-run-job | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/sg-run-job b/sg-run-job
index 11e33a6..e393408 100755
--- a/sg-run-job
+++ b/sg-run-job
@@ -337,7 +337,7 @@ proc run-job/test-rumpuserxen {} {
     run-ts . =   ts-rumpuserxen-demo-setup      + host + $g
     run-ts . =   ts-rumpuserxen-demo-xenstorels + host + $g
     run-ts . =   ts-guest-destroy-hard          + host + $g
-    repeat-ts 50 =.repeat \
+    repeat-ts 150 =.repeat \
                  ts-rumpuserxen-demo-xenstorels + host + $g   + \; \
                  ts-guest-destroy-hard            host   $g   +
 }
-- 
2.1.4




_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
http://lists.xen.org/xen-devel