pcp
[Top] [All Lists]

Re: [pcp] pcp QA Status

To: Ken McDonell <kenj@xxxxxxxxxxxxxxxx>
Subject: Re: [pcp] pcp QA Status
From: Nathan Scott <nathans@xxxxxxxxxx>
Date: Mon, 16 May 2016 20:31:21 -0400 (EDT)
Cc: pcp@xxxxxxxxxxx
Delivered-to: pcp@xxxxxxxxxxx
In-reply-to: <57394DE8.7070700@xxxxxxxxxxxxxxxx>
References: <57394DE8.7070700@xxxxxxxxxxxxxxxx>
Reply-to: Nathan Scott <nathans@xxxxxxxxxx>
Thread-index: rMMEMMgBXQwC7XIHRuBwN2w5141OTA==
Thread-topic: pcp QA Status
Hi Ken,

----- Original Message -----
> 450 is a known timezone change issue (QA setup not a code problem).
> 
> 1092 is a known package versions change issue (QA setup not a code problem)
> 
> My builds are still broken on Mac OS X (fuji) and FreeBSD 9.3 (vm10).
> 
> valgrind is still broken on Debian 6.0.10 (vm07 and vm11).
> 
> Lots of things to look at / fix here.
> 

Went through the tail - several of the newly introduced ones will now be
resolved, one or two old-timers also, and I think 756 is another case of
test programs not being rebuilt?  (pmdaperfevent again, hmm - happened
last time we updated that qa/perfevent code too IIRC)

> Details for the most commonly failing tests are available from
> ftp://oss.sgi.com/projects/pcp/download/qa-status/
> 
> === Synopsis ===
> 
> QA Status from Ken McDonell's QA Farm in Melbourne
> 
> Summary: 24153 run, 231 failed (0.96%)
> 
> QA Test  Fail  Failure Signatures (number of different failure patterns)
>     666    22  1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
>     450    22  2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
>    1092    21  21
>     024    18  14 4
>     826    17  11 4 2
>     023    13  13
>     821    11  9 1 1
>    1070     3  3
>     823     3  2 1
>     756     3  2 1
>     394     3  1 1 1
>     274     3  3
>             ^  ^
>           |  |
>           |  +-- A B C ... means one failure signature occurred A times,
>           |      another occurred B times, a third occurred C times, ...
>           +-- total number of failures for this test, equals A+B+C+...


cheers.

--
Nathan

<Prev in Thread] Current Thread [Next in Thread>