pcp
[Top] [All Lists]

Re: [pcp] QA Status

To: Ken McDonell <kenj@xxxxxxxxxxxxxxxx>
Subject: Re: [pcp] QA Status
From: Nathan Scott <nathans@xxxxxxxxxx>
Date: Tue, 15 Mar 2016 19:02:00 -0400 (EDT)
Cc: pcp@xxxxxxxxxxx
Delivered-to: pcp@xxxxxxxxxxx
In-reply-to: <56E7D66F.9010601@xxxxxxxxxxxxxxxx>
References: <56E7D66F.9010601@xxxxxxxxxxxxxxxx>
Reply-to: Nathan Scott <nathans@xxxxxxxxxx>
Thread-index: u1BcBJUr2W+ENXrvoMDnDs/x+G+/Rw==
Thread-topic: QA Status
Hi Ken,

----- Original Message -----
> [I still have 22+ failing tests on Mac OS X, so this platform is not included
> in the report, yet]
> 
> Details for the most commonly failing tests are available from
> ftp://oss.sgi.com/projects/pcp/download/qa-status/
> 
> === Synopsis ===
> 
> QA Status from Ken McDonell's QA Farm in Melbourne
> 
> Summary: 24038 run, 61 failed (0.25%)
> 
> QA Test  Fail  Failure Signatures (number of different failure patterns)
>     878    10  6 3 1

Still keen on host access there for qa/878, but ultimately think we'll just
end up having to open up some timing windows/deltas beyond the current used
settings in the test.

>    1038     5  3 1 1
>     666     4  1 1 1 1
>    1069     3  3
>    1062     3  3
>     880     3  3
>     823     3  1 1 1

I've pushed in fixes for a couple, but I'm a bit mystified that some of the
OrderedDict _notrun checks seem to pass but then pmrep fails to find it?  I
have checked pmpython, and pmrep, and the QA tests all *seem* to be getting
the same python ... so not sure how that can be.

Perhaps the python versions on these failing hosts are not setting the exit
code to non-zero once they fail to import OrderedDict in the _notrun check?

>     756     3  3

This last one is a complete mystery - has the qa/perfevent/perfevent_test
binary not been installed / updated for awhile on these hosts perhaps?  It
is failing to run several new tests that were added there (C code) for the
(new this release) pmdaperfevent server-side derivation metrics - there is
an unconditional printf that should be visible in each of those cases, but
its nowhere to be seen in the output...

cheers.

--
Nathan

<Prev in Thread] Current Thread [Next in Thread>