pcp
[Top] [All Lists]

pcp updates: QA status

To: pcp@xxxxxxxxxxx
Subject: pcp updates: QA status
From: Ken McDonell <kenj@xxxxxxxxxxxxxxxx>
Date: Sun, 27 Mar 2016 17:01:21 +1100
Delivered-to: pcp@xxxxxxxxxxx
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.6.0
Looks pretty good, especially since fuji (Mac OS X) is now running the full QA 
suite (not just -g sanity, as in the past).

This will be the last QA report from me for a while.  Tomorrow I'll shut down 
all my QA machines as I'm going to China for 5 weeks and will be out of range 
for PCP matters.

Cheers from the Old Easter Bunny.

--------
Details for the most commonly failing tests are available from
ftp://oss.sgi.com/projects/pcp/download/qa-status/

=== Synopsis ===

QA Status from Ken McDonell's QA Farm in Melbourne

Summary: 24769 run, 29 failed (0.12%)

QA Test  Fail  Failure Signatures (number of different failure patterns)
    666     6  2 1 1 1 1 
    823     3  1 1 1 
            ^  ^
            |  |
            |  +-- A B C ... means one failure signature occurred A times,
            |      another occurred B times, a third occurred C times, ...
            +-- total number of failures for this test, equals A+B+C+...

Each tarball in this directory contains .out, .out.bad and possibly
.full files for all failing test cases where a test failed on at least
9% of the QA hosts.

The latest tarball is 20160327.tgz.

==== QA Summary ====

Date        Run Pass Fail Nrun Host
2016-03-27  821  819    2   86|bo|bozo PCP 3.11.2 x86_64 Ubuntu 15.10
2016-03-25  797  796    1  110|bl|bozo-laptop PCP 3.11.2 i686 LinuxMint 15
2016-03-22  833  832    1   73|bv|bozo-vm PCP 3.11.2 x86_64 Debian 8.2
2016-03-26  693  689    4  212|fu|fuji PCP 3.11.2 i386 Darwin 10.8.0
2016-03-25  702  701    1  162|gr|grundy.sgi.com|grundy.sgi.com
2016-03-25  824  823    1   83|00|vm00 PCP 3.11.2 x86_64 Ubuntu 12.04
2016-03-22  827  827    0   79|01|vm01 PCP 3.11.2 i686 Ubuntu 15.10
2016-03-25  814  812    2   93|02|vm02 PCP 3.11.2 i686 openSUSE 13.2
2016-03-25  850  850    0   57|03|vm03 PCP 3.11.2 x86_64 Fedora 21
2016-03-26  733  733    0  174|04|vm04 PCP 3.11.2 i586 CentOS 5.11
2016-03-26  823  819    4   84|05|vm05 PCP 3.11.2 x86_64 Gentoo 2.2
2016-03-26   61   61    0    4|06|vm06 PCP 3.11.2 amd64 FreeBSD 10.2-RELEASE
2016-03-26  802  802    0  105|07|vm07 PCP 3.11.2 x86_64 Debian 6.0.10
2016-03-25  846  846    0   61|08|vm08 PCP 3.11.2 x86_64 CentOS Linux7.2.1511 
2016-03-26   61   61    0    4|09|vm09 PCP 3.11.2 i386 NetBSD 6.1.5
2016-03-26   61   61    0    4|10|vm10 PCP 3.11.2 i386 FreeBSD 9.3-RELEASE-p30
2016-03-26  801  799    2  106|11|vm11 PCP 3.11.2 i686 Debian 6.0.10
2016-03-26  846  846    0   61|12|vm12 PCP 3.11.2 i686 Fedora 22
2016-03-27  840  838    2   67|14|vm14 PCP 3.11.2 x86_64 CentOS6.7
No daily runs                 |15|vm15 PCP 3.9.1 x86_64 Slackware 13.37.0
2016-03-27  836  835    1   71|18|vm18 PCP 3.11.2 x86_64 LinuxMint 17.3
2016-03-27  815  815    0   92|19|vm19 PCP 3.11.2 x86_64 openSUSE 12.2
2016-03-27  818  818    0   89|20|vm20 PCP 3.11.2 x86_64 Ubuntu 13.04
2016-03-24  818  818    0   89|21|vm21 PCP 3.11.2 i686 Debian 7.9
2016-03-24  845  845    0   62|22|vm22 PCP 3.11.2 x86_64 Fedora 19
2016-03-24  844  844    0   63|23|vm23 PCP 3.11.2 i686 Fedora 20
2016-03-25  839  837    2   68|24|vm24 PCP 3.11.2 i686 openSUSE 13.1
2016-03-25  729  728    1  178|25|vm25 PCP 3.11.2 x86_64 CentOS 5.11
2016-03-26  848  847    1   59|26|vm26 PCP 3.11.2 x86_64 Fedora 21
2016-03-27  837  836    1   70|27|vm27 PCP 3.11.2 x86_64 Ubuntu 15.04
2016-03-24  842  841    1   65|28|vm28 PCP 3.11.2 x86_64 RHEL Server 6.7
2016-03-24  849  848    1   58|29|vm29 PCP 3.11.2 x86_64 RHEL Server 7.1
2016-03-25  845  845    0   62|30|vm30 PCP 3.11.2 x86_64 SUSE SLES12 SP0
2016-03-26  847  846    1   60|31|vm31 PCP 3.11.2 x86_64 Fedora 23
2016-03-24   61   61    0    4|32|vm32 PCP 3.11.2 amd64 FreeBSD 11.0-CURRENT
2016-03-24   61   61    0    4|33|vm33 PCP 3.11.2 amd64 OpenBSD 5.8
Summary: 24769 run, 29 failed (0.12%)

==== QA Failure (X) Map ====

Host       bo bl bv fu gr 00 02 05 11 14 18 24 25 26 27 28 29 31
Test %fail                                                       Test QA groups
 666   17%                       X     X              X  X  X  X  666 pmmgr slow
 823    9%                    X  X           X                    823 
pmda.sample pmstore secure
 102    3%           X                                            102 pmlc 
pmlogger
 110    3%           X                                            110 
pmda.simple pmda.proc pmda.install
 156    3%           X                                            156 
pmda.sample pmda.proc pmcd_wait pmda.install
 169    3%                             X                          169 pmcd
 206    3%              X                                         206 archive 
pmval
 263    3%                                X                       263 derive
 280    3%                          X                             280 pmlogger 
logutil folio pmlc
 326    3%                       X                                326 pmlogger 
pmval libpcp pmcd pmda.install folio pmdumplog pmlc timezone
 457    3%     X                                                  457 
pmda.logger pmda.install event flakey
 578    3%                                      X                 578 pmcd 
pmda.install pmval
 580    3%  X                                                     580 indom
 635    3%                                   X                    635 
pmda.linux libirixpmda
 661    3%  X                                                     661 pmwebapi
 737    3%        X                                               737 python 
timezone
 739    3%                    X                                   739 python 
getopt timezone
 756    3%                                         X              756 
pmda.perfevent
Host       bo bl bv fu gr 00 02 05 11 14 18 24 25 26 27 28 29 31
 832    3%                       X                                832 
pmda.sample pmstore secure
 892    3%                 X                                      892 pmcd 
libpcp
 956    3%           X                                            956 pmcd
 957    3%                          X                             957 
pmda.linux valgrind
Host       bo bl bv fu gr 00 02 05 11 14 18 24 25 26 27 28 29 31

<Prev in Thread] Current Thread [Next in Thread>