This is as good as it has ever been ... the report is longer because I've
lowered the threshold for failures to be reported here from 9% of hosts to 2%
of hosts, so this is now _all_ the failures in my QA Farm ... all of the "1 1"
and "2 1 1" cases below are the "onesies and twosies" that were omitted
previously.
Thanks for all those who've helped to make this happen.
Details for the most commonly failing tests are available from
ftp://oss.sgi.com/projects/pcp/download/qa-status/
=== Synopsis ===
QA Status from Ken McDonell's QA Farm in Melbourne
Summary: 26562 run, 35 failed (0.13%)
QA Test Fail Failure Signatures (number of different failure patterns)
713 3 3
651 3 2 1
667 2 1 1
662 2 1 1
1068 1 1
999 1 1
892 1 1
878 1 1
870 1 1
832 1 1
823 1 1
798 1 1
778 1 1
740 1 1
739 1 1
652 1 1
581 1 1
527 1 1
416 1 1
389 1 1
372 1 1
371 1 1
359 1 1
230 1 1
216 1 1
169 1 1
156 1 1
102 1 1
098 1 1
^ ^
| |
| +-- A B C ... means one failure signature occurred A times,
| another occurred B times, a third occurred C times, ...
+-- total number of failures for this test, equals A+B+C+...
Each tarball in this directory contains .out, .out.bad and possibly
.full files for all failing test cases where a test failed on at least
2% of the QA hosts.
The latest tarball is 20160811.tgz.
==== QA Summary ====
Date Run Pass Fail Nrun Host
2016-08-07 848 848 0 92|bo|bozo PCP 3.11.4 x86_64 Ubuntu 16.04
2016-08-09 838 838 0 102|bl|bozo-laptop PCP 3.11.4 i686 LinuxMint 15
2016-08-09 842 842 0 98|bv|bozo-vm PCP 3.11.5 x86_64 Debian 8.5
2016-08-09 150 146 4 15|fu|fuji PCP 3.11.4 i386 Darwin 10.8.0
2016-08-09 751 746 5 143|gr|grundy.sgi.com|grundy.sgi.com
2016-08-09 858 856 2 82|00|vm00 PCP 3.11.4 x86_64 Ubuntu 12.04
2016-08-09 867 866 1 72|01|vm01 PCP 3.11.4 i686 Ubuntu 15.10
2016-08-09 849 847 2 91|02|vm02 PCP 3.11.4 i686 openSUSE 13.2
2016-08-09 883 881 2 57|03|vm03 PCP 3.11.4 x86_64 Fedora 24
2016-08-10 756 754 2 184|04|vm04 PCP 3.11.4 i686 CentOS 5.11
2016-08-10 854 851 3 86|05|vm05 PCP 3.11.4 x86_64 Gentoo 2.2
2016-08-10 61 61 0 4|06|vm06 PCP 3.11.4 amd64 FreeBSD 10.2-RELEASE
2016-08-10 859 859 0 81|07|vm07 PCP 3.11.4 x86_64 Debian stretch/sid
2016-08-08 560 559 1 30|08|vm08 PCP 3.11.4 x86_64 CentOS Linux7.2.1511
2016-08-08 61 61 0 4|09|vm09 PCP 3.11.4 i386 NetBSD 6.1.5
2016-08-09 61 61 0 4|10|vm10 PCP 3.11.4 i386 FreeBSD 9.3-RELEASE-p30
2016-08-10 857 856 1 83|11|vm11 PCP 3.11.5 i686 Debian stretch/sid
2016-08-10 874 873 1 66|12|vm12 PCP 3.11.5 i686 Fedora 22
2016-08-11 872 872 0 68|14|vm14 PCP 3.11.5 x86_64 CentOS6.7
2016-08-08 804 804 0 136|15|vm15 PCP 3.11.4 x86_64 Slackware "14.2"
2016-08-11 871 870 1 69|18|vm18 PCP 3.11.4 x86_64 LinuxMint 17.3
2016-08-04 845 843 2 95|19|vm19 PCP 3.11.4 x86_64 openSUSE 12.2
2016-08-07 873 873 0 67|20|vm20 PCP 3.11.4 x86_64 Ubuntu 14.04
2016-08-07 854 854 0 86|21|vm21 PCP 3.11.4 i686 Debian 7.10
2016-08-07 874 872 2 66|22|vm22 PCP 3.11.4 x86_64 Fedora 19
2016-08-08 877 877 0 63|23|vm23 PCP 3.11.4 i686 Fedora 20
2016-08-08 870 870 0 70|24|vm24 PCP 3.11.4 i686 openSUSE 13.1
2016-08-08 751 750 1 189|25|vm25 PCP 3.11.4 x86_64 CentOS 5.11
2016-08-09 876 876 0 64|26|vm26 PCP 3.11.4 x86_64 Fedora 21
2016-08-10 865 865 0 75|27|vm27 PCP 3.11.5 x86_64 Ubuntu 15.04
2016-08-08 870 869 1 70|28|vm28 PCP 3.11.5 x86_64 RHEL Server 6.8
2016-08-07 877 877 0 63|29|vm29 PCP 3.11.4 x86_64 RHEL Server 7.2
2016-08-08 875 875 0 65|30|vm30 PCP 3.11.4 x86_64 SUSE SLES12 SP0
2016-08-09 875 873 2 65|31|vm31 PCP 3.11.4 x86_64 Fedora 23
2016-08-11 74 74 0 5|32|vm32 PCP 3.11.5 amd64 FreeBSD 11.0-CURRENT
2016-08-11 64 63 1 1|33|vm33 PCP 3.11.4 amd64 OpenBSD 5.8
2016-08-10 866 865 1 74|34|vm34 PCP 3.11.4 x86_64 Arch Linux
Summary: 26562 run, 35 failed (0.13%)
==== QA Failure (X) and Not Run or Skipped (-) Map ====
Host fu gr 00 01 02 03 04 05 08 11 12 18 19 22 25 28 31 33 34
Test %fail Test QA
groups
651 8% - X X X - 651 pmproxy
713 8% - X X X - - - - 713
context libpcp pmproxy secure
662 5% - - - - X - - - - - X 662
pmwebapi pmda.sample
667 5% - X X - - - - - 667 python
098 3% X - 098 pmlc
pmlogger other pmdumplog
102 3% X - 102 pmlc
pmlogger
156 3% X - 156
pmda.sample pmda.proc pmcd_wait pmda.install
169 3% X - 169 pmcd
216 3% - X - 216
pmda.linux
230 3% - X - 230
pmlogger pmlc
359 3% - X 359 pmcd
pminfo
371 3% - X - 371
pmimport pmdumplog perl libpcp_pmi
372 3% - X - 372
pmimport pmdumplog perl
389 3% - X - 389
pmlogger
416 3% - X 416
pmda.news dbpmda perl
527 3% - X - 527
libpcp_import perl timezone
581 3% - X - 581 pmie
652 3% - - - - - - X - - - - - - 652
pmda.systemd event flakey
Host fu gr 00 01 02 03 04 05 08 11 12 18 19 22 25 28 31 33 34
Test %fail Test QA
groups
739 3% - - X - - - - 739 python
getopt timezone
740 3% - - X - 740
pmda.sample pmstore secure
778 3% - - - - - - - - - - X - - - - - - - 778
pmda.postgresql pmie
798 3% - - X - 798
pmda.nfsclient
823 3% - - - - X - - - - - - 823
pmda.sample pmstore secure
832 3% - - - X - - - - - 832
pmda.sample pmstore secure
870 3% - X - - 870
pmlogcheck
878 3% - - X - 878
pmda.pipe pmval
892 3% - X - - 892 pmcd
libpcp
999 3% - X - - 999 pmns
1068 3% - - - - - - X - 1068 pmrep
python zabbix
Test %fail Test QA
groups
Host fu gr 00 01 02 03 04 05 08 11 12 18 19 22 25 28 31 33 34
|