Things are looking better, but not yet back to where they were 6 months ago.
1108 is a mystery ... we get 2 primary pmloggers started from pmlogger_check
(this is not supposed to happen, ever!). The failure is non-deterministic.
I've been unable to track it down ... most likely it will be a race triggered
by some earlier QA test (could be a long time before 1108 I think) and no one
else notices until 1108 stumbles along.
361 has gone a bit under the radar ... it is not passing _anywhere_ as it is
not run or skipped (-) in the (new) full report on all but 4 hosts and it fails
on the 4 hosts on which it is run. Note %fail is percentage of all hosts, not
just percentage of hosts on which the test was run, which is why %fail for 361
is 11% and not 100%.
Appart from that, there are odd failures all over the landscape which make it
very hard to progress any of this in a dramatic fashion ... if you really care
about any of the failing tests below, I'd appreciate any assistance you could
offer to smack 'em into submission.
Cheers, Ken.
Details for the most commonly failing tests are available from
ftp://oss.sgi.com/projects/pcp/download/qa-status/
=== Synopsis ===
QA Status from Ken McDonell's QA Farm in Melbourne
Summary: 26361 run, 86 failed (0.33%)
QA Test Fail Failure Signatures (number of different failure patterns)
1108 14 1 1 1 1 1 1 1 1 1 1 1 1 1
823 5 4 1
578 4 1 1 1 1
381 4 3 1
361 4 4
^ ^
| |
| +-- A B C ... means one failure signature occurred A times,
| another occurred B times, a third occurred C times, ...
+-- total number of failures for this test, equals A+B+C+...
Each tarball in this directory contains .out, .out.bad and possibly
.full files for all failing test cases where a test failed on at least
9% of the QA hosts.
The latest tarball is 20160719.tgz.
==== QA Summary ====
Date Run Pass Fail Nrun Host
2016-07-17 844 842 2 91|bo|bozo PCP 3.11.4 x86_64 Ubuntu 16.04
2016-07-15 826 825 1 106|bl|bozo-laptop PCP 3.11.4 i686 LinuxMint 15
2016-07-19 835 834 1 97|bv|bozo-vm PCP 3.11.4 x86_64 Debian 8.5
2016-07-16 705 698 7 230|fu|fuji PCP 3.11.4 i386 Darwin 10.8.0
2016-07-19 748 742 6 142|gr|grundy.sgi.com|grundy.sgi.com
2016-07-19 855 852 3 81|00|vm00 PCP 3.11.4 x86_64 Ubuntu 12.04
2016-07-15 864 861 3 71|01|vm01 PCP 3.11.4 i686 Ubuntu 15.10
2016-07-16 846 845 1 89|02|vm02 PCP 3.11.4 i686 openSUSE 13.2
2016-07-15 879 878 1 56|03|vm03 PCP 3.11.4 x86_64 Fedora 24
2016-07-16 753 749 4 182|04|vm04 PCP 3.11.4 i686 CentOS 5.11
2016-07-16 850 848 2 85|05|vm05 PCP 3.11.4 x86_64 Gentoo 2.2
2016-07-16 61 61 0 4|06|vm06 PCP 3.11.4 amd64 FreeBSD 10.2-RELEASE
2016-07-16 820 815 5 80|07|vm07 PCP 3.11.4 x86_64 Debian stretch/sid
2016-07-18 875 873 2 60|08|vm08 PCP 3.11.4 x86_64 CentOS Linux7.2.1511
2016-07-18 61 61 0 4|09|vm09 PCP 3.11.4 i386 NetBSD 6.1.5
2016-07-16 61 61 0 4|10|vm10 PCP 3.11.4 i386 FreeBSD 9.3-RELEASE-p30
2016-07-16 821 814 7 79|11|vm11 PCP 3.11.4 i686 Debian stretch/sid
2016-07-16 870 868 2 65|12|vm12 PCP 3.11.4 i686 Fedora 22
2016-07-17 868 864 4 67|14|vm14 PCP 3.11.4 x86_64 CentOS6.7
2016-07-18 801 800 1 134|15|vm15 PCP 3.11.4 x86_64 Slackware "14.2"
2016-07-17 860 860 0 75|18|vm18 PCP 3.11.4 x86_64 LinuxMint 17.3
2016-07-17 841 840 1 94|19|vm19 PCP 3.11.4 x86_64 openSUSE 12.2
2016-07-17 801 800 1 134|20|vm20 PCP 3.11.4 x86_64 Ubuntu 13.04
2016-07-17 850 848 2 85|21|vm21 PCP 3.11.4 i686 Debian 7.10
2016-07-17 62 61 1 4|22|vm22 PCP 3.11.4 x86_64 Fedora 19
2016-07-18 873 871 2 62|23|vm23 PCP 3.11.4 i686 Fedora 20
2016-07-18 868 866 2 67|24|vm24 PCP 3.11.4 i686 openSUSE 13.1
2016-07-18 748 748 0 187|25|vm25 PCP 3.11.4 x86_64 CentOS 5.11
2016-07-19 873 872 1 63|26|vm26 PCP 3.11.4 x86_64 Fedora 21
2016-07-17 859 854 5 76|27|vm27 PCP 3.11.4 x86_64 Ubuntu 15.04
2016-07-18 866 862 4 69|28|vm28 PCP 3.11.4 x86_64 RHEL Server 6.8
2016-07-17 873 870 3 62|29|vm29 PCP 3.11.4 x86_64 RHEL Server 7.2
2016-07-18 871 868 3 64|30|vm30 PCP 3.11.4 x86_64 SUSE SLES12 SP0
2016-07-19 871 868 3 64|31|vm31 PCP 3.11.4 x86_64 Fedora 23
2016-07-18 74 74 0 5|32|vm32 PCP 3.11.4 amd64 FreeBSD 11.0-CURRENT
2016-07-18 64 63 1 1|33|vm33 PCP 3.11.4 amd64 OpenBSD 5.8
2016-07-18 864 859 5 72|34|vm34 PCP 3.11.4 x86_64 Arch Linux
Summary: 26361 run, 86 failed (0.33%)
==== QA Failure (X) and Not Run or Skipped (-) Map ====
Host bo bl bv fu gr 00 01 02 03 04 05 07 08 11 12 14 15 19 20 21 22 23 24
26 27 28 29 30 31 33 34
Test %fail
Test QA groups
1108 38% X X X X X X X X X X - X
X X - X 1108 logutil folio pmlogextract
823 14% - - - - - - X X - - X - - - - X
- - X 823 pmda.sample pmstore secure
361 11% - - - - - X - - - - - - - - - X - - - X - - -
- - X - - - - - 361 pmda.linux cgroups
381 11% - - X - - X
X X - 381 logutil pmlc
578 11% X X -
X X - 578 pmcd pmda.install pmval
651 8% X X -
X - 651 pmproxy
667 8% - X - - - - -
X X - 667 python
260 5% X -
X - 260 derive pmie
662 5% - - - - - - - - - - - - -
X - X 662 pmwebapi pmda.sample
666 5% X - - - -
X - 666 pmmgr slow valgrind
713 5% - X X - -
- 713 context libpcp pmproxy secure
836 5% - X
X - 836 pmlogsummary pmdiff
857 5% - - - - - - - - - - X X - - -
- - - 857 pmda.linux
892 5% - X -
- X 892 pmcd libpcp
914 5% - - - - - - - X X - - - - - - -
- - - - - - - - 914 pmda.papi
990 5% - - X X - -
- 990 pmda.mmv
069 3% - - - X
- 069 pmcd pmval
102 3% X -
- 102 pmlc pmlogger
Host bo bl bv fu gr 00 01 02 03 04 05 07 08 11 12 14 15 19 20 21 22 23 24
26 27 28 29 30 31 33 34
Test %fail
Test QA groups
156 3% X -
- 156 pmda.sample pmda.proc pmcd_wait pmda.install
200 3% -
X - 200 context
216 3% - X -
- 216 pmda.linux
297 3% - X -
- 297 pmproxy
300 3% -
X - 300 pmcd
340 3% - - - -
X - 340 pmcd
359 3% X -
359 pmcd pminfo
371 3% X -
- 371 pmimport pmdumplog perl libpcp_pmi
372 3% X -
- 372 pmimport pmdumplog perl
389 3% X -
- 389 pmlogger
416 3% -
X 416 pmda.news dbpmda perl
430 3% X -
- 430 logutil folio
459 3% - - X - - - -
- 459 pmlogreduce valgrind
527 3% X -
- 527 libpcp_import perl timezone
581 3% -
X - 581 pmie
660 3% - - - - -
- X 660 pmwebapi
669 3% - -
X - 669 pmmgr
709 3% X - -
- 709 python
720 3% X - - - - - -
- 720 libpcp valgrind
739 3% X - -
- 739 python getopt timezone
788 3% X -
- 788 pmda.nginx pmda.install
Host bo bl bv fu gr 00 01 02 03 04 05 07 08 11 12 14 15 19 20 21 22 23 24
26 27 28 29 30 31 33 34
Test %fail
Test QA groups
832 3% - - - - - - X - - - - - -
- - 832 pmda.sample pmstore secure
878 3% X -
- 878 pmda.pipe pmval
956 3% X -
- 956 pmcd
983 3% - - X - - - -
- 983 pmie
999 3% X -
- 999 pmns
1051 3% X -
- 1051 pmieconf
Test %fail
Test QA groups
Host bo bl bv fu gr 00 01 02 03 04 05 07 08 11 12 14 15 19 20 21 22 23 24
26 27 28 29 30 31 33 34
|