Below is the current QA landscape.
There are several hidden milestones here.
+ scheduling of pcp-daily in my QA farm has moved from ad hoc when time permits
to cron-driven ... this means each host is getting exercised at least twice a
week, or 28,000+ tests per week
+ failures in absolute terms are below 10 on all hosts, with some even showing
the nirvana-like "0" failures
+ overall failure rate is below 1%
+ total failures are less than 100
We have never been in such a good position, ever, in the past.
Now if I can just get some assistance with the recalcitrant ones (115, 361, 753
and 944) we'll quickly get this down to "onesies and twosies" per host.
As always, I would encourage suggestions of platforms we should ADD or DROP
from the QA farm.
kenj@bozo:~$ pcp-qa-summary -fr
==== QA Summary ====
Date Run Pass Fail Nrun Host
2014-09-04 687 682 5 50|bozo PCP 3.10.0 x86_64 Ubuntu 14.04
2014-09-16 688 685 3 55|bozo-laptop PCP 3.10.0 i686 LinuxMint 15
2014-09-16 676 670 6 66|bozo-vm PCP 3.10.0 x86_64 Debian 7.5
No daily runs |fuji PCP 3.9.2 i386 Darwin 10.8.0
2014-09-16 611 604 7 86|grundy PCP 3.10.0 ia64 SUSE SLES11 SP1
2014-09-16 672 669 3 70|vm00 PCP 3.10.0 x86_64 Ubuntu 12.04
2014-09-16 674 671 3 69|vm01 PCP 3.10.0 i686 Ubuntu 12.10
2014-09-16 669 662 7 74|vm02 PCP 3.10.0 i686 openSUSE 12.1
2014-09-16 682 678 4 62|vm03 PCP 3.10.0 x86_64 Fedora 18
2014-09-17 643 641 2 101|vm04 PCP 3.10.0 i586 CentOS 5.10
2014-09-17 618 611 7 126|vm05 PCP 3.10.0 i486 Gentoo 2.0.3
2014-09-17 60 60 0 4|vm06 PCP 3.10.0 amd64 FreeBSD 8.2-RELEASE-p9
2014-09-17 672 664 8 72|vm07 PCP 3.10.0 x86_64 Debian 6.0.9
2014-09-15 60 56 4 4|vm10 PCP 3.10.0 i386 FreeBSD 8.2-RELEASE-p9
2014-09-17 672 667 5 72|vm11 PCP 3.10.0 i686 Debian 6.0.9
2014-09-17 654 652 2 90|vm12 PCP 3.10.0 i686 Fedora 17
2014-09-18 678 674 4 66|vm14 PCP 3.10.0 x86_64 CentOS6.5
No daily runs |vm15 PCP 3.9.1 x86_64 Slackware 13.37.0
2014-09-18 674 672 2 70|vm18 PCP 3.10.0 x86_64 LinuxMint 12
2014-09-18 673 669 4 71|vm19 PCP 3.10.0 x86_64 openSUSE 12.2
2014-09-14 653 653 0 89|vm20 PCP 3.10.0 x86_64 Ubuntu 13.04
2014-09-14 673 671 2 69|vm21 PCP 3.10.0 i686 Debian 7.4
2014-09-14 661 652 9 81|vm22 PCP 3.10.0 x86_64 Fedora 19
2014-09-15 679 676 3 63|vm23 PCP 3.10.0 i686 Fedora 20
2014-09-15 647 643 4 95|vm24 PCP 3.10.0 i686 openSUSE 13.1
Summary: 14076 run, 94 failed (0.67%)
==== QA Failure (X) Map ====
Host bo bl bv gr 00 01 02 03 04 05 07 10 11 12 14 18 19 21 22 23 24
Test %bad Test
QA groups
115 38% X X X X X X X X 115
pmie
361 38% X X X X X X X X 361
pmda.linux
752 38% X X X X X X X X 752
libpcp
944 33% X X X X X X X 944
pmcd secure
994 24% X X X X X 994
other verify
734 19% X X X X 734
libpcp pmstat
943 19% X X X X 943
pmprobe pmda.proc
260 14% X X X 260
derive pmie
722 14% X X X 722
python
023 10% X X 023
pmcd pmprobe
232 10% X X 232
libpcp
540 10% X X 540
pmda.linux pminfo
603 10% X X 603
trace pmda.install
823 10% X X 823
pmda.sample pmstore secure
828 10% X X 828
valgrind archive context
835 10% X X 835
pmda.memcache
031 5% X 031
pmns
069 5% X 069
pmcd pmval
Host bo bl bv gr 00 01 02 03 04 05 07 10 11 12 14 18 19 21 22 23 24
083 5% X 083
pmlc pmlogger compat
088 5% X 088
archive pmval
093 5% X 093
archive
112 5% X 112
pmns
188 5% X 188
libpcp
198 5% X 198
pmda context
241 5% X 241
pmda.mmv pmval perl
322 5% X 322
pmlc pmlogger
340 5% X 340
pmcd
364 5% X 364
pmlogconf
366 5% X 366
pmlogconf
374 5% X 374
pmlc pmlogger
375 5% X 375
pmlc pmlogger
507 5% X 507
other
510 5% X 510
pmlogger pmlc
511 5% X 511
pmimport pmdumplog pmlogsummary perl
533 5% X 533
dbpmda pmda.sample
574 5% X 574
libpcp pmns compat
635 5% X 635
pmda.linux libirixpmda
652 5% X 652
pmda.systemd event flakey
721 5% X 721
dbpmda
Host bo bl bv gr 00 01 02 03 04 05 07 10 11 12 14 18 19 21 22 23 24
744 5% X 744
pmda.nvidia
745 5% X 745
pmda.nvidia valgrind
776 5% X 776
pmfind
780 5% X 780
pmwebapi
798 5% X 798
pmda.nfsclient
833 5% X 833
archive context
875 5% X 875
libpcp valgrind
Host bo bl bv gr 00 01 02 03 04 05 07 10 11 12 14 18 19 21 22 23 24
|