[warning, view in a wide window ... 8^)>]
Here's a snapshot of my current QA landscape ... I'm about 3/4 of the way
through a full pass across all hosts.
Of the 276 failures, a small number look like systemic QA setup or QA test
failures, but all of the others need individual inspection.
It takes me between 1 and 10 minutes to triage and resolve a single QA failure
... so I can't clear the backlog before the next release is due and the
situation is probably not sustainable, especially as this is a pro bono love
job.
Just FYI.
kenj@bozo:~/Logs/by-vm/vm05$ pcp-qa-summary
==== QA Summary ====
Date Run Pass Fail Nrun Host
2014-09-02 674 660 14 62|bozo-laptop PCP 3.9.10 i686 LinuxMint 15
2014-08-24 63 61 2 1|bozo-vm PCP 3.9.10 x86_64 Debian 7.5
No daily runs |fuji PCP 3.9.2 i386 Darwin 10.8.0
2014-09-01 609 595 14 80|grundy PCP 3.9.10 ia64 SUSE SLES11 SP1
2014-09-01 685 681 4 48|vm00 PCP 3.9.10 x86_64 Ubuntu 12.04
2014-09-02 679 664 15 58|vm01 PCP 3.9.10 i686 Ubuntu 12.10
2014-09-02 675 664 11 62|vm02 PCP 3.9.10 i686 openSUSE 12.1
2014-09-02 686 676 10 51|vm03 PCP 3.9.10 x86_64 Fedora 18
2014-09-04 639 607 32 98|vm04 PCP 3.9.10 i586 CentOS 5.10
2014-09-03 63 61 2 1|vm05 PCP 3.9.10 i486 Gentoo 2.0.3
Daily runs, but no QA |vm06 PCP 3.9.10 amd64 FreeBSD 8.2-RELEASE-p9
2014-09-03 667 651 16 70|vm07 PCP 3.9.10 x86_64 Debian 6.0.9
Daily runs, but no QA |vm09 PCP 3.9.1 i386 NetBSD 5.1.2
Daily runs, but no QA |vm10 PCP 3.9.2 i386 FreeBSD 8.2-RELEASE-p9
2014-09-03 667 648 19 70|vm11 PCP 3.9.10 i686 Debian 6.0.9
2014-09-03 647 626 21 90|vm12 PCP 3.9.10 i686 Fedora 17
2014-09-04 672 664 8 65|vm14 PCP 3.9.10 x86_64 CentOS6.5
No daily runs |vm15 PCP 3.9.1 x86_64 Slackware 13.37.0
Daily runs, but no QA |vm16 PCP 3.8.0 x86_64 MandrivaLinux 2011.0
2014-09-04 678 666 12 59|vm18 PCP 3.9.10 x86_64 LinuxMint 12
2014-08-24 64 59 5 0|vm19 PCP 3.9.10 x86_64 openSUSE 12.2
2014-09-02 649 636 13 87|vm20 PCP 3.9.10 x86_64 Ubuntu 13.04
2014-09-01 663 627 36 73|vm21 PCP 3.9.10 i686 Debian 7.4
2014-08-24 64 58 6 0|vm22 PCP 3.9.10 x86_64 Fedora 19
2014-08-24 64 58 6 0|vm23 PCP 3.9.10 i686 Fedora 20
2014-09-02 641 608 33 95|vm24 PCP 3.9.10 i686 openSUSE 13.1
Summary: 10249 run, 279 failed (2.72%)
==== QA Failure (X) Map ====
Host bl bv gr 00 01 02 03 04 05 07 11 12 14 18 19 20 21 22 23 24
QA QA QA groups
002 X X X 002 pdu pmcd
003 X 003 pdu pmcd
mem_leak
023 X 023 pmcd
pmprobe
026 X X X 026 other
help libpcp
029 X X X X X X X X 029 pmns
pmdumplog
061 X X 061 pmlogger
pmlc pmdumplog
066 X 066 pmcd
069 X X X X 069 pmcd pmval
083 X X X X 083 pmlc
pmlogger compat
098 X 098 pmlc
pmlogger other pmdumplog
107 X X 107 pmlc
pmlogger
115 X X X X 115 pmie
119 X 119 logutil
139 X X X X X X X X 139 pmlc
169 X 169 pmcd
184 X X 184 logutil
folio pmdumplog
188 X 188 libpcp
193 X 193 libpcp
pmcd pdu
198 X X 198 pmda
context
232 X 232 libpcp
244 X 244 pmcd
pmprobe
255 X 255 compat
pmda pmda.proc help pmda.install pmda.simple
256 X X X 256 derive
pmns
259 X X X X 259 derive
pmval
260 X X X X 260 derive
pmie
279 X 279 pmcd
280 X 280 pmlogger
logutil folio
322 X X X X X 322 pmlc
pmlogger
339 X 339 pmie
340 X 340 pmcd
354 X X X X X 354 folio
359 X 359 pmcd
pminfo
361 X X X X X X X X 361 pmda.linux
364 X 364 pmlogconf
365 X 365 pmcd
370 X X 370 pmimport
derive pmdumplog perl
374 X X X 374 pmlc
pmlogger
375 X X X 375 pmlc
pmlogger
381 X 381 logutil
pmlc
388 X X 388 archive
mem_leak valgrind
391 X 391 archive
mem_leak valgrind
393 X X 393 archive
mem_leak valgrind
394 X X 394 archive
mem_leak valgrind flakey
400 X X 400 pminfo
mem_leak valgrind context_local libpcp event
430 X X X 430 logutil
folio
449 X 449 threads
flakey
459 X X X 459
pmlogreduce valgrind
510 X 510 pmlogger
pmlc
511 X 511 pmimport
pmdumplog pmlogsummary perl
519 X 519 pmie
533 X 533 dbpmda
pmda.sample
540 X 540
pmda.linux pminfo
553 X 553 dbpmda
python pmda.gluster
555 X 555 pmie
569 X X X 569 pmprobe
580 X 580 indom
583 X 583 pmie
603 X X X 603 trace
pmda.install
622 X X X X X X 622 pmie
635 X X 635
pmda.linux libirixpmda
652 X X 652
pmda.systemd event flakey
702 X X X X X 702 python
libpcp
707 X X X X X 707 python
libpcp
708 X 708 python
pmimport
709 X X 709 python
710 X 710 python
pmimport
711 X 711 pmimport
pmdumplog pmlogsummary perl
712 X X X X 712 context
libpcp pmcd secure
713 X X X X X X 713 context
libpcp pmproxy secure
714 X X X X 714 context
libpcp pmcd secure
722 X X X X X 722 python
729 X 729 python
734 X X 734 libpcp
pmstat
738 X 738 logutil
739 X 739 python
getopt
740 X 740
pmda.sample pmstore secure
741 X X 741 python
getopt
742 X X 742 python
743 X X 743 python
752 X X X 752 libpcp
753 X 753 derive
pmie
755 X X X 755
pmda.apache pmda.install
763 X 763 pmda
776 X 776 pmfind
780 X X X X X X X X X 780 pmwebapi
781 X X X X X X X X X 781 logutil
798 X 798
pmda.nfsclient
828 X X X X X X X X X X X X 828 valgrind
archive context
829 X X 829 python
833 X X X X X X X X X X 833 archive
context
841 X X X 841 pmda
842 X X X X X X X X 842 python
861 X X 861 pmcd
pmda.pmcd
875 X 875 libpcp
943 X X X 943 pmprobe
pmda.proc
944 X X X X X 944 pmcd
secure
966 X X X 966 secure
972 X 972
pmda.zswap dbpmda
979 X X 979 python
980 X X 980 python
985 X 985
pmda.dmcache dbpmda
986 X X X 986
pmda.dmcache pmda.install
988 X 988 pmda.xfs
valgrind
991 X X 991 python
994 X X X X 994 other
verify
Host bl bv gr 00 01 02 03 04 05 07 11 12 14 18 19 20 21 22 23 24
|