Below is the updated status.
Still some gopher smacking to be done, but the overall stats are of 9206
tests run (and remember each "test" includes many, sometimes thousands,
of individual tests of PCP functionality), we failed 126 or 1.37% ... I
think 0% is unrealistic given all of the environmental factors at play
and some amount of bad luck, but I would like to see this consistently
below 1% ... fixing my Mac OS X testing would just about do that, and/or
fixing 083, 116 and 709.
Also the not run numbers are still higher than I'd expect ... I'm
considering permanently retiring all the Purify tests (these are covered
(sic) by valgrind tests), and I don't know of anyone on this list that
has access to a working Purify environment any more. Ditto for the tests
that are only run on IRIX.
run 9206 pass 9077 fail 126 % fail 1.37
==== QA Summary ====
Date Run Pass Fail Nrun Host
2013-04-02 562 558 4 43|bozo PCP 3.7.1 x86_64 Ubuntu 12.10
2013-04-02 561 554 7 43|bozo-laptop PCP 3.7.1 i686 Ubuntu 12.10
2013-03-26 514 482 32 91|comma PCP 3.7.1 i386 Darwin 10.8.0
2013-03-27 502 497 5 58|grundy PCP 3.7.1 ia64 SUSE Linux
Enterprise Server 11
2013-03-26 516 515 1 44|vm00 PCP 3.7.1 x86_64 Ubuntu 12.04
2013-03-26 554 548 6 51|vm01 PCP 3.7.1 i686 Ubuntu 12.10
2013-03-26 516 513 3 44|vm02 PCP 3.7.1 i686 openSUSE 12.1
2013-03-26 550 538 12 55|vm03 PCP 3.7.1 x86_64 Fedora 18
2013-03-26 549 539 10 56|vm04 PCP 3.7.1 i586 CentOS 5.9
2013-03-27 536 529 7 69|vm05 PCP 3.7.1 i486 Gentoo 2.0.3
2013-03-26 554 547 7 51|vm07 PCP 3.7.1 x86_64 Debian 6.0.5
Daily runs, but no QA |vm09 PCP 3.7.0 i386 NetBSD 5.1.2
2013-03-27 553 543 10 52|vm11 PCP 3.7.1 i586 Debian 6.0.7
2013-03-26 549 541 8 56|vm12 PCP 3.7.1 i686 Fedora 17
2013-03-26 552 547 5 53|vm14 PCP 3.7.1 x86_64 CentOS 6.3
Daily runs, but no QA |vm15 PCP 3.7.1 x86_64 Slackware 13.37.0
2013-03-26 538 534 4 67|vm16 PCP 3.7.1 x86_64 MandrivaLinux 2011.0
2013-03-26 550 545 5 55|vm18 PCP 3.7.1 x86_64 LinuxMint 12
2013-03-27 550 547 3 55|vm19 PCP 3.7.1 x86_64 openSUSE 12.2
==== QA Failure Map ====
Host bo bl co gr 00 01 02 03 04 05 07 11 12 14 16 18 19
QA QA QA groups
(A. ==> pmda.)
062 X X X X X X X 062 pmcd
067 X X X X 067 pmcd
069 X 069 pmcd pmval
083 X X X X X X X X X X X X 083 pmlc
pmlogger compat
087 X 087 archive
100 X 100 pmlc
pmlogger pmdumplog
110 X 110 A.simple
A.proc A.install
115 X 115 pmie
116 X X X X X X X X X X X X 116 other pmie
pmval pmlc
135 X 135 pmlc
archive pmdumplog
162 X 162 pmda
A.proc A.shping A.install
172 X 172 pmcd pmlc
183 X X 183 logutil
244 X 244 pmcd pmprobe
255 X X 255 compat
pmda A.proc help A.install A.simple
273 X X 273 libpcp
279 X 279 pmcd
287 X X X X 287
pmlogreduce pmval
316 X 316 libpcp
322 X X X 322 pmlc pmlogger
325 X 325 libpcp
339 X 339 pmie
340 X 340 pmcd
359 X X 359 pmcd pminfo
365 X X 365 pmcd
369 X 369 pmimport
pmdumplog perl
372 X 372 pmimport
pmdumplog perl
375 X X 375 pmlc pmlogger
411 X 411 A.simple
A.install
430 X 430 logutil folio
441 X X 441 pmlogger
442 X X 442 pmlogextract
444 X 444 event
449 X 449 threads
457 X 457 A.logger
A.install event
459 X 459
pmlogreduce valgrind
461 X 461 A.logger
A.install event
482 X 482
pmlogsummary pmdumplog
506 X X 506 pmlogrewrite
507 X 507 other
510 X 510 pmlogger
511 X X 511 pmimport
pmdumplog pmlogsummary perl
513 X 513 libpcp pdu
514 X 514 pmie
515 X 515 pmie
518 X 518 other
520 X 520 pmie
523 X 523 pmie
532 X X 532 logutil
pmlogextract
555 X X X 555 pmie
560 X 560 A.simple
A.install
572 X 572 pmcd pmda
A.install
578 X 578 pmcd
A.install pmval
603 X 603 trace
A.install
622 X X X X 622 pmie
635 X X 635 A.linux
libirixpmda
642 X 642 A.trivial
pmns A.simple A.sample A.sendmail trace
652 X 652 A.systemd
event
653 X 653 libpcp
709 X X X X X X X 709 pcp.py
712 X X X 712 context
libpcp pmcd
713 X X X 713 context
libpcp pmproxy
714 X 714 context
libpcp pmcd
Host bo bl co gr 00 01 02 03 04 05 07 11 12 14 16 18 19
|