Below is the QA summary for runs over the last few days.
I did have the failure rate down to under 0.5% a couple of weeks back (see the
vm16, bozo and bozo-laptop results), but we've gone backwards since then.
I suspect most of these are QA regressions, rather than code regressions, but
there is going to be a fair amount of slogging to get to the end of this. Any
help with the "seems to be failing most places" cases would be appreciated
(e.g. I think I've fixed 374 and 375 since these results were produced).
==== QA Summary ====
Date Run Pass Fail Nrun Host
2013-04-25 565 565 0 34|bozo PCP 3.8.0 x86_64 Ubuntu 12.10
2013-04-19 562 562 0 37|bozo-laptop PCP 3.7.2 i686 Ubuntu 12.10
2013-05-08 542 503 39 66|comma PCP 3.8.0 i386 Darwin 10.8.0
2013-05-09 507 494 13 56|grundy PCP 3.8.0 ia64 SUSE SLES11 SP1
2013-05-08 561 557 4 47|vm00 PCP 3.8.0 x86_64 Ubuntu 12.04
2013-05-08 569 550 19 39|vm01 PCP 3.8.0 i686 Ubuntu 12.10
2013-05-08 561 546 15 47|vm02 PCP 3.8.0 i686 openSUSE 12.1
2013-05-08 561 550 11 47|vm03 PCP 3.8.0 x86_64 Fedora 18
2013-05-08 557 535 22 51|vm04 PCP 3.8.0 i586 CentOS 5.9
2013-05-08 542 521 21 66|vm05 PCP 3.8.0 i486 Gentoo 2.0.3
2013-05-08 570 553 17 38|vm07 PCP 3.8.0 x86_64 Debian 6.0.5
2013-05-08 561 543 18 47|vm11 PCP 3.8.0 i586 Debian 6.0.7
2013-05-08 557 537 20 51|vm12 PCP 3.7.2 i686 Fedora 17
2013-05-08 562 546 16 46|vm14 PCP 3.8.0 x86_64 CentOS 6.3
Daily runs, but no QA |vm15 PCP 3.7.1 x86_64 Slackware 13.37.0
2013-04-24 503 502 1 51|vm16 PCP 3.8.0 x86_64 MandrivaLinux 2011.0
2013-05-08 561 546 15 47|vm18 PCP 3.7.2 x86_64 LinuxMint 12
2013-05-08 558 543 15 50|vm19 PCP 3.8.0 x86_64 openSUSE 12.2
Summary: 9399 run, 246 failed (2.62%)
==== QA Failure Map ====
Host co gr 00 01 02 03 04 05 07 11 12 14 16 18 19
QA QA QA groups (A. ==> pmda.)
000 X 000 other pmcd
023 X 023 pmcd pmprobe
024 X X 024 context context_local
051 X X X X X X X X X 051 pmcd
062 X 062 pmcd
088 X 088 archive pmval
110 X X X X X X X X X X X X 110 A.simple A.proc A.install
116 X X 116 other pmie pmval pmlc
162 X X X X X X X X X X X X 162 pmda A.proc A.shping
A.install
187 X 187 pmcd pmlogger pmstore
244 X 244 pmcd pmprobe
255 X X X X X X X X X X X X 255 compat pmda A.proc help
A.install A.simple
322 X 322 pmlc pmlogger
339 X 339 pmie
359 X 359 pmcd pminfo
360 X 360 pmie
367 X X X X X X X X X X 367 pdu trace
371 X X X X X X X X X X X X X X 371 pmimport pmdumplog perl
372 X 372 pmimport pmdumplog perl
373 X 373 pmimport perl
374 X X X X X X X X X X X 374 pmlc pmlogger
375 X X X X X X X X X X X 375 pmlc pmlogger
381 X 381 logutil pmlc
387 X 387 pmns mem_leak valgrind
388 X 388 archive mem_leak valgrind
391 X 391 archive mem_leak valgrind
393 X X 393 archive mem_leak valgrind
394 X X 394 archive mem_leak valgrind
395 X 395 archive mem_leak valgrind
400 X 400 pminfo mem_leak valgrind
context_local libpcp event
411 X X X X X X X X X X X X 411 A.simple A.install
416 X 416 A.news dbpmda perl
430 X 430 logutil folio
444 X 444 event
449 X 449 threads
459 X X X 459 pmlogreduce valgrind
461 X 461 A.logger A.install event
507 X X 507 other
510 X 510 pmlogger
511 X 511 pmimport pmdumplog
pmlogsummary perl
513 X X X X X X X 513 libpcp pdu
514 X 514 pmie
515 X 515 pmie
518 X 518 other
520 X 520 pmie
523 X 523 pmie
526 X X X 526 pmimport
532 X X 532 logutil pmlogextract
555 X 555 pmie
560 X X X X X X X X X X X X 560 A.simple A.install
572 X X X X X X X X X X X X 572 pmcd pmda A.install
A.sample A.simple A.trivial
578 X X X X X X X X X X X X 578 pmcd A.install pmval
635 X 635 A.linux libirixpmda
642 X X X X X X X X X X X X 642 A.trivial pmns A.simple
A.sample A.sendmail trace
652 X 652 A.systemd event
653 X 653 libpcp
706 X 706 libpcp
707 X 707 python libpcp
708 X 708 python pmimport
709 X X X X X X X X X 709 python
710 X 710 python pmimport
712 X X X 712 context libpcp pmcd
713 X X X X 713 context libpcp pmproxy
714 X X X 714 context libpcp pmcd
715 X X X X X X X X X X X X 715 A.simple perl
716 X 716 dbpmda A.simple perl
Host co gr 00 01 02 03 04 05 07 11 12 14 16 18 19
|