| To: | pcp@xxxxxxxxxxx |
|---|---|
| Subject: | State of PCP QA |
| From: | kenj@xxxxxxxxxxxxxxxx (Ken McDonell) |
| Date: | Mon, 3 Aug 2015 08:45:11 +1000 (AEST) |
| Delivered-to: | pcp@xxxxxxxxxxx |
>From my QA Farm ...
Executive Summary: 21108 run, 95 failed (0.45%)
850: -a option problem, failing everywhere, fix under review
[21 failures]
975: qa comparison logic is not fuzzy enough, code is probably OK
[9 failures]
196: has become unstable, probably due to changes in default pmlogger
config and the broken pmcd this test uses ... needs test
reengineering
[6 failures]
662: Python differences between platforms make this a challenge ...
the only option seems to be to expand the perimeter of the
older Python versions where tests like this are notrun
[6 failures]
957: network.softnet induced failure (metric not supported), fixed in
qa test, but has not yet worked its way across the farm
[3 failures]
964: multiple failure modes, not diagnosis as yet
[3 failures]
And then it is the normal noise of onsies and twosies.
kenj@bozo:~$ pcp-qa-summary -fr
==== QA Summary ====
Date Run Pass Fail Nrun Host
2015-08-01 762 760 2 69|bozo PCP 3.10.6 x86_64 Ubuntu 15.04
2015-07-31 751 751 0 80|bozo-laptop PCP 3.10.6 i686 LinuxMint 15
2015-07-31 748 743 5 81|bozo-vm PCP 3.10.6 x86_64 Debian 7.8
Daily runs, but no QA |fuji PCP unknown i386 Darwin 10.8.0
2015-08-01 650 635 15 138|grundy PCP 3.10.5 ia64 SUSE SLES11 SP1
2015-07-31 760 757 3 71|vm00 PCP 3.10.6 x86_64 Ubuntu 12.04
2015-07-31 758 754 4 73|vm01 PCP 3.10.6 i686 Ubuntu 12.10
2015-07-31 731 725 6 100|vm02 PCP 3.10.6 i686 openSUSE 13.2
2015-07-31 776 773 3 55|vm03 PCP 3.10.6 x86_64 Fedora 21
2015-08-01 691 690 1 140|vm04 PCP 3.10.6 i586 CentOS 5.11
2015-08-01 678 674 4 153|vm05 PCP 3.10.6 i486 Gentoo 2.0.3
2015-08-01 60 60 0 4|vm06 PCP 3.10.6 amd64 FreeBSD 8.2-RELEASE-p9
2015-08-01 748 744 4 83|vm07 PCP 3.10.6 x86_64 Debian 6.0.10
2015-07-31 770 764 6 61|vm08 PCP 3.10.6 x86_64 CentOS Linux7.1.1503
Daily runs, but no QA |vm09 PCP 3.10.2 i386 NetBSD 6.1.5
2015-08-01 60 60 0 4|vm10 PCP 3.10.6 i386 FreeBSD 8.2-RELEASE-p9
2015-08-01 750 746 4 81|vm11 PCP 3.10.6 i686 Debian 6.0.9
2015-08-01 774 773 1 57|vm12 PCP 3.10.6 i686 Fedora 22
2015-08-02 771 767 4 60|vm14 PCP 3.10.6 x86_64 CentOS6.6
No daily runs |vm15 PCP 3.9.1 x86_64 Slackware 13.37.0
2015-08-02 753 751 2 78|vm18 PCP 3.10.6 x86_64 LinuxMint 12
2015-08-02 755 753 2 76|vm19 PCP 3.10.6 x86_64 openSUSE 12.2
2015-08-02 757 756 1 74|vm20 PCP 3.10.6 x86_64 Ubuntu 13.04
2015-08-02 753 750 3 78|vm21 PCP 3.10.6 i686 Debian 7.4
2015-08-02 771 766 5 60|vm22 PCP 3.10.6 x86_64 Fedora 19
2015-08-03 770 768 2 61|vm23 PCP 3.10.6 i686 Fedora 20
2015-08-03 775 771 4 56|vm24 PCP 3.10.6 i686 openSUSE 13.1
2015-07-31 686 684 2 145|vm25 PCP 3.10.6 x86_64 CentOS 5.11
2015-08-01 772 770 2 59|vm26 PCP 3.10.6 x86_64 Fedora 21
2015-08-01 765 763 2 66|vm27 PCP 3.10.6 x86_64 Ubuntu 15.04
2015-07-31 766 762 4 65|vm28 PCP 3.10.6 x86_64 RHEL Server 6.6
2015-08-02 775 773 2 56|vm29 PCP 3.10.6 x86_64 RHEL Server 7.1
2015-07-31 772 770 2 59|vm30 PCP 3.10.6 x86_64 SUSE SLES12 SP0
Summary: 21108 run, 95 failed (0.45%)
==== QA Failure (X) Map ====
Host bo bv gr 00 01 02 03 04 05 07 08 11 12 14 18 19 20 21 22 23 24 25 26
27 28 29 30
Test %fail
Test QA groups
850 70% X X X X X X X X X X X X X X X X X
X X X X 850 python
975 30% X X X X X X X X
X 975 pmimport
169 20% X X X X
X X 169 pmcd
662 20% X X X X X X
662 pmwebapi
957 10% X X X
957 pmda.linux valgrind
964 10% X X X
964 pmcd
514 7% X X
514 pmie
583 7% X
X 583 pmie
652 7% X X
652 pmda.systemd event flakey
739 7% X X
739 python getopt
782 7% X
X 782 pmwebapi
807 7% X X
807 pcp
823 7% X X
823 pmda.sample pmstore secure
003 3% X
003 pdu pmcd mem_leak
023 3% X
023 pmcd pmprobe
040 3% X
040 pmlogger mem_leak
119 3% X
119 logutil
152 3% X
152 pmda.pmcd pmval
Host bo bv gr 00 01 02 03 04 05 07 08 11 12 14 18 19 20 21 22 23 24 25 26
27 28 29 30
160 3% X
160 libpcp
200 3% X
200 context
274 3% X
274 pmda help pmda.install dbpmda
336 3% X
336 trace pmda.install
365 3% X
365 pmcd
366 3% X
366 pmlogconf
374 3%
X 374 pmlc pmlogger
381 3% X
381 logutil pmlc
412 3% X
412 wrap archive libpcp pmval pmdumplog
430 3% X
430 logutil folio
449 3% X
449 threads flakey
511 3% X
511 pmimport pmdumplog pmlogsummary perl
519 3% X
519 pmie
666 3% X
666 pmmgr
711 3% X
711 pmimport pmdumplog pmlogsummary perl
721 3% X
721 dbpmda
727 3% X
727 avahi
730 3% X
730 pmda.proc cgroups
750 3% X
750 pmda.rpm
756 3% X
756 pmda.perfevent
769 3% X
769 other
Host bo bv gr 00 01 02 03 04 05 07 08 11 12 14 18 19 20 21 22 23 24 25 26
27 28 29 30
775 3% X
775 pmfind
805 3% X
805 pmda.postfix
828 3% X
828 valgrind archive context
840 3% X
840 avahi
946 3% X
946 pmfind avahi
950 3% X
950 pmproxy avahi
1052 3% X
1052 pmda.json python
Host bo bv gr 00 01 02 03 04 05 07 08 11 12 14 18 19 20 21 22 23 24 25 26
27 28 29 30
|
| <Prev in Thread] | Current Thread | [Next in Thread> |
|---|---|---|
| ||
| Previous by Date: | qa/850 pmcollectl problem, Ken McDonell |
|---|---|
| Next by Date: | Re: [pcp] Windows PCP builds, Nathan Scott |
| Previous by Thread: | qa/850 pmcollectl problem, Ken McDonell |
| Next by Thread: | Re: [pcp] State of PCP QA, Nathan Scott |
| Indexes: | [Date] [Thread] [Top] [All Lists] |