pcp
[Top] [All Lists]

QA summary - bit of a milestone

To: PCP <pcp@xxxxxxxxxxx>
Subject: QA summary - bit of a milestone
From: Ken McDonell <kenj@xxxxxxxxxxxxxxxx>
Date: Wed, 18 Nov 2015 21:11:28 +1100
Delivered-to: pcp@xxxxxxxxxxx
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.3.0
I don't recall it ever being this good!

It did take a number of recheck's as we still have test instability, but even 
so, this is pretty impressive ... 5 fails out of almost 22,000 test cases 
across 30 QA hosts.

Well done to all.

kenj@bozo:~/src/pcp/qa$ pcp-qa-summary -fr
==== QA Summary ====

Date        Run Pass Fail Nrun Host
2015-11-17  794  794    0   69|bozo PCP 3.10.9 x86_64 Ubuntu 15.04
2015-11-17  778  778    0   85|bozo-laptop PCP 3.10.9 i686 LinuxMint 15
2015-11-17  782  782    0   81|bozo-vm PCP 3.10.9 x86_64 Debian 7.8
Daily runs, but no QA         |fuji PCP unknown i386 Darwin 10.8.0
2015-11-17  673  673    0  147|grundy PCP 3.10.9 ia64 SUSE SLES11 SP1
2015-11-17  785  784    1   78|vm00 PCP 3.10.9 x86_64 Ubuntu 12.04
2015-11-17  760  760    0  103|vm01 PCP 3.10.9 i686 Ubuntu 15.10
2015-11-17  763  763    0  100|vm02 PCP 3.10.9 i686 openSUSE 13.2
2015-11-17  806  806    0   57|vm03 PCP 3.10.9 x86_64 Fedora 21
2015-11-18  710  710    0  153|vm04 PCP 3.10.9 i586 CentOS 5.11
2015-11-18  778  778    0   85|vm05 PCP 3.10.9 x86_64 Gentoo 2.2
2015-11-18   60   60    0    4|vm06 PCP 3.10.9 amd64 FreeBSD 8.2-RELEASE-p9
2015-11-18  772  771    1   91|vm07 PCP 3.10.9 x86_64 Debian 6.0.10
2015-11-16  804  804    0   59|vm08 PCP 3.10.9 x86_64 CentOS Linux7.1.1503 
Daily runs, but no QA         |vm09 PCP 3.10.2 i386 NetBSD 6.1.5
2015-11-17   60   60    0    4|vm10 PCP 3.10.9 i386 FreeBSD 8.2-RELEASE-p9
2015-11-14  773  773    0   90|vm11 PCP 3.10.9 i686 Debian 6.0.10
2015-11-14  802  802    0   61|vm12 PCP 3.10.9 i686 Fedora 22
2015-11-15  801  801    0   62|vm14 PCP 3.10.9 x86_64 CentOS6.6
No daily runs                 |vm15 PCP 3.9.1 x86_64 Slackware 13.37.0
2015-11-15  775  774    1   88|vm18 PCP 3.10.9 x86_64 LinuxMint 12
2015-11-15  780  780    0   83|vm19 PCP 3.10.9 x86_64 openSUSE 12.2
2015-11-15  781  781    0   82|vm20 PCP 3.10.9 x86_64 Ubuntu 13.04
2015-11-15  783  783    0   80|vm21 PCP 3.10.9 i686 Debian 7.9
2015-11-15  802  801    1   61|vm22 PCP 3.10.9 x86_64 Fedora 19
2015-11-16  801  801    0   62|vm23 PCP 3.10.9 i686 Fedora 20
2015-11-16  802  801    1   61|vm24 PCP 3.10.9 i686 openSUSE 13.1
2015-11-16  706  706    0  157|vm25 PCP 3.10.9 x86_64 CentOS 5.11
2015-11-17  804  804    0   59|vm26 PCP 3.10.9 x86_64 Fedora 21
2015-11-14  791  791    0   72|vm27 PCP 3.10.9 x86_64 Ubuntu 15.04
2015-11-17  801  801    0   62|vm28 PCP 3.10.9 x86_64 RHEL Server 6.7
2015-11-15  806  806    0   57|vm29 PCP 3.10.9 x86_64 RHEL Server 7.1
2015-11-13  801  801    0   59|vm30 PCP 3.10.9 x86_64 SUSE SLES12 SP0
Summary: 21934 run, 5 failed (0.02%)

==== QA Failure (X) Map ====

Host       00 07 18 22 24
Test %fail                Test QA groups
 892    7%  X     X        892 pmcd libpcp
 578    3%     X           578 pmcd pmda.install pmval
 652    3%           X     652 pmda.systemd event flakey
 823    3%              X  823 pmda.sample pmstore secure
Host       00 07 18 22 24

<Prev in Thread] Current Thread [Next in Thread>
  • QA summary - bit of a milestone, Ken McDonell <=