pcp
[Top] [All Lists]

Re: [pcp] pcp updates: merge kenj (qa updates)

To: pcp@xxxxxxxxxxx
Subject: Re: [pcp] pcp updates: merge kenj (qa updates)
From: Ken McDonell <kenj@xxxxxxxxxxxxxxxx>
Date: Wed, 10 Jun 2015 08:31:50 +1000
Delivered-to: pcp@xxxxxxxxxxx
In-reply-to: <5576DA95.1090705@xxxxxxxxxx>
References: <5576DA95.1090705@xxxxxxxxxx>
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0
On 09/06/15 22:22, Mark Goodwin wrote:
> I think it may be time we had a qa conf call, if at least to
> agree on who's looking at the remaining failures so we don't
> double up, and to figure out if the release schedule needs
> another tweak. Nathan?
> ...

Here is the status from my QA farm this morning.

I've recovered from the build and install storm over the weekend and got rid of 
most of the systemic failures (1080 is the most obvious exception).

115 seems to be some issue with the pmie processes managed by pmmgr ... I have 
inconclusive evidence of pmmgr not being cleanly stopped and restarted after an 
upgrade on one Debian-based system ... but the failures are not restricted to 
Debian-based systems.

There are also some hosts (grundy, vm02, vm14 and vm28) with unexpectedly high 
failure rates (>5 tests) that are yet to be investigated.

==== QA Summary ====

Date        Run Pass Fail Nrun Host
2015-06-09  745  740    5   70|bozo PCP 3.10.5 x86_64 Ubuntu 15.04
2015-06-09  734  732    2   81|bozo-laptop PCP 3.10.5 i686 LinuxMint 15
2015-06-05  732  730    2   79|bozo-vm PCP 3.10.5 x86_64 Debian 7.8
Daily runs, but no QA         |fuji PCP pmcd.ver i386 Darwin 10.8.0
2015-06-09  633  624    9  138|grundy PCP 3.10.5 ia64 SUSE SLES11 SP1
2015-06-09  736  735    1   79|vm00 PCP 3.10.5 x86_64 Ubuntu 12.04
2015-06-09  743  743    0   72|vm01 PCP 3.10.5 i686 Ubuntu 12.10
2015-06-09  714  700   14  101|vm02 PCP 3.10.5 i686 openSUSE 13.2
2015-06-09  753  749    4   62|vm03 PCP 3.10.5 x86_64 Fedora 18
2015-06-10  679  677    2  136|vm04 PCP 3.10.5 i586 CentOS 5.11
2015-06-06  664  664    0  153|vm05 PCP 3.10.5 i486 Gentoo 2.0.3
2015-06-06   60   60    0    4|vm06 PCP 3.10.5 amd64 FreeBSD 8.2-RELEASE-p9
2015-06-06  734  732    2   82|vm07 PCP 3.10.5 x86_64 Debian 6.0.10
2015-06-08  751  748    3   64|vm08 PCP 3.10.5 x86_64 CentOS Linux7.1.1503 
Daily runs, but no QA         |vm09 PCP 3.10.2 i386 NetBSD 6.1.5
2015-06-08   60   60    0    4|vm10 PCP 3.10.5 i386 FreeBSD 8.2-RELEASE-p9
2015-06-06  734  730    4   82|vm11 PCP 3.10.5 i686 Debian 6.0.9
2015-06-07  749  748    1   67|vm12 PCP 3.10.5 i686 Fedora 17
2015-06-07  751  745    6   64|vm14 PCP 3.10.5 x86_64 CentOS6.6
No daily runs                 |vm15 PCP 3.9.1 x86_64 Slackware 13.37.0
2015-06-07  736  734    2   80|vm18 PCP 3.10.5 x86_64 LinuxMint 12
2015-06-08  736  732    4   79|vm19 PCP 3.10.5 x86_64 openSUSE 12.2
2015-06-04  737  734    3   75|vm20 PCP 3.10.5 x86_64 Ubuntu 13.04
2015-06-07  734  731    3   81|vm21 PCP 3.10.5 i686 Debian 7.4
2015-06-07  751  749    2   64|vm22 PCP 3.10.5 x86_64 Fedora 19
2015-06-08  750  749    1   65|vm23 PCP 3.10.5 i686 Fedora 20
2015-06-08  705  700    5  110|vm24 PCP 3.10.5 i686 openSUSE 13.1
2015-06-08  673  670    3  142|vm25 PCP 3.10.5 x86_64 CentOS 5.11
2015-06-08  751  750    1   64|vm26 PCP 3.10.5 x86_64 Fedora 21
2015-06-06  741  740    1   75|vm27 PCP 3.10.5 x86_64 Ubuntu 15.04
2015-06-09  751  744    7   64|vm28 PCP 3.10.5 x86_64 RHEL Server 6.6
2015-06-08  756  752    4   59|vm29 PCP 3.10.5 x86_64 RHEL Server 7.1
Summary: 19793 run, 91 failed (0.46%)

==== QA Failure (X) Map ====

Host       bo bl bv gr 00 02 03 04 07 08 11 12 14 18 19 20 21 22 23 24 25 26 27 
28 29
Test %fail                                                                      
      Test QA groups
1080   41%  X              X  X        X     X  X  X           X  X        X    
 X  X 1080 valgrind pcp
 115   17%     X  X     X                                   X                   
 X     115 pmie
 956   17%  X                                         X  X  X                   
    X  956 pmcd
 169   14%           X        X        X                                        
 X     169 pmcd
 666   10%                       X  X                    X                      
       666 pmmgr
 832   10%                    X                 X                       X       
       832 pmda.sample pmstore secure
 984   10%                 X                                         X  X       
       984 cgroups
1079   10%  X              X                       X                            
      1079 pcp
 152    7%                                                  X                 X 
       152 pmda.pmcd pmval
 260    7%        X                             X                               
       260 derive pmie
 359    7%                                            X  X                      
       359 pmcd pminfo
 578    7%                                X                                     
 X     578 pmcd pmda.install pmval
 660    7%                 X                                         X          
       660 pmwebapi
 721    7%                       X                                      X       
       721 dbpmda
 750    7%                 X                                                    
    X  750 pmda.rpm
 782    7%                                      X                               
 X     782 pmwebapi
 807    7%                          X     X                                     
       807 pcp
 023    3%           X                                                          
       023 pmcd pmprobe
Host       bo bl bv gr 00 02 03 04 07 08 11 12 14 18 19 20 21 22 23 24 25 26 27 
28 29
 087    3%                                X                                     
       087 archive
 093    3%                                                           X          
       093 archive
 113    3%                 X                                                    
       113 libirixpmda
 198    3%     X                                                                
       198 pmda context
 258    3%           X                                                          
       258 trace pmda.install
 273    3%                                                           X          
       273 libpcp
 280    3%                                X                                     
       280 pmlogger logutil folio pmlc
 322    3%  X                                                                   
       322 pmlc pmlogger
 336    3%           X                                                          
       336 trace pmda.install
 360    3%                    X                                                 
       360 pmie
 370    3%                                      X                               
       370 pmimport derive pmdumplog perl
 388    3%                 X                                                    
       388 archive mem_leak valgrind
 393    3%                 X                                                    
       393 archive mem_leak valgrind
 394    3%                 X                                                    
       394 archive mem_leak valgrind flakey
 459    3%                 X                                                    
       459 pmlogreduce valgrind
 461    3%                 X                                                    
       461 pmda.logger pmda.install event
 462    3%                                                                      
    X  462 pmcd_wait
 511    3%           X                                                          
       511 pmimport pmdumplog pmlogsummary perl
 514    3%                 X                                                    
       514 pmie
 518    3%                                                                      
 X     518 pcp flakey pmie
 583    3%  X                                                                   
       583 pmie
Host       bo bl bv gr 00 02 03 04 07 08 11 12 14 18 19 20 21 22 23 24 25 26 27 
28 29
 652    3%                                                     X                
       652 pmda.systemd event flakey
 667    3%                                                           X          
       667 python
 711    3%           X                                                          
       711 pmimport pmdumplog pmlogsummary perl
 727    3%                             X                                        
       727 avahi
 730    3%           X                                                          
       730 pmda.proc cgroups
 751    3%                 X                                                    
       751 pmda.rpm
 769    3%           X                                                          
       769 other
 783    3%                                            X                         
       783 pmda.rpm valgrind
 823    3%                                      X                               
       823 pmda.sample pmstore secure
 974    3%           X                                                          
       974 pmda.proc
 999    3%                                            X                         
       999 pmns
1000    3%                 X                                                    
      1000 pmdumptext
1052    3%                                                                      
 X    1052 pmda.json python
Host       bo bl bv gr 00 02 03 04 07 08 11 12 14 18 19 20 21 22 23 24 25 26 27 
28 29

<Prev in Thread] Current Thread [Next in Thread>