pcp
[Top] [All Lists]

pcp updates: collectl2pcp, qa

To: PCP <pcp@xxxxxxxxxxx>
Subject: pcp updates: collectl2pcp, qa
From: Nathan Scott <nathans@xxxxxxxxxx>
Date: Wed, 5 Jun 2013 22:24:30 -0400 (EDT)
Delivered-to: pcp@xxxxxxxxxxx
In-reply-to: <488186212.19621698.1370485341508.JavaMail.root@xxxxxxxxxx>
Reply-to: Nathan Scott <nathans@xxxxxxxxxx>
Thread-index: pcxR9ypX6KwfCFxM7SxMJeuXu7sgHg==
Thread-topic: pcp updates: collectl2pcp, qa
Changes committed to git://oss.sgi.com/pcp/pcp.git dev

 build/rpm/fedora.spec                    |   19 
 build/rpm/pcp.spec.in                    |   20 
 debian/GNUmakefile                       |   18 
 debian/control                           |    8 
 debian/pcp-import-collectl2pcp.install   |    2 
 debian/rules                             |    5 
 man/man1/GNUmakefile                     |    2 
 man/man1/collectl2pcp.1                  |  111 
 qa/536                                   |   97 
 qa/536.out                               |   78 
 qa/544                                   |   40 
 qa/544.out                               | 5002 +++++++++++++++++++++++++++++++
 qa/GNUmakefile                           |    2 
 qa/collectl/GNUmakefile                  |   17 
 qa/collectl/debian_sid_defaults.raw.gz   |binary
 qa/collectl/debian_sid_detailed.raw.gz   |binary
 qa/collectl/dynamic_instances.raw        |   40 
 qa/collectl/missing_instances.raw        |   38 
 qa/collectl/rhel6.raw.gz                 |binary
 qa/collectl/some_host.raw                |   43 
 qa/collectl/some_host_later.raw          |   40 
 qa/collectl/truncated.raw                |   38 
 qa/collectl/wrong_host.raw               |   40 
 qa/group                                 |    4 
 src/include/pcp/impl.h                   |    4 
 src/libpcp/src/access.c                  |  174 +
 src/libpcp/src/store.c                   |    9 
 src/pmcd/src/client.c                    |   31 
 src/pmcd/src/client.h                    |    2 
 src/pmcd/src/config.c                    |   12 
 src/pmcd/src/dopdus.c                    |   10 
 src/pmimport/GNUmakefile                 |    2 
 src/pmimport/collectl2pcp/.gitignore     |    2 
 src/pmimport/collectl2pcp/GNUmakefile    |   55 
 src/pmimport/collectl2pcp/collectl2pcp.c |  683 ++--
 src/pmimport/collectl2pcp/cpu.c          |  104 
 src/pmimport/collectl2pcp/disk.c         |  111 
 src/pmimport/collectl2pcp/generic.c      |   35 
 src/pmimport/collectl2pcp/header.c       |  155 
 src/pmimport/collectl2pcp/load.c         |   54 
 src/pmimport/collectl2pcp/metrics.c      | 1668 ++++++++++
 src/pmimport/collectl2pcp/metrics.h      |  166 -
 src/pmimport/collectl2pcp/net.c          |  138 
 src/pmimport/collectl2pcp/pmdesc.c       |   84 
 src/pmimport/collectl2pcp/proc.c         |  183 +
 src/pmimport/collectl2pcp/timestamp.c    |   64 
 src/pmimport/collectl2pcp/util.c         |  331 +-
 47 files changed, 9268 insertions(+), 473 deletions(-)

commit 709983e41759194bcf514559ee4df3846051274e
Author: Nathan Scott <nathans@xxxxxxxxxx>
Date:   Thu Jun 6 12:18:36 2013 +1000

    Fix problems found in testing collectl2pcp, esp process instances
    
    Some of the process metrics coming out of have tab-separation on
    certain fields, so remove the assumption that everything is space
    separated.
    
    Fix the process command name extraction (which becomes the inst
    name) - this was assuming all pids to be 5 characters, turns out
    they aren't always.  Then, fix the way all the command line args
    were being dropped, these are expected/wanted in the per-process
    instance names.
    
    In extracting kernel.uname.distro drop the "Platform: xxx" suffix
    and add some (commented-out for now) code to export this through
    a new hinv.platform metric.
    
    Adds in qa test 544 to exercise the proc metrics in particular.

commit e2ecaad175e081862dfae1f94f8f12645390be77
Author: Nathan Scott <nathans@xxxxxxxxxx>
Date:   Thu Jun 6 11:35:55 2013 +1000

    Add in test data from default and detailed collectl runs on Debian
    
    Fills in some of Marks suggested remaining test items.  In addition
    to verifying with the current-latest-collectl release here, this is
    adding in some more detailed pmval checks of the archive contents.

commit df4889c3d1309562632aa21248b43e037907228f
Author: Nathan Scott <nathans@xxxxxxxxxx>
Date:   Thu Jun 6 09:20:25 2013 +1000

    Descend into collectl test data directory for pcp-testsuite packaging

commit f1c76cc104a81a110bf728f3a36770e6ee8239e3
Merge: 1986289 478766e
Author: Nathan Scott <nathans@xxxxxxxxxx>
Date:   Wed Jun 5 19:19:51 2013 +1000

    Merge branch 'dev' of git://oss.sgi.com/markgw/pcp/pcp into dev

commit 1986289c3b930ef9b4788e9cfc1941b41c660cc6
Author: Nathan Scott <nathans@xxxxxxxxxx>
Date:   Wed Jun 5 19:17:40 2013 +1000

    Slight reduction in code in pmStore implementation, simpler

commit 9c22519caaeb11c34862bf9f3797cc982aee75a8
Author: Nathan Scott <nathans@xxxxxxxxxx>
Date:   Wed Jun 5 19:16:48 2013 +1000

    Account addition and deletion code for pmcd user/group ACL implementation
    
    Code for the pmcd client connection paths that does permission checks and
    performs the accounting for authenticated new client connections affected
    by user/group access controls.

commit 478766e37e9009263c7c3867bea25bbdb5237dd0
Author: Mark Goodwin <mgoodwin@xxxxxxxxxx>
Date:   Wed Jun 5 13:47:23 2013 +1000

    QA for collectl2pcp - first batch of tests, more still needed.
    
        modified:   qa/536
        modified:   qa/536.out
        new file:   qa/collectl/dynamic_instances.raw
        new file:   qa/collectl/missing_instances.raw
        new file:   qa/collectl/rhel6.raw.gz
        new file:   qa/collectl/some_host.raw
        new file:   qa/collectl/some_host_later.raw
        new file:   qa/collectl/truncated.raw
        new file:   qa/collectl/wrong_host.raw
    
    Signed-off-by: Mark Goodwin <mgoodwin@xxxxxxxxxx>

commit 02e575095f1b4818da3ce8ec496a818decf944c0
Merge: bc7c164 0550e0f
Author: Mark Goodwin <mgoodwin@xxxxxxxxxx>
Date:   Mon Jun 3 19:27:44 2013 +1000

    Merge branch 'dev' of git://oss.sgi.com/pcp/pcp into dev

commit bc7c1645e2886873c5ef75912cb2224e8bf4079b
Merge: f177810 43ee8b5
Author: Mark Goodwin <mgoodwin@xxxxxxxxxx>
Date:   Wed May 29 13:50:10 2013 +1000

    Merge branch 'dev' of git://oss.sgi.com/markgw/pcp/pcp into dev

commit f177810188f127d2526065c233c313b9609cc38b
Merge: 47ce416 d54962a
Author: Mark Goodwin <mgoodwin@xxxxxxxxxx>
Date:   Wed May 29 13:49:44 2013 +1000

    Merge branch 'dev' of git://oss.sgi.com/pcp/pcp into dev

commit 43ee8b54e762c1f4c1ac12dadffd53b69b3b2d30
Author: Mark Goodwin <mgoodwin@xxxxxxxxxx>
Date:   Wed May 29 13:46:57 2013 +1000

    Initial qa test for collectl2pcp
    
        new file:   536
        new file:   536.out
        modified:   group
    
    Signed-off-by: Mark Goodwin <mgoodwin@xxxxxxxxxx>

commit 1a2a50a05d50a3a1bdad471606562b4f144db913
Author: Mark Goodwin <mgoodwin@xxxxxxxxxx>
Date:   Wed May 29 12:41:24 2013 +1000

    Fix collectl2pcp build to handle pcp-libs-devel not installed in build root.
    
    Signed-off-by: Mark Goodwin <mgoodwin@xxxxxxxxxx>

commit 87cbeb4cda84b67770d594ba080dfe13d5cbacb4
Merge: d54962a 47ce416
Author: Mark Goodwin <mgoodwin@xxxxxxxxxx>
Date:   Wed May 29 12:04:02 2013 +1000

    Merge branch 'dev' of git://oss.sgi.com/markgw/pcp/pcp into dev

commit 47ce4161dbe4799b2eb9c88f2644d3e766845870
Merge: bd0ed75 04736b4
Author: Mark Goodwin <mgoodwin@xxxxxxxxxx>
Date:   Tue May 28 17:33:23 2013 +1000

    Merge branch 'dev' of git://oss.sgi.com/pcp/pcp into dev

commit bd0ed758e24987155a2d90a10c745e697eb30fc7
Author: Mark Goodwin <mgoodwin@xxxxxxxxxx>
Date:   Tue May 28 17:22:14 2013 +1000

    Adds support for more metrics (cpu, disk, net, mem.util, load, and some 
proc),
    improve parsing (replace strtok with "field" mini api), dynamic instance 
support
    (esp. for proc). Clean up main loop - split out header parsing, multiple 
input
    file temporal order checks. Rework cmdline args, man page update and improve
    archive layout for better replay performance.
    
        modified:   man/man1/collectl2pcp.1
        modified:   src/pmimport/collectl2pcp/GNUmakefile
        modified:   src/pmimport/collectl2pcp/collectl2pcp.c
        modified:   src/pmimport/collectl2pcp/cpu.c
        modified:   src/pmimport/collectl2pcp/disk.c
        new file:   src/pmimport/collectl2pcp/generic.c
        new file:   src/pmimport/collectl2pcp/header.c
        modified:   src/pmimport/collectl2pcp/load.c
        modified:   src/pmimport/collectl2pcp/metrics.h
        modified:   src/pmimport/collectl2pcp/net.c
        new file:   src/pmimport/collectl2pcp/proc.c
        modified:   src/pmimport/collectl2pcp/timestamp.c
        modified:   src/pmimport/collectl2pcp/util.c

commit f19c74fa7d3f4882e77d63df156b66ed9cc637a2
Merge: 9a8dee1 1a35711
Author: Mark Goodwin <mgoodwin@xxxxxxxxxx>
Date:   Sat May 18 08:18:03 2013 +1000

    Merge branch 'dev' of git://oss.sgi.com/pcp/pcp into dev

commit 9a8dee18447f4a019f28f3f36f90f341a9c81b0a
Merge: d08ceaa 717347f
Author: Mark Goodwin <mgoodwin@xxxxxxxxxx>
Date:   Thu May 16 14:22:19 2013 +1000

    Merge branch 'dev' of git://oss.sgi.com/pcp/pcp into dev

commit d08ceaa19a20a7e1d2e217b6d80200f686ac6696
Merge: 0a4c3c7 5562a66
Author: Mark Goodwin <mgoodwin@xxxxxxxxxx>
Date:   Tue May 14 15:42:36 2013 +1000

    Merge branch 'dev' of git://oss.sgi.com/pcp/pcp into dev
    
    Fixed conflicts:
        man/man1/GNUmakefile

commit 0a4c3c79b23cbfbe1d10169430bdcffab3143607
Author: Mark Goodwin <mgoodwin@xxxxxxxxxx>
Date:   Tue May 14 15:34:54 2013 +1000

    Tool to import collectl raw data archives to PCP archive.
    
    This is the initial version - so far it imports CPU, disk, network, loadavg
    and hinv metrics. It's functional but there are many TODO items. The tool
    is packaged in it's own subpackage, as is needed for most PCP import tools
    in order to isolate build and run-time dependencies from the main packages.
    
        modified:   build/rpm/fedora.spec
        modified:   build/rpm/pcp.spec.in
        modified:   debian/GNUmakefile
        modified:   debian/control
        new file:   debian/pcp-import-collectl2pcp.install
        modified:   debian/rules
        modified:   man/man1/GNUmakefile
        new file:   man/man1/collectl2pcp.1
        modified:   src/pmimport/GNUmakefile
        new file:   src/pmimport/collectl2pcp/GNUmakefile
        new file:   src/pmimport/collectl2pcp/collectl2pcp.c
        new file:   src/pmimport/collectl2pcp/cpu.c
        new file:   src/pmimport/collectl2pcp/disk.c
        new file:   src/pmimport/collectl2pcp/load.c
        new file:   src/pmimport/collectl2pcp/metrics.c
        new file:   src/pmimport/collectl2pcp/metrics.h
        new file:   src/pmimport/collectl2pcp/net.c
        new file:   src/pmimport/collectl2pcp/pmdesc.c
        new file:   src/pmimport/collectl2pcp/timestamp.c
        new file:   src/pmimport/collectl2pcp/util.c

<Prev in Thread] Current Thread [Next in Thread>
  • pcp updates: collectl2pcp, qa, Nathan Scott <=