New pmlognow utility

[Martins Innus <minnus@xxxxxxxxxxx>]

Hi,
    We have been using for a while now a utility that lets us do 
instantaneous logging.

https://github.com/ubccr/pcp/tree/logonce


Basically we have the need to at various specified moments log the state 
of the machine while still having the primary logger keep running.  This 
was our wishlist item here:
http://oss.sgi.com/bugzilla/show_bug.cgi?id=1073


Let me know if there would be any objections to including such a 
utility, and if not, I'll work on appropriate QA and manpages. It can 
use/parse an existing pmlogger config (in a crude way) or take a set of 
metrics to log on the command line. Basic usage is:
pmlognow -s -p job-1000-begin- -d /var/log/pcp/pmlogger/HOSTNAME -c 
/etc/pcp/pmlogger/pmlogger-config.ubccr
Would produce an archive file with the following prefix:

job-1000-begin-20150813.11.41.35

"-s" adds seconds to the filename
"-p" allows a prefix
"-d" directory to log to
"-c" existing pmlogger config file to use

We end up doing this at the beginning and end of HPC jobs to get as 
tight an envelope of metrics as possible without going too crazy in 
terms of frequency for our default logging.
Thanks

Martins




commit b3f074735f9c33214b737f183e2744ae02141cae
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Thu Aug 13 12:00:34 2015 -0400

    pmlognow : Deal with instances that go away during processing

 src/pmlognow/pmlognow.py | 35 +++++++++++++----------------------
 1 file changed, 13 insertions(+), 22 deletions(-)

commit 59cda8e00f930560c432dd8d0cb202161ce43a82
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Fri Jul 24 17:40:24 2015 +0000

    pmdalognow : Fix typo in debug

 src/pmlognow/pmlognow.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

commit 278f9eabd35dead5a55e9baf942af71c1907126c
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Wed Jul 22 15:38:00 2015 -0400

    pmlognow : Try to fix some instance badness, has extra debug for now

 src/pmlognow/pmlognow.py | 27 +++++++++++++++++++++++----
 1 file changed, 23 insertions(+), 4 deletions(-)

commit 5f1a5910d642fd5a02507072cfeffa59ea9ad6fe
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Wed Jul 22 11:28:09 2015 -0400

    pmlognow : Handle some cases of bad metrics

 src/pmlognow/pmlognow.py | 62 
++++++++++++++++++++++++++++++++++++--------------------------
 1 file changed, 36 insertions(+), 26 deletions(-)

commit 82b6b163d17b09228481e4b6eae843724e8eca7e
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Thu Jul 16 19:51:46 2015 +0000

    pmlognow : Deal with some metric lookup errors more cleanly

 src/pmlognow/pmlognow.py | 73 
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++---------------
 1 file changed, 58 insertions(+), 15 deletions(-)

commit a400c7113216d2835035bb82d614ef87fdada3f7
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Thu Jul 16 14:28:52 2015 +0000

    pmlognow : Fix makefile typo

 src/pmlognow/GNUmakefile | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

commit 18039237c9fdb5ab814c5484f0cdeb9f09dda9ec
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Tue Jul 14 19:32:31 2015 +0000

    Add pmlogonce to rpm build

 build/rpm/pcp.spec.in | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

commit 8375980714c961e5a0078edaa89a60895310d4ee
Merge: fe2a9dd fec6f94
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Mon Jul 6 16:12:14 2015 -0400

    Merge branch 'master' into logonce

commit fe2a9dd015b621cc8104bd684be1f1359505c454
Merge: 992fe3b b493149
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Wed Jun 10 15:09:28 2015 -0400

    Merge branch 'master' into logonce

    Conflicts:
        src/GNUmakefile

commit 992fe3bd4f45c96ac464d3b6534e7da4e27abe27
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Tue Apr 21 15:30:37 2015 +0000

    pmlognow - add some more command line options

 src/pmlognow/pmlognow.py | 26 ++++++++++++++++++++------
 1 file changed, 20 insertions(+), 6 deletions(-)

commit e9b5d41580126715b83295ae117adb52868e50aa
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Tue Apr 21 14:03:50 2015 +0000

    pmlognow - add build files

 src/GNUmakefile          |  1 +
 src/pmlognow/GNUmakefile | 32 ++++++++++++++++++++++++++++++++
 2 files changed, 33 insertions(+)

commit 8f51083761f349c4fd03d10db4a06fe711ce3ef3
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Thu Apr 2 20:21:52 2015 +0000

    First cut at a pmlognow utility

    Specify a list of metrics to write to a log file from the localhost

    Alternatively, it can parse a pmlogger file without regard to
    frequency or other parameters.  Just log all the metrics that
    are there.

 src/pmlognow/pmlognow.py | 147 
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
 1 file changed, 147 insertions(+)