pcp
[Top] [All Lists]

Re: [pcp] signal pmlogger

To: Ken McDonell <kenj@xxxxxxxxxxxxxxxx>, "'Frank Ch. Eigler'" <fche@xxxxxxxxxx>
Subject: Re: [pcp] signal pmlogger
From: Martins Innus <minnus@xxxxxxxxxxx>
Date: Tue, 15 Apr 2014 09:27:58 -0400
Cc: 'PCP Mailing List' <pcp@xxxxxxxxxxx>
Delivered-to: pcp@xxxxxxxxxxx
In-reply-to: <534C4D07.8020604@xxxxxxxxxxxxxxxx>
References: <53482BC5.6070203@xxxxxxxxxxx> <y0mr453663h.fsf@xxxxxxxx> <01c401cf55c9$d4322fc0$7c968f40$@internode.on.net> <534C3695.4050306@xxxxxxxxxxx> <534C4D07.8020604@xxxxxxxxxxxxxxxx>
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.4.0
Ken,


I can go down that path if that is the right way to do it.  But I was
hoping for some sort of "log this list of metrics right now, just once,
but don't otherwise change pmlogger"  command.

Thanks for the insight Martins.

Well this is truly interesting. Your use case is something that has not previously been encountered in over a decade of belting PCP in production environments. I find that both surprising and exciting.

Ha!

I can't see a way to achieve what you want with the single pmlogger process and the capabilities today. This is because the log mandatory pmlc command updates the logging state for all the named metrics within pmlogger, so what you describe is what I'd expect to happen.

The options are:

1. extend pmlc and pmlogger to have an additional set of metrics that can have duration and logging state that co-exists with the config file ones at startup (so the state change from pmlc is independent of, not a replacement of, the original state) ... it would be nice to have some short hand notation for turning all of these additional metrics off in one command and extend the "once" duration to allow N times.

2. Have your script that is currently calling pmlc actually launch a _new_ pmlogger to capture just the metrics you want at the start or end of the computation or with some particular frequency during the computation. Then at the end of the day, you can use pmlogextract to merge together the archive from the default system logging (or whatever pmlogger you're pointing pmlc at) with one or more archives from your computation runs. The merged archive will be the same as if 1. was implemented.
Thanks for the ideas. I'll work on 2 for now and test 1 as it evolves.

Thanks

Martins

<Prev in Thread] Current Thread [Next in Thread>