pcp
[Top] [All Lists]

Re: Prepare to be assimilated^Wanalysed; resistance is futile

To: Nathan Scott <nathans@xxxxxxxxxx>
Subject: Re: Prepare to be assimilated^Wanalysed; resistance is futile
From: Ken McDonell <kenj@xxxxxxxxxxxxxxxx>
Date: Thu, 18 Jul 2013 12:37:29 +1000
Cc: "Frank Ch. Eigler" <fche@xxxxxxxxxx>, pcp@xxxxxxxxxxx
Delivered-to: pcp@xxxxxxxxxxx
In-reply-to: <932571438.3436972.1374104853616.JavaMail.root@xxxxxxxxxx>
References: <1715044262.9523595.1372389213645.JavaMail.root@xxxxxxxxxx> <406338386.10303545.1372630273147.JavaMail.root@xxxxxxxxxx> <1251717658.10534278.1372672990990.JavaMail.root@xxxxxxxxxx> <20130702160444.GD19454@xxxxxxxxxx> <399367999.12169937.1372810670160.JavaMail.root@xxxxxxxxxx> <y0moba71pao.fsf@xxxxxxxx> <444804824.2373005.1374035342123.JavaMail.root@xxxxxxxxxx> <20130717131537.GA14710@xxxxxxxxxx> <932571438.3436972.1374104853616.JavaMail.root@xxxxxxxxxx>
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130623 Thunderbird/17.0.7
On 18/07/13 09:47, Nathan Scott wrote:

[unless I hear otherwise, at this stage I'm planning to set an increased
timeout using Jeffs suggestion, an extra -T 24h10m and the -r option...]

-r also reports what groups are logged, so it is easier to find "actual config file does not match assumption" issues ... and it is a once trip per group of metrics in the control file, so very low overhead.

The compressing/culling of their old /var/log/pcp/pmlogger/*/* files?
IIRC, that is done using find and not the contents of the control files,
so I *think* that one's a non-issue - files from rogue loggers should be
dealt with there (if not, its at least fixable by using find).

It _is_ control file driven at the moment.  We do this

        find . -type f -mtime +$CULLAFTER

and this

        find . -type f -mtime +$COMPRESSAFTER

but both within the context of a ...

cat $CONTROL \
| sed -e "s/LOCALHOSTNAME/$LOCALHOST/g" \
      -e "s;PCP_LOG_DIR;$PCP_LOG_DIR;g" \
| while read host primary socks dir args
do
        ...
        cd $dir
        ...
done

But we could add a catch all cleanup in another loop at the end, the same as is done for the "trace" files ... see pmlogger_daily, around line 835.

<Prev in Thread] Current Thread [Next in Thread>