pcp
[Top] [All Lists]

Re: [pcp] braindump on unified-context / live-logging

To: Max Matveev <makc@xxxxxxxxx>
Subject: Re: [pcp] braindump on unified-context / live-logging
From: Greg Banks <gbanks@xxxxxxx>
Date: Mon, 13 Jan 2014 17:29:37 -0800
Cc: "Frank Ch. Eigler" <fche@xxxxxxxxxx>, pcp developers <pcp@xxxxxxxxxxx>
Delivered-to: pcp@xxxxxxxxxxx
In-reply-to: <21204.32676.163457.438142@xxxxxxxxxxxx>
References: <20140108013956.GG15448@xxxxxxxxxx> <21198.38090.179929.552608@xxxxxxxxxxxx> <20140110190525.GA28062@xxxxxxxxxx> <0a923e$520gar@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx> <52D4666E.7030601@xxxxxxx> <21204.32676.163457.438142@xxxxxxxxxxxx>
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130510 Thunderbird/17.0.6
On 13/01/14 16:07, Max Matveev wrote:
On Mon, 13 Jan 2014 14:19:26 -0800, Greg Banks wrote:

  gnb> While I designed and wrote the thing, I was never happy with any
  gnb> of the iterations of the architecture and I wouldn't recommend
  gnb> to anyone that they copy it. Some of the problems were:

  gnb>   * it was both a client of pmcd and a PMDA, which led to interesting
  gnb> deadlocks with the single-threaded pmcd

That was the "second" pass with nasavg pmda. I thought there was a
first version which only used archives but it had to be abandoned
because tailing of archive being written wasn't working reliably.


Yes, the first design iteration tailed archives and was horribly unreliable. Pmarchive was writing to the various files of an archive in such a way that there was a race window where the archive reading code in libpcp would see an inconsistent archive and barf. Plus, there was an inconvenient amount of lag, up to 30 seconds, in pmarchive and in the tailer.

--
Greg.

<Prev in Thread] Current Thread [Next in Thread>