pcp
[Top] [All Lists]

Re: scale/coordinate pmie question

To: ti chi <tichi404@xxxxxxxxx>
Subject: Re: scale/coordinate pmie question
From: Kevin Wang <kjw@xxxxxxxxxxxxx>
Date: Wed, 21 Jul 2004 20:54:03 -0700
Cc: pcp@xxxxxxxxxxx
In-reply-to: <20040722010148.86481.qmail@xxxxxxxxxxxxxxxxxxxxxxx>
References: <20040722010148.86481.qmail@xxxxxxxxxxxxxxxxxxxxxxx>
Sender: pcp-bounce@xxxxxxxxxxx
User-agent: Mutt/1.4.1i
 From ti chi
> have many web customers monitored with pcp ?
> everything put on one master server with a directory
> for each customer (logger, pmie, etc.) so the
> customers are silo?ed so to speak into almost 100
> directories.
> 
> this layout scale things well since have almost 700
> servers monitored.  the problem is we want to
> coordinate pmie alerts/events that occur in the
> customer environments with our environment ? basically
> a global pmie.
> 
> don?t know good solution since: not practical to
> copy/merge all customers pmlogger files to our system
> and run pmie on logger file ? this too much data and
> takes too long.  not practical to have our pmie or
> pmlogger query all customer pmda ? to much bandwidth
> and slams pmie.
> 
> so silo?ed environment solved scale problem but
> created uncoordination of events - any thoughts on
> good way to coordinate pmie for whole environment? 
> thanks for any insight!

I'd also be generally interested in hearing about any scaling work
that's been done. I'm trying (probably in vain) to get pcp adopted at my
company. we have thousands of hosts per cluster, and would need massive
scalability. I'm not sure if it's possible.  I may be able to aggregate
the subparts of the cluster (front end, back end, logger) into their
own sub-clusters, but still, thousands is hard.

   - Kevin

<Prev in Thread] Current Thread [Next in Thread>