pcp
[Top] [All Lists]

Re: [pcp] PCP and Hadoop (or any other large cluster of commoditymachine

To: John Hearns <john.hearns@xxxxxxxxxxx>
Subject: Re: [pcp] PCP and Hadoop (or any other large cluster of commoditymachines)
From: Nathan Scott <nathans@xxxxxxxxxx>
Date: Tue, 18 Jan 2011 11:08:55 +1100 (EST)
Cc: Paul Smith <psmith@xxxxxxxxxx>, pcp@xxxxxxxxxxx
In-reply-to: <68A57CCFD4005646957BD2D18E60667B124DF700@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx>
----- "John Hearns" <john.hearns@xxxxxxxxxxx> wrote:

> > for a cluster-level pmda.   I would really like to understand more
> > about this approach.
> >
> Yes indeed, SGI have a heirarchical approach for using PCP on ICE
> clusters.
> 
> http://techpubs.sgi.com/library/tpl/cgi-bin/getdoc.cgi/linux/bks/SGI_Adm
> in/books/ClusterMan_AG/sgi_html/ch05.html#Z1210619170tls
> 
> or http://tinyurl.com/63v9p6g
> 
> As this is part of SGI's value add when supplying and supporting
> clusters, maybe they could be approached for licensing this
> software to folks who run the large clusters you describe, but not

SGI has kindly made this code available (some time ago) ...
http://oss.sgi.com/cgi-bin/gitweb.cgi?p=pcp/pcp-pmda-cluster.git;a=summary

AIUI (Mark would know more...) it gives a relatively fixed set of metrics
and is not really a general mechanism for exporting *anything* (like user
level metrics from something like Hadoop).

cheers.

-- 
Nathan

<Prev in Thread] Current Thread [Next in Thread>