From mailman-bounces@oss.sgi.com Sat Dec 1 05:00:51 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-0.8 required=5.0 tests=ALL_TRUSTED,BAYES_00, J_CHICKENPOX_25 autolearn=no version=3.4.0-r929098 Received: from oss.sgi.com (localhost [127.0.0.1]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB1B0jL8044840 for ; Sat, 1 Dec 2012 05:00:45 -0600 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Subject: oss.sgi.com mailing list memberships reminder From: mailman-owner@oss.sgi.com To: pcp@oss.sgi.com X-No-Archive: yes Message-ID: Date: Sat, 01 Dec 2012 05:00:33 -0600 Precedence: bulk X-BeenThere: mailman@oss.sgi.com X-Mailman-Version: 2.1.11 List-Id: Mailman mail X-List-Administrivia: yes Sender: mailman-bounces@oss.sgi.com Errors-To: mailman-bounces@oss.sgi.com This is a reminder, sent out once a month, about your oss.sgi.com mailing list memberships. It includes your subscription info and how to use it to change it or unsubscribe from a list. You can visit the URLs to change your membership status or configuration, including unsubscribing, setting digest-style delivery or disabling delivery altogether (e.g., for a vacation), and so on. In addition to the URL interfaces, you can also use email to make such changes. For more info, send a message to the '-request' address of the list (for example, mailman-request@oss.sgi.com) containing just the word 'help' in the message body, and an email message will be sent to you with instructions. If you have questions, problems, comments, etc, send them to mailman-owner@oss.sgi.com. Thanks! Passwords for pcp@oss.sgi.com: List Password // URL ---- -------- pcp-announce@oss.sgi.com xE+IBctR http://oss.sgi.com/mailman/options/pcp-announce/pcp%40oss.sgi.com From kenj@internode.on.net Sun Dec 2 15:00:08 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,J_CHICKENPOX_47 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB2L08Ij013559 for ; Sun, 2 Dec 2012 15:00:08 -0600 X-ASG-Debug-ID: 1354482148-04bdf02d491b7a70001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id si1qVVVRfjULj499 for ; Sun, 02 Dec 2012 13:02:28 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AssjAI7Bu1B52af4PGdsb2JhbAANN4YshDq1OQMBAQEBOIJSAQEBBCNWEAsYAgImAgJDFAYuszpwkVSBIo5MgRMDqU4 Received: from cpe-121-217-167-248.lnse2.cht.bigpond.net.au (HELO [192.168.5.51]) ([121.217.167.248]) by ipmail06.adl2.internode.on.net with ESMTP; 03 Dec 2012 07:32:06 +1030 Message-ID: <1354482125.15639.14.camel@bozo-laptop.localdomain> Subject: Re: pmcd.openfds Metric (was: [pcp] NSS/NSPR Testing Status) From: Ken McDonell X-ASG-Orig-Subj: Re: pmcd.openfds Metric (was: [pcp] NSS/NSPR Testing Status) To: Dave Brolley Cc: Nathan Scott , "Frank Ch. Eigler" , pcp@oss.sgi.com Date: Mon, 03 Dec 2012 08:02:05 +1100 In-Reply-To: <50B8DB53.20500@redhat.com> References: <591870624.35407484.1354151497586.JavaMail.root@redhat.com> <50B8DB53.20500@redhat.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1354482148 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.115908 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On Fri, 2012-11-30 at 11:14 -0500, Dave Brolley wrote: > ... > If this metric and the code which implements it were indeed written by > Ken, then I think we need some clarification from him regarding the > original intent before we can come up with the proper solution. Yep, you can blame me ... 8^)> As far as I can recall (which is not far when you get to my age), the original motivation for this was to _cheaply_ collect a metric that would detect an obscure file descriptor leak problem. Using the number of open fd would be better than the maximum fd ever if the maximum is now very large in the NSS/NSPR case. I don't think iteration with dup() meets the "cheap" requirement. So provided you have closure of all the places open() and friends are called (as the current code does) _and_ closure over all the places close() and friends are called (the current does not do this), then changing the metric to be "currently open" would be fine. If the IPC table is already capturing all of the open and close cases, that would be fine ... my only question would be what happens to the fd uses that are not related to client-pmcd or pmcd-pmda ipc, e.g. files, pipes to shells, mmap (including DSOs) ... some of these might be outside the view of the IPC table but could potentially the source of fd leaks. From nscott@redhat.com Sun Dec 2 23:22:29 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,J_CHICKENPOX_47 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB35MSkO054853 for ; Sun, 2 Dec 2012 23:22:29 -0600 X-ASG-Debug-ID: 1354512289-04cbb035a41cc3e0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id 1AaofDbn93yMhxll for ; Sun, 02 Dec 2012 21:24:49 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB35Ok2G022071; Mon, 3 Dec 2012 00:24:46 -0500 Date: Mon, 3 Dec 2012 00:24:46 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell , Dave Brolley Cc: pcp@oss.sgi.com Message-ID: <1451523441.39059957.1354512286219.JavaMail.root@redhat.com> In-Reply-To: <1354482125.15639.14.camel@bozo-laptop.localdomain> Subject: Re: pmcd.openfds Metric (was: [pcp] NSS/NSPR Testing Status) MIME-Version: 1.0 X-ASG-Orig-Subj: Re: pmcd.openfds Metric (was: [pcp] NSS/NSPR Testing Status) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.44] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1354512289 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.115942 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi guys, ----- Original Message ----- > On Fri, 2012-11-30 at 11:14 -0500, Dave Brolley wrote: > > ... > > If this metric and the code which implements it were indeed written > > by > > Ken, then I think we need some clarification from him regarding the > > original intent before we can come up with the proper solution. > > Yep, you can blame me ... 8^)> > > As far as I can recall (which is not far when you get to my age), the > original motivation for this was to _cheaply_ collect a metric that > would detect an obscure file descriptor leak problem. > > Using the number of open fd would be better than the maximum fd ever > if the maximum is now very large in the NSS/NSPR case. > > I don't think iteration with dup() meets the "cheap" requirement. > > So provided you have closure of all the places open() and friends are > called (as the current code does) _and_ closure over all the places > ... Been looking into this since its still the weekend over Dave's way. With NSS we don't have direct access to these calls, its abstracted away. I got a fair way into an implementation which does the dlsym RTLD_NEXT trick to intercept the fd create/dup/teardown calls, but it all fell over in the end due to complexities around open(). Its varargs, is inline in glibc headers, and generally difficult. So, backed off from that and went with a simpler model involving extension of the existing instrumentation points. This turned out to be much simpler, esp. once I understood exactly what Dave meant with his comment about FD_SETSIZE earlier. Will go ahead with this approach I think, keeping the existing semantics for pmcd.openfds. One question which did come up that I'm looking for a second opinion on - do we need max_seen_fd in src/pmcd/src/config.c? Doesn't this duplicate the accounting also being done in PMCD_OPENFDS_SETHI()? I wonder if the close-before-exec-loop could use pmcd_openfds_hi, and could we remove max_seen_fd?? cheers. -- Nathan From nscott@redhat.com Mon Dec 3 03:07:16 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,J_CHICKENPOX_47 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB397G6Y129484 for ; Mon, 3 Dec 2012 03:07:16 -0600 X-ASG-Debug-ID: 1354525777-04cb6c05a71dd8a0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id MQFF1Z0RUAeaFAxF for ; Mon, 03 Dec 2012 01:09:37 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB399aXH005126 for ; Mon, 3 Dec 2012 04:09:36 -0500 Date: Mon, 3 Dec 2012 04:09:36 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: pcp@oss.sgi.com Message-ID: <650259910.39159440.1354525776551.JavaMail.root@redhat.com> Subject: pcp updates: nssmerge pmcd.openfds MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: nssmerge pmcd.openfds Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.44] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1354525777 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.115956 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://oss.sgi.com/pcp/pcp.git nssmerge src/include/pcp/impl.h | 1 + src/libpcp/src/auxconnect.c | 16 ++++++++++++++++ src/libpcp_pmcd/src/data.c | 18 ++++++++++++++---- src/pmcd/src/client.c | 2 +- src/pmcd/src/config.c | 6 +++--- src/pmcd/src/pmcd.h | 10 +++++----- 6 files changed, 40 insertions(+), 13 deletions(-) commit 7fdd6e721c0a0483b5347d4bd168d24d303cffb9 Author: Nathan Scott Date: Mon Dec 3 16:45:28 2012 +1100 Implement support for pmcd file descriptor leak checker with NSS Test 578 was failing with NSS, as a result of changes around the way the file descriptor table indexing works, and the semantics of the return value of __pmSocket type routines. This change keeps the existing semantics after some discussion of possible alternatives on the list, the alternative of tracking the actual count of open file descriptors proved far too difficult in practice. From kenj@internode.on.net Mon Dec 3 03:51:50 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB39po8c151739 for ; Mon, 3 Dec 2012 03:51:50 -0600 X-ASG-Debug-ID: 1354528450-04cbb035a71d6f30001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id g93YACIv1rNIr6yS for ; Mon, 03 Dec 2012 01:54:11 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApMBAEF1vFB20e94/2dsb2JhbAANMgaGLLlqgzuBBQYCJgJys1pwkgOBIoseJ3OCFIETA5YBk00 Received: from ppp118-209-239-120.lns20.mel6.internode.on.net (HELO [192.168.1.100]) ([118.209.239.120]) by ipmail05.adl6.internode.on.net with ESMTP; 03 Dec 2012 20:24:09 +1030 Message-ID: <1354528524.4291.11.camel@bozo.localdomain> Subject: pcp updates - qa From: Ken McDonell X-ASG-Orig-Subj: pcp updates - qa To: pcp@oss.sgi.com Date: Mon, 03 Dec 2012 20:55:24 +1100 Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1354528450 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.115960 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://oss.sgi.com/kenj/pcp.git dev qa/273 | 10 ++++++++-- qa/src/xval.c | 18 +++++++++++------- 2 files changed, 19 insertions(+), 9 deletions(-) commit 65fd0b0e40362ec9b48ad7f2456fbcaf688cddbc Author: Ken McDonell Date: Sun Dec 2 18:51:09 2012 +1100 qa/273 - filter tweak Depending on the phase of the moon and the local network config, error could be "No route to host" or "Connection timed out" ... treat these as equivalent in the filtering. commit e2ffc4f75945c6c8f0651310be78bc2691d93d4e Author: Ken McDonell Date: Sun Dec 2 10:22:51 2012 +1100 qa/xval.c - recode unusual casting Following recent changes to gcc compiler options, xval was failing with an addressing exception (seen from qa/010). This commit reworks the pmValueBlock vbuf buffer allocation and use in a way that is equivalent to the original but avoids the gcc trap. From fche@redhat.com Mon Dec 3 15:19:38 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,J_CHICKENPOX_47 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB3LJbjS025736 for ; Mon, 3 Dec 2012 15:19:37 -0600 X-ASG-Debug-ID: 1354569719-04bdf02d4b21b810001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id VkjQFFbEwPJOIiqm for ; Mon, 03 Dec 2012 13:21:59 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id qB3LLuF7016900 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Mon, 3 Dec 2012 16:21:56 -0500 Received: from fche.csb (vpn-8-35.rdu.redhat.com [10.11.8.35]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id qB3LLpDX017867; Mon, 3 Dec 2012 16:21:55 -0500 Received: by fche.csb (Postfix, from userid 2569) id 84D2658145; Mon, 3 Dec 2012 16:21:50 -0500 (EST) Date: Mon, 3 Dec 2012 16:21:50 -0500 From: "Frank Ch. Eigler" To: Ken McDonell Cc: Dave Brolley , Nathan Scott , pcp@oss.sgi.com Subject: Re: pmcd.openfds Metric (was: [pcp] NSS/NSPR Testing Status) Message-ID: <20121203212150.GJ27600@redhat.com> X-ASG-Orig-Subj: Re: pmcd.openfds Metric (was: [pcp] NSS/NSPR Testing Status) References: <591870624.35407484.1354151497586.JavaMail.root@redhat.com> <50B8DB53.20500@redhat.com> <1354482125.15639.14.camel@bozo-laptop.localdomain> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1354482125.15639.14.camel@bozo-laptop.localdomain> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1354569719 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com Hi - On Mon, Dec 03, 2012 at 08:02:05AM +1100, Ken McDonell wrote: > [...] > As far as I can recall (which is not far when you get to my age), the > original motivation for this was to _cheaply_ collect a metric that > would detect an obscure file descriptor leak problem. > [...] > I don't think iteration with dup() meets the "cheap" requirement. It's not cheap, but it is thorough. :) > So provided you have closure of all the places open() and friends are > called (as the current code does) [...] Do we really? Third-party PMDA DSO's are unknown, and so may be some of the fd operations used by various libraries our own DSO's link in (e.g. the new systemd one! :-). - FChE From nscott@redhat.com Mon Dec 3 16:37:33 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB3MbXhc053365 for ; Mon, 3 Dec 2012 16:37:33 -0600 X-ASG-Debug-ID: 1354574394-04cb6c05a72189b0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id 2DAPj1LAUztTDHEm for ; Mon, 03 Dec 2012 14:39:54 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB3Mdotw016403; Mon, 3 Dec 2012 17:39:50 -0500 Date: Mon, 3 Dec 2012 17:39:50 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Dave Brolley , Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <486347961.39718033.1354574390566.JavaMail.root@redhat.com> In-Reply-To: <50B8E0DF.4010307@redhat.com> Subject: Re: More cleverer QA config needed? (was Re: [pcp] NSS/NSPR Testing Status) MIME-Version: 1.0 X-ASG-Orig-Subj: Re: More cleverer QA config needed? (was Re: [pcp] NSS/NSPR Testing Status) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.68] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1354574394 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116009 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi guys, ----- Original Message ----- > On 11/30/2012 03:18 AM, Nathan Scott wrote: > > ----- Original Message ----- > >> ... > >> So, approach used so far is to add the sort of tests we have now > >> (PCP version based) as an initial "will this compile at all" > >> check, > >> then a subsequent "dynamic" check is done via a call into a libpcp > >> routine that was added at the time of the initial feature commit. > >> > >> There's pros and cons. NSS doesn't actually have a routine like > >> this and we'd have to add something. Need to think further on the > >> best option I think - maybe adding in a feature-test interface to > >> libpcp (analogous to sysconf(3), but less int-based) and also a > >> helper tool (something like getconf(1), for QA)? > >> > >> Another option would be to use the pkg-config tool I guess. Or we > >> continue on the query-interface-per-feature path, which works too. > > Attached patch is an initial pass (untested) at approach #1 for > > your > > consideration & amusement. I came across the existing pmconfig(1) > > & > > made this fit into that tool, with similar APIs. > > > > Thoughts? > > > I like the idea of being able to query the library regarding its > features/capabilities. This would certainly be useful for testing and > would likely be useful for applications using the library. > With some minor fixes to the original patch, here's where its at: $ pmconfig -L pmapi_version=2 multi_threaded=true fault_injection=false secure_sockets=true Seems promising (nice & simple) so far, so I'll continue down this path with NSS-conditional QA test updates today, man page updates, etc. With that, I think the next stage of NSS merging is looking really good now; so planning to merge that into dev late today if nothing unexpected happens. cheers. -- Nathan From junwang123@gmail.com Mon Dec 3 18:57:22 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: *** X-Spam-Status: No, score=3.8 required=5.0 tests=BAYES_50,FREEMAIL_FROM, HTML_MESSAGE,T_DKIM_INVALID,T_TO_NO_BRKTS_FREEMAIL autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB40vMGg075780 for ; Mon, 3 Dec 2012 18:57:22 -0600 X-ASG-Debug-ID: 1354582782-04cbb035a5217e50001-S8gJnT Received: from mail-la0-f53.google.com (mail-la0-f53.google.com [209.85.215.53]) by cuda.sgi.com with ESMTP id oTvJoZNaIDFKC6Rk (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Mon, 03 Dec 2012 16:59:43 -0800 (PST) X-Barracuda-Envelope-From: junwang123@gmail.com X-Barracuda-Apparent-Source-IP: 209.85.215.53 X-Barracuda-IPDD: Level1 [gmail.com/209.85.215.53] Received: by mail-la0-f53.google.com with SMTP id w12so2910547lag.26 for ; Mon, 03 Dec 2012 16:59:42 -0800 (PST) X-Barracuda-IPDD: Level1 [gmail.com/209.85.215.53] X-Barracuda-IPDD: Level1 [gmail.com/209.85.215.53] DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=wtC98sR/VpK6n8esHwbbAWGT9EmX7iQrsUkCqWs13ZQ=; b=D7hc1VPR3+0MTBMmQHcEW6ERRiHLmAmYI6wJKHYXYBU13AhtMcBom3vjdUr/dYYa1u HW6W1PnPDpGYf9Et2plkg4n3+91qr/m62+dBT0jL8ixUvtk7wr1w4b90A6jzDJbfxpOS SMCxGHh8M8mbkwaQRf9C3MUTaifusJN5JpCYhV5sR6UfBa/5khnQlut41Fg8LM0KbMRp ktPxLYufiaCA0RU/410byol2Uu1avVSBO8IrB2HJurlGz6G1sNceKTlmD0/ltRxTRT87 wrW2KRApmn0nLP9FzOebbJCF0pMzOeJGS3J2gqyYoUGC6QVQYVA3btp7y2KFHuS4H509 7YIA== MIME-Version: 1.0 Received: by 10.152.124.83 with SMTP id mg19mr11339834lab.6.1354582782044; Mon, 03 Dec 2012 16:59:42 -0800 (PST) Received: by 10.112.84.73 with HTTP; Mon, 3 Dec 2012 16:59:41 -0800 (PST) Date: Mon, 3 Dec 2012 16:59:41 -0800 Message-ID: Subject: pmie process management From: Jun Wang X-ASG-Orig-Subj: pmie process management To: pcp@oss.sgi.com Content-Type: multipart/alternative; boundary=f46d042dfc958aeaf204cffc61f7 X-Barracuda-Connect: mail-la0-f53.google.com[209.85.215.53] X-Barracuda-Start-Time: 1354582783 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED, HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116020 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 HTML_MESSAGE BODY: HTML included in message --f46d042dfc958aeaf204cffc61f7 Content-Type: text/plain; charset=UTF-8 Folks, I noticed that I cannot start pmie service with the following command unless `chkconfig pmie on` is set for boot up. `service pmie start` Is this expected? Any why? Thanks, Jun --f46d042dfc958aeaf204cffc61f7 Content-Type: text/html; charset=UTF-8 Folks,

I noticed that I cannot start pmie service with the following command unless `chkconfig pmie on` is set for boot up.

`service pmie start`

Is this expected? Any why?

Thanks,
Jun
--f46d042dfc958aeaf204cffc61f7-- From nscott@redhat.com Tue Dec 4 00:20:47 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB46KlWL129900 for ; Tue, 4 Dec 2012 00:20:47 -0600 X-ASG-Debug-ID: 1354602188-04cbb035a5228cf0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id zMswfwVrpgPJicek for ; Mon, 03 Dec 2012 22:23:08 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB46N81B013099 for ; Tue, 4 Dec 2012 01:23:08 -0500 Date: Tue, 4 Dec 2012 01:23:08 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: pcp@oss.sgi.com Message-ID: <764940211.39850205.1354602188339.JavaMail.root@redhat.com> Subject: pcp updates: libpcp feature test MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: libpcp feature test Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.68] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1354602188 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116042 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://oss.sgi.com/pcp/pcp.git dev man/man1/pmconfig.1 | 14 ++++++++-- man/man3/pmgetconfig.3 | 36 ++++++++++++++++++++++--- src/include/pcp/impl.h | 7 +++++ src/libpcp/src/check-statics | 1 src/libpcp/src/config.c | 60 ++++++++++++++++++++++++++++++++++++++++++- src/pmcd/src/config.c | 38 +++++++++------------------ src/pmcd/src/pmcd.h | 3 ++ src/pmconfig/pmconfig.c | 44 +++++++++++++++++++++++++------ 8 files changed, 162 insertions(+), 41 deletions(-) commit b9a9da9cca14792feb00e758a08485154b358615 Author: Nathan Scott Date: Tue Dec 4 10:26:16 2012 +1100 Small source code cleanup improvements in pmcd This patch implements three straight forward improvements in the pmcd configuration file handling code: - remove the (duplicated) accounting of "max_seen_fd", which was recently noticed to be doubling up with "pmcd_openfds_hi"; - move an extern declaration into a common header; - remove initialisation-to-zero of globals, as the compiler gives guarantees about this already. commit 0eb0ac840ef40d043bccf406d4b2ab87bffe5be6 Author: Nathan Scott Date: Tue Dec 4 10:11:00 2012 +1100 Add an internal __pmGetAPIConfig feature-test interface This implements a new feature testing interface suitable for QA testing and any applications which might need to enquire about support for features they intend to use. The pmconfig(1) command is extended with a -L option allowing one to call this from the command line, in both an "all" mode and a "specific feature" query mode. From nscott@redhat.com Tue Dec 4 00:22:51 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,J_CHICKENPOX_83 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB46MpET130032 for ; Tue, 4 Dec 2012 00:22:51 -0600 X-ASG-Debug-ID: 1354602312-04cbb035a5228e70001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id NhVJFCb0p9tuo5s8 for ; Mon, 03 Dec 2012 22:25:13 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB46PC77029838 for ; Tue, 4 Dec 2012 01:25:12 -0500 Date: Tue, 4 Dec 2012 01:25:12 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: pcp@oss.sgi.com Message-ID: <1643650317.39850396.1354602312491.JavaMail.root@redhat.com> In-Reply-To: <1564614563.39849059.1354602095955.JavaMail.root@redhat.com> Subject: pcp updates: nssmerge merge MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: nssmerge merge Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.68] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1354602313 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC5_SA210e X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116042 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC5_SA210e Custom Rule SA210e This update just pulled in Ken's dev branch and Dave's nssmerge work. Massive update, really - but intertwined with many other branch merges/updates, so diffstat+log below are only the last few commits from me for today (refer to Ken's git-log & earlier nssmerge git-log emails about the respective changesets). Note: this will enable the use of NSS if a working version is found on your build system. This can be reverted if desired, or should problems crop up, using --without-secure-sockets at ./configure time (this can now be passed into Makepkgs also). Changes committed to git://oss.sgi.com/pcp/pcp.git dev qa/360 | 2 ++ qa/653 | 2 +- qa/src/dumb_pmda.c | 7 ++++++- qa/src/username.c | 6 ++++++ src/pmlc/actions.c | 3 +-- 5 files changed, 16 insertions(+), 4 deletions(-) commit d0a764c84732aff302438a4f5d862c4d5ef85076 Author: Nathan Scott Date: Tue Dec 4 17:13:15 2012 +1100 Fix lurking NSS regression in pmlc with socket teardown QA test 116 was failing for me, turned out to be due to use of an explicit close/__pmResetIPC rather than use of __pmCloseSocket as we now do. Without this, results in Address-already-in-use errors when pmlc attempts to establish a new connection. commit fb23a25ce862f177d0fdb8ad644188f6ba6ad55c Author: Nathan Scott Date: Tue Dec 4 16:20:11 2012 +1100 Temporarily disable qa/360 which appears to also be in-situ wrt pmie changes commit e6047ce59870dc40f4c41253924af0e3ffef3f8e Author: Nathan Scott Date: Tue Dec 4 13:26:08 2012 +1100 Ensure correct headers (localconfig) pulled in by test sources commit 241a87a0140da69a59fccc9af51aae4eef330c91 Author: Nathan Scott Date: Tue Dec 4 11:22:38 2012 +1100 Add compat API wrapper to username.c for testing older PCP versions commit 10cc22bf06d640d4785dad9eb20097c16d3651b5 Author: Nathan Scott Date: Tue Dec 4 11:22:03 2012 +1100 Add compat API wrapper to dumb_pmda.c for older PCP versions commit fab5bbb3657f671f254a02efaaa01365b63f9c36 Author: Nathan Scott Date: Tue Dec 4 11:21:25 2012 +1100 Fix filter in test 653 to handle single digit days of the month From kenj@internode.on.net Tue Dec 4 01:19:21 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB47JKIL144042 for ; Tue, 4 Dec 2012 01:19:20 -0600 X-ASG-Debug-ID: 1354605701-04bdf02d4a23f3f0001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id GUJ9xU4DKCBOACy7 for ; Mon, 03 Dec 2012 23:21:41 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AscDAEGjvVB20e94/2dsb2JhbAANN4YstCyCUgEDAQOBHoM7gQsCJgJDs2Zwgj+QSoEijDiCFIETA5YCk00 Received: from ppp118-209-239-120.lns20.mel6.internode.on.net (HELO [192.168.1.100]) ([118.209.239.120]) by ipmail06.adl6.internode.on.net with ESMTP; 04 Dec 2012 17:51:40 +1030 Message-ID: <1354605776.4291.18.camel@bozo.localdomain> Subject: QA Status From: Ken McDonell X-ASG-Orig-Subj: QA Status To: pcp@oss.sgi.com Date: Tue, 04 Dec 2012 18:22:56 +1100 Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1354605701 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116046 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Before the nssmerge, I've been doing some QA on the dev branch. I am seeing failures for these tests: 169 183 184 185 187 244 255 274 279 340 348 359 370 457 513 603 653 707 708 709 710 I am pretty sure these were all passing a few months ago. Is anyone else seeing similar results? From nscott@redhat.com Tue Dec 4 02:28:04 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB48S3Dr167978 for ; Tue, 4 Dec 2012 02:28:03 -0600 X-ASG-Debug-ID: 1354609825-04bdf02d4b242470001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id UKBXRtid9zaUCPy2 for ; Tue, 04 Dec 2012 00:30:25 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB48ULoc020888; Tue, 4 Dec 2012 03:30:21 -0500 Date: Tue, 4 Dec 2012 03:30:21 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <1162586249.39888846.1354609821476.JavaMail.root@redhat.com> In-Reply-To: <1354605776.4291.18.camel@bozo.localdomain> Subject: Re: [pcp] QA Status MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] QA Status Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.68] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1354609825 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116050 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi Ken, ----- Original Message ----- > Before the nssmerge, I've been doing some QA on the dev branch. > > I am seeing failures for these tests: > > 169 183 184 185 187 244 255 274 279 340 348 359 370 457 513 603 653 > 707 708 709 710 > > I am pretty sure these were all passing a few months ago. > > Is anyone else seeing similar results? > Of those, I have only 187 failing (and its always failed for me in recent time, with remote host testing enabled, and the errors look QA-test related - incl. scp usage message and so on) and 603 (also has always failed, also looks unsuitable-remote-host related). pcpqa$ ./check -q -l 169 183 184 185 187 244 255 274 279 340 348 359 370 457 513 603 653 707 [0%] 169 28s ... [5%] 183 78s ... [11%] 184 36s ... [16%] 185 61s ... [22%] 187 [failed, exit status 2] - output mismatch (see 187.out.bad) 2,10c2,56 < map file for this host present < map file for other host present < map file for other-fqdn host present < Waiting for pmcd to terminate ... < Starting pmcd ... < Starting pmlogger ... < map file for this host missing ... expected for this host when PMCD killed < map file for other host present < map file for other-fqdn host present --- > Arrgghhh ... pmlogger (pid=9332) failed to start after 20 seconds > at Tue Dec 4 19:13:47 EST 2012. > pmlogger log (/tmp/9248.log3) ... > Log for pmlogger on smash started Tue Dec 4 19:13:26 2012 > > pmlogger: Cannot connect to PMCD on host "-L": No route to host > > Log finished Tue Dec 4 19:13:27 2012 > > pmcd log (-L:/var/log/pcp/pmcd/pmcd.log) ... > scp: illegal option -- L > usage: scp [-1246BCpqrv] [-c cipher] [-F ssh_config] [-i identity_file] > [-l limit] [-o ssh_option] [-P port] [-S program] > [[user@]host1:]file1 ... [[user@]host2:]file2 [...snip...] [27%] 244 34s ... [33%] 255 53s ... [38%] 274 15s ... [44%] 279 258s ... [50%] 340 23s ... [55%] 348 20s ... [61%] 359 1s ... [66%] 370 [not run] no data file for sysstat version 9.0.4 [72%] 457 26s ... [77%] 513 1s ... [83%] 603 - output mismatch (see 603.out.bad) 81c81 < pmtrace: observation error: Cannot connect to PMDA - permission denied --- > pmtrace: observation complete (tag="eek", value=1.000000) Check local PMCD is still alive ... PMDA probe: pminfo -h smash -f sample.milliseconds PMDA probe: pminfo -h smash -f sampledso.milliseconds PMDA probe: pminfo -h smash -f simple.numfetch [88%] 653 2s ... [94%] 707 4s ... Not run: 370 Failures: 187 603 Failed 2 of 17 tests pcpqa$ ./check -q -l 708 709 710 708 0s ... 709 28s ... 710 1s ... Passed all 3 tests Same results both with and without NSS goo-dness. Noticed the last four there are all the python tests, FWIW - those failures probably share a root-cause I guess. cheers. -- Nathan From nscott@redhat.com Tue Dec 4 02:29:26 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB48TPcI168135 for ; Tue, 4 Dec 2012 02:29:25 -0600 X-ASG-Debug-ID: 1354609907-04cb6c05a6237fc0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id aI7Lux8P9qRbIUcE for ; Tue, 04 Dec 2012 00:31:47 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB48VkfB020966; Tue, 4 Dec 2012 03:31:46 -0500 Date: Tue, 4 Dec 2012 03:31:46 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Jun Wang Cc: pcp@oss.sgi.com Message-ID: <551217350.39890646.1354609906591.JavaMail.root@redhat.com> In-Reply-To: Subject: Re: [pcp] pmie process management MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pmie process management Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.68] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1354609907 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116050 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi Jun, ----- Original Message ----- > > Folks, > > I noticed that I cannot start pmie service with the following command > unless `chkconfig pmie on` is set for boot up. > > `service pmie start` > > Is this expected? It is. FWIW, I've heard this confusion/complaint from sysadmins before as well. It is also meant to give a big warning if its not going to be able to start, although this assumes its being run by $PCP_RC_DIR/pmie, which is often replaced by "service pmie start" nowadays (& no message). > Any [idea] why? The idea was to only allow it to be started if it will also start after a reboot, because otherwise it will be forgotten and on reboot wont be started. I'm not sure if this is historical IRIX behaviour now, it may have been. PCP is the only package I've observed this from though (not that I've looked around much). *shrug* ... is there really a scenario where you want to start it but would not want it started on (re)boot? I imagine the thinking was "better to fail now, while its freshly in ones mind and likely to be checked, than silently later". cheers. -- Nathan From nscott@redhat.com Tue Dec 4 02:43:07 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,J_CHICKENPOX_47 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB48h626169839 for ; Tue, 4 Dec 2012 02:43:07 -0600 X-ASG-Debug-ID: 1354610728-04bdf02d48242ba0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id CCYJhyJGuNDOKYdq for ; Tue, 04 Dec 2012 00:45:28 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB48jPb7006159; Tue, 4 Dec 2012 03:45:25 -0500 Date: Tue, 4 Dec 2012 03:45:25 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: Dave Brolley , pcp@oss.sgi.com, Ken McDonell Message-ID: <301298364.39894075.1354610725214.JavaMail.root@redhat.com> In-Reply-To: <20121203212150.GJ27600@redhat.com> Subject: Re: pmcd.openfds Metric (was: [pcp] NSS/NSPR Testing Status) MIME-Version: 1.0 X-ASG-Orig-Subj: Re: pmcd.openfds Metric (was: [pcp] NSS/NSPR Testing Status) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.68] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1354610728 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116050 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > > ... > > So provided you have closure of all the places open() and friends > > are called (as the current code does) [...] > > Do we really? Not exactly. There's critical places in pmcd (client connect, and on agent start) which are instrumented. AIUI (*my* recollection of the original intent) was to detect long-term fd leaks cheaply, which this simplistic approach does still manage to do (thanks to recycling of lower fd slots after close). > Third-party PMDA DSO's are unknown, and so may be some > of the fd operations used by various libraries our own DSO's link in > (e.g. the new systemd one! :-). If they/pmcd leak fds it will show up by watching (logging) this metric over long periods, because the high water mark gets bumped ever upward rather than reaching a steady state. cheers. -- Nathan From kenj@internode.on.net Tue Dec 4 03:47:40 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB49ldx2174553 for ; Tue, 4 Dec 2012 03:47:39 -0600 X-ASG-Debug-ID: 1354614600-04cb6c05a623a4d0001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id bwIJKWecvlsSV3AE for ; Tue, 04 Dec 2012 01:50:01 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ArUBAEDGvVB20e94/2dsb2JhbAANN4YstCyDcYMRAQEBAwEjVgUHBAsYAgISFAICVwaIHatBcII/kFeBIoseFoEADIIMgRMDlgKTTYFQCA Received: from ppp118-209-239-120.lns20.mel6.internode.on.net (HELO [192.168.1.100]) ([118.209.239.120]) by ipmail06.adl6.internode.on.net with ESMTP; 04 Dec 2012 20:20:00 +1030 Message-ID: <1354614677.4291.20.camel@bozo.localdomain> Subject: Re: [pcp] QA Status From: Ken McDonell X-ASG-Orig-Subj: Re: [pcp] QA Status To: Nathan Scott Cc: pcp@oss.sgi.com Date: Tue, 04 Dec 2012 20:51:17 +1100 In-Reply-To: <1162586249.39888846.1354609821476.JavaMail.root@redhat.com> References: <1162586249.39888846.1354609821476.JavaMail.root@redhat.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1354614600 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=FB_WORD1_END_DOLLAR X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116056 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 FB_WORD1_END_DOLLAR BODY: Looks like a word ending with a $ On Tue, 2012-12-04 at 03:30 -0500, Nathan Scott wrote: > Hi Ken, > > ----- Original Message ----- > > Before the nssmerge, I've been doing some QA on the dev branch. > > > > I am seeing failures for these tests: > > > > 169 183 184 185 187 244 255 274 279 340 348 359 370 457 513 603 653 > > 707 708 709 710 > > > > I am pretty sure these were all passing a few months ago. > > > > Is anyone else seeing similar results? > > > > Of those, I have only 187 failing (and its always failed for me in > recent time, with remote host testing enabled, and the errors look > QA-test related - incl. scp usage message and so on) and 603 (also > has always failed, also looks unsuitable-remote-host related). > > pcpqa$ ./check -q -l 169 183 184 185 187 244 255 274 279 340 348 359 370 457 513 603 653 707 > [0%] 169 28s ... > [5%] 183 78s ... > [11%] 184 36s ... > [16%] 185 61s ... > [22%] 187 [failed, exit status 2] - output mismatch (see 187.out.bad) > 2,10c2,56 > < map file for this host present > < map file for other host present > < map file for other-fqdn host present > < Waiting for pmcd to terminate ... > < Starting pmcd ... > < Starting pmlogger ... > < map file for this host missing ... expected for this host when PMCD killed > < map file for other host present > < map file for other-fqdn host present > --- > > Arrgghhh ... pmlogger (pid=9332) failed to start after 20 seconds > > at Tue Dec 4 19:13:47 EST 2012. > > pmlogger log (/tmp/9248.log3) ... > > Log for pmlogger on smash started Tue Dec 4 19:13:26 2012 > > > > pmlogger: Cannot connect to PMCD on host "-L": No route to host > > > > Log finished Tue Dec 4 19:13:27 2012 > > > > pmcd log (-L:/var/log/pcp/pmcd/pmcd.log) ... > > scp: illegal option -- L > > usage: scp [-1246BCpqrv] [-c cipher] [-F ssh_config] [-i identity_file] > > [-l limit] [-o ssh_option] [-P port] [-S program] > > [[user@]host1:]file1 ... [[user@]host2:]file2 > [...snip...] > [27%] 244 34s ... > [33%] 255 53s ... > [38%] 274 15s ... > [44%] 279 258s ... > [50%] 340 23s ... > [55%] 348 20s ... > [61%] 359 1s ... > [66%] 370 [not run] no data file for sysstat version 9.0.4 > [72%] 457 26s ... > [77%] 513 1s ... > [83%] 603 - output mismatch (see 603.out.bad) > 81c81 > < pmtrace: observation error: Cannot connect to PMDA - permission denied > --- > > pmtrace: observation complete (tag="eek", value=1.000000) > Check local PMCD is still alive ... > PMDA probe: pminfo -h smash -f sample.milliseconds > PMDA probe: pminfo -h smash -f sampledso.milliseconds > PMDA probe: pminfo -h smash -f simple.numfetch > [88%] 653 2s ... > [94%] 707 4s ... > Not run: 370 > Failures: 187 603 > Failed 2 of 17 tests many of these are failing for me with QA pmdas not being stopped/started with sighup and odd lines like this for 169 ... pmcd: error starting /home/kenj/src/pcp/qa/src/dumb_pmda: Permission denied what user id are you running QA as? > pcpqa$ ./check -q -l 708 709 710 > 708 0s ... > 709 28s ... > 710 1s ... > Passed all 3 tests > > > Same results both with and without NSS goo-dness. Noticed the last > four there are all the python tests, FWIW - those failures probably > share a root-cause I guess. Yep, e.g. 707.full looks like ... Traceback (most recent call last): File "/home/kenj/src/pcp/qa/src/test_pcp.python", line 16, in import pmapi ImportError: No module named pmapi > cheers. > > -- > Nathan From kenj@internode.on.net Tue Dec 4 13:49:13 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB4JnCTj255280 for ; Tue, 4 Dec 2012 13:49:13 -0600 X-ASG-Debug-ID: 1354650693-04cb6c05a625afa0001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id CbNkK3dTruYUkJ71 for ; Tue, 04 Dec 2012 11:51:34 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApMBACNIvlB20e94/2dsb2JhbAANN4YzuBKDEQEBAQMBI1YQCxoCJgICVwaIHa0mcJMagSKOQ4ETA5YDk00 Received: from ppp118-209-239-120.lns20.mel6.internode.on.net (HELO [192.168.1.100]) ([118.209.239.120]) by ipmail05.adl6.internode.on.net with ESMTP; 05 Dec 2012 05:35:36 +1030 Message-ID: <1354648014.4291.24.camel@bozo.localdomain> Subject: Re: [pcp] QA Status - python tests From: Ken McDonell X-ASG-Orig-Subj: Re: [pcp] QA Status - python tests To: Nathan Scott Cc: pcp@oss.sgi.com Date: Wed, 05 Dec 2012 06:06:54 +1100 In-Reply-To: <1354614677.4291.20.camel@bozo.localdomain> References: <1162586249.39888846.1354609821476.JavaMail.root@redhat.com> <1354614677.4291.20.camel@bozo.localdomain> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1354650693 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=FB_WORD1_END_DOLLAR X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116096 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 FB_WORD1_END_DOLLAR BODY: Looks like a word ending with a $ On Tue, 2012-12-04 at 20:51 +1100, Ken McDonell wrote: > > pcpqa$ ./check -q -l 708 709 710 > > 708 0s ... > > 709 28s ... > > 710 1s ... > > Passed all 3 tests > > > > > > Same results both with and without NSS goo-dness. Noticed the last > > four there are all the python tests, FWIW - those failures probably > > share a root-cause I guess. > > Yep, e.g. 707.full looks like ... > > Traceback (most recent call last): > File "/home/kenj/src/pcp/qa/src/test_pcp.python", line 16, in > import pmapi > ImportError: No module named pmapi I can get 707 to pass if PYTHONPATH=/usr/lib/python2.7/site-packages is set in the environment, so it looks like we're installing the modules in place where my version of python (2.7) is not looking for the modules. I know nothing about python, ... is this expected / normal. If QA needs to know where the package installed the modules we'll need some additional /etc/pcp.conf help to make this all work. From fche@redhat.com Tue Dec 4 15:20:45 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,J_CHICKENPOX_34 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB4LKjUf191090 for ; Tue, 4 Dec 2012 15:20:45 -0600 X-ASG-Debug-ID: 1354656187-04cbb035a5253a00001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id ahPEkxV0x90BoFS1 for ; Tue, 04 Dec 2012 13:23:08 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx01.intmail.prod.int.phx2.redhat.com (int-mx01.intmail.prod.int.phx2.redhat.com [10.5.11.11]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id qB4LN4Px022195 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Tue, 4 Dec 2012 16:23:04 -0500 Received: from fche.csb (vpn-10-116.rdu.redhat.com [10.11.10.116]) by int-mx01.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB4LN4uR004953; Tue, 4 Dec 2012 16:23:04 -0500 Received: by fche.csb (Postfix, from userid 2569) id 7BB005812B; Tue, 4 Dec 2012 16:23:03 -0500 (EST) To: Ken McDonell Cc: Nathan Scott , pcp@oss.sgi.com Subject: Re: QA Status - python tests References: <1162586249.39888846.1354609821476.JavaMail.root@redhat.com> <1354614677.4291.20.camel@bozo.localdomain> <1354648014.4291.24.camel@bozo.localdomain> X-ASG-Orig-Subj: Re: QA Status - python tests From: fche@redhat.com (Frank Ch. Eigler) Date: Tue, 04 Dec 2012 16:23:03 -0500 In-Reply-To: <1354648014.4291.24.camel@bozo.localdomain> (Ken McDonell's message of "Wed, 05 Dec 2012 06:06:54 +1100") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.67 on 10.5.11.11 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1354656187 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com Ken McDonell writes: > I can get 707 to pass if > PYTHONPATH=/usr/lib/python2.7/site-packages > is set in the environment, so it looks like we're installing the modules > in place where my version of python (2.7) is not looking for the > modules. What do these report? % python -c 'import sys; print sys.path' % make -C src/python install_python (With the latter, you'll notice we're using python's own installer; see also src/include/builddefs.in) - FChE From kenj@internode.on.net Tue Dec 4 16:42:06 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,J_CHICKENPOX_34 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB4Mg6Yt197688 for ; Tue, 4 Dec 2012 16:42:06 -0600 X-ASG-Debug-ID: 1354661066-04cbb035a6255f90001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id e9sIo8Na5Bijqecc for ; Tue, 04 Dec 2012 14:44:27 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApMBAKJ7vlB20e94/2dsb2JhbAANN4YzuBSDEQEBAQQjVhALGAICJgICVwYTtQBwkxWBIo5DgRMDlgOBHJIx Received: from ppp118-209-239-120.lns20.mel6.internode.on.net (HELO [192.168.1.100]) ([118.209.239.120]) by ipmail05.adl6.internode.on.net with ESMTP; 05 Dec 2012 09:14:24 +1030 Message-ID: <1354661142.4291.28.camel@bozo.localdomain> Subject: Re: QA Status - python tests From: Ken McDonell X-ASG-Orig-Subj: Re: QA Status - python tests To: "Frank Ch. Eigler" Cc: Nathan Scott , pcp@oss.sgi.com Date: Wed, 05 Dec 2012 09:45:42 +1100 In-Reply-To: References: <1162586249.39888846.1354609821476.JavaMail.root@redhat.com> <1354614677.4291.20.camel@bozo.localdomain> <1354648014.4291.24.camel@bozo.localdomain> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1354661066 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116106 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header On Tue, 2012-12-04 at 16:23 -0500, Frank Ch. Eigler wrote: > Ken McDonell writes: > > > I can get 707 to pass if > > PYTHONPATH=/usr/lib/python2.7/site-packages > > is set in the environment, so it looks like we're installing the modules > > in place where my version of python (2.7) is not looking for the > > modules. > > What do these report? > > % python -c 'import sys; print sys.path' Looks like everything you can hit with a big stick _except_ the place pcp_python is installing our modules ... (note dist-packages, not site-packages) $ python -c 'import sys; print sys.path' ['', '/usr/lib/python2.7', '/usr/lib/python2.7/plat-linux2', '/usr/lib/python2.7/lib-tk', '/usr/lib/python2.7/lib-old', '/usr/lib/python2.7/lib-dynload', '/usr/local/lib/python2.7/dist-packages', '/usr/lib/python2.7/dist-packages', '/usr/lib/python2.7/dist-packages/PIL', '/usr/lib/python2.7/dist-packages/gst-0.10', '/usr/lib/python2.7/dist-packages/gtk-2.0', '/usr/lib/pymodules/python2.7'] > % make -C src/python install_python Didn't want to run this as root in case I changed the problem, but ... $ make -C src/python install_python make: Entering directory `/home/kenj/src/pcp/src/python' python setup.py install --skip-build --root=${DIST_ROOT-/} --record=../../python-pcp.list --prefix=/usr running install running install_lib warning: install_lib: 'build/lib.linux-x86_64-2.7' does not exist -- no Python modules to install running install_egg_info Removing /usr/lib/python2.7/site-packages/pcp-0.2-py2.7.egg-info error: /usr/lib/python2.7/site-packages/pcp-0.2-py2.7.egg-info: Permission denied make: *** [install_python] Error 1 make: Leaving directory `/home/kenj/src/pcp/src/python' > (With the latter, you'll notice we're using python's own installer; > see also src/include/builddefs.in) > > > - FChE From nscott@redhat.com Tue Dec 4 16:42:40 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB4Mgesa197843 for ; Tue, 4 Dec 2012 16:42:40 -0600 X-ASG-Debug-ID: 1354661102-04cb6c05a6261da0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id OpglvjeHN2hPRZ2m for ; Tue, 04 Dec 2012 14:45:02 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB4MixdF018390; Tue, 4 Dec 2012 17:44:59 -0500 Date: Tue, 4 Dec 2012 17:44:59 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <383072804.40875268.1354661099598.JavaMail.root@redhat.com> In-Reply-To: <1354614677.4291.20.camel@bozo.localdomain> Subject: Re: [pcp] QA Status MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] QA Status Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.72] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1354661102 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=FB_WORD1_END_DOLLAR X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116106 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 FB_WORD1_END_DOLLAR BODY: Looks like a word ending with a $ ----- Original Message ----- > ... > many of these are failing for me with QA pmdas not being > stopped/started with sighup and odd lines like this for 169 ... > > pmcd: error starting /home/kenj/src/pcp/qa/src/dumb_pmda: Permission > denied Hmm, that is odd indeed. What does ls -l say on that binary? > what user id are you running QA as? "pcpqa" mostly, but also as myself at times (both accounts can sudo-to-root of course). > > pcpqa$ ./check -q -l 708 709 710 > > 708 0s ... > > 709 28s ... > > 710 1s ... > > Passed all 3 tests > > > > > > Same results both with and without NSS goo-dness. Noticed the last > > four there are all the python tests, FWIW - those failures probably > > share a root-cause I guess. > > Yep, e.g. 707.full looks like ... > > Traceback (most recent call last): > File "/home/kenj/src/pcp/qa/src/test_pcp.python", line 16, in > > import pmapi > ImportError: No module named pmapi Feels a bit like the install is managing to land the python library pieces in the wrong location, and they're not being found when its running/importing. Possibly a packaging issue then. cheers. -- Nathan From kenj@internode.on.net Tue Dec 4 18:16:37 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB50GbTS210822 for ; Tue, 4 Dec 2012 18:16:37 -0600 X-ASG-Debug-ID: 1354666738-04cbb035a7258700001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id 5ZWwydRAoWfHfym5 for ; Tue, 04 Dec 2012 16:18:59 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: Aq4BACaSvlB20e94/2dsb2JhbAANN4Y0tC+DaIMRAQEBBCNWDAQjAgImAgJXBrUncJMRgSKOQ4ETA5YDk00 Received: from ppp118-209-239-120.lns20.mel6.internode.on.net (HELO [192.168.1.100]) ([118.209.239.120]) by ipmail05.adl6.internode.on.net with ESMTP; 05 Dec 2012 10:48:50 +1030 Message-ID: <1354666808.4291.36.camel@bozo.localdomain> Subject: A From: Ken McDonell X-ASG-Orig-Subj: A To: Nathan Scott Cc: pcp@oss.sgi.com Date: Wed, 05 Dec 2012 11:20:08 +1100 In-Reply-To: <383072804.40875268.1354661099598.JavaMail.root@redhat.com> References: <383072804.40875268.1354661099598.JavaMail.root@redhat.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1354666738 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116112 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On Tue, 2012-12-04 at 17:44 -0500, Nathan Scott wrote: > > ----- Original Message ----- > > ... > > many of these are failing for me with QA pmdas not being > > stopped/started with sighup and odd lines like this for 169 ... > > > > pmcd: error starting /home/kenj/src/pcp/qa/src/dumb_pmda: Permission > > denied > > Hmm, that is odd indeed. What does ls -l say on that binary? The binary is fine, but ... $ x=`dirname /home/kenj/src/pcp/qa/src/dumb_pmda` $ while [ "$x" != / ]; do ls -ld $x; x=`dirname $x`; done drwxrwxr-x 2 kenj kenj 24576 2012-12-04 06:54 /home/kenj/src/pcp/qa/src drwxrwxr-x 9 kenj kenj 36864 2012-12-05 06:00 /home/kenj/src/pcp/qa drwxr-xr-x 12 kenj kenj 4096 2012-12-03 20:57 /home/kenj/src/pcp drwxr-xr-x 49 kenj kenj 4096 2012-08-18 17:49 /home/kenj/src drwx------ 114 kenj kenj 12288 2012-12-05 06:00 /home/kenj drwxr-xr-x 8 root root 4096 2011-10-09 18:31 /home So if the user pcp (who's running pmcd at this point I'm guessing) cannot read one of the parent directories below where QA is being run we're dead in the water. And sure enough, $ chmod 755 ~kenj was all that was needed to make 169 pass. But I'm still seeing failures for 183 184 185 187 255 274 340 348 359 370 513 603 653 707 708 709 710 Moving on to 183, it appears that my PMNS and pmcd.conf are out of whack ... presumably as a result of the "configuration" files being lost from the debian packaging recently (since fixed) ... once I fixed the PMNS I made a little more progress, but these are still failing ... 187 255 274 348 370 513 603 707 708 709 710 ... back to the salt mine ... From nscott@redhat.com Tue Dec 4 18:18:11 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB50IBa9210969 for ; Tue, 4 Dec 2012 18:18:11 -0600 X-ASG-Debug-ID: 1354666833-04cb6c05a8264a00001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id fKwwrENfx8XbHI2Z for ; Tue, 04 Dec 2012 16:20:33 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB50KO3N025276; Tue, 4 Dec 2012 19:20:24 -0500 Date: Tue, 4 Dec 2012 19:20:24 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com, "Frank Ch. Eigler" Message-ID: <932602507.40913446.1354666824782.JavaMail.root@redhat.com> In-Reply-To: <1354661142.4291.28.camel@bozo.localdomain> Subject: Re: QA Status - python tests MIME-Version: 1.0 X-ASG-Orig-Subj: Re: QA Status - python tests Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.72] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1354666833 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116112 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- > Looks like everything you can hit with a big stick _except_ the place > pcp_python is installing our modules ... (note dist-packages, not > site-packages) Does this help? diff --git a/src/include/builddefs.in b/src/include/builddefs.in index 4a9b56b..f5c4f8e 100644 --- a/src/include/builddefs.in +++ b/src/include/builddefs.in @@ -453,7 +453,7 @@ SETUP_PY_INSTALL_OPTIONS += --root=$${DIST_ROOT-/} SETUP_PY_INSTALL_OPTIONS += --record=$(TOPDIR)/python-pcp.list ifeq "$(PYTHON_PREFIX)" "/usr" ifeq "$(PACKAGE_DISTRIBUTION)" "debian" -SETUP_PY_INSTALL_OPTIONS += --prefix=$(PYTHON_PREFIX) +SETUP_PY_INSTALL_OPTIONS += --install-layout=deb endif else SETUP_PY_INSTALL_OPTIONS += --prefix=$(PYTHON_PREFIX) Will try it out here shortly, lemme know though. cheers. -- Nathan From nscott@redhat.com Tue Dec 4 18:34:29 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB50YTjp212430 for ; Tue, 4 Dec 2012 18:34:29 -0600 X-ASG-Debug-ID: 1354667811-04cbb035a4258d20001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id ADw4ixNpMTsiPOFF for ; Tue, 04 Dec 2012 16:36:52 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB50anlI026330; Tue, 4 Dec 2012 19:36:49 -0500 Date: Tue, 4 Dec 2012 19:36:49 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <1457324147.40921614.1354667809362.JavaMail.root@redhat.com> In-Reply-To: <932602507.40913446.1354666824782.JavaMail.root@redhat.com> Subject: Re: [pcp] QA Status - python tests MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] QA Status - python tests Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.72] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1354667812 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116112 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- ----- Original Message ----- > > > Looks like everything you can hit with a big stick _except_ the > > place > > pcp_python is installing our modules ... (note dist-packages, not > > site-packages) > > Does this help? > ... > Will try it out here shortly, lemme know though. > Yeah, looks better - pmcollectl now does interesting stuff. Pushing into dev now. cheers. -- Nathan From nscott@redhat.com Tue Dec 4 18:36:03 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB50a3f2212644 for ; Tue, 4 Dec 2012 18:36:03 -0600 X-ASG-Debug-ID: 1354667904-04bdf02d4a26f960001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id o3OC6RtS90F6pS42 for ; Tue, 04 Dec 2012 16:38:25 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB50cO4G026408 for ; Tue, 4 Dec 2012 19:38:24 -0500 Date: Tue, 4 Dec 2012 19:38:24 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: pcp@oss.sgi.com Message-ID: <1868493793.40921900.1354667904811.JavaMail.root@redhat.com> Subject: pcp updates: macosx & debian tweaks MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: macosx & debian tweaks Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.72] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1354667905 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116112 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://oss.sgi.com/pcp/pcp.git dev src/include/builddefs.in | 2 +- src/libpcp/src/check-statics | 15 +++++++-------- src/libpcp/src/util.c | 7 ++++--- 3 files changed, 12 insertions(+), 12 deletions(-) commit 00998db51a9186b24aa165c98c7a38244004f5a2 Author: Nathan Scott Date: Wed Dec 5 11:37:17 2012 +1100 Use magic setup.py --install-layout=deb for Debian builds commit 1585e2b9cb2f34066b8cd512310f4b2a7f19a85b Author: Nathan Scott Date: Wed Dec 5 11:00:53 2012 +1100 Resolve warnings from unguarded strerror_r use on MacOSX in new code commit ec81e628a84c9b87804153f7adeae9df43de13d1 Author: Nathan Scott Date: Wed Dec 5 10:58:46 2012 +1100 Fix up and reinstate libpcp statics checks on MacOSX From kenj@internode.on.net Tue Dec 4 18:40:30 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB50eU83212995 for ; Tue, 4 Dec 2012 18:40:30 -0600 X-ASG-Debug-ID: 1354668171-04cbb035a6258f90001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id mG8xqiu0a1D2ZPCX for ; Tue, 04 Dec 2012 16:42:52 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApMBAJeXvlB20e94/2dsb2JhbAANN4Y0uBiDEQEBAQQjVhALGAICJgICVwa1JnCTEoEijkOBEwOWA4EckjE Received: from ppp118-209-239-120.lns20.mel6.internode.on.net (HELO [192.168.1.100]) ([118.209.239.120]) by ipmail05.adl6.internode.on.net with ESMTP; 05 Dec 2012 11:12:51 +1030 Message-ID: <1354668249.4291.37.camel@bozo.localdomain> Subject: Re: QA Status - python tests From: Ken McDonell X-ASG-Orig-Subj: Re: QA Status - python tests To: Nathan Scott Cc: pcp@oss.sgi.com, "Frank Ch. Eigler" Date: Wed, 05 Dec 2012 11:44:09 +1100 In-Reply-To: <932602507.40913446.1354666824782.JavaMail.root@redhat.com> References: <932602507.40913446.1354666824782.JavaMail.root@redhat.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1354668171 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116112 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On Tue, 2012-12-04 at 19:20 -0500, Nathan Scott wrote: > > Looks like everything you can hit with a big stick _except_ the place > > pcp_python is installing our modules ... (note dist-packages, not > > site-packages) > > Does this help? > > diff --git a/src/include/builddefs.in b/src/include/builddefs.in > index 4a9b56b..f5c4f8e 100644 > --- a/src/include/builddefs.in > +++ b/src/include/builddefs.in > @@ -453,7 +453,7 @@ SETUP_PY_INSTALL_OPTIONS += --root=$${DIST_ROOT-/} > SETUP_PY_INSTALL_OPTIONS += --record=$(TOPDIR)/python-pcp.list > ifeq "$(PYTHON_PREFIX)" "/usr" > ifeq "$(PACKAGE_DISTRIBUTION)" "debian" > -SETUP_PY_INSTALL_OPTIONS += --prefix=$(PYTHON_PREFIX) > +SETUP_PY_INSTALL_OPTIONS += --install-layout=deb > endif > else > SETUP_PY_INSTALL_OPTIONS += --prefix=$(PYTHON_PREFIX) Worked a treat ... thanks. Modules land in a place python is looking and check -g pcp.py all passes now. From kenj@internode.on.net Wed Dec 5 04:31:56 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB5AVt5d009409 for ; Wed, 5 Dec 2012 04:31:56 -0600 X-ASG-Debug-ID: 1354703658-04cb6c05a5276c10001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id fNMr7anN0ux3HXU0 for ; Wed, 05 Dec 2012 02:34:18 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AvgCANAhv1B20e94/2dsb2JhbAANN4Y0tnIEBIEWgzuBCwImArZucJMagSKML4IUgRMDlgOTTQ Received: from ppp118-209-239-120.lns20.mel6.internode.on.net (HELO [192.168.1.100]) ([118.209.239.120]) by ipmail05.adl6.internode.on.net with ESMTP; 05 Dec 2012 21:04:17 +1030 Message-ID: <1354703736.4291.43.camel@bozo.localdomain> Subject: Non-root pmcd and SIGHUP issue From: Ken McDonell X-ASG-Orig-Subj: Non-root pmcd and SIGHUP issue To: pcp@oss.sgi.com Date: Wed, 05 Dec 2012 21:35:36 +1100 Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1354703658 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116141 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- I think there is a lurking problem with the non-root pmcd changes. The directory and all of the log files in /var/log/pcp/pmcd are owned by root. After pmcd downgrades to the user "pcp", then any SIGHUP attempting to Install a new PMDA will fail to create the new PMDA's log file (either cannot create a new file in /var/log/pcp/pmcd or cannot mv/rename an existing log file in /var/log/pcp/pmcd). The end result is that the log files may _not_ belong to the running PMDA (but are let over from some earlier run when pmcd was started), and new PMDA diagnostics are sprinkled through pmcd.log. Is anyone else seeing this? I have several QA failures that appear to match this signature. From wwwrun@oss.sgi.com Wed Dec 5 11:39:39 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-0.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from oss.sgi.com (localhost [127.0.0.1]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB5Hddvk037637 for ; Wed, 5 Dec 2012 11:39:39 -0600 Received: (from wwwrun@localhost) by oss.sgi.com (8.14.3/8.14.3/Submit) id qB5HddNe037636; Wed, 5 Dec 2012 11:39:39 -0600 Date: Wed, 5 Dec 2012 11:39:39 -0600 From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 935] New: libpcp should use getaddrinfo and iterate across results X-Bugzilla-Reason: CC X-Bugzilla-Type: newchanged X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: fche@redhat.com X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: brolley@redhat.com X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: Message-ID: Auto-Submitted: auto-generated Content-Type: text/plain; charset="UTF-8" MIME-Version: 1.0 http://oss.sgi.com/bugzilla/show_bug.cgi?id=935 Summary: libpcp should use getaddrinfo and iterate across results Product: pcp Version: unspecified Platform: All OS/Version: Linux Status: NEW Severity: major Priority: P5 Component: pcp AssignedTo: brolley@redhat.com ReportedBy: fche@redhat.com CC: pcp@oss.sgi.com Estimated Hours: 0.0 Classification: Unclassified With the src/libpcp/auxconnect.c, __pmAuxConnectPMCDPort, should iterate over the available addresses for the server, and try them in sequence. getaddrinfo is a good way to get a properly sorted ipv6/ipv4 address vector. -- Configure bugmail: http://oss.sgi.com/bugzilla/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug. From kenj@internode.on.net Wed Dec 5 14:18:38 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB5KIbaP050617 for ; Wed, 5 Dec 2012 14:18:38 -0600 X-ASG-Debug-ID: 1354738860-04bdf02d4a2a3e30001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id LRgILZjUq8F16UXq for ; Wed, 05 Dec 2012 12:21:01 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AvgCAGirv1B20e94/2dsb2JhbAANN4Y0tmcEBIEZgxEBAQEEI2YLGAICJgICV7cJcJMGgSKML4IUgRMDlgOTTQ Received: from ppp118-209-239-120.lns20.mel6.internode.on.net (HELO [192.168.1.100]) ([118.209.239.120]) by ipmail06.adl2.internode.on.net with ESMTP; 06 Dec 2012 06:50:59 +1030 Message-ID: <1354738939.4291.45.camel@bozo.localdomain> Subject: Re: [pcp] Non-root pmcd and SIGHUP issue From: Ken McDonell X-ASG-Orig-Subj: Re: [pcp] Non-root pmcd and SIGHUP issue To: pcp@oss.sgi.com Date: Thu, 06 Dec 2012 07:22:19 +1100 In-Reply-To: <1354703736.4291.43.camel@bozo.localdomain> References: <1354703736.4291.43.camel@bozo.localdomain> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1354738860 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116181 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On Wed, 2012-12-05 at 21:35 +1100, Ken McDonell wrote: > I think there is a lurking problem with the non-root pmcd changes. > > The directory and all of the log files in /var/log/pcp/pmcd are owned by > root. This looks like a debian packing issue ... which would explain why the RedHat folk have not seen it. Making the directory owned by "pcp" seems to solve the problem [ditto for the other PCP directories in /var/log/pcp]. From kenj@internode.on.net Wed Dec 5 14:28:32 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB5KSWIf050976 for ; Wed, 5 Dec 2012 14:28:32 -0600 X-ASG-Debug-ID: 1354739454-04cb6c05a5298430001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id Qtuax3ERNQp17BYF for ; Wed, 05 Dec 2012 12:30:55 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApMBAN2sv1B20e94/2dsb2JhbAANN4Y0uAiDOwSBAQYCJgJytnJwkwSBIosVgRqCFIETA5JQgzOBHJIx Received: from ppp118-209-239-120.lns20.mel6.internode.on.net (HELO [192.168.1.100]) ([118.209.239.120]) by ipmail06.adl2.internode.on.net with ESMTP; 06 Dec 2012 07:00:54 +1030 Message-ID: <1354739534.4291.47.camel@bozo.localdomain> Subject: pcp updates - assorted From: Ken McDonell X-ASG-Orig-Subj: pcp updates - assorted To: pcp@oss.sgi.com Date: Thu, 06 Dec 2012 07:32:14 +1100 Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1354739454 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116181 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Getting closer to QA passing ... Changes committed to git://oss.sgi.com/kenj/pcp.git dev debian/pcp.postinst | 5 qa/348.out.2 | 3 qa/370 | 3 qa/370.out.1 | 4420 ++++++++++++++++------------------- qa/370.out.2 | 4302 ++++++++++++++++------------------ qa/370.out.3 | 5805 ++++++++++++++++++++++++++++------------------- qa/370.out.4 | 4536 +++++++++++++++++------------------- qa/653 | 2 qa/common | 22 src/pmdas/kvm/Install | 2 src/pmdas/kvm/pmdakvm.pl | 10 11 files changed, 9835 insertions(+), 9275 deletions(-) commit bd08b39ba6d0400f66f2bf8da429e3c09afba149 Author: Ken McDonell Date: Thu Dec 6 07:29:02 2012 +1100 debian/postinst - fix log dir chowns This is run as a Bourne shell script, so {d1,d2,d3} syntax does not provide iteration. commit ee3e588e36881ea64d89824e4ed0d1b4dc26dcc1 Author: Ken McDonell Date: Thu Dec 6 07:01:12 2012 +1100 kvm PMDA needs to run as root The kvm PMDA cannot change to user "pcp", because the directory /sys/kernel/debug/kvm is unreadable by mere mortals. Needs force_restart in the Install script ... SIGHUP to a pmcd tha has already downgraded from "root" to "pcp" does not work. And no $pmda->set_user('pcp') call (the latter was guarded by if -r $kvm_path which is true when you're running as "root", but as soon as the user is changed to "pcp" this is no longer true and the PMDA returns no metric values). commit 6c07e167aeccf5d02b3e593a5a29e46c84b0cb8c Author: Ken McDonell Date: Thu Dec 6 06:19:42 2012 +1100 qa/370 - remove non-deterministic output 1. PMID assignment is not fixed for the output archive, so map 254.0.... to 245.0.NN 2. order of metric descriptions is not fixed and record sizes may vary (so temporal index is not fixed) ... so replace pmdumplog -a with pmdumplog -lm to report just the label record and all the metric-instance values commit ed0dc357f27f7449a19bba450525062e61babd17 Author: Ken McDonell Date: Wed Dec 5 16:23:14 2012 +1100 qa/common - check dirs are readable and searchable Since pmcd and friends no longer necessarily run as root, all the directories on the path to the current QA directory need to be readable and searchable by everyone ... unless -q given on the command line, check and warn if this is not the case. commit efd9d414209e52b15d3a3e753894d5d4f1b8a082 Author: Ken McDonell Date: Wed Dec 5 11:18:44 2012 +1100 qa/653 - fix date filter for first 9 days of the month From nscott@redhat.com Wed Dec 5 15:52:41 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,J_CHICKENPOX_33 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB5LqfGn060754 for ; Wed, 5 Dec 2012 15:52:41 -0600 X-ASG-Debug-ID: 1354744504-04bdf02d4a2a89f0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id Frpf4NCu5kpaLTMY for ; Wed, 05 Dec 2012 13:55:04 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB5Lt10K016535; Wed, 5 Dec 2012 16:55:01 -0500 Date: Wed, 5 Dec 2012 16:55:01 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <179883646.41584792.1354744501454.JavaMail.root@redhat.com> In-Reply-To: <1354738939.4291.45.camel@bozo.localdomain> Subject: Re: [pcp] Non-root pmcd and SIGHUP issue MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Non-root pmcd and SIGHUP issue Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.127] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1354744504 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116187 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- ----- Original Message ----- > On Wed, 2012-12-05 at 21:35 +1100, Ken McDonell wrote: > > I think there is a lurking problem with the non-root pmcd changes. > > > > The directory and all of the log files in /var/log/pcp/pmcd are > > owned by > > root. > > This looks like a debian packing issue ... which would explain why > the RedHat folk have not seen it. > > Making the directory owned by "pcp" seems to solve the problem [ditto > for the other PCP directories in /var/log/pcp]. > The debian/pcp.postinst script has: chown -R pcp:pcp /var/log/pcp/{pmcd,pmlogger,pmie,pmproxy} 2>/dev/null I thought that'd change over an existing install (seems to have for my laptop). There are some lintian warnings about this script containing bash-isms though (the use of curly braces on the above line, maybe that is part of the problem). lintian also requires that script to (re)gain use of -e which I incorrectly removed when adding the new pcp account, and also its complaining about the new tmpdir - we may have to go back to using /var/tmp after all, for Debian packages, it seems. cheers. -- Nathan From nscott@redhat.com Wed Dec 5 17:22:43 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB5NMg9Y067991 for ; Wed, 5 Dec 2012 17:22:43 -0600 X-ASG-Debug-ID: 1354749906-04cbb035a628e0a0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id wELdNnKFSGjxvXkA for ; Wed, 05 Dec 2012 15:25:06 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB5NP5NB023937 for ; Wed, 5 Dec 2012 18:25:05 -0500 Date: Wed, 5 Dec 2012 18:25:05 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: pcp@oss.sgi.com Message-ID: <35972611.41620976.1354749905590.JavaMail.root@redhat.com> Subject: pcp updates: deb lintian fixes MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: deb lintian fixes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.127] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1354749906 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116193 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://oss.sgi.com/pcp/pcp.git dev GNUmakefile | 2 + Makepkgs | 2 - debian/pcp-testsuite.postinst | 6 ++--- debian/pcp.postinst | 15 ++++++++----- debian/rules | 2 - qa/008 | 2 - qa/008.out.verge | 47 ++++++++++++++++++++++++++++++++++++++++++ qa/GNUmakefile | 9 ++++---- src/pmdas/bash/GNUmakefile | 2 + src/pmdas/mmv/GNUmakefile | 2 + src/pmie/GNUmakefile | 2 + src/pmlogger/GNUmakefile | 2 + 12 files changed, 77 insertions(+), 16 deletions(-) commit e748721ffbe1630868f8b9de097570fab4a86dcd Author: Nathan Scott Date: Thu Dec 6 10:07:03 2012 +1100 Some common qa scripts need to be installed executable (not sourced) commit 9bd21b53fc4c66746fc3d48ae1f09a0f6f45c849 Author: Nathan Scott Date: Thu Dec 6 10:03:38 2012 +1100 Do not package tmpfile dirs below /tmp or /var/tmp commit a506d3d837257b5de919a0702ef2121b0d6badb5 Author: Nathan Scott Date: Thu Dec 6 10:02:48 2012 +1100 Do not use full paths to commands in Debian postinst scripts commit fc461d2a46661e0983db590db2e544f56293d195 Author: Nathan Scott Date: Thu Dec 6 09:22:44 2012 +1100 Revert default tmpdir setting to well-known, traditional place The option is still there, and used on Fedora and presumably on OpenSUSE too; for the rest it seems using the original setting is for the best. Resolves another lintian complaint for Debian packages. commit 5ab6fc98b8cbe1722e9d7abf78342f6f4e75018e Author: Nathan Scott Date: Thu Dec 6 09:15:11 2012 +1100 Remove bashism and add back -e to debhelper scripts (lintian complains) commit 5594627ac881a6bb6a80d50a2ff1cc1f42119ac6 Author: Nathan Scott Date: Wed Dec 5 12:25:25 2012 +1100 Add test 008 (disk stats) output for a debian and a macosx machine From nscott@redhat.com Wed Dec 5 17:32:40 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB5NWeQJ068568 for ; Wed, 5 Dec 2012 17:32:40 -0600 X-ASG-Debug-ID: 1354750503-04cb6c05a82a0c60001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id 38piqKEjON67dzmj for ; Wed, 05 Dec 2012 15:35:03 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB5NZ0AO009100; Wed, 5 Dec 2012 18:35:00 -0500 Date: Wed, 5 Dec 2012 18:35:00 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <1228151390.41623859.1354750500299.JavaMail.root@redhat.com> In-Reply-To: <35972611.41620976.1354749905590.JavaMail.root@redhat.com> Subject: Re: pcp updates: deb lintian fixes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: pcp updates: deb lintian fixes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.127] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1354750503 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116193 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- ----- Original Message ----- > Changes committed to git://oss.sgi.com/pcp/pcp.git dev > FYI - with this last set, I'm down to just the one remaining, new lintian failure: E: python-pcp: package-installs-python-bytecode usr/lib/python2.7/dist-packages/pcp.pyc N: N: Compiled python source files must not be included in the package. These N: files should be removed from the package and created at package N: installation time in the postinst. N: N: Refer to Debian Python Policy section 2.6 (Modules Byte-Compilation) for N: details. N: N: Severity: serious, Certainty: certain N: N: Check: files, Type: binary, udeb N: E: python-pcp: package-installs-python-bytecode usr/lib/python2.7/dist-packages/pcpi.pyc [ excerpt from lintian -Ii build/deb/*.{deb,dsc} ] Would be good to crack this nut before next release, so that the deb packages can be uploaded to the Debian archives once more (I've been a bit slack lately, haven't updated em since the python module introduction, as the above suggests). cheers. -- Nathan From kenj@internode.on.net Thu Dec 6 03:08:18 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB698I54107264 for ; Thu, 6 Dec 2012 03:08:18 -0600 X-ASG-Debug-ID: 1354785040-04cbb035a72a65c0001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id RDMk3vPDSFEUPDEl for ; Thu, 06 Dec 2012 01:10:41 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AlYpAINgwFABnZyFPGdsb2JhbAANN4Y0hDqzVAMBAQEBOIJ8BHoNAiYCRbcQcJJygSKML4IUgRMDnBCNQA Received: from unknown (HELO [10.230.38.245]) ([1.157.156.133]) by ipmail05.adl6.internode.on.net with ESMTP; 06 Dec 2012 19:40:39 +1030 Message-ID: <1354785036.26658.15.camel@bozo-laptop.localdomain> Subject: Moving pcp tmp dir around From: Ken McDonell X-ASG-Orig-Subj: Moving pcp tmp dir around To: pcp@oss.sgi.com Date: Thu, 06 Dec 2012 20:10:36 +1100 Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1354785041 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116231 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- With t-o-t packages on LinuxMint (so debian -> ubuntu genealogy), I see this ... dpkg: warning: unable to delete old directory '/var/lib/pcp/tmp/mmv': Directory not empty dpkg: warning: unable to delete old directory '/var/lib/pcp/tmp': Directory not empty This is a variant of something Frank mentioned earlier in the context of the proposed relocation of the configuration files (e.g. pmcd.conf). I think we need uber preinst and postinst scripts to handle these sort of migrations. In the case above, the preinst script needs to cleanout the contents of /var/lib/pcp/tmp and /var/lib/pcp/tmp/mmv so the rmdir from the package upgrade will work. From nscott@redhat.com Thu Dec 6 03:14:27 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,J_CHICKENPOX_23 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB69EQdP107631 for ; Thu, 6 Dec 2012 03:14:27 -0600 X-ASG-Debug-ID: 1354785410-04bdf02d4b2c6110001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id PieCGs5t05C7sPTS for ; Thu, 06 Dec 2012 01:16:50 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB69GkRG027284; Thu, 6 Dec 2012 04:16:46 -0500 Date: Thu, 6 Dec 2012 04:16:46 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <1578328480.41770675.1354785406901.JavaMail.root@redhat.com> In-Reply-To: <1354785036.26658.15.camel@bozo-laptop.localdomain> Subject: Re: [pcp] Moving pcp tmp dir around MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Moving pcp tmp dir around Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.127] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1354785410 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116231 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- ----- Original Message ----- > With t-o-t packages on LinuxMint (so debian -> ubuntu genealogy), I > see > this ... > > dpkg: warning: unable to delete old directory '/var/lib/pcp/tmp/mmv': > Directory not empty > dpkg: warning: unable to delete old directory '/var/lib/pcp/tmp': > Directory not empty > I noticed this too. However, this migration to+fro for Debian tmpdir only ever happened in the dev branch ... so I figure'd you and I are the only ones ever likely to see it, and we both know what the root cause is. > I think we need uber preinst and postinst scripts to handle these sort > of migrations. So, just for this one, I think we're OK without the extra scripting. cheers. -- Nathan From kenj@internode.on.net Thu Dec 6 13:40:27 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,J_CHICKENPOX_23 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB6JeR4M147087 for ; Thu, 6 Dec 2012 13:40:27 -0600 X-ASG-Debug-ID: 1354822971-04cb6c05a52df270001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id LzZPaVhaoaFm1YGM for ; Thu, 06 Dec 2012 11:42:51 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ArccALjzwFABnZyFPGdsb2JhbAANN4Y0hDqzUQMBAQEBOIJSAQEBAwEjVgULCw0NAiYCAkMUBogdrxdwknCBIo5HgRMDnBCNQQ Received: from unknown (HELO [10.230.38.245]) ([1.157.156.133]) by ipmail07.adl2.internode.on.net with ESMTP; 07 Dec 2012 06:12:49 +1030 Message-ID: <1354822969.26658.17.camel@bozo-laptop.localdomain> Subject: Re: [pcp] Moving pcp tmp dir around From: Ken McDonell X-ASG-Orig-Subj: Re: [pcp] Moving pcp tmp dir around To: Nathan Scott Cc: pcp@oss.sgi.com Date: Fri, 07 Dec 2012 06:42:49 +1100 In-Reply-To: <1578328480.41770675.1354785406901.JavaMail.root@redhat.com> References: <1578328480.41770675.1354785406901.JavaMail.root@redhat.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1354822971 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116272 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On Thu, 2012-12-06 at 04:16 -0500, Nathan Scott wrote: > I noticed this too. However, this migration to+fro for Debian tmpdir > only ever happened in the dev branch ... so I figure'd you and I are > the only ones ever likely to see it, and we both know what the root > cause is. OK From junwang123@gmail.com Thu Dec 6 19:45:28 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: * X-Spam-Status: No, score=1.1 required=5.0 tests=BAYES_00,FREEMAIL_FROM, HTML_MESSAGE,T_DKIM_INVALID,T_TO_NO_BRKTS_FREEMAIL autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB71jSuw181271 for ; Thu, 6 Dec 2012 19:45:28 -0600 X-ASG-Debug-ID: 1354844873-04cb6c05a82ef7f0001-S8gJnT Received: from mail-qc0-f181.google.com (mail-qc0-f181.google.com [209.85.216.181]) by cuda.sgi.com with ESMTP id szrxVUiOrcPfiLgg (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Thu, 06 Dec 2012 17:47:53 -0800 (PST) X-Barracuda-Envelope-From: junwang123@gmail.com X-Barracuda-Apparent-Source-IP: 209.85.216.181 X-Barracuda-IPDD: Level1 [gmail.com/209.85.216.181] Received: by mail-qc0-f181.google.com with SMTP id x40so4150407qcp.26 for ; Thu, 06 Dec 2012 17:47:52 -0800 (PST) X-Barracuda-IPDD: Level1 [gmail.com/209.85.216.181] X-Barracuda-IPDD: Level1 [gmail.com/209.85.216.181] DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=+rKutxCt6+iPnK/0S6RaRKooQMvHOQ8vHZZ+LtH7fZc=; b=e89MHfiREY5wQy2+TvkD/btwSbp6kChxasAIRBZWzAaWvw9Xwa9FmZS3mkcCaoT5KZ t0FikWsA98wun0VugPq1fQ0juo870IflgyzuJTIN3fHl3dNbrUZjBp772FMgyVSrSLni 2bP/kOwhEcyHNe7IJ2XeZ3ToyFNOz7bz0FVLvzWf3kK6fE4Xw2FycgGoy/pWNcj/CquZ DGf/8zC6plZzCjqwnucExuQkDV7iKZZigMQJVrK6zbcjLTlDaBS0lBNVcVshaXtEz7me PeO29IBjuh7BwEHpc5Q8KxXXcV2E1YoX98uEhcEPshKsPAKSNY2MJrM1lg6fKnU0kLyI rC0w== MIME-Version: 1.0 Received: by 10.224.210.202 with SMTP id gl10mr6503400qab.72.1354844872834; Thu, 06 Dec 2012 17:47:52 -0800 (PST) Received: by 10.49.48.72 with HTTP; Thu, 6 Dec 2012 17:47:52 -0800 (PST) Date: Thu, 6 Dec 2012 17:47:52 -0800 Message-ID: Subject: Qn on supporting metrics from multiple hosts in pmstat, pmchart and pmie tools From: Jun Wang X-ASG-Orig-Subj: Qn on supporting metrics from multiple hosts in pmstat, pmchart and pmie tools To: pcp@oss.sgi.com Content-Type: multipart/alternative; boundary=20cf300512b25eff0704d039674e X-Barracuda-Connect: mail-qc0-f181.google.com[209.85.216.181] X-Barracuda-Start-Time: 1354844873 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED, HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116298 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 HTML_MESSAGE BODY: HTML included in message --20cf300512b25eff0704d039674e Content-Type: text/plain; charset=UTF-8 Hi PCP Folks, Being a newbie on PCP, I have questions on monitoring metrics from multiple collector hosts. On the monitoring side, with tools like pmchart, pmie and pmstat, what's the strategy to monitor metrics from multiple collector nodes? To my understanding, each pmcd, together with the corresponding pmdas, runs and manages one collector node. I'm reading PCP on Linux user's guide on http://www.damtp.cam.ac.uk/cosmos/private/documentation/SGI/propack/PCP_LinuxUAG/pdf/PCP_LinuxUAG.pdf . pmstat has an option -H which allows users to specify multiple hosts. I verifies that it does print out stats from multiple hosts, one after the other when hosts are specified with -H. pmie has an -h option which allow users to specify only one host to monitor. However, it appears that hosts can also be specified in the pmie specification language to create per-host and cross-host rules. Does this implicitly trigger the communication between pmie and the pmcd(s) on the corresponding hosts that are specified in the pmie spec language? On the other hand, there appears to be discussions on starting one pmie, on the monitor side, for each collector host. What's the recommended approach? pmchart also has an -h option allowing users to specify only one host to monitor. However, there are discussions on hosts in the pmchart man page and it is claimed that pmchart can display metrics from multiple hosts. How do I specify those hosts? Is it available on the menu of the GUI? What's the relation between those hosts and the ONLY host specified with -h option? http://techpubs.sgi.com/library/tpl/cgi-bin/getdoc.cgi?coll=linux&db=man&fname=/usr/share/catman/man1/pmchart.1.html Also, if I define a new metrics domain on a collector, a new PMDA and new configuration line(s) in pmcd to enable it, how do I make it available to be selected from pmchart menu? What about multiple metrics domains on multiple collector hosts? Can they be displayed with one pmchart application but multiple views on the monitor side? Thanks in advance, Jun --20cf300512b25eff0704d039674e Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi PCP Folks,

Being a newbie on PCP, I have questions on monitoring = metrics from multiple collector hosts. On the monitoring side, with tools l= ike pmchart, pmie and pmstat, what's the strategy to monitor metrics fr= om multiple collector nodes? To my understanding, each pmcd, together with= the corresponding pmdas, runs and manages one collector node.

I'm reading PCP on Linux user's guide on http://www.damtp.cam.ac.uk/cosmos/private/documentation/SG= I/propack/PCP_LinuxUAG/pdf/PCP_LinuxUAG.pdf.

pmstat has an option -H which allows users to specify multiple hosts. I= verifies that it does print out stats from multiple hosts, one after the o= ther when hosts are specified with -H.

pmie has an -h option which a= llow users to specify only one host to monitor. However, it appears that ho= sts can also be specified in the pmie specification language to create per-= host and cross-host rules. Does this implicitly trigger the communication b= etween pmie and the pmcd(s) on the corresponding hosts that are specified i= n the pmie spec language? On the other hand, there appears to be discussion= s on starting one pmie, on the monitor side, for each collector host. What&= #39;s the recommended approach?

pmchart also has an -h option allowing users to specify only one host t= o monitor. However, there are discussions on hosts in the pmchart man page = and it is claimed that pmchart can display metrics from multiple hosts. How= do I specify those hosts? Is it available on the menu of the GUI? What'= ;s the relation between those hosts and the ONLY host specified with -h opt= ion?
http://= techpubs.sgi.com/library/tpl/cgi-bin/getdoc.cgi?coll=3Dlinux&db=3Dman&a= mp;fname=3D/usr/share/catman/man1/pmchart.1.html

Also, if I define a new metrics domain on a collector, a new PMDA and n= ew configuration line(s) in pmcd to enable it, how do I make it available t= o be selected from pmchart menu? What about multiple metrics domains on mul= tiple collector hosts? Can they be displayed with one pmchart application b= ut multiple views on the monitor side?

Thanks in advance,
Jun
--20cf300512b25eff0704d039674e-- From nscott@redhat.com Thu Dec 6 20:24:43 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB72Oh6I184113 for ; Thu, 6 Dec 2012 20:24:43 -0600 X-ASG-Debug-ID: 1354847227-04cbb035a62de100001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id Ds4hpttoALV7Wb7V for ; Thu, 06 Dec 2012 18:27:07 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB72R6eu001587; Thu, 6 Dec 2012 21:27:06 -0500 Date: Thu, 6 Dec 2012 21:27:06 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Jun Wang Cc: pcp@oss.sgi.com Message-ID: <903577094.42361781.1354847226756.JavaMail.root@redhat.com> In-Reply-To: Subject: Re: [pcp] Qn on supporting metrics from multiple hosts in pmstat, pmchart and pmie tools MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Qn on supporting metrics from multiple hosts in pmstat, pmchart and pmie tools Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.131] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1354847227 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116300 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi Jun, ----- Original Message ----- > > Hi PCP Folks, > > Being a newbie on PCP, I have questions on monitoring metrics from > multiple collector hosts. On the monitoring side, with tools like > pmchart, pmie and pmstat, what's the strategy to monitor metrics > from multiple collector nodes? To my understanding, each pmcd, > together with the corresponding pmdas, runs and manages one > collector node. That's correct. > I'm reading PCP on Linux user's guide on > http://www.damtp.cam.ac.uk/cosmos/private/documentation/SGI/propack/PCP_LinuxUAG/pdf/PCP_LinuxUAG.pdf > . > > pmstat has an option -H which allows users to specify multiple hosts. > I verifies that it does print out stats from multiple hosts, one > after the other when hosts are specified with -H. *nod*. You can also use multiple -h options on the command line to pmstat, which results in an extra initial column showing the node: $ pmstat -h smash -h verge -t 1 @ Fri Dec 7 13:13:04 2012 node loadavg memory swap io system cpu 1 min swpd buff cache pi po bi bo in cs us sy id smash 1.45 0 4015m 8746m 0 0 0 0 493 1246 0 1 99 verge 0.30 0 404512 2213m 0 0 0 0 291 358 1 1 98 smash 1.45 0 4025m 8746m 0 0 0 0 575 1471 1 0 99 verge 0.30 0 404648 2213m 0 0 0 0 264 296 2 1 97 > pmie has an -h option which allow users to specify only one host to > monitor. Strictly speaking, that specifies the default host. Others can be specified directly, in the pmie language, for individual rules or parts of rules. For rules with no host explicitly specified, the default is used. If no default is specified, localhost will be used. > However, it appears that hosts can also be specified in the > pmie specification language to create per-host and cross-host rules. That's right. > Does this implicitly trigger the communication between pmie and the > pmcd(s) on the corresponding hosts that are specified in the pmie > spec language? Yes. > On the other hand, there appears to be discussions on > starting one pmie, on the monitor side, for each collector host. > What's the recommended approach? Whatever works best for you. I've seen production deployments where either, and both strategies have been used. > pmchart also has an -h option allowing users to specify only one host Like with pmie before, that's for the default host(s). And like with pmstat, you can give multiple -h options. > to monitor. However, there are discussions on hosts in the pmchart > man page and it is claimed that pmchart can display metrics from > multiple hosts. How do I specify those hosts? Is it available on the > menu of the GUI? What's the relation between those hosts and the > ONLY host specified with -h option? Using this as a guide: http://oss.sgi.com/projects/pcp/pcp-gui.git/man/html/lab.pmchart.html (from the PCP Manual link on the bottm left of the PCP project page) On the third screenshot (Open View) there's a "Host:" drop down, and a new host button between Open and Cancel. The drop down menu will contain all hosts seen so far (so, all -h options, and any hostnames entered via the UI). The new host button pops up another window that will allow you to enter additional host names. FWIW, when running in "archive mode" (historical data), the UI is all the same, except instead of "Hosts:" the user can enter additional PCP archives from which historical data is sourced. The archives have a one-to-one mapping with hosts (i.e. an archive records data from one host and one host only). If you scroll further down the above URL to the sixth screenshot, you will see another Host button on the New Chart window - that has the same effect as the new host button on the Open View window earlier. > Also, if I define a new metrics domain on a collector, a new PMDA and > new configuration line(s) in pmcd to enable it, how do I make it > available to be selected from pmchart menu? What about multiple As soon as the PMDA is installed (via its Install script, usually), its metrics become immediately available in the client tools like pmchart, with no other intervention required (client tools do auto- discovery via the metric names and their associated metadata). > metrics domains on multiple collector hosts? Can they be displayed > with one pmchart application but multiple views on the monitor side? Yes. It's even possible in pmchart to have a single chart that has individual plots from different hosts. Good questions! :) The PCP man pages are extensive too - so on any host that you've installed pcp and pcp-gui on, you will also be able to browse through: $ man pmstat $ man pmie $ man pmchart $ man pmcd Several of the command line option (e.g. time window specification, for archives) are also documented on the PCPIntro man page, might be of use too. Enjoy! cheers. -- Nathan From wwwrun@oss.sgi.com Fri Dec 7 04:22:36 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-0.8 required=5.0 tests=ALL_TRUSTED,BAYES_00, J_CHICKENPOX_74 autolearn=no version=3.4.0-r929098 Received: from oss.sgi.com (localhost [127.0.0.1]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB7AMZwT209581 for ; Fri, 7 Dec 2012 04:22:35 -0600 Received: (from wwwrun@localhost) by oss.sgi.com (8.14.3/8.14.3/Submit) id qB7AMZrh209580; Fri, 7 Dec 2012 04:22:35 -0600 Date: Fri, 7 Dec 2012 04:22:35 -0600 From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 936] New: pmie falling operator does not insert instance (%i) and value (%v) X-Bugzilla-Reason: CC X-Bugzilla-Type: newchanged X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: azzurrow@gmail.com X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: mort@sgi.com X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: Message-ID: Auto-Submitted: auto-generated Content-Type: text/plain; charset="UTF-8" MIME-Version: 1.0 http://oss.sgi.com/bugzilla/show_bug.cgi?id=936 Summary: pmie falling operator does not insert instance (%i) and value (%v) Product: pcp Version: unspecified Platform: All OS/Version: Linux Status: NEW Severity: major Priority: P5 Component: pcp AssignedTo: mort@sgi.com ReportedBy: azzurrow@gmail.com CC: pcp@oss.sgi.com Estimated Hours: 0.0 Classification: Unclassified The pmie rising and falling operators allow to implement threshold monitoring using upper and lower limits. There seems to be a bug in the falling operator that inhibits the insertion of instance and value. In particular the former is required for any alarms handling. All tests were done with PCP V3.6.10. The O/S is RedHat EL 5.6 x6_64. [root@lggwsl32 ~]# pmie -t 10 -v falling some_inst match_inst "^(/dev/root|/dev/cciss)" ( filesys.full > 40 ) -> print "normal file system util" " [%i] %v "; expr_1: ? expr_1: false expr_1: false Fri Dec 7 11:16:49 2012: normal file system util expr_1: true [root@lggwsl32 ~]# pmie -t 10 -v falling some_inst match_inst "^(/dev/root|/dev/cciss)" ( filesys.full > 40 ) -> print "normal file system util [%i] %v "; expr_1: ? expr_1: false expr_1: false Fri Dec 7 11:17:48 2012: (null) expr_1: true The rising operators works [root@lggwsl32 SW]# pmie -t 10 -v rising some_inst match_inst "^(/dev/root|/dev/cciss)" ( filesys.full > 50 ) -> print "high file system util" " [%i] %v "; falling some_inst match_inst "^(/dev/root|/dev/cciss)" ( filesys.full > 40 ) -> print "normal file system util" " [%i] %v "; ^D expr_1: ? expr_2: ? expr_1: false expr_2: false Fri Dec 7 09:34:07 2012: high file system util [/dev/cciss/c0d0p1] 53 expr_1: true expr_2: false expr_1: false expr_2: false Fri Dec 7 09:34:27 2012: normal file system util expr_1: false expr_2: true -- Configure bugmail: http://oss.sgi.com/bugzilla/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug. From chandana@desilva.id.au Sat Dec 8 01:14:20 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.5 required=5.0 tests=BAYES_00,J_CHICKENPOX_44, J_CHICKENPOX_47,J_CHICKENPOX_73,J_CHICKENPOX_75 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB87EJ1L017304 for ; Sat, 8 Dec 2012 01:14:19 -0600 X-ASG-Debug-ID: 1354951003-04bdf02d4a3576b0001-S8gJnT Received: from mho-02-ewr.mailhop.org (mho-04-ewr.mailhop.org [204.13.248.74]) by cuda.sgi.com with ESMTP id B7rgl2DLmrnwM5Mi (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 07 Dec 2012 23:16:44 -0800 (PST) X-Barracuda-Envelope-From: chandana@desilva.id.au X-Barracuda-Apparent-Source-IP: 204.13.248.74 Received: from d210-49-168-202.sun801.vic.optusnet.com.au ([210.49.168.202] helo=mail.desilva.id.au) by mho-02-ewr.mailhop.org with esmtpa (Exim 4.72) (envelope-from ) id 1ThEeR-000OS5-58 for pcp@oss.sgi.com; Sat, 08 Dec 2012 07:16:43 +0000 Received: from [192.168.1.57] (unknown [192.168.1.57]) by mail.desilva.id.au (Postfix) with ESMTPSA id CACFE70EB for ; Sat, 8 Dec 2012 18:13:31 +1100 (EST) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 210.49.168.202 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX19fQSLxvddFq+ubikYwYJVdlxAnJkNdILM= Message-ID: <50C2E957.9010704@desilva.id.au> Date: Sat, 08 Dec 2012 18:16:39 +1100 From: Chandana De Silva Reply-To: chandana@desilva.id.au User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:16.0) Gecko/20121011 Thunderbird/16.0.1 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Error installing MySQL PMDA on PCP 3.6.10 Content-Type: text/plain; charset=ISO-8859-1; format=flowed X-ASG-Orig-Subj: Error installing MySQL PMDA on PCP 3.6.10 Content-Transfer-Encoding: 7bit X-Barracuda-Connect: mho-04-ewr.mailhop.org[204.13.248.74] X-Barracuda-Start-Time: 1354951004 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116414 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- All, I tried to install the MySQL PMDA on PCP 3.6.10 on a CentOS 63 host, which did not work. [chandana@c63 mysql]$ ls Install mysql.conf pmdamysql.pl Remove [chandana@c63 mysql]$ sudo ./Install mktemp: failed to create directory via template `/var/lib/pcp/tmp/pmdaproc.XXXXXXXXX': No such file or directory [chandana@c63 mysql]$ sudo mkdir /var/lib/pcp/tmp/ [chandana@c63 mysql]$ sudo ./Install You will need to choose an appropriate configuration for installation of the "mysql" Performance Metrics Domain Agent (PMDA). collector collect performance statistics on this system monitor allow this system to monitor local and/or remote systems both collector and monitor configuration for this system Please enter c(ollector) or m(onitor) or b(oth) [b] Updating the Performance Metrics Name Space (PMNS) ... pmnsadd: cannot find PMNS file "" Install: failed to add the PMNS entries for "mysql" ... total 60 -rw-r--r--. 1 root root 1093 Nov 19 16:26 Makefile -rwxr-xr-x. 1 root root 4279 Nov 19 16:26 Make.stdpmid -rw-r--r--. 1 root root 13 Dec 8 18:10 mysql -rwxr-xr-x. 1 root root 8079 Nov 19 16:26 Rebuild -rw-r--r--. 1 root root 20228 Nov 19 16:26 root_linux ----------. 1 root root 0 Dec 8 18:10 root.lock -rw-r--r--. 1 root root 103 Nov 19 16:26 root_mmv -rw-r--r--. 1 root root 2222 Nov 19 16:26 root_pmcd -rw-r--r--. 1 root root 76 Nov 19 16:26 stdpmid.local -rw-r--r--. 1 root root 1345 Nov 19 16:26 stdpmid.pcp Chandana This is how I installed PCP sudo yum localinstall pcp-3.6.10-1.el6.x86_64.rpm pcp-libs-3.6.10-1.el6.x86_64.rpm pcp-libs-devel-3.6.10-1.el6.x86_64.rpm perl-PCP-MMV-3.6.10-1.el6.x86_64.rpm perl-PCP-PMDA-3.6.10-1.el6.x86_64.rpm python-pcp-3.6.10-1.el6.x86_64.rpm Loaded plugins: fastestmirror, security Setting up Local Package Process Examining pcp-3.6.10-1.el6.x86_64.rpm: pcp-3.6.10-1.el6.x86_64 Marking pcp-3.6.10-1.el6.x86_64.rpm to be installed base | 3.7 kB 00:00 base/primary_db | 4.5 MB 00:09 extras | 3.5 kB 00:00 extras/primary_db | 23 kB 00:00 updates | 3.5 kB 00:00 updates/primary_db | 4.1 MB 00:07 Examining pcp-libs-3.6.10-1.el6.x86_64.rpm: pcp-libs-3.6.10-1.el6.x86_64 Marking pcp-libs-3.6.10-1.el6.x86_64.rpm to be installed Examining pcp-libs-devel-3.6.10-1.el6.x86_64.rpm: pcp-libs-devel-3.6.10-1.el6.x86_64 Marking pcp-libs-devel-3.6.10-1.el6.x86_64.rpm to be installed Examining perl-PCP-MMV-3.6.10-1.el6.x86_64.rpm: perl-PCP-MMV-3.6.10-1.el6.x86_64 Marking perl-PCP-MMV-3.6.10-1.el6.x86_64.rpm to be installed Examining perl-PCP-PMDA-3.6.10-1.el6.x86_64.rpm: perl-PCP-PMDA-3.6.10-1.el6.x86_64 Marking perl-PCP-PMDA-3.6.10-1.el6.x86_64.rpm to be installed Examining python-pcp-3.6.10-1.el6.x86_64.rpm: python-pcp-3.6.10-1.el6.x86_64 Marking python-pcp-3.6.10-1.el6.x86_64.rpm to be installed Resolving Dependencies --> Running transaction check ---> Package pcp.x86_64 0:3.6.10-1.el6 will be installed ---> Package pcp-libs.x86_64 0:3.6.10-1.el6 will be installed ---> Package pcp-libs-devel.x86_64 0:3.6.10-1.el6 will be installed ---> Package perl-PCP-MMV.x86_64 0:3.6.10-1.el6 will be installed ---> Package perl-PCP-PMDA.x86_64 0:3.6.10-1.el6 will be installed ---> Package python-pcp.x86_64 0:3.6.10-1.el6 will be installed --> Finished Dependency Resolution Dependencies Resolved ====================================================================================================================================================== Package Arch Version Repository Size ====================================================================================================================================================== Installing: pcp x86_64 3.6.10-1.el6 /pcp-3.6.10-1.el6.x86_64 3.5 M pcp-libs x86_64 3.6.10-1.el6 /pcp-libs-3.6.10-1.el6.x86_64 493 k pcp-libs-devel x86_64 3.6.10-1.el6 /pcp-libs-devel-3.6.10-1.el6.x86_64 667 k perl-PCP-MMV x86_64 3.6.10-1.el6 /perl-PCP-MMV-3.6.10-1.el6.x86_64 44 k perl-PCP-PMDA x86_64 3.6.10-1.el6 /perl-PCP-PMDA-3.6.10-1.el6.x86_64 111 k python-pcp x86_64 3.6.10-1.el6 /python-pcp-3.6.10-1.el6.x86_64 149 k Transaction Summary ====================================================================================================================================================== Install 6 Package(s) Total size: 4.9 M Installed size: 4.9 M Is this ok [y/N]: y Downloading Packages: Running rpm_check_debug Running Transaction Test Transaction Test Succeeded Running Transaction Installing : pcp-libs-3.6.10-1.el6.x86_64 1/6 Installing : perl-PCP-PMDA-3.6.10-1.el6.x86_64 2/6 Installing : python-pcp-3.6.10-1.el6.x86_64 3/6 Installing : pcp-3.6.10-1.el6.x86_64 4/6 Installing : perl-PCP-MMV-3.6.10-1.el6.x86_64 5/6 Installing : pcp-libs-devel-3.6.10-1.el6.x86_64 6/6 Verifying : perl-PCP-MMV-3.6.10-1.el6.x86_64 1/6 Verifying : pcp-3.6.10-1.el6.x86_64 2/6 Verifying : pcp-libs-devel-3.6.10-1.el6.x86_64 3/6 Verifying : perl-PCP-PMDA-3.6.10-1.el6.x86_64 4/6 Verifying : pcp-libs-3.6.10-1.el6.x86_64 5/6 Verifying : python-pcp-3.6.10-1.el6.x86_64 6/6 Installed: pcp.x86_64 0:3.6.10-1.el6 pcp-libs.x86_64 0:3.6.10-1.el6 pcp-libs-devel.x86_64 0:3.6.10-1.el6 perl-PCP-MMV.x86_64 0:3.6.10-1.el6 perl-PCP-PMDA.x86_64 0:3.6.10-1.el6 python-pcp.x86_64 0:3.6.10-1.el6 From kenj@internode.on.net Sat Dec 8 14:39:06 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB8Kd6a1054519 for ; Sat, 8 Dec 2012 14:39:06 -0600 X-ASG-Debug-ID: 1354999291-04bdf02d4936dfc0001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id bi15GJv8Ah0wGJx8 for ; Sat, 08 Dec 2012 12:41:32 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AtofAFqlw1ABihHiPGdsb2JhbAANN4Y3hDq0BwMBAQEBOIJ8BHoHBgImAkUttGRwkX6BIosdgRqCFoETA5wTjUI Received: from unknown (HELO [10.192.128.124]) ([1.138.17.226]) by ipmail07.adl2.internode.on.net with ESMTP; 09 Dec 2012 07:11:30 +1030 Message-ID: <1354999287.32387.5.camel@bozo-laptop.localdomain> Subject: pcp updates - change primary pmlogger control file from symlink to link From: Ken McDonell X-ASG-Orig-Subj: pcp updates - change primary pmlogger control file from symlink to link To: pcp@oss.sgi.com Date: Sun, 09 Dec 2012 07:41:27 +1100 Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1354999291 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116468 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://oss.sgi.com/kenj/pcp.git dev qa/280 | 6 qa/348.out.2 | 3 qa/430 | 18 qa/430.3.out | 252 + qa/512 | 6 qa/645 | 2 qa/common.check | 38 src/libpcp_fault/src/GNUmakefile | 9 src/pmcd/rc_pmcd | 4 src/pmlogctl/pmlogger_check.sh | 53 src/pmlogctl/pmlogger_daily.sh | 55 src/pmlogger/ports.c | 6 ... commit 5efd079193a44a19bbdc59ff4da379b9d8850ce1 Author: Ken McDonell Date: Sun Dec 9 07:30:33 2012 +1100 Change primary pmlogger control from symlink to link $PCP_TMP_DIR/pmlogger/primary used to be a symbolic link. This commit makes all the changes necessary to change this to be a (hard) link to the control file for the primary pmlogger. The change is motivated by the combination of moving to non-root execution of many PCP daemons (and pmlogger in particular), and Ubuntu's security-driven changes that have modified (broken?) the semantics of how symbolic links behave when created within a "sticky" directory like $PCP_TMP_DIR/pmlogger commit a87ddb4df4258da5796a20fb8d6019f229183db4 Author: Ken McDonell Date: Sun Dec 9 06:09:16 2012 +1100 qa/512 - correct path to source after pcpqa -> pcp merge commit f50565e7a5f7058d04f72112ab55ca327e5b7879 Author: Ken McDonell Date: Fri Dec 7 06:38:08 2012 +1100 libpcp_fault - add nss/nspr glue to makefile From nscott@redhat.com Sat Dec 8 17:05:21 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB8N5Kgq062469 for ; Sat, 8 Dec 2012 17:05:21 -0600 X-ASG-Debug-ID: 1355008066-04cb6c05a53659d0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id jiPoLC0oVgBJ69XA for ; Sat, 08 Dec 2012 15:07:47 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qB8N7jPO026589; Sat, 8 Dec 2012 18:07:45 -0500 Date: Sat, 8 Dec 2012 18:07:45 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: chandana@desilva.id.au Cc: pcp@oss.sgi.com Message-ID: <905228797.44906431.1355008065064.JavaMail.root@redhat.com> In-Reply-To: <50C2E957.9010704@desilva.id.au> Subject: Re: [pcp] Error installing MySQL PMDA on PCP 3.6.10 MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Error installing MySQL PMDA on PCP 3.6.10 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.134] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1355008067 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116478 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header ----- Original Message ----- > All, > > I tried to install the MySQL PMDA on PCP 3.6.10 on a CentOS 63 host, > which did not work. > > [chandana@c63 mysql]$ ls > Install mysql.conf pmdamysql.pl Remove > [chandana@c63 mysql]$ sudo ./Install > mktemp: failed to create directory via template > `/var/lib/pcp/tmp/pmdaproc.XXXXXXXXX': No such file or directory > This was a spec file botch at my end, there's a 3.6.10-2 RPM which was pushed into Fedora and EPEL, but which I now realise has not been put on oss.sgi.com yet - will get to that shortly. The dev branch RPM build will work too until then (Makepkgs). > [chandana@c63 mysql]$ sudo mkdir /var/lib/pcp/tmp/ (this needs to be mkdir -p 1777 ...) $ rpm -ql pcp | grep tmp /var/lib/pcp/tmp /var/lib/pcp/tmp/mmv /var/lib/pcp/tmp/pmdabash /var/lib/pcp/tmp/pmie /var/lib/pcp/tmp/pmlogger (these were missing in the -1 spec file) cheers. -- Nathan From wwwrun@oss.sgi.com Sat Dec 8 17:20:25 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-0.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from oss.sgi.com (localhost [127.0.0.1]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB8NKPXC063063 for ; Sat, 8 Dec 2012 17:20:25 -0600 Received: (from wwwrun@localhost) by oss.sgi.com (8.14.3/8.14.3/Submit) id qB8NKPqY063062; Sat, 8 Dec 2012 17:20:25 -0600 Date: Sat, 8 Dec 2012 17:20:25 -0600 Message-Id: <201212082320.qB8NKPqY063062@oss.sgi.com> From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 936] pmie falling operator does not insert instance (%i) and value (%v) X-Bugzilla-Reason: CC X-Bugzilla-Type: newchanged X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: nathans@debian.org X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: mort@sgi.com X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: CC In-Reply-To: References: Auto-Submitted: auto-generated Content-Type: text/plain; charset="UTF-8" MIME-Version: 1.0 http://oss.sgi.com/bugzilla/show_bug.cgi?id=936 Nathan Scott changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |nathans@debian.org --- Comment #1 from Nathan Scott 2012-12-08 17:20:23 CST --- I'll take a look during the week, unless someone else does first. However, you might find use of the rising/falling keywords to be superflous (and perhaps overly simplistic - I've personally never used them). The pmie(1) man page gives an example showing explicit use of multiple samples (rather than the implicit use that rising/falling gives) - i.e. $hour >= 9 && $hour <= 17 && some_inst ( 75 %_sample ( disk.dev.total @0..3 > 60 count/sec ) ) -> print "disk %i busy "; For reference, @0 is the most recent sample, @1 the sample prior, and so on (so the above rule evaluates four samples worth of the disk.dev.total values). It may be that rising/falling ends up with the value for that part of the rule becoming boolean, in which case you'll want something like the above anyway. cheers. -- Configure bugmail: http://oss.sgi.com/bugzilla/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug. From chandana@desilva.id.au Sat Dec 8 18:08:26 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB908QWr065087 for ; Sat, 8 Dec 2012 18:08:26 -0600 X-ASG-Debug-ID: 1355011852-04cb6c05a7367cd0001-S8gJnT Received: from mho-01-ewr.mailhop.org (mho-03-ewr.mailhop.org [204.13.248.66]) by cuda.sgi.com with ESMTP id svMGMmSAvVorbsjL (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sat, 08 Dec 2012 16:10:52 -0800 (PST) X-Barracuda-Envelope-From: chandana@desilva.id.au X-Barracuda-Apparent-Source-IP: 204.13.248.66 Received: from d210-49-168-202.sun801.vic.optusnet.com.au ([210.49.168.202] helo=mail.desilva.id.au) by mho-01-ewr.mailhop.org with esmtpa (Exim 4.72) (envelope-from ) id 1ThUTs-0002HI-5x; Sun, 09 Dec 2012 00:10:52 +0000 Received: from [192.168.1.57] (unknown [192.168.1.57]) by mail.desilva.id.au (Postfix) with ESMTPSA id 63E546FF3; Sun, 9 Dec 2012 11:07:41 +1100 (EST) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 210.49.168.202 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX18GEUzvrqR5vK/tMFd+rdUjjwHQtiRulZw= Message-ID: <50C3D708.9050307@desilva.id.au> Date: Sun, 09 Dec 2012 11:10:48 +1100 From: Chandana De Silva Reply-To: chandana@desilva.id.au User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:16.0) Gecko/20121011 Thunderbird/16.0.1 MIME-Version: 1.0 To: Nathan Scott CC: pcp@oss.sgi.com Subject: Re: [pcp] Error installing MySQL PMDA on PCP 3.6.10 References: <905228797.44906431.1355008065064.JavaMail.root@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Error installing MySQL PMDA on PCP 3.6.10 In-Reply-To: <905228797.44906431.1355008065064.JavaMail.root@redhat.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: mho-03-ewr.mailhop.org[204.13.248.66] X-Barracuda-Start-Time: 1355011852 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116482 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Nathan, Thanks, I used the src tarball, ran Makepkgs and installed those RPM's. Worked fine. The 3.6.9-1 RPM's also have the same problem. Just one niggle.. on the 3.6.10 set: sudo /etc/init.d/pcp restart Waiting for pmcd to terminate ... Starting pmcd ... Starting pmlogger ... /etc/rc.d/init.d/pmlogger: line 100: /var/tmp/pcp.t9ulDJC5J/pmcheck: No such file or directory On 09/12/12 10:07, Nathan Scott wrote: > The dev branch RPM build will work too until then (Makepkgs). From wwwrun@oss.sgi.com Sun Dec 9 03:30:25 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-0.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from oss.sgi.com (localhost [127.0.0.1]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB99UPEg087771 for ; Sun, 9 Dec 2012 03:30:25 -0600 Received: (from wwwrun@localhost) by oss.sgi.com (8.14.3/8.14.3/Submit) id qB99UPVj087770; Sun, 9 Dec 2012 03:30:25 -0600 Date: Sun, 9 Dec 2012 03:30:25 -0600 Message-Id: <201212090930.qB99UPVj087770@oss.sgi.com> From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 936] pmie falling operator does not insert instance (%i) and value (%v) X-Bugzilla-Reason: CC X-Bugzilla-Type: newchanged X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: kenj@internode.on.net X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: mort@sgi.com X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: CC In-Reply-To: References: Auto-Submitted: auto-generated Content-Type: text/plain; charset="UTF-8" MIME-Version: 1.0 http://oss.sgi.com/bugzilla/show_bug.cgi?id=936 Ken McDonell changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |kenj@internode.on.net --- Comment #2 from Ken McDonell 2012-12-09 03:30:23 CST --- First I think this is already fixed for rising, but not for falling (don't ask!) in my top of tree pmie (I fixed a couple of %i %v binding botches a couple of weeks ago). Second, a new QA test (515 ... coming soon), show something very similar to the problem show here works as expected for the rising case and shows the failure for the falling case. Thirdly, the predicate proposed is OK ... the semantics of rising and falling follow the analogue of a logic analyzer where the trigger (or alarm) is in the rising (or falling) edge of the predicate going from false to true (or true to false) -- Configure bugmail: http://oss.sgi.com/bugzilla/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug. From wwwrun@oss.sgi.com Sun Dec 9 15:58:45 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-0.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from oss.sgi.com (localhost [127.0.0.1]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qB9Lwjl2141961 for ; Sun, 9 Dec 2012 15:58:45 -0600 Received: (from wwwrun@localhost) by oss.sgi.com (8.14.3/8.14.3/Submit) id qB9LwjZH141960; Sun, 9 Dec 2012 15:58:45 -0600 Date: Sun, 9 Dec 2012 15:58:45 -0600 Message-Id: <201212092158.qB9LwjZH141960@oss.sgi.com> From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 936] pmie falling operator does not insert instance (%i) and value (%v) X-Bugzilla-Reason: CC X-Bugzilla-Type: newchanged X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: nathans@debian.org X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: mort@sgi.com X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: In-Reply-To: References: Auto-Submitted: auto-generated Content-Type: text/plain; charset="UTF-8" MIME-Version: 1.0 http://oss.sgi.com/bugzilla/show_bug.cgi?id=936 --- Comment #3 from Nathan Scott 2012-12-09 15:58:44 CST --- Awesome, thanks Ken. -- Configure bugmail: http://oss.sgi.com/bugzilla/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug. From nscott@redhat.com Mon Dec 10 15:45:47 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBALjljP006556 for ; Mon, 10 Dec 2012 15:45:47 -0600 X-ASG-Debug-ID: 1355176093-04cbb035a63caf50001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id 6mSdcmtfRC4xFrHu for ; Mon, 10 Dec 2012 13:48:14 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBALmD7t026124 for ; Mon, 10 Dec 2012 16:48:13 -0500 Date: Mon, 10 Dec 2012 16:48:13 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: pcp@oss.sgi.com Message-ID: <2006224076.46864749.1355176093795.JavaMail.root@redhat.com> In-Reply-To: <1185312965.46864589.1355176008248.JavaMail.root@redhat.com> Subject: pmdasummary -c option? MIME-Version: 1.0 X-ASG-Orig-Subj: pmdasummary -c option? Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.134] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1355176093 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116645 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi all, Does anyone know what the -c option to pmdasummary was used for? The man page is a bit cryptic... -c When used to summarize metrics from multiple hosts, pmdasummary reads host information from configfile. This is a binary file produced by $PCP_PMDAS_DIR/ array/mkconfig, and so this option may only be used if the add-on PCP for Arrays product is also installed. A bunch of questions ensue... - following the code, we end up in summary.c::service_config when data arrives on this file descriptor, and it appears to be PDU formatted (desc/result) - has this been tested since the changes to __pmDecodeResult (i.e. does whoever sends this PDU guarantee that its correctly formatted, lengths all make sense, etc?) - Is the PCP for Arrays (sounds IRIX-y) still a product? Can the mkconfig script be found? Is anything using the -c option now? I suspect this is long dead code which should be removed at this point, unless this is a generic service that might be useful to others? Need a bit more historical context to tell though. thanks! -- Nathan From kenj@internode.on.net Mon Dec 10 16:53:27 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBAMrR5B009793 for ; Mon, 10 Dec 2012 16:53:27 -0600 X-ASG-Debug-ID: 1355180154-04cbb035a53cfd20001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id mYpnKwUxvOuA0YfN for ; Mon, 10 Dec 2012 14:55:55 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApMBANdnxlB20e94/2dsb2JhbAANOIY3uEuDEQEBAQQjVhALGAICJgICVwatEXCCQJAcgSKOTYETA5YGk08 Received: from ppp118-209-239-120.lns20.mel6.internode.on.net (HELO [192.168.1.100]) ([118.209.239.120]) by ipmail07.adl2.internode.on.net with ESMTP; 11 Dec 2012 09:25:53 +1030 Message-ID: <1355180239.4826.6.camel@bozo.localdomain> Subject: Re: [pcp] pmdasummary -c option? From: Ken McDonell X-ASG-Orig-Subj: Re: [pcp] pmdasummary -c option? To: Nathan Scott Cc: pcp@oss.sgi.com Date: Tue, 11 Dec 2012 09:57:19 +1100 In-Reply-To: <2006224076.46864749.1355176093795.JavaMail.root@redhat.com> References: <2006224076.46864749.1355176093795.JavaMail.root@redhat.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1355180154 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116651 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On Mon, 2012-12-10 at 16:48 -0500, Nathan Scott wrote: > Hi all, > > Does anyone know what the -c option to pmdasummary was used for? > The man page is a bit cryptic... Blank stares from this direction ... no clue I'm afraid. From mgoodwin@redhat.com Mon Dec 10 17:48:29 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBANmTQh012150 for ; Mon, 10 Dec 2012 17:48:29 -0600 X-ASG-Debug-ID: 1355183458-04bdf02d483f29b0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id OaixS2eeAS6YIsEO for ; Mon, 10 Dec 2012 15:50:58 -0800 (PST) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id qBANovLk003529 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK) for ; Mon, 10 Dec 2012 18:50:58 -0500 Received: from fletch.usersys.redhat.com (vpn1-51-181.bne.redhat.com [10.64.51.181]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id qBANourV028830 for ; Mon, 10 Dec 2012 18:50:57 -0500 Message-ID: <50C6755F.3060402@redhat.com> Date: Tue, 11 Dec 2012 10:50:55 +1100 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:13.0) Gecko/20120605 Thunderbird/13.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] pmdasummary -c option? References: <2006224076.46864749.1355176093795.JavaMail.root@redhat.com> <1355180239.4826.6.camel@bozo.localdomain> X-ASG-Orig-Subj: Re: [pcp] pmdasummary -c option? In-Reply-To: <1355180239.4826.6.camel@bozo.localdomain> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1355183458 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com On 12/11/2012 09:57 AM, Ken McDonell wrote: > On Mon, 2012-12-10 at 16:48 -0500, Nathan Scott wrote: >> Hi all, >> >> Does anyone know what the -c option to pmdasummary was used for? >> The man page is a bit cryptic... > > Blank stares from this direction ... no clue I'm afraid. -c When used to summarize metrics from multiple hosts, pmdasummary reads host information from configfile. This is a binary file produced by $PCP_PMDAS_DIR/array/mkconfig, and so this option may only be used if the add-on PCP for Arrays product is also installed. Some kind of cluster/array wide pmie data aggregation, lost in the midsts of nostalga. I think we can nuke it from the man page and from pmdasummary. Cheers From wwwrun@oss.sgi.com Mon Dec 10 21:06:31 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-0.7 required=5.0 tests=ALL_TRUSTED,BAYES_00, J_CHICKENPOX_63,J_CHICKENPOX_64 autolearn=no version=3.4.0-r929098 Received: from oss.sgi.com (localhost [127.0.0.1]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBB36VTm033775 for ; Mon, 10 Dec 2012 21:06:31 -0600 Received: (from wwwrun@localhost) by oss.sgi.com (8.14.3/8.14.3/Submit) id qBB36V5O033774; Mon, 10 Dec 2012 21:06:31 -0600 Date: Mon, 10 Dec 2012 21:06:31 -0600 Message-Id: <201212110306.qBB36V5O033774@oss.sgi.com> From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 934] drop make src-lnk-pcp etc. mechanism to create source tarball X-Bugzilla-Reason: CC X-Bugzilla-Type: newchanged X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: mgoodwin@redhat.com X-Bugzilla-Status: ASSIGNED X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: mgoodwin@redhat.com X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: Status AssignedTo In-Reply-To: References: Auto-Submitted: auto-generated Content-Type: text/plain; charset="UTF-8" MIME-Version: 1.0 http://oss.sgi.com/bugzilla/show_bug.cgi?id=934 Mark Goodwin changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |ASSIGNED AssignedTo|mort@sgi.com |mgoodwin@redhat.com --- Comment #3 from Mark Goodwin 2012-12-10 21:06:29 CST --- Had a quick play around with this and it seems like it will work with incantations similar to : $ git archive --format=tar --prefix=pcp-3.6.11/ HEAD | gzip > build/tar/pcp-3.6.11.src.tar.gz $ ln -sf ../../tar/pcp-3.6.11.src.tar.gz build/rpm/SOURCES rpmbuild -ba --define '_topdir /home/mgoodwin/src/git/pcp/build/rpm' build/rpm/SPECS/fedora.spec $ ls build/rpm/SOURCES/ build/rpm/SPECS build/rpm/SOURCES/: pcp-3.6.11.src.tar.gz build/rpm/SPECS: fedora.spec Will need some Makepkgs munging and rpmbuild directories below build/rpm mkdir -p build/rpm/{SPECS,SOURCES,SRPMS,RPMS} -- Configure bugmail: http://oss.sgi.com/bugzilla/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug. From nscott@redhat.com Tue Dec 11 04:33:41 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBBAXeop053635 for ; Tue, 11 Dec 2012 04:33:41 -0600 X-ASG-Debug-ID: 1355222169-04cb6c05a740a4d0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id 7ppIMq1AYT8MMTbQ for ; Tue, 11 Dec 2012 02:36:10 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBBAa9U6015259 for ; Tue, 11 Dec 2012 05:36:09 -0500 Date: Tue, 11 Dec 2012 05:36:09 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: pcp@oss.sgi.com Message-ID: <5623485.47093753.1355222169255.JavaMail.root@redhat.com> In-Reply-To: <50C6755F.3060402@redhat.com> Subject: Re: [pcp] pmdasummary -c option? MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pmdasummary -c option? Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.134] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1355222169 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116697 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- ----- Original Message ----- > On 12/11/2012 09:57 AM, Ken McDonell wrote: > > On Mon, 2012-12-10 at 16:48 -0500, Nathan Scott wrote: > >> Hi all, > >> > >> Does anyone know what the -c option to pmdasummary was used for? > >> The man page is a bit cryptic... > > > > Blank stares from this direction ... no clue I'm afraid. > ... > Some kind of cluster/array wide pmie data aggregation, lost in the > midsts of nostalga. I think we can nuke it from the man page and > from pmdasummary. > Another clue lurks in the usage message: " -c configfile load ASCII PDUs from config file on startup\n" Since ASCII PDUs went the way of the dodo a long time ago, this can't possible be functional. Will remove it. cheers. -- Nathan From nscott@redhat.com Tue Dec 11 04:44:57 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBBAiuev054111 for ; Tue, 11 Dec 2012 04:44:56 -0600 X-ASG-Debug-ID: 1355222829-04cb6c05a840b290001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id nfxATGrrwHvoRHJC for ; Tue, 11 Dec 2012 02:47:09 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBBAl9sB030161 for ; Tue, 11 Dec 2012 05:47:09 -0500 Date: Tue, 11 Dec 2012 05:47:09 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: pcp@oss.sgi.com Message-ID: <1066842797.47098012.1355222829007.JavaMail.root@redhat.com> Subject: pcp updates: kenj merge, pmdasummary spring clean MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: kenj merge, pmdasummary spring clean Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.134] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1355222829 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116699 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://oss.sgi.com/pcp/pcp.git dev man/man1/pmdasummary.1 | 11 - qa/280 | 6 qa/430 | 18 ++ qa/430.3.out | 252 +++++++++++++++++++++++++++++++++++++++ qa/512 | 6 qa/645 | 2 qa/common.check | 38 +++++ src/libpcp_fault/src/GNUmakefile | 9 + src/pmcd/rc_pmcd | 4 src/pmdas/summary/mainloop.c | 44 ------ src/pmdas/summary/pmda.c | 27 ---- src/pmdas/summary/summary.c | 43 ------ src/pmdas/summary/summary.h | 7 - src/pmlogctl/pmlogger_check.sh | 53 +++++++- src/pmlogctl/pmlogger_daily.sh | 55 +++++++- src/pmlogger/ports.c | 6 16 files changed, 428 insertions(+), 153 deletions(-) commit 57fc766e25071526c678c61e5f40e04aad579a27 Author: Nathan Scott Date: Tue Dec 11 21:45:47 2012 +1100 Remove the unused -c option from pmdasummary After some discussion, noone remembers what this was for, everyone is sure the "Array Services" product mentioned on the man page is pre-historical, and the usage message that points to use of ASCII PDUs was the nail in the coffin. Cannot possibly be in-use-by anyone, so have removed it rather than attempt to explain it via docs. commit 5efd079193a44a19bbdc59ff4da379b9d8850ce1 Author: Ken McDonell Date: Sun Dec 9 07:30:33 2012 +1100 Change primary pmlogger control from symlink to link $PCP_TMP_DIR/pmlogger/primary used to be a symbolic link. This commit makes all the changes necessary to change this to be a (hard) link to the control file for the primary pmlogger. The change is motivated by the combination of moving to non-root execution of many PCP daemons (and pmlogger in particular), and Ubuntu's security-driven changes that have modified (broken?) the semantics of how symbolic links behave when created within a "sticky" directory like $PCP_TMP_DIR/pmlogger commit a87ddb4df4258da5796a20fb8d6019f229183db4 Author: Ken McDonell Date: Sun Dec 9 06:09:16 2012 +1100 qa/512 - correct path to source after pcpqa -> pcp merge commit f50565e7a5f7058d04f72112ab55ca327e5b7879 Author: Ken McDonell Date: Fri Dec 7 06:38:08 2012 +1100 libpcp_fault - add nss/nspr glue to makefile From chandana@desilva.id.au Tue Dec 11 15:28:06 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBBLS6bt101613 for ; Tue, 11 Dec 2012 15:28:06 -0600 X-ASG-Debug-ID: 1355261434-04bdf02d4945b750001-S8gJnT Received: from mho-02-ewr.mailhop.org (mho-04-ewr.mailhop.org [204.13.248.74]) by cuda.sgi.com with ESMTP id qsPLZ2OmeSeETUAH (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 11 Dec 2012 13:30:35 -0800 (PST) X-Barracuda-Envelope-From: chandana@desilva.id.au X-Barracuda-Apparent-Source-IP: 204.13.248.74 Received: from d210-49-168-202.sun801.vic.optusnet.com.au ([210.49.168.202] helo=mail.desilva.id.au) by mho-02-ewr.mailhop.org with esmtpa (Exim 4.72) (envelope-from ) id 1TiXPO-0009zS-EM for pcp@oss.sgi.com; Tue, 11 Dec 2012 21:30:34 +0000 Received: from [192.168.19.77] (ip-34.83.45.175.VOCUS.net.au [175.45.83.34]) by mail.desilva.id.au (Postfix) with ESMTPSA id 0A40C70DE for ; Wed, 12 Dec 2012 08:27:24 +1100 (EST) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 210.49.168.202 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX180MNsUfD1/gHQg1ogEsaxR3NreunmoiNE= Message-ID: <50C7A5F5.6090706@desilva.id.au> Date: Wed, 12 Dec 2012 08:30:29 +1100 From: Chandana De Silva Reply-To: chandana@desilva.id.au User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:16.0) Gecko/20121011 Thunderbird/16.0.1 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: proc pmda - incorrect units Content-Type: text/plain; charset=ISO-8859-1; format=flowed X-ASG-Orig-Subj: proc pmda - incorrect units Content-Transfer-Encoding: 7bit X-Barracuda-Connect: mho-04-ewr.mailhop.org[204.13.248.74] X-Barracuda-Start-Time: 1355261435 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116740 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- $ pminfo -d -t proc.io.write_bytes proc.io.write_bytes [] Data Type: 64-bit unsigned int InDom: 3.9 0xc00009 Semantics: counter Units: Kbyte I think the Units should be byte ... From nscott@redhat.com Tue Dec 11 16:55:35 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,J_CHICKENPOX_44 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBBMtZhJ107368 for ; Tue, 11 Dec 2012 16:55:35 -0600 X-ASG-Debug-ID: 1355266684-04cb6c05a7450f30001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id ctutCt4IDuPR6yZA for ; Tue, 11 Dec 2012 14:58:04 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBBMw3pA004979; Tue, 11 Dec 2012 17:58:03 -0500 Date: Tue, 11 Dec 2012 17:58:03 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: chandana@desilva.id.au Cc: pcp@oss.sgi.com Message-ID: <437685871.47599423.1355266683632.JavaMail.root@redhat.com> In-Reply-To: <50C7A5F5.6090706@desilva.id.au> Subject: Re: [pcp] proc pmda - incorrect units MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] proc pmda - incorrect units Content-Type: multipart/mixed; boundary="----=_Part_47599421_1025241956.1355266683631" X-Originating-IP: [10.64.51.195] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1355266684 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116746 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header ------=_Part_47599421_1025241956.1355266683631 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Hi, ----- Original Message ----- > $ pminfo -d -t proc.io.write_bytes > > proc.io.write_bytes [] > Data Type: 64-bit unsigned int InDom: 3.9 0xc00009 > Semantics: counter Units: Kbyte > > I think the Units should be byte ... Yes, I think you're right. In the kernel, fs/proc/base.c::do_io_accounting does the heavy lifting. That copies the task_io_accounting "ioac" field (a struct) into a local and copies each counter in there directly to the exported buffer with no conversion. Going further up the chain, vfs_read does add_rchar(bytes), for example, and there's nowhere on this path where any conversion is done. There's a bit of a red herring over in kernel/tsacct.c as that code also access these fields, and converts everything to kilobytes in xacct_add_tsk() - including the r/w syscall counts strangely enough. But that's in "System accounting" code, and we don't use that in PCP. How does the attached patch look? The help text was correct already. cheers. -- Nathan ------=_Part_47599421_1025241956.1355266683631 Content-Type: text/x-patch; name=proc-iostats.patch Content-Disposition: attachment; filename=proc-iostats.patch Content-Transfer-Encoding: base64 ZGlmZiAtLWdpdCBhL3NyYy9wbWRhcy9saW51eF9wcm9jL3BtZGEuYyBiL3NyYy9wbWRhcy9saW51 eF9wcm9jL3BtZGEuYwppbmRleCBmZWUxNjZkLi44YjJjMDk0IDEwMDY0NAotLS0gYS9zcmMvcG1k YXMvbGludXhfcHJvYy9wbWRhLmMKKysrIGIvc3JjL3BtZGFzL2xpbnV4X3Byb2MvcG1kYS5jCkBA IC01MTUsMTUgKzUxNSwxNSBAQCBwbWRhTWV0cmljIHByb2NfbWV0cmljdGFiW10gPSB7CiAvKiBw cm9jLmlvLnJlYWRfYnl0ZXMgKi8KICAgeyBOVUxMLAogICAgIHsgUE1EQV9QTUlEKENMVVNURVJf UElEX0lPLDQpLCBQTV9UWVBFX1U2NCwgUFJPQ19JTkRPTSwgUE1fU0VNX0NPVU5URVIsCi0gICAg UE1EQV9QTVVOSVRTKDEsMCwwLFBNX1NQQUNFX0tCWVRFLDAsMCl9fSwKKyAgICBQTURBX1BNVU5J VFMoMSwwLDAsUE1fU1BBQ0VfQllURSwwLDApfX0sCiAvKiBwcm9jLmlvLndyaXRlX2J5dGVzICov CiAgIHsgTlVMTCwKICAgICB7IFBNREFfUE1JRChDTFVTVEVSX1BJRF9JTyw1KSwgUE1fVFlQRV9V NjQsIFBST0NfSU5ET00sIFBNX1NFTV9DT1VOVEVSLAotICAgIFBNREFfUE1VTklUUygxLDAsMCxQ TV9TUEFDRV9LQllURSwwLDApfX0sCisgICAgUE1EQV9QTVVOSVRTKDEsMCwwLFBNX1NQQUNFX0JZ VEUsMCwwKX19LAogLyogcHJvYy5pby5jYW5jZWxsZWRfd3JpdGVfYnl0ZXMgKi8KICAgeyBOVUxM LAogICAgIHsgUE1EQV9QTUlEKENMVVNURVJfUElEX0lPLDYpLCBQTV9UWVBFX1U2NCwgUFJPQ19J TkRPTSwgUE1fU0VNX0NPVU5URVIsCi0gICAgUE1EQV9QTVVOSVRTKDEsMCwwLFBNX1NQQUNFX0tC WVRFLDAsMCl9fSwKKyAgICBQTURBX1BNVU5JVFMoMSwwLDAsUE1fU1BBQ0VfQllURSwwLDApfX0s CiAKIC8qCiAgKiBwcm9jLnJ1bnEgY2x1c3Rlcgo= ------=_Part_47599421_1025241956.1355266683631-- From chandana@desilva.id.au Tue Dec 11 17:10:09 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBBNA9JO108005 for ; Tue, 11 Dec 2012 17:10:09 -0600 X-ASG-Debug-ID: 1355267558-04cbb035a443f8f0001-S8gJnT Received: from mho-01-ewr.mailhop.org (mho-03-ewr.mailhop.org [204.13.248.66]) by cuda.sgi.com with ESMTP id 8YHUVyzKwagkuWSQ (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 11 Dec 2012 15:12:38 -0800 (PST) X-Barracuda-Envelope-From: chandana@desilva.id.au X-Barracuda-Apparent-Source-IP: 204.13.248.66 Received: from d210-49-168-202.sun801.vic.optusnet.com.au ([210.49.168.202] helo=mail.desilva.id.au) by mho-01-ewr.mailhop.org with esmtpa (Exim 4.72) (envelope-from ) id 1TiZ09-000Px8-OC; Tue, 11 Dec 2012 23:12:38 +0000 Received: from [192.168.19.77] (ip-34.83.45.175.VOCUS.net.au [175.45.83.34]) by mail.desilva.id.au (Postfix) with ESMTPSA id 15E676EA6; Wed, 12 Dec 2012 10:09:28 +1100 (EST) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 210.49.168.202 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX18h1bmBUK3QF/QlQA3q9QXDVWIVg60Uja4= Message-ID: <50C7BDE0.3060000@desilva.id.au> Date: Wed, 12 Dec 2012 10:12:32 +1100 From: Chandana De Silva Reply-To: chandana@desilva.id.au User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:16.0) Gecko/20121011 Thunderbird/16.0.1 MIME-Version: 1.0 To: Nathan Scott CC: pcp@oss.sgi.com Subject: Re: [pcp] proc pmda - incorrect units References: <437685871.47599423.1355266683632.JavaMail.root@redhat.com> X-ASG-Orig-Subj: Re: [pcp] proc pmda - incorrect units In-Reply-To: <437685871.47599423.1355266683632.JavaMail.root@redhat.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: mho-03-ewr.mailhop.org[204.13.248.66] X-Barracuda-Start-Time: 1355267558 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116746 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- I will apply this to/morrow night and see .... On 12/12/12 09:58, Nathan Scott wrote: > Hi, > > ----- Original Message ----- >> $ pminfo -d -t proc.io.write_bytes >> >> proc.io.write_bytes [] >> Data Type: 64-bit unsigned int InDom: 3.9 0xc00009 >> Semantics: counter Units: Kbyte >> >> I think the Units should be byte ... > Yes, I think you're right. > > In the kernel, fs/proc/base.c::do_io_accounting does the > heavy lifting. That copies the task_io_accounting "ioac" > field (a struct) into a local and copies each counter in > there directly to the exported buffer with no conversion. > > Going further up the chain, vfs_read does add_rchar(bytes), > for example, and there's nowhere on this path where any > conversion is done. > > There's a bit of a red herring over in kernel/tsacct.c as > that code also access these fields, and converts everything > to kilobytes in xacct_add_tsk() - including the r/w syscall > counts strangely enough. But that's in "System accounting" > code, and we don't use that in PCP. > > How does the attached patch look? The help text was correct > already. > > cheers. > > -- > Nathan From nscott@redhat.com Tue Dec 11 17:29:31 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBBNTVYO132363 for ; Tue, 11 Dec 2012 17:29:31 -0600 X-ASG-Debug-ID: 1355268720-04bdf02d484634b0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id OReVQjYs7hi9Jy7R for ; Tue, 11 Dec 2012 15:32:00 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBBNVxV6021612; Tue, 11 Dec 2012 18:31:59 -0500 Date: Tue, 11 Dec 2012 18:31:59 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: chandana@desilva.id.au Cc: pcp@oss.sgi.com Message-ID: <495687388.47606339.1355268719647.JavaMail.root@redhat.com> In-Reply-To: <905228797.44906431.1355008065064.JavaMail.root@redhat.com> Subject: Re: [pcp] Error installing MySQL PMDA on PCP 3.6.10 MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Error installing MySQL PMDA on PCP 3.6.10 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.195] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1355268720 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116748 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header ----- Original Message ----- > ----- Original Message ----- > > ... > > [chandana@c63 mysql]$ ls > > Install mysql.conf pmdamysql.pl Remove > > [chandana@c63 mysql]$ sudo ./Install > > mktemp: failed to create directory via template > > `/var/lib/pcp/tmp/pmdaproc.XXXXXXXXX': No such file or directory > > > > This was a spec file botch at my end, there's a 3.6.10-2 RPM > which was pushed into Fedora and EPEL, but which I now realise > has not been put on oss.sgi.com yet - will get to that shortly. This has been done now, BTW, if any was looking for this rebuild. cheers. -- Nathan From wwwrun@oss.sgi.com Tue Dec 11 18:02:35 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-0.8 required=5.0 tests=ALL_TRUSTED,BAYES_00, J_CHICKENPOX_74 autolearn=no version=3.4.0-r929098 Received: from oss.sgi.com (localhost [127.0.0.1]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBC02ZhJ134840 for ; Tue, 11 Dec 2012 18:02:35 -0600 Received: (from wwwrun@localhost) by oss.sgi.com (8.14.3/8.14.3/Submit) id qBC02Yns134839; Tue, 11 Dec 2012 18:02:34 -0600 Date: Tue, 11 Dec 2012 18:02:34 -0600 Message-Id: <201212120002.qBC02Yns134839@oss.sgi.com> From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 936] pmie falling operator does not insert instance (%i) and value (%v) X-Bugzilla-Reason: CC X-Bugzilla-Type: newchanged X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: kenj@internode.on.net X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: mort@sgi.com X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: In-Reply-To: References: Auto-Submitted: auto-generated Content-Type: text/plain; charset="UTF-8" MIME-Version: 1.0 http://oss.sgi.com/bugzilla/show_bug.cgi?id=936 --- Comment #4 from Ken McDonell 2012-12-11 18:02:33 CST --- OK, I've dug a little deeper. The original rule was falling some_inst ... the semantics of this are a little odd, namely the some_inst ... has a singular boolean value, so falling can only be true when some_inst ... transitions from true to false ... I don't think there is any robust binding of %v (1 is the best you could get) or %i (_all_ the instances conspire to make some_inst false, and we don't have enough history to figure which of the instances were true at the last sample). Although this rule is syntactically correct, the semantics are sufficiently unusual that I don't propose smacking pmie to try and get a better answer (because I don't thing there is one, especially when one considers the range of operators that could be involved in a boolean expression following the "falling". I suspect the intent of the rule may be more accurately captured by: some_inst falling match_inst ... filesys.full > 40 which would be true (and %i well defined) when some filesystem falls below 40% full. It turns out that the following is semantically equivalent if you prefer: some_inst match_inst ... falling filesys.full > 40 The other example of rising some_inst ... sort of works _by accident_ as we can find the instances that make some_inst true and all instances must have been false at the previous sample. Again a better representation of the rule would probably be: some_inst rising match_inst ... filesys.full > 50 Unless someone objects over the next week, I plan to close out this bug. -- Configure bugmail: http://oss.sgi.com/bugzilla/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug. From wwwrun@oss.sgi.com Wed Dec 12 05:40:48 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-0.8 required=5.0 tests=ALL_TRUSTED,BAYES_00, J_CHICKENPOX_74 autolearn=no version=3.4.0-r929098 Received: from oss.sgi.com (localhost [127.0.0.1]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBCBemJi180443 for ; Wed, 12 Dec 2012 05:40:48 -0600 Received: (from wwwrun@localhost) by oss.sgi.com (8.14.3/8.14.3/Submit) id qBCBem3g180442; Wed, 12 Dec 2012 05:40:48 -0600 Date: Wed, 12 Dec 2012 05:40:48 -0600 Message-Id: <201212121140.qBCBem3g180442@oss.sgi.com> From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 936] pmie falling operator does not insert instance (%i) and value (%v) X-Bugzilla-Reason: CC X-Bugzilla-Type: newchanged X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: azzurrow@gmail.com X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: mort@sgi.com X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: In-Reply-To: References: Auto-Submitted: auto-generated Content-Type: text/plain; charset="UTF-8" MIME-Version: 1.0 http://oss.sgi.com/bugzilla/show_bug.cgi?id=936 --- Comment #5 from azzurrow@gmail.com 2012-12-12 05:40:46 CST --- I've changed the rules to some_inst rising match_inst "^(/dev/root|/dev/cciss)" ( filesys.full > 50 ) -> syslog "high file system util" " [%i] %v "; some_inst falling match_inst "^(/dev/root|/dev/cciss)" ( filesys.full > 40 ) -> syslog "normal file system util" " [%i] %v "; and the log entries show the corectvalues Dec 12 12:34:48 lggwsl32 pcp-pmie[10674]: high file system util [/dev/cciss/c0d0p1] 53 Dec 12 12:35:18 lggwsl32 pcp-pmie[10674]: normal file system util [/dev/cciss/c0d0p1] 36.0 Good stuff. Thanks. -- Configure bugmail: http://oss.sgi.com/bugzilla/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug. From junwang123@gmail.com Wed Dec 12 21:26:39 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,FREEMAIL_FROM, T_DKIM_INVALID autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBD3QdMj239252 for ; Wed, 12 Dec 2012 21:26:39 -0600 X-ASG-Debug-ID: 1355369349-04bdf02d484cb6f0001-S8gJnT Received: from mail-pa0-f53.google.com (mail-pa0-f53.google.com [209.85.220.53]) by cuda.sgi.com with ESMTP id zgosdxXFof68Tyv8 (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Wed, 12 Dec 2012 19:29:09 -0800 (PST) X-Barracuda-Envelope-From: junwang123@gmail.com X-Barracuda-Apparent-Source-IP: 209.85.220.53 X-Barracuda-IPDD: Level1 [gmail.com/209.85.220.53] Received: by mail-pa0-f53.google.com with SMTP id hz1so1100234pad.26 for ; Wed, 12 Dec 2012 19:29:09 -0800 (PST) X-Barracuda-IPDD: Level1 [gmail.com/209.85.220.53] X-Barracuda-IPDD: Level1 [gmail.com/209.85.220.53] DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:from:content-type:x-mailer:message-id:date:to :content-transfer-encoding:mime-version; bh=uypEOn0XyV1qiqK6QuLAzK/GvHdxnGLw1JHIzogqWO0=; b=bY9NrSezdYotYP0KbL8bHrXtz3O5dr1m7H3kOhq6yVv6ceoR3tX+ZoEX6SYEroDN26 GGK/igdf9/p7CrWV0uWSGSnUNBB/JDsHO3VR6gHSgMzbf60/nqMIxibJ8fLiWcfMQR36 afOJ3tQe6HqXZiKnDYBXONWLWxC9sjtzPhGeSVysSC++Sy2wF7ZLSJSNayk6N/r9aYXP G5pIPNPzn0mnhXNUMc0MfBWg0HZLu5hbwwAxJxD073W+sERQfDqOfOAhKwVTKeVN9tNP zNNLsY2DuTGmWFI43entuVnB7sOS3aUen5xF4YAS3iwejr4l4clBLz9sb38ZFMeBQyzT cxOA== Received: by 10.68.253.230 with SMTP id ad6mr1140497pbd.84.1355369349154; Wed, 12 Dec 2012 19:29:09 -0800 (PST) Received: from [192.168.1.104] (c-24-130-206-152.hsd1.ca.comcast.net. [24.130.206.152]) by mx.google.com with ESMTPS id nf9sm190940pbc.17.2012.12.12.19.29.06 (version=SSLv3 cipher=OTHER); Wed, 12 Dec 2012 19:29:07 -0800 (PST) Subject: Web UI for PCP From: Jun Wang X-ASG-Orig-Subj: Web UI for PCP Content-Type: text/plain; charset=us-ascii X-Mailer: iPhone Mail (10A525) Message-Id: <166A4312-2C26-4BC0-ACE1-27ED9A516B55@gmail.com> Date: Wed, 12 Dec 2012 19:29:05 -0800 To: PCP Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (1.0) X-Barracuda-Connect: mail-pa0-f53.google.com[209.85.220.53] X-Barracuda-Start-Time: 1355369349 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116860 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature Folks, In general, are there efforts to add web interface for various PCP tools? Thanks, Jun From nscott@redhat.com Wed Dec 12 23:28:50 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.7 required=5.0 tests=BAYES_00,J_CHICKENPOX_42, J_CHICKENPOX_44 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBD5SonB247754 for ; Wed, 12 Dec 2012 23:28:50 -0600 X-ASG-Debug-ID: 1355376676-04bdf02d494d15a0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id B6zMG2aO0DjAkTYk for ; Wed, 12 Dec 2012 21:31:16 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBD5VGeP003376 for ; Thu, 13 Dec 2012 00:31:16 -0500 Date: Thu, 13 Dec 2012 00:31:16 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: pcp@oss.sgi.com Message-ID: <1841839499.48556175.1355376676584.JavaMail.root@redhat.com> Subject: pcp updates: initial ssl steps MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: initial ssl steps Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.159] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1355376676 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116868 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://oss.sgi.com/pcp/pcp.git nssmerge configure | 154 ++++++++++++++ configure.in | 11 + man/man1/pmcd.1 | 10 man/man3/pmnewcontext.3 | 7 qa/src/endian.c | 8 qa/src/pducheck.c | 7 src/include/builddefs.in | 1 src/include/pcp/impl.h | 57 +++-- src/include/pcp/pmapi.h | 9 src/libpcp/src/GNUmakefile | 3 src/libpcp/src/auxconnect.c | 443 +++++++++++++++++++++++++++---------------- src/libpcp/src/check-statics | 5 src/libpcp/src/connect.c | 62 ++++-- src/libpcp/src/context.c | 166 ++++++++-------- src/libpcp/src/ipc.c | 113 ++++++---- src/pmcd/src/config.c | 21 -- src/pmcd/src/dopdus.c | 19 + src/pmcd/src/pmcd.c | 13 - src/pmdas/linux_proc/pmda.c | 6 src/pmproxy/pmproxy.c | 1 src/python/pmapi.c | 6 21 files changed, 748 insertions(+), 374 deletions(-) commit fbb2751b9abf816e04f402f8f74f648eeeed99da Author: Nathan Scott Date: Thu Dec 13 16:29:37 2012 +1100 Initial PCP protocol changes to support secure sockets layer (SSL) This introduces several changes that prepare for the pmcd/client protocol exchange to be optionally augmented with an SSL handshake after the initial PCP handshake. Enabling this requires several steps. Firstly, the PM_CTXFLAG concept is reintroduced (which was dropped awhile ago from lack of interest). The shallow/exclusive flags that were there are left alone, for back- compat, and a new SECURE flag is added for use with HOST contexts. In addition, in the future, pmParseHostSpec is likely to be extended with pcp://... and pcps://... prefix extraction. Current intention is to wait on deeper understanding of user authentication before that gets tackled, however, for a more coherent naming strategy. When a socket is established to pmcd, the first stage of the protocol is to send an extended error PDU back to the client. This contains a field that was previously always zeroed - this is now reclaimed to hold "feature" flags. If pmcd is capable of doing SSL encryption, a bit is set here indicating the presense of the feature (at least 15 other bits are also available for later features, at which point we could also go with a larger "pduinfo" payload, I think). All existing client tools ignore this bit, and are oblivious to the fact that it changed from a zero to a one for pmcd binaries built with this feature. For new clients who choose to take pmcd up on its offer of encrypted communication, the credentials version PDU (which the client sends back) has also been modified, in a similar way - it has a previously-always-zero bit now set, which is used in pmcd to identify client willingness to partake. Early stages of the subsequent SSL exchange are in place, but there's plenty of work to do in completing that (around setting up certificate databases and so forth in pmcd). A large part of this change is around reworking __pmDataIPC & friends to be able to hold more than just a single pointer (it now also holds an SSL fd, in addition to the existing NSPR). This is also expected to grow in future. If NSS (--without-secure-sockets) is disables during configure, the ipc table is now returned to its pre-NSS size too, an unexpected little bonus. commit a59094c30a016fbaa0b6ad4798d42052b93a01b4 Author: Nathan Scott Date: Thu Dec 13 15:00:49 2012 +1100 Correct the units for three Linux proc.io metrics commit 96978ae0c7f77715ec6561f25d1561107f06fc3c Author: Nathan Scott Date: Thu Dec 13 15:00:17 2012 +1100 Add configure/build support for linking with libssl commit 7b7ee3829772c14838b500bfd133a7e501bd15bf Author: Nathan Scott Date: Thu Dec 13 14:52:41 2012 +1100 Reference a pmda example which still exists in pmcd man page commit 738eb7aa5ac784345239719726367090a99683e5 Author: Nathan Scott Date: Thu Dec 13 14:51:55 2012 +1100 Use most appropriate API in pducheck.c for host+port connect From nscott@redhat.com Thu Dec 13 00:05:42 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBD65fNl252459 for ; Thu, 13 Dec 2012 00:05:42 -0600 X-ASG-Debug-ID: 1355378892-04cb6c05a74c1a50001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id qw1BjQPjiDL3ly1E for ; Wed, 12 Dec 2012 22:08:12 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBD68Apw005772; Thu, 13 Dec 2012 01:08:10 -0500 Date: Thu, 13 Dec 2012 01:08:10 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Jun Wang Cc: PCP Message-ID: <1326446925.48563854.1355378890881.JavaMail.root@redhat.com> In-Reply-To: <166A4312-2C26-4BC0-ACE1-27ED9A516B55@gmail.com> Subject: Re: [pcp] Web UI for PCP MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Web UI for PCP Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.159] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1355378892 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116870 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi Jun, ----- Original Message ----- > Folks, > > In general, are there efforts to add web interface for various PCP > tools? > While not stuck in meetings, Frank has been occasionally hacking away on a JSON/web interface to the PMAPI. AIUI, its just a few simple lines of code away from completion (heh, sorry, bad in-joke). Its my hope that this will enable new kinds of projects to be built on the services PCP is already making available to the C/C++/python client tools. Beyond that initial JSON interface, at this stage I think much of the planned roadmap calls for core PCP functionality. So, we're hoping others can take up the baton and experiment with the web interfaces, while we beaver away providing a richer set of core services. That's my understanding/line-of-thinking anyway, possibly others will pop up with different plans/opinions shortly. :) cheers. -- Nathan From kenj@internode.on.net Thu Dec 13 14:05:09 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBDK59Q5132790 for ; Thu, 13 Dec 2012 14:05:09 -0600 X-ASG-Debug-ID: 1355429258-04cbb035a64e0e30001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id 3s2OUymVp6K9EzvW for ; Thu, 13 Dec 2012 12:07:39 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApMBAAQ0ylB20TUh/2dsb2JhbAANOIY4uE6DO4EFBgImAnKxDXCTEoEiizWDMIETA5JWhE+SMw Received: from ppp118-209-53-33.lns20.mel4.internode.on.net (HELO [192.168.1.101]) ([118.209.53.33]) by ipmail05.adl6.internode.on.net with ESMTP; 14 Dec 2012 06:37:38 +1030 Message-ID: <1355429260.5399.18.camel@bozo-laptop.localdomain> Subject: pcp updates - pmie, qa, non-root fallout From: Ken McDonell X-ASG-Orig-Subj: pcp updates - pmie, qa, non-root fallout To: pcp@oss.sgi.com Date: Fri, 14 Dec 2012 07:07:40 +1100 Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1355429258 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116926 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://oss.sgi.com/kenj/pcp.git dev qa/022 | 2 qa/191 | 5 qa/191.out | 6 qa/255 | 9 qa/297 | 4 qa/321 | 10 qa/321.out | 12 qa/325 | 1 qa/358 | 4 qa/360 | 5 qa/361 | 12 qa/361.out.2 | 82 ++-- qa/514 | 46 +- qa/514.out | 802 +++++++++++++++++++++++++++++++++++++++---- qa/515 | 82 ++++ qa/515.out | 26 + qa/group | 1 qa/pmdas/GNUmakefile.install | 14 src/pmcd/GNUmakefile | 2 src/pmcd/pmdaproc.sh | 8 src/pmie/src/eval.c | 3 src/pmie/src/grammar.y | 6 src/pmie/src/show.c | 95 +++-- 23 files changed, 1063 insertions(+), 174 deletions(-) commit 92068154c598b7a635bef475795fc3e948547103 Author: Ken McDonell Date: Fri Dec 14 07:04:13 2012 +1100 qa/360 - allowed back in the pool now commit 03757519ab612ba21ec3792620994a54ac6ddad5 Author: Ken McDonell Date: Fri Dec 14 06:17:44 2012 +1100 qa/325 - small diagnostics improvement commit 142346c2e37ef711996f62722c796c619b2e7f96 Author: Ken McDonell Date: Fri Dec 14 06:17:05 2012 +1100 qa/255 - fix some more non-root pmcd fallout commit 220034a6a0895ace07d3bb036ce469b9a989b5ba Author: Ken McDonell Date: Fri Dec 14 06:11:46 2012 +1100 pmdaproc.sh - rotate PMDA log files before starting a PMDA This change ensures a PMDA launched from one of the Install scripts and PMDA's launched by pmcd at startup from the $PCP_RC_DIR/pmcd script both rotate old PMDA logfiles from .log to .log.prev. Since the non-root pmcd changes this is more important as .log may be owned by root, but the new PMDA may be running as the user "pcp" and unable to overwrite an existing .log, which was causing the PMDA's log to be spliced into pmcd.log. commit 41552a2fe0407f2cfeff34c59aa0b1a67f8ca652 Author: Ken McDonell Date: Fri Dec 14 06:07:14 2012 +1100 Make $PCP_LOG_DIR/pmcd mode 1777 Since the non-root pmcd changes, we can have log files for PMDAs created by either "root" or the user "pcp". To allow a PMDA launched from pmcd's SIGHUP handling (PMDA install or restarting a failed PMDA) to be able to create their own log files, the mode of $PCP_LOG_DIR/pmcd has to be less restrictive ... mode 1777 follows the $PCP_TMP_DIR model. commit 1e5fad42db79330d3940ba4846364df187f6dfea Author: Ken McDonell Date: Thu Dec 13 11:06:35 2012 +1100 qa/361 - would not have worked since proc PMDA split from Linux Fix output file selection and output file. Failures would have been masked if proc PMDA was _not_ installed on the system under test. commit a05b388ae090c13fcf54c4b7a7ca713e7b73087c Author: Ken McDonell Date: Thu Dec 13 10:48:42 2012 +1100 qa/297 - tweak filter Remove (recent) __pmSetDataIPC diagnostics from output. commit 699091748f2c20825376ba37280ffe978e72b7a1 Author: Ken McDonell Date: Thu Dec 13 06:57:52 2012 +1100 qa - use GNUmakefile.install when running QA in the tree Extend earlier fix to the pmdas subdir within qa ... fixes failures for the broken pmda (qa/274). commit 1ce774e5352ce259a1eab3470326004d9d4329bf Author: Ken McDonell Date: Thu Dec 13 06:27:14 2012 +1100 qa/022 - expect fd > 9 after nss/nspr changes commit 995352bee82ef158a5b66dc824b63bde2c127feb Author: Ken McDonell Date: Wed Dec 12 20:52:45 2012 +1100 qa/514 - back in the game Re-enable ... now passing a much larger set of tests with recent pmie changes. But still some work TODO here. commit 807d7a43e1cc1c7071579976c3d91733e33222cd Author: Ken McDonell Date: Wed Dec 12 20:51:15 2012 +1100 qa/358 - fix typo and make a little more stable commit c8d36df7d45b3e5fdd66781789f0c9723c6b1cd4 Author: Ken McDonell Date: Wed Dec 12 20:50:19 2012 +1100 qa/321 - tweak after recent pmie %i/%v changes commit d3a826bb483afcbec6f2434ba06cefc09b4297f6 Author: Ken McDonell Date: Wed Dec 12 20:48:52 2012 +1100 qa/515 - (new) exercise falling and rising operators for pmie commit 15cfcfdb3bc1c6fcd43b6cc3adfd857ab7f7afa7 Author: Ken McDonell Date: Wed Dec 12 20:47:51 2012 +1100 pmie - more verbose diagnostics for %i, %v with -Dappl2 commit 9c13777cd494eac77f798a7cbafc571f5c14ddae Author: Ken McDonell Date: Tue Dec 11 07:41:20 2012 +1100 pmie - fix match_inst and nomatch_inst reporting with -d When using -d (interactive or debug mode), expressions containing the match_inst or nomatch_inst operators were being reported incorrectly and the regex argument was not being treated correctly ... this is a compiled regex at this point, so the original string representation cannot be recovered and reported ... use "/regex/" instead. commit b55be3b78a4fc400c0429dab324dd718748772ce Author: Ken McDonell Date: Tue Dec 11 07:22:08 2012 +1100 pmie - expression fixups Remove code that depends on order of values assigned to operators ... so op >= ABC && op <= DEF replaced by enumeration of the operator values in the guard, e.g. op == ABC || op == PQR || op == DEF Fix %[iv] bindings for the count_{inst,sample,host} operator. commit a2b7595d3b32a60eb61fae6610a03c6362ef8655 Author: Ken McDonell Date: Mon Dec 10 15:54:14 2012 +1100 qa/191 - tweak after recent pmie changes From nscott@redhat.com Thu Dec 13 17:14:50 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBDNEn1t152878 for ; Thu, 13 Dec 2012 17:14:50 -0600 X-ASG-Debug-ID: 1355440641-04bdf02d4850fd70001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id mMOXIE8cHqNOFgZP for ; Thu, 13 Dec 2012 15:17:21 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBDNHHHT004558; Thu, 13 Dec 2012 18:17:17 -0500 Date: Thu, 13 Dec 2012 18:17:17 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <1074649813.49227675.1355440637912.JavaMail.root@redhat.com> In-Reply-To: <1355429260.5399.18.camel@bozo-laptop.localdomain> Subject: Re: [pcp] pcp updates - pmie, qa, non-root fallout MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pcp updates - pmie, qa, non-root fallout Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.159] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1355440641 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116938 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- ----- Original Message ----- > Changes committed to git://oss.sgi.com/kenj/pcp.git dev > ... > commit 41552a2fe0407f2cfeff34c59aa0b1a67f8ca652 > Author: Ken McDonell > Date: Fri Dec 14 06:07:14 2012 +1100 > > Make $PCP_LOG_DIR/pmcd mode 1777 > > Since the non-root pmcd changes, we can have log files for PMDAs > created > by either "root" or the user "pcp". To allow a PMDA launched > from pmcd's > SIGHUP handling (PMDA install or restarting a failed PMDA) to be > able to > create their own log files, the mode of $PCP_LOG_DIR/pmcd has to > be less > restrictive ... mode 1777 follows the $PCP_TMP_DIR model. This will make lintian complain once more. I think we can override it, probably, but once we do we should consider whether making private temp dirs on Debian is worthwhile once more (since lintian was the reason we reverted that, and if we have to override it anyway...). cheers. -- Nathan From kenj@internode.on.net Thu Dec 13 18:35:35 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBE0ZZ0T157932 for ; Thu, 13 Dec 2012 18:35:35 -0600 X-ASG-Debug-ID: 1355445486-04cb6c05a84fe300001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id CtEYSb1Nw29MFcPo for ; Thu, 13 Dec 2012 16:38:06 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApMBAEZzylB20TUh/2dsb2JhbAANOIY4uFGDEQEBAQQjVgwECxQEAgImAgJXBhMbsSBwkw2BIos1gzCBEwOSVpcC Received: from ppp118-209-53-33.lns20.mel4.internode.on.net (HELO [192.168.1.101]) ([118.209.53.33]) by ipmail07.adl2.internode.on.net with ESMTP; 14 Dec 2012 11:08:05 +1030 Message-ID: <1355445469.5399.30.camel@bozo-laptop.localdomain> Subject: Re: [pcp] pcp updates - pmie, qa, non-root fallout From: Ken McDonell X-ASG-Orig-Subj: Re: [pcp] pcp updates - pmie, qa, non-root fallout To: Nathan Scott Cc: pcp@oss.sgi.com Date: Fri, 14 Dec 2012 11:37:49 +1100 In-Reply-To: <1074649813.49227675.1355440637912.JavaMail.root@redhat.com> References: <1074649813.49227675.1355440637912.JavaMail.root@redhat.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1355445486 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116944 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Well ... I am assuming that the order of importance is ... 1. PCP works 2. non-root execution is goodness 3. lintian compliance So I think there is no option other than finding a way to smack lintian. I battled for 6 hours trying to figure out why qa/255 was failing, and I would be very surprised to find an alternative solution that does not involve making the mode for $PCP_LOG_DIR/pmcd more permissive. If it is not 1777, then I suspect it could possibly be 755 and _owned_ by the user pcp ... I changed it by hand post-install to be thus and pmcd starts (with a bunch of root owned log files therein) and qa/255 passes. Would that be any less sucky for lintian and any of the other packaging pixies? I cannot test on fedora/suse/centos as I am still stuck there with the python rpm packaging failures I mentioned on 26 Nov. On Thu, 2012-12-13 at 18:17 -0500, Nathan Scott wrote: > > ----- Original Message ----- > > Changes committed to git://oss.sgi.com/kenj/pcp.git dev > > ... > > commit 41552a2fe0407f2cfeff34c59aa0b1a67f8ca652 > > Author: Ken McDonell > > Date: Fri Dec 14 06:07:14 2012 +1100 > > > > Make $PCP_LOG_DIR/pmcd mode 1777 > > > > Since the non-root pmcd changes, we can have log files for PMDAs > > created > > by either "root" or the user "pcp". To allow a PMDA launched > > from pmcd's > > SIGHUP handling (PMDA install or restarting a failed PMDA) to be > > able to > > create their own log files, the mode of $PCP_LOG_DIR/pmcd has to > > be less > > restrictive ... mode 1777 follows the $PCP_TMP_DIR model. > > This will make lintian complain once more. I think we can override it, > probably, but once we do we should consider whether making private temp > dirs on Debian is worthwhile once more (since lintian was the reason we > reverted that, and if we have to override it anyway...). > > cheers. > > -- > Nathan From nscott@redhat.com Thu Dec 13 19:01:38 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.7 required=5.0 tests=BAYES_00,J_CHICKENPOX_33, J_CHICKENPOX_44 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBE11clR159329 for ; Thu, 13 Dec 2012 19:01:38 -0600 X-ASG-Debug-ID: 1355447049-04cb6c05a74ff050001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id kgBQB8bTIDd5BS3n for ; Thu, 13 Dec 2012 17:04:10 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBE147ec011633; Thu, 13 Dec 2012 20:04:07 -0500 Date: Thu, 13 Dec 2012 20:04:07 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <1452036590.49275961.1355447047230.JavaMail.root@redhat.com> In-Reply-To: <1355445469.5399.30.camel@bozo-laptop.localdomain> Subject: Re: [pcp] pcp updates - pmie, qa, non-root fallout MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pcp updates - pmie, qa, non-root fallout Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.159] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1355447049 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116946 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- ----- Original Message ----- > Well ... I am assuming that the order of importance is ... > > 1. PCP works > 2. non-root execution is goodness > 3. lintian compliance > *nod*. > So I think there is no option other than finding a way to smack > lintian. I'll take a look, lets assume I can "make it so" for now though. > I battled for 6 hours trying to figure out why qa/255 was failing, Ouch. :| > and I > would be very surprised to find an alternative solution that does not > involve making the mode for $PCP_LOG_DIR/pmcd more permissive. We need to be super careful then with tmpfile issues. I suspect for example that this opens a symlink attack vector via __pmOpenLog() - its current use of unlink + freopen/fdreopen with no O_EXCL looks problematic (needs "x" flag on glibc? or reimplement). Fortunately all PCP uses will be accessing the logdir through that one routine. > If it is not 1777, then I suspect it could possibly be 755 and _owned_ > by the user pcp ... I changed it by hand post-install to be thus and > pmcd starts (with a bunch of root owned log files therein) and qa/255 > passes. Would that be any less sucky for lintian and any of the > other packaging pixies? Isn't that what the packaging does though? debian/pcp.postinst has chown -R pcp:pcp /var/log/pcp/pmcd 2>/dev/null || true How did it become root:root again? > I cannot test on fedora/suse/centos as I am still stuck there with > the python rpm packaging failures I mentioned on 26 Nov. > Hmmm, Fedora and RHEL builds are OK for me, and I'd missed that there were still issues there. Only python issues I knew of were on Debian (which we'd mostly fixed, except for the lintian issue) and the RHEL4 report from Chandana. I'll go take a peek, thanks. cheers. -- Nathan From nscott@redhat.com Thu Dec 13 20:13:18 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBE2DIbC163173 for ; Thu, 13 Dec 2012 20:13:18 -0600 X-ASG-Debug-ID: 1355451349-04bdf02d4b515970001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id GuWpZPhhxkDEP8yL for ; Thu, 13 Dec 2012 18:15:49 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBE2FnGJ000310 for ; Thu, 13 Dec 2012 21:15:49 -0500 Date: Thu, 13 Dec 2012 21:15:49 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: pcp@oss.sgi.com Message-ID: <1198162759.49292924.1355451349093.JavaMail.root@redhat.com> Subject: pcp updates: nssmerge qa MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: nssmerge qa Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.159] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1355451349 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116949 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://oss.sgi.com/pcp/pcp.git nssmerge qa/024 | 1 qa/200 | 1 qa/273 | 1 qa/294 | 7 +++ qa/295 | 7 +++ qa/297 | 1 src/include/pcp/impl.h | 7 ++- src/include/pcp/pmapi.h | 1 src/libpcp/src/auxconnect.c | 87 ++++++++++++++++++++++++++++++-------------- src/libpcp/src/connect.c | 18 ++++++--- src/pmcd/src/dopdus.c | 13 +++--- src/pmcd/src/pmcd.c | 1 12 files changed, 102 insertions(+), 43 deletions(-) commit d1b9d9ea186c0135bd138f257e8f2cd051190df0 Author: Nathan Scott Date: Fri Dec 14 13:13:24 2012 +1100 Add NSS socket compression option in as well commit 3807452ecb53a2586a5c3a99e017fc24533610ec Author: Nathan Scott Date: Fri Dec 14 13:12:35 2012 +1100 Update QA filters for additional IPC diagnostics commit 3267f84b171efa91d633e5880d8e16ff00f62990 Author: Nathan Scott Date: Fri Dec 14 09:57:57 2012 +1100 Fix pmDupContext handling of context flags. Brain failure. From junwang123@gmail.com Fri Dec 14 00:24:45 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: *** X-Spam-Status: No, score=3.0 required=5.0 tests=BAYES_20,FREEMAIL_FROM, HTML_MESSAGE,T_DKIM_INVALID,T_TO_NO_BRKTS_FREEMAIL autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBE6Oiv3216833 for ; Fri, 14 Dec 2012 00:24:44 -0600 X-ASG-Debug-ID: 1355466434-04bdf02d4951bfd0001-S8gJnT Received: from mail-la0-f53.google.com (mail-la0-f53.google.com [209.85.215.53]) by cuda.sgi.com with ESMTP id 6ebeCWB2V1DYvT5s (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Thu, 13 Dec 2012 22:27:15 -0800 (PST) X-Barracuda-Envelope-From: junwang123@gmail.com X-Barracuda-Apparent-Source-IP: 209.85.215.53 X-Barracuda-IPDD: Level1 [gmail.com/209.85.215.53] Received: by mail-la0-f53.google.com with SMTP id w12so2407630lag.26 for ; Thu, 13 Dec 2012 22:27:14 -0800 (PST) X-Barracuda-IPDD: Level1 [gmail.com/209.85.215.53] X-Barracuda-IPDD: Level1 [gmail.com/209.85.215.53] DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=9iOa95YRodnH1TZUT24PGGP6J5JPIJsH6I+eC5KOBjs=; b=ihhPoql6cHuzLOYd4GlQ8SQBTyVHxkg/w1NXuj8RN01oMiTIxi0hnlU0R2zMCG2vAd NyJLTlgG0IuV1o055mbcac1xBcT79Me034h5kOC9oFgz47buHm7sqbh5n1idEQ8xlvKk mHHaE0RDx0ZE0DcwZOFPlPnW3yzPM9JWTkXQNYhNqvv2k4Sd6sWbce3c28Hecuu/5ZuC PUVVeSONuLnKbXyxkUJ4tLRaszEWT6oLw61zULMySqGMYrJ6Gmi8mzbQ1QvkonwH8nSp jpA8Z2Z+fx3X87MQ6HMXwBh5ZPIiDnNN+ShslwWALITkEvNM2Riyp70gu4JAO7yTm+ix is8A== MIME-Version: 1.0 Received: by 10.112.9.74 with SMTP id x10mr1884295lba.59.1355466434096; Thu, 13 Dec 2012 22:27:14 -0800 (PST) Received: by 10.112.22.162 with HTTP; Thu, 13 Dec 2012 22:27:14 -0800 (PST) Date: Thu, 13 Dec 2012 22:27:14 -0800 Message-ID: Subject: Can the monitor and the collector run on different platforms, Linux, Mac OS and Windows? From: Jun Wang X-ASG-Orig-Subj: Can the monitor and the collector run on different platforms, Linux, Mac OS and Windows? To: pcp@oss.sgi.com Content-Type: multipart/alternative; boundary=e0cb4efe307a4f2f2504d0ca1fbb X-Barracuda-Connect: mail-la0-f53.google.com[209.85.215.53] X-Barracuda-Start-Time: 1355466435 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED, HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116966 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 HTML_MESSAGE BODY: HTML included in message --e0cb4efe307a4f2f2504d0ca1fbb Content-Type: text/plain; charset=UTF-8 Folks, Can the monitoring software run on a different platform that the collector software runs? Here the platforms refer to Linux, Windows and Mac OS X and etc. For example, can we use the pmchart on the MacBook laptop running Mac OS X to monitor servers running Linux on which Linux version of the PCP collecting software, i.e. a PMCD and many PMDAs, runs to provide metrics? i.e. does PMAPI/libpcp supports cross-platform peers? This isn't explicitly mentioned in PCP FAQ and I didn't find an answer with Google search either. Thanks, Jun --e0cb4efe307a4f2f2504d0ca1fbb Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Folks,

Can the monitoring software run on a different platform that = the collector software runs? Here the platforms refer to Linux, Windows and= Mac OS X and etc.

For example, can we use the pmchart on the MacBoo= k laptop running Mac OS X to monitor servers running Linux on which Linux v= ersion of the PCP collecting software, i.e. a PMCD and many PMDAs, runs to = provide metrics? i.e. does PMAPI/libpcp supports cross-platform peers?

This isn't explicitly mentioned in PCP FAQ and I didn't find an= answer with Google search either.

Thanks,
Jun
--e0cb4efe307a4f2f2504d0ca1fbb-- From junwang123@gmail.com Fri Dec 14 03:51:01 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,FREEMAIL_FROM, MIME_QP_LONG_LINE,T_DKIM_INVALID autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBE9p1d7037105 for ; Fri, 14 Dec 2012 03:51:01 -0600 X-ASG-Debug-ID: 1355478813-04bdf02d48520550001-S8gJnT Received: from mail-da0-f53.google.com (mail-da0-f53.google.com [209.85.210.53]) by cuda.sgi.com with ESMTP id uut4hUgyImiOMFY3 (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Fri, 14 Dec 2012 01:53:33 -0800 (PST) X-Barracuda-Envelope-From: junwang123@gmail.com X-Barracuda-Apparent-Source-IP: 209.85.210.53 X-Barracuda-IPDD: Level1 [gmail.com/209.85.210.53] Received: by mail-da0-f53.google.com with SMTP id x6so1288081dac.26 for ; Fri, 14 Dec 2012 01:53:33 -0800 (PST) X-Barracuda-IPDD: Level1 [gmail.com/209.85.210.53] X-Barracuda-IPDD: Level1 [gmail.com/209.85.210.53] DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:from:content-type:x-mailer:message-id:date:to :content-transfer-encoding:mime-version; bh=WezX2Rwr7/I9Vi36PwAz+0w83wy9YZGb9BDvCZ73ocM=; b=CxPqErRpNsaEZ1wLEbsrkpJ/ydwjaI6nr71s+yL+NJlRVQmg74UynlxhxEFJKsG71J 05E7XrlnWKrjyEu2fbzu6TxN4WJEfuDgk59yNuVg8R8rgZGUz/9YK14SJzT1rMztEHQ5 tj8Tfu3OgJyGrIfRgv0DLfCUhMMf2Kiww5CHUpn6eSnBADIpz7GJts1eD6KhlAYBPnh9 SMpARHwX11JVoIOIKpJvJxaZAWl+JsNMfaxVXimQI5sYkwi3iSIuHdn7LOZStwLQYlTN B1zL2jzhtqP0HPdDU6tWY/toCTdPK8OrIIpDlfwlOK/veLkn3Yn8daxgr0x6PsfDVYf5 /PIw== Received: by 10.68.225.70 with SMTP id ri6mr14325692pbc.41.1355478812780; Fri, 14 Dec 2012 01:53:32 -0800 (PST) Received: from [192.168.1.104] (c-24-130-206-152.hsd1.ca.comcast.net. [24.130.206.152]) by mx.google.com with ESMTPS id gq10sm2670233pbc.54.2012.12.14.01.53.30 (version=SSLv3 cipher=OTHER); Fri, 14 Dec 2012 01:53:31 -0800 (PST) Subject: high frequency metrics collection and trace From: Jun Wang X-ASG-Orig-Subj: high frequency metrics collection and trace Content-Type: text/plain; charset=us-ascii X-Mailer: iPhone Mail (10A525) Message-Id: Date: Fri, 14 Dec 2012 01:53:29 -0800 To: PCP Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (1.0) X-Barracuda-Connect: mail-da0-f53.google.com[209.85.210.53] X-Barracuda-Start-Time: 1355478813 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.82 X-Barracuda-Spam-Status: No, SCORE=0.82 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED, MIME_QP_LONG_LINE, MIME_QP_LONG_LINE_2 X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116980 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 MIME_QP_LONG_LINE RAW: Quoted-printable line longer than 76 chars 0.82 MIME_QP_LONG_LINE_2 RAW: Quoted-printable line longer than 76 chars Folks, In terms of the add-hoc high frequency stats/metrics collection, do we have a known upper limit on the frequency to= collect and display the metrics? Can we sample every 100 milliseconds or wi= th even higher frequency?=20 What about tracing with trace PMDA? How fast can an instrumented application= push data through libpcp_trace? Is the PDU buffer size on the trace PMDA si= de configurable? =20 Does the PMAPI have to use fetch/pull to collect data with certain fixed fre= quency? I assume that PMCD cannot push data to the monitoring side via PMAPI= .=20 However, for the trace PMDA case, does it make sense to collect multiple sam= ples in the buffer, each with a different timestamp, and have the monitoring= tools on the other side, such as pmchart, to display multiple samples, per= every fetch/pull, based on the timestamp? Just a thought on one option to i= ncrease the sample frequency without increasing the fetch/pull frequency.=20= Thanks, Jun From junwang123@gmail.com Fri Dec 14 05:01:00 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,FREEMAIL_FROM, MIME_QP_LONG_LINE,T_DKIM_INVALID autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBEB105q045174 for ; Fri, 14 Dec 2012 05:01:00 -0600 X-ASG-Debug-ID: 1355483011-04cbb035a44f9c00001-S8gJnT Received: from mail-pb0-f53.google.com (mail-pb0-f53.google.com [209.85.160.53]) by cuda.sgi.com with ESMTP id pJV0M6U8XAxBJMY7 (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Fri, 14 Dec 2012 03:03:31 -0800 (PST) X-Barracuda-Envelope-From: junwang123@gmail.com X-Barracuda-Apparent-Source-IP: 209.85.160.53 X-Barracuda-IPDD: Level1 [gmail.com/209.85.160.53] Received: by mail-pb0-f53.google.com with SMTP id jt11so2142664pbb.26 for ; Fri, 14 Dec 2012 03:03:31 -0800 (PST) X-Barracuda-IPDD: Level1 [gmail.com/209.85.160.53] X-Barracuda-IPDD: Level1 [gmail.com/209.85.160.53] DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=references:mime-version:in-reply-to:content-type :content-transfer-encoding:message-id:cc:x-mailer:from:subject:date :to; bh=fuxfxwuRJq/lvP6MIFksv3QNBPs4Dcu9hTwYmEHX0/E=; b=AePkC7+xuTQv+D4h+AjY1i8ClNdOogWY+iM8NcTtx31np79chck6plKN2j0Onsek4V DLheYbHxBcbMsjDV03xe7vIr83yOUdmSsiIDdlUFJYOBhYue9/IScA+EIQuvh78G1QjD KRNDhg9mxLzny7UJVsKe3KlCs+Ea3RDzSRC/blb6zqRxYnFMDeBAGp9YIjQS747VR9kO XoVF2+e2uGS6qHTF6PvoIi8YS+wHeNtJqujW/+xotxYIfyWNp2/jXRAS/mLT+EUiJbX2 B7JOlZduci720jzUSUUyFg6iA5LrGJqKWHUBo7LOe/XqZehbphMziDG+DgGdJ70FNggh 4FxQ== Received: by 10.68.248.70 with SMTP id yk6mr14377774pbc.160.1355483011137; Fri, 14 Dec 2012 03:03:31 -0800 (PST) Received: from [192.168.1.104] (c-24-130-206-152.hsd1.ca.comcast.net. [24.130.206.152]) by mx.google.com with ESMTPS id j9sm3045467paw.2.2012.12.14.03.03.27 (version=SSLv3 cipher=OTHER); Fri, 14 Dec 2012 03:03:29 -0800 (PST) References: <903577094.42361781.1354847226756.JavaMail.root@redhat.com> Mime-Version: 1.0 (1.0) In-Reply-To: <903577094.42361781.1354847226756.JavaMail.root@redhat.com> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Message-Id: Cc: "pcp@oss.sgi.com" X-Mailer: iPhone Mail (10A525) From: Jun Wang Subject: Re: [pcp] Qn on supporting metrics from multiple hosts in pmstat, pmchart and pmie tools Date: Fri, 14 Dec 2012 03:03:26 -0800 X-ASG-Orig-Subj: Re: [pcp] Qn on supporting metrics from multiple hosts in pmstat, pmchart and pmie tools To: Nathan Scott X-Barracuda-Connect: mail-pb0-f53.google.com[209.85.160.53] X-Barracuda-Start-Time: 1355483011 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.82 X-Barracuda-Spam-Status: No, SCORE=0.82 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED, MIME_QP_LONG_LINE, MIME_QP_LONG_LINE_2 X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.116984 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 MIME_QP_LONG_LINE RAW: Quoted-printable line longer than 76 chars 0.82 MIME_QP_LONG_LINE_2 RAW: Quoted-printable line longer than 76 chars Nathan, Thanks for the great and detailed explanation on the multi-host support.=20 I assume that pmchart can graph individual metrics, collected from multiple h= osts separately, over time series, though it isn't designed to graph the ave= rage/sum/etc of those metrics, collected on a multiple host, over time seri= es. Is there any other way, or workaround, that can be used for PCP to grap= h the average/sum/etc of a metrics across multiple, in 100s for example, of h= osts? Can summary PMDA be used for that? I noticed a summary PMDA process, together with a pmie daemon, that can do e= xpression of multiple metrics.=20 At first, for a single collector host, this means the following steps, all o= n the collector host except for the last step, based on my understanding.=20= * metrics foo.X is collected by PMDA foo; * metrics bar.Y is collected by PMDA bar; * the pmie daemon talks to PMCD and get metrics foo.X and metrics bar.Y vi= a the corresponding PMDAs, then use both of them to calculate metrics summay= .Z. * the summary PMDA talks to pmie daemon periodically and fetch summary.Z; * the monitoring tools retrieve summary.Z from PMCD, and summary PMDA, via= PMAPI and graph it.=20 Does PMCD cache the metrics foo.X and bar.Y? or does PMCD run completely sta= teless without caching any metrics? I think that PMCD shouldn't cache any me= trics. That, however, means that time-wise the summary metrics is always run= ning a step, or a sampling period, behind the foo.X and bar.Y as it uses the= values of X and Y at the last time when the pmie talks to PMCD.=20 Secondly, can summary PMDA be used to do sum/avg across multiple hosts? Say w= e run a pmie process on a server and have it talk to PMCDs on multiple hosts= to collect h1:foo.X, h2:foo.X, h3:foo.X and ... and calculate the value of t= he expression. Then we also run summary PMDA and a PMCD on this server and h= ave the summary PMDA talks to the pmie process to collect the the of summar= y.FOO-X metrics. Now we can have any PCP monitor tools to, either remotely o= r locally, graph or analyze the sum/avg/etc of foo.X across multiple hosts.=20= Does this make sense? Thanks, Jun On Dec 6, 2012, at 6:27 PM, Nathan Scott wrote: > Hi Jun, >=20 > ----- Original Message ----- >>=20 >> Hi PCP Folks, >>=20 >> Being a newbie on PCP, I have questions on monitoring metrics from >> multiple collector hosts. On the monitoring side, with tools like >> pmchart, pmie and pmstat, what's the strategy to monitor metrics >> from multiple collector nodes? To my understanding, each pmcd, >> together with the corresponding pmdas, runs and manages one >> collector node. >=20 > That's correct. >=20 >> I'm reading PCP on Linux user's guide on >> http://www.damtp.cam.ac.uk/cosmos/private/documentation/SGI/propack/PCP_L= inuxUAG/pdf/PCP_LinuxUAG.pdf >> . >>=20 >> pmstat has an option -H which allows users to specify multiple hosts. >> I verifies that it does print out stats from multiple hosts, one >> after the other when hosts are specified with -H. >=20 > *nod*. You can also use multiple -h options on the command line to > pmstat, which results in an extra initial column showing the node: >=20 > $ pmstat -h smash -h verge -t 1 > @ Fri Dec 7 13:13:04 2012 > node loadavg memory swap io system = cpu > 1 min swpd buff cache pi po bi bo in cs us sy = id > smash 1.45 0 4015m 8746m 0 0 0 0 493 1246 0 1= 99 > verge 0.30 0 404512 2213m 0 0 0 0 291 358 1 1= 98 > smash 1.45 0 4025m 8746m 0 0 0 0 575 1471 1 0= 99 > verge 0.30 0 404648 2213m 0 0 0 0 264 296 2 1= 97 >=20 >> pmie has an -h option which allow users to specify only one host to >> monitor. >=20 > Strictly speaking, that specifies the default host. Others can > be specified directly, in the pmie language, for individual rules > or parts of rules. For rules with no host explicitly specified, > the default is used. If no default is specified, localhost will > be used. >=20 >> However, it appears that hosts can also be specified in the >> pmie specification language to create per-host and cross-host rules. >=20 > That's right. >=20 >> Does this implicitly trigger the communication between pmie and the >> pmcd(s) on the corresponding hosts that are specified in the pmie >> spec language? >=20 > Yes. >=20 >> On the other hand, there appears to be discussions on >> starting one pmie, on the monitor side, for each collector host. >> What's the recommended approach? >=20 > Whatever works best for you. I've seen production deployments where > either, and both strategies have been used. >=20 >> pmchart also has an -h option allowing users to specify only one host >=20 > Like with pmie before, that's for the default host(s). And like with > pmstat, you can give multiple -h options. >=20 >> to monitor. However, there are discussions on hosts in the pmchart >> man page and it is claimed that pmchart can display metrics from >> multiple hosts. How do I specify those hosts? Is it available on the >> menu of the GUI? What's the relation between those hosts and the >> ONLY host specified with -h option? >=20 > Using this as a guide: > http://oss.sgi.com/projects/pcp/pcp-gui.git/man/html/lab.pmchart.html > (from the PCP Manual link on the bottm left of the PCP project page) >=20 > On the third screenshot (Open View) there's a "Host:" drop down, and > a new host button between Open and Cancel. The drop down menu will > contain all hosts seen so far (so, all -h options, and any hostnames > entered via the UI). The new host button pops up another window that > will allow you to enter additional host names. >=20 > FWIW, when running in "archive mode" (historical data), the UI is all > the same, except instead of "Hosts:" the user can enter additional PCP > archives from which historical data is sourced. The archives have a > one-to-one mapping with hosts (i.e. an archive records data from one > host and one host only). >=20 > If you scroll further down the above URL to the sixth screenshot, you > will see another Host button on the New Chart window - that has the > same effect as the new host button on the Open View window earlier. >=20 >> Also, if I define a new metrics domain on a collector, a new PMDA and >> new configuration line(s) in pmcd to enable it, how do I make it >> available to be selected from pmchart menu? What about multiple >=20 > As soon as the PMDA is installed (via its Install script, usually), > its metrics become immediately available in the client tools like > pmchart, with no other intervention required (client tools do auto- > discovery via the metric names and their associated metadata). >=20 >> metrics domains on multiple collector hosts? Can they be displayed >> with one pmchart application but multiple views on the monitor side? >=20 > Yes. It's even possible in pmchart to have a single chart that has > individual plots from different hosts. >=20 > Good questions! :) The PCP man pages are extensive too - so on any > host that you've installed pcp and pcp-gui on, you will also be able > to browse through: >=20 > $ man pmstat > $ man pmie > $ man pmchart > $ man pmcd >=20 > Several of the command line option (e.g. time window specification, for > archives) are also documented on the PCPIntro man page, might be of use > too. Enjoy! >=20 > cheers. >=20 > -- > Nathan From kenj@internode.on.net Fri Dec 14 15:58:40 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,J_CHICKENPOX_44 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBELwepa180428 for ; Fri, 14 Dec 2012 15:58:40 -0600 X-ASG-Debug-ID: 1355522471-04cbb035a45138e0001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id CRVUq4oei5LhHTU5 for ; Fri, 14 Dec 2012 14:01:11 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AuUgAGOgy1ABm1+0PGdsb2JhbAANOIY6hDq0LQMBAQEBOIJSAQEBAwEjVgULCw0LAgImAgJDFAaIIKkucJMBgSKLSoMbgRMDnBaNQoFQ Received: from unknown (HELO [10.230.68.255]) ([1.155.95.180]) by ipmail07.adl2.internode.on.net with ESMTP; 15 Dec 2012 08:31:09 +1030 Message-ID: <1355522469.5399.54.camel@bozo-laptop.localdomain> Subject: Re: [pcp] Qn on supporting metrics from multiple hosts in pmstat, pmchart and pmie tools From: Ken McDonell X-ASG-Orig-Subj: Re: [pcp] Qn on supporting metrics from multiple hosts in pmstat, pmchart and pmie tools To: Jun Wang Cc: Nathan Scott , "pcp@oss.sgi.com" Date: Sat, 15 Dec 2012 09:01:09 +1100 In-Reply-To: References: <903577094.42361781.1354847226756.JavaMail.root@redhat.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1355522471 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117024 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On Fri, 2012-12-14 at 03:03 -0800, Jun Wang wrote: > Nathan, > > Thanks for the great and detailed explanation on the multi-host > support. > > I assume that pmchart ... isn't designed to graph the average/sum/etc > of those metrics, collected on a multiple host, over time series. Correct. > Is there any other way, or workaround, that can be used for PCP to > graph the average/sum/etc of a metrics across multiple, in 100s for > example, of hosts? Derived metrics (see the pmRegisterDerived(3) man page) provide a way of doing customized aggregation for metrics ... unfortunately this is limited to metrics from a single source (host or archive). > Can summary PMDA be used for that? It can indeed. A fragment of pmie suitable for use with the summary PMDA and a 4 node cluster is as follows: hosts = ":node1 :node2 :node3 :node4"; summary.ncpu.sum = sum_host hinv.ncpu $hosts; summary.ncpu.avg = avg_host hinv.ncpu $hosts; summary.ncpu.max = max_host hinv.ncpu $hosts; Now, this is untested (to my knowledge) for hundreds of nodes, so it would be interesting to see if it works. One issue here may be that pmie cannot evaluate sum_host() (or any of the other *_host() aggregates) if pmcd cannot be contacted on _any_ of the listed hosts. We don't have anything that I can think of that will handle the "average" of a metric across N available hosts from a pool of M possible hosts (for N <= M). > I noticed a summary PMDA process, together with a pmie daemon, that > can do expression of multiple metrics. Yep. > At first, for a single collector host, this means the following steps, > all on the collector host except for the last step, based on my > understanding. > * metrics foo.X is collected by PMDA foo; > * metrics bar.Y is collected by PMDA bar; > * the pmie daemon talks to PMCD and get metrics foo.X and metrics > bar.Y via the corresponding PMDAs, then use both of them to calculate > metrics summay.Z. > * the summary PMDA talks to pmie daemon periodically and fetch > summary.Z; > * the monitoring tools retrieve summary.Z from PMCD, and summary > PMDA, via PMAPI and graph it. All sounds pretty correct to me. The summary PMDA does not have to be on the same host as the one providing the foo.X and bar.Y metrics ... although this is commonly the case for the single host deployment, it won't/can't be the case for the hundreds of nodes case. > Does PMCD cache the metrics foo.X and bar.Y? or does PMCD run > completely stateless without caching any metrics? I think that PMCD > shouldn't cache any metrics. That, however, means that time-wise the > summary metrics is always running a step, or a sampling period, behind > the foo.X and bar.Y as it uses the values of X and Y at the last time > when the pmie talks to PMCD. There is no data cacheing in pmcd ... that is a deliberate and important design decision. And indeed there is very little client state maintained by pmcd. The summary PMDA is operating on a (usually) constant timing loop, evaluating _all_ the expressions it has been asked to support every N seconds. When pmcd asks the summary PMDA for metric values, the summay PMDA returns the most recently evaluated expression results. So there is indeed a lag ... but if you're talking about hundreds of nodes then any lag is unlikely to be an issue in practice ... this system would have the response time of a Titanic-sized ship, statistical dampening across a large data set will mask individual changes and Heisenberg is always confusing the issue. > Secondly, can summary PMDA be used to do sum/avg across multiple > hosts? Say we run a pmie process on a server and have it talk to PMCDs > on multiple hosts to collect h1:foo.X, h2:foo.X, h3:foo.X and ... and > calculate the value of the expression. Then we also run summary PMDA > and a PMCD on this server and have the summary PMDA talks to the pmie > process to collect the the of summary.FOO-X metrics. Now we can have > any PCP monitor tools to, either remotely or locally, graph or analyze > the sum/avg/etc of foo.X across multiple hosts. Yes this will all work, subject to my earlier comments on moving in uncharted waters and the "one host down" Achilles heel. One thing to consider is the timing loop used by the summary PMDA ... making this short increases the load on all nodes, especially where the summary PMDA is running. Making it longer decreases the load, but increases the lag between changes happening and being exported in the summary metrics. Consider you're likely sampling interval from pmchart and pmlogger and friends and tune the summary PMDA sampling interval to be about the same. > Does this make sense? Yep and good luck ... please let us know how it turns out. From kenj@internode.on.net Fri Dec 14 16:07:53 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBEM7rci180973 for ; Fri, 14 Dec 2012 16:07:53 -0600 X-ASG-Debug-ID: 1355523024-04cbb035a5513b90001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id OconN7uNGCrSK0Wk for ; Fri, 14 Dec 2012 14:10:25 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AuUgALeiy1ABm1+0PGdsb2JhbAANOIY6hDq0LgMBAQEBOIJSAQEBAwEjVgULCw0LAgImAgJDFAaIIKkvcJMDgSKLS4MagRMDnBaNQoFR Received: from unknown (HELO [10.230.68.255]) ([1.155.95.180]) by ipmail07.adl2.internode.on.net with ESMTP; 15 Dec 2012 08:40:24 +1030 Message-ID: <1355523024.5399.62.camel@bozo-laptop.localdomain> Subject: Re: [pcp] high frequency metrics collection and trace From: Ken McDonell X-ASG-Orig-Subj: Re: [pcp] high frequency metrics collection and trace To: Jun Wang Cc: PCP Date: Sat, 15 Dec 2012 09:10:24 +1100 In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1355523024 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117024 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On Fri, 2012-12-14 at 01:53 -0800, Jun Wang wrote: > Folks, > > In terms of the add-hoc high frequency > stats/metrics collection, do we have a known upper limit on the > frequency to collect and display the metrics? Can we sample every 100 > milliseconds or with even higher frequency? This is a "length of the piece of string" question ... not all metrics have equal cost to instantiate (collect), not all fetches return the same number of metrics and values and not all CPUs are the same speed. Sampling in the 100's of msec range is certainly feasible for many combinations. > What about tracing with trace PMDA? How fast can an instrumented > application push data through libpcp_trace? Is the PDU buffer size on > the trace PMDA side configurable? The trace PMDA was never intended for high frequency sampling (annotation of bash scripts is a common use), so I would not consider this for high throughput. More interesting would be the relatively recent PMAPI extensions for event records ... Nathan can probably expand on this better than I. > Does the PMAPI have to use fetch/pull to collect data with certain > fixed frequency? I assume that PMCD cannot push data to the monitoring > side via PMAPI. There is very little client state maintained at pmcd, so clients are free to fetch at whatever frequency they desire and indeed pmlogger and pmie collect different groups of metrics at different frequencies. Pushing from pmcd is nver going to happen (this is not an SNMP trap model!). > However, for the trace PMDA case, does it make sense to collect > multiple samples in the buffer, each with a different timestamp, and > have the monitoring tools on the other side, such as pmchart, to > display multiple samples, per every fetch/pull, based on the > timestamp? Just a thought on one option to increase the sample > frequency without increasing the fetch/pull frequency. The event record services address just this issue. Individual event records are timestamped, even though a group of them are delivered in a batch to the PMAPI client. From nscott@redhat.com Fri Dec 14 17:46:59 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBENkx7j208484 for ; Fri, 14 Dec 2012 17:46:59 -0600 X-ASG-Debug-ID: 1355528971-04cbb035a6515300001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id egDOMw2YCgder0yq for ; Fri, 14 Dec 2012 15:49:32 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBENnU6F000886; Fri, 14 Dec 2012 18:49:30 -0500 Date: Fri, 14 Dec 2012 18:49:30 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Jun Wang Cc: pcp@oss.sgi.com Message-ID: <328883363.49755120.1355528970770.JavaMail.root@redhat.com> In-Reply-To: Subject: Re: [pcp] Can the monitor and the collector run on different platforms, Linux, Mac OS and Windows? MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Can the monitor and the collector run on different platforms, Linux, Mac OS and Windows? Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.161] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1355528971 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117032 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi Jun, ----- Original Message ----- > > Folks, > > Can the monitoring software run on a different platform that the > collector software runs? Here the platforms refer to Linux, Windows > and Mac OS X and etc. > Yes. Both the wire protocol and the on-disk format for PCP archives are platform neutral. This includes 32/64 bit variants of the same platforms, different distributions, etc, etc. In an amusing extreme case, the PCP testsuite contains PCP archives created on MIPS/IRIX in early 1995 which can still be replayed with the current tools. $ pmdumplog -l qa/src/babylon.percpu_v2.0 Log Label (Log Format Version 2) Performance metrics from host babylon commencing Wed Jan 11 17:50:50.990 1995 ending Wed Jan 11 17:56:47.996 1995 > For example, can we use the pmchart on the MacBook laptop running Mac > OS X to monitor servers running Linux on which Linux version of the > PCP collecting software, i.e. a PMCD and many PMDAs, runs to provide > metrics? i.e. does PMAPI/libpcp supports cross-platform peers? Yes. In a previous workplace, we routinely monitored remote Linux and Windows production servers from Mac, Windows and Linux desktops. Its considered a development requirement for us PCP devs that this will always work. > This isn't explicitly mentioned in PCP FAQ and I didn't find an > answer with Google search either. It should be in the FAQ I guess, its a big selling point over some other comparable tools like sar. cheers. -- Nathan From kenj@internode.on.net Sat Dec 15 13:41:27 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBFJfR1G116449 for ; Sat, 15 Dec 2012 13:41:27 -0600 X-ASG-Debug-ID: 1355600639-04cb6c05a654c600001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id VJrDB9sM2WL8X7ut for ; Sat, 15 Dec 2012 11:44:00 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ArYgAH7RzFABm1+0PGdsb2JhbAANOIY7hDqzdAMBAQEBOIJSAQEBAwEjVgULCw0NAiYCAkMUBoggqBNwkieBIo5rgRMDnBeNQg Received: from unknown (HELO [10.230.68.255]) ([1.155.95.180]) by ipmail06.adl6.internode.on.net with ESMTP; 16 Dec 2012 06:13:57 +1030 Message-ID: <1355600643.5399.84.camel@bozo-laptop.localdomain> Subject: Re: pcp updates - compilation warning and configuration files in packaging From: Ken McDonell X-ASG-Orig-Subj: Re: pcp updates - compilation warning and configuration files in packaging To: "Frank Ch. Eigler" Cc: pcp@oss.sgi.com Date: Sun, 16 Dec 2012 06:44:03 +1100 In-Reply-To: <20121125220602.GE32625@redhat.com> References: <1353702995.2573.10.camel@bozo-laptop.localdomain> <1353787979.2573.43.camel@bozo-laptop.localdomain> <20121125020818.GC32625@redhat.com> <1353873879.2573.65.camel@bozo-laptop.localdomain> <20121125220602.GE32625@redhat.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1355600639 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117108 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header I'm back considering this change ... OPTION A Introduce $PCP_SYSCONF_DIR to expose $sysconfdir via pcp.conf and then move everything currently below $PCP_VAR_DIR/config/ to $PCP_SYSCONF_DIR/. and ... On Sun, 2012-11-25 at 17:06 -0500, Frank Ch. Eigler wrote: > One tricky aspect could require some packaging scripting, that being > the migration of config files from the old to the new locations. I have two questions for the gallery ... 1. Should the default setting for $PCP_SYSCONF_DIR be /etc or /etc/pcp. The former would lead to a bunch of dirs in /etc, e.g. /etc/pmcd, /etc/pmlogger, /etc/pmie ... The latter would aggregate all the PCP config files below /etc/pcp, so we'd have directories like /etc/pcp/pmcd, /etc/pcp/pmlogger, /etc/pcp/pmie ... I prefer collecting all these directories below /etc/pcp and minimizing the name pollution (and possible collisions) in /etc. 2. Just how should the migration work? My initial thought is that as a _pre_ install task we ... For each config directory in the current package consider the list if directories where we've hidden the equivalent config files in the past (but not the current config directory) ... so if we're setting up /etc/pcp/pmcd we'd consider /var/lib/pcp/config/pmcd and /etc/pmcd and /etc/sysconfig/pmcd For each file in each of these directories do the following: - if the file is not in the new directory, copy it into the new directory, else if the file is _newer_ (more recently modified) than the file in the new directory, copy it to the new directory - delete the file from the old directory Try to delete the old directory. The idea is (a) to get the latest version into the place where the installation is going to happen so it will be replaced or shuffled around if modified config files are being saved/kept and (b) clean up some of the mess we've left behind in the past. Thoughts? From fche@redhat.com Sat Dec 15 20:54:23 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBG2sNQr202849 for ; Sat, 15 Dec 2012 20:54:23 -0600 X-ASG-Debug-ID: 1355626616-04cbb035a6549ac0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id DUDQe2sWcgNpfFj2 for ; Sat, 15 Dec 2012 18:56:57 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx12.intmail.prod.int.phx2.redhat.com (int-mx12.intmail.prod.int.phx2.redhat.com [10.5.11.25]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id qBG2uqgP019389 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Sat, 15 Dec 2012 21:56:52 -0500 Received: from fche.csb (vpn-8-223.rdu.redhat.com [10.11.8.223]) by int-mx12.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id qBG2upVR028494; Sat, 15 Dec 2012 21:56:51 -0500 Received: by fche.csb (Postfix, from userid 2569) id 1CD385815C; Sat, 15 Dec 2012 21:56:46 -0500 (EST) To: Ken McDonell Cc: Jun Wang , PCP Subject: Re: high frequency metrics collection and trace References: <1355523024.5399.62.camel@bozo-laptop.localdomain> X-ASG-Orig-Subj: Re: high frequency metrics collection and trace From: fche@redhat.com (Frank Ch. Eigler) Date: Sat, 15 Dec 2012 21:56:46 -0500 In-Reply-To: <1355523024.5399.62.camel@bozo-laptop.localdomain> (Ken McDonell's message of "Sat, 15 Dec 2012 09:10:24 +1100") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.25 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1355626617 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com Hi, Ken - kenj wrote: > [...] >> Does the PMAPI have to use fetch/pull to collect data with certain >> fixed frequency? I assume that PMCD cannot push data to the monitoring >> side via PMAPI. > > There is very little client state maintained at pmcd, so clients are > free to fetch at whatever frequency they desire and indeed pmlogger and > pmie collect different groups of metrics at different frequencies. > > Pushing from pmcd is nver going to happen (this is not an SNMP trap > model!). Might it make sense to add a repeated-pmFetch type of operation to the wire protocol at some point? Imagine if the latency/throughput overhead of requesting the same data metrics over and over again becomes noticeable? (From a brief tcpdump experiment, pmval request traffic is almost as large as pmcd response.) - FChE From fche@redhat.com Sun Dec 16 10:36:41 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBGGafXk259993 for ; Sun, 16 Dec 2012 10:36:41 -0600 X-ASG-Debug-ID: 1355675955-04bdf02d4b59b410001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id B2r2W3FTF4FOsro2 for ; Sun, 16 Dec 2012 08:39:15 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx01.intmail.prod.int.phx2.redhat.com (int-mx01.intmail.prod.int.phx2.redhat.com [10.5.11.11]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id qBGGdBui003396 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Sun, 16 Dec 2012 11:39:11 -0500 Received: from fche.csb (vpn-8-223.rdu.redhat.com [10.11.8.223]) by int-mx01.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBGGdA8G006100; Sun, 16 Dec 2012 11:39:11 -0500 Received: by fche.csb (Postfix, from userid 2569) id 5E8A458154; Sun, 16 Dec 2012 11:39:10 -0500 (EST) To: Ken McDonell Cc: pcp@oss.sgi.com Subject: Re: pcp updates - compilation warning and configuration files in packaging References: <1353702995.2573.10.camel@bozo-laptop.localdomain> <1353787979.2573.43.camel@bozo-laptop.localdomain> <20121125020818.GC32625@redhat.com> <1353873879.2573.65.camel@bozo-laptop.localdomain> <20121125220602.GE32625@redhat.com> <1355600643.5399.84.camel@bozo-laptop.localdomain> X-ASG-Orig-Subj: Re: pcp updates - compilation warning and configuration files in packaging From: fche@redhat.com (Frank Ch. Eigler) Date: Sun, 16 Dec 2012 11:39:10 -0500 In-Reply-To: <1355600643.5399.84.camel@bozo-laptop.localdomain> (Ken McDonell's message of "Sun, 16 Dec 2012 06:44:03 +1100") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.67 on 10.5.11.11 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1355675955 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com Hi, Ken - kenj wrote: > [...] > I have two questions for the gallery ... Peanut Gallery present and fully charged, Sir! > 1. Should the default setting for $PCP_SYSCONF_DIR be /etc or /etc/pcp. > [...] > I prefer collecting all these directories below /etc/pcp and minimizing > the name pollution (and possible collisions) in /etc. Agreed. > 2. Just how should the migration work? My initial thought is that as a > _pre_ install task we ... > [...] > [copy-update old-config-dir files to the new-config-dir] > [...] Sure. > Try to delete the old directory. I suggest *not* deleting anything explicitly, the same way as a make-install doesn't delete previous versions of files/libraries. Instead, rely on the packaging system's normal uninstall facilities, applied to the previous package to get rid of the old stuff. (Our src/GNUmakefiles don't have an uninstall target; they probably should.) - FChE From nscott@redhat.com Sun Dec 16 17:24:39 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.7 required=5.0 tests=BAYES_00,J_CHICKENPOX_33, J_CHICKENPOX_44 autolearn=no version=3.4.0-r929098 Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBGNOdIs027137 for ; Sun, 16 Dec 2012 17:24:39 -0600 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id BBD6130404E for ; Sun, 16 Dec 2012 15:27:14 -0800 (PST) X-ASG-Debug-ID: 1355700430-04bdf0430f05c00001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id IqC2UE5EwJpAjrJH for ; Sun, 16 Dec 2012 15:27:10 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBGNR64b001523; Sun, 16 Dec 2012 18:27:06 -0500 Date: Sun, 16 Dec 2012 18:27:06 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <602668854.52907932.1355700426206.JavaMail.root@redhat.com> In-Reply-To: <1452036590.49275961.1355447047230.JavaMail.root@redhat.com> Subject: Re: [pcp] pcp updates - pmie, qa, non-root fallout MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pcp updates - pmie, qa, non-root fallout Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.192] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1355700430 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117214 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- ----- Original Message ----- > ... > > If it is not 1777, then I suspect it could possibly be 755 and > > _owned_ > > by the user pcp ... I changed it by hand post-install to be thus > > and > > pmcd starts (with a bunch of root owned log files therein) and > > qa/255 > > passes. Would that be any less sucky for lintian and any of the > > other packaging pixies? > > Isn't that what the packaging does though? debian/pcp.postinst has > chown -R pcp:pcp /var/log/pcp/pmcd 2>/dev/null || true > > How did it become root:root again? I just went and manually modified an existing Debian install to have the old root:root permissions for /var/log/pcp/pmcd (and all files below that) and verified that the packaging script do set this to pcp:pcp at the end of the install, as hoped/expected. So, either these were somehow not run for you (?) or else something (maybe qa? i've not observed that happen here though) has gone and changed the permissions behind your back after install? cheers. -- Nathan From nscott@redhat.com Sun Dec 16 17:49:16 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBGNnGWU029599 for ; Sun, 16 Dec 2012 17:49:16 -0600 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 8C872304039 for ; Sun, 16 Dec 2012 15:51:51 -0800 (PST) X-ASG-Debug-ID: 1355701910-04bdf0431106ad0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id D2u2WHyQoltqDRDi for ; Sun, 16 Dec 2012 15:51:50 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBGNpjlA019833; Sun, 16 Dec 2012 18:51:45 -0500 Date: Sun, 16 Dec 2012 18:51:45 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com, "Frank Ch. Eigler" Message-ID: <1515576420.52914610.1355701905430.JavaMail.root@redhat.com> In-Reply-To: <1355600643.5399.84.camel@bozo-laptop.localdomain> Subject: Re: [pcp] pcp updates - compilation warning and configuration files in packaging MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pcp updates - compilation warning and configuration files in packaging Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.192] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1355701910 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117216 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- ----- Original Message ----- > I'm back considering this change ... > > OPTION A > > Introduce $PCP_SYSCONF_DIR to expose $sysconfdir via pcp.conf > and then move everything currently below > $PCP_VAR_DIR/config/ to > $PCP_SYSCONF_DIR/. > > and ... > > On Sun, 2012-11-25 at 17:06 -0500, Frank Ch. Eigler wrote: > > > One tricky aspect could require some packaging scripting, that > > being > > the migration of config files from the old to the new locations. > > I have two questions for the gallery ... > > 1. Should the default setting for $PCP_SYSCONF_DIR be /etc or > /etc/pcp. > The former would lead to a bunch of dirs in /etc, > e.g. /etc/pmcd, /etc/pmlogger, /etc/pmie ... The latter would > aggregate > all the PCP config files below /etc/pcp, so we'd have directories > like /etc/pcp/pmcd, /etc/pcp/pmlogger, /etc/pcp/pmie ... > > I prefer collecting all these directories below /etc/pcp and > minimizing > the name pollution (and possible collisions) in /etc. > Sounds good to me. FWIW, Debian policy docs state: (http://www.debian.org/doc/debian-policy/ch-files.html) 10.7.2 Location Any configuration files created or used by your package must reside in /etc. If there are several, consider creating a subdirectory of /etc named after your package. If your package creates or uses configuration files outside of /etc, and it is not feasible to modify the package to use /etc directly, put the files in /etc and create symbolic links to those files from the location that the package requires. So, /etc/pcp/* sounds fine to me, and we don't need to go for symlinks since we can set the direction to wherever we like. I guess you might consider symlinks from the old location to the new if you're concerned about fallout from a move (rather than removing the old path entirely). But personally I think a clean cutover is best for the long-term. cheers. -- Nathan From kenj@internode.on.net Sun Dec 16 20:03:56 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.7 required=5.0 tests=BAYES_00,J_CHICKENPOX_33, J_CHICKENPOX_44 autolearn=no version=3.4.0-r929098 Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBH23uo0034704 for ; Sun, 16 Dec 2012 20:03:56 -0600 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 32606304048 for ; Sun, 16 Dec 2012 18:06:31 -0800 (PST) X-ASG-Debug-ID: 1355709985-04bdf043110ca50001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id jlMWjpUf83mlr0pD for ; Sun, 16 Dec 2012 18:06:26 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApMBADR9zlB20TUh/2dsb2JhbAANOIY7uCGDEQEBAQMBI1YFCwsaAiYCAlcGiCCmPnCRdYEijmuBEwOWCpNP Received: from ppp118-209-53-33.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.53.33]) by ipmail06.adl2.internode.on.net with ESMTP; 17 Dec 2012 12:36:25 +1030 Message-ID: <1355710076.3857.2.camel@bozo.localdomain> Subject: Re: [pcp] pcp updates - pmie, qa, non-root fallout From: Ken McDonell X-ASG-Orig-Subj: Re: [pcp] pcp updates - pmie, qa, non-root fallout To: Nathan Scott Cc: pcp@oss.sgi.com Date: Mon, 17 Dec 2012 13:07:56 +1100 In-Reply-To: <602668854.52907932.1355700426206.JavaMail.root@redhat.com> References: <602668854.52907932.1355700426206.JavaMail.root@redhat.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1355709985 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117224 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On Sun, 2012-12-16 at 18:27 -0500, Nathan Scott wrote: > I just went and manually modified an existing Debian install to have > the old root:root permissions for /var/log/pcp/pmcd (and all files > below that) and verified that the packaging script do set this to > pcp:pcp at the end of the install, as hoped/expected. > > So, either these were somehow not run for you (?) or else something > (maybe qa? i've not observed that happen here though) has gone and > changed the permissions behind your back after install? Thanks for chasing this up Nathan. I suspect (but cannot prove) that I ran sudo make install and that would have caused the problem ... we don't (and can't) set the ownership of files to pcp in the makefiles, but it is done in the package scripts, so make install is not the same a package install in this respect. From junwang123@gmail.com Mon Dec 17 11:20:19 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: * X-Spam-Status: No, score=1.1 required=5.0 tests=BAYES_00,FREEMAIL_FROM, HTML_MESSAGE,T_DKIM_INVALID autolearn=no version=3.4.0-r929098 Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBHHKJxL127078 for ; Mon, 17 Dec 2012 11:20:19 -0600 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id E23EF8F8064 for ; Mon, 17 Dec 2012 09:22:51 -0800 (PST) X-ASG-Debug-ID: 1355764969-04cb6c05a65bc5b0001-S8gJnT Received: from mail-lb0-f181.google.com (mail-lb0-f181.google.com [209.85.217.181]) by cuda.sgi.com with ESMTP id H16pxqAOa2syLh7B (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Mon, 17 Dec 2012 09:22:50 -0800 (PST) X-Barracuda-Envelope-From: junwang123@gmail.com X-Barracuda-Apparent-Source-IP: 209.85.217.181 X-Barracuda-IPDD: Level1 [gmail.com/209.85.217.181] Received: by mail-lb0-f181.google.com with SMTP id ge1so4828578lbb.26 for ; Mon, 17 Dec 2012 09:22:49 -0800 (PST) X-Barracuda-IPDD: Level1 [gmail.com/209.85.217.181] X-Barracuda-IPDD: Level1 [gmail.com/209.85.217.181] DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=cHAHQo0fKTbjOK/CFUz7ZzfA3bXIjpR+IYB9y/hHYR4=; b=yZ4Huw7ZBckCitgbUtc1vnrUxdDC8JnY434JdcWNJi4Zad1yC3BzavJzGc3QmSQ6zG qNenrlCykLeWi1zug0Ap/2z51UCcGME5AwggLwF/AV+CvJaUCv3gxKHUicr5r1KXpn3i reaUx8Ap/dNu6oghtRB0LmHp9J2NwRPC1msqQ1lcBNUwmXh6ZEnvQnJdcSpkzMEvZblt QkLTC/j6k5HxDKL0+JmKvpe/ZNR7Hy3WuPQzIoo6nFwK8R0HjHRP8VJSh4ae6gmjgdjq nD3Gmook8t6eRCrJWFUChS8SNENv8S0sxk/QaQldik1udJtuWyfg7bqdDuLcY/1AgHkK t8ag== MIME-Version: 1.0 Received: by 10.152.106.163 with SMTP id gv3mr9723610lab.55.1355764968977; Mon, 17 Dec 2012 09:22:48 -0800 (PST) Received: by 10.112.22.162 with HTTP; Mon, 17 Dec 2012 09:22:48 -0800 (PST) In-Reply-To: <1355523024.5399.62.camel@bozo-laptop.localdomain> References: <1355523024.5399.62.camel@bozo-laptop.localdomain> Date: Mon, 17 Dec 2012 09:22:48 -0800 Message-ID: Subject: Re: [pcp] high frequency metrics collection and trace From: Jun Wang X-ASG-Orig-Subj: Re: [pcp] high frequency metrics collection and trace To: Ken McDonell Cc: PCP Content-Type: multipart/alternative; boundary=f46d04083aad5ff6d504d10fa174 X-Barracuda-Connect: mail-lb0-f181.google.com[209.85.217.181] X-Barracuda-Start-Time: 1355764970 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED, HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117284 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 HTML_MESSAGE BODY: HTML included in message --f46d04083aad5ff6d504d10fa174 Content-Type: text/plain; charset=UTF-8 Hi Ken, Thanks a lot for the information. Any information on the event record service? Is it related to the "Event Logging" on the following link at all? http://oss.sgi.com/projects/pcp/pcp-gui.git/man/html/howto.systemlog.html Thanks, Jun On Fri, Dec 14, 2012 at 2:10 PM, Ken McDonell wrote: > On Fri, 2012-12-14 at 01:53 -0800, Jun Wang wrote: > > Folks, > > > > In terms of the add-hoc high frequency > > stats/metrics collection, do we have a known upper limit on the > > frequency to collect and display the metrics? Can we sample every 100 > > milliseconds or with even higher frequency? > > This is a "length of the piece of string" question ... not all metrics > have equal cost to instantiate (collect), not all fetches return the > same number of metrics and values and not all CPUs are the same speed. > Sampling in the 100's of msec range is certainly feasible for many > combinations. > > > What about tracing with trace PMDA? How fast can an instrumented > > application push data through libpcp_trace? Is the PDU buffer size on > > the trace PMDA side configurable? > > The trace PMDA was never intended for high frequency sampling > (annotation of bash scripts is a common use), so I would not consider > this for high throughput. More interesting would be the relatively > recent PMAPI extensions for event records ... Nathan can probably expand > on this better than I. > > > Does the PMAPI have to use fetch/pull to collect data with certain > > fixed frequency? I assume that PMCD cannot push data to the monitoring > > side via PMAPI. > > There is very little client state maintained at pmcd, so clients are > free to fetch at whatever frequency they desire and indeed pmlogger and > pmie collect different groups of metrics at different frequencies. > > Pushing from pmcd is nver going to happen (this is not an SNMP trap > model!). > > > However, for the trace PMDA case, does it make sense to collect > > multiple samples in the buffer, each with a different timestamp, and > > have the monitoring tools on the other side, such as pmchart, to > > display multiple samples, per every fetch/pull, based on the > > timestamp? Just a thought on one option to increase the sample > > frequency without increasing the fetch/pull frequency. > > The event record services address just this issue. Individual event > records are timestamped, even though a group of them are delivered in a > batch to the PMAPI client. > > --f46d04083aad5ff6d504d10fa174 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Ken,

Thanks a lot for the information. Any information on the eve= nt record service?
Is it related to the "Event Logging" on the= following link at all?
http://oss.sgi.com/projects/pcp/pcp-g= ui.git/man/html/howto.systemlog.html

Thanks,
Jun

On Fri, Dec 14, 2012 a= t 2:10 PM, Ken McDonell <kenj@internode.on.net> wrote:
On Fri, 2012-12-14 at 01:53 -0800, Jun Wang wrote:
> Folks,
>
> In terms of the add-hoc high frequency
> stats/metrics collection, do we have a known upper limit on the
> frequency to collect and display the metrics? Can we sample every 100<= br> > milliseconds or with even higher frequency?

This is a "length of the piece of string" question ... not = all metrics
have equal cost to instantiate (collect), not all fetches return the
same number of metrics and values and not all CPUs are the same speed.
Sampling in the 100's of msec range is certainly feasible for many
combinations.

> What about tracing with trace PMDA? How fast can an instrumented
> application push data through libpcp_trace? Is the PDU buffer size on<= br> > the trace PMDA side configurable?

The trace PMDA was never intended for high frequency sampling
(annotation of bash scripts is a common use), so I would not consider
this for high throughput. =C2=A0More interesting would be the relatively recent PMAPI extensions for event records ... Nathan can probably expand on this better than I.

> Does the PMAPI have to use fetch/pull to collect data with certain
> fixed frequency? I assume that PMCD cannot push data to the monitoring=
> side via PMAPI.

There is very little client state maintained at pmcd, so clients are<= br> free to fetch at whatever frequency they desire and indeed pmlogger and
pmie collect different groups of metrics at different frequencies.

Pushing from pmcd is nver going to happen (this is not an SNMP trap
model!).

> However, for the trace PMDA case, does it make sense to collect
> multiple samples in the buffer, each with a different timestamp, and > have the monitoring tools on the other side, such as pmchart, to
> display multiple samples, per every fetch/pull, based on the
> timestamp? Just a thought on one option to increase the sample
> frequency without increasing the fetch/pull frequency.

The event record services address just this issue. =C2=A0Individual e= vent
records are timestamped, even though a group of them are delivered in a
batch to the PMAPI client.


--f46d04083aad5ff6d504d10fa174-- From kenj@internode.on.net Mon Dec 17 13:51:13 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBHJpD05160124 for ; Mon, 17 Dec 2012 13:51:13 -0600 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 798D8304059 for ; Mon, 17 Dec 2012 11:53:46 -0800 (PST) X-ASG-Debug-ID: 1355774021-04cbb035a45b22a0001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id h7ySHbmzb9DLzQoA for ; Mon, 17 Dec 2012 11:53:41 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApMBAK10z1B20TUh/2dsb2JhbAANOIY7uAGDEQEBAQQjVhALGAICJgICVwaIMqZYcIJAkBGBIo5rgRMDlgqTTw Received: from ppp118-209-53-33.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.53.33]) by ipmail07.adl2.internode.on.net with ESMTP; 18 Dec 2012 06:23:40 +1030 Message-ID: <1355774113.3857.12.camel@bozo.localdomain> Subject: Re: [pcp] high frequency metrics collection and trace From: Ken McDonell X-ASG-Orig-Subj: Re: [pcp] high frequency metrics collection and trace To: Jun Wang Cc: PCP Date: Tue, 18 Dec 2012 06:55:13 +1100 In-Reply-To: References: <1355523024.5399.62.camel@bozo-laptop.localdomain> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1355774021 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117294 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On Mon, 2012-12-17 at 09:22 -0800, Jun Wang wrote: > Hi Ken, > > Thanks a lot for the information. Any information on the event record > service? > Is it related to the "Event Logging" on the following link at all? > http://oss.sgi.com/projects/pcp/pcp-gui.git/man/html/howto.systemlog.html No that is something different again. We don't have "how to" on the event logging services, so the options are - man pages for a pmda developer ... pmdaeventarray(3), pmdaeventqueue(3) and pmdaeventclient(3). - source code examples for pmdas that producer event traces ... see the bash, etw, logger, sample and systemd PMDAs - for consumer of events see the man page and source for pmevent(1). From nscott@redhat.com Mon Dec 17 21:41:26 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBI3fQ1G203010 for ; Mon, 17 Dec 2012 21:41:26 -0600 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id EBCF5AC002 for ; Mon, 17 Dec 2012 19:43:58 -0800 (PST) X-ASG-Debug-ID: 1355802234-04cbb035a55d3490001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id Y3oqjI7OGh4jbThY for ; Mon, 17 Dec 2012 19:43:54 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBI3hm9k023676; Mon, 17 Dec 2012 22:43:48 -0500 Date: Mon, 17 Dec 2012 22:43:48 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Jun Wang , Ken McDonell Cc: PCP Message-ID: <1855124637.54637622.1355802228573.JavaMail.root@redhat.com> In-Reply-To: Subject: Re: [pcp] high frequency metrics collection and trace MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] high frequency metrics collection and trace Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.199] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1355802234 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117324 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- ----- Original Message ----- > On Fri, 2012-12-14 at 01:53 -0800, Jun Wang wrote: > > In terms of the add-hoc high frequency stats/metrics collection, > ... > The trace PMDA was never intended for high frequency sampling > ... On the topic of pmdatrace I would also add that this PMDA pre-dates many modern advances in event tracing - in particular, concepts like end-to-end tracing (implemented in Event Tracing for Windows, a number of commercial products like DynaTrace, New Relic, and so on), dynamic tracing (systemtap, DTrace, dyninst and co), low-cost static tracing (like LTTng), and ironically even the recent event tracing extensions in PCP itself. pmdatrace is well overdue for a revamp, so unless your needs are quite simple I wouldn't really recommend using it at this stage. > More interesting would be the relatively recent PMAPI extensions for > event records ... Nathan can probably expand on this better than I. Further details can be found in the paper here, from page 11 onward: http://oss.sgi.com/projects/pcp/papers/unifying-thesis.pdf This is relatively fresh code in PCP, and so not as well documented at this stage as other areas. In general, this is an area of active exploration as we're uncovering the needs of each new tracing domain we come across. cheers. -- Nathan From kenj@internode.on.net Thu Dec 20 15:29:58 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBKLTw8R097800 for ; Thu, 20 Dec 2012 15:29:58 -0600 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 3CE818F8033 for ; Thu, 20 Dec 2012 13:32:37 -0800 (PST) X-ASG-Debug-ID: 1356039149-04cbb035a66a5870001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id GAIrDSSxBr2HtHiD for ; Thu, 20 Dec 2012 13:32:30 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: Ak4cADaD01BlrAZOPGdsb2JhbAANOIY6hDqzEgMBAQEBOIJ8fgcGAiYCRS2teXCTF4EiizWDMIETA5cnhHGDQIoD Received: from unknown (HELO [10.230.79.158]) ([101.172.6.78]) by ipmail05.adl6.internode.on.net with ESMTP; 21 Dec 2012 08:02:28 +1030 Message-ID: <1356039148.13089.24.camel@bozo-laptop.localdomain> Subject: pcp updates - pmie, qa and PCP_SYSCONF_DIR (new) From: Ken McDonell X-ASG-Orig-Subj: pcp updates - pmie, qa and PCP_SYSCONF_DIR (new) To: pcp@oss.sgi.com Date: Fri, 21 Dec 2012 08:32:28 +1100 Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1356039149 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117587 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- PCP_SYSCONF_DIR changes touch lots of files ... all of this passes QA for me with Debian packaging. I've made what I believe to be the correct RPM packaging changes, but I cannot test these as all my RPM builds are still failing with the python packaging issue I raised several weeks ago that remains unresolved. So it would be _really_ good to have these changes reviewed by those with a vested interest in RPM packaging for PCP. Cheers, Santa Ken. Changes committed to git://oss.sgi.com/kenj/pcp.git dev GNUmakefile | 1 INSTALL | 9 build/rpm/.gitignore | 1 build/rpm/GNUmakefile | 34 build/rpm/fedora.spec | 529 - build/rpm/fedora.spec.head | 271 build/rpm/fedora.spec.head.in | 271 build/rpm/fedora.spec.tail | 275 build/rpm/pcp.spec.head | 360 build/rpm/pcp.spec.head.in | 360 build/rpm/pcp.spec.in | 492 - build/rpm/pcp.spec.tail | 148 build/tar/.gitignore | 2 build/tar/GNUmakefile | 10 build/tar/preinstall | 41 build/tar/preinstall.head.in | 22 build/tar/preinstall.tail | 35 configure |15147 ++++++++++-------------------------------- configure.in | 35 debian/.gitignore | 2 debian/GNUmakefile | 15 debian/cleanconfigs | 71 debian/pcp.conffiles | 11 debian/pcp.lintian | 4 debian/pcp.preinst.head.in | 14 debian/pcp.preinst.tail | 7 man/man1/pcp.1 | 4 man/man1/pcpintro.1 | 2 man/man1/pmafm.1 | 6 man/man1/pmclient.1 | 2 man/man1/pmie.1 | 4 man/man1/pmie_check.1 | 4 man/man1/pmlogger.1 | 31 man/man1/pmlogger_daily.1 | 12 man/man1/pmnewlog.1 | 6 man/man1/pmstat.1 | 2 qa/019 | 37 qa/019.linux.4 | 689 + qa/023 | 2 qa/041 | 2 qa/110 | 11 qa/115 | 2 qa/119 | 2 qa/187 | 15 qa/244 | 2 qa/273 | 32 qa/273.out.4 | 1715 ++++ qa/280 | 2 qa/282.out.2.1 | 12 qa/282.out.4 | 6 qa/282.out.pre-2.1 | 12 qa/294 | 4 qa/294.out.1 | 2 qa/294.out.2 | 2 qa/340 | 2 qa/427 | 2 qa/504 | 2 qa/507 | 2 qa/516 | 41 qa/516.out | 16 qa/517 | 199 qa/517.out | 54 qa/check | 8 qa/common | 4 qa/common.check | 4 qa/common.filter | 1 qa/group | 8 src/include/pcp.conf.in | 28 src/pcp/GNUmakefile | 2 src/pcp/pcp.sh | 3 src/pmcd/GNUmakefile | 2 src/pmcd/rc_local | 2 src/pmclient/GNUmakefile | 2 src/pmdas/cisco/GNUmakefile | 2 src/pmie/GNUmakefile | 2 src/pmie/control | 2 src/pmie/pmie_check.sh | 2 src/pmie/src/dstruct.c | 19 src/pmieconf/GNUmakefile | 2 src/pmieconf/pmieconf.c | 4 src/pmlogctl/GNUmakefile | 2 src/pmlogctl/pmnewlog.sh | 4 src/pmlogger/pmlogger.c | 8 src/pmstat/GNUmakefile | 2 84 files changed, 8433 insertions(+), 12787 deletions(-) commit 8442aa6c5c727e7245f94db006d29288875090cd Author: Ken McDonell Date: Fri Dec 21 08:22:13 2012 +1100 PCP_SYSCONF_DIR changes Big changes here to introduce $PCP_SYSCONF_DIR (defaults to /etc/pcp) as the base directory for the configuration files for pmcd, pmie, pmlogger and pmproxy. Also included is the migration script (debian/cleanconfigs) that can be used in packaging as part of the pre-install script to harvest and migrate configuration files from all the places we've hidden them in the past. commit d22deb140c79fa3803ef079e9a1e206e9a9473ff Author: Ken McDonell Date: Fri Dec 21 07:18:27 2012 +1100 qa/273 - proc PMDA games Need to handle variant output this is different if the proc PMDA is (a) not installed, or (b) installed as a daemon, or (c) installed as a DSO. commit fd1d15bb620b1e98bd8a10e6d07be16d6f602023 Author: Ken McDonell Date: Fri Dec 21 07:12:21 2012 +1100 qa/019 - a little more parnoia in error check land commit 8c6d017ecfe5921cc833970bfda4aca6c5b7f2f1 Author: Ken McDonell Date: Fri Dec 21 06:44:57 2012 +1100 qa/110 - be mor careful about the log file for the simple PMDA Post the non-root changes, the log file may be absent in some cases ... only issue is with the 110.full diagnostics. commit e2ca9cd2182cb4663ddf0988a1f0631851556b68 Author: Ken McDonell Date: Fri Dec 21 06:23:36 2012 +1100 qa/019 - more exposed to proc PMDA variants This test produces different results when the proc PMDA is installed as a daemon (not a DSO) ... add variant output file and more complicated logic to select the correct expected output file. commit f8dd86b1eafb5294d3b7b5ba8dd27205597ab071 Author: Ken McDonell Date: Thu Dec 20 10:51:52 2012 +1100 qa/common.check - be more careful of quoting for perl ' is being interpreted by the shell in this context, need additional " to make Perl string of the arguments to gethostbyname() and inet_aton() commit a60ce41c76430f4240d916874a6f3f850dc75bc6 Author: Ken McDonell Date: Mon Dec 17 06:52:59 2012 +1100 qa/517 - small typo correction commit de599964dd55f29e3a3a6ba7b1e8c126213106f0 Author: Ken McDonell Date: Mon Dec 17 06:51:30 2012 +1100 qa/517 (new) - check config file migration logic commit 5ce01e8a3112bcafa0c20d45a8fc01fa5adba649 Author: Ken McDonell Date: Mon Dec 17 06:50:45 2012 +1100 qa/516 (new) - pmie was dumping core on the error path commit b447b1d615dcce75216748ee59bae09022a5bec7 Author: Ken McDonell Date: Sat Dec 15 07:11:28 2012 +1100 pmie - ugly free botch on error path Discovered trying create multi-host pmie rules for the summary PMDA ... made a typing error and pmie blew up! Cause ended up being multiple calls to free() with obscurely overlapping regions. From kenj@internode.on.net Thu Dec 20 17:35:19 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBKNZJfe110103 for ; Thu, 20 Dec 2012 17:35:19 -0600 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 79160304059 for ; Thu, 20 Dec 2012 15:37:58 -0800 (PST) X-ASG-Debug-ID: 1356046673-04cb6c05a56cb750001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id mOF0FbuwKjVsC6EH for ; Thu, 20 Dec 2012 15:37:53 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: Ak4cALuf01BlrAZOPGdsb2JhbAANOIY6hDqzEgMBAQEBOIJ8fgcGAiYCRS2sV3CTEIEiizWBGoIWgRMDnBiNQw Received: from unknown (HELO [10.230.79.158]) ([101.172.6.78]) by ipmail05.adl6.internode.on.net with ESMTP; 21 Dec 2012 10:07:52 +1030 Message-ID: <1356046672.13089.25.camel@bozo-laptop.localdomain> Subject: pcp updates - oops + oversight From: Ken McDonell X-ASG-Orig-Subj: pcp updates - oops + oversight To: pcp@oss.sgi.com Date: Fri, 21 Dec 2012 10:37:52 +1100 Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1356046673 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117595 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://oss.sgi.com/kenj/pcp.git dev build/rpm/GNUmakefile | 4 ++-- build/tar/GNUmakefile | 2 +- debian/GNUmakefile | 2 +- src/pmdas/linux_proc/help | 22 +++++++++++----------- 4 files changed, 15 insertions(+), 15 deletions(-) commit 84432a4d2df3c91fa5df742adc71283c0a84cd74 Author: Ken McDonell Date: Fri Dec 21 10:36:46 2012 +1100 packaging gmake fix up if you're going to use cryptic gmake auto variables, use the right ones! commit e415b50e80d6b4866e0ce2665fb04b89b4780d64 Author: Ken McDonell Date: Fri Dec 21 10:29:43 2012 +1100 proc PMDA - one-line help Add one-line help for the metrics that did not have it. From nscott@redhat.com Thu Dec 20 18:10:31 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.7 required=5.0 tests=BAYES_00,J_CHICKENPOX_34, J_CHICKENPOX_64 autolearn=no version=3.4.0-r929098 Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBL0AUJM113450 for ; Thu, 20 Dec 2012 18:10:30 -0600 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 5115DAC005 for ; Thu, 20 Dec 2012 16:13:06 -0800 (PST) X-ASG-Debug-ID: 1356048781-04bdf043101477a0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id KfGAVUGNcpFt4YKG for ; Thu, 20 Dec 2012 16:13:01 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBL0CwHJ022313; Thu, 20 Dec 2012 19:12:58 -0500 Date: Thu, 20 Dec 2012 19:12:58 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <743099991.56817266.1356048778324.JavaMail.root@redhat.com> In-Reply-To: <1356039148.13089.24.camel@bozo-laptop.localdomain> Subject: dev branch build issues MIME-Version: 1.0 X-ASG-Orig-Subj: dev branch build issues Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.230] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1356048781 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117597 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi Ken, >From your earlier mail re RPM packaging pain and python, [ http://oss.sgi.com/archives/pcp/2012-11/msg00084.html ] the attached patch may help to work around it, not sure, give it a crack and let me know. Its a hack. With your last set of changes, I see this in RPM builds (this from a RHEL6.3 build): ... === tar === Wrote: /source/build/debug-info-path/git/golden-pcp/build/tar/pcp-3.6.11-1.tar.gz === rpm === DEFS=`grep '^--define' rpmmacros`; \ eval /usr/bin/rpmbuild -ba $DEFS \ --target x86_64-unknown-linux \ --clean pcp.spec fedora.spec error: line 10: Empty tag: BuildRoot: Building target platforms: x86_64-unknown-linux Building for target x86_64-unknown-linux gmake[1]: *** [pack_pcp] Error 1 make: *** [pack_pcp] Error 2 make: Leaving directory `/source/build/debug-info-path/git/golden-pcp/build' cheers. -- Nathan From nscott@redhat.com Thu Dec 20 18:11:08 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBL0B87n113604 for ; Thu, 20 Dec 2012 18:11:08 -0600 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 27A29AC002 for ; Thu, 20 Dec 2012 16:13:46 -0800 (PST) X-ASG-Debug-ID: 1356048825-04cb6c05a66cd700001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id EaWBjEhWiicXrtHd for ; Thu, 20 Dec 2012 16:13:45 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBL0DgMh005808; Thu, 20 Dec 2012 19:13:42 -0500 Date: Thu, 20 Dec 2012 19:13:42 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <710965841.56817377.1356048822720.JavaMail.root@redhat.com> In-Reply-To: <743099991.56817266.1356048778324.JavaMail.root@redhat.com> Subject: Re: dev branch build issues MIME-Version: 1.0 X-ASG-Orig-Subj: Re: dev branch build issues Content-Type: multipart/mixed; boundary="----=_Part_56817375_1548897767.1356048822719" X-Originating-IP: [10.64.51.230] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1356048825 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117597 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- ------=_Part_56817375_1548897767.1356048822719 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Helps if the patch is attached. ----- Original Message ----- > Hi Ken, > > From your earlier mail re RPM packaging pain and python, > [ http://oss.sgi.com/archives/pcp/2012-11/msg00084.html ] > the attached patch may help to work around it, not sure, > give it a crack and let me know. Its a hack. > ------=_Part_56817375_1548897767.1356048822719 Content-Type: text/x-patch; name=kenj.patch Content-Disposition: attachment; filename=kenj.patch Content-Transfer-Encoding: base64 ZGlmZiAtLWdpdCBhL3NyYy9pbmNsdWRlL2J1aWxkZGVmcy5pbiBiL3NyYy9pbmNsdWRlL2J1aWxk ZGVmcy5pbgppbmRleCA3ZTVhNzI5Li43ZDhhNmE3IDEwMDY0NAotLS0gYS9zcmMvaW5jbHVkZS9i dWlsZGRlZnMuaW4KKysrIGIvc3JjL2luY2x1ZGUvYnVpbGRkZWZzLmluCkBAIC00NjMsNyArNDYz LDEwIEBAIGVuZGlmCiBpZmVxICIkKFRBUkdFVF9PUykiICJsaW51eCIKIFBZVEhPTl9JTlNUQUxM ID0gXAogCSQoQVdLKSAne3ByaW50fSAvLnB5YyQkLyB7c3ViKC8ucHljJCQvLCIucHlvIik7IHBy aW50fScgXAotCQk8ICQoVE9QRElSKS9weXRob24tcGNwLmxpc3QgPiAkKFRPUERJUikvcHl0aG9u LXBjcC5saXN0LnJwbQorCQk8ICQoVE9QRElSKS9weXRob24tcGNwLmxpc3QgPiAkKFRPUERJUikv cHl0aG9uLXBjcC5saXN0LnJwbTsgXAorCWNhdCAkKFRPUERJUikvcHl0aG9uLXBjcC5saXN0LnJw bSB8IHdoaWxlIHJlYWQgZjsgZG8gXAorCSAgICB0b3VjaCAkJHtESVNUX1JPT1QtL30kJGY7IFwK Kwlkb25lCiBlbHNlCiBpZmVxICIkKHNoZWxsIFsgJyQoUEFDS0FHRV9ESVNUUklCVVRJT04pJyA9 IGNvY29hIFwKICAgICAgICAgICAgICAgICAtbyAnJChQQUNLQUdFX0RJU1RSSUJVVElPTiknID0g bWFjb3N4IFwK ------=_Part_56817375_1548897767.1356048822719-- From nscott@redhat.com Thu Dec 20 23:08:18 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBL58INd145482 for ; Thu, 20 Dec 2012 23:08:18 -0600 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id B82258F8039 for ; Thu, 20 Dec 2012 21:10:54 -0800 (PST) X-ASG-Debug-ID: 1356066653-04bdf043101599c0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id QPpvzM8k3wh8iobP for ; Thu, 20 Dec 2012 21:10:53 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBL5Aq83007299 for ; Fri, 21 Dec 2012 00:10:53 -0500 Date: Fri, 21 Dec 2012 00:10:52 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: PCP Message-ID: <1689903290.56907052.1356066652570.JavaMail.root@redhat.com> Subject: pcp updates: recent nssmerge code MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: recent nssmerge code Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.230] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1356066653 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117617 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://oss.sgi.com/pcp/pcp.git nssmerge src/include/pcp/impl.h | 9 - src/libpcp/src/auxconnect.c | 148 +++++++++++++++-- src/libpcp/src/check-statics | 2 src/libpcp/src/connect.c | 88 ++++++---- src/libpcp/src/context.c | 3 src/libpcp/src/util.c | 16 + src/pmcd/src/GNUmakefile | 18 ++ src/pmcd/src/dopdus.c | 8 src/pmcd/src/pmcd.c | 40 +++- src/pmcd/src/pmcd.h | 6 src/pmcd/src/secure.c | 355 ++++++++++++++++++++++++++++++++++++++++--- src/pmcd/src/secure.h | 54 +++++- 12 files changed, 641 insertions(+), 106 deletions(-) commit a855d1bc9eb468714d84357e6b2624815576dda7 Author: Nathan Scott Date: Fri Dec 21 16:08:58 2012 +1100 Initial client-side support code for NSS secure contexts Added code to load up per-user and system-wide NSS certificate database for the client side of a secure connection. Refactored one-time-initialisation code in pmcd connection setup as part of this, in particular the proxy setup is now done by a helper like pmcd env vars always were (and also like the newly added cert db setup is). Extended the libpcp shutdown routine to also cleanup NSS cert db state we've setup. Changed the way this handles errors, so that it keeps going through shutdown in the presence of errors, while saving the first error code and returning that. Otherwise, some unrelated error (eg in local context handling) may cause dodgey teardown of NSS stuff, for example. Finally, cleaned up the pmcd symbol namespace a little to prevent naming collisions. commit aa3eb752d6760ec8e2aea55db88b7ddcd87491f3 Author: Nathan Scott Date: Thu Dec 20 14:51:47 2012 +1100 Chop end-of-line markers from passwd file, close file always commit 1a63f9ed2a0da20101751a854158f27b0275779b Author: Nathan Scott Date: Thu Dec 20 14:50:49 2012 +1100 Fix bitfield check mask, consistent pmcd ipc error handling commit 14831dbeb729f7d3194ee1a40231730947d5802c Author: Nathan Scott Date: Thu Dec 20 14:47:16 2012 +1100 Add a env var mechanism for forcing encrypted host contexts commit 95856cc50775c7fac35d984625af23ca96e81515 Author: Nathan Scott Date: Wed Dec 19 21:40:46 2012 +1100 Make client side SSL setup consistent with server side code commit f98ec7b65c6dde01d77ebe9f5d0544b6aaf59289 Author: Nathan Scott Date: Wed Dec 19 17:38:51 2012 +1100 Server side (pmcd) support for encrypted and compressed communication Adds the necessary SSL support code for responding to a client request for SSL connections. Two new pmcd command line options are added, one allowing a non-default credentials database path to be specified and the other to allow a password file to be passed in if the database is password protected. At startup the database is queried for credential nickname "PCP Collector credential", which is then verified, private key extracted, and used for subsequent encrypted channels (both clear and encrypted communication is supported by the one pmcd, just depends on what an individual client requests for each context it creates). Its not clear which of these new routines will end up in libpcp and which in pmcd (some will be shared with client side), so for now all have used libpcp naming conventions and I'll revisit that later when cleaning up. From kenj@internode.on.net Fri Dec 21 00:52:41 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.7 required=5.0 tests=BAYES_00,J_CHICKENPOX_34, J_CHICKENPOX_64 autolearn=no version=3.4.0-r929098 Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBL6qfnE150674 for ; Fri, 21 Dec 2012 00:52:41 -0600 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 373BBAC002 for ; Thu, 20 Dec 2012 22:55:20 -0800 (PST) X-ASG-Debug-ID: 1356072914-04cbb035a76c5a50001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id QC9uxRECSWL88NTe for ; Thu, 20 Dec 2012 22:55:14 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AnMbACIH1FBlrAZOPGdsb2JhbAANN4Y6t1ADAQEBATiCUgEBAQQjVhALDQsCAiYCAkMUBogyo0Bwkw+BIotQgxWBEwOcGI1DgVk Received: from unknown (HELO [10.230.79.158]) ([101.172.6.78]) by ipmail05.adl6.internode.on.net with ESMTP; 21 Dec 2012 17:25:13 +1030 Message-ID: <1356072916.13089.30.camel@bozo-laptop.localdomain> Subject: Re: dev branch build issues From: Ken McDonell X-ASG-Orig-Subj: Re: dev branch build issues To: Nathan Scott Cc: pcp@oss.sgi.com Date: Fri, 21 Dec 2012 17:55:16 +1100 In-Reply-To: <743099991.56817266.1356048778324.JavaMail.root@redhat.com> References: <743099991.56817266.1356048778324.JavaMail.root@redhat.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1356072914 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117625 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On Thu, 2012-12-20 at 19:12 -0500, Nathan Scott wrote: > Hi Ken, > > From your earlier mail re RPM packaging pain and python, > [ http://oss.sgi.com/archives/pcp/2012-11/msg00084.html ] > the attached patch may help to work around it, not sure, > give it a crack and let me know. Its a hack. > > With your last set of changes, I see this in RPM builds > (this from a RHEL6.3 build): Nathan, Do you have my second commit from this morning (a84cd74)? This has a fix for the first botched recipe for stitching the rpm spec file together from pieces. My guess would be pcp.spec is wrongly created ... the makefile should do something like cat pcp.spec.head ../../debian/cleanconfigs pcp.spec.tail >pcp.spec (ditto for fedora.spec if you're using that one) I can't do any rpm builds until Sun night or Mon morning ... I'll try your patch then. Thanks, Ken. > ... > === tar === > Wrote: /source/build/debug-info-path/git/golden-pcp/build/tar/pcp-3.6.11-1.tar.gz > === rpm === > DEFS=`grep '^--define' rpmmacros`; \ > eval /usr/bin/rpmbuild -ba $DEFS \ > --target x86_64-unknown-linux \ > --clean pcp.spec fedora.spec > error: line 10: Empty tag: BuildRoot: > Building target platforms: x86_64-unknown-linux > Building for target x86_64-unknown-linux > gmake[1]: *** [pack_pcp] Error 1 > make: *** [pack_pcp] Error 2 > make: Leaving directory `/source/build/debug-info-path/git/golden-pcp/build' > > > cheers. > > -- > Nathan From wwwrun@oss.sgi.com Sat Dec 22 03:36:08 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-0.8 required=5.0 tests=ALL_TRUSTED,BAYES_00, J_CHICKENPOX_63 autolearn=no version=3.4.0-r929098 Received: from oss.sgi.com (localhost [127.0.0.1]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBM9a8mn187373 for ; Sat, 22 Dec 2012 03:36:08 -0600 Received: (from wwwrun@localhost) by oss.sgi.com (8.14.3/8.14.3/Submit) id qBM9a8tB187372; Sat, 22 Dec 2012 03:36:08 -0600 Date: Sat, 22 Dec 2012 03:36:08 -0600 Message-Id: <201212220936.qBM9a8tB187372@oss.sgi.com> From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 936] pmie falling operator does not insert instance (%i) and value (%v) X-Bugzilla-Reason: CC X-Bugzilla-Type: newchanged X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: azzurrow@gmail.com X-Bugzilla-Status: RESOLVED X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: mort@sgi.com X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: Status Resolution In-Reply-To: References: Auto-Submitted: auto-generated Content-Type: text/plain; charset="UTF-8" MIME-Version: 1.0 http://oss.sgi.com/bugzilla/show_bug.cgi?id=936 azzurrow@gmail.com changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution| |WORKSFORME -- Configure bugmail: http://oss.sgi.com/bugzilla/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug. From chandana@desilva.id.au Sat Dec 22 16:01:13 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBMM1D7Z041849 for ; Sat, 22 Dec 2012 16:01:13 -0600 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 1C2C1304043 for ; Sat, 22 Dec 2012 14:03:50 -0800 (PST) X-ASG-Debug-ID: 1356213829-04cb6c05a576b770001-S8gJnT Received: from mho-01-ewr.mailhop.org (mho-03-ewr.mailhop.org [204.13.248.66]) by cuda.sgi.com with ESMTP id vimomYkfR4B8hDu8 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sat, 22 Dec 2012 14:03:49 -0800 (PST) X-Barracuda-Envelope-From: chandana@desilva.id.au X-Barracuda-Apparent-Source-IP: 204.13.248.66 Received: from d210-49-168-202.sun801.vic.optusnet.com.au ([210.49.168.202] helo=mail.desilva.id.au) by mho-01-ewr.mailhop.org with esmtpa (Exim 4.72) (envelope-from ) id 1TmXAa-0004WO-Uo for pcp@oss.sgi.com; Sat, 22 Dec 2012 22:03:49 +0000 Received: from [192.168.1.57] (unknown [192.168.1.57]) by mail.desilva.id.au (Postfix) with ESMTPSA id 905876FE6 for ; Sun, 23 Dec 2012 09:00:46 +1100 (EST) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 210.49.168.202 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX1//m395HB76lPgFshuN3g4H2UREN+qwrMM= Message-ID: <50D62E41.7000006@desilva.id.au> Date: Sun, 23 Dec 2012 09:03:45 +1100 From: Chandana De Silva Reply-To: chandana@desilva.id.au User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Error starting pmlogger Content-Type: text/plain; charset=ISO-8859-1; format=flowed X-ASG-Orig-Subj: Error starting pmlogger Content-Transfer-Encoding: 7bit X-Barracuda-Connect: mho-03-ewr.mailhop.org[204.13.248.66] X-Barracuda-Start-Time: 1356213829 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117781 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- I am trying to start pmlogger on 3.6.10-1. I know that 3.6.10-2 has been released, but the source tarball still makes 3.6.10-1. The error I get is: sudo /etc/ini.d/pmlogger start /etc/init.d/pmlogger: line 100: /var/tmp/pcp.cT81ruA1f/pmcheck: No such file or directory I added a few debug lines in /etc/init.d/pmlogger to see what happens to the temp directory. The directory seems to get deleted just after the call to start_pmcheck. It is there just before the call. Test Code --------- > grep -A2 -B3 "ls -la" /etc/init.d/pmlogger > _start_pmcheck() > { > echo "inside start_pmcheck" > ls -la /var/tmp > pmlogger_check $VFLAG >$tmp/pmcheck 2>&1 > if [ -s $tmp/pmcheck ] > -- > # > $ECHO $PCP_ECHO_N "Starting pmlogger ..." "$PCP_ECHO_C" > echo "call start_pmcheck" > ls -la /var/tmp > _start_pmcheck & > # success > -- > if [ "$PMLOGGER_CTL" = on ] > then > echo "call start_pmlogger" > ls -la /var/tmp > _start_pmlogger > fi Results ------- sudo /etc/init.d/pmlogger start call start_pmlogger total 12 drwxrwxrwt. 3 root root 4096 Dec 23 08:55 . drwxr-xr-x. 20 root root 4096 Dec 8 16:55 .. drwx------. 2 root root 4096 Dec 23 08:55 pcp.cT81ruA1f Starting pmlogger ... call start_pmcheck total 12 drwxrwxrwt. 3 root root 4096 Dec 23 08:55 . drwxr-xr-x. 20 root root 4096 Dec 8 16:55 .. drwx------. 2 root root 4096 Dec 23 08:55 pcp.cT81ruA1f inside start_pmcheck [chandana@c63 rpm]$ total 8 drwxrwxrwt. 2 root root 4096 Dec 23 08:55 . drwxr-xr-x. 20 root root 4096 Dec 8 16:55 .. /etc/init.d/pmlogger: line 102: /var/tmp/pcp.cT81ruA1f/pmcheck: No such file or directory From fche@redhat.com Sat Dec 22 16:18:41 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBMMIfIb042364 for ; Sat, 22 Dec 2012 16:18:41 -0600 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id D034B304043 for ; Sat, 22 Dec 2012 14:21:21 -0800 (PST) X-ASG-Debug-ID: 1356214880-04cbb035a674b560001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id pzcNVKAJqDK8IFAH for ; Sat, 22 Dec 2012 14:21:21 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id qBMMLJWv004181 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Sat, 22 Dec 2012 17:21:19 -0500 Received: from fche.csb (vpn-48-186.rdu2.redhat.com [10.10.48.186]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id qBMMLIqc017036; Sat, 22 Dec 2012 17:21:19 -0500 Received: by fche.csb (Postfix, from userid 2569) id 1DF345813A; Sat, 22 Dec 2012 17:21:18 -0500 (EST) To: chandana@desilva.id.au Cc: pcp@oss.sgi.com Subject: Re: Error starting pmlogger References: <50D62E41.7000006@desilva.id.au> X-ASG-Orig-Subj: Re: Error starting pmlogger From: fche@redhat.com (Frank Ch. Eigler) Date: Sat, 22 Dec 2012 17:21:17 -0500 In-Reply-To: <50D62E41.7000006@desilva.id.au> (Chandana De Silva's message of "Sun, 23 Dec 2012 09:03:45 +1100") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1356214880 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com Chandana De Silva writes: > I am trying to start pmlogger on 3.6.10-1. I know that 3.6.10-2 has > been released, but the source tarball still makes 3.6.10-1. > [...] I believe this was fixed in Author: Nathan Scott Date: Wed Nov 28 14:30:31 2012 +1100 Fix race conditions in pmie and pmlogger startup scripts Recent changes to tempfile handling has regressed the pmie and pmlogger startup scripts. Errors of the form: /etc/rc.d/init.d/pmlogger: line 100: /var/tmp/pcp.5vfQsSHKo/pmcheck: No such file or directory are now produced. [...] - FChE From chandana@desilva.id.au Sun Dec 23 01:22:24 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBN7MOHg203619 for ; Sun, 23 Dec 2012 01:22:24 -0600 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id A6764304039 for ; Sat, 22 Dec 2012 23:25:02 -0800 (PST) X-ASG-Debug-ID: 1356247497-04bdf0430f1f1980001-S8gJnT Received: from mho-02-ewr.mailhop.org (mho-04-ewr.mailhop.org [204.13.248.74]) by cuda.sgi.com with ESMTP id bjB100YgzJknwoGU (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sat, 22 Dec 2012 23:24:58 -0800 (PST) X-Barracuda-Envelope-From: chandana@desilva.id.au X-Barracuda-Apparent-Source-IP: 204.13.248.74 Received: from d210-49-168-202.sun801.vic.optusnet.com.au ([210.49.168.202] helo=mail.desilva.id.au) by mho-02-ewr.mailhop.org with esmtpa (Exim 4.72) (envelope-from ) id 1Tmfvd-000D5G-8m; Sun, 23 Dec 2012 07:24:57 +0000 Received: from [192.168.1.57] (unknown [192.168.1.57]) by mail.desilva.id.au (Postfix) with ESMTPSA id B55F26D89; Sun, 23 Dec 2012 18:21:54 +1100 (EST) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 210.49.168.202 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX1+5vHoIX8SsVpWli5tglCEsnk1PQAkpHUQ= Message-ID: <50D6B1C5.8000201@desilva.id.au> Date: Sun, 23 Dec 2012 18:24:53 +1100 From: Chandana De Silva Reply-To: chandana@desilva.id.au User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: "Frank Ch. Eigler" CC: pcp@oss.sgi.com Subject: Re: Error starting pmlogger References: <50D62E41.7000006@desilva.id.au> X-ASG-Orig-Subj: Re: Error starting pmlogger In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: mho-04-ewr.mailhop.org[204.13.248.74] X-Barracuda-Start-Time: 1356247498 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117815 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header Frank, Thanks, but I don't think the src tarball has been updated. Chandana On 23/12/12 09:21, Frank Ch. Eigler wrote: > Chandana De Silva writes: > >> I am trying to start pmlogger on 3.6.10-1. I know that 3.6.10-2 has >> been released, but the source tarball still makes 3.6.10-1. >> [...] > I believe this was fixed in > > Author: Nathan Scott > Date: Wed Nov 28 14:30:31 2012 +1100 > > Fix race conditions in pmie and pmlogger startup scripts > > Recent changes to tempfile handling has regressed the pmie and > pmlogger startup scripts. Errors of the form: > /etc/rc.d/init.d/pmlogger: line 100: /var/tmp/pcp.5vfQsSHKo/pmcheck: No such file or directory > are now produced. > > [...] > > - FChE From chandana@desilva.id.au Sun Dec 23 01:35:22 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBN7ZMAk203902 for ; Sun, 23 Dec 2012 01:35:22 -0600 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 0303BAC003 for ; Sat, 22 Dec 2012 23:38:02 -0800 (PST) X-ASG-Debug-ID: 1356248281-04bdf07fae163b40001-S8gJnT Received: from mho-02-ewr.mailhop.org (mho-04-ewr.mailhop.org [204.13.248.74]) by cuda.sgi.com with ESMTP id kYGgwhGuVWYB6tAZ (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sat, 22 Dec 2012 23:38:01 -0800 (PST) X-Barracuda-Envelope-From: chandana@desilva.id.au X-Barracuda-Apparent-Source-IP: 204.13.248.74 Received: from d210-49-168-202.sun801.vic.optusnet.com.au ([210.49.168.202] helo=mail.desilva.id.au) by mho-02-ewr.mailhop.org with esmtpa (Exim 4.72) (envelope-from ) id 1Tmg8G-000KyR-N5 for pcp@oss.sgi.com; Sun, 23 Dec 2012 07:38:01 +0000 Received: from [192.168.1.57] (unknown [192.168.1.57]) by mail.desilva.id.au (Postfix) with ESMTPSA id 8A83A7388 for ; Sun, 23 Dec 2012 18:34:58 +1100 (EST) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 210.49.168.202 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX19tIxDso4W/X7ea68xoRXvYlWpmYVc93nc= Message-ID: <50D6B4D5.6080106@desilva.id.au> Date: Sun, 23 Dec 2012 18:37:57 +1100 From: Chandana De Silva Reply-To: chandana@desilva.id.au User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: MySQL PMDA Does not re-connect after a MySQL re-start Content-Type: text/plain; charset=ISO-8859-1; format=flowed X-ASG-Orig-Subj: MySQL PMDA Does not re-connect after a MySQL re-start Content-Transfer-Encoding: 7bit X-Barracuda-Connect: mho-04-ewr.mailhop.org[204.13.248.74] X-Barracuda-Start-Time: 1356248281 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117815 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- The MySQL PMDA dies if the MySQL database is re-started, or if some other error error occurs while fetching data. I have got a preliminary fix for this, which works for the database re-start use case. Chandana --- pmdamysql.pl.orig 2012-12-23 18:18:27.438466152 +1100 +++ pmdamysql.pl 2012-12-23 18:17:54.996470514 +1100 @@ -42,6 +42,9 @@ if (!defined($dbh)) { $dbh = DBI->connect($database, $username, $password); if (defined($dbh)) { + # set the db handle to undef in case of any failure + # this will force a database reconnect + $dbh->{HandleError} = sub { $dbh = undef; }; $pmda->log("MySQL connection established\n"); $sth_variables = $dbh->prepare('show variables'); $sth_status = $dbh->prepare('show status'); @@ -1838,3 +1841,4 @@ =head1 SEE ALSO pmcd(1), pmdadbping.pl(1) and DBI(3). +# vi: sw=4 ts=4 et PMCD - MySQL log output: -------------------------- [Sun Dec 23 18:23:17] pmdamysql(16160) Info: MySQL connection established DBD::mysql::st execute failed: MySQL server has gone away at /var/lib/pcp/pmdas/mysql/pmdamysql.pl line 77. DBD::mysql::st fetchall_arrayref failed: fetch() without execute() at /var/lib/pcp/pmdas/mysql/pmdamysql.pl line 78. DBI connect('mysql','root',...) failed: Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2) adas/mysql/pmdamysql.pl line 43 DBI connect('mysql','root',...) failed: Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2) adas/mysql/pmdamysql.pl line 43 DBI connect('mysql','root',...) failed: Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2) adas/mysql/pmdamysql.pl line 43 DBI connect('mysql','root',...) failed: Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2) adas/mysql/pmdamysql.pl line 43 DBI connect('mysql','root',...) failed: Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2) adas/mysql/pmdamysql.pl line 43 [Sun Dec 23 18:27:33] pmdamysql(16160) Info: MySQL connection established Test using pmval ---------------- pmval mysql.status.uptime metric: mysql.status.uptime host: localhost semantics: cumulative counter (converting to rate) units: sec (converting to time utilization) samples: all 0.9932 0.9973 0.9927 0.9932 pmval: pmFetch: Metric not supported by this version of monitored application pmval: pmFetch: Metric not supported by this version of monitored application pmval: pmFetch: Metric not supported by this version of monitored application pmval: pmFetch: Metric not supported by this version of monitored application pmval: pmFetch: Metric not supported by this version of monitored application pmval: pmFetch: Metric not supported by this version of monitored application No values available 0.9931 0.9931 0.9931 0.9934 0.9932 0.9933 0.9932 0.9930 0.9930 ^C From kenj@internode.on.net Sun Dec 23 13:49:12 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBNJnCq3256195 for ; Sun, 23 Dec 2012 13:49:12 -0600 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id C136A30404E for ; Sun, 23 Dec 2012 11:51:53 -0800 (PST) X-ASG-Debug-ID: 1356292307-04cb6c05a579eed0001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id oha7m3pEz53HFzla for ; Sun, 23 Dec 2012 11:51:48 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApMBAEdg11B20TU//2dsb2JhbAANN4Y6t1GDO4EFBgImAlMfqgtwkXSBIos1gRqCFoETA5JZgzOTUA Received: from ppp118-209-53-63.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.53.63]) by ipmail06.adl6.internode.on.net with ESMTP; 24 Dec 2012 06:21:47 +1030 Message-ID: <1356292408.3135.0.camel@bozo.localdomain> Subject: pcp updates From: Ken McDonell X-ASG-Orig-Subj: pcp updates To: pcp@oss.sgi.com Date: Mon, 24 Dec 2012 06:53:28 +1100 Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1356292307 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117862 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- First commit is the critical one for fixing error: line 10: Empty tag: BuildRoot: failures in rpm builds. Changes committed to git://oss.sgi.com/kenj/pcp.git dev build/rpm/GNUmakefile | 14 - build/rpm/fedora.spec.head | 271 --------------------------------- build/rpm/pcp.spec.head | 360 --------------------------------------------- build/tar/GNUmakefile | 4 debian/GNUmakefile | 4 qa/518 | 52 ++++++ qa/518.out | 4 qa/group | 1 src/pcp/pcp.sh | 20 +- src/pmcd/rc-proc.sh | 3 10 files changed, 80 insertions(+), 653 deletions(-) commit 0ab23e5f9efed364d78dee05731602799956bcb8 Author: Ken McDonell Date: Mon Dec 24 06:37:40 2012 +1100 rpm builds - fix spec file construction After the PCP_SYSCONF_DIR changes I had to spilt the rpm spec files into 3 pieces ... a head, the cleanconfigs script and a tail. The recipe for stitching together a working spec file was not quite right. commit 6181e951fc4deb5ec983bbd7fb9601d8e486ac14 Author: Ken McDonell Date: Sat Dec 22 06:45:24 2012 +1100 qa/518 (new) - exercise pcp -p commit 0f107a64349c937e1a16de234076b6d2a0c85f95 Author: Ken McDonell Date: Sat Dec 22 06:42:51 2012 +1100 pcp(1) - fix -p option -p (to report running pmie instances) has been broken for sometime due to a race/botch in the temp file handling. Fixed this and tidied up the reporting format a little. commit d5f3d9f38702cf73ff3cadf996e0e743b859ef0f Author: Ken McDonell Date: Sat Dec 22 06:39:32 2012 +1100 rc-proc.sh - fix update-rc.d hints Found as follows: pmie is chkconfig off by default and the hints for how to enable this (so /etc/init.d/pmie does something) were wrong. The problem is not specific to pmie, but in the generic chkconfig_on_msg() function. commit 844d14cedfcf3bdc82842fa703d2067c9669f0b0 Author: Ken McDonell Date: Fri Dec 21 18:44:37 2012 +1100 packaging tweaks - avoid $< and $@ Just to be sure, to be sure, make the rules explicit and don't rely on gmake to substitute filenames in the order we require. From kenj@internode.on.net Sun Dec 23 13:51:14 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBNJpEQa256271 for ; Sun, 23 Dec 2012 13:51:14 -0600 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 0FF06304039 for ; Sun, 23 Dec 2012 11:53:56 -0800 (PST) X-ASG-Debug-ID: 1356292434-04cb6c05a879f110001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id ZNIMNujBFHLEqaPv for ; Sun, 23 Dec 2012 11:53:54 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApMBAEdg11B20TU//2dsb2JhbAANN4Y6t1GDEQEBAQMBI1YFCwsYAgImAgJXBoggEqFscJF0gSKLUIMVgRMDlgyTUIFZ Received: from ppp118-209-53-63.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.53.63]) by ipmail06.adl6.internode.on.net with ESMTP; 24 Dec 2012 06:23:53 +1030 Message-ID: <1356292535.3135.2.camel@bozo.localdomain> Subject: Re: dev branch build issues From: Ken McDonell X-ASG-Orig-Subj: Re: dev branch build issues To: Nathan Scott Cc: pcp@oss.sgi.com Date: Mon, 24 Dec 2012 06:55:35 +1100 In-Reply-To: <743099991.56817266.1356048778324.JavaMail.root@redhat.com> References: <743099991.56817266.1356048778324.JavaMail.root@redhat.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1356292434 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117862 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On Thu, 2012-12-20 at 19:12 -0500, Nathan Scott wrote: > Hi Ken, > > From your earlier mail re RPM packaging pain and python, > [ http://oss.sgi.com/archives/pcp/2012-11/msg00084.html ] > the attached patch may help to work around it, not sure, > give it a crack and let me know. Its a hack. Yep, but it works in the one rpm case I've tried. > With your last set of changes, I see this in RPM builds > (this from a RHEL6.3 build): > ... > error: line 10: Empty tag: BuildRoot: I just pushed a commit into my dev tree to fix this ... sorry for the breakage. From kenj@internode.on.net Sun Dec 23 14:49:43 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBNKnhQZ257610 for ; Sun, 23 Dec 2012 14:49:43 -0600 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id EB33C8F804B for ; Sun, 23 Dec 2012 12:52:21 -0800 (PST) X-ASG-Debug-ID: 1356295936-04bdf04310219b00001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id NJqUs4RtMuaDyj8G for ; Sun, 23 Dec 2012 12:52:16 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApMBAJ5u11B20TU//2dsb2JhbAANN4Y6t1GDO4EFBgImAnKqE3CRcYEiizWBGoIWgRMDlgyBHJI0gVAk Received: from ppp118-209-53-63.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.53.63]) by ipmail06.adl6.internode.on.net with ESMTP; 24 Dec 2012 07:22:16 +1030 Message-ID: <1356296038.3135.4.camel@bozo.localdomain> Subject: pcp updates - rpm packaging From: Ken McDonell X-ASG-Orig-Subj: pcp updates - rpm packaging To: pcp@oss.sgi.com Date: Mon, 24 Dec 2012 07:53:58 +1100 Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1356295936 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.117864 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Second commit is critical, even if you don't want to take the first one. Changes committed to git://oss.sgi.com/kenj/pcp.git dev build/rpm/GNUmakefile | 2 +- src/include/builddefs.in | 5 ++++- 2 files changed, 5 insertions(+), 2 deletions(-) commit 4deec66ad1cbcc66c3c72f7000faf92085d4d3a9 Author: Ken McDonell Date: Mon Dec 24 07:51:57 2012 +1100 python packaging "fix" Commiting Nathan's hack so I can do rpm-based QA again. commit f9a8855e559bf976cb13e768043742a292ead44f Author: Ken McDonell Date: Mon Dec 24 07:49:14 2012 +1100 rpm packaging - fix small but critical typo If PCP_SYSCONF_DIR was spelled correctly, then cleanconfigs would not stash stuff away directly under / ... doh! Thank goodness for /var/log/pcp/install.log which is a temporary crutch while we sort out the wrinkles in this config file migration + packaging stuff. From kenj@internode.on.net Tue Dec 25 13:18:50 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBPJIoos161715 for ; Tue, 25 Dec 2012 13:18:50 -0600 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 5BB58304053 for ; Tue, 25 Dec 2012 11:21:31 -0800 (PST) X-ASG-Debug-ID: 1356463285-04cb6c05a5820f90001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id pfRzLW2OjAaws6JB for ; Tue, 25 Dec 2012 11:21:26 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApMBANv72VB20TU//2dsb2JhbAANN4Y6t0KDO4EFBgImAlMfqldwkgaBIos1gRqCFoETA5YMk1A Received: from ppp118-209-53-63.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.53.63]) by ipmail06.adl2.internode.on.net with ESMTP; 26 Dec 2012 05:51:24 +1030 Message-ID: <1356463388.3366.0.camel@bozo.localdomain> Subject: pcp updates From: Ken McDonell X-ASG-Orig-Subj: pcp updates To: pcp@oss.sgi.com Date: Wed, 26 Dec 2012 06:23:08 +1100 Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.2- Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1356463285 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.118045 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://oss.sgi.com/kenj/pcp.git dev qa/457 | 1 + qa/458 | 1 + qa/461 | 1 + 3 files changed, 3 insertions(+) commit 2824f94c41285d5b6ac2af0750808be52fa203b8 Author: Ken McDonell Date: Tue Dec 25 06:51:44 2012 +1100 qa/logger pmda - avoid first time infinite loop The pmda's Install script calls _choose_configfile() which will create $PCP_VAR_DIR/config/logger if it does not exist ... but the first time one of these QA tests is run the directory does not exist, the cp in the QA script to set things up fails and the Install script goes into an infinite loop. From chandana@desilva.id.au Sun Dec 30 00:38:58 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBU6cw5p140999 for ; Sun, 30 Dec 2012 00:38:58 -0600 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id D23B7AC001 for ; Sat, 29 Dec 2012 22:41:42 -0800 (PST) X-ASG-Debug-ID: 1356849701-04cbb035a48e4210001-S8gJnT Received: from mho-01-ewr.mailhop.org (mho-03-ewr.mailhop.org [204.13.248.66]) by cuda.sgi.com with ESMTP id YKLBAOjGmSHW2VKn (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sat, 29 Dec 2012 22:41:41 -0800 (PST) X-Barracuda-Envelope-From: chandana@desilva.id.au X-Barracuda-Apparent-Source-IP: 204.13.248.66 Received: from d210-49-168-202.sun801.vic.optusnet.com.au ([210.49.168.202] helo=mail.desilva.id.au) by mho-01-ewr.mailhop.org with esmtpa (Exim 4.72) (envelope-from ) id 1TpCaa-000NoW-MV for pcp@oss.sgi.com; Sun, 30 Dec 2012 06:41:40 +0000 Received: from [192.168.1.57] (unknown [192.168.1.57]) by mail.desilva.id.au (Postfix) with ESMTPSA id 8D28073D9 for ; Sun, 30 Dec 2012 17:38:42 +1100 (EST) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 210.49.168.202 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX1+9jt9qeO2G8IUKlkm3P/W+c6EQFr/3v3Q= Message-ID: <50DFE221.7050100@desilva.id.au> Date: Sun, 30 Dec 2012 17:41:37 +1100 From: Chandana De Silva Reply-To: chandana@desilva.id.au User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: proc.psinfo.stime Content-Type: text/plain; charset=ISO-8859-1; format=flowed X-ASG-Orig-Subj: proc.psinfo.stime Content-Transfer-Encoding: 7bit X-Barracuda-Connect: mho-03-ewr.mailhop.org[204.13.248.66] X-Barracuda-Start-Time: 1356849701 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.118442 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- I am trying to identify the process(s) which are consuming kernel resources on a system, using proc.psinfo.stime. However, this counter seems to be counting down, rather than up pmval -r -i 3008 proc.psinfo.stime metric: proc.psinfo.stime host: localhost semantics: cumulative counter units: millisec samples: all 3008 18446744049059337616 18446744049059311616 18446744049059286616 18446744049059270616 18446744049059248616 18446744049059220616 18446744049059188616 18446744049059167616 Can someone explain this to me, please ? From mgoodwin@redhat.com Sun Dec 30 15:26:29 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBULQTZU228225 for ; Sun, 30 Dec 2012 15:26:29 -0600 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 8613F304053 for ; Sun, 30 Dec 2012 13:29:14 -0800 (PST) X-ASG-Debug-ID: 1356902948-04cbb035a58fe2f0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id MyAi7aWriBHsIExG for ; Sun, 30 Dec 2012 13:29:09 -0800 (PST) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx01.intmail.prod.int.phx2.redhat.com (int-mx01.intmail.prod.int.phx2.redhat.com [10.5.11.11]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id qBULT7rn030289 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Sun, 30 Dec 2012 16:29:07 -0500 Received: from fletch.usersys.redhat.com (vpn1-51-249.bne.redhat.com [10.64.51.249]) by int-mx01.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBULT5Hp005884; Sun, 30 Dec 2012 16:29:06 -0500 Message-ID: <50E0B220.2080304@redhat.com> Date: Mon, 31 Dec 2012 08:29:04 +1100 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:13.0) Gecko/20120605 Thunderbird/13.0 MIME-Version: 1.0 To: chandana@desilva.id.au CC: pcp@oss.sgi.com Subject: Re: [pcp] proc.psinfo.stime References: <50DFE221.7050100@desilva.id.au> X-ASG-Orig-Subj: Re: [pcp] proc.psinfo.stime In-Reply-To: <50DFE221.7050100@desilva.id.au> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.67 on 10.5.11.11 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1356902948 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com On 12/30/2012 05:41 PM, Chandana De Silva wrote: > pmval -r -i 3008 proc.psinfo.stime Hi Chandana, it's not working for me either, e.g. : $ while true; do date >/dev/null; done & [3] 3266 $ pmval -r -i 3266 proc.psinfo.stime metric: proc.psinfo.stime host: localhost semantics: cumulative counter units: millisec samples: all 3266 18446744073696892616 18446744073696875616 18446744073696859616 18446744073696843616 18446744073696828616 18446744073696813616 I'll check the code - the metric item number is supposed to correspond to the field number (counting from 0) in /proc/PID/stat. Maybe that has come to grief or something or there is an error or overflow in the conversion from jiffies to milliseconds. $ pminfo -m proc.psinfo.stime proc.psinfo.stime PMID: 3.8.14 ----------^^ $ awk '{print $15}' /proc/3266/stat 18952 $ awk '{print $15}' /proc/3266/stat 19015 So the exported values fro mthe kernel look sane, but the values reported by pmval look suspiciously like they've wrapped : $ bc -q obase=16 18446744073696813616 FFFFFFFFFF3DA230 I'll investigate some more ... Regards -- Mark From chandana@desilva.id.au Sun Dec 30 15:34:35 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBULYZ1F228457 for ; Sun, 30 Dec 2012 15:34:35 -0600 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 57C508F8037 for ; Sun, 30 Dec 2012 13:37:23 -0800 (PST) X-ASG-Debug-ID: 1356903438-04cb6c05a892a9a0001-S8gJnT Received: from mho-01-ewr.mailhop.org (mho-03-ewr.mailhop.org [204.13.248.66]) by cuda.sgi.com with ESMTP id YGCKHW24V3pMtJWq (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sun, 30 Dec 2012 13:37:19 -0800 (PST) X-Barracuda-Envelope-From: chandana@desilva.id.au X-Barracuda-Apparent-Source-IP: 204.13.248.66 Received: from d210-49-168-202.sun801.vic.optusnet.com.au ([210.49.168.202] helo=mail.desilva.id.au) by mho-01-ewr.mailhop.org with esmtpa (Exim 4.72) (envelope-from ) id 1TpQZK-000GMA-H6; Sun, 30 Dec 2012 21:37:18 +0000 Received: from [192.168.1.57] (unknown [192.168.1.57]) by mail.desilva.id.au (Postfix) with ESMTPSA id C5A8F6EA4; Mon, 31 Dec 2012 08:34:20 +1100 (EST) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 210.49.168.202 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX1/i+GjP9FLN22T4lPFXgGJu9wHhVpJvddA= Message-ID: <50E0B40A.60002@desilva.id.au> Date: Mon, 31 Dec 2012 08:37:14 +1100 From: Chandana De Silva Reply-To: chandana@desilva.id.au User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: Mark Goodwin CC: pcp@oss.sgi.com Subject: Re: [pcp] proc.psinfo.stime References: <50DFE221.7050100@desilva.id.au> <50E0B220.2080304@redhat.com> X-ASG-Orig-Subj: Re: [pcp] proc.psinfo.stime In-Reply-To: <50E0B220.2080304@redhat.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: mho-03-ewr.mailhop.org[204.13.248.66] X-Barracuda-Start-Time: 1356903439 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.118497 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hello Mark, Thanks for your prompt response. If it is any help, this was from PCP 3.6.9 on a production machine running CentOS 5.5 x86_64. My laptop, running Ubuntu 12.04, with PCP 3.5.11 works correctly. Regards Chandana On 31/12/12 08:29, Mark Goodwin wrote: > On 12/30/2012 05:41 PM, Chandana De Silva wrote: >> pmval -r -i 3008 proc.psinfo.stime > > Hi Chandana, it's not working for me either, e.g. : > > $ while true; do date >/dev/null; done & > [3] 3266 > > $ pmval -r -i 3266 proc.psinfo.stime > > metric: proc.psinfo.stime > host: localhost > semantics: cumulative counter > units: millisec > samples: all > > 3266 > 18446744073696892616 > 18446744073696875616 > 18446744073696859616 > 18446744073696843616 > 18446744073696828616 > 18446744073696813616 > > I'll check the code - the metric item number is supposed to correspond > to the field number (counting from 0) in /proc/PID/stat. Maybe that has > come to grief or something or there is an error or overflow in the > conversion from jiffies to milliseconds. > > $ pminfo -m proc.psinfo.stime > proc.psinfo.stime PMID: 3.8.14 > ----------^^ > > $ awk '{print $15}' /proc/3266/stat > 18952 > $ awk '{print $15}' /proc/3266/stat > 19015 > > So the exported values fro mthe kernel look sane, but the values reported > by pmval look suspiciously like they've wrapped : > > $ bc -q > obase=16 > 18446744073696813616 > FFFFFFFFFF3DA230 > > I'll investigate some more ... > > Regards > -- Mark From mgoodwin@redhat.com Sun Dec 30 15:53:41 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,J_CHICKENPOX_61 autolearn=no version=3.4.0-r929098 Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBULrf5q229195 for ; Sun, 30 Dec 2012 15:53:41 -0600 Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 69089AC002 for ; Sun, 30 Dec 2012 13:56:26 -0800 (PST) X-ASG-Debug-ID: 1356904585-04bdf043123a47d0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id LlOFHwuhC4ZecqEv for ; Sun, 30 Dec 2012 13:56:25 -0800 (PST) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx01.intmail.prod.int.phx2.redhat.com (int-mx01.intmail.prod.int.phx2.redhat.com [10.5.11.11]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id qBULuOfS012599 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Sun, 30 Dec 2012 16:56:24 -0500 Received: from fletch.usersys.redhat.com (vpn1-51-249.bne.redhat.com [10.64.51.249]) by int-mx01.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBULuMsW011538; Sun, 30 Dec 2012 16:56:23 -0500 Message-ID: <50E0B886.8090009@redhat.com> Date: Mon, 31 Dec 2012 08:56:22 +1100 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:13.0) Gecko/20120605 Thunderbird/13.0 MIME-Version: 1.0 To: chandana@desilva.id.au CC: pcp@oss.sgi.com Subject: Re: [pcp] proc.psinfo.stime References: <50DFE221.7050100@desilva.id.au> <50E0B220.2080304@redhat.com> <50E0B40A.60002@desilva.id.au> X-ASG-Orig-Subj: Re: [pcp] proc.psinfo.stime In-Reply-To: <50E0B40A.60002@desilva.id.au> Content-Type: multipart/mixed; boundary="------------060909020008070103040304" X-Scanned-By: MIMEDefang 2.67 on 10.5.11.11 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1356904585 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com This is a multi-part message in MIME format. --------------060909020008070103040304 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit On 12/31/2012 08:37 AM, Chandana De Silva wrote: > On 31/12/12 08:29, Mark Goodwin wrote: >> On 12/30/2012 05:41 PM, Chandana De Silva wrote: >>... >> I'll check the code - the metric item number is supposed to correspond >> to the field number (counting from 0) in /proc/PID/stat. Maybe that has >> come to grief or something or there is an error or overflow in the >> conversion from jiffies to milliseconds. hz was not initialized, so we are multiplying by -1. This is a bug introduced when we split the proc PMDA off from the linux PMDA. Here's the patch to fix it (same fix also applies for proc.psinfo.utime and friends). Cheers -- Mark --------------060909020008070103040304 Content-Type: text/x-patch; name="proc_stime_fix.patch" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="proc_stime_fix.patch" diff --git a/src/pmdas/linux_proc/pmda.c b/src/pmdas/linux_proc/pmda.c index fee166d..f83d660 100644 --- a/src/pmdas/linux_proc/pmda.c +++ b/src/pmdas/linux_proc/pmda.c @@ -24,6 +24,7 @@ #include "dynamic.h" #include +#include #include #include #include @@ -857,7 +858,10 @@ proc_fetchCallBack(pmdaMetric *mdesc, unsigned int inst, pmAtomValue *atom) int *ip; proc_pid_entry_t *entry; struct filesys *fs; - static int hz = -1; + static long hz = -1; + + if (hz == -1) + hz = sysconf(_SC_CLK_TCK); if (mdesc->m_user != NULL) { /* @@ -973,11 +977,6 @@ proc_fetchCallBack(pmdaMetric *mdesc, unsigned int inst, pmAtomValue *atom) return PM_ERR_INST; sscanf(f, "%lu", &ul); - if (hz == -1) { - // TODO one trip initialization, same way - // proc_stat.hz is set in the linux PMDA - ; - } _pm_assign_ulong(atom, 1000 * (double)ul / hz); break; --------------060909020008070103040304-- From chandana@desilva.id.au Sun Dec 30 18:00:32 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBV00VXY236316 for ; Sun, 30 Dec 2012 18:00:31 -0600 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id C312BAC001 for ; Sun, 30 Dec 2012 16:03:16 -0800 (PST) X-ASG-Debug-ID: 1356912188-04cb6c05a592f900001-S8gJnT Received: from mho-02-ewr.mailhop.org (mho-04-ewr.mailhop.org [204.13.248.74]) by cuda.sgi.com with ESMTP id jHoZBoYOuabOVZm2 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sun, 30 Dec 2012 16:03:09 -0800 (PST) X-Barracuda-Envelope-From: chandana@desilva.id.au X-Barracuda-Apparent-Source-IP: 204.13.248.74 Received: from d210-49-168-202.sun801.vic.optusnet.com.au ([210.49.168.202] helo=mail.desilva.id.au) by mho-02-ewr.mailhop.org with esmtpa (Exim 4.72) (envelope-from ) id 1TpSqS-000AxW-BD; Mon, 31 Dec 2012 00:03:08 +0000 Received: from [192.168.1.57] (unknown [192.168.1.57]) by mail.desilva.id.au (Postfix) with ESMTPSA id 5FE016EA4; Mon, 31 Dec 2012 11:00:10 +1100 (EST) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 210.49.168.202 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX1/QBeNQmJqPU97ZiekXGKcTQFGf58ulStM= Message-ID: <50E0D638.6090300@desilva.id.au> Date: Mon, 31 Dec 2012 11:03:04 +1100 From: Chandana De Silva Reply-To: chandana@desilva.id.au User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: Mark Goodwin CC: pcp@oss.sgi.com Subject: Re: [pcp] proc.psinfo.stime References: <50DFE221.7050100@desilva.id.au> <50E0B220.2080304@redhat.com> <50E0B40A.60002@desilva.id.au> <50E0B886.8090009@redhat.com> X-ASG-Orig-Subj: Re: [pcp] proc.psinfo.stime In-Reply-To: <50E0B886.8090009@redhat.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: mho-04-ewr.mailhop.org[204.13.248.74] X-Barracuda-Start-Time: 1356912189 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.118506 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Mark, Thanks for that very quick turn around. I will try that out soon. Chandana On 31/12/12 08:56, Mark Goodwin wrote: > On 12/31/2012 08:37 AM, Chandana De Silva wrote: >> On 31/12/12 08:29, Mark Goodwin wrote: >>> On 12/30/2012 05:41 PM, Chandana De Silva wrote: > >>... >>> I'll check the code - the metric item number is supposed to correspond >>> to the field number (counting from 0) in /proc/PID/stat. Maybe that has >>> come to grief or something or there is an error or overflow in the >>> conversion from jiffies to milliseconds. > > > hz was not initialized, so we are multiplying by -1. This is a bug > introduced when we split the proc PMDA off from the linux PMDA. Here's > the patch to fix it (same fix also applies for proc.psinfo.utime > and friends). > > Cheers > -- Mark > > > > > > > > From nscott@redhat.com Mon Dec 31 17:29:58 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBVNTw9K084289 for ; Mon, 31 Dec 2012 17:29:58 -0600 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 9188CAC002 for ; Mon, 31 Dec 2012 15:32:43 -0800 (PST) X-ASG-Debug-ID: 1356996762-04cbb035a59372e0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id PdaljlNGqsf1SJwr for ; Mon, 31 Dec 2012 15:32:42 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBVNWes9024054; Mon, 31 Dec 2012 18:32:41 -0500 Date: Mon, 31 Dec 2012 18:32:40 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: chandana@desilva.id.au Cc: pcp@oss.sgi.com, "Frank Ch. Eigler" Message-ID: <1741565561.59675860.1356996760916.JavaMail.root@redhat.com> In-Reply-To: <50D6B1C5.8000201@desilva.id.au> Subject: Re: [pcp] Error starting pmlogger MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Error starting pmlogger Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.48.5] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1356996762 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.118595 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header ----- Original Message ----- > Frank, > > Thanks, but I don't think the src tarball has been updated. IIRC, I patched this in for fedora/EPEL only, via rpm patch. (checks) yep, so source fix is in dev only at this stage and will be in the next bugfix update (early to mid Jan) - along with a few other odds and ends by the look of my mail box. :) cheers. -- Nathan From nscott@redhat.com Mon Dec 31 17:51:37 2012 X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id qBVNpbgR085886 for ; Mon, 31 Dec 2012 17:51:37 -0600 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 69429304059 for ; Mon, 31 Dec 2012 15:54:26 -0800 (PST) X-ASG-Debug-ID: 1356998064-04cb6c05a6969dc0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id sCWKKgYRDgAXT78g for ; Mon, 31 Dec 2012 15:54:25 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id qBVNsOgx010150 for ; Mon, 31 Dec 2012 18:54:24 -0500 Date: Mon, 31 Dec 2012 18:54:24 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: PCP Message-ID: <1834632148.59679456.1356998064311.JavaMail.root@redhat.com> Subject: pcp updates: fixes from kenj, chandana & mgoodwin MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: fixes from kenj, chandana & mgoodwin Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.48.5] X-Mailer: Zimbra 7.2.0_GA_2669 (ZimbraWebClient - FF3.0 (Linux)/7.2.0_GA_2669) X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1356998065 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.118597 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://oss.sgi.com/pcp/pcp.git dev src/include/builddefs.in | 5 ++++- src/pmdas/linux_proc/pmda.c | 11 +++++------ src/pmdas/mysql/pmdamysql.pl | 4 ++++ 3 files changed, 13 insertions(+), 7 deletions(-) commit 79439fd813fa8d00c9ef513826e6f9ad5a532014 Author: Chandana De Silva Date: Tue Jan 1 10:51:40 2013 +1100 MySQL PMDA does not re-connect after a MySQL re-start The MySQL PMDA dies if the MySQL database is re-started, or if some other error error occurs while fetching data. This is the preliminary fix for this, which works for the database re-start use case. commit 5ab6b9d4e33456cb1d57752bbc0b86d98eb4e26a Author: Mark Goodwin Date: Tue Jan 1 10:47:29 2013 +1100 Ensure HZ is initialised in Linux proc PMDA. HZ was not initialized, so we are multiplying by -1 during certain calculations, and exporting incorrect values for some per-process CPU time metrics. This is a bug introduced when we split the proc PMDA off from the Linux PMDA. commit 1b092603c8be6caa29fe6ab0687c7cea914afeb3 Merge: 6713ef6 2824f94 Author: Nathan Scott Date: Tue Jan 1 10:44:15 2013 +1100 Merge branch 'dev' of git://oss.sgi.com/kenj/pcp into dev commit 6713ef664cf97ea5ad9cd8edcf93332d1c22ef30 Author: Nathan Scott Date: Tue Jan 1 10:43:52 2013 +1100 Workaround versioning issues between python and rpmbuild Evidently some versions of rpmbuild will create and install python object files late in the build process, which we can handle, but some versions do not. This change ensures that these files which we expect to exist, do. Hack; but gets a few distros building once more.