From ntindall@aconex.com Sun Feb 1 16:25:14 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 8E44B7F87 for ; Sun, 1 Feb 2015 16:25:14 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 60013304032 for ; Sun, 1 Feb 2015 14:25:11 -0800 (PST) X-ASG-Debug-ID: 1422829507-04bdf01eee9bce80001-S8gJnT Received: from postoffice2.aconex.com (mail.aconex.com [175.45.105.35]) by cuda.sgi.com with ESMTP id aUrulXA95HfJ9lG7 for ; Sun, 01 Feb 2015 14:25:08 -0800 (PST) X-Barracuda-Envelope-From: ntindall@aconex.com X-Barracuda-Apparent-Source-IP: 175.45.105.35 Received: from postoffice.aconex.com (postoffice.yarra.acx [192.168.35.100]) by postoffice2.aconex.com with ESMTP id h2GW3sv14UywadeY; Mon, 02 Feb 2015 09:25:05 +1100 (EST) Received: from gatekeeper.aconex.com (gatekeeper.yarra.acx [192.168.35.102]) by postoffice.aconex.com (Postfix) with ESMTP id 91EB13CE00A3; Mon, 2 Feb 2015 09:25:05 +1100 (EST) Received: from localhost (localhost.localdomain [127.0.0.1]) by gatekeeper.aconex.com (Postfix) with ESMTP id 8C8DB243A932; Mon, 2 Feb 2015 09:25:05 +1100 (EST) Received: from gatekeeper.aconex.com ([127.0.0.1]) by localhost (gatekeeper.aconex.com [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id 8eGRmWmDH6T6; Mon, 2 Feb 2015 09:25:03 +1100 (EST) Received: from localhost (localhost.localdomain [127.0.0.1]) by gatekeeper.aconex.com (Postfix) with ESMTP id EF17D243A91D; Mon, 2 Feb 2015 09:25:02 +1100 (EST) X-Virus-Scanned: amavisd-new at aconex.com Received: from gatekeeper.aconex.com ([127.0.0.1]) by localhost (gatekeeper.aconex.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id uYksNlLL4rQW; Mon, 2 Feb 2015 09:25:02 +1100 (EST) Received: from acxmail-au2.aconex.com (acxmail-au2.aconex.com [192.168.35.104]) by gatekeeper.aconex.com (Postfix) with ESMTP id D604D243A8CA; Mon, 2 Feb 2015 09:25:02 +1100 (EST) Received: from acxmail-au2.aconex.com (localhost.localdomain [127.0.0.1]) by acxmail-au2.aconex.com (Postfix) with ESMTP id C6E483B20003; Mon, 2 Feb 2015 09:25:02 +1100 (EST) Received: from localhost (localhost.localdomain [127.0.0.1]) by acxmail-au2.aconex.com (Postfix) with ESMTP id A796B3B20002; Mon, 2 Feb 2015 09:25:02 +1100 (EST) X-Virus-Scanned: amavisd-new at aconex.com Received: from acxmail-au2.aconex.com ([127.0.0.1]) by localhost (acxmail-au2.aconex.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 7mAOA-9G9UG9; Mon, 2 Feb 2015 09:25:02 +1100 (EST) Received: from acxmail-au2.aconex.com (localhost.localdomain [127.0.0.1]) by acxmail-au2.aconex.com (Postfix) with ESMTP id 68DC03B20001; Mon, 2 Feb 2015 09:25:02 +1100 (EST) Date: Mon, 2 Feb 2015 09:25:01 +1100 (EST) From: Nicholas Tindall To: Paul Smith Cc: David Arnold , Nathan Scott , pcp@oss.sgi.com Message-ID: <2050357788.23770.1422829501317.JavaMail.zimbra@aconex.com> In-Reply-To: <83264544-DAE1-4DC2-961E-9A1981B448C8@aconex.com> References: <2128760560.2058735.1422442489832.JavaMail.zimbra@redhat.com> <61046EB1-880B-45B8-B17F-4B9DDBCDD55C@aconex.com> <1BA04216-5431-4919-B95A-EF2BC4C68D12@pobox.com> <83264544-DAE1-4DC2-961E-9A1981B448C8@aconex.com> Subject: Re: [pcp] Relocation of Parfait MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Relocation of Parfait Content-Type: multipart/alternative; boundary="----=_Part_23769_2079246996.1422829501316" X-Originating-IP: [192.168.7.121] X-Mailer: Zimbra 8.0.7_GA_6037 (ZimbraWebClient - GC40 (Linux)/8.0.7_GA_6021) Thread-Topic: Relocation of Parfait Thread-Index: cAkfYwuI9pUu9Z4lBNWOMFKDW/NCNA== X-Virus-Scanned: by bsmtpd at aconex.com X-Barracuda-Connect: mail.aconex.com[175.45.105.35] X-Barracuda-Start-Time: 1422829507 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, HTML_MESSAGE, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14842 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 HTML_MESSAGE BODY: HTML included in message 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ------=_Part_23769_2079246996.1422829501316 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi All,=20 I've cloned the new GitHub repo and put the bulk of my changes up there (fo= r Dropwizard integration, https://github.com/nicktindall/parfai t). I'll up= date the docs and give the code a once-over before I submit a pull request.= Feel free to have a look and let me know if there's anything obviously mis= sing/wrong.=20 I'm planning to:=20 * Include a fluent builder in the ParfaitReporter similar to line 44 in= https://github.com/dropwizard/metrics/blob/master/metrics-ganglia/src/main= /java/com/codahale/metrics/ganglia/GangliaReporter.java . This seems to be = a pattern that most other Reporter implementations adhere to.=20 * Add some documentation in the form of a README.md=20 * Maybe reconsider the inclusion of Metric name translation. The only r= eason I included it is because PCP doesn't like hyphens in metric names, wh= ich appear in some of the out of the box MetricSets that come with Dropwiza= rd. I feel like it's not really a concern of the MetricAdapterFactory thoug= h.=20 Cheers,=20 Nick T=20 ----- Original Message ----- From: "Paul Smith" =20 To: "David Arnold" =20 Cc: "Nathan Scott" , "Nicholas Tindall" , pcp@oss.sgi.com=20 Sent: Saturday, 31 January, 2015 2:50:03 PM=20 Subject: Re: [pcp] Relocation of Parfait=20 >=20 >> I'm now at the point of considering deleting the Google site completely,= or somehow deprecating it. I think it better to delete it and not look lik= e it is rotting. Does anyone have an opinion?=20 >=20 > Is it possible to have it return a 301 (Moved Permanently) for a while? I= think that=E2=80=99ll help search engines, etc, find the new one.=20 Can't see a way unless it's part of the Delete process itself.=20 Paul=20 ------=_Part_23769_2079246996.1422829501316 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
Hi All,

I've cloned the new GitHub repo and put the bulk of my changes up there (f= or Dropwizard integration, https://github.com/nicktindall/parfait). I'll update the docs and giv= e the code a once-over before I submit a pull request. Feel free to have a = look and let me know if there's anything obviously missing/wrong.

I'm planning to:
Cheers,
Nick T
=

From: "Paul Smith" <psmith@aconex.com>
= To: "David Arnold" <davida@pobox.com>
Cc: "Nathan Sc= ott" <nathans@redhat.com>, "Nicholas Tindall" <ntindall@aconex.com= >, pcp@oss.sgi.com
Sent: Saturday, 31 January, 2015 2:50:03 PM=
Subject: Re: [pcp] Relocation of Parfait

> =
>> I'm now at the point of considering deleting the Google site c= ompletely, or somehow deprecating it.  I think it better to delete it = and not look like it is rotting. Does anyone have an opinion?
>
&= gt; Is it possible to have it return a 301 (Moved Permanently) for a while?=  I think that=E2=80=99ll help search engines, etc, find the new one.<= br>

Can't see a way unless it's part of the Delete process it= self.

Paul

------=_Part_23769_2079246996.1422829501316-- From nscott@redhat.com Sun Feb 1 18:24:27 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id EE9387F90 for ; Sun, 1 Feb 2015 18:24:26 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 7C677AC002 for ; Sun, 1 Feb 2015 16:24:23 -0800 (PST) X-ASG-Debug-ID: 1422836660-04cb6c2e6cbfcfc0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id DLUA1EKrEJdHxKBU (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sun, 01 Feb 2015 16:24:21 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t120OCfJ013336; Sun, 1 Feb 2015 19:24:13 -0500 Date: Sun, 1 Feb 2015 19:24:12 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Paul Smith , Michele Baldessari Cc: pcp@oss.sgi.com, Nicholas Tindall Message-ID: <1968411007.5031522.1422836652003.JavaMail.zimbra@redhat.com> In-Reply-To: <61046EB1-880B-45B8-B17F-4B9DDBCDD55C@aconex.com> References: <2128760560.2058735.1422442489832.JavaMail.zimbra@redhat.com> <61046EB1-880B-45B8-B17F-4B9DDBCDD55C@aconex.com> Subject: Re: [pcp] Relocation of Parfait MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Relocation of Parfait Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Relocation of Parfait Thread-Index: WHKc7RHeRmYMfuz7JEhYnx4SNhs2NQ== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1422836660 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14844 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Paul, ----- Original Message ----- > An update on progress and some further plans. > [...] > I will be building a small example webapp Maven module using DropWizard > outlining how to do a simple Hello World REST-based Webapp with full > DropWizard metrics and PCP integration. This will also provide me with a > test harness to do further modifications as required. Oh, that would be wonderful, thanks Paul - you've made my day. :) I also hope to come play in that sandpit soon, so this will be most helpful. > I hope to write up a Wiki page guiding people to set things up. Thanks. > Is the website editable? > (https://github.com/performancecopilot/pcp-website > ) I may look to create a > Pull request with changes to add details around Parfait. Yep, just send the pull request through however you like (github or email here) - someone (probably Michele, maybe me, maybe someone else) will pick it up, check & merge & update the web pages. If you find you need to do it alot, we can arrange that you join that team too and start editing the website more directly if that's helpful. cheers. -- Nathan From psmith@aconex.com Sun Feb 1 20:57:26 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 44FD07F90 for ; Sun, 1 Feb 2015 20:57:26 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id BA02DAC001 for ; Sun, 1 Feb 2015 18:57:22 -0800 (PST) X-ASG-Debug-ID: 1422845833-04cb6c2e6bbfec20001-S8gJnT Received: from postoffice2.aconex.com (mail.aconex.com [175.45.105.35]) by cuda.sgi.com with ESMTP id BZcdJTdCsGjgCe5X for ; Sun, 01 Feb 2015 18:57:14 -0800 (PST) X-Barracuda-Envelope-From: psmith@aconex.com X-Barracuda-Apparent-Source-IP: 175.45.105.35 Received: from postoffice.aconex.com (postoffice.yarra.acx [192.168.35.100]) by postoffice2.aconex.com with ESMTP id LDVVnxYjFeV9i1x9; Mon, 02 Feb 2015 13:57:12 +1100 (EST) Received: from gatekeeper.aconex.com (gatekeeper.yarra.acx [192.168.35.102]) by postoffice.aconex.com (Postfix) with ESMTP id 6BAA93CE00DB; Mon, 2 Feb 2015 13:57:12 +1100 (EST) Received: from localhost (localhost.localdomain [127.0.0.1]) by gatekeeper.aconex.com (Postfix) with ESMTP id 67C76243A91D; Mon, 2 Feb 2015 13:57:12 +1100 (EST) Received: from gatekeeper.aconex.com ([127.0.0.1]) by localhost (gatekeeper.aconex.com [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id 1-4JyYHSCPSQ; Mon, 2 Feb 2015 13:57:11 +1100 (EST) Received: from localhost (localhost.localdomain [127.0.0.1]) by gatekeeper.aconex.com (Postfix) with ESMTP id A87BD243A86D; Mon, 2 Feb 2015 13:57:11 +1100 (EST) X-Virus-Scanned: amavisd-new at aconex.com Received: from gatekeeper.aconex.com ([127.0.0.1]) by localhost (gatekeeper.aconex.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id gKXkN5yEh_kU; Mon, 2 Feb 2015 13:57:11 +1100 (EST) Received: from paul.engr.acx (paul.engr.acx [192.168.7.130]) by gatekeeper.aconex.com (Postfix) with ESMTPSA id 8EC9E243A86B; Mon, 2 Feb 2015 13:57:11 +1100 (EST) Content-Type: multipart/alternative; boundary="Apple-Mail=_1C1D9FCA-FB71-4256-8412-9DACB8581D6E" Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2070.6\)) Subject: Re: [pcp] Relocation of Parfait From: Paul Smith X-ASG-Orig-Subj: Re: [pcp] Relocation of Parfait In-Reply-To: <2050357788.23770.1422829501317.JavaMail.zimbra@aconex.com> Date: Mon, 2 Feb 2015 13:57:10 +1100 Cc: David Arnold , Nathan Scott , pcp@oss.sgi.com Message-Id: <341C5580-9902-49AB-8FC3-C87BDF0ED9EE@aconex.com> References: <2128760560.2058735.1422442489832.JavaMail.zimbra@redhat.com> <61046EB1-880B-45B8-B17F-4B9DDBCDD55C@aconex.com> <1BA04216-5431-4919-B95A-EF2BC4C68D12@pobox.com> <83264544-DAE1-4DC2-961E-9A1981B448C8@aconex.com> <2050357788.23770.1422829501317.JavaMail.zimbra@aconex.com> To: Nicholas Tindall X-Mailer: Apple Mail (2.2070.6) X-Virus-Scanned: by bsmtpd at aconex.com X-Barracuda-Connect: mail.aconex.com[175.45.105.35] X-Barracuda-Start-Time: 1422845833 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14846 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 HTML_MESSAGE BODY: HTML included in message 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain --Apple-Mail=_1C1D9FCA-FB71-4256-8412-9DACB8581D6E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii > On 2 Feb 2015, at 9:25 am, Nicholas Tindall = wrote: >=20 > Hi All, >=20 > I've cloned the new GitHub repo and put the bulk of my changes up = there (for Dropwizard integration, https://github.com/nicktindall/parfai = t). I'll update the docs and give = the code a once-over before I submit a pull request. Feel free to have a = look and let me know if there's anything obviously missing/wrong. >=20 Looks ok to me, and the proof is in the pudding, since you're running = this in production... it would know better than I would... I'd rather = capture this as it is, if that's what you're using. We can refine it = later. > I'm planning to: > Include a fluent builder in the ParfaitReporter similar to line 44 in = https://github.com/dropwizard/metrics/blob/master/metrics-ganglia/src/main= /java/com/codahale/metrics/ganglia/GangliaReporter.java = . This seems to = be a pattern that most other Reporter implementations adhere to. > Add some documentation in the form of a README.md > Maybe reconsider the inclusion of Metric name translation. The only = reason I included it is because PCP doesn't like hyphens in metric = names, which appear in some of the out of the box MetricSets that come = with Dropwizard. I feel like it's not really a concern of the = MetricAdapterFactory though. All the above are lovely things, probably could be done as subsequent = commits. If you do a pull request of what you have, the Travis CI build = should automatically test the Pull Request: https://travis-ci.org/performancecopilot/parfait/pull_requests = I can merge it, and spin a new RC release into oss.sonatype.com = , which you can change BIM to use, rather than = the 'special' build you've made locally; makes it more hunky-dory legit. Thanks Nick! Paul= --Apple-Mail=_1C1D9FCA-FB71-4256-8412-9DACB8581D6E Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii
On 2 Feb 2015, at 9:25 am, Nicholas Tindall <ntindall@aconex.com>= wrote:

Hi = All,

I've = cloned the new GitHub repo and put the bulk of my changes up there (for = Dropwizard integration, https://github.com/nicktindall/parfait). I'll update the = docs and give the code a once-over before I submit a pull request. Feel = free to have a look and let me know if there's anything obviously = missing/wrong.

Looks ok to me, and the = proof is in the pudding, since you're running this in production... it = would know better than I would...  I'd rather capture this as it = is, if that's what you're using.  We can refine it = later.

I'm= planning to:

All the above are lovely things, probably could be done = as subsequent commits.  If you do a pull request of what you have, = the Travis CI build should automatically test the Pull = Request:


I can merge it, and spin a new = RC release into oss.sonatype.com, which you can change BIM to use, rather = than the 'special' build you've made locally; makes it more hunky-dory = legit.

Thanks Nick!

Paul
= --Apple-Mail=_1C1D9FCA-FB71-4256-8412-9DACB8581D6E-- From nscott@redhat.com Mon Feb 2 02:59:48 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 1BDA47FBF for ; Mon, 2 Feb 2015 02:59:48 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id EED738F8035 for ; Mon, 2 Feb 2015 00:59:47 -0800 (PST) X-ASG-Debug-ID: 1422867576-04bdf01eee9c73a0001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id WdoY1OhI0hvCIpHX (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 02 Feb 2015 00:59:37 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t128xam0021198 for ; Mon, 2 Feb 2015 03:59:36 -0500 Date: Mon, 2 Feb 2015 03:59:36 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: PCP Message-ID: <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> In-Reply-To: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> Subject: Containers analysis with PCP MIME-Version: 1.0 X-ASG-Orig-Subj: Containers analysis with PCP Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF34 (Linux)/8.0.6_GA_5922) Thread-Topic: Containers analysis with PCP Thread-Index: ZO3Hj3eaUwN9Gf1K6JZX/8wcZH7CYg== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1422867577 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 1.02 X-Barracuda-Spam-Status: No, SCORE=1.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MV0613, BSF_SC0_SA717, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14852 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 1.00 BSF_SC0_MV0613 BSF_SC0_MV0613 0.00 BSF_SC0_SA717 Custom Rule BSF_SC0_SA717 Hi all, I've put a writeup of the current status of the container work here: http://pcp.io/docs/lab.containers.html Feel free to review & add to it. There's alot of work to be done in the area, so if anyone wants to hack on something container-related, just let me know! cheers. -- Nathan From pevans@redhat.com Mon Feb 2 11:10:11 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 22BD27FED for ; Mon, 2 Feb 2015 11:10:11 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id E90D68F8033 for ; Mon, 2 Feb 2015 09:10:07 -0800 (PST) X-ASG-Debug-ID: 1422897003-04bdf01eed9d3a00001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id z6zUGBmDnDtVhQxK (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 02 Feb 2015 09:10:03 -0800 (PST) X-Barracuda-Envelope-From: pevans@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t12HA2NB031016 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 2 Feb 2015 12:10:02 -0500 Received: from [10.36.4.46] (vpn1-4-46.ams2.redhat.com [10.36.4.46]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t12HA0it021879; Mon, 2 Feb 2015 12:10:01 -0500 Message-ID: <54CFAF63.1000200@redhat.com> Date: Mon, 02 Feb 2015 17:09:55 +0000 From: Paul Evans User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: nathan Scott , dave Brolley , pcp@oss.sgi.com Subject: NFS Server pmda Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: NFS Server pmda Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1422897003 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, I have been working on filling the gap with current PCP NFS coverage by designing a NFS Server pmda for review/inclusion. It has the same coverage for NFS Server a collectl and nfs-stat taking NFS server metrics from the data provided by /proc/net/rpc/nfsd interface. Changes committed to git://github.com/pauljevans/pcp.git dev qa/657 | 61 +++ qa/657.out | 840 +++++++++++++++++++++++++++++++++ qa/GNUmakefile | 3 +- qa/group | 1 + qa/nfsserver/GNUmakefile | 14 + qa/nfsserver/GNUmakefile.install | 1 + qa/nfsserver/nfsserver-root-3.17.8.tgz | Bin 0 -> 411 bytes src/pmdas/GNUmakefile | 3 +- src/pmdas/nfsserver/.gitignore | 4 + src/pmdas/nfsserver/GNUmakefile | 62 +++ src/pmdas/nfsserver/Install | 30 ++ src/pmdas/nfsserver/README | 58 +++ src/pmdas/nfsserver/Remove | 24 + src/pmdas/nfsserver/help | 383 +++++++++++++++ src/pmdas/nfsserver/nfsd.c | 185 ++++++++ src/pmdas/nfsserver/nfsd.h | 145 ++++++ src/pmdas/nfsserver/pmda.c | 670 ++++++++++++++++++++++++++ src/pmdas/nfsserver/pmdanfsserver.1 | 66 +++ src/pmdas/nfsserver/pmdanfsserver.h | 30 ++ src/pmdas/nfsserver/pmns | 171 +++++++ src/pmdas/nfsserver/root | 13 + src/pmns/stdpmid.pcp | 1 + 22 files changed, 2763 insertions(+), 2 deletions(-) commit 127b4e781d8a0d8cd6ca635ac866aebc76dd96b8 Author: Paul Evans Date: Mon Feb 2 16:08:45 2015 +0000 pmdanfsserver: Initial PMDA Code Initial version of a PMDA for reporting NFS Server stats given from the proc/net interface. DSO and Daemon running available, have reserved the next free domain number 136. Exporting statistics from the /proc/net/rpc/nfsd file. Using the values given there are stats for the replycache, filehandle, io, net rpc along with Server v2, v3 and v4. For the metric names am using the same naming scheme as collectl and have equal coverage in most cases and exceeding coverage with regards to v4 server stats. QA is provided with qa/657 which runs the pmda in DSO mode with a fake root, (again borrowed with work from xfs and used in the cifs pmda) to provide testing data. Code is checked with Coverity and has no reported issues or build warnings. All of the patches have been tested and have had covscan run on them. As always please let me know if there are any issues and feedback is welcome :). Cheers, Paul From brolley@redhat.com Mon Feb 2 14:49:32 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id E5A8E29E03 for ; Mon, 2 Feb 2015 14:49:31 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 822A7AC003 for ; Mon, 2 Feb 2015 12:49:28 -0800 (PST) X-ASG-Debug-ID: 1422910167-04bdf01eef9d90b0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id NVPLHpCF9Ks3jHZs (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 02 Feb 2015 12:49:27 -0800 (PST) X-Barracuda-Envelope-From: brolley@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t12KnQeU013850 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 2 Feb 2015 15:49:27 -0500 Received: from [10.10.60.196] (vpn-60-196.rdu2.redhat.com [10.10.60.196]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t12KnQiL014958 for ; Mon, 2 Feb 2015 15:49:26 -0500 Message-ID: <54CFE302.9000004@redhat.com> Date: Mon, 02 Feb 2015 15:50:10 -0500 From: Dave Brolley User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: PCP Mailing List Subject: pcp updates: build: fche: rhel5 pmwebd, cairo Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: build: fche: rhel5 pmwebd, cairo Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1422910167 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Changes committed to git://git.pcp.io/pcp.git dev Frank Ch. Eigler (2): pmwebd configury: BZ11069226 fixed, so reenable libmicrohttpd on rhel5 pmwebd configury: epel5 builds fine, so reenable cairo on rhel5 From nscott@redhat.com Mon Feb 2 16:10:48 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id CD5B97F58 for ; Mon, 2 Feb 2015 16:10:48 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 5B34BAC004 for ; Mon, 2 Feb 2015 14:10:45 -0800 (PST) X-ASG-Debug-ID: 1422915039-04cbb0416abe9780001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id hwC82cGBuWSa8yEE (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 02 Feb 2015 14:10:40 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t12MAbTt009470; Mon, 2 Feb 2015 17:10:37 -0500 Date: Mon, 2 Feb 2015 17:10:37 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Paul Evans Cc: pcp@oss.sgi.com Message-ID: <2063280794.5937221.1422915037777.JavaMail.zimbra@redhat.com> In-Reply-To: <54CFAF63.1000200@redhat.com> References: <54CFAF63.1000200@redhat.com> Subject: Re: NFS Server pmda MIME-Version: 1.0 X-ASG-Orig-Subj: Re: NFS Server pmda Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: NFS Server pmda Thread-Index: GaN1C9T7IT6Qxd1f0Gx9huTKGAui+Q== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1422915040 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14872 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi Paul, ----- Original Message ----- > Hi, > > I have been working on filling the gap with current PCP NFS coverage by > designing a NFS Server pmda for review/inclusion. It has the same > coverage for NFS Server a collectl and nfs-stat taking NFS server > metrics from the data provided by /proc/net/rpc/nfsd interface. > At first glance there would appear to be overlap with metrics from the Linux kernel PMDA - see the nfs.*, nfs3.*, nfs4.* and rpc.* metrics - are there some additional metrics added here that don't exist there? If yes, we should consider adding 'em into the kernel PMDA alongside the others; if no, the QA you've added here is still highly valuable - maybe it could be switched over to using the existing metrics? A python implementation of nfsstat(1) using the PMAPI would also be a handy addition (gives historical reporting, in particular) if you have any interest in hacking on monitor tools too? Along a similar vein, pmcollectl(1) could aquire the -s f (nfs) subsystem option to report NFS stats. cheers. -- Nathan From kenj@internode.on.net Tue Feb 3 02:31:39 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 89C747FD8 for ; Tue, 3 Feb 2015 02:31:39 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 69C2F8F8050 for ; Tue, 3 Feb 2015 00:31:36 -0800 (PST) X-ASG-Debug-ID: 1422952289-04cbb0416abf2b10001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id WMV6VtDGCE3mFcxs for ; Tue, 03 Feb 2015 00:31:30 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApUBAJuG0FR20Zu9/2dsb2JhbAANTYNYg1rBfIdYAQEBAQGFMwSBBwIFIQIRAlkIAQHGfHCWYoEhkUaBQQWSV4ckkQ+CJByBZFuCQgEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail07.adl2.internode.on.net with ESMTP; 03 Feb 2015 19:01:28 +1030 Message-ID: <54D08763.80100@internode.on.net> Date: Tue, 03 Feb 2015 19:31:31 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - duplicate names allowed in the PMNS by default Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - duplicate names allowed in the PMNS by default Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1422952289 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14892 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- There are quite a few changes here ... some review is probably warranted before pushing upstream. Everything sort of worked out, although I ran into a couple of nasty bugs that were not really related, but the PMNS changes exposed them and fixes for these are included in this batch. The only residual issues I have (and am seeking opinions of others) are ... Case 1 - libpcp_qmc libpcp_qmc/src/qmc_context.cpp if ((sts = pmNameID(pmid, &value)) >= 0) { This is a problem in ... QmcContext::lookupName(pmID pmid, QString **name) and there does not appear to be a comparable method to return a set of names. This is used in the higher level QmcContext::lookup(pmID pmid, QString **namePtr, ...) and both methods are public. This may be a non-problem as none of the libpcp_qmc users (pmdumptext, pmview, pmgadgets, pmtime and pmchart) actually calls QmcContext::lookup() or QmcContext::lookupName(). Case 2 - pmwebapi pmwebapi/pmwebapi.cxx rc = pmNameID (fieldvsp->pmid, &fieldname); rc = pmNameID (pvs->pmid, &metric_name); In both the places above, there appears to be an assumption that a PMID -> one name at most, and I can't see if that should be change, much less how it would be changed. Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (36): libpcp: change default pmLoadNameSpace behaviour qa/254: remove variant output qa/392: remove variant output dups in pmns: change pmns utilities qa/993: (new) exercise duplicate names in the pmns for pmlogger and pmdumplog sample PMDA: add sample.dupnames.* libpcp/pmgetopt.c: change -N and -n semantics libpcp: duplicate PMNS names allowed by default impl.h: add __pmPrintMetricNames prototype pminfo: duplicate PMNS names allowed by default pmlogger: duplicate PMNS names allowed by default dbpmda: duplicate PMNS names allowed by default pmcd: duplicate PMNS names allowed by default PMNS helper apps: reinstate -d pmdumplog: duplicate PMNS names allowed by default pmlogreduce: duplicate PMNS names allowed by default qa/admin/pcp-daily: tweak kenj's xhost command qa/src/multithread9.c: duplicate PMNS names allowed by default qa/src/nameall.c: duplicate PMNS names allowed by default qa/src/test_pcp.python: duplicate PMNS names allowed by default qa: duplicate PMNS names allowed by default man pages: drop -d documentation for pmns helpers chkhelp: duplicate PMNS names allowed by default solaris PMDA: duplicate PMNS names allowed by default pmevent: duplicate PMNS names allowed by default qa/765 & foo+ archive: more test fodder for pmlogsummary pmlogsummary: duplicate PMNS names allowed by default pmlogrewrite: bug fix and duplicate PMNS names qa/838: fix botched comment qa/930(new): pmlogrewrite and duplicate names in the PMNS pmlogrewrite: put back optimization in the absence of event records sample PMDA: add sample.dupnames.seconds as alias for sample.seconds pmlogcheck: duplicate PMNS names allowed by default qa/src/torture_api.c: another incorrect PMNS assumption qa: changes for addition of sample.dupnames.two.seconds qa: assorted .out remakes after recent sample PMDA changes man/man1/pmcd.1 | 6 man/man1/pminfo.1 | 6 man/man1/pmnsadd.1 | 7 man/man1/pmnsdel.1 | 7 man/man1/pmnsmerge.1 | 8 man/man3/pmloadasciinamespace.3 | 4 man/man3/pmloadnamespace.3 | 8 man/man3/pmnameid.3 | 9 man/man5/pmns.5 | 7 qa/.gitignore | 2 qa/014.out | 16 qa/029.out | 32 + qa/031.out.linux | 2 qa/048.out | 144 +++--- qa/098.out | 152 +++--- qa/100.out | 102 ++-- qa/101 | 3 qa/101.out | 152 +++--- qa/102.out | 2 qa/103 | 3 qa/103.out | 154 +++--- qa/104 | 3 qa/104.out | 152 +++--- qa/105 | 3 qa/105.out | 152 +++--- qa/106 | 3 qa/106.out | 152 +++--- qa/132.out | 2 qa/134.out | 4 qa/145 | 4 qa/145.out.nonsec | 8 qa/145.out.sec | 8 qa/146 | 8 qa/147.out | 12 qa/156 | 2 qa/156.out | 28 - qa/162.out | 10 qa/174.out | 36 - qa/177.out | 4 qa/179.out | 16 qa/218.out | 2 qa/235.out | 8 qa/236.out | 2 qa/245.out | 1 qa/248.out.2 | 24 - qa/249.out | 2 qa/254 | 20 qa/254.out | 17 qa/254.out.1 | 22 qa/254.out.2 | 17 qa/256.out | 46 ++ qa/257.out | 4 qa/273.out | 69 ++- qa/344.out | 88 +-- qa/392 | 48 -- qa/392.out | 55 +- qa/392.out.1 | 38 - qa/392.out.2 | 36 - qa/432.out | 4 qa/464.out | 2 qa/465.out.4 | 2 qa/475.out | 60 +- qa/509.out | 12 qa/531.out | 2 qa/533.out | 2 qa/569 | 9 qa/569.out | 51 ++ qa/574.out.linux | 2 qa/617.out.3 | 20 qa/633.out.2 | 3 qa/650.out | 37 - qa/660.out.46 | 82 ++- qa/726.out | 2 qa/762 | 26 + qa/762.out | 303 +++++++++++++ qa/765 | 26 + qa/765.out | 912 ++++++++++++++++++++++++++++++++++++++++ qa/838 | 73 +++ qa/838.out | 25 + qa/930 | 63 ++ qa/930.out | 124 +++++ qa/993 | 49 ++ qa/993.out | 21 qa/admin/pcp-daily | 2 qa/archives/GNUmakefile | 5 qa/archives/foo+.0 |binary qa/archives/foo+.index |binary qa/archives/foo+.meta |binary qa/archives/mk.foo+.sh | 31 + qa/group | 5 qa/src/multithread9.c | 61 +- qa/src/nameall.c | 11 qa/src/test_pcp.python | 19 qa/src/torture_api.c | 27 - src/dbpmda/src/util.c | 16 src/include/pcp/impl.h | 2 src/include/pcp/pmapi.h | 4 src/libpcp/src/events.c | 10 src/libpcp/src/exports | 5 src/libpcp/src/getopt.c | 6 src/libpcp/src/interp.c | 2 src/libpcp/src/pmns.c | 41 + src/libpcp/src/util.c | 23 - src/newhelp/chkhelp.c | 11 src/pmcd/pmcd.options | 5 src/pmcd/pmdaproc.sh | 4 src/pmcd/rc_pmcd | 2 src/pmcd/src/pmcd.c | 24 - src/pmdas/sample/pmns | 30 + src/pmdas/sample/src/sample.c | 43 - src/pmdas/solaris/solaris.c | 18 src/pmdumplog/pmdumplog.c | 63 +- src/pmevent/pmevent.c | 4 src/pminfo/pminfo.c | 16 src/pmlogcheck/pmlogcheck.c | 46 +- src/pmlogger/src/callback.c | 73 ++- src/pmlogger/src/dopdu.c | 9 src/pmlogreduce/dometric.c | 45 + src/pmlogrewrite/pmlogrewrite.c | 79 ++- src/pmlogsummary/pmlogcheck.c | 9 src/pmlogsummary/pmlogsummary.c | 96 ++-- src/pmns/Rebuild | 40 - src/pmns/pmnsadd | 11 src/pmns/pmnsdel.c | 18 src/pmns/pmnsmerge.c | 20 125 files changed From michele@acksyn.org Tue Feb 3 04:16:49 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=T_DKIM_INVALID autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 67DF67F9A for ; Tue, 3 Feb 2015 04:16:49 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 0465EAC006 for ; Tue, 3 Feb 2015 02:16:45 -0800 (PST) X-ASG-Debug-ID: 1422958600-04cb6c2e6ac22ae0001-S8gJnT Received: from palahniuk.acksyn.org (palahniuk.acksyn.org [5.9.7.26]) by cuda.sgi.com with ESMTP id qr3GOg80qspO1kg2 for ; Tue, 03 Feb 2015 02:16:40 -0800 (PST) X-Barracuda-Envelope-From: michele@acksyn.org X-Barracuda-Apparent-Source-IP: 5.9.7.26 Received: from localhost (localhost [127.0.0.1]) by palahniuk.acksyn.org (Postfix) with ESMTP id 5B49F295D2; Tue, 3 Feb 2015 05:00:53 -0500 (EST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=acksyn.org; h= user-agent:in-reply-to:content-disposition:content-type :content-type:mime-version:references:message-id:subject:subject :from:from:date:date:received:received; s=2010; t=1422957652; bh=qhK4VYNTfhJlB8Rpm66feyrrKgEgIny8LYZVwl/JxHo=; b=GxhmhpQxaXjr PPEXmY128puWEBtCeTfNA2rKVEgqxG+c6g6a5HQevYVwXHJRtVI31k+UhOA3Pg3L tz+W1B7SDlcT43LgZ9yd+H8jZ+NjwZcb19Y867lDGgg/ObzqK+wfhXR30dWvre4C eQrrOcgaPdKVLv7IlVk60SqO2joU1Ks= Received: from palahniuk.acksyn.org ([127.0.0.1]) by localhost (mail.acksyn.org [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 4q6GqPcb_6OK; Tue, 3 Feb 2015 05:00:52 -0500 (EST) Received: from localhost (unknown [213.175.37.10]) by palahniuk.acksyn.org (Postfix) with ESMTPSA id B630A2024C; Tue, 3 Feb 2015 05:00:52 -0500 (EST) Date: Tue, 3 Feb 2015 11:16:38 +0100 From: Michele Baldessari To: Nathan Scott Cc: Paul Smith , pcp@oss.sgi.com, Nicholas Tindall Subject: Re: [pcp] Relocation of Parfait Message-ID: <20150203101638.GC5410@fante.int.rhx> X-ASG-Orig-Subj: Re: [pcp] Relocation of Parfait References: <2128760560.2058735.1422442489832.JavaMail.zimbra@redhat.com> <61046EB1-880B-45B8-B17F-4B9DDBCDD55C@aconex.com> <1968411007.5031522.1422836652003.JavaMail.zimbra@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1968411007.5031522.1422836652003.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.5.21 (2012-12-30) X-Barracuda-Connect: palahniuk.acksyn.org[5.9.7.26] X-Barracuda-Start-Time: 1422958600 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14894 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature On Sun, Feb 01, 2015 at 07:24:12PM -0500, Nathan Scott wrote: > > Is the website editable? > > (https://github.com/performancecopilot/pcp-website > > ) I may look to create a > > Pull request with changes to add details around Parfait. > > Yep, just send the pull request through however you like (github or email here) - > someone (probably Michele, maybe me, maybe someone else) will pick it up, check & > merge & update the web pages. If you find you need to do it alot, we can arrange > that you join that team too and start editing the website more directly if that's > helpful. Sure thing, just drop me a line with the text you have in mind and I'll shape it up and commit, if you want Cheers, Michele -- Michele Baldessari C2A5 9DA3 9961 4FFB E01B D0BC DDD4 DCCB 7515 5C6D From pevans@redhat.com Tue Feb 3 09:13:52 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id D597C7FFA for ; Tue, 3 Feb 2015 09:13:52 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id C4C678F8065 for ; Tue, 3 Feb 2015 07:13:49 -0800 (PST) X-ASG-Debug-ID: 1422976424-04cbb0416abfba10001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id hc81Q1fmAeMsATBd (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 03 Feb 2015 07:13:45 -0800 (PST) X-Barracuda-Envelope-From: pevans@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t13FDhWr031408 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 3 Feb 2015 10:13:44 -0500 Received: from [10.36.4.216] (vpn1-4-216.ams2.redhat.com [10.36.4.216]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t13FDgrX018236; Tue, 3 Feb 2015 10:13:42 -0500 Message-ID: <54D0E5A5.6040000@redhat.com> Date: Tue, 03 Feb 2015 15:13:41 +0000 From: Paul Evans User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp@oss.sgi.com Subject: Re: NFS Server pmda References: <54CFAF63.1000200@redhat.com> <2063280794.5937221.1422915037777.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: NFS Server pmda In-Reply-To: <2063280794.5937221.1422915037777.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1422976425 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, On 02/02/15 22:10, Nathan Scott wrote: > At first glance there would appear to be overlap with metrics from the > Linux kernel PMDA - see the nfs.*, nfs3.*, nfs4.* and rpc.* metrics - > are there some additional metrics added here that don't exist there? Err, look like I missed that the nfs.*.reqs metrics had the different request types as instances. Pretty much everything that was to be added with nfsserver pmdas is already covered by the existing linux kernel pmda. > If yes, we should consider adding 'em into the kernel PMDA alongside > the others; if no, the QA you've added here is still highly valuable > - maybe it could be switched over to using the existing metrics? Please find below an update to qa/732 which tests the Linux Kernel PMDA's NFS metrics, I've added the test data from the previously posted work as a new nfsrpc-root and updated the 732.out to reflect these changes. Changes committed to git://github.com/pauljevans/pcp.git dev qa/732.out | 331 +++++++++++++++++++++++++++++++++++++++++++ qa/linux/nfsrpc-root-002.tgz | Bin 0 -> 569 bytes 2 files changed, 331 insertions(+) commit 062b0e02b96a83a446c44e87f50181ea7c55ea8c Author: Paul Evans Date: Tue Feb 3 14:25:30 2015 +0000 qa/732 - update with additional stats Have added additional stats for the qa/732 run which now run with a second nfsrpc-root. Have updated the 732.out to reflect the new output Cheers, Paul. From fche@redhat.com Tue Feb 3 09:23:50 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 241987FFA for ; Tue, 3 Feb 2015 09:23:50 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 105F48F8066 for ; Tue, 3 Feb 2015 07:23:49 -0800 (PST) X-ASG-Debug-ID: 1422977028-04cb6c2e6ac2a7b0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id Et6p0LAeYKHwQg3D (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 03 Feb 2015 07:23:49 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t13FNgeM015041 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Tue, 3 Feb 2015 10:23:43 -0500 Received: from fche.csb (vpn-230-55.phx2.redhat.com [10.3.230.55]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t13FNgKV019153; Tue, 3 Feb 2015 10:23:42 -0500 Received: by fche.csb (Postfix, from userid 2569) id 12B43584EA; Tue, 3 Feb 2015 10:23:38 -0500 (EST) To: Ken McDonell Cc: pcp@oss.sgi.com Subject: Re: pcp updates - duplicate names allowed in the PMNS by default References: <54D08763.80100@internode.on.net> X-ASG-Orig-Subj: Re: pcp updates - duplicate names allowed in the PMNS by default From: fche@redhat.com (Frank Ch. Eigler) Date: Tue, 03 Feb 2015 10:23:38 -0500 In-Reply-To: <54D08763.80100@internode.on.net> (Ken McDonell's message of "Tue, 03 Feb 2015 19:31:31 +1100") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1422977028 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 kenj wrote: > [...] > Case 2 - pmwebapi > pmwebapi/pmwebapi.cxx > rc = pmNameID (fieldvsp->pmid, &fieldname); > rc = pmNameID (pvs->pmid, &metric_name); > > In both the places above, there appears to be an assumption that a PMID > -> one name at most [...] A baby step could be just a documentation change, namely to inform pmwebapi users that the returned "name" field is -a- name for the PMID, rather than -the- name or -all- names. (The pmwebapi.3 man page doesn't even go into detail and calls that field self-explanatory.) A possible step would be to pass back all names for pmid-metadata, one could add a JSON vector subfield like "names": ["foo.bar", "foo.bar2"] to the /pmapi/NNNNN/_metric query. A likely necessary step would be to tweak the /_fetch code, so that the result "name":"NAME*" fields match up with the /_fetch?name=NAME requests. This would mean teaching pmwebapi_respond_metric_fetch() to store not just resolved "pmID *metrics;" but a vector of pre-resolved "metric-names". I can give that a go if you like. - FChE From minnus@buffalo.edu Tue Feb 3 10:50:04 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: ** X-Spam-Status: No, score=3.0 required=5.0 tests=TVD_SUBJ_NUM_OBFU_MINFP autolearn=no version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id F34EE8005 for ; Tue, 3 Feb 2015 10:50:03 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id E28518F8065 for ; Tue, 3 Feb 2015 08:50:00 -0800 (PST) X-ASG-Debug-ID: 1422982197-04cb6c2e6bc2d1f0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve8.acsu.buffalo.edu [128.205.6.19]) by cuda.sgi.com with ESMTP id cQKf7LhQWBCTdyV5 for ; Tue, 03 Feb 2015 08:49:57 -0800 (PST) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.6.19 Received: from localmailC.acsu.buffalo.edu (localmailc.acsu.buffalo.edu [128.205.5.204]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 4CDEDBB0 for ; Tue, 3 Feb 2015 11:49:57 -0500 (EST) Received: from localmailC.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 47074E765 for ; Tue, 3 Feb 2015 11:49:57 -0500 (EST) Received: from localmailC.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailC.acsu.buffalo.edu (Postfix) with ESMTP id 85809E762 for ; Tue, 3 Feb 2015 11:49:56 -0500 (EST) Received: from smtp.buffalo.edu (smtp2.acsu.buffalo.edu [128.205.5.254]) by localmailC.acsu.buffalo.edu (Prefixe) with ESMTP id 75FF7E761 for ; Tue, 3 Feb 2015 11:49:56 -0500 (EST) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 68A214664 for ; Tue, 3 Feb 2015 11:49:56 -0500 (EST) Message-ID: <54D0FC34.6070401@buffalo.edu> Date: Tue, 03 Feb 2015 11:49:56 -0500 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: "pcp@oss.sgi.com >> PCP" Subject: ganglia2pcp question Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: ganglia2pcp question Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve8.acsu.buffalo.edu[128.205.6.19] X-Barracuda-Start-Time: 1422982197 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14901 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi, I am starting to work on a ganglia to PCP archive converter as highlighted here: http://oss.sgi.com/bugzilla/show_bug.cgi?id=1078 Since rrd and pcp both have a perl api, the conversion is pretty straightforward. The one issue might be that the rrd files are already rate converted or averaged or whatever you want to call it. So for what PCP would consider counter metrics (network packets, bytes transferred, etc) ganglia gives you only the change between sampling intervals, not the raw counter value. This is not a problem when constructing an archive from existing ganglia files at a single point in time since you can accumulate the counter values, but might be an issue when you want to, for instance, convert ganglia archives to pcp format as a daily cron job for the previous 24 hour period. In this case, if you constructed a pcp archive each day containingin the previous 24 hours ganglia data, if you didn't do some sort of state saving, each metric would start off at a raw counter value of zero. Then at some later time, if you wanted to pmlogextract for a time period that spanned multiple of these converted logs, you would get a discontinuity when these "counters" reset to zero. Or does all this just get handled properly by client tools when they see the "MARK" records that pmlogextract would put in these locations? I haven't gotten far enough along to actually test what happens, was just wondering what I should expect. Thanks Martins From kenj@internode.on.net Tue Feb 3 14:02:32 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: ** X-Spam-Status: No, score=3.0 required=5.0 tests=TVD_SUBJ_NUM_OBFU_MINFP autolearn=no version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 7D4147F90 for ; Tue, 3 Feb 2015 14:02:32 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 6C2C6304032 for ; Tue, 3 Feb 2015 12:02:29 -0800 (PST) X-ASG-Debug-ID: 1422993746-04cb6c2e6bc33d50001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id EoJombK73EJ1Fqw6 for ; Tue, 03 Feb 2015 12:02:27 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApUBABso0VR20Zu9/2dsb2JhbAANTcxdgk8CgWEBAQEBAYUJAQEBAwE4QAYLCxgJFg8JAwIBAgFFEwgBAYghv2CXNwEBCAIBH49/FoQTAQSrEYQkgx0BAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail07.adl2.internode.on.net with ESMTP; 04 Feb 2015 06:32:25 +1030 Message-ID: <54D12955.1050805@internode.on.net> Date: Wed, 04 Feb 2015 07:02:29 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] ganglia2pcp question References: <54D0FC34.6070401@buffalo.edu> X-ASG-Orig-Subj: Re: [pcp] ganglia2pcp question In-Reply-To: <54D0FC34.6070401@buffalo.edu> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1422993746 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14906 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 04/02/15 03:49, Martins Innus wrote: > Hi, > > I am starting to work on a ganglia to PCP archive converter ... OK that sounds like a useful addition. > > In this case, if you constructed a pcp archive each day > containingin the previous 24 hours ganglia data, if you didn't do some > sort of state saving, each metric would start off at a raw counter value > of zero. Then at some later time, if you wanted to pmlogextract for a > time period that spanned multiple of these converted logs, you would get > a discontinuity when these "counters" reset to zero. Yep. In fact you'd get this discontinuity and a record at each archive boundary, independent of the counters being reset, because each pmlogger invocation starts a new session with pmcd and this may be because pmcd has been restarted or the machine rebooted, both of which would cause PMDA data to be reset. So I don't think this is any different to the status quo. > Or does all this just get handled properly by client tools when > they see the "MARK" records that pmlogextract would put in these locations? When records are encountered client tools using "interp" mode (and that is most of them that are used to replay an archive) see "No values" for fetches that where the fetch interval spans a record, and in the regions where there are no records, values are returned as normal. The much talked about, but not actually implemented, improved pmlogreduce would do a much better job of handling this situation by aggregation of values prior to the and after the and reporting the time averaged value over an interval containing one or more records. But this would be in a tool that converts one archive into another (smaller, with less data granularity) archive, not as a part of libpcp. > I haven't gotten far enough along to actually test what happens, > was just wondering what I should expect. To see what to expect ... install the sample PMDA start a pmlogger logging sample.pdu wait a while restart pmcd start another pmlogger logging sample.pdu wait a while kill the pmlogger merge the two archives with pmlogextract From kenj@internode.on.net Tue Feb 3 14:09:21 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id D35A57FA7 for ; Tue, 3 Feb 2015 14:09:21 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id B07FB304032 for ; Tue, 3 Feb 2015 12:09:21 -0800 (PST) X-ASG-Debug-ID: 1422994156-04cbb04168c04d30001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id Cix9dVeU4DdB5HC9 for ; Tue, 03 Feb 2015 12:09:17 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: Ap4BAG8q0VR20Zu9/2dsb2JhbAANTYNYWcUChXkCgWIBAQEBAYUJAQEBAwE4QAEFCwsYCRYPCQMCAQIBRQYNAQcBAYghv1yXNwEBAQEBAQEDAQEBAQEBARuPFhEBUAeEKQEEjSmFMUmGJo4Lgz2CJByBZFuBC4E3AQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail07.adl2.internode.on.net with ESMTP; 04 Feb 2015 06:39:16 +1030 Message-ID: <54D12AF0.5010303@internode.on.net> Date: Wed, 04 Feb 2015 07:09:20 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: "Frank Ch. Eigler" CC: pcp@oss.sgi.com Subject: Re: pcp updates - duplicate names allowed in the PMNS by default References: <54D08763.80100@internode.on.net> X-ASG-Orig-Subj: Re: pcp updates - duplicate names allowed in the PMNS by default In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1422994156 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14906 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header Thanks for the feedback Frank. On 04/02/15 02:23, Frank Ch. Eigler wrote: > ... > A baby step could be just a documentation change, namely to inform > pmwebapi users that the returned "name" field is -a- name for the > PMID, rather than -the- name or -all- names. (The pmwebapi.3 man page > doesn't even go into detail and calls that field self-explanatory.) I'll do that. > A possible step would be to pass back all names for pmid-metadata, one > could add a JSON vector subfield like > "names": ["foo.bar", "foo.bar2"] > to the /pmapi/NNNNN/_metric query. > > A likely necessary step would be to tweak the /_fetch code, so that > the result "name":"NAME*" fields match up with the /_fetch?name=NAME > requests. This would mean teaching pmwebapi_respond_metric_fetch() to > store not just resolved "pmID *metrics;" but a vector of pre-resolved > "metric-names". I can give that a go if you like. I am not sure it really worth it, until we have a real use case outside the sample PMDA. My goal was to make the core functionality robust after allowing duplicate PMNS names by default, and I think the two pieces I've found issues with can probably stay unchanged for the time being. In addition to the documentation change I might add a comment in the code (based on your email) so (a) the limitation is noted, and (b) the possible fix is not lost in the email archive bog. Thanks again. From nscott@redhat.com Tue Feb 3 17:16:57 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id AD1B57FF4 for ; Tue, 3 Feb 2015 17:16:57 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 8DF118F8089 for ; Tue, 3 Feb 2015 15:16:57 -0800 (PST) X-ASG-Debug-ID: 1423005410-04cbb04168c0b220001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id RB4RWFcqkt4OvAD8 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 03 Feb 2015 15:16:51 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t13NGn2W006167; Tue, 3 Feb 2015 18:16:49 -0500 Date: Tue, 3 Feb 2015 18:16:49 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus Cc: "pcp@oss.sgi.com >> PCP" Message-ID: <1038115318.6736926.1423005409130.JavaMail.zimbra@redhat.com> In-Reply-To: <54D0FC34.6070401@buffalo.edu> References: <54D0FC34.6070401@buffalo.edu> Subject: Re: [pcp] ganglia2pcp question MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] ganglia2pcp question Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: ganglia2pcp question Thread-Index: jzSlWlAxksfnDkjARKDFxLiv+YirVg== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1423005411 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14911 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Martins, ----- Original Message ----- > Hi, > > I am starting to work on a ganglia to PCP archive converter as > highlighted here: > > http://oss.sgi.com/bugzilla/show_bug.cgi?id=1078 > > Since rrd and pcp both have a perl api, the conversion is pretty > straightforward. The one issue might be that the rrd files are already > rate converted or averaged or whatever you want to call it. So for what > PCP would consider counter metrics (network packets, bytes transferred, > etc) ganglia gives you only the change between sampling intervals, not > the raw counter value. This is not a problem when constructing an > archive from existing ganglia files at a single point in time since you > can accumulate the counter values, Even here (but also in your later scenarios) it would be fine to export these values as instantaneous metrics instead of counters, provided the units are handled correctly. See the sar2pcp perl script for example - it has to deal with this same situation (everything's already been rate converted by sadf) - it uses only PM_SEM_INSTANT and PM_SEM_DISCRETE. cheers. -- Nathan From kenj@internode.on.net Tue Feb 3 20:20:32 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 9A24D7F8C for ; Tue, 3 Feb 2015 20:20:32 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 897568F8084 for ; Tue, 3 Feb 2015 18:20:32 -0800 (PST) X-ASG-Debug-ID: 1423016426-04cbb0416ac0ed00001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id 0m61qoMJPLBuJ9Aj for ; Tue, 03 Feb 2015 18:20:26 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AsMBAGSB0VR20Zu9/2dsb2JhbAANTYNYWYMBwgWHVgEBAQEBhTNVNgIFFgsCCwMCAQIBWAgBAcc0cJZ+gSGOdIJSgUEFhUyNDpg3hCRbgkIBAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail07.adl2.internode.on.net with ESMTP; 04 Feb 2015 12:50:07 +1030 Message-ID: <54D181DC.1000504@internode.on.net> Date: Wed, 04 Feb 2015 13:20:12 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - man pages, qa, ... Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - man pages, qa, ... Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1423016426 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14914 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (5): webapi man page: clarify that the name parameter semantics man pages: clean up some acronym use and explanation pmwebapi: annotate the code with Frank's comments re. the name parameter qa: assorted more minor fallout from recent sample PMDA changes qa/555: smack long standing failure man/man1/chkhelp.1 | 2 +- man/man1/newhelp.1 | 2 +- man/man1/pmlogcheck.1 | 2 +- man/man1/pmlogextract.1 | 2 +- man/man1/pmnsadd.1 | 2 +- man/man1/pmnsdel.1 | 2 +- man/man3/pmfetch.3 | 4 ++-- man/man3/pmnameall.3 | 2 +- man/man3/pmnameid.3 | 2 +- man/man3/pmwebapi.3 | 9 ++++++++- man/retired/pmnscomp.1 | 2 +- qa/014.out | 4 ++-- qa/029.out | 2 +- qa/273.out | 3 +++ qa/555 | 29 ++++++++++++++++++----------- src/pmwebapi/pmwebapi.cxx | 23 +++++++++++++++++++++++ 16 files changed From nscott@redhat.com Tue Feb 3 20:20:34 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id B28AC7F8C for ; Tue, 3 Feb 2015 20:20:34 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 9E9A48F8084 for ; Tue, 3 Feb 2015 18:20:31 -0800 (PST) X-ASG-Debug-ID: 1423016429-04cb6c2e6cc3d880001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id LSAzglAEKb79xIGY (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 03 Feb 2015 18:20:30 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t142KTEq047719 for ; Tue, 3 Feb 2015 21:20:29 -0500 Date: Tue, 3 Feb 2015 21:20:29 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "pcp@oss.sgi.com >> PCP" Message-ID: <278037320.6790899.1423016429038.JavaMail.zimbra@redhat.com> In-Reply-To: <1831378684.6790413.1423016167949.JavaMail.zimbra@redhat.com> Subject: pcp updates: docs, qa MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: docs, qa Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: docs, qa Thread-Index: 5/nGUqV1yREb7LDuwcMdzglHrAg8bA== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1423016429 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14914 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Nathan Scott (4): doc: improvements to html for tutorial rendering on pcp.io doc: improve the host dialog screenshots pmchart: add an extra optional chart colour scheme qa: fix namespace traversal indeterminism kenj hit in 758 man/html/images/pmchart_add_host_container.png |binary man/html/images/pmchart_add_host_secure.png |binary man/html/lab.auth.html | 7 ++--- man/html/lab.containers.html | 12 ++++---- man/html/lab.importdata.html | 7 ++--- man/html/lab.mmapvalues.html | 8 ++--- man/html/lab.pmchart.html | 7 ++--- man/html/lab.pmdas.html | 7 ++--- man/html/lab.pmie.html | 7 ++--- man/html/lab.pmieconf.html | 7 ++--- man/html/lab.pmlogconf.html | 6 ++-- man/html/lab.pmlogger.html | 7 ++--- man/html/lab.pmview.html | 7 ++--- man/html/lab.secure.html | 34 +++++++++++++------------ man/html/lab.trace.html | 7 ++--- man/html/pcpdoc.css | 8 ++++- qa/758 | 5 ++- src/pmchart/views/Schemes | 3 +- 18 files changed, 80 insertions(+), 59 deletions(-) From nscott@redhat.com Tue Feb 3 22:40:15 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id EA70B7FFD for ; Tue, 3 Feb 2015 22:40:14 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 85E29AC00E for ; Tue, 3 Feb 2015 20:40:11 -0800 (PST) X-ASG-Debug-ID: 1423024805-04cbb04167c11b00001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id 6y7rJHpRMTfPDH9N (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 03 Feb 2015 20:40:06 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t144e5dx018507 for ; Tue, 3 Feb 2015 23:40:05 -0500 Date: Tue, 3 Feb 2015 23:40:05 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "pcp@oss.sgi.com >> PCP" Message-ID: <1838902881.6952157.1423024805273.JavaMail.zimbra@redhat.com> In-Reply-To: <23273355.372.1423022546978.JavaMail.rmckee@wsrmckee> References: <23273355.372.1423022546978.JavaMail.rmckee@wsrmckee> Subject: Fwd: pmmgr memory hog MIME-Version: 1.0 X-ASG-Orig-Subj: Fwd: pmmgr memory hog Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pmmgr memory hog Thread-Index: +eW9hCoXZ4j6GfnFlfy59PgPuMLzF+fCApXs X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1423024806 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14918 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Bit of an older version, but I don't see any memory leak fixes from a quick scan of pmmgr git-log ... any ideas? ----- Forwarded Message ----- [...] Anyway, I have a pretty vanilla ubuntu host (openvpn virtual host). I installed pcp on it and have been noticing the memory use being high. Pretty small host, 2GB memory but 47% feels a bit much for pmmgr. Any thoughts? PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 1270 pcp 20 0 1349932 979308 2440 S 0.0 47.7 3400:22 pmmgr platform: Linux OVPNAS20 3.8.0-31-generic #46-Ubuntu SMP Tue Sep 10 20:03:44 UTC 2013 x86_64 hardware: 1 cpu, 1 disk, 1 node, 2003MB RAM timezone: AEDT-11 pmcd: Version 3.8.12-1, 6 agents, 2 clients pmda: pmcd proc xfs linux mmv jbd2 From nscott@redhat.com Wed Feb 4 00:52:05 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 796697FF2 for ; Wed, 4 Feb 2015 00:52:05 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 4B98E304062 for ; Tue, 3 Feb 2015 22:52:02 -0800 (PST) X-ASG-Debug-ID: 1423032719-04bdf01eeda0f160001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id lGJblw5BGOofkOfT (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 03 Feb 2015 22:51:59 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t146pxuU019565 for ; Wed, 4 Feb 2015 01:51:59 -0500 Date: Wed, 4 Feb 2015 01:51:59 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "pcp@oss.sgi.com >> PCP" Message-ID: <2137797653.7026201.1423032719078.JavaMail.zimbra@redhat.com> In-Reply-To: <516531745.7016365.1423031361915.JavaMail.zimbra@redhat.com> Subject: pcp updates: pevans+brolley+kenj merges MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: pevans+brolley+kenj merges Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: pevans+brolley+kenj merges Thread-Index: 05x6SbS44oTEPEfhk7Ec+MXVGRePnQ== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1423032719 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14921 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Ken McDonell (41): libpcp: change default pmLoadNameSpace behaviour qa/254: remove variant output qa/392: remove variant output dups in pmns: change pmns utilities qa/993: (new) exercise duplicate names in the pmns for pmlogger and pmdumplog sample PMDA: add sample.dupnames.* libpcp/pmgetopt.c: change -N and -n semantics libpcp: duplicate PMNS names allowed by default impl.h: add __pmPrintMetricNames prototype pminfo: duplicate PMNS names allowed by default pmlogger: duplicate PMNS names allowed by default dbpmda: duplicate PMNS names allowed by default pmcd: duplicate PMNS names allowed by default PMNS helper apps: reinstate -d pmdumplog: duplicate PMNS names allowed by default pmlogreduce: duplicate PMNS names allowed by default qa/admin/pcp-daily: tweak kenj's xhost command qa/src/multithread9.c: duplicate PMNS names allowed by default qa/src/nameall.c: duplicate PMNS names allowed by default qa/src/test_pcp.python: duplicate PMNS names allowed by default qa: duplicate PMNS names allowed by default man pages: drop -d documentation for pmns helpers chkhelp: duplicate PMNS names allowed by default solaris PMDA: duplicate PMNS names allowed by default pmevent: duplicate PMNS names allowed by default qa/765 & foo+ archive: more test fodder for pmlogsummary pmlogsummary: duplicate PMNS names allowed by default pmlogrewrite: bug fix and duplicate PMNS names qa/838: fix botched comment qa/930(new): pmlogrewrite and duplicate names in the PMNS pmlogrewrite: put back optimization in the absence of event records sample PMDA: add sample.dupnames.seconds as alias for sample.seconds pmlogcheck: duplicate PMNS names allowed by default qa/src/torture_api.c: another incorrect PMNS assumption qa: changes for addition of sample.dupnames.two.seconds qa: assorted .out remakes after recent sample PMDA changes webapi man page: clarify that the name parameter semantics man pages: clean up some acronym use and explanation pmwebapi: annotate the code with Frank's comments re. the name parameter qa: assorted more minor fallout from recent sample PMDA changes qa/555: smack long standing failure Dave Brolley (1): Eliminate dependencies on python-pcp for rhel 5. Nathan Scott (1): python: begin handling some python2/python3 packaging issues Paul Evans (1): qa/732 - update with additional stats build/rpm/fedora.spec | 8 man/man1/chkhelp.1 | 2 man/man1/newhelp.1 | 2 man/man1/pmcd.1 | 6 man/man1/pminfo.1 | 6 man/man1/pmlogcheck.1 | 2 man/man1/pmlogextract.1 | 2 man/man1/pmnsadd.1 | 9 man/man1/pmnsdel.1 | 9 man/man1/pmnsmerge.1 | 8 man/man3/pmfetch.3 | 4 man/man3/pmloadasciinamespace.3 | 4 man/man3/pmloadnamespace.3 | 8 man/man3/pmnameall.3 | 2 man/man3/pmnameid.3 | 11 man/man3/pmwebapi.3 | 9 man/man5/pmns.5 | 7 man/retired/pmnscomp.1 | 2 qa/.gitignore | 2 qa/014.out | 20 qa/029.out | 34 + qa/031.out.linux | 2 qa/048.out | 144 +++--- qa/098.out | 152 +++--- qa/100.out | 102 ++-- qa/101 | 3 qa/101.out | 152 +++--- qa/102.out | 2 qa/103 | 3 qa/103.out | 154 +++--- qa/104 | 3 qa/104.out | 152 +++--- qa/105 | 3 qa/105.out | 152 +++--- qa/106 | 3 qa/106.out | 152 +++--- qa/132.out | 2 qa/134.out | 4 qa/145 | 4 qa/145.out.nonsec | 8 qa/145.out.sec | 8 qa/146 | 8 qa/147.out | 12 qa/156 | 2 qa/156.out | 28 - qa/162.out | 10 qa/174.out | 36 - qa/177.out | 4 qa/179.out | 16 qa/218.out | 2 qa/235.out | 8 qa/236.out | 2 qa/245.out | 1 qa/248.out.2 | 24 - qa/249.out | 2 qa/254 | 20 qa/254.out | 17 qa/254.out.1 | 22 qa/254.out.2 | 17 qa/256.out | 46 ++ qa/257.out | 4 qa/273.out | 72 +++ qa/344.out | 88 +-- qa/392 | 48 -- qa/392.out | 55 +- qa/392.out.1 | 38 - qa/392.out.2 | 36 - qa/432.out | 4 qa/464.out | 2 qa/465.out.4 | 2 qa/475.out | 60 +- qa/509.out | 12 qa/531.out | 2 qa/533.out | 2 qa/555 | 29 - qa/569 | 9 qa/569.out | 51 ++ qa/574.out.linux | 2 qa/617.out.3 | 20 qa/633.out.2 | 3 qa/650.out | 37 - qa/660.out.46 | 82 ++- qa/726.out | 2 qa/732.out | 331 ++++++++++++++ qa/762 | 26 + qa/762.out | 303 +++++++++++++ qa/765 | 26 + qa/765.out | 912 ++++++++++++++++++++++++++++++++++++++++ qa/838 | 73 +++ qa/838.out | 25 + qa/930 | 63 ++ qa/930.out | 124 +++++ qa/993 | 49 ++ qa/993.out | 21 qa/GNUmakefile | 11 qa/admin/pcp-daily | 2 qa/archives/GNUmakefile | 5 qa/archives/foo+.0 |binary qa/archives/foo+.index |binary qa/archives/foo+.meta |binary qa/archives/mk.foo+.sh | 31 + qa/common.python | 1 qa/group | 5 qa/linux/nfsrpc-root-002.tgz |binary qa/pmdas/GNUmakefile | 8 qa/src/GNUlocaldefs | 7 qa/src/multithread9.c | 61 +- qa/src/nameall.c | 11 qa/src/test_pcp.python | 19 qa/src/torture_api.c | 27 - src/GNUmakefile | 12 src/dbpmda/src/util.c | 16 src/include/pcp/impl.h | 2 src/include/pcp/pmapi.h | 4 src/libpcp/src/events.c | 10 src/libpcp/src/exports | 5 src/libpcp/src/getopt.c | 6 src/libpcp/src/interp.c | 2 src/libpcp/src/pmns.c | 41 + src/libpcp/src/util.c | 23 - src/newhelp/chkhelp.c | 11 src/pmcd/pmcd.options | 5 src/pmcd/pmdaproc.sh | 4 src/pmcd/rc_pmcd | 2 src/pmcd/src/pmcd.c | 24 - src/pmdas/GNUmakefile | 6 src/pmdas/sample/pmns | 30 + src/pmdas/sample/src/sample.c | 43 - src/pmdas/simple/GNUmakefile | 7 src/pmdas/solaris/solaris.c | 18 src/pmdumplog/pmdumplog.c | 63 +- src/pmevent/pmevent.c | 4 src/pminfo/pminfo.c | 16 src/pmlogcheck/pmlogcheck.c | 46 +- src/pmlogger/src/callback.c | 73 ++- src/pmlogger/src/dopdu.c | 9 src/pmlogreduce/dometric.c | 45 + src/pmlogrewrite/pmlogrewrite.c | 79 ++- src/pmlogsummary/pmlogcheck.c | 9 src/pmlogsummary/pmlogsummary.c | 96 ++-- src/pmns/Rebuild | 40 - src/pmns/pmnsadd | 11 src/pmns/pmnsdel.c | 18 src/pmns/pmnsmerge.c | 20 src/pmwebapi/pmwebapi.cxx | 23 + 145 files changed, 3808 insertions(+), 1455 deletions(-) From myllynen@redhat.com Wed Feb 4 01:42:21 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id EAAA17F90 for ; Wed, 4 Feb 2015 01:42:21 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id D929E8F809E for ; Tue, 3 Feb 2015 23:42:18 -0800 (PST) X-ASG-Debug-ID: 1423035737-04cb6c2e6ac43e80001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id YPe4lmWvSgmXiHOY (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 03 Feb 2015 23:42:18 -0800 (PST) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t147gHSS017167 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 4 Feb 2015 02:42:17 -0500 Received: from mmyllyne.csb (vpn1-7-119.ams2.redhat.com [10.36.7.119]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t147gGI4001919 for ; Wed, 4 Feb 2015 02:42:16 -0500 Message-ID: <54D1CD57.80908@redhat.com> Date: Wed, 04 Feb 2015 09:42:15 +0200 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] NFS Server pmda References: <54CFAF63.1000200@redhat.com> <2063280794.5937221.1422915037777.JavaMail.zimbra@redhat.com> <54D0E5A5.6040000@redhat.com> X-ASG-Orig-Subj: Re: [pcp] NFS Server pmda In-Reply-To: <54D0E5A5.6040000@redhat.com> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423035738 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, On 2015-02-03 17:13, Paul Evans wrote: > On 02/02/15 22:10, Nathan Scott wrote: >> At first glance there would appear to be overlap with metrics from the >> Linux kernel PMDA - see the nfs.*, nfs3.*, nfs4.* and rpc.* metrics - >> are there some additional metrics added here that don't exist there? > Err, look like I missed that the nfs.*.reqs metrics had the different > request types as instances. Pretty much everything that was to be > added with nfsserver pmdas is already covered by the existing linux > kernel pmda. yes, you're not the first one missing the fact, perhaps we should add a quick note somewhere about this? http://oss.sgi.com/pipermail/pcp/2014-September/005578.html Thanks, -- Marko Myllynen From nscott@redhat.com Wed Feb 4 03:43:16 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id C59D37FB2 for ; Wed, 4 Feb 2015 03:43:16 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id B32BC30407B for ; Wed, 4 Feb 2015 01:43:13 -0800 (PST) X-ASG-Debug-ID: 1423042991-04cbb04169c16cc0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id LCTWgG6LoLrlTMpZ (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 04 Feb 2015 01:43:12 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t149hBqc014055; Wed, 4 Feb 2015 04:43:11 -0500 Date: Wed, 4 Feb 2015 04:43:11 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: myllynen@redhat.com, Paul Evans Cc: pcp@oss.sgi.com Message-ID: <2104856114.7133363.1423042991272.JavaMail.zimbra@redhat.com> In-Reply-To: <54D1CD57.80908@redhat.com> References: <54CFAF63.1000200@redhat.com> <2063280794.5937221.1422915037777.JavaMail.zimbra@redhat.com> <54D0E5A5.6040000@redhat.com> <54D1CD57.80908@redhat.com> Subject: Re: [pcp] NFS Server pmda MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] NFS Server pmda Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: NFS Server pmda Thread-Index: R07C8kHpuXbI3Y8VxLF3QXJJ1UG8oA== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1423042992 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14924 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi guys, ----- Original Message ----- > Hi, > > On 2015-02-03 17:13, Paul Evans wrote: > > On 02/02/15 22:10, Nathan Scott wrote: > >> At first glance there would appear to be overlap with metrics from the > >> Linux kernel PMDA - see the nfs.*, nfs3.*, nfs4.* and rpc.* metrics - > >> are there some additional metrics added here that don't exist there? > > Err, look like I missed that the nfs.*.reqs metrics had the different > > request types as instances. Pretty much everything that was to be > > added with nfsserver pmdas is already covered by the existing linux > > kernel pmda. > > yes, you're not the first one missing the fact, perhaps we should add a > quick note somewhere about this? *nod* - any ideas where it might go, that would be seen by someone going down this path? Maybe the issue is the existing metrics names not being expressive enough? cheers. -- Nathan From myllynen@redhat.com Wed Feb 4 03:54:20 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 546AB7FB2 for ; Wed, 4 Feb 2015 03:54:20 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 413698F8070 for ; Wed, 4 Feb 2015 01:54:20 -0800 (PST) X-ASG-Debug-ID: 1423043658-04cbb04168c16ee0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id d6J9qFAOuYsqSMQc (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 04 Feb 2015 01:54:18 -0800 (PST) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t149sHCm011002 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 4 Feb 2015 04:54:18 -0500 Received: from mmyllyne.csb (vpn1-7-119.ams2.redhat.com [10.36.7.119]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t149sGaV005606; Wed, 4 Feb 2015 04:54:16 -0500 Message-ID: <54D1EC47.9010004@redhat.com> Date: Wed, 04 Feb 2015 11:54:15 +0200 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Nathan Scott , Paul Evans CC: pcp@oss.sgi.com Subject: Re: [pcp] NFS Server pmda References: <54CFAF63.1000200@redhat.com> <2063280794.5937221.1422915037777.JavaMail.zimbra@redhat.com> <54D0E5A5.6040000@redhat.com> <54D1CD57.80908@redhat.com> <2104856114.7133363.1423042991272.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] NFS Server pmda In-Reply-To: <2104856114.7133363.1423042991272.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423043658 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, On 2015-02-04 11:43, Nathan Scott wrote: >> On 2015-02-03 17:13, Paul Evans wrote: >>> On 02/02/15 22:10, Nathan Scott wrote: >>>> At first glance there would appear to be overlap with metrics from the >>>> Linux kernel PMDA - see the nfs.*, nfs3.*, nfs4.* and rpc.* metrics - >>>> are there some additional metrics added here that don't exist there? >>> Err, look like I missed that the nfs.*.reqs metrics had the different >>> request types as instances. Pretty much everything that was to be >>> added with nfsserver pmdas is already covered by the existing linux >>> kernel pmda. >> >> yes, you're not the first one missing the fact, perhaps we should add a >> quick note somewhere about this? > > *nod* - any ideas where it might go, that would be seen by someone going > down this path? Maybe the issue is the existing metrics names not being > expressive enough? I think a big fat note in a README (e.g. under nfsclient PMDA dir) would probably have caught my attention. Thanks, -- Marko Myllynen From nscott@redhat.com Wed Feb 4 04:11:30 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id CFEBB7F9B for ; Wed, 4 Feb 2015 04:11:30 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id BC8728F8073 for ; Wed, 4 Feb 2015 02:11:27 -0800 (PST) X-ASG-Debug-ID: 1423044683-04cb6c2e6ac46750001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id RLH8fCKCgr6tlH4I (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 04 Feb 2015 02:11:24 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t14ABN8J017936 for ; Wed, 4 Feb 2015 05:11:23 -0500 Date: Wed, 4 Feb 2015 05:11:23 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "pcp@oss.sgi.com >> PCP" Message-ID: <230241964.7144646.1423044683027.JavaMail.zimbra@redhat.com> Subject: pcp updates: qa, docs MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: qa, docs Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: qa, docs Thread-Index: jwXrZ8mnojY8dELKnoC3cYH7/4VCew== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1423044683 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14924 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Nathan Scott (2): qa: resolve several failures after last round of merges docs: add a note in the nfs client PMDA source re server stats qa/257.out | 4 qa/660.out.4 | 332 +++++++++++++++++++++++++++++++++++++++++---- qa/660.out.46 | 18 +- qa/732 | 2 qa/838.out | 1 qa/common.webapi | 1 src/pmdas/nfsclient/README | 7 7 files changed, 329 insertions(+), 36 deletions(-) From kenj@internode.on.net Wed Feb 4 05:16:59 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id D9F487FA7 for ; Wed, 4 Feb 2015 05:16:59 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id B5AF830408B for ; Wed, 4 Feb 2015 03:16:56 -0800 (PST) X-ASG-Debug-ID: 1423048608-04bdf01eeca14150001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id 1jD2ktrDzqPlsWAG for ; Wed, 04 Feb 2015 03:16:49 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AigCABP/0VR20Zu9PGdsb2JhbAANTYNYWYMBaoJAvAaFb4FiAQEBAQEGAQEBATiEcRV2AgUhAhECMicIAQHHFHCXCIEhjnSCUoFBBZJamDeEJFuCQgEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 04 Feb 2015 21:46:25 +1030 Message-ID: <54D1FF9A.30602@internode.on.net> Date: Wed, 04 Feb 2015 22:16:42 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - qa/257 Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates - qa/257 Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423048609 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14925 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (1): qa/257.out: fixed up qa/257.out | 4 ---- 1 file changed From fche@redhat.com Wed Feb 4 10:32:32 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 1BADC7FA5 for ; Wed, 4 Feb 2015 10:32:32 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id AD39FAC005 for ; Wed, 4 Feb 2015 08:32:28 -0800 (PST) X-ASG-Debug-ID: 1423067546-04cbb04168c1f790001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id UoiZJxVQRYJktHyK (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 04 Feb 2015 08:32:27 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t14GWPNl028791 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 4 Feb 2015 11:32:26 -0500 Received: from fche.csb (vpn-230-75.phx2.redhat.com [10.3.230.75]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t14GWOF7008659; Wed, 4 Feb 2015 11:32:24 -0500 Received: by fche.csb (Postfix, from userid 2569) id D0BE258517; Wed, 4 Feb 2015 11:32:17 -0500 (EST) To: Nathan Scott Cc: "pcp@oss.sgi.com >> PCP" Subject: Re: Fwd: pmmgr memory hog References: <23273355.372.1423022546978.JavaMail.rmckee@wsrmckee> <1838902881.6952157.1423024805273.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: Fwd: pmmgr memory hog From: fche@redhat.com (Frank Ch. Eigler) Date: Wed, 04 Feb 2015 11:32:17 -0500 In-Reply-To: <1838902881.6952157.1423024805273.JavaMail.zimbra@redhat.com> (Nathan Scott's message of "Tue, 3 Feb 2015 23:40:05 -0500 (EST)") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423067547 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 > [...] > Anyway, I have a pretty vanilla ubuntu host (openvpn virtual host). > I installed pcp on it and have been noticing the memory use being high. > Pretty small host, 2GB memory but 47% feels a bit much for pmmgr. > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > 1270 pcp 20 0 1349932 979308 2440 S 0.0 47.7 3400:22 pmmgr > [...] The RES column sounds like a problem. Please describe the pmmgr version/configuration, lifespan of the process, pmmgr.log file, and whatever else looks relevant. The TIME+ column looks way too high also, as though there was a tight failure/retry loop in effect sometime. (commit 90ea027d3 fixes one possible trigger for this.) (The VIRT column is not necessarily a problem. The confluence of pmmgr & libpcp probe=NNN discovery multithreading has been seen to fragment the virtual address space pretty easily, but the vast majority of that space is unmapped. It may be possible to ease this particular aspect, but it's a separate, non-leak issue.) A more typical pmmgr top(1) report looks like this: PID USER NI VIRT RES SWAP vMj %CPU nTH TIME+ COMMAND 16477 pcp 0 4224352 6856 916 0.5 1 2:00.46 /usr/libexec/pcp/bin/pmmgr -l pmmgr.log or this: PID USER NI VIRT RES %CPU TIME+ SWAP nFLT COMMAND 3188 pcp 0 99220 2400 0.0 1:02.01 640 63 /usr/libexec/pcp/bin/pmmgr -l pmmgr.log - FChE From kenj@internode.on.net Wed Feb 4 14:50:25 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 2E1E97F83 for ; Wed, 4 Feb 2015 14:50:25 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id BA6C1AC002 for ; Wed, 4 Feb 2015 12:50:21 -0800 (PST) X-ASG-Debug-ID: 1423083014-04bdf01eefa23fa0001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id 3G0Z3CA9KQkpur43 for ; Wed, 04 Feb 2015 12:50:14 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AvoBACmF0lR20Zu9PGdsb2JhbAANTYNYWYMBgyq8D4ddAQEBAQEGAQEBATiEcRVANgIFFgsCCwMCAQIBMScIAQHHZnCWaYEhjnSCUoFBBZJgmDyEJFuCQgEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail04.adl6.internode.on.net with ESMTP; 05 Feb 2015 07:20:13 +1030 Message-ID: <54D28617.1090703@internode.on.net> Date: Thu, 05 Feb 2015 07:50:31 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - another single qa fix Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates - another single qa fix Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1423083014 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14938 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (1): qa/838: refine filter after recent PMNS duplicates changes qa/838 | 3 ++- qa/838.out | 1 - 2 files changed From jhanson@sgi.com Wed Feb 4 15:06:32 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=RP_MATCHES_RCVD autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 3CB737F9C for ; Wed, 4 Feb 2015 15:06:32 -0600 (CST) Received: from xmail.sgi.com (pv-excas3-dc21.corp.sgi.com [137.38.106.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 2B8138F8054 for ; Wed, 4 Feb 2015 13:06:29 -0800 (PST) Received: from carenath.corp.sgi.com (134.15.95.84) by xmail.sgi.com (137.38.106.6) with Microsoft SMTP Server (TLS) id 14.3.195.1; Wed, 4 Feb 2015 15:06:28 -0600 Message-ID: <54D289D4.8020307@sgi.com> Date: Wed, 4 Feb 2015 16:06:28 -0500 From: Jeff Hanson User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: PCP Subject: bmc on cmc in ICE X not responding Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit X-Originating-IP: [134.15.95.84] While I know you HATE cpower the problem is shown below with that tool What can be done to get the bmc back? cpower --verbose --debug --status --node r1i7c gives: Debug main thread condition wait Debug main thread condition release warning time out ipmitool -I lanplus -H 10.16.1.9 -U 'ADMIN' -P 'ADMIN' node is r1i7c Error:Too many timeouts communicating with BMC on r1i7c r1i7c: power is unknown Debug workerthread 140130184353536 condition acquire Debug workerthread 140130184353536 set running=false Debug workerthread 140130184353536 condition notify Debug workerthread 140130184353536 condition release Debug workerthread 140130184353536 condition done -- ----------------------------------------------------------------------- Jeff Hanson - jhanson@sgi.com - Field Technical Analyst You can choose a ready guide in some celestial voice. If you choose not to decide, you still have made a choice. You can choose from phantom fears and kindness that can kill; I will choose a path that's clear I will choose freewill. - Peart From jhanson@sgi.com Wed Feb 4 15:07:05 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=RP_MATCHES_RCVD autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 417E17F9C for ; Wed, 4 Feb 2015 15:07:05 -0600 (CST) Received: from xmail.sgi.com (pv-excas3-dc21.corp.sgi.com [137.38.106.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id B5057AC005 for ; Wed, 4 Feb 2015 13:07:01 -0800 (PST) Received: from carenath.corp.sgi.com (134.15.95.84) by xmail.sgi.com (137.38.106.6) with Microsoft SMTP Server (TLS) id 14.3.195.1; Wed, 4 Feb 2015 15:07:01 -0600 Message-ID: <54D289F4.7050909@sgi.com> Date: Wed, 4 Feb 2015 16:07:00 -0500 From: Jeff Hanson User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: PCP Subject: Re: [pcp] bmc on cmc in ICE X not responding References: <54D289D4.8020307@sgi.com> In-Reply-To: <54D289D4.8020307@sgi.com> Content-Type: text/plain; charset="windows-1252" Content-Transfer-Encoding: 7bit X-Originating-IP: [134.15.95.84] On 02/04/2015 04:06 PM, Jeff Hanson wrote: > While I know you HATE cpower the problem is shown below with that tool > What can be done to get the bmc back? > > cpower --verbose --debug --status --node r1i7c gives: > Debug main thread condition wait > Debug main thread condition release > warning time out > ipmitool -I lanplus -H 10.16.1.9 -U 'ADMIN' -P 'ADMIN' > node is r1i7c > Error:Too many timeouts communicating with BMC on r1i7c > r1i7c: power is unknown > Debug workerthread 140130184353536 condition acquire > Debug workerthread 140130184353536 set running=false > Debug workerthread 140130184353536 condition notify > Debug workerthread 140130184353536 condition release > Debug workerthread 140130184353536 condition done > AAARGGGHHHH. Never mind wrong pcp. -- ----------------------------------------------------------------------- Jeff Hanson - jhanson@sgi.com - Field Technical Analyst You can choose a ready guide in some celestial voice. If you choose not to decide, you still have made a choice. You can choose from phantom fears and kindness that can kill; I will choose a path that's clear I will choose freewill. - Peart From kenj@internode.on.net Wed Feb 4 23:57:19 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id A600A7FF3 for ; Wed, 4 Feb 2015 23:57:19 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 82DD88F8064 for ; Wed, 4 Feb 2015 21:57:19 -0800 (PST) X-ASG-Debug-ID: 1423115834-04cb6c2e6bc61b40001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id Y7PmKqnofCiLpi6Y for ; Wed, 04 Feb 2015 21:57:15 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AtcBAL4F01R20Zu9PGdsb2JhbAANTYpcv0CCTwKBYAEBAQEBBgEBAQE4hEgBAQSBCQsYCSUPAjIUEwgBAcZjlysBAQEHAgEfj38WhBMFqx6CJByBZIMdAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail04.adl6.internode.on.net with ESMTP; 05 Feb 2015 16:27:02 +1030 Message-ID: <54D30640.90901@internode.on.net> Date: Thu, 05 Feb 2015 16:57:20 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] Fwd: pmmgr memory hog References: <23273355.372.1423022546978.JavaMail.rmckee@wsrmckee> <1838902881.6952157.1423024805273.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Fwd: pmmgr memory hog In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1423115834 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14951 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 05/02/15 03:32, Frank Ch. Eigler wrote: > > ... > A more typical pmmgr top(1) report looks like this: My numbers from a random sample of machines are sort of like Frank's ... $ for host in bozo bozo-laptop bozo-vm vm01 vm03 vm11 grundy; do echo ${host}; ssh $host top -u pcp -n 1 -b | egrep 'RES|pmmgr'; done bozo PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 27384 pcp 20 0 196308 2820 1732 S 0.0 0.0 0:48.10 pmmgr bozo-laptop PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 21086 pcp 20 0 25140 2692 2000 S 0.0 0.1 0:02.46 pmmgr bozo-vm PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 4757 pcp 20 0 66600 3068 2248 S 0.0 0.1 0:04.27 pmmgr vm01 PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 21730 pcp 20 0 24688 2208 1660 S 0.0 0.4 0:01.98 pmmgr vm03 PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND vm11 PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 2072 pcp 20 0 21816 2268 1860 S 0.0 0.2 0:00.71 pmmgr grundy PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 26986 pcp 20 0 155m 8128 5440 S 0 0.0 0:18.11 pmmgr From kenj@internode.on.net Thu Feb 5 00:09:38 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 1E0517FF3 for ; Thu, 5 Feb 2015 00:09:38 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 0AC1A304051 for ; Wed, 4 Feb 2015 22:09:35 -0800 (PST) X-ASG-Debug-ID: 1423116572-04cb6c2e69c61eb0001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id O27FkpBH5Eqpe7bm for ; Wed, 04 Feb 2015 22:09:33 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AuYBABQI01R20Zu9PGdsb2JhbAANTYNYWYMBgyq8FodbAQEBAQEGAQEBATiEcVU2AgUWCwILAwIBAgExDhkIAQHGdHCWZ4EhjnSCUoFBBZJihyaRFoQkW4JCAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail04.adl6.internode.on.net with ESMTP; 05 Feb 2015 16:39:32 +1030 Message-ID: <54D3092F.4070903@internode.on.net> Date: Thu, 05 Feb 2015 17:09:51 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1423116572 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14951 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (4): qa/104[456]: activate paranoid debugging qa/257.out: die, die, die src/include/builddefs.in: harden up the LNMAKE macro pmwebapi/pmwebapi.cxx: add some diagnostics to help triage qa/660 failures qa/1044 | 7 +++++++ qa/1045 | 7 +++++++ qa/1046 | 7 +++++++ qa/257.out | 4 ---- src/include/builddefs.in | 4 ++-- src/pmwebapi/pmwebapi.cxx | 2 ++ 6 files changed, 25 insertions(+), 6 deletions(-) From kenj@internode.on.net Thu Feb 5 06:39:38 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id A8D977FF7 for ; Thu, 5 Feb 2015 06:39:38 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 88B64304032 for ; Thu, 5 Feb 2015 04:39:35 -0800 (PST) X-ASG-Debug-ID: 1423139971-04cbb04167c3e580001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id ynKQUt6hVvhXsX0C for ; Thu, 05 Feb 2015 04:39:32 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AhgCAMFj01R20Zu9PGdsb2JhbAANTYNYWYMBgyqyaYkwhW+BcwEBAQEBBgEBAQE4hHFVNgIFFgsCCwMCAQIBMScIAQHGfnCWZIEhjnSCUoFBBYVOjRaHJ5EdhCRbgkIBAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 05 Feb 2015 23:09:31 +1030 Message-ID: <54D36496.4040407@internode.on.net> Date: Thu, 05 Feb 2015 23:39:50 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - closing in on the duplicate names in the PMNS work Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - closing in on the duplicate names in the PMNS work Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423139972 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14957 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (1): pmdaproc.sh & sample PMDA: last piece of duplicate names in PMNS work src/pmcd/pmdaproc.sh | 132 +++++++++++++++++++++++++++++++++-------------- src/pmdas/sample/Install | 1 2 files changed From minnus@buffalo.edu Thu Feb 5 14:07:16 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: *** X-Spam-Status: No, score=3.0 required=5.0 tests=HTML_MESSAGE, TVD_SUBJ_NUM_OBFU_MINFP autolearn=no version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 8690B801F for ; Thu, 5 Feb 2015 14:07:16 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 754228F8037 for ; Thu, 5 Feb 2015 12:07:13 -0800 (PST) X-ASG-Debug-ID: 1423166831-04cbb0416ac4be60001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve8.acsu.buffalo.edu [128.205.6.19]) by cuda.sgi.com with ESMTP id xSVsew6dcJMjNXCf for ; Thu, 05 Feb 2015 12:07:11 -0800 (PST) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.6.19 Received: from localmailC.acsu.buffalo.edu (localmailc.acsu.buffalo.edu [128.205.5.204]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 4AFEF1176; Thu, 5 Feb 2015 15:07:11 -0500 (EST) Received: from localmailC.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 45A39118F2; Thu, 5 Feb 2015 15:07:11 -0500 (EST) Received: from localmailC.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailC.acsu.buffalo.edu (Postfix) with ESMTP id E45A4118ED; Thu, 5 Feb 2015 15:07:09 -0500 (EST) Received: from smtp.buffalo.edu (smtp4.acsu.buffalo.edu [128.205.5.229]) by localmailC.acsu.buffalo.edu (Prefixe) with ESMTP id D7B88118EB; Thu, 5 Feb 2015 15:07:09 -0500 (EST) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id CB8F34733; Thu, 5 Feb 2015 15:07:09 -0500 (EST) Message-ID: <54D3CD6D.3060303@buffalo.edu> Date: Thu, 05 Feb 2015 15:07:09 -0500 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Ken McDonell , pcp@oss.sgi.com, Nathan Scott Subject: Re: [pcp] ganglia2pcp question References: <54D0FC34.6070401@buffalo.edu> <54D12955.1050805@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] ganglia2pcp question In-Reply-To: <54D12955.1050805@internode.on.net> Content-Type: multipart/alternative; boundary="------------010102050208050700040809" X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve8.acsu.buffalo.edu[128.205.6.19] X-Barracuda-Start-Time: 1423166831 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14965 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 HTML_MESSAGE BODY: HTML included in message This is a multi-part message in MIME format. --------------010102050208050700040809 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Nathan and Ken, On 2/3/15 3:02 PM, Ken McDonell wrote: > On 04/02/15 03:49, Martins Innus wrote: >> Hi, >> >> I am starting to work on a ganglia to PCP archive converter ... > > OK that sounds like a useful addition. > >> >> In this case, if you constructed a pcp archive each day >> containingin the previous 24 hours ganglia data, if you didn't do some >> sort of state saving, each metric would start off at a raw counter value >> of zero. Then at some later time, if you wanted to pmlogextract for a >> time period that spanned multiple of these converted logs, you would get >> a discontinuity when these "counters" reset to zero. > > Yep. In fact you'd get this discontinuity and a record at each > archive boundary, independent of the counters being reset, because > each pmlogger invocation starts a new session with pmcd and this may > be because pmcd has been restarted or the machine rebooted, both of > which would cause PMDA data to be reset. > > So I don't think this is any different to the status quo. Thanks for the feedback. I'm done with the bulk of the work and now am getting a little tripped up on handling times/timezones. I found this conversation here: http://comments.gmane.org/gmane.comp.sysutils.pcp/3003 With the comment: "The hostname and timezone will default to the local host, but can be explicitly set after pmiStart() by calling pmiSetHostname() or pmiSetTimezone(). " But the examples I looked at (mover2pcp, iostat2pcp) explicitly set the timezone to UTC and only change it based on the presence of a command line option, ignoring, I think, what may be configured on the local host. Is that the way to go for default options? In our use case we'd always be setting an option for local time. The ganglia stats are already in unix time, so no conversion is needed there, but this would affect parsing start end/times, etc I think. Thanks Martins --------------010102050208050700040809 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: 8bit
Nathan and Ken,

On 2/3/15 3:02 PM, Ken McDonell wrote:
On 04/02/15 03:49, Martins Innus wrote:
Hi,

I am starting to work on a ganglia to PCP archive converter ...

OK that sounds like a useful addition.


     In this case, if you constructed a pcp archive each day
containingin the previous 24 hours ganglia data, if you didn't do some
sort of state saving, each metric would start off at a raw counter value
of zero.  Then at some later time, if you wanted to pmlogextract for a
time period that spanned multiple of these converted logs, you would get
a discontinuity when these "counters" reset to zero.

Yep.  In fact you'd get this discontinuity and a <mark> record at each archive boundary, independent of the counters being reset, because each pmlogger invocation starts a new session with pmcd and this may be because pmcd has been restarted or the machine rebooted, both of which would cause PMDA data to be reset.

So I don't think this is any different to the status quo.
Thanks for the feedback.  I'm done with the bulk of the work and now am getting a little tripped up on handling times/timezones. I found this conversation here:

http://comments.gmane.org/gmane.comp.sysutils.pcp/3003

With the comment:

"The hostname and timezone will default to the local host, but can be explicitly set after pmiStart() by calling pmiSetHostname() or pmiSetTimezone(). "

But the examples I looked at (mover2pcp, iostat2pcp) explicitly set the timezone to UTC and only change it based on the presence of a command line option, ignoring, I think, what may be configured on the local host.  Is that the way to go for default options?  In our use case we'd always be setting an option for local time.

The ganglia stats are already in unix time, so no conversion is needed there, but this would affect parsing start end/times, etc I think.

Thanks

Martins
--------------010102050208050700040809-- From kenj@internode.on.net Thu Feb 5 15:26:33 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id DB2FF8022 for ; Thu, 5 Feb 2015 15:26:33 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id C9CD38F8059 for ; Thu, 5 Feb 2015 13:26:30 -0800 (PST) X-ASG-Debug-ID: 1423171584-04cb6c2e6cc7a580001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id WIJBa0RYzDQCVEyT for ; Thu, 05 Feb 2015 13:26:25 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: As0BAHnf01R20Zu9PGdsb2JhbAANTYNYWYMBgyqybIkwh14BAQEBAQYBAQEBOIRxVTYCBRYLAgsDAgECATEnCAEBx1BwllyBIY50glKBQQWFUI0YhymRHoQkW4JCAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 06 Feb 2015 07:56:23 +1030 Message-ID: <54D3E013.7010304@internode.on.net> Date: Fri, 06 Feb 2015 08:26:43 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - dups in PMNS and qa Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - dups in PMNS and qa Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423171584 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14966 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- The last commit (pmdaproc.sh) is important as my initial attempt last night was incomplete. The qa/837 one removes a dozen or so failures for qa/897 (yes a different test!) from my QA failure matrix! Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (4): qa/740: was killing the primary pmlogger qa/837: was killing the primary pmlogger qa/check: add optional callback pmdaproc.sh: rework the duplictes in PMNS check qa/740 | 3 ++- qa/837 | 3 ++- qa/check | 4 ++++ src/pmcd/pmdaproc.sh | 47 ++++++++++++++++++++++++++++++++--------------- 4 files changed From nscott@redhat.com Thu Feb 5 16:48:14 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 6EAA28023 for ; Thu, 5 Feb 2015 16:48:14 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 40526304043 for ; Thu, 5 Feb 2015 14:48:14 -0800 (PST) X-ASG-Debug-ID: 1423176490-04bdf01eeea4cc40001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id d2pifcz1f1r1wggP (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 05 Feb 2015 14:48:10 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t15Mm9Jv003665; Thu, 5 Feb 2015 17:48:10 -0500 Date: Thu, 5 Feb 2015 17:48:09 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: "pcp@oss.sgi.com >> PCP" Message-ID: <1683339037.8571387.1423176489834.JavaMail.zimbra@redhat.com> In-Reply-To: References: <23273355.372.1423022546978.JavaMail.rmckee@wsrmckee> <1838902881.6952157.1423024805273.JavaMail.zimbra@redhat.com> Subject: Re: pmmgr memory hog MIME-Version: 1.0 X-ASG-Orig-Subj: Re: pmmgr memory hog Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pmmgr memory hog Thread-Index: tdKcsIdKg/L2jiY6irrcGghIYu4RWg== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1423176490 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14967 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > > [...] > > Anyway, I have a pretty vanilla ubuntu host (openvpn virtual host). > > I installed pcp on it and have been noticing the memory use being high. > > Pretty small host, 2GB memory but 47% feels a bit much for pmmgr. > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > > 1270 pcp 20 0 1349932 979308 2440 S 0.0 47.7 3400:22 pmmgr > > [...] > > The RES column sounds like a problem. *nod* & as reporter said, the 47.7 in %MEM -> ~1GB, matching RES. > Please describe the pmmgr version pcp(1) output from earlier mail contained - (this is Ubuntu LTS) pmcd: Version 3.8.12-1, 6 agents, 2 clients > configuration, lifespan of the process, pmmgr.log file, > and whatever else looks relevant. > [...] Here's the reply: | Well, ya know. Thats the thing, this thing just appeared after installing pcp. | By default it looks like it has no config and no logs that I can see | I guess if it's using alot of CPU then it's used that amount of time. | Current uptime is only 52 days. | Have made it go away by stopping it and preventing it from starting. So, sounds like no modification to the default setup, just switched it on by installing the pcp-manager package (different daemon start policy on deb vs rpm - enabled by default once installed). cheers. -- Nathan From fche@redhat.com Thu Feb 5 16:58:38 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 63A8D7F9C for ; Thu, 5 Feb 2015 16:58:38 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 4333C8F8054 for ; Thu, 5 Feb 2015 14:58:34 -0800 (PST) X-ASG-Debug-ID: 1423177113-04bdf01eeda4d0b0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id LC293NOYYcZRASYL (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 05 Feb 2015 14:58:34 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t15MwXNM011513 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 5 Feb 2015 17:58:33 -0500 Received: from fche.csb (vpn-230-75.phx2.redhat.com [10.3.230.75]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t15MwXDB031741; Thu, 5 Feb 2015 17:58:33 -0500 Received: by fche.csb (Postfix, from userid 2569) id 3157A585E3; Thu, 5 Feb 2015 17:58:22 -0500 (EST) Date: Thu, 5 Feb 2015 17:58:22 -0500 From: "Frank Ch. Eigler" To: Nathan Scott Cc: pcp@oss.sgi.com Subject: Re: pmmgr memory hog Message-ID: <20150205225822.GA28568@redhat.com> X-ASG-Orig-Subj: Re: pmmgr memory hog References: <23273355.372.1423022546978.JavaMail.rmckee@wsrmckee> <1838902881.6952157.1423024805273.JavaMail.zimbra@redhat.com> <1683339037.8571387.1423176489834.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1683339037.8571387.1423176489834.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423177114 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - > > Please describe the pmmgr version > > pcp(1) output from earlier mail contained - (this is Ubuntu LTS) > pmcd: Version 3.8.12-1, 6 agents, 2 clients OK, that's a bit more information. > | Have made it go away by stopping it and preventing it from starting. OK, that suggests they may be unable / unwilling to help debug further. Nevertheless, please ask the reporter to forward his/her /var/log/pcp/pmmgr/pmmgr.log* files. - FChE From nscott@redhat.com Thu Feb 5 17:04:30 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id ACF2D7F54 for ; Thu, 5 Feb 2015 17:04:30 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 3C288AC002 for ; Thu, 5 Feb 2015 15:04:27 -0800 (PST) X-ASG-Debug-ID: 1423177465-04cb6c2e6cc7d410001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id Eja4fGZtBG7oJPrr (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 05 Feb 2015 15:04:25 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t15N4PLu047244; Thu, 5 Feb 2015 18:04:25 -0500 Date: Thu, 5 Feb 2015 18:04:24 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: pcp@oss.sgi.com Message-ID: <1790828395.8575235.1423177464966.JavaMail.zimbra@redhat.com> In-Reply-To: <20150205225822.GA28568@redhat.com> References: <23273355.372.1423022546978.JavaMail.rmckee@wsrmckee> <1838902881.6952157.1423024805273.JavaMail.zimbra@redhat.com> <1683339037.8571387.1423176489834.JavaMail.zimbra@redhat.com> <20150205225822.GA28568@redhat.com> Subject: Re: pmmgr memory hog MIME-Version: 1.0 X-ASG-Orig-Subj: Re: pmmgr memory hog Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pmmgr memory hog Thread-Index: UI247wQjQ0ljx9AMnkqCslyZ3ek2Cg== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1423177465 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14968 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > > | Have made it go away by stopping it and preventing it from starting. > > OK, that suggests they may be unable / unwilling to help debug > further. Nevertheless, please ask the reporter to forward his/her > /var/log/pcp/pmmgr/pmmgr.log* files. I asked (yep, with full path), but none were forthcoming / found. What's our level of confidence re valgrind vs pmmgr? - could make a good pmmgr QA test. cheers. -- Nathan From nscott@redhat.com Thu Feb 5 17:21:54 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 773057F58 for ; Thu, 5 Feb 2015 17:21:54 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id EED14AC003 for ; Thu, 5 Feb 2015 15:21:53 -0800 (PST) X-ASG-Debug-ID: 1423178508-04cbb0416ac51170001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id 4lcZ4kCO5QlhiO5V (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 05 Feb 2015 15:21:49 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t15NLiJn012882; Thu, 5 Feb 2015 18:21:44 -0500 Date: Thu, 5 Feb 2015 18:21:43 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus Cc: Ken McDonell , pcp@oss.sgi.com Message-ID: <1766192388.8580939.1423178503985.JavaMail.zimbra@redhat.com> In-Reply-To: <54D3CD6D.3060303@buffalo.edu> References: <54D0FC34.6070401@buffalo.edu> <54D12955.1050805@internode.on.net> <54D3CD6D.3060303@buffalo.edu> Subject: Re: [pcp] ganglia2pcp question MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] ganglia2pcp question Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: ganglia2pcp question Thread-Index: y7iGSkfD0N1UIrhcQNcK2SQbHau2nA== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1423178509 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14970 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Martins, ----- Original Message ----- > "The hostname and timezone will default to the local host, but can be > explicitly set after pmiStart() by calling pmiSetHostname() or > pmiSetTimezone(). " > > But the examples I looked at (mover2pcp, iostat2pcp) explicitly set the > timezone to UTC and only change it based on the presence of a command > line option, ignoring, I think, what may be configured on the local > host. > > Is that the way to go for default options? In our use case we'd > always be setting an option for local time. > > The ganglia stats are already in unix time, so no conversion is needed > there, but this would affect parsing start end/times, etc I think. If you know for certain what the timezone on the host from which the metrics were collected is, its best to default to storing that in the log label. In the iostat case at least, this is not known though, IIRC. That data is often imported from text output sent from a customer system, without timezone info embedded in it. cheers. -- Nathan From fche@redhat.com Thu Feb 5 17:23:59 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 1064C7FA5 for ; Thu, 5 Feb 2015 17:23:59 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id E3F218F8054 for ; Thu, 5 Feb 2015 15:23:55 -0800 (PST) X-ASG-Debug-ID: 1423178634-04bdf01eeda4d870001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id GJthf2T3VpxeRwGP (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 05 Feb 2015 15:23:55 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t15NNst7030533 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 5 Feb 2015 18:23:54 -0500 Received: from fche.csb (vpn-230-75.phx2.redhat.com [10.3.230.75]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t15NNsnH009907; Thu, 5 Feb 2015 18:23:54 -0500 Received: by fche.csb (Postfix, from userid 2569) id 071DC5869B; Thu, 5 Feb 2015 18:23:42 -0500 (EST) Date: Thu, 5 Feb 2015 18:23:42 -0500 From: "Frank Ch. Eigler" To: Nathan Scott Cc: pcp@oss.sgi.com Subject: Re: pmmgr memory hog Message-ID: <20150205232342.GB28568@redhat.com> X-ASG-Orig-Subj: Re: pmmgr memory hog References: <23273355.372.1423022546978.JavaMail.rmckee@wsrmckee> <1838902881.6952157.1423024805273.JavaMail.zimbra@redhat.com> <1683339037.8571387.1423176489834.JavaMail.zimbra@redhat.com> <20150205225822.GA28568@redhat.com> <1790828395.8575235.1423177464966.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1790828395.8575235.1423177464966.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423178635 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - > > OK, that suggests they may be unable / unwilling to help debug > > further. Nevertheless, please ask the reporter to forward his/her > > /var/log/pcp/pmmgr/pmmgr.log* files. > > I asked (yep, with full path), but none were forthcoming / found. Too bad. > What's our level of confidence re valgrind vs pmmgr? - could make > a good pmmgr QA test. Inserting a "valgrind" into qa/666:75 generates all-clean results. The larger memory consumption comes in when scanning network with the probe/avahi discoveries, which that test case doesn't do (since it's necessarily site-specific). I've run valgrind on pmmgr in the past against a larger network-scanny installation, and again no complaints. Am rerunning now. - FChE From fche@redhat.com Thu Feb 5 17:36:55 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 9E0978017 for ; Thu, 5 Feb 2015 17:36:55 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 8AB5C8F8040 for ; Thu, 5 Feb 2015 15:36:55 -0800 (PST) X-ASG-Debug-ID: 1423179414-04cbb04168c51540001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id Q43nqiZcY6WYFMTf (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 05 Feb 2015 15:36:54 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t15Narmt023245 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 5 Feb 2015 18:36:53 -0500 Received: from fche.csb (vpn-230-75.phx2.redhat.com [10.3.230.75]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t15Narwg013103; Thu, 5 Feb 2015 18:36:53 -0500 Received: by fche.csb (Postfix, from userid 2569) id 33F3B5869B; Thu, 5 Feb 2015 18:36:42 -0500 (EST) Date: Thu, 5 Feb 2015 18:36:42 -0500 From: "Frank Ch. Eigler" To: Nathan Scott Cc: pcp@oss.sgi.com Subject: Re: pmmgr memory hog Message-ID: <20150205233642.GA1910@redhat.com> X-ASG-Orig-Subj: Re: pmmgr memory hog References: <23273355.372.1423022546978.JavaMail.rmckee@wsrmckee> <1838902881.6952157.1423024805273.JavaMail.zimbra@redhat.com> <1683339037.8571387.1423176489834.JavaMail.zimbra@redhat.com> <20150205225822.GA28568@redhat.com> <1790828395.8575235.1423177464966.JavaMail.zimbra@redhat.com> <20150205232342.GB28568@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20150205232342.GB28568@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423179414 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - I wrote: > [...] I've run valgrind on pmmgr in the past against a larger > network-scanny installation, and again no complaints. Am rerunning > now. A brief scanny run now produces actual valgrind leak reports ... all within libpcp, not pmmgr: ==17174== HEAP SUMMARY: ==17174== in use at exit: 203,575 bytes in 114 blocks ==17174== total heap usage: 240,631 allocs, 240,517 frees, 60,114,048 bytes allocated ==17174== ==17174== 324 (72 direct, 252 indirect) bytes in 9 blocks are definitely lost in loss record 14 of 21 ==17174== at 0x4C2B946: calloc (in /usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so) ==17174== by 0x4E80824: __pmHashAdd (hash.c:51) ==17174== by 0x4E6D346: parseAttributeSpec (spec.c:842) ==17174== by 0x4E6D346: __pmParseHostAttrsSpec (spec.c:937) ==17174== by 0x4E49545: pmNewContext (context.c:468) ==17174== by 0x116B8A: pmmgr_job_spec::compute_hostid(std::string const&) (pmmgr.cxx:236) ==17174== by 0x1178A6: pmmgr_job_spec::poll() (pmmgr.cxx:430) ==17174== by 0x10DE48: main (pmmgr.cxx:1313) ==17174== ==17174== 1,509 bytes in 50 blocks are definitely lost in loss record 16 of 21 ==17174== at 0x4C29BCF: malloc (in /usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so) ==17174== by 0x5B87129: strdup (strdup.c:42) ==17174== by 0x4E70B94: posix_formatter (config.c:159) ==17174== by 0x4E70EA3: __pmConfig (config.c:218) ==17174== by 0x4E71069: pmGetConfig (config.c:242) ==17174== by 0x10DA53: main (pmmgr.cxx:1201) ==17174== ==17174== LEAK SUMMARY: ==17174== definitely lost: 1,581 bytes in 59 blocks ==17174== indirectly lost: 252 bytes in 18 blocks ==17174== possibly lost: 0 bytes in 0 blocks ==17174== still reachable: 201,742 bytes in 37 blocks ==17174== suppressed: 0 bytes in 0 blocks ==17174== Reachable blocks (those to which a pointer was found) are not shown. ==17174== To see them, rerun with: --leak-check=full --show-leak-kinds=all - FChE From nscott@redhat.com Thu Feb 5 17:43:44 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id CC61F802B for ; Thu, 5 Feb 2015 17:43:44 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id BA7658F8064 for ; Thu, 5 Feb 2015 15:43:44 -0800 (PST) X-ASG-Debug-ID: 1423179822-04cbb04167c51730001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id Rpq3pCvaauayz58i (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 05 Feb 2015 15:43:43 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t15NhgSg009229; Thu, 5 Feb 2015 18:43:42 -0500 Date: Thu, 5 Feb 2015 18:43:42 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: pcp@oss.sgi.com Message-ID: <917283598.8588833.1423179822440.JavaMail.zimbra@redhat.com> In-Reply-To: <20150205232342.GB28568@redhat.com> References: <23273355.372.1423022546978.JavaMail.rmckee@wsrmckee> <1838902881.6952157.1423024805273.JavaMail.zimbra@redhat.com> <1683339037.8571387.1423176489834.JavaMail.zimbra@redhat.com> <20150205225822.GA28568@redhat.com> <1790828395.8575235.1423177464966.JavaMail.zimbra@redhat.com> <20150205232342.GB28568@redhat.com> Subject: Re: pmmgr memory hog MIME-Version: 1.0 X-ASG-Orig-Subj: Re: pmmgr memory hog Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pmmgr memory hog Thread-Index: fDyaL8lhG7O4/7HEf90gp4AEetAOHw== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1423179823 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14970 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > Inserting a "valgrind" into qa/666:75 generates all-clean results. > The larger memory consumption comes in when scanning network with the > probe/avahi discoveries, Is that enabled by default though? I'd expect not (esp. the network scanning... right?), in which case that wont be the root cause here. > I've run valgrind on pmmgr in the past > [...snip testing-by-hand notes...] > Am rerunning now. A permanent QA test helps beyond just the immediate concern, of course; for the next person hacking on pmmgr & accidentally introducing a leak, so please do give it some thought. cheers. -- Nathan From nscott@redhat.com Thu Feb 5 18:20:34 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 434077F50 for ; Thu, 5 Feb 2015 18:20:34 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 2272E304039 for ; Thu, 5 Feb 2015 16:20:31 -0800 (PST) X-ASG-Debug-ID: 1423182028-04bdf01eefa4e9d0001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id BeyOBO58pWpOfKm9 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 05 Feb 2015 16:20:29 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t160KRv5060118; Thu, 5 Feb 2015 19:20:27 -0500 Date: Thu, 5 Feb 2015 19:20:27 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: pcp@oss.sgi.com Message-ID: <1155257352.8599325.1423182027804.JavaMail.zimbra@redhat.com> In-Reply-To: <20150205233642.GA1910@redhat.com> References: <23273355.372.1423022546978.JavaMail.rmckee@wsrmckee> <1838902881.6952157.1423024805273.JavaMail.zimbra@redhat.com> <1683339037.8571387.1423176489834.JavaMail.zimbra@redhat.com> <20150205225822.GA28568@redhat.com> <1790828395.8575235.1423177464966.JavaMail.zimbra@redhat.com> <20150205232342.GB28568@redhat.com> <20150205233642.GA1910@redhat.com> Subject: Re: pmmgr memory hog MIME-Version: 1.0 X-ASG-Orig-Subj: Re: pmmgr memory hog Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pmmgr memory hog Thread-Index: z9OwzESzDXoEX4d+EmV7NVkxIfUQSQ== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1423182029 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14971 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > [...] > A brief scanny run now produces actual valgrind leak reports ... It could be this first one is part of the issue - does pmmgr create and destroy contexts with attributes alot by default? (if so, at what sort of rates? IOW, can we explain 1GB of memory this way?) > ==17174== by 0x4E6D346: __pmParseHostAttrsSpec (spec.c:937) > ==17174== by 0x4E49545: pmNewContext (context.c:468) > ==17174== by 0x116B8A: pmmgr_job_spec::compute_hostid(std::string const&) This second one is fine - its a once-off thing, not on-going. The QA tests guard against reporting this (see the _run_valgrind shell code). > ==17174== by 0x4E70EA3: __pmConfig (config.c:218) > ==17174== by 0x4E71069: pmGetConfig (config.c:242) > ==17174== by 0x10DA53: main (pmmgr.cxx:1201) cheers. -- Nathan From fche@redhat.com Thu Feb 5 18:42:02 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id A2D51800B for ; Thu, 5 Feb 2015 18:42:02 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 8FC52304039 for ; Thu, 5 Feb 2015 16:42:02 -0800 (PST) X-ASG-Debug-ID: 1423183320-04cbb04169c525d0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id vyAjihGOqxVHXDq3 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 05 Feb 2015 16:42:00 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t160fxxn020930 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 5 Feb 2015 19:42:00 -0500 Received: from fche.csb (vpn-230-75.phx2.redhat.com [10.3.230.75]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t160fx92002568; Thu, 5 Feb 2015 19:41:59 -0500 Received: by fche.csb (Postfix, from userid 2569) id 242BB5869B; Thu, 5 Feb 2015 19:41:48 -0500 (EST) Date: Thu, 5 Feb 2015 19:41:48 -0500 From: "Frank Ch. Eigler" To: Nathan Scott Cc: pcp@oss.sgi.com Subject: Re: pmmgr memory hog Message-ID: <20150206004148.GB1969@redhat.com> X-ASG-Orig-Subj: Re: pmmgr memory hog References: <23273355.372.1423022546978.JavaMail.rmckee@wsrmckee> <1838902881.6952157.1423024805273.JavaMail.zimbra@redhat.com> <1683339037.8571387.1423176489834.JavaMail.zimbra@redhat.com> <20150205225822.GA28568@redhat.com> <1790828395.8575235.1423177464966.JavaMail.zimbra@redhat.com> <20150205232342.GB28568@redhat.com> <20150205233642.GA1910@redhat.com> <1155257352.8599325.1423182027804.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1155257352.8599325.1423182027804.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423183320 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - > > A brief scanny run now produces actual valgrind leak reports ... > > It could be this first one is part of the issue - does pmmgr create and > destroy contexts with attributes alot by default? (if so, at what sort > of rates? IOW, can we explain 1GB of memory this way?) > > > ==17174== by 0x4E6D346: __pmParseHostAttrsSpec (spec.c:937) > > ==17174== by 0x4E49545: pmNewContext (context.c:468) > > ==17174== by 0x116B8A: pmmgr_job_spec::compute_hostid(std::string const&) pmmgr normally polls/discovers at a configured rate (default 60s), and opens new brief pcp context for each live target. If slave pmlogger/pmie or *conf processes fail, this rate can be faster. (This is why I was asking for the pmmgr.log file.) Back-of-the envelope calculations indicate that 1 GB over 54 days can be leaked at the low low rate of 13K/minute = 200B/second. That would seem to require a very tight poll loop, but that's consistent with the high CPU time seen. pmmgr nowadays refuses to loop faster then 1Hz for any particular target (since commit 43626c97, merged in 3.10.0). > This second one is fine - its a once-off thing, not on-going. The QA > tests guard against reporting this (see the _run_valgrind shell code). > > > ==17174== by 0x4E70EA3: __pmConfig (config.c:218) > > ==17174== by 0x4E71069: pmGetConfig (config.c:242) > > ==17174== by 0x10DA53: main (pmmgr.cxx:1201) ... as long as that getenv() protection on config.c:215 works, so that we leak only as many strings as there are variables in pcp.conf, I guess that's ok. (pmGetConfig()'s documentation gives no hint that it leaks memory, so an app would be in the right to call it many times.) - FChE From nscott@redhat.com Thu Feb 5 19:09:06 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 584908029 for ; Thu, 5 Feb 2015 19:09:06 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 467CA304039 for ; Thu, 5 Feb 2015 17:09:03 -0800 (PST) X-ASG-Debug-ID: 1423184937-04cb6c2e6bc7f670001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id oREDSkKETBGWuMEr (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 05 Feb 2015 17:08:58 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1618v8J003538; Thu, 5 Feb 2015 20:08:57 -0500 Date: Thu, 5 Feb 2015 20:08:57 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: pcp@oss.sgi.com Message-ID: <1610481115.8607872.1423184937700.JavaMail.zimbra@redhat.com> In-Reply-To: <20150206004148.GB1969@redhat.com> References: <23273355.372.1423022546978.JavaMail.rmckee@wsrmckee> <1683339037.8571387.1423176489834.JavaMail.zimbra@redhat.com> <20150205225822.GA28568@redhat.com> <1790828395.8575235.1423177464966.JavaMail.zimbra@redhat.com> <20150205232342.GB28568@redhat.com> <20150205233642.GA1910@redhat.com> <1155257352.8599325.1423182027804.JavaMail.zimbra@redhat.com> <20150206004148.GB1969@redhat.com> Subject: Re: pmmgr memory hog MIME-Version: 1.0 X-ASG-Orig-Subj: Re: pmmgr memory hog Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pmmgr memory hog Thread-Index: mYRkaoLsmCou6QpKaV5eisaRAI1+OA== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1423184938 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14972 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > ... as long as that getenv() protection on config.c:215 works, so that > we leak only as many strings as there are variables in pcp.conf, I > guess that's ok. (pmGetConfig()'s documentation gives no hint that it > leaks memory, so an app would be in the right to call it many times.) You may have missed the one-trip guard before the point you are looking (see config.c:240)? The values are set in the environment so "leak" is a little misleading here too, FWLIW. cheers. -- Nathan From fche@redhat.com Thu Feb 5 20:43:04 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 83E9B7F50 for ; Thu, 5 Feb 2015 20:43:04 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 110E2AC004 for ; Thu, 5 Feb 2015 18:43:03 -0800 (PST) X-ASG-Debug-ID: 1423190577-04cbb04169c54240001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id rBeYuB8PSw6ku7Rc (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 05 Feb 2015 18:42:59 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t162gubo003945 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 5 Feb 2015 21:42:56 -0500 Received: from fche.csb (vpn-230-75.phx2.redhat.com [10.3.230.75]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t162guc1013940; Thu, 5 Feb 2015 21:42:56 -0500 Received: by fche.csb (Postfix, from userid 2569) id 5B4515869B; Thu, 5 Feb 2015 21:42:44 -0500 (EST) Date: Thu, 5 Feb 2015 21:42:44 -0500 From: "Frank Ch. Eigler" To: Nathan Scott Cc: pcp@oss.sgi.com Subject: Re: pmmgr memory hog Message-ID: <20150206024244.GC1969@redhat.com> X-ASG-Orig-Subj: Re: pmmgr memory hog References: <23273355.372.1423022546978.JavaMail.rmckee@wsrmckee> <1838902881.6952157.1423024805273.JavaMail.zimbra@redhat.com> <1683339037.8571387.1423176489834.JavaMail.zimbra@redhat.com> <20150205225822.GA28568@redhat.com> <1790828395.8575235.1423177464966.JavaMail.zimbra@redhat.com> <20150205232342.GB28568@redhat.com> <917283598.8588833.1423179822440.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <917283598.8588833.1423179822440.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423190579 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - > [..] > A permanent QA test helps beyond just the immediate concern, of course; > for the next person hacking on pmmgr & accidentally introducing a leak, > so please do give it some thought. Enjoy pcpfans.git fche/pmmgr: commit 0c9496a4fbd08e7b7c292a9097f900e39f182c04 Author: Frank Ch. Eigler Date: Thu Feb 5 21:40:54 2015 -0500 qa/666: use $_valgrind_clean_assert for pmmgr under microscope commit b32ac025a46db98a5f0c7afdbb137087766e7027 Author: Frank Ch. Eigler Date: Thu Feb 5 21:38:48 2015 -0500 qa/common.check: introduce $_valgrind_clean_assert This is a variable which a normal test case can casually insert ahead of an invocation of some random pcp or other program. It may expand to nothing, or to a "valgrind -q ..." prefix. Using it thusly: $_valgrind_clean_assert CMD ARGS ... is a nop, unless there are unsuppressed valgrind errors. commit d3202e24be3b03e62a8b2c6cec2e8fa59216a6c1 Author: Frank Ch. Eigler Date: Fri Jan 23 21:36:01 2015 -0500 pmmgr: build fix for older g++ std::map::at turns out to be a c++11 facility. Use the equivalent but wordier find()->second instead. From nscott@redhat.com Thu Feb 5 21:05:24 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 06BD87F6D for ; Thu, 5 Feb 2015 21:05:24 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id D94CD304032 for ; Thu, 5 Feb 2015 19:05:20 -0800 (PST) X-ASG-Debug-ID: 1423191918-04cb6c2e6ac81390001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id FlPwgkTrf1IPuj0E (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 05 Feb 2015 19:05:19 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1635EuT010979; Thu, 5 Feb 2015 22:05:14 -0500 Date: Thu, 5 Feb 2015 22:05:14 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <174093802.8645054.1423191914875.JavaMail.zimbra@redhat.com> In-Reply-To: <54D3092F.4070903@internode.on.net> References: <54D3092F.4070903@internode.on.net> Subject: Re: [pcp] pcp updates MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pcp updates Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates Thread-Index: i4TspPJGh/wkojFCnvcBr798HmLKmA== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1423191919 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14974 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > Changes committed to git://git.pcp.io/kenj/pcp dev > > Ken McDonell (4): > qa/104[456]: activate paranoid debugging > qa/257.out: die, die, die > src/include/builddefs.in: harden up the LNMAKE macro > pmwebapi/pmwebapi.cxx: add some diagnostics to help triage qa/660 > failures > > qa/1044 | 7 +++++++ > qa/1045 | 7 +++++++ > qa/1046 | 7 +++++++ > qa/257.out | 4 ---- > src/include/builddefs.in | 4 ++-- > src/pmwebapi/pmwebapi.cxx | 2 ++ > 6 files changed, 25 insertions(+), 6 deletions(-) > I'm seeing some new failures - do these ring any bells? [50%] 666 223s ... - output mismatch (see 666.out.bad) 10d9 < more than one [55%] 715 25s ... - output mismatch (see 715.out.bad) 13,17c13,17 < Updating the Performance Metrics Name Space (PMNS) ... < Terminate PMDA if already installed ... < [...install files, make output...] < Updating the PMCD control file, and notifying PMCD ... < Check simple metrics have appeared ... 5 metrics and 9 values --- > [pmns:1] Error Parsing ASCII PMNS: { expected > simple 253:*:* > ^ [83%] 1044 0s ... - output mismatch (see 1044.out.bad) 52a53 > fatal: Not a git repository (or any of the parent directories): .git From kenj@internode.on.net Thu Feb 5 21:15:00 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 4583D8035 for ; Thu, 5 Feb 2015 21:15:00 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 33CFA8F8059 for ; Thu, 5 Feb 2015 19:14:56 -0800 (PST) X-ASG-Debug-ID: 1423192493-04cbb0416ac54960001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id vvGOV1DS9hCDpPE0 for ; Thu, 05 Feb 2015 19:14:54 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AtYBAJQw1FR20Zu9PGdsb2JhbAANTYcygyq/SYJPAoFfAQEBAQEGAQEBATiESAEBBCNWEAsaAgUhAgIPAjIUBg0BBwEBxmdwlicBAQEBAQEBAQIBAQEBAQEBARqBIY5XB4JogUEFqy+EJIMdAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 06 Feb 2015 13:44:53 +1030 Message-ID: <54D431C1.60105@internode.on.net> Date: Fri, 06 Feb 2015 14:15:13 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp@oss.sgi.com Subject: Re: [pcp] pcp updates References: <54D3092F.4070903@internode.on.net> <174093802.8645054.1423191914875.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] pcp updates In-Reply-To: <174093802.8645054.1423191914875.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423192494 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14974 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 06/02/15 14:05, Nathan Scott wrote: > [50%] 666 223s ... - output mismatch (see 666.out.bad) > 10d9 > < more than one 666 has been a chronic failer for me for some time ... this not a recent regression for me. Host bo bl bv gr 00 01 02 03 04 05 06 07 08 10 11 12 14 18 19 20 21 22 23 24 25 26 Test %bad Test QA groups 666 62% X X X X X X X X X X X X X X X X 666 pmmgr I just have not been able to narrow down why it is failing ... it usually has a bunch of bad ls output in addition to the "more than one" line missing > [55%] 715 25s ... - output mismatch (see 715.out.bad) This looks like something I broke in the last 24 hrs ... I'll check this evening. > [83%] 1044 0s ... - output mismatch (see 1044.out.bad) > 52a53 >> fatal: Not a git repository (or any of the parent directories): .git Another thing I broke ... tried to add some diags for a sporadic and really annoying failure, but forget about you people running from "testsuite" rather than the build tree ... other 104? tests will have the same problem ... will fix tonight also. Sorry for the interference. From nscott@redhat.com Thu Feb 5 21:20:48 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id E24FC7F75 for ; Thu, 5 Feb 2015 21:20:48 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id B2EEC8F8059 for ; Thu, 5 Feb 2015 19:20:48 -0800 (PST) X-ASG-Debug-ID: 1423192843-04cb6c2e6bc81740001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id seZLbsTW03Oi2U0x (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 05 Feb 2015 19:20:44 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t163KdFL014595; Thu, 5 Feb 2015 22:20:39 -0500 Date: Thu, 5 Feb 2015 22:20:39 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <837102949.8649505.1423192839785.JavaMail.zimbra@redhat.com> In-Reply-To: <54D431C1.60105@internode.on.net> References: <54D3092F.4070903@internode.on.net> <174093802.8645054.1423191914875.JavaMail.zimbra@redhat.com> <54D431C1.60105@internode.on.net> Subject: Re: [pcp] pcp updates MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pcp updates Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates Thread-Index: Wfzv7XLQXhu4W367Qo+cGeNEVWxPSw== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1423192843 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14974 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > On 06/02/15 14:05, Nathan Scott wrote: > > > [50%] 666 223s ... - output mismatch (see 666.out.bad) > > 10d9 > > < more than one > > 666 has been a chronic failer for me for some time ... this not a recent > regression for me. OK, thanks, didn't realise that. > [...] > Sorry for the interference. No problem at all. cheers. -- Nathan From kenj@internode.on.net Fri Feb 6 03:31:43 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id E32267FEF for ; Fri, 6 Feb 2015 03:31:43 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id C3C10304043 for ; Fri, 6 Feb 2015 01:31:43 -0800 (PST) X-ASG-Debug-ID: 1423215097-04bdf01eeda56d40001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id yp3KUoedg2uWvJh8 for ; Fri, 06 Feb 2015 01:31:37 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AuwBAAiJ1FR20Zu9PGdsb2JhbAANTYNYWYMBgyq8KIdaAQEBAQEGAQEBATiEcVU2AgUWCwILAwIBAgExJwgBAcYlcJZUgSGOdIJSgUEFkmiHKZEehCRbgkIBAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 06 Feb 2015 20:01:36 +1030 Message-ID: <54D48A0D.3070507@internode.on.net> Date: Fri, 06 Feb 2015 20:31:57 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - fix qa 715, 1044 et al Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - fix qa 715, 1044 et al Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423215097 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14982 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (2): qa/104[456]: be more defensive about using git in diagnostics pmdaproc.sh: handle schizo PMDAs with daemon/Perl/Python implementations qa/1044 | 6 +++++- qa/1045 | 6 +++++- qa/1046 | 6 +++++- src/pmcd/pmdaproc.sh | 9 +++++++-- 4 files changed From fche@redhat.com Fri Feb 6 12:57:40 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id E9A9A800A for ; Fri, 6 Feb 2015 12:57:40 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id D2E2530406A for ; Fri, 6 Feb 2015 10:57:37 -0800 (PST) X-ASG-Debug-ID: 1423249053-04bdf01eeeabc300001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id kUDNsgelWA3229Iw (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 06 Feb 2015 10:57:33 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t16IvWu1010710 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Fri, 6 Feb 2015 13:57:32 -0500 Received: from fche.csb (vpn-230-75.phx2.redhat.com [10.3.230.75]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t16IvWnA011466; Fri, 6 Feb 2015 13:57:32 -0500 Received: by fche.csb (Postfix, from userid 2569) id 9335A5869B; Fri, 6 Feb 2015 13:57:18 -0500 (EST) Date: Fri, 6 Feb 2015 13:57:17 -0500 From: "Frank Ch. Eigler" To: David Smith Cc: pcp developers Subject: Re: [pcp] a jsonpointer-based alternative format for json-pmda metadata Message-ID: <20150206185717.GD1969@redhat.com> X-ASG-Orig-Subj: Re: [pcp] a jsonpointer-based alternative format for json-pmda metadata References: <20150113164148.GE28781@redhat.com> <54C7C79C.6070406@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <54C7C79C.6070406@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423249053 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, David - > I finally got a good bit of this working (I haven't implemented units > support yet). Thanks! I had a look through this; nice progress! > I did make a few changes to the metadata format when it comes to arrays. > [...] > I changed things around a bit to make it easier to implement and perhaps > be a bit more readable: [...] Looks good! A few notes & suggestions for next steps: > "type": "integer" > "type": "string" It should not be too hard to expose all the scalar PM_TYPE_* types; the pmda/python fetch_callback binding can handle them (apprx.) all. Semantics, and scale/units (parse via pmParseUnitsStr) should also be configurable. Please give a rescan to the previous proposal re. configuring the pmda with a search path of directories. Maybe choose a file name extension for the metadata files that the pmda can glob for. The /proc/systemtap path should not need to be hard-coded - and for that matter, no systemtap specificity remains in the pmda, so it could be just renamed pmdajson or somesuch. The code needs to spell out a policy for refreshing the metadata/pmns. Doing it for each incoming pcp fetch is very likely excessive (unless perhaps there's clever fstat/mtime caching). Perhaps do it by timer, or a .control.refresh metric set? Similarly, it needs to spell out a policy for refreshing the payload data. Doing it once per fetch-item (metric+instance tuple, i.e., __fetch_callback) is very likely excessive; once per incoming fetch could be OK (once per set_fetch() pre-fetch-callback) ... except that this call doesn't get supplied with all the pmids requested, so can't limit itself to reading only the json files of interest. So maybe have the __fetch_callback memoize payload files' contents, and have the set_fetch callback clear that memoize table beforehand.) Making sense? - FChE From minnus@buffalo.edu Fri Feb 6 14:08:32 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 70A4D8047 for ; Fri, 6 Feb 2015 14:08:32 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id C9BECAC007 for ; Fri, 6 Feb 2015 12:08:28 -0800 (PST) X-ASG-Debug-ID: 1423253307-04bdf030e700820001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve8.acsu.buffalo.edu [128.205.6.19]) by cuda.sgi.com with ESMTP id F4rRt1ZlR0epFycR for ; Fri, 06 Feb 2015 12:08:27 -0800 (PST) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.6.19 Received: from localmailB.acsu.buffalo.edu (localmailb.acsu.buffalo.edu [128.205.5.200]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 4D398D4E for ; Fri, 6 Feb 2015 15:08:27 -0500 (EST) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 48B26C349 for ; Fri, 6 Feb 2015 15:08:27 -0500 (EST) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailB.acsu.buffalo.edu (Postfix) with ESMTP id 64ABFC346 for ; Fri, 6 Feb 2015 15:08:26 -0500 (EST) Received: from smtp.buffalo.edu (smtp2.acsu.buffalo.edu [128.205.5.254]) by localmailB.acsu.buffalo.edu (Prefixe) with ESMTP id 59719C345 for ; Fri, 6 Feb 2015 15:08:26 -0500 (EST) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 4F46F4FC4 for ; Fri, 6 Feb 2015 15:08:26 -0500 (EST) Message-ID: <54D51F39.1050205@buffalo.edu> Date: Fri, 06 Feb 2015 15:08:25 -0500 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Vagrant update Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: Vagrant update Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve8.acsu.buffalo.edu[128.205.6.19] X-Barracuda-Start-Time: 1423253307 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.14993 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi, Here's my current vagrant setup, if there is interest to merge it for others to work on/use. https://github.com/ubccr/pcp/tree/vagrant commit 101fa307933ad58b2ade616a9efc0c46d70443f6 Author: Martins Innus Date: Fri Feb 6 14:58:47 2015 -0500 Vagrant QA setup based on the Aconex idea Run "vagrant up" in the pcp directory to load, provision and run QA on a bunch of VMs Requires virtualbox and vagrant installed .gitignore | 2 + Vagrantfile | 338 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2 files changed, 340 insertions(+), 0 deletions(-) Requires virtualbox and vagrant installed. Its just the Vagrantfile for now. I ended up not including the activemq QA changes since I don't use it and wasn't sure on the right way to make it work for all the platforms I had configured. So the git history isn't in there but all credit goes to Aconex for this idea. I tried to make it self contained and as uniform as possible just for my ease of use and testing. So there are common config sections for all ubuntu, all centos, etc as much as possible. In a fully fleshed out system it probably makes sense to have individual configs for the different VMs, individual config files, and not have a big mess in one file. I have not done an audit on what portions of pcp get built on all the platforms. I think some of the older VMs have python and QT issues. In the root pcp directory a "vagrant up" will start , provision and run qa on all the hosts. The provisioning happens in serial and the QA runs happen in parallel. The first time you run it, there will be a big network hit as the base boxes are downloaded. But after that, all subsequent runs will use the local cached data. After the qa is done, any .bad files as well as the QA output itself are copied to a new "qaresults" hierarchy in the current directory. Probably could script something to do a simple analysis on the results. If you had a good enough host machine, you could probably run all the VMs at once, but vagrant up will also take a regex, so I tend to do something like: vagrant up /centos.*/ or depending on your shell vagrant up \/centos.\*\/ You can configure the VM characteristics as well as the QA tests to run with a few variables at the top. As I mentioned in my last email, I had trouble getting the OpenSuse images to load properly. I haven't gotten back to looking at that. Also, these are all x86_64 boxes. Probably should add the 32bit distributions that are appropriate if anyone has interest It would be great to get some more hacking in this, I'm not tied to any of my implementation details, it was just a quick and ugly way to get a bunch of VMs up for QA. Tested on Linux and Mac hosts. Thanks Martins From kenj@internode.on.net Sun Feb 8 18:43:10 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id A52C37F83 for ; Sun, 8 Feb 2015 18:43:10 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 262DAAC001 for ; Sun, 8 Feb 2015 16:43:06 -0800 (PST) X-ASG-Debug-ID: 1423442581-04cb6c6b0c84570001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id 7nCVx83GZYZJbtkR for ; Sun, 08 Feb 2015 16:43:02 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: Ai8CAK8B2FR20Zu9PGdsb2JhbAANT4NYWoMCgyq8RYdMAQEBAQEBBQEBAQE4hHFVNgIFFgsCCwMCAQIBMScIAQG6OnCWNIEhjnSCUoFCBYVSjRmYTIQkW4JCAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 09 Feb 2015 11:13:00 +1030 Message-ID: <54D802AF.1000806@internode.on.net> Date: Mon, 09 Feb 2015 11:43:27 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - some key qa fixups Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - some key qa fixups Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423442581 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15057 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (3): qa/104[456]: accommodate older git versions qa/518: fix filter for multiple pmie's qa/666: overhaul qa/1044 | 2 qa/1045 | 2 qa/1046 | 2 qa/518 | 23 ++++++-- qa/666 | 170 ++++++++++++++++++++++++++++++++++++++++------------------------ 5 files changed From kenj@internode.on.net Sun Feb 8 19:00:07 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 6A1FA7F83 for ; Sun, 8 Feb 2015 19:00:07 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 3B2118F8037 for ; Sun, 8 Feb 2015 17:00:03 -0800 (PST) X-ASG-Debug-ID: 1423443595-04bdf06a598d980001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id sAJNIYhBqHYHSOR0 for ; Sun, 08 Feb 2015 16:59:55 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: Ai8CAHEF2FR20Zu9PGdsb2JhbAANT4NYWoMCgyq8RYVvgV0BAQEBAQEFAQEBATiEcVU2AgUWCwILAwIBAgExJwgBAbo/cJYzgSGOdIJSgUIFkmuYTIQkW4JCAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 09 Feb 2015 11:29:54 +1030 Message-ID: <54D806A5.1050309@internode.on.net> Date: Mon, 09 Feb 2015 12:00:21 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - oops Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - oops Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423443595 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15058 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (1): qa/666: remove sleep 3600 that was accidentally left behind qa/666 | 2 -- 1 file changed From nscott@redhat.com Sun Feb 8 23:08:29 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 41B067F88 for ; Sun, 8 Feb 2015 23:08:29 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id B6AB5AC001 for ; Sun, 8 Feb 2015 21:08:25 -0800 (PST) X-ASG-Debug-ID: 1423458502-04cbb011638cac0001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id vZICUO63iHro8UHU (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sun, 08 Feb 2015 21:08:23 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1958KoV020127; Mon, 9 Feb 2015 00:08:20 -0500 Date: Mon, 9 Feb 2015 00:08:20 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: "pcp@oss.sgi.com >> PCP" Message-ID: <152929046.927256.1423458500522.JavaMail.zimbra@redhat.com> In-Reply-To: <648304535.926907.1423458368849.JavaMail.zimbra@redhat.com> Subject: Reduce pmdaproc.sh runtime for pmdaInstall MIME-Version: 1.0 X-ASG-Orig-Subj: Reduce pmdaproc.sh runtime for pmdaInstall Content-Type: multipart/mixed; boundary="----=_Part_927254_1716925503.1423458500520" X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Reduce pmdaproc.sh runtime for pmdaInstall Thread-Index: MKoQmru8UoRSUj5w1b8nIWvkdgt2xg== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1423458503 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15065 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ------=_Part_927254_1716925503.1423458500520 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit (resending, oss rejected the .sh attachment suffix) Hi Ken, When the dust settles on the current crop of failures we're triaging, could you toss the attached patch into your regular QA and see how it fares? (no regressions so far here). The aim is to reduce the runtime for all of QA, but there's one/ two tests that are particularly problematic (3x speedup with this - one pmdasample test goes from ~2.5mins to < ~50sec). It makes PMDA installs quicker in general, so a bonus for all users really. The comments in the code (removed) about a 1s timestamp resolution have long been resolved in the kernel (it is from early 2.4 days IIRC - all modern Linux filesystems use higher resolution timestamps, as does the VFS - so I think its safe at this stage). cheers. -- Nathan ------=_Part_927254_1716925503.1423458500520 Content-Type: text/x-patch; name=speedup.pmdaproc.patch Content-Disposition: attachment; filename=speedup.pmdaproc.patch Content-Transfer-Encoding: base64 ZGlmZiAtLWdpdCBhL3NyYy9wbWNkL3BtZGFwcm9jLnNoIGIvc3JjL3BtY2QvcG1kYXByb2Muc2gK aW5kZXggNTgwZmY4ZS4uYmVlNWM4ZiAxMDA2NDQKLS0tIGEvc3JjL3BtY2QvcG1kYXByb2Muc2gK KysrIGIvc3JjL3BtY2QvcG1kYXByb2Muc2gKQEAgLTE1Myw3ICsxNTMsNyBAQCBpcGNfcHJvdD1i aW5hcnkKICMJTmVlZCB0byBmb3JjZSBhIHJlc3RhcnQgb2YgcG1jZD8KIGZvcmNlZF9yZXN0YXJ0 PXRydWUKICMJRGVsYXkgYWZ0ZXIgaW5zdGFsbCBiZWZvcmUgY2hlY2tpbmcgKHNlYykKLWNoZWNr X2RlbGF5PTMKK2NoZWNrX2RlbGF5PTAuMwogIwlBZGRpdGlvbmFsIGNvbW1hbmQgbGluZSBhcmdz IHRvIGdvIGluICRQQ1BfUE1DRENPTkZfUEFUSAogYXJncz0iIgogIwlkaXR0byBmb3IgcGVybCBQ TURBcwpAQCAtMzY0LDEzICszNjQsMTMgQEAgRU5ECQkJCQl7IGV4aXQgc3RhdHVzIH0nCiAJdGhl bgogCSAgICBwbXNpZ25hbCAtYSAtcyBIVVAgcG1jZCA+L2Rldi9udWxsIDI+JjEKIAkgICAgIyBh bGxvdyBzaWduYWwgcHJvY2Vzc2luZyB0byBiZSBkb25lIGJlZm9yZSBjaGVja2luZyBzdGF0dXMK LQkgICAgc2xlZXAgMgorCSAgICBwbXNsZWVwIDAuMgogCSAgICBfX3dhaXRfZm9yX3BtY2QKIAkg ICAgaWYgJF9fcG1jZF9pc19kZWFkCiAJICAgIHRoZW4KIAkJX19yZXN0b3JlX3BtY2QKIAkJIyBn aXZlIFBNQ0QgYSBjaGFuY2UgdG8gZ2V0IGJhY2sgaW50byBvcmlnaW5hbCBzdGF0ZQotCSAgICBz bGVlcCAzCisJCXBtc2xlZXAgMwogCQlfX3dhaXRfZm9yX3BtY2QKIAkgICAgZmkKIAlmaQpAQCAt Mzg2LDcgKzM4Niw3IEBAIEVORAkJCQkJeyBleGl0IHN0YXR1cyB9JwogCXRoZW4KIAkgICAgcG1z aWduYWwgLXMgJF9fc2lnICRfX3BpZHMgPi9kZXYvbnVsbCAyPiYxCiAJICAgICMgYWxsb3cgc2ln bmFsIHByb2Nlc3NpbmcgdG8gYmUgZG9uZQotCSAgICBzbGVlcCAyCisJICAgIHBtc2xlZXAgMC4y CiAJZWxzZQogCSAgICBicmVhawogCWZpCkBAIC00NTMsNyArNDUzLDcgQEAgJDE9PSInJG15bmFt ZSciICYmICQyPT0iJyRteWRvbWFpbiciCXsgbmV4dCB9CiAgICAgdGhlbgogCXBtc2lnbmFsIC1h IC1zIEhVUCBwbWNkID4vZGV2L251bGwgMj4mMQogCSMgYWxsb3cgc2lnbmFsIHByb2Nlc3Npbmcg dG8gYmUgZG9uZSBiZWZvcmUgY2hlY2tpbmcgc3RhdHVzCi0Jc2xlZXAgMgorCXBtc2xlZXAgMC4y CiAJX193YWl0X2Zvcl9wbWNkCiAJJF9fcG1jZF9pc19kZWFkICYmIF9fcmVzdG9yZV9wbWNkCiAg ICAgZWxzZQpAQCAtMTI5OSw4ICsxMjk5LDggQEAgX2luc3RhbGwoKQogCSAgICB0aGVuCiAJCXBt c2lnbmFsIC1hIC1zIEhVUCBwbWNkID4vZGV2L251bGwgMj4mMQogCQkjIE1ha2Ugc3VyZSB0aGUg UE1OUyB0aW1lc3RhbXAgd2lsbCBiZSBkaWZmZXJlbnQgdGhlIG5leHQKLQkJIyB0aW1lIHRoZSBQ TU5TIGlzIHVwZGF0ZWQgKGZvciBMaW51eCBvbmx5IDEgc2VjIHJlc29sdXRpb24pCi0JCXNsZWVw IDIKKwkJIyB0aW1lIHRoZSBQTU5TIGlzIHVwZGF0ZWQKKwkJcG1zbGVlcCAwLjIKIAkgICAgZWxz ZQogCQlpZiBncmVwICdOb24tdGVybWluYWwgIiciJF9fbiInIiBub3QgZm91bmQnICR0bXAvYmFz ZSA+L2Rldi9udWxsCiAJCXRoZW4KQEAgLTEzNDAsOCArMTM0MCw4IEBAIF9pbnN0YWxsKCkKIAl0 aGVuCiAJICAgIHBtc2lnbmFsIC1hIC1zIEhVUCBwbWNkID4vZGV2L251bGwgMj4mMQogCSAgICAj IE1ha2Ugc3VyZSB0aGUgUE1OUyB0aW1lc3RhbXAgd2lsbCBiZSBkaWZmZXJlbnQgdGhlIG5leHQK LQkgICAgIyB0aW1lIHRoZSBQTU5TIGlzIHVwZGF0ZWQgKGZvciBMaW51eCBvbmx5IDEgc2VjIHJl c29sdXRpb24pCi0JICAgIHNsZWVwIDIKKwkgICAgIyB0aW1lIHRoZSBQTU5TIGlzIHVwZGF0ZWQg CisJICAgIHBtc2xlZXAgMC4yCiAJZWxzZQogCSAgICBlY2hvICIkcHJvZzogZmFpbGVkIHRvIGFk ZCB0aGUgUE1OUyBlbnRyaWVzIGZvciBcIiRfX25cIiAuLi4iCiAJICAgIGVjaG8KQEAgLTEzODMs OCArMTM4Myw5IEBAIF9pbnN0YWxsKCkKIAkjCiAJaWYgJGRvX2NoZWNrCiAJdGhlbgotCSAgICBb ICIkY2hlY2tfZGVsYXkiIC1ndCA1IF0gJiYgZWNobyAiV2FpdCAkY2hlY2tfZGVsYXkgc2Vjb25k cyBmb3IgdGhlICRpYW0gYWdlbnQgdG8gaW5pdGlhbGl6ZSAuLi4iCi0JICAgIHNsZWVwICRjaGVj a19kZWxheQorCSAgICBfX2RlbGF5X2ludD1gZWNobyAkY2hlY2tfZGVsYXkgfCBzZWQgLWUgJ3Mv XC4uKi8vZydgCisJICAgIFsgIiRfX2RlbGF5X2ludCIgLWd0IDUgXSAmJiBlY2hvICJXYWl0ICRj aGVja19kZWxheSBzZWNvbmRzIGZvciB0aGUgJGlhbSBhZ2VudCB0byBpbml0aWFsaXplIC4uLiIK KwkgICAgcG1zbGVlcCAkY2hlY2tfZGVsYXkKIAkgICAgZm9yIF9fbiBpbiAkcG1uc19uYW1lCiAJ ICAgIGRvCiAJCSRQQ1BfRUNIT19QUk9HICRQQ1BfRUNIT19OICJDaGVjayAkX19uIG1ldHJpY3Mg aGF2ZSBhcHBlYXJlZCAuLi4gIiIkUENQX0VDSE9fQyIKQEAgLTE0MTksNyArMTQyMCw3IEBAIF9y ZW1vdmUoKQogCXRoZW4KIAkgICAgcm0gLWYgJFBNTlNESVIvJF9fbgogCSAgICBwbXNpZ25hbCAt YSAtcyBIVVAgcG1jZCA+L2Rldi9udWxsIDI+JjEKLQkgICAgc2xlZXAgMgorCSAgICBwbXNsZWVw IDAuMgogCSAgICBlY2hvICJkb25lIgogCWVsc2UKIAkgICAgaWYgZ3JlcCAnTm9uLXRlcm1pbmFs ICInIiRfX24iJyIgbm90IGZvdW5kJyAkdG1wL2Jhc2UgPi9kZXYvbnVsbAo= ------=_Part_927254_1716925503.1423458500520-- From nscott@redhat.com Mon Feb 9 02:37:25 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id D08037F8B for ; Mon, 9 Feb 2015 02:37:25 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id BDA758F8049 for ; Mon, 9 Feb 2015 00:37:25 -0800 (PST) X-ASG-Debug-ID: 1423471038-04cb6c6b0a9cc00001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id wFWVCRHLn6hZ5Z9G (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 00:37:19 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t198bIWb022539 for ; Mon, 9 Feb 2015 03:37:18 -0500 Date: Mon, 9 Feb 2015 03:37:18 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "pcp@oss.sgi.com >> PCP" Message-ID: <127520334.1072077.1423471038120.JavaMail.zimbra@redhat.com> In-Reply-To: <233679622.1070354.1423470955916.JavaMail.zimbra@redhat.com> Subject: pcp updates: lxc support, libpcp fix, qa MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: lxc support, libpcp fix, qa Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: lxc support, libpcp fix, qa Thread-Index: lshC3uGP9mK379bDYoTlIedsXJ/kJQ== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1423471038 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15069 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Ken McDonell (4): qa/104[456]: accommodate older git versions qa/518: fix filter for multiple pmie's qa/666: overhaul qa/666: remove sleep 3600 that was accidently left behind Nathan Scott (3): pmdaroot: add support for the LXC container engine qa: ensure 976 cleans up its temporary files libpcp: fix small attribute memleak in context destruction qa/1044 | 2 qa/1045 | 2 qa/1046 | 2 qa/518 | 23 ++- qa/666 | 172 ++++++++++++++++--------- qa/761 | 21 ++- qa/761.out | 32 ++++ qa/976 | 6 qa/977 | 29 ++++ qa/977.out | 43 ++++++ qa/group | 1 qa/linux/containers-lxc-1.0.6-root-001.tgz |binary qa/src/grind_ctx.c | 10 - src/libpcp/src/context.c | 22 +++ src/pmdas/root/GNUmakefile | 4 src/pmdas/root/docker.c | 2 src/pmdas/root/docker.h | 1 src/pmdas/root/lxc.c | 192 +++++++++++++++++++++++++++++ src/pmdas/root/lxc.h | 25 +++ src/pmdas/root/root.c | 14 +- 20 files changed, 504 insertions(+), 99 deletions(-) From kenj@internode.on.net Mon Feb 9 02:44:17 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id BE3E17F8B for ; Mon, 9 Feb 2015 02:44:17 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 9C9BF8F8037 for ; Mon, 9 Feb 2015 00:44:17 -0800 (PST) X-ASG-Debug-ID: 1423471453-04cbb01165970a0001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id QGh7hkV5YndMTyCU for ; Mon, 09 Feb 2015 00:44:13 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AlsCAPly2FR20Zu9PGdsb2JhbAANT4NYWoMCgyq8RIVvgWEBAQEBAQEFAQEBATiEcVU2AgUWCwILAwIBAgExJwgBAbgYcJYxgSGOdIJSgUIFkmuYTIQkW4JCAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 09 Feb 2015 19:14:12 +1030 Message-ID: <54D87377.3050802@internode.on.net> Date: Mon, 09 Feb 2015 19:44:39 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - qa/837 Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - qa/837 Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423471453 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15069 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (1): qa/837: add guard for platforms without adequate container support qa/837 | 12 ++++++++++++ 1 file changed From fche@redhat.com Mon Feb 9 11:08:16 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 269FF7F99 for ; Mon, 9 Feb 2015 11:08:16 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 161C08F8074 for ; Mon, 9 Feb 2015 09:08:15 -0800 (PST) X-ASG-Debug-ID: 1423501691-04cbb01165dcb70001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id gL7IpAMSczIVKLfn (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 09:08:11 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t19H890q010654 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 9 Feb 2015 12:08:10 -0500 Received: from fche.csb (vpn-230-246.phx2.redhat.com [10.3.230.246]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t19H89cN021870; Mon, 9 Feb 2015 12:08:09 -0500 Received: by fche.csb (Postfix, from userid 2569) id D48FC58516; Mon, 9 Feb 2015 12:07:45 -0500 (EST) To: Nathan Scott Cc: PCP Subject: Re: Containers analysis with PCP References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: Containers analysis with PCP From: fche@redhat.com (Frank Ch. Eigler) Date: Mon, 09 Feb 2015 12:07:45 -0500 In-Reply-To: <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> (Nathan Scott's message of "Mon, 2 Feb 2015 03:59:36 -0500 (EST)") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423501691 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Nathan Scott writes: > [...] > http://pcp.io/docs/lab.containers.html Thank you. Please don't forget to address earlier review comments in [1]. Also, on my x86-64 fedora21 box running the 3.10.2 build, I still can't get any pcp client --container ops working, e.g., % pmprobe -I --container=compassionate_archimedes network.interface.up network.interface.up 4-12366 IPC protocol failure (pmGetInDom) in pmcd.log, pmcd is shown to die, but no other diagnostics appear: [Mon Feb 9 12:04:59] pmcd(2152) Error: ClientLoop select: Bad file descriptor [Mon Feb 9 12:05:00] pmcd(2152) Info: CleanupAgent ... Cleanup "root" agent (dom 1): terminated, exit(1) [1] http://oss.sgi.com/pipermail/pcp/2015-January/006330.html - FChE From fche@redhat.com Mon Feb 9 13:27:26 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id BF3D17F9F for ; Mon, 9 Feb 2015 13:27:26 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id AEAA8304032 for ; Mon, 9 Feb 2015 11:27:23 -0800 (PST) X-ASG-Debug-ID: 1423510042-04cb6c6b0ae9870001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id IbOuLfgWsBrnEMQD (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 11:27:22 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t19JRLpt015227 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 9 Feb 2015 14:27:21 -0500 Received: from fche.csb (vpn-230-246.phx2.redhat.com [10.3.230.246]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t19JRLW3021788 for ; Mon, 9 Feb 2015 14:27:21 -0500 Received: by fche.csb (Postfix, from userid 2569) id 9588558516; Mon, 9 Feb 2015 14:26:57 -0500 (EST) Date: Mon, 9 Feb 2015 14:26:57 -0500 From: "Frank Ch. Eigler" To: pcp developers Subject: libpcp crash in sasl/connection/attributes Message-ID: <20150209192657.GD25151@redhat.com> X-ASG-Orig-Subj: libpcp crash in sasl/connection/attributes Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423510042 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - This is with older-than-git-master libpcp, but as this problem occurs during the pmNewContext, commit 63721a89 shouldn't be related. % valgrind pminfo -h 'pcp://localhost?pass=jsjs' ==18776== Memcheck, a memory error detector ==18776== Copyright (C) 2002-2013, and GNU GPL'd, by Julian Seward et al. ==18776== Using Valgrind-3.10.1 and LibVEX; rerun with -h for copyright info ==18776== Command: pminfo -h pcp://localhost?container=FOO&pass=jsjs ==18776== Username: sdf ==18776== Invalid free() / delete / delete[] / realloc() ==18776== at 0x4C2ACE9: free (in /usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so) ==18776== by 0x4E6B6B1: attrHashNodeDel (spec.c:682) ==18776== by 0x4E809C4: __pmHashWalkCB (hash.c:146) ==18776== by 0x4E49A6C: pmNewContext (context.c:518) ==18776== by 0x4017F3: main (pminfo.c:642) ==18776== Address 0x7ce15d0 is 0 bytes inside a block of size 5 free'd ==18776== at 0x4C2ACE9: free (in /usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so) ==18776== by 0x4E8A374: __pmAuthSecretCB (secureconnect.c:764) ==18776== by 0x5C2845A: _plug_get_password (in /usr/lib64/libsasl2.so.3.0.0) ==18776== by 0x92BC4CE: ??? (in /usr/lib64/sasl2/libdigestmd5.so.3.0.0) ==18776== by 0x92C0894: ??? (in /usr/lib64/sasl2/libdigestmd5.so.3.0.0) ==18776== by 0x5C1C689: sasl_client_step (in /usr/lib64/libsasl2.so.3.0.0) ==18776== by 0x4E8B0BD: __pmAuthClientNegotiation (secureconnect.c:1133) ==18776== by 0x4E8BBC8: __pmSecureClientHandshake (secureconnect.c:1215) ==18776== by 0x4E47099: attributes_handshake (connect.c:175) ==18776== by 0x4E47099: __pmConnectHandshake (connect.c:257) ==18776== by 0x4E478D2: __pmConnectPMCD (connect.c:413) ==18776== by 0x4E498BB: pmNewContext (context.c:507) ==18776== by 0x4017F3: main (pminfo.c:642) From kenj@internode.on.net Mon Feb 9 16:27:02 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 6057029DF8 for ; Mon, 9 Feb 2015 16:27:02 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 0C8A9AC006 for ; Mon, 9 Feb 2015 14:27:01 -0800 (PST) X-ASG-Debug-ID: 1423520816-04bdf06a5af3a70001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id tv0uwJZstBXF4ICV for ; Mon, 09 Feb 2015 14:26:56 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AswBAFoz2VR20Zu9/2dsb2JhbAANT4NYWoMCv3SFbwoCgWEBAQEBAQGFCQEBBCMVQAEQCxgCAgUWCwICCQMCAQIBRQYNAQcBAbw3cJY3AQEBAQEBAQMBAQEBAR2BIY11EQFQB4JogUIBBJJrhyqRIoQkW4ELgTcBAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail07.adl2.internode.on.net with ESMTP; 10 Feb 2015 08:56:55 +1030 Message-ID: <54D9343F.1070703@internode.on.net> Date: Tue, 10 Feb 2015 09:27:11 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Nathan Scott CC: "pcp@oss.sgi.com >> PCP" Subject: Re: Reduce pmdaproc.sh runtime for pmdaInstall References: <724742467.926637.1423458271929.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: Reduce pmdaproc.sh runtime for pmdaInstall In-Reply-To: <724742467.926637.1423458271929.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1423520816 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15088 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 09/02/15 16:04, Nathan Scott wrote: > Hi Ken, > > When the dust settles on the current crop of failures we're > triaging, could you toss the attached patch into the QA farm > and see how it fares? No regressions on the first host I tried this on with a full QA run. I've committed it to my git tree (but not sent git push email yet), as that is the best way for me to get it used across all the hosts in my QA farm. From mgoodwin@redhat.com Mon Feb 9 17:36:35 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 658377FBE for ; Mon, 9 Feb 2015 17:36:35 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 45C9C8F8074 for ; Mon, 9 Feb 2015 15:36:31 -0800 (PST) X-ASG-Debug-ID: 1423524990-04bdf06a5bf5110001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 9h6I6m1D7C3ArOfB (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 15:36:30 -0800 (PST) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t19NaTBW017873 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 9 Feb 2015 18:36:30 -0500 Received: from [10.64.5.223] (wlan-5-223.bne.redhat.com [10.64.5.223] (may be forged)) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t19NaS2J000376 for ; Mon, 9 Feb 2015 18:36:29 -0500 Message-ID: <54D9447B.203@redhat.com> Date: Tue, 10 Feb 2015 09:36:27 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] Containers analysis with PCP References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Containers analysis with PCP In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423524990 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 02/10/2015 03:07 AM, Frank Ch. Eigler wrote: > Nathan Scott writes: > >> [...] >> http://pcp.io/docs/lab.containers.html > > Thank you. Please don't forget to address earlier review comments in [1]. > > Also, on my x86-64 fedora21 box running the 3.10.2 build, I still can't get > any pcp client --container ops working, e.g., > > % pmprobe -I --container=compassionate_archimedes network.interface.up > network.interface.up 4-12366 IPC protocol failure (pmGetInDom) > > in pmcd.log, pmcd is shown to die, but no other diagnostics appear: > > [Mon Feb 9 12:04:59] pmcd(2152) Error: ClientLoop select: Bad file descriptor > [Mon Feb 9 12:05:00] pmcd(2152) Info: CleanupAgent ... > Cleanup "root" agent (dom 1): terminated, exit(1) Not working for me either, but I'm getting ENOSUP errors. I'm running top-of-tree on f19 (3.10.3-1) : # sudo docker run -it 834629358fe2 /bin/bash bash-4.3# bash-4.3# ls -l /proc/$$/ns total 0 lrwxrwxrwx 1 root root 0 Feb 9 18:17 ipc -> ipc:[4026532510] lrwxrwxrwx 1 root root 0 Feb 9 18:17 mnt -> mnt:[4026532508] lrwxrwxrwx 1 root root 0 Feb 9 18:17 net -> net:[4026532513] lrwxrwxrwx 1 root root 0 Feb 9 18:17 pid -> pid:[4026532511] lrwxrwxrwx 1 root root 0 Feb 9 18:17 user -> user:[4026531837] lrwxrwxrwx 1 root root 0 Feb 9 18:17 uts -> uts:[4026532509] then in another shell : $ sudo docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES c2a1bd412ad4 fedora:latest /bin/bash 33 minutes ago Up 33 minutes jovial_lovelace # pminfo -h localhost -f hinv.ncpu hinv.ncpu value 4 # pminfo -h localhost --container c2a1bd412ad4 -f hinv.ncpu pminfo: Cannot connect to PMCD on host "localhost": Operation not supported [mgoodwin@fletch pcp]$ pminfo -h localhost --container jovial_lovelace -f hinv.ncpu pminfo: Cannot connect to PMCD on host "localhost": Operation not supported Also note: after upgrading to pcp-3.10.3 I had to manually Install the new root PMDA. Should it be auto-installed? Regards -- Mark From nscott@redhat.com Mon Feb 9 18:32:19 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 53AA37FB4 for ; Mon, 9 Feb 2015 18:32:19 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 33F18304043 for ; Mon, 9 Feb 2015 16:32:19 -0800 (PST) X-ASG-Debug-ID: 1423528333-04cb6c6b0befda0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id vRb72YPcxEyklrUB (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 16:32:14 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1A0WD3W013683; Mon, 9 Feb 2015 19:32:13 -0500 Date: Mon, 9 Feb 2015 19:32:13 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: PCP Message-ID: <1602407544.1781133.1423528333125.JavaMail.zimbra@redhat.com> In-Reply-To: References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> Subject: Re: Containers analysis with PCP MIME-Version: 1.0 X-ASG-Orig-Subj: Re: Containers analysis with PCP Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Containers analysis with PCP Thread-Index: jw6c/TYQa7yQMgk3HnolFFRk/QxA7A== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1423528334 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15091 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > > [...] > Please don't forget to address earlier review comments in [1]. The review was ~2 weeks out of date when sent & the one/two issues there were fixed already, independently. I see nothing needing further action there. Feel free to revisit & reassess with current code (objectively, please - patches and QA tests will help you more than opinions about design docs) if you think there's anything worth doing there still. > Also, on my x86-64 fedora21 box running the 3.10.2 build, I still can't get > any pcp client --container ops working, e.g., > > % pmprobe -I --container=compassionate_archimedes network.interface.up > network.interface.up 4-12366 IPC protocol failure (pmGetInDom) This is not reproducible here - can you either debug & send a fix and test case, or go into more detail about your containers + pcp setup such that someone can help you? (incl. pmcd.conf, pmcd.log, values for containers metrics & detailed go-to-woe instructions for the Docker commands you're using). Can you also describe what you have already in terms of diagnosing this? cheers. -- Nathan From nscott@redhat.com Mon Feb 9 18:35:42 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id BA70D7FB4 for ; Mon, 9 Feb 2015 18:35:42 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id A8C7F8F8035 for ; Mon, 9 Feb 2015 16:35:39 -0800 (PST) X-ASG-Debug-ID: 1423528534-04cbb01165ec1e0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id DemFn3fxlugUJxpb (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 16:35:34 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1A0ZXNQ018169; Mon, 9 Feb 2015 19:35:33 -0500 Date: Mon, 9 Feb 2015 19:35:33 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Mark Goodwin Cc: pcp@oss.sgi.com Message-ID: <743115533.1781377.1423528533840.JavaMail.zimbra@redhat.com> In-Reply-To: <54D9447B.203@redhat.com> References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> <54D9447B.203@redhat.com> Subject: Re: [pcp] Containers analysis with PCP MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Containers analysis with PCP Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Containers analysis with PCP Thread-Index: tcbEvsv0Ik4s84gIFcbDqTA81cp0oA== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1423528534 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15091 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi Mark, ----- Original Message ----- > [...] > Not working for me either, but I'm getting ENOSUP errors. I'm running > top-of-tree on f19 (3.10.3-1) : > [...] > # pminfo -h localhost --container c2a1bd412ad4 -f hinv.ncpu > pminfo: Cannot connect to PMCD on host "localhost": Operation not supported What does "pminfo -f containers" say? > Also note: after upgrading to pcp-3.10.3 I had to manually Install the > new root PMDA. Should it be auto-installed? It is auto-installed for new installations, and /etc/pcp/pmcd/pmcd.conf falls under the usual RPM configuration file rules for an upgrade. cheers. -- Nathan From nscott@redhat.com Mon Feb 9 18:39:28 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 03CE27FB6 for ; Mon, 9 Feb 2015 18:39:28 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id A24F2AC004 for ; Mon, 9 Feb 2015 16:39:27 -0800 (PST) X-ASG-Debug-ID: 1423528766-04bdf06a5bf6200001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id QqpVbzF5cmEByoLa (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 16:39:26 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1A0dPve018673; Mon, 9 Feb 2015 19:39:25 -0500 Date: Mon, 9 Feb 2015 19:39:25 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: pcp developers Message-ID: <1691871639.1781628.1423528765870.JavaMail.zimbra@redhat.com> In-Reply-To: <20150209192657.GD25151@redhat.com> References: <20150209192657.GD25151@redhat.com> Subject: Re: [pcp] libpcp crash in sasl/connection/attributes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] libpcp crash in sasl/connection/attributes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: libpcp crash in sasl/connection/attributes Thread-Index: kzxZ4DrOJD/tGmaG+OfX3bk380Sw/Q== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1423528766 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15091 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > Hi - > > This is with older-than-git-master libpcp, but as this problem occurs > during the pmNewContext, commit 63721a89 shouldn't be related. > > % valgrind pminfo -h 'pcp://localhost?pass=jsjs' Hmm, this is not reproducible here with current dev - I see all sorts of krb*, sasl*, and gss* valgrind warnings from error paths in those libs, but nothing that seems to originate from pcp so far. cheers. -- Nathan From mgoodwin@redhat.com Mon Feb 9 18:50:57 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 386F37FBC for ; Mon, 9 Feb 2015 18:50:57 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 2467A8F8073 for ; Mon, 9 Feb 2015 16:50:56 -0800 (PST) X-ASG-Debug-ID: 1423529455-04cbb01163ec560001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id IAf5HLk6ntl1mgOH (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 16:50:55 -0800 (PST) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1A0ostc002345 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 9 Feb 2015 19:50:54 -0500 Received: from [10.64.5.223] (wlan-5-223.bne.redhat.com [10.64.5.223] (may be forged)) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1A0orsi026651; Mon, 9 Feb 2015 19:50:53 -0500 Message-ID: <54D955EB.4040201@redhat.com> Date: Tue, 10 Feb 2015 10:50:51 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp@oss.sgi.com Subject: Re: [pcp] Containers analysis with PCP References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> <54D9447B.203@redhat.com> <743115533.1781377.1423528533840.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Containers analysis with PCP In-Reply-To: <743115533.1781377.1423528533840.JavaMail.zimbra@redhat.com> Content-Type: multipart/mixed; boundary="------------090004030101060905060408" X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423529455 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 This is a multi-part message in MIME format. --------------090004030101060905060408 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit On 02/10/2015 10:35 AM, Nathan Scott wrote: > Hi Mark, > > ----- Original Message ----- >> [...] >> Not working for me either, but I'm getting ENOSUP errors. I'm running >> top-of-tree on f19 (3.10.3-1) : >> [...] >> # pminfo -h localhost --container c2a1bd412ad4 -f hinv.ncpu >> pminfo: Cannot connect to PMCD on host "localhost": Operation not supported > > What does "pminfo -f containers" say? see attached pminfo -f containers.name (it's pretty wordy) > >> Also note: after upgrading to pcp-3.10.3 I had to manually Install the >> new root PMDA. Should it be auto-installed? > > It is auto-installed for new installations, and /etc/pcp/pmcd/pmcd.conf > falls under the usual RPM configuration file rules for an upgrade. that's fine, but if the root PMDA is needed for container support to function, then we'll have an upgrade issue that'll need management (?) --------------090004030101060905060408 Content-Type: text/plain; charset=UTF-8; name="pminfo_containers.txt" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="pminfo_containers.txt" JCBwbWluZm8gLWYgY29udGFpbmVycy5uYW1lCgpjb250YWluZXJzLm5hbWUKICAgIGluc3Qg WzAgb3IgImFlNmNjYWI5YzAzZmU4YTJiODNmODUzNzQ5ZTA4YTdiNTk3NzBkMDM4ZDliOGIz ZGVjNTNiMjM1ODRhNDRjMDkiXSB2YWx1ZSAibWFkX2hhd2tpbmciCiAgICBpbnN0IFsxIG9y ICJjMmExYmQ0MTJhZDQyMDZjZWQ4MTA3YjlmYWExZjliMjQ0YmQ4NzNkY2NlZDZmOTA5ZGJm NzI2ODI2NjJiN2Q5Il0gdmFsdWUgImpvdmlhbF9sb3ZlbGFjZSIKICAgIGluc3QgWzIgb3Ig IjYyZGM3OGQ4NTU0MmYzNWE1N2FhYmU4MjNkNzExMWFkZDFmM2JkMjY5NDAwMTZlNDNkZGZl ZGEzOTQ2OThmMzQiXSB2YWx1ZSAibWFkX2xvdmVsYWNlIgogICAgaW5zdCBbMyBvciAiMmRh YmM2MjllNmQxMTQzMGQ4MDI5YWViYjcwMGY3YTg0ZjNhODA1NDhkNTk2NzEyZGY2OTQ3YTBi MDE5NjdlNyJdIHZhbHVlICJsb25lbHlfYmxhY2t3ZWxsIgogICAgaW5zdCBbNCBvciAiYmJi MDVkNTE1NjAyZjVlNzJjMjAzYjM5YWQzOWIxOGFjNGQ2OTYwZTc2Y2FiMTJmY2YyYzUyMzk4 MzlhNGRiMyJdIHZhbHVlICJwZW5zaXZlX3JpdGNoaWUiCiAgICBpbnN0IFs1IG9yICJmNWMw MDY4OWRhMWU2YjE3MjIyOTUzOWQ2ZjgxMDU0ODc2ZjQxNjQzZWI4YzRlOTFmOWE0NjI1ZjBi MmUxZjMyIl0gdmFsdWUgImJlcnNlcmtfbGVha2V5IgogICAgaW5zdCBbNiBvciAiOWIxMmUx YzYyYmQ0MTU0MzY3ZjVhZDdjY2RhOWIxOTBhNTFhMzNkMjZmM2FmMjYyZTg4YTEzZTlhNDMz YzE4NyJdIHZhbHVlICJuZXdmZWRvcmEiCiAgICBpbnN0IFs3IG9yICJlZWQxNjYzYjBmNDAw Y2UzNjdmZmIwOGIwNzc2M2UxYTVjNDQ1YWFlYzM1N2JiYzYyZjZhZTgwYjdlMmRmMzRjIl0g dmFsdWUgImZ1cmlvdXNfcml0Y2hpZSIKICAgIGluc3QgWzggb3IgIjgzZTdkZGFmZTllYzcx OWUxNWI4NjljNDBiMzU5Y2E5M2E1NTBkM2MyYjg2MDMzZWYwN2RlNGIxZGJjNzJkMGQiXSB2 YWx1ZSAia2lja2Fzc19zaW5vdXNzaSIKICAgIGluc3QgWzkgb3IgIjZkMTI0ZDVjMmQwNWZi Nzk4YTJiZTVhMTBlYWNlNzBkYzBjZWFiY2QxOTA2MWRjZWY2Mzk0ZjI2ZDYxNDFlZGEiXSB2 YWx1ZSAiY3Jhbmt5X21jY2xpbnRvY2siCiAgICBpbnN0IFsxMCBvciAiZjYyNTM0Njc4N2Rm MjI2MWVmMWM5NzM3YzEyYmEyYThlZTNhNjE1MjhjOTZmMWYwMzgzZGM4N2JlNWYwNDE3ZSJd IHZhbHVlICJiZXJzZXJrX3Bpa2UiCiAgICBpbnN0IFsxMSBvciAiZWQwOWJmNTBjYWNlZjE5 NDhkNWM1M2Y4MjkwMGQ4N2QwNGQ4ZmZjZTMwNjY1NmE3ZWY3Y2YyM2I5YmRmNjExNyJdIHZh bHVlICJlbGVnYW50X2NhcnNvbiIKICAgIGluc3QgWzEyIG9yICI0NmFmNjE4OTc5Y2UxM2I2 ZDM2MTM1NTBhYzg0ZDRlNmQ1MWUzMDExZmY4MDZlOWJmYjhiZTliNDhjMjY4NjZhIl0gdmFs dWUgImpvbGx5X21lc3RvcmYiCiAgICBpbnN0IFsxMyBvciAiM2E4YmY1ODdkNzZiMTBmNTJm MWE0OGRkMmVjZjdmNGVmNDgxMTBkZjQxMGY4OTY0Y2Q4N2QzMzRhY2Y3YjhmNiJdIHZhbHVl ICJqb2xseV9wdG9sZW15IgogICAgaW5zdCBbMTQgb3IgIjM5MzNhZTBjYTRmMTA5MzNhMjA2 ZGMyODEwY2MyYTNhNjcyZTkwODAxMTFhNzA4NmVlZTEwOGRkYjk5YjFkZjYiXSB2YWx1ZSAi ZHJlYW15X3Nob2NrbGV5IgogICAgaW5zdCBbMTUgb3IgIjBlZTFhOWQ2NDViZGJjMzkwYzYy ZDFlYjE2MTc3MThjNDU3YTBhYzhiMTFhMTFkYjEyMGFlNGVmNGY3MmM0YTUiXSB2YWx1ZSAi Y29tcGFzc2lvbmF0ZV9iYXJkZWVuIgogICAgaW5zdCBbMTYgb3IgImZhYmVhMzhlOGE2OWE1 ZmZjNzdhYmQ2MzBiMDZhMjhkNzBlZTE4MWRmYmRjNGRhMWRmYzJlMGEzNmIxMjA0NTMiXSB2 YWx1ZSAibWFkX3dpbHNvbiIKICAgIGluc3QgWzE3IG9yICIyZGUyNmMzN2QxYmY4MTQ4OGI2 OTdkYjAwNjcxMTkyNTM2ZTEzNzZiMTZhNTlkMTcyZDFmZGUxYTFjZmQ3MWUxIl0gdmFsdWUg Imh1bmdyeV93aWxzb24iCiAgICBpbnN0IFsxOCBvciAiYjAyZDc4ODgxNmIzMzUxYjFlMDhi MjA0ZjNhYTBiZTZmM2U5OTY5MDE0YTU0ZmY1ZGM0N2RiNTM2NWFjMDNhNiJdIHZhbHVlICJk cmVhbXlfZmVybWkiCiAgICBpbnN0IFsxOSBvciAiYzdiYzYwNzFiMGI1ZWEwZTA3MTZmNDM1 ZjNlNmRmMWFlYzVmNmFmNzI1MGYxNWY5ZDQwN2RiNWZiNWIyNWNmNyJdIHZhbHVlICJsb25l bHlfcGlrZSIKICAgIGluc3QgWzIwIG9yICI0ODI2YWFiZjFmNzI4NjIwOTM5NWYzMDY0OWFj NmQ0ODZmOTYwZDZkNTVmMzUzYzljNzgxZTA1NDZiODAxY2ZiIl0gdmFsdWUgImV2aWxfYWxi YXR0YW5pIgogICAgaW5zdCBbMjEgb3IgImE1NTBjNzljOTQ2YWRkNGMwYzdkOWMxYjQ4Mjcw ZmE1ZmY5ZWNjYjI3OTEyMjI3MDFmMjg3ZmFiY2NmYWU3ZjgiXSB2YWx1ZSAibm9zdGFsZ2lj X2VpbnN0ZWluIgogICAgaW5zdCBbMjIgb3IgImY4OTI4MTNjMGRmMmM4ZGY1YzY3OTdjOTc3 NTA1ODZlMThiM2UwMTAwNGUzMDYxZGQ1MmM0ZWU0Y2Y2MTY0ZDUiXSB2YWx1ZSAidGVuZGVy X2JyYXR0YWluIgogICAgaW5zdCBbMjMgb3IgIjdkMWMxMmFhOTIwMzZjYjNiN2NiNmY0Yzll NDI4YmE3M2M4NDdjNGIyOTU3YzA0YmQ3NDkwZTMxNDIwNGMzMTYiXSB2YWx1ZSAibG9uZWx5 X2tpcmNoIgogICAgaW5zdCBbMjQgb3IgIjczN2I3YmZjMzRlYzc0OTNhZTQxYWExZDBkZDIy MTZhMDgwNzA5NjAzMTBlN2E3YzVkNTg0NjkzNTVlMDQ1ZDYiXSB2YWx1ZSAic2xlZXB5X2Zl cm1pIgogICAgaW5zdCBbMjUgb3IgIjQ2OTVkNTgwYzBjMjMxZjYzNDc0MzhlYWJjYmNlYzUx MGUxMzU5Mjc2NzBiYWE1OGNlOWM3YzA1YzcyY2FhNWYiXSB2YWx1ZSAiaHVuZ3J5X2JhcmRl ZW4iCg== --------------090004030101060905060408-- From mgoodwin@redhat.com Mon Feb 9 18:58:03 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id C0CFD7FBE for ; Mon, 9 Feb 2015 18:58:03 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 4E09FAC003 for ; Mon, 9 Feb 2015 16:58:03 -0800 (PST) X-ASG-Debug-ID: 1423529881-04cbb01165ec6f0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id DY5G4y9rQ6mTTNLl (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 16:58:02 -0800 (PST) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1A0w19u003529 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 9 Feb 2015 19:58:01 -0500 Received: from [10.64.5.223] (reserved-5-223.bne.redhat.com [10.64.5.223]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1A0vxd4023331; Mon, 9 Feb 2015 19:58:00 -0500 Message-ID: <54D95796.9050106@redhat.com> Date: Tue, 10 Feb 2015 10:57:58 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp@oss.sgi.com Subject: Re: [pcp] Containers analysis with PCP References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> <54D9447B.203@redhat.com> <743115533.1781377.1423528533840.JavaMail.zimbra@redhat.com> <54D955EB.4040201@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Containers analysis with PCP In-Reply-To: <54D955EB.4040201@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423529881 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 02/10/2015 10:50 AM, Mark Goodwin wrote: > On 02/10/2015 10:35 AM, Nathan Scott wrote: >> Hi Mark, >> >> ----- Original Message ----- >>> [...] >>> Not working for me either, but I'm getting ENOSUP errors. I'm running >>> top-of-tree on f19 (3.10.3-1) : >>> [...] >>> # pminfo -h localhost --container c2a1bd412ad4 -f hinv.ncpu >>> pminfo: Cannot connect to PMCD on host "localhost": Operation not supported >> >> What does "pminfo -f containers" say? > > see attached pminfo -f containers.name (it's pretty wordy) Also, would it be a bit more user-friendly if the external instance names were the container name instead of the container-id? BTW pminfo -f containers.state.running shows none are running, but I know for sure that one of them is. From nscott@redhat.com Mon Feb 9 18:58:48 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 215187FBE for ; Mon, 9 Feb 2015 18:58:48 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 0ED018F8033 for ; Mon, 9 Feb 2015 16:58:48 -0800 (PST) X-ASG-Debug-ID: 1423529925-04cb6c6b0af0330001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id d00n3qWvP3cq10yh (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 16:58:46 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1A0wjYe017201; Mon, 9 Feb 2015 19:58:45 -0500 Date: Mon, 9 Feb 2015 19:58:45 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Mark Goodwin Cc: "pcp@oss.sgi.com >> PCP" Message-ID: <101871230.1785584.1423529925191.JavaMail.zimbra@redhat.com> In-Reply-To: <54D955EB.4040201@redhat.com> References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> <54D9447B.203@redhat.com> <743115533.1781377.1423528533840.JavaMail.zimbra@redhat.com> <54D955EB.4040201@redhat.com> Subject: Re: [pcp] Containers analysis with PCP MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Containers analysis with PCP Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Containers analysis with PCP Thread-Index: AUuXoDNsf8DOlZK5thzI2iCUEfN0+A== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1423529925 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15092 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi Mark, ----- Original Message ----- > [...] > see attached pminfo -f containers.name (it's pretty wordy) > Do the containers.pid metrics reflect valid pids for the running containers? Does pmcd.feature.containers metric have value 1? If both look OK, I'll need you to dig further into where things are going off the rails in the libpcp/ pmcd connection setup (stepping through with gdb & finding where ENOTSUPP is coming from). > > > >> Also note: after upgrading to pcp-3.10.3 I had to manually Install the > >> new root PMDA. Should it be auto-installed? > > > > It is auto-installed for new installations, and /etc/pcp/pmcd/pmcd.conf > > falls under the usual RPM configuration file rules for an upgrade. > > that's fine, but if the root PMDA is needed for container support to > function, then we'll have an upgrade issue that'll need management (?) Yep. Any suggestions beyond what has already been done (the PMDA Install and Remove scripts, default inclusion in pmcd.conf, and the how-to doc)? cheers. -- Nathan From nscott@redhat.com Mon Feb 9 19:05:16 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id C9DDC7FBE for ; Mon, 9 Feb 2015 19:05:16 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 58B12AC003 for ; Mon, 9 Feb 2015 17:05:13 -0800 (PST) X-ASG-Debug-ID: 1423530311-04cbb01162ec8e0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id BedXR6tzrFBwHkpp (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 17:05:11 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1A155tn022205; Mon, 9 Feb 2015 20:05:05 -0500 Date: Mon, 9 Feb 2015 20:05:05 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Mark Goodwin Cc: pcp@oss.sgi.com Message-ID: <1959010667.1788714.1423530305916.JavaMail.zimbra@redhat.com> In-Reply-To: <54D95796.9050106@redhat.com> References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> <54D9447B.203@redhat.com> <743115533.1781377.1423528533840.JavaMail.zimbra@redhat.com> <54D955EB.4040201@redhat.com> <54D95796.9050106@redhat.com> Subject: Re: [pcp] Containers analysis with PCP MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Containers analysis with PCP Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Containers analysis with PCP Thread-Index: FiEQAOeTe9EhTuqdCVJkg1XdOKbr+A== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1423530311 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15092 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > [...] > Also, would it be a bit more user-friendly if the external instance > names were the container name instead of the container-id? Yeah, I thought alot about that but went with the hash in the end because it means we need to do alot less work in the PMDA for each instance refresh. > BTW pminfo -f containers.state.running shows none are running, but I know > for sure that one of them is. Hmm, thats a good clue. Can you send through the container.pid values?, keen to see what pmdaroot discovered there. thanks. -- Nathan From nscott@redhat.com Mon Feb 9 19:08:48 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 977D47FBE for ; Mon, 9 Feb 2015 19:08:48 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 23BF0AC003 for ; Mon, 9 Feb 2015 17:08:47 -0800 (PST) X-ASG-Debug-ID: 1423530525-04cb6c6b0af05f0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id AtzpoRL8NnyxVU0N (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 17:08:45 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1A178Td018310; Mon, 9 Feb 2015 20:07:08 -0500 Date: Mon, 9 Feb 2015 20:07:08 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: "pcp@oss.sgi.com >> PCP" Message-ID: <1243621922.1791278.1423530428670.JavaMail.zimbra@redhat.com> In-Reply-To: <54D9343F.1070703@internode.on.net> References: <724742467.926637.1423458271929.JavaMail.zimbra@redhat.com> <54D9343F.1070703@internode.on.net> Subject: Re: Reduce pmdaproc.sh runtime for pmdaInstall MIME-Version: 1.0 X-ASG-Orig-Subj: Re: Reduce pmdaproc.sh runtime for pmdaInstall Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Reduce pmdaproc.sh runtime for pmdaInstall Thread-Index: PU6RvTryzEGdNOThwf4dCcihRi1QWg== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1423530525 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15092 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > On 09/02/15 16:04, Nathan Scott wrote: > > Hi Ken, > > > > When the dust settles on the current crop of failures we're > > triaging, could you toss the attached patch into the QA farm > > and see how it fares? > > No regressions on the first host I tried this on with a full QA run. > > I've committed it to my git tree (but not sent git push email yet), as > that is the best way for me to get it used across all the hosts in my QA > farm. Great - thanks Ken! -- Nathan From mgoodwin@redhat.com Mon Feb 9 19:10:47 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 29BBB7FBE for ; Mon, 9 Feb 2015 19:10:47 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id ED6388F8033 for ; Mon, 9 Feb 2015 17:10:43 -0800 (PST) X-ASG-Debug-ID: 1423530642-04bdf06a5bf6850001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id PcRhLLvpQK76xruI (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 17:10:42 -0800 (PST) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1A1Ag3Q017596 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 9 Feb 2015 20:10:42 -0500 Received: from [10.64.5.223] (reserved-5-223.bne.redhat.com [10.64.5.223]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1A1Aedv003110; Mon, 9 Feb 2015 20:10:41 -0500 Message-ID: <54D95A8F.5030704@redhat.com> Date: Tue, 10 Feb 2015 11:10:39 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp@oss.sgi.com Subject: Re: [pcp] Containers analysis with PCP References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> <54D9447B.203@redhat.com> <743115533.1781377.1423528533840.JavaMail.zimbra@redhat.com> <54D955EB.4040201@redhat.com> <54D95796.9050106@redhat.com> <1959010667.1788714.1423530305916.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Containers analysis with PCP In-Reply-To: <1959010667.1788714.1423530305916.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423530642 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 02/10/2015 11:05 AM, Nathan Scott wrote: > > > ----- Original Message ----- >> [...] >> Also, would it be a bit more user-friendly if the external instance >> names were the container name instead of the container-id? > > Yeah, I thought alot about that but went with the hash in the end because it > means we need to do alot less work in the PMDA for each instance refresh. well the id<->name is 1:1 isn't it? So shouldn't be a lot of extra work?? And you could have a containers.id metric whose indom is the name and value is the id (to export the mapping). An ascii string name is a lot easier to use (and remember) than a whopping 64 character hash id :) > >> BTW pminfo -f containers.state.running shows none are running, but I know >> for sure that one of them is. > > Hmm, thats a good clue. Can you send through the container.pid values?, keen > to see what pmdaroot discovered there. containers.pid should pid is 0 for all containers. I'll fire up gdb and see where the ENOSUP is coming from (might not be until later today ...) Cheers From goodwinos@gmail.com Mon Feb 9 19:18:35 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=FREEMAIL_FROM autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 359AF7FBE for ; Mon, 9 Feb 2015 19:18:35 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 1C2158F8074 for ; Mon, 9 Feb 2015 17:18:35 -0800 (PST) X-ASG-Debug-ID: 1423531113-04cb6c6b0af08e0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id epFgGmtNNQAgpxn5 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 17:18:34 -0800 (PST) X-Barracuda-Envelope-From: goodwinos@gmail.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1A1IXdQ013923 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 9 Feb 2015 20:18:33 -0500 Received: from [10.64.5.223] (wlan-5-223.bne.redhat.com [10.64.5.223] (may be forged)) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1A1IWjf006570 for ; Mon, 9 Feb 2015 20:18:33 -0500 Message-ID: <54D95C67.4020802@gmail.com> Date: Tue, 10 Feb 2015 11:18:31 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] Containers analysis with PCP References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> <54D9447B.203@redhat.com> <743115533.1781377.1423528533840.JavaMail.zimbra@redhat.com> <54D955EB.4040201@redhat.com> <101871230.1785584.1423529925191.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Containers analysis with PCP In-Reply-To: <101871230.1785584.1423529925191.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423531114 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 02/10/2015 10:58 AM, Nathan Scott wrote: > Hi Mark, > > ----- Original Message ----- >> [...] >> see attached pminfo -f containers.name (it's pretty wordy) >> > > Do the containers.pid metrics reflect valid pids for the running containers? > Does pmcd.feature.containers metric have value 1? If both look OK, I'll need > you to dig further into where things are going off the rails in the libpcp/ > pmcd connection setup (stepping through with gdb & finding where ENOTSUPP is > coming from). pmcd.feature.containers is 1 but containers.pid is 0 for all containers. >>> >>>> Also note: after upgrading to pcp-3.10.3 I had to manually Install the >>>> new root PMDA. Should it be auto-installed? >>> >>> It is auto-installed for new installations, and /etc/pcp/pmcd/pmcd.conf >>> falls under the usual RPM configuration file rules for an upgrade. >> >> that's fine, but if the root PMDA is needed for container support to >> function, then we'll have an upgrade issue that'll need management (?) > > Yep. Any suggestions beyond what has already been done (the PMDA Install > and Remove scripts, default inclusion in pmcd.conf, and the how-to doc)? Installing $(PCP_PMDAS_DIR)/root/.NeedInstall should do? From nscott@redhat.com Mon Feb 9 19:20:16 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 9B18D7FBE for ; Mon, 9 Feb 2015 19:20:16 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 26D03AC002 for ; Mon, 9 Feb 2015 17:20:16 -0800 (PST) X-ASG-Debug-ID: 1423531212-04cb6c6b0bf0980001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id zRGemaqVXD8hQiEc (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 17:20:13 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1A1KC7M006218; Mon, 9 Feb 2015 20:20:12 -0500 Date: Mon, 9 Feb 2015 20:20:12 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Mark Goodwin Cc: pcp@oss.sgi.com Message-ID: <1858725993.1798147.1423531212593.JavaMail.zimbra@redhat.com> In-Reply-To: <54D95A8F.5030704@redhat.com> References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <54D9447B.203@redhat.com> <743115533.1781377.1423528533840.JavaMail.zimbra@redhat.com> <54D955EB.4040201@redhat.com> <54D95796.9050106@redhat.com> <1959010667.1788714.1423530305916.JavaMail.zimbra@redhat.com> <54D95A8F.5030704@redhat.com> Subject: Re: [pcp] Containers analysis with PCP MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Containers analysis with PCP Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Containers analysis with PCP Thread-Index: oC5XiSjzhulJGgeqPHgMFpvitv8ckw== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1423531213 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15092 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > On 02/10/2015 11:05 AM, Nathan Scott wrote: > well the id<->name is 1:1 isn't it? So shouldn't be a lot of extra work?? Yes, but that assertion doesn't follow. :) Its very cheap to find all the hash names and to see if the set has changed, its more work to find all of the other metric values there. > And you could have a containers.id metric whose indom is the name and value > is the id (to export the mapping). An ascii string name is a lot easier to > use (and remember) than a whopping 64 character hash id :) Yes, I definitely thought about wearing the extra cost. Maybe we should, maybe we will end up having to wear this cost anyway in order to solve... > >> BTW pminfo -f containers.state.running shows none are running, but I > >> know > >> for sure that one of them is. > > > > Hmm, thats a good clue. Can you send through the container.pid values?, > > keen > > to see what pmdaroot discovered there. > > containers.pid should pid is 0 for all containers. > > I'll fire up gdb and see where the ENOSUP is coming from (might > not be until later today ...) If all your containers are showing up as inactive, and you know some are running, this is likely to be a big part of the problem. Can you tar up your /var/lib/docker directory & send it to me (off-list) please? cheers. -- Nathan From nscott@redhat.com Mon Feb 9 19:24:01 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 3C7D57FC2 for ; Mon, 9 Feb 2015 19:24:01 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 0D7F2304043 for ; Mon, 9 Feb 2015 17:23:57 -0800 (PST) X-ASG-Debug-ID: 1423531435-04bdf06a5bf6ae0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id 3n57XdEUGN0kzMIy (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 17:23:56 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1A1Nsru021404; Mon, 9 Feb 2015 20:23:54 -0500 Date: Mon, 9 Feb 2015 20:23:54 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Mark Goodwin Cc: pcp@oss.sgi.com Message-ID: <1944361706.1798643.1423531434154.JavaMail.zimbra@redhat.com> In-Reply-To: <54D95C67.4020802@gmail.com> References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> <54D9447B.203@redhat.com> <743115533.1781377.1423528533840.JavaMail.zimbra@redhat.com> <54D955EB.4040201@redhat.com> <101871230.1785584.1423529925191.JavaMail.zimbra@redhat.com> <54D95C67.4020802@gmail.com> Subject: Re: [pcp] Containers analysis with PCP MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Containers analysis with PCP Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Containers analysis with PCP Thread-Index: raf6d99Z/0+doXmI5SiTOxMe5kOuAg== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1423531436 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15092 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > On 02/10/2015 10:58 AM, Nathan Scott wrote: > >[...] > > Yep. Any suggestions beyond what has already been done (the PMDA Install > > and Remove scripts, default inclusion in pmcd.conf, and the how-to doc)? > > Installing $(PCP_PMDAS_DIR)/root/.NeedInstall should do? > Great idea! Hmm, oh, wait - except if someone had removed it, we'd constantly be putting it back. Maybe worth trading off that issue for ensuring its there? Not clear. Its complicated by the change to pmdalinux as well (needs to be run as daemon now) in pmcd.conf ... which we can't tackle this way. So, we kinda need people on upgrade to look at pmcd.conf and actively choose how they want to run things. cheers. -- Nathan From mgoodwin@redhat.com Mon Feb 9 19:30:00 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 59A477FC2 for ; Mon, 9 Feb 2015 19:30:00 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 34D8B8F8073 for ; Mon, 9 Feb 2015 17:30:00 -0800 (PST) X-ASG-Debug-ID: 1423531798-04bdf06a5bf6c40001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id df7pZsuU5Q2GQJkE (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 17:29:59 -0800 (PST) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1A1TwLl017595 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 9 Feb 2015 20:29:58 -0500 Received: from [10.64.5.223] (wlan-5-223.bne.redhat.com [10.64.5.223] (may be forged)) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1A1Tvlh010490 for ; Mon, 9 Feb 2015 20:29:58 -0500 Message-ID: <54D95F14.8040505@redhat.com> Date: Tue, 10 Feb 2015 11:29:56 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] Containers analysis with PCP References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> <54D9447B.203@redhat.com> <743115533.1781377.1423528533840.JavaMail.zimbra@redhat.com> <54D955EB.4040201@redhat.com> <101871230.1785584.1423529925191.JavaMail.zimbra@redhat.com> <54D95C67.4020802@gmail.com> <1944361706.1798643.1423531434154.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Containers analysis with PCP In-Reply-To: <1944361706.1798643.1423531434154.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423531799 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 02/10/2015 11:23 AM, Nathan Scott wrote: > > > ----- Original Message ----- >> On 02/10/2015 10:58 AM, Nathan Scott wrote: >>> [...] >>> Yep. Any suggestions beyond what has already been done (the PMDA Install >>> and Remove scripts, default inclusion in pmcd.conf, and the how-to doc)? >> >> Installing $(PCP_PMDAS_DIR)/root/.NeedInstall should do? >> > > Great idea! Hmm, oh, wait - except if someone had removed it, we'd constantly > be putting it back. Maybe worth trading off that issue for ensuring its there? > Not clear. Its complicated by the change to pmdalinux as well (needs to be run > as daemon now) in pmcd.conf ... which we can't tackle this way. So, we kinda > need people on upgrade to look at pmcd.conf and actively choose how they want > to run things. Well, I think we need to figure it out and make sure it's always there - an admin should have to do something to turn it off (if that's how they want to run), but IMO the default install and upgrade scenario should have it activated. The docker folks are convinced that containers will take over the known universe, once systemd has finished with it ;) Cheers From fche@redhat.com Mon Feb 9 20:34:45 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 556E97FC2 for ; Mon, 9 Feb 2015 20:34:45 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id DF669AC002 for ; Mon, 9 Feb 2015 18:34:41 -0800 (PST) X-ASG-Debug-ID: 1423535676-04cb6c6b0cf1ac0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id SeIt9Md7BxYVFcmc (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 18:34:37 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1A2YZAC031655 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 9 Feb 2015 21:34:36 -0500 Received: from fche.csb (vpn-230-246.phx2.redhat.com [10.3.230.246]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1A2YZbV008146; Mon, 9 Feb 2015 21:34:35 -0500 Received: by fche.csb (Postfix, from userid 2569) id 30ABC58516; Mon, 9 Feb 2015 21:34:10 -0500 (EST) Date: Mon, 9 Feb 2015 21:34:10 -0500 From: "Frank Ch. Eigler" To: Nathan Scott Cc: PCP Subject: Re: Containers analysis with PCP Message-ID: <20150210023410.GE25151@redhat.com> X-ASG-Orig-Subj: Re: Containers analysis with PCP References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> <1602407544.1781133.1423528333125.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1602407544.1781133.1423528333125.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423535677 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - > > Please don't forget to address earlier review comments in [1]. > > The review was ~2 weeks out of date when sent & the one/two issues there > were fixed already, independently. It would have been helpful to note this contemporaneously. > I see nothing needing further action there. Please check closer. Nothing appears to have changed about container naming policy or mechanism (pmdas still store it as char*'s, resolution still done repeatedly and ambiguously), which represented the bulk of the concern. > Feel free to revisit & reassess with current code (objectively, > please - patches and QA tests will help you more than opinions about > design docs) (The absence of design docs/discussion is an objective fact.) - FChE From nscott@redhat.com Mon Feb 9 20:56:56 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 81DD87FC2 for ; Mon, 9 Feb 2015 20:56:56 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 0B9E8AC003 for ; Mon, 9 Feb 2015 18:56:55 -0800 (PST) X-ASG-Debug-ID: 1423537012-04cb6c6b0af2020001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id ZV5Cf3nI6ZGnYpFU (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 09 Feb 2015 18:56:53 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1A2uquS005927; Mon, 9 Feb 2015 21:56:52 -0500 Date: Mon, 9 Feb 2015 21:56:52 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: PCP Message-ID: <1930031505.1820911.1423537012392.JavaMail.zimbra@redhat.com> In-Reply-To: <20150210023410.GE25151@redhat.com> References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> <1602407544.1781133.1423528333125.JavaMail.zimbra@redhat.com> <20150210023410.GE25151@redhat.com> Subject: Re: Containers analysis with PCP MIME-Version: 1.0 X-ASG-Orig-Subj: Re: Containers analysis with PCP Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Containers analysis with PCP Thread-Index: F1Yp78b57Cv+d9niURMvgQ/11O2mtw== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1423537013 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15094 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > [...] > Please check closer. Nothing appears to have changed about container > naming policy or mechanism (pmdas still store it as char*'s, > resolution still done repeatedly and ambiguously), which represented > the bulk of the concern. I understood your concern, but I was then and remain now unconvinced of any genuine issues there. Arguing about it then, as now, is sure to be counter-productive, and time is precious. cheers. -- Nathan From kenj@internode.on.net Tue Feb 10 02:58:56 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 67C987FBE for ; Tue, 10 Feb 2015 02:58:56 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 5656A8F8073 for ; Tue, 10 Feb 2015 00:58:53 -0800 (PST) X-ASG-Debug-ID: 1423558729-04cb6c6b0af8780001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id mQALoCGHiGnusR7n for ; Tue, 10 Feb 2015 00:58:50 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: At8BAGzH2VR20Zu9PGdsb2JhbAANT4c0gyrACYQyAQEBAQEBBQEBAQE4hHFVNgIFFgsCCwMCAQIBMRoNCAEBvg9wlwAsgSGRRYFCBas3hCSDHQEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail04.adl6.internode.on.net with ESMTP; 10 Feb 2015 19:28:48 +1030 Message-ID: <54D9C865.6060708@internode.on.net> Date: Tue, 10 Feb 2015 19:59:17 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: PCP Subject: ipv6 and qa/533 question Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: ipv6 and qa/533 question Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1423558729 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15100 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Can someone with ipv6 experience help here? On vm02 (i686 openSUSE 12.1), pmconfig -L reports kenj@vm02:~/src/pcp/qa$ pmconfig -L ipv6 ipv6=true But qa/533 dies because the pmda fails to create the ipv6 socket, thusly ... Log for pmdasample on vm02 started Tue Feb 10 19:54:00 2015 __pmSetSocketIPC: fd=5 IPC table fd(PDU version): auxconnect.c:__pmBind(fd=5, family=10, port=6261, addr=::1) [Tue Feb 10 19:54:00] pmdasample(21089) Critical: __pmdaOpenSocket: bind: Cannot assign requested address Log finished Tue Feb 10 19:54:00 2015 Any suggestion as to where I go from here? From nscott@redhat.com Tue Feb 10 05:11:16 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id F1C3D7FC6 for ; Tue, 10 Feb 2015 05:11:15 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 7192EAC006 for ; Tue, 10 Feb 2015 03:11:12 -0800 (PST) X-ASG-Debug-ID: 1423566667-04cb6c6b0bfad50001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id nwjtT8IlBC2vbWbJ (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 10 Feb 2015 03:11:07 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1ABB4Ts006938; Tue, 10 Feb 2015 06:11:04 -0500 Date: Tue, 10 Feb 2015 06:11:04 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: "pcp@oss.sgi.com >> PCP" Message-ID: <1786689886.2028682.1423566664005.JavaMail.zimbra@redhat.com> In-Reply-To: <717061209.2027585.1423566421833.JavaMail.zimbra@redhat.com> Subject: interp3.c vs valgrind qa fallout MIME-Version: 1.0 X-ASG-Orig-Subj: interp3.c vs valgrind qa fallout Content-Type: multipart/mixed; boundary="----=_Part_2028680_1652214986.1423566664001" X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: interp3.c vs valgrind qa fallout Thread-Index: R/l+QZkqqRxSAtQKldln5DL+vtAlPg== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1423566667 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15102 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ------=_Part_2028680_1652214986.1423566664001 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Hi Ken, I'm running your latest dev with pmdaproc.sh speedup ... seeing the attached qa fail - just FYI. I'm not seeing any likely libpcp cause so I'm punting this change is behind it at this stage: commit 641cefaa599a66e55e2faf741581483dc1091650 Author: Ken McDonell Date: Tue Feb 10 12:17:34 2015 +1100 qa/src/interp3.c: free() the *alloc()s from main Avoids confusing valgrind in some places, like vm25 (x86_64 CentOS 5.5). Lemme know if its not ringing a bell & I'll dig further. cheers. -- Nathan ------=_Part_2028680_1652214986.1423566664001 Content-Type: application/octet-stream; name=394.out.bad Content-Disposition: attachment; filename=394.out.bad Content-Transfer-Encoding: base64 UUEgb3V0cHV0IGNyZWF0ZWQgYnkgMzk0Cgo9PT0gc3JjL2JpZ2JpbiBkZWx0YT0yID09PQo9PT0g c3RkIGVyciA9PT0KPT09IGZpbHRlcmVkIHZhbGdyaW5kIHJlcG9ydCA9PT0KTWVtY2hlY2ssIGEg bWVtb3J5IGVycm9yIGRldGVjdG9yCkNvbW1hbmQ6IHNyYy9pbnRlcnAzIC1hIHNyYy9iaWdiaW4g LXQgMgozLDgyOCAoNzkyIGRpcmVjdCwgMywwMzYgaW5kaXJlY3QpIGJ5dGVzIGluIDExIGJsb2Nr cyBhcmUgZGVmaW5pdGVseSBsb3N0IGluIGxvc3MgcmVjb3JkIDUyIG9mIDU1CmF0IDB4NEEwNUZE RTogbWFsbG9jICh2Z19yZXBsYWNlX21hbGxvYy5jOjIzNikKYnkgMHg0QzYzRjE2OiBfX3BtTG9n RmV0Y2hJbnRlcnAgKGludGVycC5jOjY0MCkKYnkgMHg0QzVGMjVDOiBfX3BtTG9nRmV0Y2ggKGxv Z3V0aWwuYzoxNzQ5KQpieSAweDRDM0NCMjM6IHBtRmV0Y2ggKGZldGNoLmM6MTUxKQpieSAweDQw MTRBRjogbWFpbiAoaW50ZXJwMy5jOjIxMCkKTEVBSyBTVU1NQVJZOgpkZWZpbml0ZWx5IGxvc3Q6 IDc5MiBieXRlcyBpbiAxMSBibG9ja3MKaW5kaXJlY3RseSBsb3N0OiAzLDAzNiBieXRlcyBpbiA3 NSBibG9ja3MKRVJST1IgU1VNTUFSWTogMSBlcnJvcnMgZnJvbSAxIGNvbnRleHRzIC4uLgoKPT09 IHNyYy9iaWdiaW4gZGVsdGE9MC4wMTIgPT09Cj09PSBzdGQgZXJyID09PQo9PT0gZmlsdGVyZWQg dmFsZ3JpbmQgcmVwb3J0ID09PQpNZW1jaGVjaywgYSBtZW1vcnkgZXJyb3IgZGV0ZWN0b3IKQ29t bWFuZDogc3JjL2ludGVycDMgLWEgc3JjL2JpZ2JpbiAtdCAwLjAxMgo2NDYsMzU2ICgxMjAsMDI0 IGRpcmVjdCwgNTI2LDMzMiBpbmRpcmVjdCkgYnl0ZXMgaW4gMSw2NjcgYmxvY2tzIGFyZSBkZWZp bml0ZWx5IGxvc3QgaW4gbG9zcyByZWNvcmQgNzAgb2YgNzAKYXQgMHg0QTA1RkRFOiBtYWxsb2Mg KHZnX3JlcGxhY2VfbWFsbG9jLmM6MjM2KQpieSAweDRDNjNGMTY6IF9fcG1Mb2dGZXRjaEludGVy cCAoaW50ZXJwLmM6NjQwKQpieSAweDRDNUYyNUM6IF9fcG1Mb2dGZXRjaCAobG9ndXRpbC5jOjE3 NDkpCmJ5IDB4NEMzQ0IyMzogcG1GZXRjaCAoZmV0Y2guYzoxNTEpCmJ5IDB4NDAxNEFGOiBtYWlu IChpbnRlcnAzLmM6MjEwKQpMRUFLIFNVTU1BUlk6CmRlZmluaXRlbHkgbG9zdDogMTIwLDAyNCBi eXRlcyBpbiAxLDY2NyBibG9ja3MKaW5kaXJlY3RseSBsb3N0OiA1MjYsMzMyIGJ5dGVzIGluIDEx LDY2NyBibG9ja3MKRVJST1IgU1VNTUFSWTogMSBlcnJvcnMgZnJvbSAxIGNvbnRleHRzIC4uLgoK PT09IHNyYy9ub3RpLW9rLWZvbyBkZWx0YT0wLjUgPT09Cj09PSBzdGQgZXJyID09PQo9PT0gZmls dGVyZWQgdmFsZ3JpbmQgcmVwb3J0ID09PQpNZW1jaGVjaywgYSBtZW1vcnkgZXJyb3IgZGV0ZWN0 b3IKQ29tbWFuZDogc3JjL2ludGVycDMgLWEgc3JjL25vdGktb2stZm9vIC10IDAuNQo0LDQ1MSAo MSwyMjQgZGlyZWN0LCAzLDIyNyBpbmRpcmVjdCkgYnl0ZXMgaW4gMTcgYmxvY2tzIGFyZSBkZWZp bml0ZWx5IGxvc3QgaW4gbG9zcyByZWNvcmQgNjEgb2YgNjMKYXQgMHg0QTA1RkRFOiBtYWxsb2Mg KHZnX3JlcGxhY2VfbWFsbG9jLmM6MjM2KQpieSAweDRDNjNGMTY6IF9fcG1Mb2dGZXRjaEludGVy cCAoaW50ZXJwLmM6NjQwKQpieSAweDRDNUYyNUM6IF9fcG1Mb2dGZXRjaCAobG9ndXRpbC5jOjE3 NDkpCmJ5IDB4NEMzQ0IyMzogcG1GZXRjaCAoZmV0Y2guYzoxNTEpCmJ5IDB4NDAxNEFGOiBtYWlu IChpbnRlcnAzLmM6MjEwKQpMRUFLIFNVTU1BUlk6CmRlZmluaXRlbHkgbG9zdDogMSwyMjQgYnl0 ZXMgaW4gMTcgYmxvY2tzCmluZGlyZWN0bHkgbG9zdDogMywyMjcgYnl0ZXMgaW4gMTE3IGJsb2Nr cwpFUlJPUiBTVU1NQVJZOiAxIGVycm9ycyBmcm9tIDEgY29udGV4dHMgLi4uCgo9PT0gc3JjL25v dGktb2stZm9vIGRlbHRhPTEuMCA9PT0KPT09IHN0ZCBlcnIgPT09Cj09PSBmaWx0ZXJlZCB2YWxn cmluZCByZXBvcnQgPT09Ck1lbWNoZWNrLCBhIG1lbW9yeSBlcnJvciBkZXRlY3RvcgpDb21tYW5k OiBzcmMvaW50ZXJwMyAtYSBzcmMvbm90aS1vay1mb28gLXQgMS4wCjIsMzYzICg2NDggZGlyZWN0 LCAxLDcxNSBpbmRpcmVjdCkgYnl0ZXMgaW4gOSBibG9ja3MgYXJlIGRlZmluaXRlbHkgbG9zdCBp biBsb3NzIHJlY29yZCA1OSBvZiA2MwphdCAweDRBMDVGREU6IG1hbGxvYyAodmdfcmVwbGFjZV9t YWxsb2MuYzoyMzYpCmJ5IDB4NEM2M0YxNjogX19wbUxvZ0ZldGNoSW50ZXJwIChpbnRlcnAuYzo2 NDApCmJ5IDB4NEM1RjI1QzogX19wbUxvZ0ZldGNoIChsb2d1dGlsLmM6MTc0OSkKYnkgMHg0QzND QjIzOiBwbUZldGNoIChmZXRjaC5jOjE1MSkKYnkgMHg0MDE0QUY6IG1haW4gKGludGVycDMuYzoy MTApCkxFQUsgU1VNTUFSWToKZGVmaW5pdGVseSBsb3N0OiA2NDggYnl0ZXMgaW4gOSBibG9ja3MK aW5kaXJlY3RseSBsb3N0OiAxLDcxNSBieXRlcyBpbiA2MiBibG9ja3MKRVJST1IgU1VNTUFSWTog MSBlcnJvcnMgZnJvbSAxIGNvbnRleHRzIC4uLgoKPT09IHNyYy9ub3RpLW9rLWZvbyBkZWx0YT0y LjAgPT09Cj09PSBzdGQgZXJyID09PQo9PT0gZmlsdGVyZWQgdmFsZ3JpbmQgcmVwb3J0ID09PQpN ZW1jaGVjaywgYSBtZW1vcnkgZXJyb3IgZGV0ZWN0b3IKQ29tbWFuZDogc3JjL2ludGVycDMgLWEg c3JjL25vdGktb2stZm9vIC10IDIuMAoxLDI2NSAoMzYwIGRpcmVjdCwgOTA1IGluZGlyZWN0KSBi eXRlcyBpbiA1IGJsb2NrcyBhcmUgZGVmaW5pdGVseSBsb3N0IGluIGxvc3MgcmVjb3JkIDYwIG9m IDY1CmF0IDB4NEEwNUZERTogbWFsbG9jICh2Z19yZXBsYWNlX21hbGxvYy5jOjIzNikKYnkgMHg0 QzYzRjE2OiBfX3BtTG9nRmV0Y2hJbnRlcnAgKGludGVycC5jOjY0MCkKYnkgMHg0QzVGMjVDOiBf X3BtTG9nRmV0Y2ggKGxvZ3V0aWwuYzoxNzQ5KQpieSAweDRDM0NCMjM6IHBtRmV0Y2ggKGZldGNo LmM6MTUxKQpieSAweDQwMTRBRjogbWFpbiAoaW50ZXJwMy5jOjIxMCkKTEVBSyBTVU1NQVJZOgpk ZWZpbml0ZWx5IGxvc3Q6IDM2MCBieXRlcyBpbiA1IGJsb2NrcwppbmRpcmVjdGx5IGxvc3Q6IDkw NSBieXRlcyBpbiAzNCBibG9ja3MKRVJST1IgU1VNTUFSWTogMSBlcnJvcnMgZnJvbSAxIGNvbnRl eHRzIC4uLgo= ------=_Part_2028680_1652214986.1423566664001-- From nscott@redhat.com Tue Feb 10 05:24:11 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id CA50D7FC9 for ; Tue, 10 Feb 2015 05:24:11 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id B8F97304032 for ; Tue, 10 Feb 2015 03:24:08 -0800 (PST) X-ASG-Debug-ID: 1423567446-04cbb01162f6360001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id smVL33ohseaeNKsG (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 10 Feb 2015 03:24:07 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1ABO4Es018760; Tue, 10 Feb 2015 06:24:04 -0500 Date: Tue, 10 Feb 2015 06:24:04 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: PCP Message-ID: <1574919743.2034323.1423567444249.JavaMail.zimbra@redhat.com> In-Reply-To: <54D9C865.6060708@internode.on.net> References: <54D9C865.6060708@internode.on.net> Subject: Re: [pcp] ipv6 and qa/533 question MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] ipv6 and qa/533 question Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: ipv6 and qa/533 question Thread-Index: mZ19t4Klr+juonmiBrVVVZG1l9PCmw== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1423567447 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15103 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > Can someone with ipv6 experience help here? > [...] > auxconnect.c:__pmBind(fd=5, family=10, port=6261, addr=::1) > [Tue Feb 10 19:54:00] pmdasample(21089) Critical: __pmdaOpenSocket: bind: > Cannot assign requested address Some googling suggests this to be a fairly regular occurrence with IPv6 interfaces that have recently been brought up & are still in "tentative" state... what does "ip -6 addr show tentative" say? cheers. -- Nathan From fche@redhat.com Tue Feb 10 10:33:48 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id E29AA7FC3 for ; Tue, 10 Feb 2015 10:33:48 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id D05068F808E for ; Tue, 10 Feb 2015 08:33:45 -0800 (PST) X-ASG-Debug-ID: 1423586024-04cbb01163116760001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id thBeT8Oyk0DMl75h (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 10 Feb 2015 08:33:44 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1AGXhSn026065 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 10 Feb 2015 11:33:43 -0500 Received: from fche.csb (vpn-231-172.phx2.redhat.com [10.3.231.172]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1AGXgEx025168; Tue, 10 Feb 2015 11:33:43 -0500 Received: by fche.csb (Postfix, from userid 2569) id E93B15850D; Tue, 10 Feb 2015 11:33:15 -0500 (EST) Date: Tue, 10 Feb 2015 11:33:15 -0500 From: "Frank Ch. Eigler" To: Nathan Scott Cc: pcp developers Subject: Re: [pcp] libpcp crash in sasl/connection/attributes Message-ID: <20150210163315.GG25151@redhat.com> X-ASG-Orig-Subj: Re: [pcp] libpcp crash in sasl/connection/attributes References: <20150209192657.GD25151@redhat.com> <1691871639.1781628.1423528765870.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1691871639.1781628.1423528765870.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423586024 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - > > This is with older-than-git-master libpcp, but as this problem occurs > > during the pmNewContext, commit 63721a89 shouldn't be related. > > > > % valgrind pminfo -h 'pcp://localhost?pass=jsjs' > > Hmm, this is not reproducible here with current dev - I see all sorts of > krb*, sasl*, and gss* valgrind warnings from error paths in those libs, > but nothing that seems to originate from pcp so far. I don't see how it could appear that way to you. In fact, the problem shows up readily on old versions of PCP on RHEL5 through git pcp on rawhide. And indeed it is a bug in pcp, corrected thusly on pcpfans.git fche/sasl-crash : commit 22d1cc0b662b34f19fcdb9e5ba5af4e9005dbc40 Author: Frank Ch. Eigler Date: Tue Feb 10 11:26:39 2015 -0500 qa/720 test for memory sasl-authentication double-free Add an item to the 720 testsuite that actually tests a sasl authentication, not just a pcp-URL's syntactic parseability. This test can trigger the memory double-free corrected in commit 4670799bf, and a memory leak within cyrus-sasl (suppressed, reported as RHBZ1191183). commit 4670799bf275679fe4030d72f10003f7e15378fa Author: Frank Ch. Eigler Date: Tue Feb 10 11:22:02 2015 -0500 Correct memory double-free of __pmGetAttrValue result __pmGetAttrValue doesn't strdup its return value (and it's right not to waste time that way). Its caller __pmAuthSecretCB thus shouldn't free() it. (It'll be freed eventually during pcp-level context-attribute cleanup.) From kenj@internode.on.net Tue Feb 10 14:00:59 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 191637FB6 for ; Tue, 10 Feb 2015 14:00:59 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id DBE2B8F8087 for ; Tue, 10 Feb 2015 12:00:58 -0800 (PST) X-ASG-Debug-ID: 1423598452-04bdf06a5c130170001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id kSlGWdxJlp54Kp99 for ; Tue, 10 Feb 2015 12:00:53 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AhcCAJhi2lR20Zu9PGdsb2JhbAANToNYWoMBgyq8Y4V5AoFmAQEBAQEBBQEBAQE4hEgBAQQjFTwEARALFAQCAgUWCwICCQMCAQIBMRQGDQEFAgEBwglwll4BAQEBAQEBAQIBAQEBAQEBG4EhjlYHgmiBQgEEjTuFNoZ1No1qgz6EJFuCQwEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 11 Feb 2015 06:30:51 +1030 Message-ID: <54DA6391.2000405@internode.on.net> Date: Wed, 11 Feb 2015 07:01:21 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Nathan Scott CC: "pcp@oss.sgi.com >> PCP" Subject: Re: interp3.c vs valgrind qa fallout References: <1786689886.2028682.1423566664005.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: interp3.c vs valgrind qa fallout In-Reply-To: <1786689886.2028682.1423566664005.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423598452 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15111 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Yep. My previous "fix" just morphed the valgrind errors, not removed them as I'd hoped ... in my tree there is an updated fix which I'm just giving some QA love before I advertise it as ready to be pushed. Thanks and apologies. On 10/02/15 22:11, Nathan Scott wrote: > Hi Ken, > > I'm running your latest dev with pmdaproc.sh speedup ... seeing the > attached qa fail - just FYI. I'm not seeing any likely libpcp cause > so I'm punting this change is behind it at this stage: > > commit 641cefaa599a66e55e2faf741581483dc1091650 > Author: Ken McDonell > Date: Tue Feb 10 12:17:34 2015 +1100 > > qa/src/interp3.c: free() the *alloc()s from main > > Avoids confusing valgrind in some places, like vm25 (x86_64 > CentOS 5.5). > > Lemme know if its not ringing a bell & I'll dig further. > > cheers. > > -- > Nathan > From nscott@redhat.com Tue Feb 10 15:50:33 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id C731B7FB6 for ; Tue, 10 Feb 2015 15:50:33 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id B60B98F8035 for ; Tue, 10 Feb 2015 13:50:30 -0800 (PST) X-ASG-Debug-ID: 1423605023-04cb6c6b0a12f840001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id Hw8yPgS0eug8gLAp (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 10 Feb 2015 13:50:24 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1ALoN1S006168; Tue, 10 Feb 2015 16:50:23 -0500 Date: Tue, 10 Feb 2015 16:50:23 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: pcp developers Message-ID: <1451500695.2628548.1423605023068.JavaMail.zimbra@redhat.com> In-Reply-To: <20150210163315.GG25151@redhat.com> References: <20150209192657.GD25151@redhat.com> <1691871639.1781628.1423528765870.JavaMail.zimbra@redhat.com> <20150210163315.GG25151@redhat.com> Subject: Re: [pcp] libpcp crash in sasl/connection/attributes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] libpcp crash in sasl/connection/attributes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: libpcp crash in sasl/connection/attributes Thread-Index: zHWoIPSEv4v+1vNNGM3Q1SwfHP6pGw== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1423605023 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15114 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > > > This is with older-than-git-master libpcp, but as this problem occurs > > > during the pmNewContext, commit 63721a89 shouldn't be related. > > > > > > % valgrind pminfo -h 'pcp://localhost?pass=jsjs' > > > > Hmm, this is not reproducible here with current dev - I see all sorts of > > krb*, sasl*, and gss* valgrind warnings from error paths in those libs, > > but nothing that seems to originate from pcp so far. > > I don't see how it could appear that way to you. In fact, the problem > shows up readily on old versions of PCP on RHEL5 through git pcp on > rawhide. And indeed it is a bug in pcp, corrected thusly on > pcpfans.git fche/sasl-crash : Thanks. Here's what I see FWIW ... quite different to yours. Could be a difference in SASL configuration or installed SASL modules, perhaps. $ valgrind pminfo -h 'pcp://localhost?pass=jsjs' ==20278== Memcheck, a memory error detector ==20278== Copyright (C) 2002-2010, and GNU GPL'd, by Julian Seward et al. ==20278== Using Valgrind-3.6.0 and LibVEX; rerun with -h for copyright info ==20278== Command: pminfo -h pcp://localhost?pass=jsjs ==20278== Username: moo ==20278== Invalid read of size 8 ==20278== at 0x3CC6732D44: __strspn_sse42 (in /lib64/libc-2.12.so) ==20278== by 0x31BBC8302D: krb5int_clean_hostname (in /lib64/libkrb5.so.3.3) ==20278== by 0x31BBC83579: krb5_get_host_realm (in /lib64/libkrb5.so.3.3) ==20278== by 0x31BBC88A80: krb5_sname_to_principal (in /lib64/libkrb5.so.3.3) ==20278== by 0x31BB821C1C: ??? (in /lib64/libgssapi_krb5.so.2.2) ==20278== by 0x31BB811E5E: ??? (in /lib64/libgssapi_krb5.so.2.2) ==20278== by 0x31BB81297B: gss_init_sec_context (in /lib64/libgssapi_krb5.so.2.2) ==20278== by 0x5858248: ??? (in /usr/lib64/sasl2/libgssapiv2.so.2.0.23) ==20278== by 0x3CD760874B: sasl_client_step (in /usr/lib64/libsasl2.so.2.0.23) ==20278== by 0x3CD7608CD8: sasl_client_start (in /usr/lib64/libsasl2.so.2.0.23) ==20278== by 0x3C64E6F209: __pmAuthClientNegotiation (secureconnect.c:1080) ==20278== by 0x3C64E6F943: __pmSecureClientHandshake (secureconnect.c:1216) ==20278== Address 0x4c50e58 is 8 bytes inside a block of size 10 alloc'd ==20278== at 0x4A05FDE: malloc (vg_replace_malloc.c:236) ==20278== by 0x3CC6680871: strdup (in /lib64/libc-2.12.so) ==20278== by 0x31BBC88B7C: krb5_sname_to_principal (in /lib64/libkrb5.so.3.3) ==20278== by 0x31BB821C1C: ??? (in /lib64/libgssapi_krb5.so.2.2) ==20278== by 0x31BB811E5E: ??? (in /lib64/libgssapi_krb5.so.2.2) ==20278== by 0x31BB81297B: gss_init_sec_context (in /lib64/libgssapi_krb5.so.2.2) ==20278== by 0x5858248: ??? (in /usr/lib64/sasl2/libgssapiv2.so.2.0.23) ==20278== by 0x3CD760874B: sasl_client_step (in /usr/lib64/libsasl2.so.2.0.23) ==20278== by 0x3CD7608CD8: sasl_client_start (in /usr/lib64/libsasl2.so.2.0.23) ==20278== by 0x3C64E6F209: __pmAuthClientNegotiation (secureconnect.c:1080) ==20278== by 0x3C64E6F943: __pmSecureClientHandshake (secureconnect.c:1216) ==20278== by 0x3C64E120B4: attributes_handshake (connect.c:175) ==20278== ==20278== Conditional jump or move depends on uninitialised value(s) ==20278== at 0x3CC6732D4E: __strspn_sse42 (in /lib64/libc-2.12.so) ==20278== by 0x31BBC8302D: krb5int_clean_hostname (in /lib64/libkrb5.so.3.3) ==20278== by 0x31BBC831CC: krb5_get_fallback_host_realm (in /lib64/libkrb5.so.3.3) ==20278== by 0x31BBC57AEE: krb5_tkt_creds_step (in /lib64/libkrb5.so.3.3) ==20278== by 0x31BBC57FD7: krb5_tkt_creds_get (in /lib64/libkrb5.so.3.3) ==20278== by 0x31BBC5812C: krb5_get_credentials (in /lib64/libkrb5.so.3.3) ==20278== by 0x31BB822E21: ??? (in /lib64/libgssapi_krb5.so.2.2) ==20278== by 0x31BB823C3C: ??? (in /lib64/libgssapi_krb5.so.2.2) ==20278== by 0x31BB824356: ??? (in /lib64/libgssapi_krb5.so.2.2) ==20278== by 0x31BB812A17: gss_init_sec_context (in /lib64/libgssapi_krb5.so.2.2) ==20278== by 0x5858248: ??? (in /usr/lib64/sasl2/libgssapiv2.so.2.0.23) ==20278== by 0x3CD760874B: sasl_client_step (in /usr/lib64/libsasl2.so.2.0.23) ==20278== ==20278== Conditional jump or move depends on uninitialised value(s) ==20278== at 0x31BBC8303C: krb5int_clean_hostname (in /lib64/libkrb5.so.3.3) ==20278== by 0x31BBC831CC: krb5_get_fallback_host_realm (in /lib64/libkrb5.so.3.3) ==20278== by 0x31BBC57AEE: krb5_tkt_creds_step (in /lib64/libkrb5.so.3.3) ==20278== by 0x31BBC57FD7: krb5_tkt_creds_get (in /lib64/libkrb5.so.3.3) ==20278== by 0x31BBC5812C: krb5_get_credentials (in /lib64/libkrb5.so.3.3) ==20278== by 0x31BB822E21: ??? (in /lib64/libgssapi_krb5.so.2.2) ==20278== by 0x31BB823C3C: ??? (in /lib64/libgssapi_krb5.so.2.2) ==20278== by 0x31BB824356: ??? (in /lib64/libgssapi_krb5.so.2.2) ==20278== by 0x31BB812A17: gss_init_sec_context (in /lib64/libgssapi_krb5.so.2.2) ==20278== by 0x5858248: ??? (in /usr/lib64/sasl2/libgssapiv2.so.2.0.23) ==20278== by 0x3CD760874B: sasl_client_step (in /usr/lib64/libsasl2.so.2.0.23) ==20278== by 0x3CD7608CD8: sasl_client_start (in /usr/lib64/libsasl2.so.2.0.23) ==20278== [Wed Feb 11 08:39:28] pminfo(20278) Alert: GSSAPI Error: Unspecified GSS failure. Minor code may provide more information (Ticket expired) pminfo: Cannot connect to PMCD on host "pcp://localhost?pass=jsjs": Authentication - generic failure ==20278== ==20278== HEAP SUMMARY: ==20278== in use at exit: 37,277 bytes in 164 blocks ==20278== total heap usage: 1,432 allocs, 1,268 frees, 289,167 bytes allocated ==20278== ==20278== LEAK SUMMARY: ==20278== definitely lost: 1,506 bytes in 51 blocks ==20278== indirectly lost: 32 bytes in 1 blocks ==20278== possibly lost: 0 bytes in 0 blocks ==20278== still reachable: 35,739 bytes in 112 blocks ==20278== suppressed: 0 bytes in 0 blocks ==20278== Rerun with --leak-check=full to see details of leaked memory ==20278== ==20278== For counts of detected and suppressed errors, rerun with: -v ==20278== Use --track-origins=yes to see where uninitialised values come from ==20278== ERROR SUMMARY: 3 errors from 3 contexts (suppressed: 48 from 9) From nscott@redhat.com Tue Feb 10 16:07:26 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 502CA7FB6 for ; Tue, 10 Feb 2015 16:07:26 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 30C5D304043 for ; Tue, 10 Feb 2015 14:07:23 -0800 (PST) X-ASG-Debug-ID: 1423606037-04cbb01165128d30001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id eHEOsSdJ1BsvLfmC (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 10 Feb 2015 14:07:18 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1AM7EOO009590; Tue, 10 Feb 2015 17:07:14 -0500 Date: Tue, 10 Feb 2015 17:07:14 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp developers Message-ID: <58143110.2647790.1423606034034.JavaMail.zimbra@redhat.com> In-Reply-To: <54DA6391.2000405@internode.on.net> References: <1786689886.2028682.1423566664005.JavaMail.zimbra@redhat.com> <54DA6391.2000405@internode.on.net> Subject: Re: interp3.c vs valgrind qa fallout MIME-Version: 1.0 X-ASG-Orig-Subj: Re: interp3.c vs valgrind qa fallout Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: interp3.c vs valgrind qa fallout Thread-Index: MN4bA3tbwkIoz4vOYrnQt7uW9C6+xg== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1423606038 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15115 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > Yep. > > My previous "fix" just morphed the valgrind errors, not removed them as > I'd hoped ... in my tree there is an updated fix which I'm just giving > some QA love before I advertise it as ready to be pushed. Great, taa. > Thanks and apologies. No problem at all. cheers. -- Nathan From nscott@redhat.com Tue Feb 10 17:58:01 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 791467F47 for ; Tue, 10 Feb 2015 17:58:01 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 0615CAC003 for ; Tue, 10 Feb 2015 15:58:00 -0800 (PST) X-ASG-Debug-ID: 1423612675-04cb6c6b09133580001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id Z09fXnFxYKGgwe5Y (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 10 Feb 2015 15:57:55 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1ANvs6k026752; Tue, 10 Feb 2015 18:57:54 -0500 Date: Tue, 10 Feb 2015 18:57:54 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Lukas Berk Cc: pcp developers Message-ID: <1730959537.2690842.1423612674835.JavaMail.zimbra@redhat.com> In-Reply-To: <266702076.2689468.1423612211793.JavaMail.zimbra@redhat.com> Subject: pmdapapi buglets from Coverity scan MIME-Version: 1.0 X-ASG-Orig-Subj: pmdapapi buglets from Coverity scan Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pmdapapi buglets from Coverity scan Thread-Index: PQiZXVqMuD8O2E2wurxmnWnga7J1tw== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1423612675 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15120 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi Lukas, Coverity is reporting a couple of issues in pmdapapi that I could use some help with if you could? It's saying the sts setting here is dead code... /* * This is where we'd see if a requested counter was * "one too many". We must leave a note for the * function to return an error, but must continue (so * that reactivating other counters is still * attempted). */ sts = PM_ERR_VALUE; continue; which at first glance does indeed seem to be the case (it'll be overwritten on subsequent loop iterations by PAPI_add_event). papi_store it then says has a loop control issue - apparently it can only execute the "for (i = 0; i < result->numpmid; i++)" loop once. I think this is because the switch always returns a result for the first PMID, when we should really be continuing on through all metrics being stored to. cheers. -- Nathan From nscott@redhat.com Tue Feb 10 23:13:14 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 930447F47 for ; Tue, 10 Feb 2015 23:13:14 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 72876304032 for ; Tue, 10 Feb 2015 21:13:11 -0800 (PST) X-ASG-Debug-ID: 1423631585-04cb6c6b0a145c80001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id lXj1OhUJCgyMirkW (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 10 Feb 2015 21:13:06 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1B5D1oP061716; Wed, 11 Feb 2015 00:13:01 -0500 Date: Wed, 11 Feb 2015 00:13:01 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: "pcp@oss.sgi.com >> PCP" Message-ID: <655540918.2840278.1423631581624.JavaMail.zimbra@redhat.com> In-Reply-To: <54D9343F.1070703@internode.on.net> References: <724742467.926637.1423458271929.JavaMail.zimbra@redhat.com> <54D9343F.1070703@internode.on.net> Subject: Re: Reduce pmdaproc.sh runtime for pmdaInstall MIME-Version: 1.0 X-ASG-Orig-Subj: Re: Reduce pmdaproc.sh runtime for pmdaInstall Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Reduce pmdaproc.sh runtime for pmdaInstall Thread-Index: P6TT4W1X5iGJXp0ZypiWmTDSgdOVVg== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1423631586 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15132 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > On 09/02/15 16:04, Nathan Scott wrote: > > Hi Ken, > > > > When the dust settles on the current crop of failures we're > > triaging, could you toss the attached patch into the QA farm > > and see how it fares? > > No regressions on the first host I tried this on with a full QA run. > > I've committed it to my git tree (but not sent git push email yet), as > that is the best way for me to get it used across all the hosts in my QA > farm. I'm finding pmdarpm Install to have become unreliable - the patch below resolves it for me (simply reinstates the original delay in that one PMDA)... diff --git a/src/pmdas/rpm/Install b/src/pmdas/rpm/Install index 8f11751..4213033 100644 --- a/src/pmdas/rpm/Install +++ b/src/pmdas/rpm/Install @@ -19,6 +19,7 @@ . $PCP_SHARE_DIR/lib/pmdaproc.sh iam=rpm +check_delay=3 pmda_interface=5 forced_restart=false (even with this, qa/750 runtime has gone from 15 to 7-8 seconds, so we're still ahead here) cheers. -- Nathan From kenj@kenj.com.au Wed Feb 11 02:58:22 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 5432B7F4E for ; Wed, 11 Feb 2015 02:58:22 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id E485AAC006 for ; Wed, 11 Feb 2015 00:58:18 -0800 (PST) X-ASG-Debug-ID: 1423645092-04bdf06a5a172b20001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id AB9gKuCXd9TkWlyW for ; Wed, 11 Feb 2015 00:58:12 -0800 (PST) X-Barracuda-Envelope-From: kenj@kenj.com.au X-Barracuda-Apparent-Source-IP: 150.101.137.129 Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO bozo-vm.localdomain) ([118.209.155.189]) by ipmail06.adl2.internode.on.net with ESMTP; 11 Feb 2015 19:28:10 +1030 Received: by bozo-vm.localdomain (Postfix, from userid 1000) id 37B6FA329B; Wed, 11 Feb 2015 18:00:05 +1100 (EST) To: pcp@oss.sgi.com Subject: pcp updates - qa & pmda code changes Message-Id: <20150211070006.37B6FA329B@bozo-vm.localdomain> X-ASG-Orig-Subj: pcp updates - qa & pmda code changes Date: Wed, 11 Feb 2015 18:00:05 +1100 (EST) From: kenj@kenj.com.au (Ken McDonell) X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1423645092 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15137 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (11): qa/943: fine-tune the filter src/pmcd/pmdaproc.sh: reduce delays qa/src/interp3.c: free() the *alloc()s from main qa/555: critical typo left syslog.conf clobbered, sometimes qa/514: some extra diags to 514.full qa/admin/pcp-daily: more games with VERSION.pcp and dodging git-iness qa/104[456]: pander to older versions of git qa/652: more traditional debugging pmdaproc.sh: fine tune delays qa/652: not everyone can get info from journalctl src/pmdas/systemd/Install: need to be trickier about access controls qa/1044 | 5 +++-- qa/1045 | 5 +++-- qa/1046 | 5 +++-- qa/514 | 3 ++- qa/555 | 2 +- qa/652 | 28 +++++++++++++++------------- qa/943 | 4 +++- qa/admin/pcp-daily | 7 +++++-- qa/src/interp3.c | 3 +++ src/pmcd/pmdaproc.sh | 39 +++++++++++++++++++++------------------ src/pmdas/systemd/Install | 27 +++++++++++++++++++++++++-- 11 files changed, 84 insertions(+), 44 deletions(-) From kenj@internode.on.net Wed Feb 11 04:30:56 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id F40997F4E for ; Wed, 11 Feb 2015 04:30:55 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 826C6AC003 for ; Wed, 11 Feb 2015 02:30:52 -0800 (PST) X-ASG-Debug-ID: 1423650648-04cbb0116517d600001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id RlC5F8dW5hMlmZ3Y for ; Wed, 11 Feb 2015 02:30:48 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AuYBAEMu21R20Zu9PGdsb2JhbAANToNYWoMBgyq8ZodgAQEBAQEBBQEBAQE4hHEVQDYCBRYLAgsDAgECATEnCAEBwWxwlx6BIYsmAYNMglKBQgWSdJhWgjGBc1uCQwEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl2.internode.on.net with ESMTP; 11 Feb 2015 21:00:47 +1030 Message-ID: <54DB2F76.7060001@internode.on.net> Date: Wed, 11 Feb 2015 21:31:18 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - fix qa/394 regression Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates - fix qa/394 regression Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1423650648 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15139 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (1): qa/src/interp3.c: really free() all the *alloc()'d space qa/src/interp3.c | 5 ++++- 1 file changed From jimjbbank@centurylink.net Wed Feb 11 05:38:17 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,T_DKIM_INVALID autolearn=unavailable version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id E69287F51 for ; Wed, 11 Feb 2015 05:38:16 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 832E0AC003 for ; Wed, 11 Feb 2015 03:38:13 -0800 (PST) X-ASG-Debug-ID: 1423654684-04bdf06a5b18d8f0001-S8gJnT Received: from smtp.centurylink.net (mail.centurylink.net [205.219.233.9]) by cuda.sgi.com with ESMTP id CgUxPEDrZENx3qdF (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 11 Feb 2015 03:38:05 -0800 (PST) X-Barracuda-Envelope-From: jimjbbank@centurylink.net X-Barracuda-Apparent-Source-IP: 205.219.233.9 DKIM-Signature: v=1; a=rsa-sha1; d=centurylink.net; s=ctl201402; c=relaxed/simple; q=dns/txt; i=@centurylink.net; t=1423654683; h=From:Subject:Date:To:MIME-Version:Content-Type; bh=R9jt7PU7qqp0tSFpPeEwkL7P3XA=; b=GmO2V0428DxnA9V8MIsXKt87fH0HL8xFMqGPis+HYAasNvSehSqjn6nvXzyy6Hrb xmzmwvkAHuC8Em/AoFEyeSQn3XNlEF84LgsJp/k/37lFPlIeUz21tmK0fVcZYOVW ubXYjuIZfCgv+UwpfSRJng7MaAvFgX2gk8Z5xn/OW+11NzLpvnz3m2mZhT5V80i9 6TNprG7gCmjfPzu3eOBkS9wkChF/FnBit2G9ROiTOmg9+NCePHIbSx6eAKy+E5PE xaQ7KUFch3TfFyRWoWFy+pUw4bILhHDs0ThUTOAizQkrG3+DeMdw1z6AK51fmHfc D+zpeMQgrjuASAJThoCg0w==; X_CMAE_Category: , , X-CNFS-Analysis: v=2.0 cv=FNOZNpUs c=1 sm=1 a=9cW_t1CCXrUA:10 a=FKkrIqjQGGEA:10 a=jPJDawAOAc8A:10 a=yEKiwCq5NtIA:10 a=I_5RNyk1AAAA:8 a=4iUaeoCYq0_jRT8LJq8A:9 a=QEXdDO2ut3YA:10 a=gSHtfwDzS2Auy-8E:21 a=5AVQqgFq-6UBx367:21 a=vI1dNY1eAAAA:8 a=8pVyiYs2AGwmS_nXZ9IA:9 a=_W_S_7VecoQA:10 a=oqTNY41KwZmHObj8:21 a=yTYSwXIJ_kWe_Gcs:21 a=HNR7tGgGFs_YiykZ:21 a=UDo720tNcInnqUF9S9yrCA==:117 X-CM-Score: 0 X-Scanned-by: Cloudmark Authority Engine X-Authed-Username: amltamJiYW5rQGNlbnR1cnlsaW5rLm5ldA== Received: from [10.40.66.4] ([10.40.66.4:49852] helo=md11.agate.dfw.synacor.com) by smtp.centurylink.net (envelope-from ) (ecelerity 3.5.1.37854 r(Momo-dev:3.5.1.0)) with ESMTP id E8/24-01480-81F3BD45; Wed, 11 Feb 2015 06:38:00 -0500 Date: Wed, 11 Feb 2015 06:38:00 -0500 (EST) From: Bank Of Ireland Message-ID: <2114844606.1917491.1423654680023.JavaMail.root@centurylink.net> Subject: =?utf-8?Q?Account_Activation_Notice.=E2=80=8F=E2=80=8F?= MIME-Version: 1.0 X-ASG-Orig-Subj: =?utf-8?Q?Account_Activation_Notice.=E2=80=8F=E2=80=8F?= Content-Type: multipart/alternative; boundary="----=_Part_1917490_1349559262.1423654680019" X-Originating-IP: [207.244.89.112] X-Mailer: Zimbra 7.2.2_GA_2852 (zclient/7.2.2_GA_2852) X-Barracuda-Connect: mail.centurylink.net[205.219.233.9] X-Barracuda-Start-Time: 1423654685 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 1.71 X-Barracuda-Spam-Status: No, SCORE=1.71 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC7_SA578_CH, DKIM_SIGNED, DKIM_VERIFIED, HTML_MESSAGE, MISSING_HEADERS, TO_CC_NONE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15140 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 1.21 MISSING_HEADERS Missing To: header 0.00 HTML_MESSAGE BODY: HTML included in message 0.00 TO_CC_NONE No To: or Cc: header 0.50 BSF_SC7_SA578_CH Custom Rule SA578_CH To: undisclosed-recipients:; ------=_Part_1917490_1349559262.1423654680019 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Dear customer, Please note that your online banking access expires soon. In order for this service to continue without any interruption, You are require to fill and confirm your details via the following link below: Bank Of Ireland online banking update: click here After completion of this step, your online account will then be automatically restored and you can easily do transfers and standing orders with one click. THE ADVANTAGES AT A GLANCE: - Account access around the clock- Quick access on current account- Online banking from the comfort of cell phone or PC- Flexible in every corner of the world- Clear accounting- High safety standards- Can be combined with telephone banking We are very pleased to be at your service Sincerely,Bank Of Ireland Customer Service. ------=_Part_1917490_1349559262.1423654680019 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
Dear customer, 
=

Please note that your online banking access expires soon. In order for this=20 service to continue without any interruption, You are require to fill=20 and confirm your details via the following link below:

Bank Of Ireland online banking update: click here

After completion of this step, your online account will then be automatically restored and you can easily do transfers and standing orders with one=20 click.

THE ADVANTAGES AT A GLANCE:

<= div style=3D"text-indent:0px;color:#000000;font-family:Calibri, sans-serif;= font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:nor= mal;text-align:start;text-transform:none;white-space:normal;word-spacing:0p= x;line-height:21.299999237060547px;font-size:15px;background-color:#ffffff;= ">- Account access around the clock
- Quick access on current accou= nt
- Online banking from the comfort of cell phone or PC
- = Flexible in every corner of the world
- Clear accounting
- = High safety standards
- Can be combined with telephone banking

We are very pleased to be at your service

Sincerely,
Bank Of Ireland Customer Service.
------=_Part_1917490_1349559262.1423654680019-- From fche@redhat.com Wed Feb 11 12:49:51 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 54BDB7F3F for ; Wed, 11 Feb 2015 12:49:51 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id D7C58AC004 for ; Wed, 11 Feb 2015 10:49:47 -0800 (PST) X-ASG-Debug-ID: 1423680582-04cbb011621b0a50001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id OZRUkRG5H58FFNWq (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 11 Feb 2015 10:49:43 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1BIng7b015991 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 11 Feb 2015 13:49:42 -0500 Received: from fche.csb (vpn-230-111.phx2.redhat.com [10.3.230.111]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1BIngtc002630 for ; Wed, 11 Feb 2015 13:49:42 -0500 Received: by fche.csb (Postfix, from userid 2569) id 95F96580B0; Wed, 11 Feb 2015 13:49:40 -0500 (EST) Date: Wed, 11 Feb 2015 13:49:40 -0500 From: "Frank Ch. Eigler" To: pcp developers Subject: pcp updates Message-ID: <20150211184940.GA16895@redhat.com> X-ASG-Orig-Subj: pcp updates Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423680583 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - In the queue on pcpfans.git: branch fche/gcc5: commit 704035986f5322cd96bee3c772ec570868a41c00 Author: Frank Ch. Eigler Date: Wed Feb 11 13:43:47 2015 -0500 pcp configury: gcc5 compatibility for -rdynamic Fix a configury breakage due to gcc5 default warnings. https://lists.fedoraproject.org/pipermail/devel/2015-February/207625.html While in the vicinity fix a typo regarding struct dirent field checking. branch fche/pmmgr: commit 4eb19a3c3ed5155c0d6b6ace2e27c57784f54729 (origin/fche/pmmgr) Author: Frank Ch. Eigler Date: Thu Feb 5 21:40:54 2015 -0500 qa/666: use $_valgrind_clean_assert for pmmgr under microscope commit b6c0b6fbb5393eb7405e18536f5d4cccd06efdaa Author: Frank Ch. Eigler Date: Thu Feb 5 21:38:48 2015 -0500 qa/common.check: introduce $_valgrind_clean_assert This is a variable which a normal test case can casually insert ahead of an invocation of some random pcp or other program. It may expand to nothing, or to a "valgrind -q ..." prefix. Using it thusly: $_valgrind_clean_assert CMD ARGS ... is a nop, unless there are unsuppressed valgrind errors. commit 17075eacee1f35b7e4dbe30710053e49d26110ee Author: Frank Ch. Eigler Date: Fri Jan 23 21:36:01 2015 -0500 pmmgr: build fix for older g++ std::map::at turns out to be a c++11 facility. Use the equivalent but wordier find()->second instead. branch fche/sasl-crash: commit 22d1cc0b662b34f19fcdb9e5ba5af4e9005dbc40 Author: Frank Ch. Eigler Date: Tue Feb 10 11:26:39 2015 -0500 qa/720 test for memory sasl-authentication double-free Add an item to the 720 testsuite that actually tests a sasl authentication, not just a pcp-URL's syntactic parseability. This test can trigger the memory double-free corrected in commit 4670799bf, and a memory leak within cyrus-sasl (suppressed, reported as RHBZ1191183). commit 4670799bf275679fe4030d72f10003f7e15378fa Author: Frank Ch. Eigler Date: Tue Feb 10 11:22:02 2015 -0500 Correct memory double-free of __pmGetAttrValue result __pmGetAttrValue doesn't strdup its return value (and it's right not to waste time that way). Its caller __pmAuthSecretCB thus shouldn't free() it. (It'll be freed eventually during pcp-level context-attribute cleanup.) From minnus@buffalo.edu Wed Feb 11 13:17:38 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id E5D617F3F for ; Wed, 11 Feb 2015 13:17:38 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id B6FEF8F8050 for ; Wed, 11 Feb 2015 11:17:38 -0800 (PST) X-ASG-Debug-ID: 1423682253-04bdf06a591c49b0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve8.acsu.buffalo.edu [128.205.6.19]) by cuda.sgi.com with ESMTP id Lu6rGvGe47eO8i9C for ; Wed, 11 Feb 2015 11:17:33 -0800 (PST) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.6.19 Received: from localmailB.acsu.buffalo.edu (localmailb.acsu.buffalo.edu [128.205.5.200]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 1959317A0 for ; Wed, 11 Feb 2015 14:17:33 -0500 (EST) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 14D7010C3F for ; Wed, 11 Feb 2015 14:17:33 -0500 (EST) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailB.acsu.buffalo.edu (Postfix) with ESMTP id AA02510C3A for ; Wed, 11 Feb 2015 14:17:32 -0500 (EST) Received: from smtp.buffalo.edu (smtp1.acsu.buffalo.edu [128.205.5.253]) by localmailB.acsu.buffalo.edu (Prefixe) with ESMTP id 9FDCF10C39 for ; Wed, 11 Feb 2015 14:17:32 -0500 (EST) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 9382549D1 for ; Wed, 11 Feb 2015 14:17:32 -0500 (EST) Message-ID: <54DBAACC.9060906@buffalo.edu> Date: Wed, 11 Feb 2015 14:17:32 -0500 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Lustre QA Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: Lustre QA Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve8.acsu.buffalo.edu[128.205.6.19] X-Barracuda-Start-Time: 1423682253 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15149 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi, Was tracking down a QA problem and found that lustre disappeared from the QA makefile. This should fix it: https://github.com/ubccr/pcp/tree/martins_working Thanks Martins commit 55f70076bf60aaca5ee31cda2fd6b4ffcdc3591d Author: Martins Innus Date: Wed Feb 11 13:44:13 2015 -0500 Add back lustre that went missing from QA qa/GNUmakefile | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) From kenj@internode.on.net Wed Feb 11 13:43:44 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id B58BB7F51 for ; Wed, 11 Feb 2015 13:43:44 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 75AF88F8054 for ; Wed, 11 Feb 2015 11:43:44 -0800 (PST) X-ASG-Debug-ID: 1423683821-04bdf06a5c1ccc10001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id IuWz05Is7zDjGzwY for ; Wed, 11 Feb 2015 11:43:41 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: At0BAB+w21R20Zu9PGdsb2JhbAANToczgyrAAYJPAoFsAQEBAQEBBQEBAQE4hEgBAQQjFUABEAsYAgIFFgsCAgkDAgECATEUBg0BBwEBwz5wlwkBAQEBAQEBAQIBAQEBAQEBG4EhiWuEbQeCaIFCAQSrVYQkgx4BAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 12 Feb 2015 06:13:41 +1030 Message-ID: <54DBB10C.3000505@internode.on.net> Date: Thu, 12 Feb 2015 06:44:12 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Nathan Scott CC: PCP Subject: Re: [pcp] ipv6 and qa/533 question References: <54D9C865.6060708@internode.on.net> <1574919743.2034323.1423567444249.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] ipv6 and qa/533 question In-Reply-To: <1574919743.2034323.1423567444249.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423683821 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15151 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 10/02/15 22:24, Nathan Scott wrote: > ... > Some googling suggests this to be a fairly regular occurrence with IPv6 > interfaces that have recently been brought up & are still in "tentative" > state... what does "ip -6 addr show tentative" say? Had a chance to dig a little deeper here ... it was a sysctl issue, with ipv6 being disabled (altogether). Fixed now, thanks. From fche@redhat.com Wed Feb 11 13:45:46 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 069377F51 for ; Wed, 11 Feb 2015 13:45:46 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id D7C568F804C for ; Wed, 11 Feb 2015 11:45:45 -0800 (PST) X-ASG-Debug-ID: 1423683943-04cbb011631be340001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 1a9xKwXGPlVXF01h (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 11 Feb 2015 11:45:44 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1BJjhPQ009004 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 11 Feb 2015 14:45:43 -0500 Received: from fche.csb (vpn-230-111.phx2.redhat.com [10.3.230.111]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1BJjgMT021254; Wed, 11 Feb 2015 14:45:43 -0500 Received: by fche.csb (Postfix, from userid 2569) id 86782580B0; Wed, 11 Feb 2015 14:45:41 -0500 (EST) Date: Wed, 11 Feb 2015 14:45:41 -0500 From: "Frank Ch. Eigler" To: Nathan Scott Cc: PCP Subject: Re: Containers analysis with PCP Message-ID: <20150211194541.GB16895@redhat.com> X-ASG-Orig-Subj: Re: Containers analysis with PCP References: <2100915892.5240937.1422867358164.JavaMail.zimbra@redhat.com> <768474811.5242777.1422867576642.JavaMail.zimbra@redhat.com> <1602407544.1781133.1423528333125.JavaMail.zimbra@redhat.com> <20150210023410.GE25151@redhat.com> <1930031505.1820911.1423537012392.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1930031505.1820911.1423537012392.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423683944 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - > > [...] > > Please check closer. Nothing appears to have changed about container > > naming policy or mechanism (pmdas still store it as char*'s, > > resolution still done repeatedly and ambiguously), which represented > > the bulk of the concern. > > I understood your concern, but I was then and remain now unconvinced > of any genuine issues there. Perhaps this will help. Consider the following situation: % docker run --name=SUBSTRING1 --hostname=FOO1 -i --rm sleep $RANDOM & % docker run --name=SUBSTRING2 --hostname=FOO2 -i --rm sleep $RANDOM & % docker run --name=SUBSTRING3 --hostname=FOO3 -i --rm sleep $RANDOM & % ... and more, coming and going ... while pcp monitoring: pmval --container=SUBSTRING pmcd.hostname # but current pmda code (?) appears to work once, then # cache the result, even if no containers at all stay running pmval --container=SUBSTRING network.interface.inet_addr # but current pmda code crashes pmcd(31340) Error: ClientLoop: error sending Conn ACK PDU to new client IPC protocol failure pmcd(31340) Info: CleanupAgent ... Cleanup "linux" agent (dom 60): protocol failure for fd=18, exit(0) Since the code doesn't run well here, I'm unable to show an actual transcript. But one can read code (e.g., up and down the call chain from container_enter_namespaces() in pmdas/linux). So, according to the current code/design, which of those SUBSTRING*y containers, coming & going constantly, are pmval instances supposed to track? With the container-name-lookup being done *at every fetch*, it's a coin toss - and that is absurd. (More cases were outlined in the January comments.) Using container-name substrings as though they were a reliable & persistent identifier is an error. > Arguing about it then, as now, is sure to be counter-productive, and > time is precious. This is unacceptable. - FChE From kenj@internode.on.net Wed Feb 11 13:46:19 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id D9D3A7F51 for ; Wed, 11 Feb 2015 13:46:19 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id C8594304043 for ; Wed, 11 Feb 2015 11:46:19 -0800 (PST) X-ASG-Debug-ID: 1423683973-04cb6c6b0b1de150001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id lCU53BTU5MvNyZQI for ; Wed, 11 Feb 2015 11:46:14 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AtwBAEqx21R20Zu9PGdsb2JhbAANTopdwAGCTwKBbAEBAQEBAQUBAQEBOIRIAQEEOEARCxgJFg8JAwIBAgExFBMIAQHDSZd7AQEIAgEfiwyEdBaEFAEEq1WEJIMeAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 12 Feb 2015 06:15:45 +1030 Message-ID: <54DBB189.8060903@internode.on.net> Date: Thu, 12 Feb 2015 06:46:17 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] ipv6 QA issues on openSuSE 12.1 References: <54079E72.1020604@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] ipv6 QA issues on openSuSE 12.1 In-Reply-To: <54079E72.1020604@internode.on.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423683973 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15150 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 04/09/14 09:04, Ken McDonell wrote: > I am seeing a couple of QA failures for IPv6 related issues. > > .bad files attached. > ... Recent investigations have resolved this ... 533 and 776 now passing after I removed the sysctl config that was blocking all ipv6 networking. From kenj@internode.on.net Wed Feb 11 15:23:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 68B787F55 for ; Wed, 11 Feb 2015 15:23:18 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 01958AC004 for ; Wed, 11 Feb 2015 13:23:17 -0800 (PST) X-ASG-Debug-ID: 1423689790-04cbb011651c9e90001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id Irj4iegmFs1hFqMB for ; Wed, 11 Feb 2015 13:23:11 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AgkCAJLH21R20Zu9PGdsb2JhbAANToNYWoMBgyq8V4deAQEBAQEBBQEBAQE4hHEVQDYCBRYLAgsDAgECATEOGQgBAcNdcJctgSGOdYJSgUIFknmYXIQkW4JDAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 12 Feb 2015 07:53:11 +1030 Message-ID: <54DBC85E.9080305@internode.on.net> Date: Thu, 12 Feb 2015 08:23:42 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423689790 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15157 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (2): src/pmdas/rpm/Install: restore previous $check_delay qa/977: needs guard for container support not available qa/977 | 12 ++++++++++++ src/pmdas/rpm/Install | 1 + 2 files changed From kenj@internode.on.net Wed Feb 11 15:24:21 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id DEBB47F55 for ; Wed, 11 Feb 2015 15:24:21 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id BE3B28F8054 for ; Wed, 11 Feb 2015 13:24:18 -0800 (PST) X-ASG-Debug-ID: 1423689856-04bdf06a5a1da440001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id Cck6jnQ01LO59HZA for ; Wed, 11 Feb 2015 13:24:16 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AgkCAJLH21R20Zu9PGdsb2JhbAANToNYWoMBgyq8V4deAQEBAQEBBQEBAQE4hHFVNgIFFgsCCwMCAQIBMQ4MDQgBAcNdcJctgSGRR4FCBZJ5mFyCJByBZFuCQwEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 12 Feb 2015 07:54:16 +1030 Message-ID: <54DBC8A0.8010805@internode.on.net> Date: Thu, 12 Feb 2015 08:24:48 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: PCP Subject: pmcd dumps core on containers test Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pmcd dumps core on containers test Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423689856 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15157 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On vm18 (x86_64 LinuxMint 12) qa/837 is killing pmcd at this command $ pminfo -v --container=test This is a current PCP build from my git repo, which is up to date wrt the official tree. Here's the callback from gdb attached to the failing pmcd: (gdb) c Continuing. Program received signal SIGABRT, Aborted. 0x00007f00274653e5 in __GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 64 ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory. in ../nptl/sysdeps/unix/sysv/linux/raise.c (gdb) where #0 0x00007f00274653e5 in __GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 #1 0x00007f0027468b4b in __GI_abort () at abort.c:92 #2 0x00007f002749f4d3 in __libc_message (do_abort=2, fmt=0x7f002758fe41 "*** %s ***: %s terminated\n") at ../sysdeps/unix/sysv/linux/libc_fatal.c:189 #3 0x00007f002752aee7 in __GI___fortify_fail ( msg=0x7f002758fdd8 "buffer overflow detected") at fortify_fail.c:32 #4 0x00007f0027529e00 in __GI___chk_fail () at chk_fail.c:29 #5 0x00007f00275290e6 in __strncpy_chk (s1=, s2=, n=, s1len=) at strncpy_chk.c:34 #6 0x00007f0027c5cb5c in strncpy (__len=5, __src=, __dest=) at /usr/include/x86_64-linux-gnu/bits/string3.h:121 #7 __pmdaSendRootPDUContainer (fd=5, pdutype=, pid=, name=, len=, status=) at pduroot.c:87 #8 0x00007f0027c5d054 in pmdaRootContainerHostName (clientfd=5, name=, namelen=, buffer=0x7f0025956bc0 "", buflen=64) at root.c:116 #9 0x00007f0025755052 in ?? () from /var/lib/pcp/pmdas/pmcd/pmda_pmcd.so #10 0x00007f0028094240 in SendFetch (ctxnum=0, cPtr=0x7f00285367f0, aPtr=0x7f0028530718, dpList=0x7f0028536da0) at dofetch.c:263 ---Type to continue, or q to quit--- #11 DoFetch (cip=0x7f00285367f0, pb=0x7f002854a000) at dofetch.c:407 #12 0x00007f002808e866 in HandleClientInput (fdsPtr=0x7fff269236a0) at pmcd.c:325 #13 0x00007f002808d47f in ClientLoop () at pmcd.c:695 #14 main (argc=, argv=) at pmcd.c:884 From brolley@redhat.com Wed Feb 11 15:49:43 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id EB0F87F55 for ; Wed, 11 Feb 2015 15:49:43 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id B5E508F8054 for ; Wed, 11 Feb 2015 13:49:43 -0800 (PST) X-ASG-Debug-ID: 1423691382-04bdf06a5b1daf50001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id N6j5iobXiWlGGb16 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 11 Feb 2015 13:49:42 -0800 (PST) X-Barracuda-Envelope-From: brolley@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1BLng3x015973 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 11 Feb 2015 16:49:42 -0500 Received: from [10.10.59.124] (vpn-59-124.rdu2.redhat.com [10.10.59.124]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1BLnfKJ019341 for ; Wed, 11 Feb 2015 16:49:41 -0500 Message-ID: <54DBCEA6.8010505@redhat.com> Date: Wed, 11 Feb 2015 16:50:30 -0500 From: Dave Brolley User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: PCP Mailing List Subject: pcp updates: kenj qa, fche gcc5 Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: kenj qa, fche gcc5 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423691382 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Changes committed to git://git.pcp.io/pcp.git dev Ken McDonell (13): qa/943: fine-tune the filter src/pmcd/pmdaproc.sh: reduce delays qa/src/interp3.c: free() the *alloc()s from main qa/555: critical typo left syslog.conf clobbered, sometimes qa/514: some extra diags to 514.full qa/admin/pcp-daily: more games with VERSION.pcp and dodging git-iness qa/104[456]: pander to older versions of git qa/652: more traditional debugging pmdaproc.sh: fine tune delays qa/652: not everyone can get info from journalctl src/pmdas/systemd/Install: need to be trickier about access controls qa/src/interp3.c: really free() all the *alloc()'d space src/pmdas/rpm/Install: restore previous $check_delay Frank Ch. Eigler (1): pcp configury: gcc5 compatibility for -rdynamic configure | 40 +++++++++++++++++++++++++--------------- configure.ac | 29 +++++++++++++---------------- qa/1044 | 5 +++-- qa/1045 | 5 +++-- qa/1046 | 5 +++-- qa/514 | 3 ++- qa/555 | 2 +- qa/652 | 28 +++++++++++++++------------- qa/943 | 4 +++- qa/admin/pcp-daily | 7 +++++-- qa/src/interp3.c | 8 +++++++- src/pmcd/pmdaproc.sh | 39 +++++++++++++++++++++------------------ src/pmdas/rpm/Install | 1 + src/pmdas/systemd/Install | 27 +++++++++++++++++++++++++-- 14 files changed, 127 insertions(+), 76 deletions(-) From nscott@redhat.com Wed Feb 11 16:25:16 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 7C8707F59 for ; Wed, 11 Feb 2015 16:25:16 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 6B583304062 for ; Wed, 11 Feb 2015 14:25:13 -0800 (PST) X-ASG-Debug-ID: 1423693510-04cbb011621cb2a0001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id U2j0Bp6ymxXLoc11 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 11 Feb 2015 14:25:11 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1BMP6RT009895; Wed, 11 Feb 2015 17:25:06 -0500 Date: Wed, 11 Feb 2015 17:25:06 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: PCP Message-ID: <911908095.3825780.1423693506632.JavaMail.zimbra@redhat.com> In-Reply-To: <54DBC8A0.8010805@internode.on.net> References: <54DBC8A0.8010805@internode.on.net> Subject: Re: [pcp] pmcd dumps core on containers test MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pmcd dumps core on containers test Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pmcd dumps core on containers test Thread-Index: CKJ/3sJRtPmd3zLldlvQb8AnqA5oUw== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1423693511 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15159 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > On vm18 (x86_64 LinuxMint 12) qa/837 is killing pmcd at this command > > $ pminfo -v --container=test > > This is a current PCP build from my git repo, which is up to date wrt the > official tree. > > Here's the callback from gdb attached to the failing pmcd: > [...] Thanks Ken - that doesn't fail on any of my hosts so far, but there may be enough state here for me to figure it out. Will get back to ya. cheers. -- Nathan From nscott@redhat.com Wed Feb 11 16:28:13 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 25EB77F59 for ; Wed, 11 Feb 2015 16:28:13 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id F302B304064 for ; Wed, 11 Feb 2015 14:28:12 -0800 (PST) X-ASG-Debug-ID: 1423693690-04bdf06a5c1dbf90001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id RGXs1Tgp2rn7VDGp (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 11 Feb 2015 14:28:11 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1BMS8PC030400; Wed, 11 Feb 2015 17:28:09 -0500 Date: Wed, 11 Feb 2015 17:28:08 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus Cc: pcp@oss.sgi.com Message-ID: <257620424.3828339.1423693688925.JavaMail.zimbra@redhat.com> In-Reply-To: <54DBAACC.9060906@buffalo.edu> References: <54DBAACC.9060906@buffalo.edu> Subject: Re: [pcp] Lustre QA MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Lustre QA Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Lustre QA Thread-Index: VR38JfiouUJ0VCFoVs1RDrWG2NkjoA== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1423693691 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15159 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > Hi, > Was tracking down a QA problem and found that lustre disappeared > from the QA makefile. This should fix it: > > https://github.com/ubccr/pcp/tree/martins_working Thanks Martins; this was a merge botch at my end when the gpfs & lustre pmdas arrived together - thought I caught all the spots, but obviously missed one. cheers. -- Nathan From kenj@internode.on.net Wed Feb 11 16:42:39 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 498C67F5A for ; Wed, 11 Feb 2015 16:42:39 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 285218F8054 for ; Wed, 11 Feb 2015 14:42:39 -0800 (PST) X-ASG-Debug-ID: 1423694553-04cb6c6b0c1ee6b0001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id cEVcGc75BEKM0QfI for ; Wed, 11 Feb 2015 14:42:33 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: At0BAGXa21R20Zu9PGdsb2JhbAANToczgyrAAYJPAoFkAQEBAQEBBQEBAQE4hEgBAQQjFUABEAsYAgIFDQEICwICCQMCAQIBMRQGDQEHAQHDYXCXDgEBAQEBAQEDAQEBAQEBARuBIYlrhG0HEgGCVYFCAQSNP4kSlQSEJIFfB4E4AQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 12 Feb 2015 09:11:38 +1030 Message-ID: <54DBDAC2.5020204@internode.on.net> Date: Thu, 12 Feb 2015 09:42:10 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Nathan Scott CC: PCP Subject: Re: [pcp] pmcd dumps core on containers test References: <54DBC8A0.8010805@internode.on.net> <911908095.3825780.1423693506632.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] pmcd dumps core on containers test In-Reply-To: <911908095.3825780.1423693506632.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423694553 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15158 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 12/02/15 09:25, Nathan Scott wrote: > ... > Thanks Ken - that doesn't fail on any of my hosts so far, but there may > be enough state here for me to figure it out. Will get back to ya. Thanks Nathan. As with all my failures, ... 1. if you need more state or runs with special sauce, just ask, and 2. I can provide remote login in a very controlled basis if needed as a last resort. From nscott@redhat.com Wed Feb 11 16:58:17 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 41CA07F5E for ; Wed, 11 Feb 2015 16:58:17 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id D2EA9AC001 for ; Wed, 11 Feb 2015 14:58:13 -0800 (PST) X-ASG-Debug-ID: 1423695491-04bdf06a5a1dc8e0001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id COhRE5uD7Q2KIVAY (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 11 Feb 2015 14:58:11 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1BMwBec014900 for ; Wed, 11 Feb 2015 17:58:11 -0500 Date: Wed, 11 Feb 2015 17:58:10 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: PCP Message-ID: <1559084719.3857960.1423695490984.JavaMail.zimbra@redhat.com> Subject: pcp updates: qa & coverity fixes, round #1 MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: qa & coverity fixes, round #1 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: qa & coverity fixes, round #1 Thread-Index: HPucP8YeBxBVujRVjYK4fOG2C8rSXw== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1423695491 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15160 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Nathan Scott (15): qa: split 660 into two tests and make 'em quicker libpcp: coverity-detected leak, return code and null check fixes libpcp_http: coverity-detected memory leak fix libpcp_pmda: coverity-detected null-value test fix, consistency libpcp_qed: coverity-detected return-code-check fix pmdacisco: coverity-detected memory leak fix pmdalinux: coverity-detected fd leak-on-error fix pmdaproc: coverity-detected fd & mem leak-on-error fixes pmdaproc: coverity - control umask when calling mkstemp pmdaproc: coverity-detected return code check fix, cleanup pmtime: coverity-detected return code check fixes pmcd: coverity-detected return code check fixes pmdaroot: coverity-detected return code check fixes pmie: coverity-detected memleak-on-error-path fix qa: remove coverity-detected impossible unsigned check qa/.gitignore | 3 qa/660 | 63 --- qa/660.out.4 | 526 ---------------------------- qa/660.out.46 | 526 ---------------------------- qa/662 | 63 +++ qa/662.out.4 | 263 ++++++++++++++ qa/662.out.46 | 525 +++++++++++++++++++++++++++ qa/common.check | 19 + qa/common.webapi | 17 qa/group | 1 qa/src/nvidia-ml.c | 1 qa/src/test_webapi.python | 4 src/libpcp/src/auxconnect.c | 8 src/libpcp/src/auxserver.c | 11 src/libpcp/src/getopt.c | 6 src/libpcp/src/logportmap.c | 6 src/libpcp/src/spec.c | 4 src/libpcp_http/src/http_fetcher.c | 3 src/libpcp_pmda/src/dynamic.c | 56 +- src/libpcp_qed/src/qed_fileiconprovider.cpp | 5 src/pmdas/cisco/telnet.c | 5 src/pmdas/linux/proc_loadavg.c | 23 - src/pmdas/linux_proc/cgroups.c | 6 src/pmdas/linux_proc/config.c | 12 src/pmdas/linux_proc/pmda.c | 14 src/pmdas/linux_proc/proc_pid.c | 17 src/pmdas/pmcd/src/pmcd.c | 11 src/pmdas/root/jsmn.c | 2 src/pmie/src/stomp.c | 3 src/pmtime/main.cpp | 2 30 files changed, 1022 insertions(+), 1183 deletions(-) From nscott@redhat.com Wed Feb 11 22:39:36 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id B1B667F5E for ; Wed, 11 Feb 2015 22:39:36 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id A00CE304043 for ; Wed, 11 Feb 2015 20:39:33 -0800 (PST) X-ASG-Debug-ID: 1423715967-04cb6c6b0c1f55f0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id dKfqaCSb4kb9k0nS (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 11 Feb 2015 20:39:27 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1C4dMwd013380 for ; Wed, 11 Feb 2015 23:39:22 -0500 Date: Wed, 11 Feb 2015 23:39:22 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: PCP Message-ID: <2011032309.4022727.1423715962317.JavaMail.zimbra@redhat.com> In-Reply-To: <918851115.3965585.1423713220863.JavaMail.zimbra@redhat.com> Subject: pcp updates: coverity, qa, martins+fche merges MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: coverity, qa, martins+fche merges Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: coverity, qa, martins+fche merges Thread-Index: zhOkuZyBl2jcVCdZ8AzxhNuLHs/ZCQ== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1423715967 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15171 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Nathan Scott (8): libpcp: harden coverity-found af_unix path termination pmdalinux: simplify distro name search, for coverity checker pmdaproc: harden coverity-found cgroup name termination pmdalinux: harden coverity-found device mapper name termination pmdaproc: remove some coverity-found dead code qa: add unstable bytes_read to the memcached filter qa: add a problematic s390x /proc/cpuinfo test case qa: share containers check code between tests Frank Ch. Eigler (5): Correct memory double-free of __pmGetAttrValue result qa/720 test for memory sasl-authentication double-free pmmgr: build fix for older g++ qa/common.check: introduce $_valgrind_clean_assert qa/666: use $_valgrind_clean_assert for pmmgr under microscope Martins Innus (2): Vagrant QA setup based on the Aconex idea Add back lustre that went missing from QA .gitignore | 2 Vagrantfile | 338 +++++++++++++++++++++++++++++++ qa/666 | 4 qa/720 | 1 qa/720.out | 10 qa/835 | 4 qa/837 | 13 - qa/977 | 13 - qa/GNUmakefile | 2 qa/common.check | 46 ++++ qa/linux/cpuinfo-2cpu-s390x-linux-2.6.32 | 6 qa/valgrind-suppress | 15 + src/libpcp/src/auxconnect.c | 9 src/libpcp/src/secureconnect.c | 6 src/pmdas/linux/getinfo.c | 6 src/pmdas/linux/proc_partitions.c | 4 src/pmdas/linux_proc/cgroups.c | 1 src/pmdas/linux_proc/config.c | 185 ---------------- src/pmdas/linux_proc/config.h | 1 src/pmmgr/pmmgr.cxx | 4 20 files changed, 440 insertions(+), 230 deletions(-) From nscott@redhat.com Wed Feb 11 22:44:03 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 2516129DF8 for ; Wed, 11 Feb 2015 22:44:03 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id F2E20304043 for ; Wed, 11 Feb 2015 20:44:02 -0800 (PST) X-ASG-Debug-ID: 1423716241-04bdf06a591e3d30001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id wkGrtsr0FsSKiQsh (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 11 Feb 2015 20:44:01 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1C4hjnW014200; Wed, 11 Feb 2015 23:43:45 -0500 Date: Wed, 11 Feb 2015 23:43:45 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Dave Brolley , Ken McDonell Cc: PCP Message-ID: <1183130201.4033528.1423716225841.JavaMail.zimbra@redhat.com> In-Reply-To: <2029497109.4024932.1423716016512.JavaMail.zimbra@redhat.com> Subject: Hopefully short-lived QA issue MIME-Version: 1.0 X-ASG-Orig-Subj: Hopefully short-lived QA issue Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Hopefully short-lived QA issue Thread-Index: ACkn+vTCsQGYp0fOw7e8PNFvsNv5Pg== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1423716241 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15171 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi guys, Just a heads-up that I've committed a reproducer for an s390x-specific /proc/cpuinfo parsing bug. Until I or someone else :) fixes it - which I expect will be within a day or two - it'll cause qa/885 to fail. (commit c99bdae10) cheers. -- Nathan From kenj@internode.on.net Wed Feb 11 22:59:49 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id A52A07F5E for ; Wed, 11 Feb 2015 22:59:49 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 91CAF8F8059 for ; Wed, 11 Feb 2015 20:59:49 -0800 (PST) X-ASG-Debug-ID: 1423717185-04cbb011651d1ef0001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id 0RUkX76uBMtiIRzL for ; Wed, 11 Feb 2015 20:59:46 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AkACALky3FR20Zu9PGdsb2JhbAANToNYWoMCgyq8XodiAQEBAQEBBQEBAQE4hHFVNgIFFgsCCwMCAQIBMQ4ZCAEBwy9wl0mBIY10gQGCUoFCBZJ7hy2RL4QkW4ECgUEBAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 12 Feb 2015 15:29:05 +1030 Message-ID: <54DC3339.5010000@internode.on.net> Date: Thu, 12 Feb 2015 15:59:37 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423717185 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15172 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- second one is well worth a review by someone who knows! Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (2): valgrind: dodge more brokenness from valgrind 3.6.0 on debian pmatop: arrgh, got you! truncated output bug squashed qa/valgrind-suppress-3.6.0.SVN-Debian | 79 ++++++++++++++++++++++++++++++++++ src/pmatop/pmatop.py | 7 ++- 2 files changed, 85 insertions(+), 1 deletion(-) From nscott@redhat.com Wed Feb 11 23:01:13 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 770E87F5E for ; Wed, 11 Feb 2015 23:01:13 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id F0416AC002 for ; Wed, 11 Feb 2015 21:01:09 -0800 (PST) X-ASG-Debug-ID: 1423717267-04cb6c6b0b1f5af0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id XlvJlphmZmn0bLCn (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 11 Feb 2015 21:01:07 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1C516wk020466; Thu, 12 Feb 2015 00:01:06 -0500 Date: Thu, 12 Feb 2015 00:01:06 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" , Dave Brolley Cc: PCP Message-ID: <170098171.4053973.1423717266752.JavaMail.zimbra@redhat.com> In-Reply-To: <1936499254.4052190.1423716457141.JavaMail.zimbra@redhat.com> Subject: Possible QA issue in _valgrind_clean_assert MIME-Version: 1.0 X-ASG-Orig-Subj: Possible QA issue in _valgrind_clean_assert Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Possible QA issue in _valgrind_clean_assert Thread-Index: KraDaXrjZF5pVx58AVzX+2nHHwxUUw== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1423717267 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15171 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi, "qa/666: use $_valgrind_clean_assert for pmmgr under microscope" is now merged. It looks OK to me & 666 passes with it here. Dave made a note that he's observed this, however... 666 - output mismatch (see 666.out.bad) 18a19,21 > ==9712== could not unlink /tmp/vgdb-pipe-from-vgdb-to-9712-by-root-on-brolley-t530 > ==9712== could not unlink /tmp/vgdb-pipe-to-vgdb-from-9712-by-root-on-brolley-t530 > ==9712== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-9712-by-root-on-brolley-t530 ... could you take a look & work it out together? I'm punting its something specific to Dave's valgrind version/installation. Also, note I've had to update the valgrind-suppress change from the SASL fix; syntax used was not available for older valgrinds (e.g. 3.6.0 on rhel6). cheers. -- Nathan From nscott@redhat.com Wed Feb 11 23:06:59 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 575E87F61 for ; Wed, 11 Feb 2015 23:06:59 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id E577CAC005 for ; Wed, 11 Feb 2015 21:06:58 -0800 (PST) X-ASG-Debug-ID: 1423717616-04bdf06a5a1e41d0001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id LYKq75uDPl4AZLBd (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 11 Feb 2015 21:06:57 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1C56rD3009373; Thu, 12 Feb 2015 00:06:53 -0500 Date: Thu, 12 Feb 2015 00:06:53 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <265174262.4055069.1423717613146.JavaMail.zimbra@redhat.com> In-Reply-To: <54DC3339.5010000@internode.on.net> References: <54DC3339.5010000@internode.on.net> Subject: Re: [pcp] pcp updates MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pcp updates Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates Thread-Index: oSR8sZLUw4gpbfywLr84ISjDJIU+rg== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1423717617 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15172 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > second one is well worth a review by someone who knows! > [...] > pmatop: arrgh, got you! truncated output bug squashed Ah, nice one. :) You could possibly use a more specific Exception, like "except KeyError as e:"? Otherwise looks fine to me though. cheers. -- Nathan From kenj@internode.on.net Wed Feb 11 23:22:35 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 757EA7F62 for ; Wed, 11 Feb 2015 23:22:35 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 63FF08F8037 for ; Wed, 11 Feb 2015 21:22:32 -0800 (PST) X-ASG-Debug-ID: 1423718549-04cb6c6b0b1f6020001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id CYmgXjLWZeLY9zg6 for ; Wed, 11 Feb 2015 21:22:30 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: Ai0CAG833FR20Zu9PGdsb2JhbAANToc0gyrAEoJPAoFnAQEBAQEBBQEBAQE4hEcBAQEEIxVAAQwECxgCAgUWCwICCQMCAQIBMRQGDQEHAQHDOXCXHAEBAQEBAQEDAQEBAQEBARuBIYlrhG0HgmiBQgEEq1eEJIMeAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 12 Feb 2015 15:52:29 +1030 Message-ID: <54DC38B5.1080706@internode.on.net> Date: Thu, 12 Feb 2015 16:23:01 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp@oss.sgi.com Subject: Re: [pcp] pcp updates References: <54DC3339.5010000@internode.on.net> <265174262.4055069.1423717613146.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] pcp updates In-Reply-To: <265174262.4055069.1423717613146.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423718549 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15173 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 12/02/15 16:06, Nathan Scott wrote: > > > ----- Original Message ----- >> second one is well worth a review by someone who knows! >> [...] >> pmatop: arrgh, got you! truncated output bug squashed > > Ah, nice one. :) You could possibly use a more specific > Exception, like "except KeyError as e:"? Otherwise looks > fine to me though. The error is an os-level ENOENT ... I had no clue what sort of exception that maps to in Python-speak. From kenj@internode.on.net Wed Feb 11 23:38:27 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 095B329DFB for ; Wed, 11 Feb 2015 23:38:27 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id EC61D304066 for ; Wed, 11 Feb 2015 21:38:23 -0800 (PST) X-ASG-Debug-ID: 1423719501-04cb6c6b091f63a0001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id tWslQLR5bE8Sht8D for ; Wed, 11 Feb 2015 21:38:21 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: Ag4CAN463FR20Zu9PGdsb2JhbAANToNYWoYsvGiFeQKBZwEBAQEBAQUBAQEBOIRIAQEEeBELGAkWDwkDAgECATEUEwgBAcM8mAwBAQgCAR+LDIR0FoQUAQSSe5hcgiEfgWRbgkMBAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 12 Feb 2015 16:08:20 +1030 Message-ID: <54DC3C6D.4090005@internode.on.net> Date: Thu, 12 Feb 2015 16:38:53 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] pcp updates: coverity, qa, martins+fche merges References: <2011032309.4022727.1423715962317.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] pcp updates: coverity, qa, martins+fche merges In-Reply-To: <2011032309.4022727.1423715962317.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423719501 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15173 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 12/02/15 15:39, Nathan Scott wrote: > Changes committed to git://git.pcp.io/pcp.git dev > > ... FWIW I have run the new/changed/previously failing qa tests on vm08 (x86_64 CentOS Linux7.0.1406) 666 - extra lines + ==23969== could not unlink /tmp/vgdb-pipe-from-vgdb-to-23969-by-root-on-vm08.localdomain + ==23969== could not unlink /tmp/vgdb-pipe-to-vgdb-from-23969-by-root-on-vm08.localdomain + ==23969== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-23969-by-root-on-vm08.localdomain 720 - valgrind detected errors Command: pminfo -h pcp://localhost?user=NOsuchUSER&pass=DEFINITELYnotApassword + 39 bytes in 1 blocks are definitely lost in loss record 14 of 38 + at 0x4C2A1D4: calloc (in /usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so) + by 0x4E86ADB: __pmAuthSecretCB (secureconnect.c:750) + by 0x5C2459A: _plug_get_password (in /usr/lib64/libsasl2.so.3.0.0) + by 0x90BE45F: ??? (in /usr/lib64/sasl2/libdigestmd5.so.3.0.0) + by 0x90C29CA: ??? (in /usr/lib64/sasl2/libdigestmd5.so.3.0.0) + by 0x5C187F1: sasl_client_step (in /usr/lib64/libsasl2.so.3.0.0) + by 0x4E87825: __pmAuthClientNegotiation (secureconnect.c:1131) + by 0x4E8832C: __pmSecureClientHandshake (secureconnect.c:1213) + by 0x4E44126: __pmConnectHandshake (connect.c:175) + by 0x4E44746: __pmConnectPMCD (connect.c:413) + by 0x4E468EC: pmNewContext (context.c:525) + by 0x401860: main (pminfo.c:644) 977 - kills pmcd, same as this morning's reported failure with pminfo -v --container=test From nscott@redhat.com Wed Feb 11 23:47:40 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 87F067F63 for ; Wed, 11 Feb 2015 23:47:40 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 56C0E304059 for ; Wed, 11 Feb 2015 21:47:40 -0800 (PST) X-ASG-Debug-ID: 1423720057-04bdf06a5c1e4c50001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id ZfOle0ZK9484EkgE (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 11 Feb 2015 21:47:38 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1C5lYhn018229; Thu, 12 Feb 2015 00:47:35 -0500 Date: Thu, 12 Feb 2015 00:47:34 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <900480755.4067256.1423720054914.JavaMail.zimbra@redhat.com> In-Reply-To: <54DC3C6D.4090005@internode.on.net> References: <2011032309.4022727.1423715962317.JavaMail.zimbra@redhat.com> <54DC3C6D.4090005@internode.on.net> Subject: Re: [pcp] pcp updates: coverity, qa, martins+fche merges MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pcp updates: coverity, qa, martins+fche merges Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: coverity, qa, martins+fche merges Thread-Index: 9h0odHEohjW5izJhkEWnpqcmSSUDIA== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1423720057 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15173 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > On 12/02/15 15:39, Nathan Scott wrote: > > Changes committed to git://git.pcp.io/pcp.git dev > > > > ... > > FWIW I have run the new/changed/previously failing qa tests on vm08 (x86_64 > CentOS Linux7.0.1406) > > 666 - extra lines > + ==23969== could not unlink > /tmp/vgdb-pipe-from-vgdb-to-23969-by-root-on-vm08.localdomain > + ==23969== could not unlink > /tmp/vgdb-pipe-to-vgdb-from-23969-by-root-on-vm08.localdomain > + ==23969== could not unlink > /tmp/vgdb-pipe-shared-mem-vgdb-23969-by-root-on-vm08.localdomain > See last mail to Dave & Frank - guess its a newer-valgrind-version related issue. > 720 - valgrind detected errors > Command: pminfo -h > pcp://localhost?user=NOsuchUSER&pass=DEFINITELYnotApassword > + 39 bytes in 1 blocks are definitely lost in loss record 14 of 38 > + at 0x4C2A1D4: calloc (in > /usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so) > + by 0x4E86ADB: __pmAuthSecretCB (secureconnect.c:750) > + by 0x5C2459A: _plug_get_password (in /usr/lib64/libsasl2.so.3.0.0) > + by 0x90BE45F: ??? (in /usr/lib64/sasl2/libdigestmd5.so.3.0.0) > + by 0x90C29CA: ??? (in /usr/lib64/sasl2/libdigestmd5.so.3.0.0) > + by 0x5C187F1: sasl_client_step (in /usr/lib64/libsasl2.so.3.0.0) > + by 0x4E87825: __pmAuthClientNegotiation (secureconnect.c:1131) > + by 0x4E8832C: __pmSecureClientHandshake (secureconnect.c:1213) > + by 0x4E44126: __pmConnectHandshake (connect.c:175) > + by 0x4E44746: __pmConnectPMCD (connect.c:413) > + by 0x4E468EC: pmNewContext (context.c:525) > + by 0x401860: main (pminfo.c:644) Not seeing that here; its a new test - looks like possibly a genuine failure though & a bug still remaining in libpcp/sasl code? commit 2ae6cd0a4ce may have exposed this reporting? Not sure, needs to be investigated some more I think. > 977 - kills pmcd, same as this morning's reported failure with pminfo -v > --container=test This ones near the top of my short-term list, thanks. cheers. -- Nathan From nscott@redhat.com Wed Feb 11 23:49:39 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 798B17F63 for ; Wed, 11 Feb 2015 23:49:39 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 6403B304064 for ; Wed, 11 Feb 2015 21:49:38 -0800 (PST) X-ASG-Debug-ID: 1423720177-04cb6c6b0a1f6660001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id kfr77DeaqWsFbf22 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 11 Feb 2015 21:49:37 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1C5nMcx023540; Thu, 12 Feb 2015 00:49:22 -0500 Date: Thu, 12 Feb 2015 00:49:22 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <1531256945.4067509.1423720162040.JavaMail.zimbra@redhat.com> In-Reply-To: <54DC38B5.1080706@internode.on.net> References: <54DC3339.5010000@internode.on.net> <265174262.4055069.1423717613146.JavaMail.zimbra@redhat.com> <54DC38B5.1080706@internode.on.net> Subject: Re: [pcp] pcp updates MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pcp updates Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates Thread-Index: f98w+jMsu9y6bZTSPk6YjmEfODmiDQ== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1423720177 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15173 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > On 12/02/15 16:06, Nathan Scott wrote: > > > > > > ----- Original Message ----- > >> second one is well worth a review by someone who knows! > >> [...] > >> pmatop: arrgh, got you! truncated output bug squashed > > > > Ah, nice one. :) You could possibly use a more specific > > Exception, like "except KeyError as e:"? Otherwise looks > > fine to me though. > > The error is an os-level ENOENT ... I had no clue what sort of exception > that maps to in Python-speak. I think the more specific exception then would be "except OSError:" ? cheers. -- Nathan From nscott@redhat.com Thu Feb 12 03:27:54 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 3D9D07F67 for ; Thu, 12 Feb 2015 03:27:54 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 28996304066 for ; Thu, 12 Feb 2015 01:27:50 -0800 (PST) X-ASG-Debug-ID: 1423733268-04cbb011641dc420001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id kEuIgFnkcfo18Fsl (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 12 Feb 2015 01:27:49 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1C9Riqs055560; Thu, 12 Feb 2015 04:27:44 -0500 Date: Thu, 12 Feb 2015 04:27:44 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: PCP Message-ID: <245733123.4207829.1423733264690.JavaMail.zimbra@redhat.com> In-Reply-To: <54DBDAC2.5020204@internode.on.net> References: <54DBC8A0.8010805@internode.on.net> <911908095.3825780.1423693506632.JavaMail.zimbra@redhat.com> <54DBDAC2.5020204@internode.on.net> Subject: Re: [pcp] pmcd dumps core on containers test MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pmcd dumps core on containers test Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pmcd dumps core on containers test Thread-Index: bUFDdLuI9lg3Mttd6HglekpZfGr+Ww== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1423733269 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15181 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > On 12/02/15 09:25, Nathan Scott wrote: > > ... > > Thanks Ken - that doesn't fail on any of my hosts so far, but there may > > be enough state here for me to figure it out. Will get back to ya. > > > Thanks Nathan. > > As with all my failures, ... > > 1. if you need more state or runs with special sauce, just ask, and Taa. After several hours and several hosts - still no reproducer. And staring at the code I'm not seeing the bug. Can you do a debug build on one of the failing hosts (with -g, without -O2 in builddefs) and send through the stack trace once more? (without all the "optimized away" parameter values). > 2. I can provide remote login in a very controlled basis if needed as a > last resort. Else, that's our next best option I guess. Thanks! -- Nathan From kenj@internode.on.net Thu Feb 12 13:41:45 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 580027F37 for ; Thu, 12 Feb 2015 13:41:45 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id E9E25AC004 for ; Thu, 12 Feb 2015 11:41:41 -0800 (PST) X-ASG-Debug-ID: 1423770093-04cbb01163259560001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id zUK8iuRRfXppI3sO for ; Thu, 12 Feb 2015 11:41:34 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AuIBANQA3VR20Zu9PGdsb2JhbAANToc0gyrAHoJPAoFvAQEBAQEBBQEBAQE4hEgBAQQjBFEBEAsYAgIFFgsCAgkDAgECATEUBg0BBwEBxXxwlycBAQEBAQEBAwEBAQEBAQEbgSGJa4RtB4JogUIBBKtcgiQcgWSDHgEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 13 Feb 2015 06:11:33 +1030 Message-ID: <54DD020E.5000208@internode.on.net> Date: Fri, 13 Feb 2015 06:42:06 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Nathan Scott CC: PCP Subject: Re: [pcp] pmcd dumps core on containers test References: <54DBC8A0.8010805@internode.on.net> <911908095.3825780.1423693506632.JavaMail.zimbra@redhat.com> <54DBDAC2.5020204@internode.on.net> <245733123.4207829.1423733264690.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] pmcd dumps core on containers test In-Reply-To: <245733123.4207829.1423733264690.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423770094 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15202 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 12/02/15 20:27, Nathan Scott wrote: > ... Can you do a debug build on > one of the failing hosts (with -g, without -O2 in builddefs) and send > through the stack trace once more? (without all the "optimized away" > parameter values). Did that and the test no longer fails. This is smelling like yet another gcc optimizer bug. kenj@vm18:~/src/pcp/src/libpcp_pmda/src$ gcc --version gcc (Ubuntu/Linaro 4.6.1-9ubuntu3) 4.6.1 For a long time I turned off -O2 optimizations on Ubuntu because their gcc version we demonstrably broken ... that problem went away (not sure how or why) but seems to have reappeared or something similar has popped up. I did these experiments to narrow the scope. libpcp libpcp_pmda libpcp_pmcd pmcd pminfo --container=test build -g -O2 -g -O2 -g -O2 -g -O2 fails build -g -g -g -g passes build -g -O2 -g -g -g passes build -g -O2 -g -g -g -O2 passes build -g -O2 -g -g -O2 -g -O2 passes build -g -O2 -g -O2 -g -O2 -g -O2 fails So it is libpcp_pmda that has the bad code. Digging further, with all of the rest of libpcp_pmda compiled -O2, the problem appears and disappears depending on whether pduroot.c is compiled -O2 or not. Hmm ... pduroot.c seems benign, but wait ... pduroot.h contains the pdu buffer typedef with a name[0] field ... this looks like a smoking gun. If -O2 is confused by the pointer assignment and thinks pdu->name is of size 0 and then checks before doing the inlined strncpy, then maybe KABOOM. A small rework of pduroot.h and associated code in pduroot.c and we're laughing ... all the container QA tests pass. I'll push my code changes upstream for review. From minnus@buffalo.edu Thu Feb 12 13:52:05 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: ** X-Spam-Status: No, score=3.0 required=5.0 tests=TVD_SUBJ_NUM_OBFU_MINFP autolearn=no version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 947A57F37 for ; Thu, 12 Feb 2015 13:52:05 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 8262E8F8040 for ; Thu, 12 Feb 2015 11:52:02 -0800 (PST) X-ASG-Debug-ID: 1423770721-04cbb0116325a150001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve8.acsu.buffalo.edu [128.205.6.19]) by cuda.sgi.com with ESMTP id vaaHsOu5GWPAit0G for ; Thu, 12 Feb 2015 11:52:01 -0800 (PST) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.6.19 Received: from localmailA.acsu.buffalo.edu (localmaila.acsu.buffalo.edu [128.205.5.196]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id D15EFFB4 for ; Thu, 12 Feb 2015 14:52:00 -0500 (EST) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id CC42AC12C for ; Thu, 12 Feb 2015 14:52:00 -0500 (EST) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailA.acsu.buffalo.edu (Postfix) with ESMTP id 3EFD5C122 for ; Thu, 12 Feb 2015 14:52:00 -0500 (EST) Received: from smtp.buffalo.edu (smtp3.acsu.buffalo.edu [128.205.5.226]) by localmailA.acsu.buffalo.edu (Prefixe) with ESMTP id 2D989C121 for ; Thu, 12 Feb 2015 14:52:00 -0500 (EST) Received: from [128.205.28.142] (slash.eng.buffalo.edu [128.205.28.142]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 2280B45BC for ; Thu, 12 Feb 2015 14:52:00 -0500 (EST) Message-ID: <54DD045E.50009@buffalo.edu> Date: Thu, 12 Feb 2015 14:51:58 -0500 From: Martins Innus User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: ganglia2pcp Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: ganglia2pcp Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve8.acsu.buffalo.edu[128.205.6.19] X-Barracuda-Start-Time: 1423770721 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15203 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi, I have a ganglia2pcp utility here for review/merging: https://github.com/ubccr/pcp/tree/ganglia-import This is a first step that converts most of the default metrics to equivalent pcp metrics. It operates on a directory full of rrd files and generates one pcp archive from this set. It uses the RRDs perl module that I tested was available in recent Centos and Ubuntu. I think I got all the build logic correct for at least these 2 platforms. QA requires binary rrd files, but I tried to make them as small as possible. Usage: ganglia2pcp [-s start] [-e end] [-f output file name] [-d output file dir ] [-Z timezone] [-h hostname] input_dir Only required parameter is an input directory. If no timespec is given, it will try to grab the last 24 hours. RRD files can have multiple time resolutions but this will only try to get the highest resolution. start and end are formats that str2time would understand. The default conversion config is in the source file. Any unknown metrics will be skipped. As far as I can tell, everything I have so far maps to correct current pcp metrics. Future work will be a config file to allow configuration of other custom metrics to convert. I only tested on default ganglia configurations, so if anything breaks on more complex setups, please let me know. I borrowed some code (mostly timezone stuff) from iostat2pcp so feel free to change the copyright if appropriate. Thanks Martins From minnus@buffalo.edu Thu Feb 12 14:01:39 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: ** X-Spam-Status: No, score=3.0 required=5.0 tests=TVD_SUBJ_NUM_OBFU_MINFP autolearn=no version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 2F5B57F58 for ; Thu, 12 Feb 2015 14:01:39 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 0D701304062 for ; Thu, 12 Feb 2015 12:01:35 -0800 (PST) X-ASG-Debug-ID: 1423771294-04cbb0116325c340001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve8.acsu.buffalo.edu [128.205.6.19]) by cuda.sgi.com with ESMTP id Ktnu6dD2aS0aGKCo for ; Thu, 12 Feb 2015 12:01:34 -0800 (PST) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.6.19 Received: from localmailA.acsu.buffalo.edu (localmaila.acsu.buffalo.edu [128.205.5.196]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 3376A3204 for ; Thu, 12 Feb 2015 15:01:34 -0500 (EST) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 2F60EC2F1 for ; Thu, 12 Feb 2015 15:01:34 -0500 (EST) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailA.acsu.buffalo.edu (Postfix) with ESMTP id D7643C2D1 for ; Thu, 12 Feb 2015 15:01:32 -0500 (EST) Received: from smtp.buffalo.edu (smtp3.acsu.buffalo.edu [128.205.5.226]) by localmailA.acsu.buffalo.edu (Prefixe) with ESMTP id C0F62C2CD for ; Thu, 12 Feb 2015 15:01:32 -0500 (EST) Received: from [128.205.28.142] (slash.eng.buffalo.edu [128.205.28.142]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id B59AD46CD for ; Thu, 12 Feb 2015 15:01:32 -0500 (EST) Message-ID: <54DD069A.8090604@buffalo.edu> Date: Thu, 12 Feb 2015 15:01:30 -0500 From: Martins Innus User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] ganglia2pcp References: <54DD045E.50009@buffalo.edu> X-ASG-Orig-Subj: Re: [pcp] ganglia2pcp In-Reply-To: <54DD045E.50009@buffalo.edu> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: X: 10% X-Barracuda-Connect: mtareserve8.acsu.buffalo.edu[128.205.6.19] X-Barracuda-Start-Time: 1423771294 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15203 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Forgot the git log: commit a61617613a267fcca1423a446d9642acd4cdc0a3 Author: Martins Innus Date: Thu Feb 12 18:02:27 2015 +0000 Fix qa output for latest ganglia changes qa/926.out | 49 ++++++++++++++++++++++++++----------------------- 1 file changed, 26 insertions(+), 23 deletions(-) commit 97d4879b488ce51bd2167841403c06c692279f49 Author: Martins Innus Date: Thu Feb 12 17:57:47 2015 +0000 ganglia2pcp add cpu indom support Add support for multiple cpus even though all we are grabbing is cpu speed and I have not yet seen per cpu metrics in ganglia. src/ganglia2pcp/ganglia2pcp | 106 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++------------ 1 file changed, 94 insertions(+), 12 deletions(-) commit f694401e390eafa8eab080fe485e32296e81975e Author: Martins Innus Date: Wed Feb 11 21:15:08 2015 +0000 Fix commented code in ganglia2pcp qa qa/926 | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) commit f205876244ea4314e845047bad14614be03ac0d4 Author: Martins Innus Date: Wed Feb 11 21:09:36 2015 +0000 ganglia2pcp tweaks Fix undef check Sort metrics so QA is deterministic qa/926.out | 576 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++----------------------------------------------------------------------------------- src/ganglia2pcp/ganglia2pcp | 15 +++-- 2 files changed, 298 insertions(+), 293 deletions(-) commit 3faaadbed0ae72ea829bc63356fde1d3f16137b7 Author: Martins Innus Date: Wed Feb 11 19:08:53 2015 +0000 More ganglia2pcp work Add qa Fixup some debian build rules debian/rules | 4 ++ qa/926 | 51 ++++++++++++++ qa/926.out | 564 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ qa/GNUmakefile | 2 +- qa/ganglia/GNUmakefile | 15 +++++ qa/ganglia/gangliatest/GNUmakefile | 18 +++++ qa/ganglia/gangliatest/boottime.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/bytes_in.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/bytes_out.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/cpu_aidle.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/cpu_idle.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/cpu_nice.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/cpu_num.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/cpu_speed.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/cpu_system.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/cpu_user.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/cpu_wio.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/disk_free.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/disk_total.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/load_fifteen.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/load_five.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/load_one.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/mem_buffers.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/mem_cached.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/mem_free.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/mem_shared.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/mem_total.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/part_max_used.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/pkts_in.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/pkts_out.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/proc_run.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/proc_total.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/swap_free.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/swap_total.rrd | Bin 0 -> 1112 bytes qa/group | 1 + src/ganglia2pcp/GNUmakefile | 2 +- 36 files changed, 655 insertions(+), 2 deletions(-) commit 8ef77cec61cbc916d4a0b11a3e0d87da97431f28 Author: Martins Innus Date: Wed Feb 11 16:09:29 2015 +0000 ganglia2pcp cleanups Add manpage Fix build scripts debian/GNUmakefile | 4 ++++ debian/control | 8 ++++++++ debian/control.master | 8 ++++++++ debian/pcp-import-ganglia2pcp.install | 2 ++ debian/rules | 2 ++ man/man1/ganglia2pcp.1 | 118 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ src/ganglia2pcp/ganglia2pcp | 2 +- 7 files changed, 143 insertions(+), 1 deletion(-) commit da9a4e850eb3d0b5ea0e1c5e3fd20f8d51f1cdd7 Author: Martins Innus Date: Tue Feb 10 20:47:20 2015 +0000 ganglia2pcp initial commit Convert ganglia (rrd) files to a pcp archive A directory containing a set of rrd files for a single host can be converted to a single pcp archive src/GNUmakefile | 1 + src/ganglia2pcp/GNUmakefile | 28 ++++++++ src/ganglia2pcp/README | 30 ++++++++ src/ganglia2pcp/ganglia2pcp | 625 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 4 files changed, 684 insertions(+) Martins On 2/12/2015 2:51 PM, Martins Innus wrote: > Hi, > I have a ganglia2pcp utility here for review/merging: > From kenj@internode.on.net Thu Feb 12 14:06:08 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 174F57F3F for ; Thu, 12 Feb 2015 14:06:08 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 00CA2304062 for ; Thu, 12 Feb 2015 12:06:07 -0800 (PST) X-ASG-Debug-ID: 1423771560-04cb6c6b0b294ea0001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id YvXn9HF69VuRp80o for ; Thu, 12 Feb 2015 12:06:01 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AuwBAMkG3VR20Zu9PGdsb2JhbAANToNYWoMCgyq8dIdqAQEBAQEBBQEBAQE4hHFVNgIFFgsCCwMCAQIBMScIAQHFbnCXVoEhjnWCUoFCBYVWjSmYXYQkW4JDAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 13 Feb 2015 06:35:59 +1030 Message-ID: <54DD07C9.9090008@internode.on.net> Date: Fri, 13 Feb 2015 07:06:33 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - containers fix, freebsd changes Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - containers fix, freebsd changes Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423771560 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15202 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (6): libpcp/secureconnect.c: fix compilation warning qa/031&574: freebsd variant of the dupnames output files qa/group: add a couple of tests to the containers group qa/160: rework for FreeBSD qa/common.check: make _cleanup_pmda() wait and check a bit more libpcp_pmda: fix for pmdaRootPDUContainer problem qa/031.out.freebsd | 2 +- qa/160 | 22 ++++++++++++++-------- qa/574.out.freebsd | 2 +- qa/common.check | 21 +++++++++++++++------ qa/group | 5 ++--- src/libpcp/src/secureconnect.c | 6 +++--- src/libpcp_pmda/src/pduroot.c | 19 +++++++++---------- src/libpcp_pmda/src/pduroot.h | 2 +- 8 files changed From kenj@internode.on.net Thu Feb 12 15:07:01 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 7D34B7F51 for ; Thu, 12 Feb 2015 15:07:01 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 19F0BAC007 for ; Thu, 12 Feb 2015 13:06:57 -0800 (PST) X-ASG-Debug-ID: 1423775212-04bdf06a5926ee80001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id IbnBDX3HX8UyZPQc for ; Thu, 12 Feb 2015 13:06:52 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AuEBAPgU3VR20Zu9PGdsb2JhbAANToc0gyrAHoRAAQEBAQEBBQEBAQE4hHEEUTYCBRYLAgsDAgECATEaDQgBAcVncJcoLIEhkUeBQgWrXIIkHIFkgx4BAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 13 Feb 2015 07:36:52 +1030 Message-ID: <54DD160D.7020704@internode.on.net> Date: Fri, 13 Feb 2015 08:07:25 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: PCP Subject: Rash of QA failures Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: Rash of QA failures Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423775212 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15205 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- My failure rate went up spectacularly overnight ... is it possible that some changes checked in yesterday have broken things? For example ... $ pmlc -Dall ... pmlc> show loggers @vm21 stmt=278, state=0, control=0, hostspec=vm21, pid=-2, port=-2 auxconnect.c:__pmGetAddrInfo(bozo) -> (null) auxconnect.c:__pmGetAddrInfo(vm21) -> (null) auxconnect.c:__pmHostEntFree(hostent=0x1f2c0b0) name=(nil) ((null)) addresses=0x1f2c330 auxconnect.c:__pmHostEntFree(hostent=0x1f2d0a0) name=(nil) ((null)) addresses=0x1f2e4f0 auxconnect.c:__pmGetAddrInfo(bozo) -> (null) auxconnect.c:__pmGetAddrInfo(vm21) -> (null) auxconnect.c:__pmHostEntFree(hostent=0x1f2d0a0) name=(nil) ((null)) addresses=0x1f2e760 auxconnect.c:__pmHostEntFree(hostent=0x1f2c0b0) name=(nil) ((null)) addresses=0x1f2e590 Error finding pmloggers on vm21: Unknown code gvAS 96 pmlc> What's this "Unknown code gvAS 96" stuff? On another system (code from a few days ago), the same operation produces ... pmlc> show loggers @vm21 stmt=278, state=0, control=0, hostspec=vm21, pid=-2, port=-2 auxconnect.c:__pmGetAddrInfo(vm01) -> (null) auxconnect.c:__pmGetAddrInfo(vm21) -> (null) auxconnect.c:__pmHostEntFree(hostent=0x835d068) name=(nil) ((null)) addresses=0x835d160 auxconnect.c:__pmHostEntFree(hostent=0x835d1d0) name=(nil) ((null)) addresses=0x835e4d8 __pmConnectPMCD: trying __pmAuxConnectPMCDPort(vm21, 44321) ... auxconnect.c:__pmGetAddrInfo(vm21) -> (null) __pmSetSocketIPC: fd=3 IPC table fd(PDU version): __pmDataIPC: fd=3, data=0x835ec10(sz=16) __pmDataIPC: fd=3, data=0x835ec10(sz=16) __pmDataIPC: fd=3, data=0x835ec10(sz=16) auxconnect.c:__pmHostEntFree(hostent=0x835ebb0) name=(nil) ((null)) addresses=0x835d938 ... (lots of tracing) ... The following pmloggers are running on vm21: primary (16147) 21909 Does this match any place changes have been made recently? My first guess would be the Coverity-driven commits, but that is only a guess. From nscott@redhat.com Thu Feb 12 15:41:02 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 3AF187F51 for ; Thu, 12 Feb 2015 15:41:02 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id D8F48AC005 for ; Thu, 12 Feb 2015 13:41:01 -0800 (PST) X-ASG-Debug-ID: 1423777259-04bdf06a5926fac0001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id d1g2HGkLQRSlBxVu (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 12 Feb 2015 13:41:00 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1CLeuLh008418; Thu, 12 Feb 2015 16:40:56 -0500 Date: Thu, 12 Feb 2015 16:40:56 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: PCP Message-ID: <241286973.4990147.1423777256103.JavaMail.zimbra@redhat.com> In-Reply-To: <54DD020E.5000208@internode.on.net> References: <54DBC8A0.8010805@internode.on.net> <911908095.3825780.1423693506632.JavaMail.zimbra@redhat.com> <54DBDAC2.5020204@internode.on.net> <245733123.4207829.1423733264690.JavaMail.zimbra@redhat.com> <54DD020E.5000208@internode.on.net> Subject: Re: [pcp] pmcd dumps core on containers test MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pmcd dumps core on containers test Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pmcd dumps core on containers test Thread-Index: QW7V6E08rbudoNUDltn+SNegvlySrQ== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1423777260 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15206 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > [...] > Digging further, with all of the rest of libpcp_pmda compiled -O2, the > problem appears and disappears depending on whether pduroot.c is compiled > -O2 or not. Oh wow, thanks for the detailed analysis & insight!! > Hmm ... pduroot.c seems benign, but wait ... pduroot.h contains the pdu > buffer typedef with a name[0] field ... this looks like a smoking gun. If > -O2 is confused by the pointer assignment and thinks pdu->name is of size 0 > and then checks before doing the inlined strncpy, then maybe KABOOM. > > A small rework of pduroot.h and associated code in pduroot.c and we're > laughing ... all the container QA tests pass. Good stuff - thanks again Ken! cheers. -- Nathan From nscott@redhat.com Thu Feb 12 16:11:45 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id C6E787F54 for ; Thu, 12 Feb 2015 16:11:45 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id B50898F8050 for ; Thu, 12 Feb 2015 14:11:42 -0800 (PST) X-ASG-Debug-ID: 1423779097-04cb6c6b0b297dc0001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id NrWtOG6WclKioENH (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 12 Feb 2015 14:11:38 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1CMBYAA015319; Thu, 12 Feb 2015 17:11:34 -0500 Date: Thu, 12 Feb 2015 17:11:34 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: PCP Message-ID: <626525689.5005370.1423779094084.JavaMail.zimbra@redhat.com> In-Reply-To: <54DD160D.7020704@internode.on.net> References: <54DD160D.7020704@internode.on.net> Subject: Re: [pcp] Rash of QA failures MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Rash of QA failures Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Rash of QA failures Thread-Index: m+MK2m0rPG6qzGGjqIULOgTbMXh52Q== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1423779098 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15206 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > My failure rate went up spectacularly overnight ... is it possible that some > changes checked in yesterday have broken things? Very much so. For me, the trend all week has been toward a happier place (incl. overnight) ... could you try revert commit d3895954cc6 (libpcp: coverity-detected leak, return code and null check fixes) and see if that's contributing here? > Error finding pmloggers on vm21: Unknown code gvAS 96 > pmlc> > > > What's this "Unknown code gvAS 96" stuff? I guess its coming out of strerror, via the pmErrStr call in pmlc (actions.c:205) ... not sure how/why though. > Does this match any place changes have been made recently? My first guess > would be the Coverity-driven commits, but that is only a guess. *nod* - that'd be my first guess also. cheers. -- Nathan From brolley@redhat.com Thu Feb 12 16:16:27 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 547EE7F54 for ; Thu, 12 Feb 2015 16:16:27 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 2C16A8F806F for ; Thu, 12 Feb 2015 14:16:27 -0800 (PST) X-ASG-Debug-ID: 1423779385-04cbb0116225fd30001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id CpwkPDu3Lz7JnQ4j (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 12 Feb 2015 14:16:26 -0800 (PST) X-Barracuda-Envelope-From: brolley@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1CMGPVd003239 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 12 Feb 2015 17:16:25 -0500 Received: from [10.10.61.171] (vpn-61-171.rdu2.redhat.com [10.10.61.171]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1CMGNRd031144; Thu, 12 Feb 2015 17:16:23 -0500 Message-ID: <54DD2668.6020005@redhat.com> Date: Thu, 12 Feb 2015 17:17:12 -0500 From: Dave Brolley User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: Nathan Scott , "Frank Ch. Eigler" CC: PCP Subject: Re: Possible QA issue in _valgrind_clean_assert References: <170098171.4053973.1423717266752.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: Possible QA issue in _valgrind_clean_assert In-Reply-To: <170098171.4053973.1423717266752.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423779386 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 02/12/2015 12:01 AM, Nathan Scott wrote: > ... could you take a look & work it out together? I'm punting its > something specific to Dave's valgrind version/installation. Also, > note I've had to update the valgrind-suppress change from the SASL > fix; syntax used was not available for older valgrinds (e.g. 3.6.0 > on rhel6). > Here are the results from running: sudo strace -o /tmp/666.strace.txt -f sh ./check 666 666 - output mismatch (see 666.out.bad) 18a19,21 > ==12100== could not unlink /tmp/vgdb-pipe-from-vgdb-to-12100-by-root-on-brolley-t530 > ==12100== could not unlink /tmp/vgdb-pipe-to-vgdb-from-12100-by-root-on-brolley-t530 > ==12100== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-12100-by-root-on-brolley-t530 Within the generated log, we find: 12100 unlink("/tmp/vgdb-pipe-from-vgdb-to-12100-by-root-on-brolley-t530") = -1 EPERM (Operation not permitted) and in the filesystem, we see: prw-------. 1 root root 0 Feb 12 17:03 vgdb-pipe-to-vgdb-from-12100-by-root-on-brolley-t530 -rw-------. 1 root root 40 Feb 12 17:03 vgdb-pipe-shared-mem-vgdb-12100-by-root-on-brolley-t530 prw-------. 1 root root 0 Feb 12 17:03 vgdb-pipe-from-vgdb-to-12100-by-root-on-brolley-t530 I hope this helps, Dave From brolley@redhat.com Thu Feb 12 16:22:10 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 7AD8F7F54 for ; Thu, 12 Feb 2015 16:22:10 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 0A388AC007 for ; Thu, 12 Feb 2015 14:22:06 -0800 (PST) X-ASG-Debug-ID: 1423779725-04cb6c6b0b298210001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id fDnqUB2P13FwWveV (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 12 Feb 2015 14:22:06 -0800 (PST) X-Barracuda-Envelope-From: brolley@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1CMM5l5024015 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 12 Feb 2015 17:22:05 -0500 Received: from [10.10.61.171] (vpn-61-171.rdu2.redhat.com [10.10.61.171]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1CMM4Ok001282 for ; Thu, 12 Feb 2015 17:22:05 -0500 Message-ID: <54DD27BD.60707@redhat.com> Date: Thu, 12 Feb 2015 17:22:53 -0500 From: Dave Brolley User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: PCP Mailing List Subject: pcp updates: kenj: containers fix, freebsd changes Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: kenj: containers fix, freebsd changes Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423779725 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Changes committed to git://git.pcp.io/pcp.git dev Ken McDonell (6): libpcp/secureconnect.c: fix compilation warning qa/031&574: freebsd variant of the dupnames output files qa/group: add a couple of tests to the containers group qa/160: rework for FreeBSD qa/common.check: make _cleanup_pmda() wait and check a bit more libpcp_pmda: fix for pmdaRootPDUContainer problem qa/031.out.freebsd | 2 +- qa/160 | 22 ++++++++++++++-------- qa/574.out.freebsd | 2 +- qa/common.check | 21 +++++++++++++++------ qa/group | 5 ++--- src/libpcp/src/secureconnect.c | 6 +++--- src/libpcp_pmda/src/pduroot.c | 19 +++++++++---------- src/libpcp_pmda/src/pduroot.h | 2 +- 8 files changed, 46 insertions(+), 33 deletions(-) From kenj@internode.on.net Thu Feb 12 16:42:45 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id D60817F54 for ; Thu, 12 Feb 2015 16:42:44 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 622DFAC008 for ; Thu, 12 Feb 2015 14:42:44 -0800 (PST) X-ASG-Debug-ID: 1423780961-04cbb011652607a0001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id yUvZktu6ccqg8Xxw for ; Thu, 12 Feb 2015 14:42:41 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AuIBABgr3VR20Zu9PGdsb2JhbAANToc0gyrAHYJPAoFmAQEBAQEBBQEBAQE4hEgBAQQjFUABEAsYAgIFFgsCAgkDAgECATEUBg0BBwEBxXBwlyYBAQEBAQEBAwEBAQEBAQEbgSGJa4RtB4JogUIBBKtcgiQcgWSDHgEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 13 Feb 2015 09:12:40 +1030 Message-ID: <54DD2C82.4020505@internode.on.net> Date: Fri, 13 Feb 2015 09:43:14 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Nathan Scott CC: PCP Subject: Re: [pcp] Rash of QA failures References: <54DD160D.7020704@internode.on.net> <626525689.5005370.1423779094084.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Rash of QA failures In-Reply-To: <626525689.5005370.1423779094084.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423780961 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15208 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 13/02/15 09:11, Nathan Scott wrote: > ... could you try revert commit d3895954cc6 Did that. Rebuilt libpcp. pmlc back in the land of the living. Unfortunately the bad code has leaked out across the QA farm, and some failures are distributed tests where the bad code could be on the SUT or the remote system. It will take a while to return to normal. I will push my revert back upstream to my tree later today to try and clean up the QA farm. I don't have time to triage the real cause of the problem I'm afraid. From nscott@redhat.com Thu Feb 12 16:54:37 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 685067F54 for ; Thu, 12 Feb 2015 16:54:37 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 552CD8F8035 for ; Thu, 12 Feb 2015 14:54:37 -0800 (PST) X-ASG-Debug-ID: 1423781675-04cb6c6b0b298bd0001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id FQSHNMdxusKaYYBH (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 12 Feb 2015 14:54:35 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1CMsVfD022076; Thu, 12 Feb 2015 17:54:31 -0500 Date: Thu, 12 Feb 2015 17:54:31 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: PCP Message-ID: <904423461.5027644.1423781671433.JavaMail.zimbra@redhat.com> In-Reply-To: <54DD2C82.4020505@internode.on.net> References: <54DD160D.7020704@internode.on.net> <626525689.5005370.1423779094084.JavaMail.zimbra@redhat.com> <54DD2C82.4020505@internode.on.net> Subject: Re: [pcp] Rash of QA failures MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Rash of QA failures Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Rash of QA failures Thread-Index: z8VNijNO+JmibjdieJsjed1jmaMUXQ== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1423781675 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15208 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > On 13/02/15 09:11, Nathan Scott wrote: > > ... could you try revert commit d3895954cc6 > > Did that. Rebuilt libpcp. pmlc back in the land of the living. OK, good to know - thanks! I'll take it from there. > Unfortunately the bad code has leaked out across the QA farm, and some > failures are distributed tests where the bad code could be on the SUT or > the remote system. > > It will take a while to return to normal. Sorry 'bout that. > I will push my revert back upstream to my tree later today to try and > clean up the QA farm. > > I don't have time to triage the real cause of the problem I'm afraid. No problem, I'll figure it out a root cause or revert it today. thanks. -- Nathan From fche@redhat.com Thu Feb 12 17:35:52 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id F34587F47 for ; Thu, 12 Feb 2015 17:35:51 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id D24918F8064 for ; Thu, 12 Feb 2015 15:35:48 -0800 (PST) X-ASG-Debug-ID: 1423784142-04bdf06a5a272050001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id l6HkQZHsVTEFOE48 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 12 Feb 2015 15:35:44 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1CNZgsO025430 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 12 Feb 2015 18:35:42 -0500 Received: from fche.csb (vpn-230-111.phx2.redhat.com [10.3.230.111]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1CNZgVT031771; Thu, 12 Feb 2015 18:35:42 -0500 Received: by fche.csb (Postfix, from userid 2569) id CFEAC580F2; Thu, 12 Feb 2015 18:35:36 -0500 (EST) Date: Thu, 12 Feb 2015 18:35:36 -0500 From: "Frank Ch. Eigler" To: Dave Brolley Cc: Nathan Scott , PCP Subject: Re: Possible QA issue in _valgrind_clean_assert Message-ID: <20150212233536.GC16895@redhat.com> X-ASG-Orig-Subj: Re: Possible QA issue in _valgrind_clean_assert References: <170098171.4053973.1423717266752.JavaMail.zimbra@redhat.com> <54DD2668.6020005@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <54DD2668.6020005@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423784144 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - brolley wrote: > Here are the results from running: sudo strace -o /tmp/666.strace.txt -f > sh ./check 666 > > 666 - output mismatch (see 666.out.bad) > 18a19,21 > > ==12100== could not unlink > /tmp/vgdb-pipe-from-vgdb-to-12100-by-root-on-brolley-t530 > [...] > Within the generated log, we find: > > 12100 > unlink("/tmp/vgdb-pipe-from-vgdb-to-12100-by-root-on-brolley-t530") = -1 > EPERM (Operation not permitted) > > and in the filesystem, we see: > > prw-------. 1 root root 0 Feb 12 17:03 > vgdb-pipe-to-vgdb-from-12100-by-root-on-brolley-t530 OK, this probably comes from some sort of setuid emulation side-effect in valgrind, triggered by kenj's "sudo ... pmmgr ..." change. The two don't seem to play well with each other. I'll poke at the test case tomorrow to see if the sudo can be removed or valgrind placated. - FChE From fche@redhat.com Thu Feb 12 18:11:33 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id DD38D7F56 for ; Thu, 12 Feb 2015 18:11:33 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id AE2878F8066 for ; Thu, 12 Feb 2015 16:11:30 -0800 (PST) X-ASG-Debug-ID: 1423786289-04bdf06a59272af0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 9t4J9BR3wcLWuJF0 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 12 Feb 2015 16:11:29 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1D0BSF2031859 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 12 Feb 2015 19:11:29 -0500 Received: from fche.csb (vpn-230-111.phx2.redhat.com [10.3.230.111]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1D0BSqk011010; Thu, 12 Feb 2015 19:11:28 -0500 Received: by fche.csb (Postfix, from userid 2569) id E5AC65810E; Thu, 12 Feb 2015 19:11:22 -0500 (EST) Date: Thu, 12 Feb 2015 19:11:22 -0500 From: "Frank Ch. Eigler" To: Dave Brolley Cc: Nathan Scott , PCP Subject: Re: Possible QA issue in _valgrind_clean_assert Message-ID: <20150213001122.GD16895@redhat.com> X-ASG-Orig-Subj: Re: Possible QA issue in _valgrind_clean_assert References: <170098171.4053973.1423717266752.JavaMail.zimbra@redhat.com> <54DD2668.6020005@redhat.com> <20150212233536.GC16895@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20150212233536.GC16895@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423786289 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - > [...] I'll poke at the test case tomorrow to see if the sudo can be > removed or valgrind placated. This seems to work on my machines; would folks please confirm on theirs? diff --git a/qa/common.check b/qa/common.check index f712203b4e87..2c2bf0c9dc76 100644 --- a/qa/common.check +++ b/qa/common.check @@ -835,7 +835,7 @@ if which valgrind >/dev/null 2>&1; then else __extra='' fi - _valgrind_clean_assert="valgrind -q --leak-check=full --read-var-info=yes \ + _valgrind_clean_assert="valgrind -q --vgdb=no --leak-check=full --read-var-info=yes \ --suppressions=$here/valgrind-suppress $__extra \ --log-fd=1" fi - FChE From fche@redhat.com Thu Feb 12 18:16:20 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id DBD287F56 for ; Thu, 12 Feb 2015 18:16:20 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id CA8E1304043 for ; Thu, 12 Feb 2015 16:16:17 -0800 (PST) X-ASG-Debug-ID: 1423786576-04cb6c6b0a29a540001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id VHhN21bfz5OBVM6T (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 12 Feb 2015 16:16:16 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1D0GBjj001194 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Thu, 12 Feb 2015 19:16:11 -0500 Received: from fche.csb (vpn-230-111.phx2.redhat.com [10.3.230.111]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1D0GA1e013625; Thu, 12 Feb 2015 19:16:11 -0500 Received: by fche.csb (Postfix, from userid 2569) id C502D5810E; Thu, 12 Feb 2015 19:16:05 -0500 (EST) To: Nathan Scott Cc: Ken McDonell , pcp@oss.sgi.com Subject: Re: pcp updates: coverity, qa, martins+fche merges References: <2011032309.4022727.1423715962317.JavaMail.zimbra@redhat.com> <54DC3C6D.4090005@internode.on.net> <900480755.4067256.1423720054914.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: pcp updates: coverity, qa, martins+fche merges From: fche@redhat.com (Frank Ch. Eigler) Date: Thu, 12 Feb 2015 19:16:05 -0500 In-Reply-To: <900480755.4067256.1423720054914.JavaMail.zimbra@redhat.com> (Nathan Scott's message of "Thu, 12 Feb 2015 00:47:34 -0500 (EST)") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423786576 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 > [...] >> 720 - valgrind detected errors >> Command: pminfo -h >> pcp://localhost?user=NOsuchUSER&pass=DEFINITELYnotApassword >> + 39 bytes in 1 blocks are definitely lost in loss record 14 of 38 >> + at 0x4C2A1D4: calloc (in >> /usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so) >> + by 0x4E86ADB: __pmAuthSecretCB (secureconnect.c:750) >> + by 0x5C2459A: _plug_get_password (in /usr/lib64/libsasl2.so.3.0.0) >> [...] > Not seeing that here; its a new test - looks like possibly a genuine > failure though & a bug still remaining in libpcp/sasl code? commit > 2ae6cd0a4ce may have exposed this reporting? Not sure, needs to be > investigated some more I think. See the text for the pcp commit; this was already analyzed and reported to cyrus-sasl as a memory leak (RHBZ1191183). - FChE From nscott@redhat.com Thu Feb 12 18:59:50 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id D77DD7F54 for ; Thu, 12 Feb 2015 18:59:50 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id C28258F8059 for ; Thu, 12 Feb 2015 16:59:50 -0800 (PST) X-ASG-Debug-ID: 1423789186-04cb6c6b0a29b280001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id jbX4YV6l5MkK8uTf (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 12 Feb 2015 16:59:47 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1D0xeXa043220; Thu, 12 Feb 2015 19:59:40 -0500 Date: Thu, 12 Feb 2015 19:59:39 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" , Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <1825151080.5082853.1423789179971.JavaMail.zimbra@redhat.com> In-Reply-To: References: <2011032309.4022727.1423715962317.JavaMail.zimbra@redhat.com> <54DC3C6D.4090005@internode.on.net> <900480755.4067256.1423720054914.JavaMail.zimbra@redhat.com> Subject: Re: pcp updates: coverity, qa, martins+fche merges MIME-Version: 1.0 X-ASG-Orig-Subj: Re: pcp updates: coverity, qa, martins+fche merges Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: coverity, qa, martins+fche merges Thread-Index: sFC70dPAKf20CovtHa7zXZDi1B4Ikw== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1423789187 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15213 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > > [...] > >> 720 - valgrind detected errors > >> Command: pminfo -h > >> pcp://localhost?user=NOsuchUSER&pass=DEFINITELYnotApassword > >> + 39 bytes in 1 blocks are definitely lost in loss record 14 of 38 > >> + at 0x4C2A1D4: calloc (in > >> /usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so) > >> + by 0x4E86ADB: __pmAuthSecretCB (secureconnect.c:750) > >> + by 0x5C2459A: _plug_get_password (in /usr/lib64/libsasl2.so.3.0.0) > >> [...] > > Not seeing that here; its a new test - looks like possibly a genuine > > failure though & a bug still remaining in libpcp/sasl code? commit > > 2ae6cd0a4ce may have exposed this reporting? Not sure, needs to be > > investigated some more I think. > > See the text for the pcp commit; this was already analyzed and > reported to cyrus-sasl as a memory leak (RHBZ1191183). > OK, sounds like the valgrind-suppress file needs to be further tweaked? -- Nathan From kenj@internode.on.net Thu Feb 12 19:54:04 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 816D47F55 for ; Thu, 12 Feb 2015 19:54:04 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 6AD6B304039 for ; Thu, 12 Feb 2015 17:54:01 -0800 (PST) X-ASG-Debug-ID: 1423792435-04cbb01162264000001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id dSglRF0jUP4QQuvQ for ; Thu, 12 Feb 2015 17:53:56 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AssKANpX3VR5LCppPGdsb2JhbABbgwaBLIIzg3nCaAQCAoElRAEBAQEBAQUBAQEBODuEDAEBAQQIAjAcIwwBAwIGAxUBKQcZIAoDEQIEARILBYgc1UMBAQEBBgEBAQEBHYsMhG0HhCoFjUKBZ1WJdoMGhiqIOIQkKjGCQwEBAQ Received: from ppp121-44-42-105.lns20.syd4.internode.on.net (HELO bozohorize) ([121.44.42.105]) by ipmail06.adl6.internode.on.net with ESMTP; 13 Feb 2015 12:23:54 +1030 From: "Ken McDonell" To: "'Frank Ch. Eigler'" , "'Dave Brolley'" Cc: "'PCP'" References: <170098171.4053973.1423717266752.JavaMail.zimbra@redhat.com> <54DD2668.6020005@redhat.com> <20150212233536.GC16895@redhat.com> <20150213001122.GD16895@redhat.com> In-Reply-To: <20150213001122.GD16895@redhat.com> Subject: RE: [pcp] Possible QA issue in _valgrind_clean_assert Date: Fri, 13 Feb 2015 12:53:46 +1100 X-ASG-Orig-Subj: RE: [pcp] Possible QA issue in _valgrind_clean_assert Message-ID: <049c01d0472f$e9e972d0$bdbc5870$@internode.on.net> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQFwFpftGHOdy4cWhnIL82teAYDEcgI1MOEDARj9wLsBGjav052K6Ihw Content-Language: en-au X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423792435 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15216 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header > -----Original Message----- > From: pcp-bounces@oss.sgi.com [mailto:pcp-bounces@oss.sgi.com] On > Behalf Of Frank Ch. Eigler > Sent: Friday, 13 February 2015 11:11 AM > ... > This seems to work on my machines; would folks please confirm on theirs? Works for me for a sample of 1 out of 1 hosts. I'll commit to my git repo so that I can get wider QA exposure over the coming days. Thanks Frank. From kenj@internode.on.net Thu Feb 12 21:32:06 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id BADE87F55 for ; Thu, 12 Feb 2015 21:32:06 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 974518F8059 for ; Thu, 12 Feb 2015 19:32:06 -0800 (PST) X-ASG-Debug-ID: 1423798323-04cbb011622658f0001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id 3FavP5VOZy8MbH6i for ; Thu, 12 Feb 2015 19:32:03 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AtUBAMVv3VR20Zu9PGdsb2JhbAANToc0gyrAM4JPAoFpAQEBAQEBBQEBAQE4hEgBAQQjFUABEAsYAgIFFgsCAgkDAgECATEUBgEMAQcBAcRecJdeAQEBAQEBAQEBAQEBAQEBAQEBGoEhiWuEbQeCaIFCAQSrXIQkgx4BAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 13 Feb 2015 14:01:39 +1030 Message-ID: <54DD703D.2000004@internode.on.net> Date: Fri, 13 Feb 2015 14:32:13 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Nathan Scott , "Frank Ch. Eigler" CC: pcp@oss.sgi.com Subject: Re: pcp updates: coverity, qa, martins+fche merges References: <2011032309.4022727.1423715962317.JavaMail.zimbra@redhat.com> <54DC3C6D.4090005@internode.on.net> <900480755.4067256.1423720054914.JavaMail.zimbra@redhat.com> <1825151080.5082853.1423789179971.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: pcp updates: coverity, qa, martins+fche merges In-Reply-To: <1825151080.5082853.1423789179971.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423798323 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15219 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 13/02/15 11:59, Nathan Scott wrote: > ... > OK, sounds like the valgrind-suppress file needs to be further tweaked? Already on my TODO list for this afternoon. From kenj@internode.on.net Thu Feb 12 21:53:22 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 8E7757F55 for ; Thu, 12 Feb 2015 21:53:22 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 6B4C6304032 for ; Thu, 12 Feb 2015 19:53:22 -0800 (PST) X-ASG-Debug-ID: 1423799599-04cb6c6b0a29e4f0001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id Dd4lirXF41vHJMzD for ; Thu, 12 Feb 2015 19:53:19 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: As8BAEJ03VR20Zu9PGdsb2JhbAANTopewDOCTwKBaQEBAQEBAQUBAQEBOIRIAQEEeBELGAkWDwkDAgECATEUEwgBAcRamE8BAQgCAR+LDIQ6OhaEFAEEq1yEJIMeAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 13 Feb 2015 14:23:18 +1030 Message-ID: <54DD7551.2080309@internode.on.net> Date: Fri, 13 Feb 2015 14:53:53 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] pcp updates: coverity, qa, martins+fche merges References: <2011032309.4022727.1423715962317.JavaMail.zimbra@redhat.com> <54DC3C6D.4090005@internode.on.net> <900480755.4067256.1423720054914.JavaMail.zimbra@redhat.com> <1825151080.5082853.1423789179971.JavaMail.zimbra@redhat.com> <54DD703D.2000004@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] pcp updates: coverity, qa, martins+fche merges In-Reply-To: <54DD703D.2000004@internode.on.net> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423799599 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15219 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 13/02/15 14:32, Ken McDonell wrote: > On 13/02/15 11:59, Nathan Scott wrote: >> ... >> OK, sounds like the valgrind-suppress file needs to be further tweaked? > > Already on my TODO list for this afternoon. > Frank had already updated valgrind-suppress, but the call path needed to be expanded a little due to some inlining (different number of levels in the call path) and missing symbols. I've got it passing on the machine where it was failing and passing the valgrind part on another machine, but I'm now seeing this failure on the second machine (Ubuntu). kenj@bozo:~/src/pcp/qa$ diff -u 720.out* --- 720.out 2015-02-12 16:08:33.429799316 +1100 +++ 720.out.bad 2015-02-13 14:47:55.624031127 +1100 @@ -98,7 +98,7 @@ ERROR SUMMARY: 0 errors from 0 contexts ... === std out === === std err === -pminfo: Cannot connect to PMCD on host "pcp://localhost?user=NOsuchUSER&pass=DEFINITELYnotApassword": Authentication - authentication failure +Error: Authentication - user not found === filtered valgrind report === Memcheck, a memory error detector Command: pminfo -h pcp://localhost?user=NOsuchUSER&pass=DEFINITELYnotApassword I have no idea if this test expects something to be set up that I'm missing, or if these are mutually acceptable outputs that need to be somehow accommodated in the filtering ... over to someone who knows. From nscott@redhat.com Fri Feb 13 00:57:35 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id C45F97F5E for ; Fri, 13 Feb 2015 00:57:35 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id A4C428F8066 for ; Thu, 12 Feb 2015 22:57:35 -0800 (PST) X-ASG-Debug-ID: 1423810649-04cbb0116227b710001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id 0NtjdkAP7xbTzEzT (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 12 Feb 2015 22:57:30 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1D6vT0A009234 for ; Fri, 13 Feb 2015 01:57:29 -0500 Date: Fri, 13 Feb 2015 01:57:29 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: PCP Message-ID: <812008937.5201770.1423810649762.JavaMail.zimbra@redhat.com> In-Reply-To: <1427583130.5197293.1423809110757.JavaMail.zimbra@redhat.com> Subject: pcp updates: /proc/cpuinfo fix, qa MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: /proc/cpuinfo fix, qa Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: /proc/cpuinfo fix, qa Thread-Index: kbGxARNI0Kfbh+asSOEDDS8wP7G/tQ== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1423810650 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15226 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Nathan Scott (2): Partially revert "libpcp: coverity-detected leak, return code and null check fixes" pmdalinux: improve /proc/cpuinfo parser for irregular formats qa/885.out | 89 ++++++++++++++++++++++++++++++----------- src/libpcp/src/auxserver.c | 9 ---- src/libpcp/src/logportmap.c | 6 -- src/libpcp/src/spec.c | 2 src/pmdas/linux/proc_cpuinfo.c | 57 ++++++++++++++------------ src/pmdas/linux/proc_cpuinfo.h | 6 -- 6 files changed, 102 insertions(+), 67 deletions(-) From kenj@internode.on.net Fri Feb 13 03:04:44 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 3290B7F55 for ; Fri, 13 Feb 2015 03:04:44 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id B5943AC006 for ; Fri, 13 Feb 2015 01:04:40 -0800 (PST) X-ASG-Debug-ID: 1423818274-04cb6c6b0b2b6a20001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id PMw7vl7K839HbQP3 for ; Fri, 13 Feb 2015 01:04:34 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AuwBAHe93VR20Zu9PGdsb2JhbAANToNYWoMCgyq9KIdRAQEBAQEBBQEBAQE4hHEVQDAGAgUWCwILAwIBAgExDhkGAgEBxGtwl36BIY51glKBQgWSf5hdhCRbgkMBAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 13 Feb 2015 19:34:33 +1030 Message-ID: <54DDBE44.8040307@internode.on.net> Date: Fri, 13 Feb 2015 20:05:08 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423818274 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15229 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (3): qa/083: really don't need sleep 300 after failure! qa/common.check: --vgdb=no fix from Frank qa/666: be more patient ... qa/083 | 1 - qa/666 | 8 ++++---- qa/common.check | 3 ++- 3 files changed, 6 insertions(+), 6 deletions(-) Details ... commit 79099487376dad3c91eb8e3dd12674b0648558bc Author: Ken McDonell Date: Fri Feb 13 13:11:36 2015 +1100 qa/666: be more patient ... On at least one QA machine (bozo-vm), I have observed delays between pmcd restart and the pmlogger and pmie processes getting started of typically 24 seconds, but outliers of 33, 42 and 45 seconds. Increase the maximum time we're willing to wait from 40ish (was already up from Frank's original 30ish IIRC), to 60ish seconds and try every 3 seconds. commit 9c41d59de4c4a6b3acfeb88f39d16cb2f8b5d91f Author: Ken McDonell Date: Fri Feb 13 13:05:00 2015 +1100 qa/common.check: --vgdb=no fix from Frank commit 2381bfa263a1d8f8038e41c87018e5024c22f40b Author: Ken McDonell Date: Fri Feb 13 12:59:11 2015 +1100 qa/083: really don't need sleep 300 after failure! From kenj@internode.on.net Fri Feb 13 03:30:23 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 1378C7F55 for ; Fri, 13 Feb 2015 03:30:23 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id C6EC58F8050 for ; Fri, 13 Feb 2015 01:30:19 -0800 (PST) X-ASG-Debug-ID: 1423819816-04bdf06a59290570001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id hlNfMHeEZo9RnUxy for ; Fri, 13 Feb 2015 01:30:16 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AusBAEHD3VR20Zu9PGdsb2JhbAANToNYWoMCgyq9KIdSAQEBAQEBBQEBAQE4hHGBBQYCBSECEQIyJwYCAQHEVXCXfIEhjgcBAYM+gUIFhVaHbIU9hnWOKoM+hCRbgQuBOAEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 13 Feb 2015 20:00:15 +1030 Message-ID: <54DDC44B.608@internode.on.net> Date: Fri, 13 Feb 2015 20:30:51 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - getting back in sync Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - getting back in sync Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1423819816 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15231 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- This is getting pretty messy ... we're doing a revert dance. These changes applied to my git repo make mine the same as the "official" one plus the valgrind-suppress and pcp-push changes. Nathan/Dave, it is probably going to need some conflict mangling at your end, and then I'll have to do some at my end when you commits come back down. Sigh. Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (3): Revert "Revert "libpcp: coverity-detected leak return code and null check fixes"" qa/valgrind-suppress: rework Frank's supressions for RHBZ1191183 scripts/pcp-push: make take mail more verbose by default Nathan Scott (3): qa: fix memcached output for bytes_read filtering Revert "libpcp: coverity-detected leak, return code and null check fixes" pmdalinux: improve /proc/cpuinfo parser for irregular formats qa/835.out | 1 qa/885.out | 89 ++++++++++++++++++++++++++++++----------- qa/valgrind-suppress | 19 ++++++-- scripts/pcp-push | 15 ++++++ src/libpcp/src/auxconnect.c | 8 ++- src/libpcp/src/auxserver.c | 20 ++++----- src/libpcp/src/getopt.c | 6 ++ src/libpcp/src/logportmap.c | 12 ++--- src/libpcp/src/spec.c | 6 +- src/pmdas/linux/proc_cpuinfo.c | 57 ++++++++++++++------------ src/pmdas/linux/proc_cpuinfo.h | 6 -- 11 files changed, 157 insertions(+), 82 deletions(-) Details ... commit 7ee069391db5d687a80524417c81d452adab1ae7 Author: Ken McDonell Date: Fri Feb 13 20:24:46 2015 +1100 scripts/pcp-push: make take mail more verbose by default Old behaviour is with -s (new option). New default behaviour is to include commit logs with details of changes, not just one-line summaries and diffstats. commit 5b0faa31bd98663d65e3a003600954921e3af808 Author: Ken McDonell Date: Fri Feb 13 20:23:48 2015 +1100 qa/valgrind-suppress: rework Frank's supressions for RHBZ1191183 commit a6d6856792319a77811b8271211a718643d147be Author: Ken McDonell Date: Fri Feb 13 20:14:56 2015 +1100 Revert "Revert "libpcp: coverity-detected leak, return code and null check fixes"" This reverts commit f1b793328b3eb134157091a2260ab7cfab28135a. Trying to get back in sync with Nathan's changes. commit 05c9881334c74f8b1e9899e40b144ad0ad39778e Author: Nathan Scott Date: Fri Feb 13 17:30:23 2015 +1100 pmdalinux: improve /proc/cpuinfo parser for irregular formats For a long time the architectures with /proc/cpuinfo forms that have global CPU information either before/after the individual "processor:" lines have been problematic. The last wrinkle was on s390 where the global info precedes these lines (previously we'd only seen archs with processor lines at the files head). Rework things so that global information is saved on-stack in the same way for all platforms (removing Alpha cpp conditional code, and improving detection on Alpha at the same time - as can be seen in qa/885). The test 885 expected output has been updated to include the new s390x output, which previously was causing a sigsegv. commit 476df6bde7b5288786e8d996bf49fc70dcc8feaa Author: Nathan Scott Date: Fri Feb 13 17:24:34 2015 +1100 Revert "libpcp: coverity-detected leak, return code and null check fixes" This reverts commit d3895954cc63aa59ed84aec6b98becfeaf0c230c. (problematic parts reworked and/or removed). commit c18339170270b0677df47281ed84a552a4445b8b Author: Nathan Scott Date: Thu Feb 12 20:03:57 2015 +1100 qa: fix memcached output for bytes_read filtering From scox@redhat.com Fri Feb 13 11:35:43 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 48CF17F66 for ; Fri, 13 Feb 2015 11:35:43 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 221E9304043 for ; Fri, 13 Feb 2015 09:35:40 -0800 (PST) X-ASG-Debug-ID: 1423848938-04bdf06a5c29e180001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 24c4qX2peFBUUyiF (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 13 Feb 2015 09:35:39 -0800 (PST) X-Barracuda-Envelope-From: scox@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1DHZcUj006240 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Fri, 13 Feb 2015 12:35:38 -0500 Received: from [10.13.129.6] (dhcp129-6.rdu.redhat.com [10.13.129.6]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1DHZc5Z016210 for ; Fri, 13 Feb 2015 12:35:38 -0500 Message-ID: <54DE35EA.2030509@redhat.com> Date: Fri, 13 Feb 2015 12:35:38 -0500 From: Stan Cox User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp Subject: datetime 'next TODAY' Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: datetime 'next TODAY' Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423848939 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 The datetime support for the -S/-T options was not supporting 'next TODAY' properly. The desired behavior is one week from today. This patch fixes that and adds a bit more testing. git://sourceware.org/git/pcpfans.git scox/dev b47af16c219f78d96f3962e61d022ca9006ad3a8 Stan Cox (1): Match current parse-datetime.y behavior for 'next *TODAY*' From brolley@redhat.com Fri Feb 13 11:40:36 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 1D3467F66 for ; Fri, 13 Feb 2015 11:40:36 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 0961F8F8059 for ; Fri, 13 Feb 2015 09:40:35 -0800 (PST) X-ASG-Debug-ID: 1423849234-04cb6c6b092c3fe0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id gPbAJIUF1KD5wKGz (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 13 Feb 2015 09:40:35 -0800 (PST) X-Barracuda-Envelope-From: brolley@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1DHeY6n005101 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Fri, 13 Feb 2015 12:40:34 -0500 Received: from [10.10.62.56] (vpn-62-56.rdu2.redhat.com [10.10.62.56]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1DHeXWc021736 for ; Fri, 13 Feb 2015 12:40:34 -0500 Message-ID: <54DE3744.1050308@redhat.com> Date: Fri, 13 Feb 2015 12:41:24 -0500 From: Dave Brolley User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: PCP Mailing List Subject: pcp updates: kenj qa + rsync Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: kenj qa + rsync Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423849235 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 These changes also pick up fche's valgrind fix for qa test 666 via ken's branch. I should also really learn to type after all these years (see below) ---------------------------------------------------------------------------------- Changes committed to git://git.pcp.io/pcp.git dev Ken McDonell (6): qa/083: really don't need sleep 300 after failure! qa/common.check: --vgdb=no fix from Frank qa/666: be more patient ... Revert "Revert "libpcp: coverity-detected leak, return code and null check fixes"" qa/valgrind-suppress: rework Frank's supressions for RHBZ1191183 scripts/pcp-push: make take mail more verbose by default Nathan Scott (3): qa: fix memcached output for bytes_read filtering Revert "libpcp: coverity-detected leak, return code and null check fixes" pmdalinux: improve /proc/cpuinfo parser for irregular formats Dave Brolley (1): Fix uninitizlied field in src/pmdas/linux/getinfo.c:get_distro_info() qa/083 | 1 qa/666 | 8 +-- qa/835.out | 1 qa/885.out | 89 ++++++++++++++++++++++++++++++----------- qa/common.check | 3 - qa/valgrind-suppress | 19 ++++++-- scripts/pcp-push | 15 ++++++ src/libpcp/src/auxconnect.c | 8 ++- src/libpcp/src/auxserver.c | 20 ++++----- src/libpcp/src/getopt.c | 6 ++ src/libpcp/src/logportmap.c | 12 ++--- src/libpcp/src/spec.c | 6 +- src/pmdas/linux/getinfo.c | 6 +- src/pmdas/linux/proc_cpuinfo.c | 57 ++++++++++++++------------ src/pmdas/linux/proc_cpuinfo.h | 6 -- 15 files changed, 167 insertions(+), 90 deletions(-) From minnus@buffalo.edu Fri Feb 13 13:34:00 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 5C6327F6A for ; Fri, 13 Feb 2015 13:34:00 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id DE8D9AC002 for ; Fri, 13 Feb 2015 11:33:56 -0800 (PST) X-ASG-Debug-ID: 1423856034-04cbb01162291a80001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve8.acsu.buffalo.edu [128.205.6.19]) by cuda.sgi.com with ESMTP id 0bRhzBFPScMk7MSX for ; Fri, 13 Feb 2015 11:33:54 -0800 (PST) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.6.19 Received: from localmailC.acsu.buffalo.edu (localmailc.acsu.buffalo.edu [128.205.5.204]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id E9406EE2 for ; Fri, 13 Feb 2015 14:33:53 -0500 (EST) Received: from localmailC.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id E51CA104D1 for ; Fri, 13 Feb 2015 14:33:53 -0500 (EST) Received: from localmailC.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailC.acsu.buffalo.edu (Postfix) with ESMTP id 4F05E104CB for ; Fri, 13 Feb 2015 14:33:53 -0500 (EST) Received: from smtp.buffalo.edu (smtp1.acsu.buffalo.edu [128.205.5.253]) by localmailC.acsu.buffalo.edu (Prefixe) with ESMTP id 411C5104CA for ; Fri, 13 Feb 2015 14:33:53 -0500 (EST) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 2DFC132A9 for ; Fri, 13 Feb 2015 14:33:53 -0500 (EST) Message-ID: <54DE51A0.7070905@buffalo.edu> Date: Fri, 13 Feb 2015 14:33:52 -0500 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: PCP Mailing List Subject: Python pmda instances Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: Python pmda instances Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve8.acsu.buffalo.edu[128.205.6.19] X-Barracuda-Start-Time: 1423856034 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15252 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi, I am trying to write a python PMDA (since the thing i am trying to monitor only has python and not perl bindings) and am running into an implementation problem, likely due to my python knowledge. In perl you can do (simplified): our %h = (); $h{$nfsinst} = {}; $h{$nfsinst}->{'nfsclient.export'} = $export; $h{$nfsinst}->{'nfsclient.mountpoint'} = $mtpt; ....... $pmda->replace_indom($nfsclient_indom, \%h); ....... my $lookup = pmda_inst_lookup($nfsclient_indom, $inst); Basically to have a hash of hashes with all the information for the instances stored in the cache and this works as it seems to be intended. But in python when I do what I think is the equivalent thing: self.cards = {} self.cards[device] = {} self.cards[device]['numcores'] = mic.mic_get_cores_count() self.replace_indom(self.card_indom, self.cards) I get the following: File "pmdamic.py", line 42, in update_mic self.replace_indom(self.card_indom, self.cards) File "/usr/lib64/python2.6/site-packages/pcp/pmda.py", line 218, in replace_indom replacement = pmdaIndom(indom, insts) File "/usr/lib64/python2.6/site-packages/pcp/pmda.py", line 105, in __init__ self.set_instances(indom, insts) File "/usr/lib64/python2.6/site-packages/pcp/pmda.py", line 128, in set_instances self.set_dict_instances(indom, insts) File "/usr/lib64/python2.6/site-packages/pcp/pmda.py", line 120, in set_dict_instances LIBPCP_PMDA.pmdaCacheStore(indom, cpmda.PMDA_CACHE_ADD, key, byref(insts[key])) TypeError: byref() argument must be a ctypes instance, not 'dict' I can work around this by just storing an index instead, but I don't know enough about python to know if there is a way to make that cast work. Thanks Martins From brolley@redhat.com Fri Feb 13 13:51:01 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 73C967F6A for ; Fri, 13 Feb 2015 13:51:01 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 20AC2AC005 for ; Fri, 13 Feb 2015 11:51:00 -0800 (PST) X-ASG-Debug-ID: 1423857056-04bdf06a5b2a1f40001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id fUMASTIlg1Pmz071 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 13 Feb 2015 11:50:56 -0800 (PST) X-Barracuda-Envelope-From: brolley@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1DJouHt015339 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Fri, 13 Feb 2015 14:50:56 -0500 Received: from [10.10.62.56] (vpn-62-56.rdu2.redhat.com [10.10.62.56]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1DJot7M024472 for ; Fri, 13 Feb 2015 14:50:56 -0500 Message-ID: <54DE55D2.7080508@redhat.com> Date: Fri, 13 Feb 2015 14:51:46 -0500 From: Dave Brolley User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: PCP Mailing List Subject: pcp updates: scox: qa 752 (next TODAY) Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: scox: qa 752 (next TODAY) Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423857056 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Changes committed to git://git.pcp.io/pcp.git dev Stan Cox (1): Match current parse-datetime.y behavior for 'next *TODAY*' qa/752 | 19 ++++++++++++++++--- qa/752.out | 28 +++++++++++++++++++++++----- qa/src/rtimetest.c | 12 +++++++++--- src/libpcp/src/getdate.y | 4 ++-- 4 files changed, 50 insertions(+), 13 deletions(-) From kenj@internode.on.net Fri Feb 13 14:09:58 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 752A17F6C for ; Fri, 13 Feb 2015 14:09:58 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 4F19A8F8052 for ; Fri, 13 Feb 2015 12:09:54 -0800 (PST) X-ASG-Debug-ID: 1423858191-04bdf06a5c2a25f0001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id aXtq48eHdSb1tVsx for ; Fri, 13 Feb 2015 12:09:52 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AtUBAMFY3lR20Zu9PGdsb2JhbAANToNYWoYsu32FeQKBVwEBAQEBAQUBAQEBOIRIAQEEOEARCxgJFg8JAwIBAgExFBMIAQHFT5d7AQEIAgEfiwyEdBaEFAEEjUmFQYcvkTWEJFuCQwEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail04.adl6.internode.on.net with ESMTP; 14 Feb 2015 06:39:51 +1030 Message-ID: <54DE5A33.4040008@internode.on.net> Date: Sat, 14 Feb 2015 07:10:27 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] datetime 'next TODAY' References: <54DE35EA.2030509@redhat.com> X-ASG-Orig-Subj: Re: [pcp] datetime 'next TODAY' In-Reply-To: <54DE35EA.2030509@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1423858191 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15253 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 14/02/15 04:35, Stan Cox wrote: > The datetime support for the -S/-T options was not supporting 'next > TODAY' properly. The desired behavior is one week from today. This > patch fixes that and adds a bit more testing. > > git://sourceware.org/git/pcpfans.git > scox/dev b47af16c219f78d96f3962e61d022ca9006ad3a8 > Stan Cox (1): Match current parse-datetime.y behavior for 'next *TODAY*' Thanks so much Stan. This has been a long-running intermittent QA failure. I've cherry-picked you commit and tested, looks good. I've also extended the test to cover every day of the week so we should see either always pass or always fail. Both commits will flow upstream in my next push. From wwwrun@oss.sgi.com Sat Feb 14 14:22:30 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id F00577F6F; Sat, 14 Feb 2015 14:22:30 -0600 (CST) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1104] New: signal delivery may lead to deadlock Date: Sat, 14 Feb 2015 20:22:30 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: kenj@internode.on.net X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter cc classification Message-ID: Content-Type: multipart/alternative; boundary="1423945350.121756fD2.5482"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1423945350.121756fD2.5482 Date: Sat, 14 Feb 2015 14:22:30 -0600 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1104 Bug ID: 1104 Summary: signal delivery may lead to deadlock Product: pcp Version: unspecified Hardware: All OS: Linux Status: NEW Severity: normal Priority: P5 Component: pcp Assignee: pcp@kenj.com.au Reporter: kenj@internode.on.net CC: pcp@oss.sgi.com Classification: Unclassified Observed when QA 134 hung with pmlc never exiting ... because pmlogger is blocked and not responding ... (gdb) where #0 0x004d8416 in __kernel_vsyscall () #1 0x00956e02 in __lll_lock_wait () from /lib/libpthread.so.0 #2 0x00952933 in _L_lock_654 () from /lib/libpthread.so.0 #3 0x00952814 in pthread_mutex_lock () from /lib/libpthread.so.0 #4 0x0047f8dc in __pmInitLocks () at lock.c:59 #5 0x00442594 in pmWhichContext () at context.c:236 #6 0x00451f90 in pmAddProfile (indom=indom@entry=4294967295, instlist_len=instlist_len@entry=0, instlist=instlist@entry=0x0) at profile.c:205 #7 0x009a63ba in log_callback (afid=32772, data=0x22687b48) at callback.c:471 #8 0x0046d504 in onalarm (dummy=14) at AF.c:272 #9 #10 0x00953521 in __pthread_mutex_unlock_usercnt () from /lib/libpthread.so.0 #11 0x0047f8f2 in __pmInitLocks () at lock.c:98 #12 0x0046dc10 in __pmAFblock () at AF.c:468 #13 0x009a3498 in main (argc=7, argv=0xbfd0f664) at pmlogger.c:904 So we're in __pmInitLocks() releasing the local mutex that protects the "one trip" guard (done) and pmlogger's timer goes off and we notice an indom change so try to adjust the fetch profile via pmAddProfile (it does not really matter how we entry libpcp at this point, so in this case it is pmAddProfile(), but __pmInitLocks() is called from all over the place). I think the impact of this is relatively low because outside pmlogger and pmie we don't asynchronous signals in contexts like the failing one. The fix is probably in pmlogger where our log_callback() is called in a signal handler context and clearly violates the guidance here http://www.opengroup.org/onlinepubs/007904975/functions/xsh_chap02_04.html#tag_02_04_04 Frank has alluded to this in the past, see http://oss.sgi.com/bugzilla/show_bug.cgi?id=1069, so I guess it is time to go fix it, at least in this case. pmlc is NOT the problem but for completeness here is the pmlc traceback when it is hung #0 0x00f3b416 in __kernel_vsyscall () #1 0x4f44ea81 in recv () from /lib/libc.so.6 #2 0x00cb4d60 in recv (__flags=0, __n=12, __buf=0x8e77000, __fd=3) at /usr/include/bits/socket2.h:45 #3 __pmRecv (fd=fd@entry=3, buffer=buffer@entry=0x8e77000, length=length@entry=12, flags=flags@entry=0) at secureconnect.c:1555 #4 0x00c7265c in pduread (fd=fd@entry=3, buf=buf@entry=0x8e77000 "", len=, len@entry=12, part=part@entry=-1, timeout=timeout@entry=0) at pdu.c:198 #5 0x00c73022 in __pmGetPDU (fd=fd@entry=3, mode=mode@entry=0, timeout=0, result=result@entry=0xbfd1fd00) at pdu.c:379 #6 0x00c9d6c7 in __pmConnectLogger (connectionSpec=, pid=0x80542e4, port=0x80542e0) at logconnect.c:391 #7 0x0804bca8 in ConnectLogger () #8 0x08049a9b in main () All of this on vm11 (i686 Debian 6.0.9) running PCP 3.10.3 although the problem is not platform specific -- You are receiving this mail because: You are on the CC list for the bug. --1423945350.121756fD2.5482 Date: Sat, 14 Feb 2015 14:22:30 -0600 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8"
Bug ID 1104
Summary signal delivery may lead to deadlock
Product pcp
Version unspecified
Hardware All
OS Linux
Status NEW
Severity normal
Priority P5
Component pcp
Assignee pcp@kenj.com.au
Reporter kenj@internode.on.net
CC pcp@oss.sgi.com
Classification Unclassified

Observed when QA 134 hung with pmlc never exiting ... because pmlogger is
blocked and not responding ...

(gdb) where
#0  0x004d8416 in __kernel_vsyscall ()
#1  0x00956e02 in __lll_lock_wait () from /lib/libpthread.so.0
#2  0x00952933 in _L_lock_654 () from /lib/libpthread.so.0
#3  0x00952814 in pthread_mutex_lock () from /lib/libpthread.so.0
#4  0x0047f8dc in __pmInitLocks () at lock.c:59
#5  0x00442594 in pmWhichContext () at context.c:236
#6  0x00451f90 in pmAddProfile (indom=indom@entry=4294967295, 
    instlist_len=instlist_len@entry=0, instlist=instlist@entry=0x0)
    at profile.c:205
#7  0x009a63ba in log_callback (afid=32772, data=0x22687b48) at callback.c:471
#8  0x0046d504 in onalarm (dummy=14) at AF.c:272
#9  <signal handler called>
#10 0x00953521 in __pthread_mutex_unlock_usercnt () from /lib/libpthread.so.0
#11 0x0047f8f2 in __pmInitLocks () at lock.c:98
#12 0x0046dc10 in __pmAFblock () at AF.c:468
#13 0x009a3498 in main (argc=7, argv=0xbfd0f664) at pmlogger.c:904

So we're in __pmInitLocks() releasing the local mutex that protects the "one
trip" guard (done) and pmlogger's timer goes off and we notice an indom change
so try to adjust the fetch profile via pmAddProfile (it does not really matter
how we entry libpcp at this point, so in this case it is pmAddProfile(), but
__pmInitLocks() is called from all over the place).

I think the impact of this is relatively low because outside pmlogger and pmie
we don't asynchronous signals in contexts like the failing one.

The fix is probably in pmlogger where our log_callback() is called in a signal
handler context and clearly violates the guidance here
http://www.opengroup.org/onlinepubs/007904975/functions/xsh_chap02_04.html#tag_02_04_04

Frank has alluded to this in the past, see
http://oss.sgi.com/bugzilla/show_bug.cgi?id=1069, so I guess it is time to go
fix it, at least in this case.

pmlc is NOT the problem but for completeness here is the pmlc traceback when it
is hung
#0  0x00f3b416 in __kernel_vsyscall ()
#1  0x4f44ea81 in recv () from /lib/libc.so.6
#2  0x00cb4d60 in recv (__flags=0, __n=12, __buf=0x8e77000, __fd=3)
    at /usr/include/bits/socket2.h:45
#3  __pmRecv (fd=fd@entry=3, buffer=buffer@entry=0x8e77000, 
    length=length@entry=12, flags=flags@entry=0) at secureconnect.c:1555
#4  0x00c7265c in pduread (fd=fd@entry=3, buf=buf@entry=0x8e77000 "", 
    len=<optimized out>, len@entry=12, part=part@entry=-1, 
    timeout=timeout@entry=0) at pdu.c:198
#5  0x00c73022 in __pmGetPDU (fd=fd@entry=3, mode=mode@entry=0, timeout=0, 
    result=result@entry=0xbfd1fd00) at pdu.c:379
#6  0x00c9d6c7 in __pmConnectLogger (connectionSpec=<optimized out>, 
    pid=0x80542e4, port=0x80542e0) at logconnect.c:391
#7  0x0804bca8 in ConnectLogger ()
#8  0x08049a9b in main ()

All of this on vm11 (i686 Debian 6.0.9) running PCP 3.10.3 although the problem
is not platform specific


You are receiving this mail because:
  • You are on the CC list for the bug.
--1423945350.121756fD2.5482-- From fche@redhat.com Sat Feb 14 19:28:40 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id C96DE7F6C for ; Sat, 14 Feb 2015 19:28:40 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id B7A11304039 for ; Sat, 14 Feb 2015 17:28:37 -0800 (PST) X-ASG-Debug-ID: 1423963709-04cb6c6b09309ee0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id Rqo1YpsYmhlHcL9k (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO); Sat, 14 Feb 2015 17:28:30 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1F1STq9026974 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Sat, 14 Feb 2015 20:28:29 -0500 Received: from fche.csb (vpn-232-103.phx2.redhat.com [10.3.232.103]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1F1SSFj009659; Sat, 14 Feb 2015 20:28:28 -0500 Received: by fche.csb (Postfix, from userid 2569) id ED155581BA; Sat, 14 Feb 2015 20:28:15 -0500 (EST) To: bugzilla-daemon@oss.sgi.com Cc: pcp@oss.sgi.com Subject: Re: [Bug 1104] New: signal delivery may lead to deadlock References: X-ASG-Orig-Subj: Re: [Bug 1104] New: signal delivery may lead to deadlock From: fche@redhat.com (Frank Ch. Eigler) Date: Sat, 14 Feb 2015 20:28:15 -0500 In-Reply-To: (bugzilla-daemon@oss.sgi.com's message of "Sat, 14 Feb 2015 20:22:30 +0000") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1423963709 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 bugzilla-daemon@oss.sgi.com writes: > [...] Frank has alluded to this in the past, see > http://oss.sgi.com/bugzilla/show_bug.cgi?id=1069, so I guess it is > time to go fix it, at least in this case. [...] Yeah, it's a textbook example. I was thinking at one point that the AF* functionality could be recast as something occurring synchronously rather than asynchronously. For example, we could define redefine the __pmAF* functions so that callbacks occur only as/after libpcp functions are about to return to the application. (A new __pmAFwait() could serve pmlogger's non-busy-looping.) Such an implementation of AF* could still rely on signals internally, but they'd just set a global flag for the deferred callback, and would thus be safe. - FChE From kenj@internode.on.net Sun Feb 15 03:47:21 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 3914D7F69 for ; Sun, 15 Feb 2015 03:47:21 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id CA1D4AC001 for ; Sun, 15 Feb 2015 01:47:17 -0800 (PST) X-ASG-Debug-ID: 1423993630-04bdf06a593423d0001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id zeRvAMq7QIkNgskY for ; Sun, 15 Feb 2015 01:47:10 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: Av0BAIZq4FR20Zu9PGdsb2JhbAANToNYWoYtvAaFeQKBUAEBAQEBAQUBAQEBOIRIAQEEeBELGAkWDwkDAgECATEUEwgBAb9xlz8BAQgCAR+LDIR0FoQUAQSTD4Z4OIp2hkeEJFuCQwEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail04.adl6.internode.on.net with ESMTP; 15 Feb 2015 20:17:09 +1030 Message-ID: <54E06B44.9030401@internode.on.net> Date: Sun, 15 Feb 2015 20:47:48 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] datetime 'next TODAY' References: <54DE35EA.2030509@redhat.com> X-ASG-Orig-Subj: Re: [pcp] datetime 'next TODAY' In-Reply-To: <54DE35EA.2030509@redhat.com> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1423993630 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15329 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 14/02/15 04:35, Stan Cox wrote: > The datetime support for the -S/-T options was not supporting 'next > TODAY' properly. The desired behavior is one week from today. This > patch fixes that and adds a bit more testing. > > git://sourceware.org/git/pcpfans.git > scox/dev b47af16c219f78d96f3962e61d022ca9006ad3a8 > Stan Cox (1): Match current parse-datetime.y behavior for 'next *TODAY*' Stan, I'm working on revamping qa/752 to make it more robust ... and seeing this issue ... # grep sunday 752.full sunday: 2015-02-15 <---- this one is from date(1) first sunday: 2015-02-22 this sunday: 2015-02-15 next sunday: 2015-02-22 last sunday: 2015-02-08 #1 "sunday" 2015-02-22 00:00:00 <--- from rtimetest #2 "sunday" 2015-02-22 00:00:00 #3 "sunday" 2014-01-27 11:28:50 #1 "first sunday" 2015-02-22 00:00:00 #2 "first sunday" 2015-02-22 00:00:00 #3 "first sunday" 2014-01-27 11:28:50 #1 "this sunday" 2015-02-15 00:00:00 #2 "this sunday" 2015-02-15 00:00:00 #3 "this sunday" 2014-01-27 11:28:50 #1 "next sunday" 2015-02-22 00:00:00 #2 "next sunday" 2015-02-22 00:00:00 #3 "next sunday" 2014-01-27 11:28:50 #1 "last sunday" 2015-02-08 00:00:00 #2 "last sunday" 2015-02-08 00:00:00 #3 "last sunday" 2014-01-27 11:28:50 The libpcp one as a week ahead of the date(1). The qa test now exercises _every_ day of the week, so I'll update tomorrow if monday is now wrong in a similar way. From kenj@internode.on.net Sun Feb 15 15:36:23 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 68D8E7F47 for ; Sun, 15 Feb 2015 15:36:23 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 37449304053 for ; Sun, 15 Feb 2015 13:36:22 -0800 (PST) X-ASG-Debug-ID: 1424036176-04bdf06a5c386960001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id n8IHNEWBXQ9kMmZn for ; Sun, 15 Feb 2015 13:36:17 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApUBAOsQ4VR20Zu9/2dsb2JhbAANT8oQgk8CgVMBAQEBAQGFCQEBBDhRCxgJJQ8CRhMIAQG9I5clAQEBBwIBH4sMhHQWhBQFlRwMllSEJIMeAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail07.adl2.internode.on.net with ESMTP; 16 Feb 2015 08:06:15 +1030 Message-ID: <54E1116B.90003@internode.on.net> Date: Mon, 16 Feb 2015 08:36:43 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] [Bug 1104] New: signal delivery may lead to deadlock References: X-ASG-Orig-Subj: Re: [pcp] [Bug 1104] New: signal delivery may lead to deadlock In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1424036177 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15354 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 15/02/15 12:28, Frank Ch. Eigler wrote: > > Yeah, it's a textbook example. I was thinking at one point that the > AF* functionality could be recast as something occurring synchronously > rather than asynchronously. For example, we could define redefine the > __pmAF* functions so that callbacks occur only as/after libpcp > functions are about to return to the application. (A new __pmAFwait() > could serve pmlogger's non-busy-looping.) Maybe. But pmlogger is sitting in select waiting for an AF timer event _or_ i/o on the control port (via pmlc) ... not sure how a __pmAFwait() could be helpful here. Anyway, for the specific case of pmlogger, I've fixed this is the proper POSIX.1 way, and made all of the AF callback routines restricted to be async-signal-safe (indeed they call _no_ other routines). All of the work is deferred to the main loop once the global state change(s) are noticed. I've also added documentation in the pmaf(3) man page to describe the required restrictions on the func() routine passed to pmAFregister(). These changes have passed a full QA (including recreating all the QA archives that are not checked in), are in my next batch of commits. I think the number of places we need to address these issues is sufficiently small that we should audit and fix as required as a first attempt, without changing libpcp abi/api/semantics if possible. For reference here are the places __pmAFregister() is called: perl/PMDA/local.c - this is an issue, see bug#1069 pmdas/bash/bash.c - safe pmdas/linux_proc/proc_pid.c - would need a libpcp_pmda change to allow some safe but async hook from pmdaMain() back into the pmda code, or use its own main loop, like some other pmdas do (e.g. logger, trace) pmdas/hotproc/src/hotproc.c - dead code pmdas/logger/logger.c - safe pmdas/papi/papi.c - same as linux_proc pmdas/trace/src/trace.c and pmdas/trace/src/comms.c - has own main loop, could be fixed easily pmlogger/... - all done From kenj@internode.on.net Sun Feb 15 15:38:14 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 034387F47 for ; Sun, 15 Feb 2015 15:38:14 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 775CDAC001 for ; Sun, 15 Feb 2015 13:38:10 -0800 (PST) X-ASG-Debug-ID: 1424036287-04cbb01163360150001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id hFqWFQOC1iSSzdAL for ; Sun, 15 Feb 2015 13:38:07 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AswBAOsQ4VR20Zu9/2dsb2JhbAANT4NYWoMDvzmHRgEBAQEBAYUyVTAGAgUWCwILAwIBAgE/GQYCAQGINrRtcJZhgSGRR4FCBYVajTWYbYQkWwGCQgEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail07.adl2.internode.on.net with ESMTP; 16 Feb 2015 08:08:06 +1030 Message-ID: <54E111DA.1070508@internode.on.net> Date: Mon, 16 Feb 2015 08:38:34 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1424036287 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15354 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (6): libpcp/AF.c: reduce chance of problems with signals pmlogger: fix signal handler deadlock qa/040: tweak timing for pmlogger qa/1045: add more diagnostics to try and catch file clobbering qa/301: fix small tail race qa/752: expanded coverage, more robust filtering Stan Cox (1): Match current parse-datetime.y behavior for 'next *TODAY*' man/man3/pmaf.3 | 26 +++++++ qa/040 | 13 ++- qa/1045 | 3 qa/301 | 1 qa/752 | 92 +++++++++++++++++----------- qa/752.out | 144 ++++++++++++++++++++++++-------------------- qa/src/rtimetest.c | 12 ++- src/libpcp/src/AF.c | 9 ++ src/libpcp/src/getdate.y | 4 - src/pmlogger/src/callback.c | 34 +++++++++- src/pmlogger/src/logger.h | 3 src/pmlogger/src/pmlogger.c | 66 +++++++++++++++++++- 12 files changed, 290 insertions(+), 117 deletions(-) Details ... commit 343b79d183721db6b133170d798868bffd900a02 Author: Ken McDonell Date: Mon Feb 16 07:08:39 2015 +1100 qa/752: expanded coverage, more robust filtering commit 8053ade42eed280e803113305a03c398731df0aa Author: Ken McDonell Date: Mon Feb 16 07:05:31 2015 +1100 qa/301: fix small tail race Need _wait_for_pmlogger after restarting pmcd at the end. commit c081d8345903cad261b07362c4ec475385c1b0eb Author: Ken McDonell Date: Mon Feb 16 07:04:19 2015 +1100 qa/1045: add more diagnostics to try and catch file clobbering Still trying to understand how pconf/cpu/load_average sometimes ends up as an empty file. commit 90bde5e658acee30830a35abd523907ad4203ee8 Author: Ken McDonell Date: Mon Feb 16 07:01:06 2015 +1100 qa/040: tweak timing for pmlogger With the changes to pmlogger to avoid the signal deadlock, it is no longer possible to log reliably at a 5msec sample frequency. (It never really was, but previously we never got out of the interrupt handler!). Logging at 20msec seems to work fine. Fine-tune the number of logging samples and the checking iterations to match. commit b365c37d9b321cb514fbdb39e4d1dba2028f3ab6 Author: Ken McDonell Date: Mon Feb 16 06:54:55 2015 +1100 pmlogger: fix signal handler deadlock All the AF* callbacks are now async-signal-safe. Fixes http://oss.sgi.com/bugzilla/show_bug.cgi?id=1104 and addresses the pmlogger issues in http://oss.sgi.com/bugzilla/show_bug.cgi?id=1069 commit 78cc8d020c59d15d3ced69a52b129abddfe6cc7b Author: Ken McDonell Date: Mon Feb 16 06:48:53 2015 +1100 libpcp/AF.c: reduce chance of problems with signals As described in http://oss.sgi.com/bugzilla/show_bug.cgi?id=1069 we should restrict ourselves to async-signal-safe routines to be called from onalarm(). This commit replaces the pmprintf()/pmflush() calls with printf() (which is no better) but places them behind debug guards ... so without setting -Daf there are no stdio calls in onalarm(). The free() remains, I need to figure out how to delay that one. Also the pmaf(3) man page describes the restrictions that must be applied to the func() passed to pmAFregister(), namely it must also restrict itself to calling only async-signal-safe routines. commit b47af16c219f78d96f3962e61d022ca9006ad3a8 Author: Stan Cox Date: Fri Feb 13 12:23:08 2015 -0500 Match current parse-datetime.y behavior for 'next *TODAY*' * libpcp/src/getdate.y (__pmGlibGetDate): Consider 'next TODAY' to be next week. * qa/src/rtimetest.c: Test more relative DAYNAMEs. * (qa/752, qa/752.out): Likewise From wwwrun@oss.sgi.com Sun Feb 15 15:39:07 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 8C1197F5F; Sun, 15 Feb 2015 15:39:07 -0600 (CST) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1104] signal delivery may lead to deadlock Date: Sun, 15 Feb 2015 21:39:06 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: kenj@internode.on.net X-Bugzilla-Status: RESOLVED X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1424036347.E82dE2.11938"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1424036347.E82dE2.11938 Date: Sun, 15 Feb 2015 15:39:07 -0600 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1104 Ken McDonell changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution|--- |FIXED --- Comment #1 from Ken McDonell --- Fixed in commit b365c37d -- You are receiving this mail because: You are on the CC list for the bug. --1424036347.E82dE2.11938 Date: Sun, 15 Feb 2015 15:39:07 -0600 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" changed bug 1104
What Removed Added
Status NEW RESOLVED
Resolution --- FIXED

Comment # 1 on bug 1104 from
Fixed in commit b365c37d


You are receiving this mail because:
  • You are on the CC list for the bug.
--1424036347.E82dE2.11938-- From nscott@redhat.com Sun Feb 15 18:00:37 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id EF2E37F47 for ; Sun, 15 Feb 2015 18:00:37 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id DD16B8F8039 for ; Sun, 15 Feb 2015 16:00:34 -0800 (PST) X-ASG-Debug-ID: 1424044829-04cb6c6b093b3ca0001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id 3AXW7U6ENJfL0U4Q (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sun, 15 Feb 2015 16:00:29 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1G00Rg7011977; Sun, 15 Feb 2015 19:00:27 -0500 Date: Sun, 15 Feb 2015 19:00:26 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus Cc: PCP Mailing List Message-ID: <809928565.6893210.1424044826216.JavaMail.zimbra@redhat.com> In-Reply-To: <54DE51A0.7070905@buffalo.edu> References: <54DE51A0.7070905@buffalo.edu> Subject: Re: [pcp] Python pmda instances MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Python pmda instances Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Python pmda instances Thread-Index: s3EkKQ/r0rgIFexBEZajpO8qmZzNEw== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1424044829 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15358 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Martins, ----- Original Message ----- > [...] > LIBPCP_PMDA.pmdaCacheStore(indom, cpmda.PMDA_CACHE_ADD, key, > byref(insts[key])) > TypeError: byref() argument must be a ctypes instance, not 'dict' > > I can work around this by just storing an index instead, but I don't > know enough about python to know if there is a way to make that cast work. We're using the python ctypes module extensively in our PMDA (and PMAPI) library wrappers. To store into the pmdaCache pointers, we need to use something that is a subclass of a ctypes class, usually "Structure", so that the reference counting and type checking is done correctly (IIRC). See src/pmdas/dmcache and/or src/pmdas/gluster PMDAs for example PMDAs that use python pmdaCache-tracked objects. cheers. -- Nathan From nscott@redhat.com Sun Feb 15 20:43:08 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id CBAA77F3F for ; Sun, 15 Feb 2015 20:43:08 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id B64A58F8040 for ; Sun, 15 Feb 2015 18:43:05 -0800 (PST) X-ASG-Debug-ID: 1424054578-04cbb01162370db0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id 87RAPHwguRakq8zx (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sun, 15 Feb 2015 18:42:59 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1G2gwkp015527 for ; Sun, 15 Feb 2015 21:42:58 -0500 Date: Sun, 15 Feb 2015 21:42:58 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: PCP Mailing List Message-ID: <301124559.6915512.1424054578401.JavaMail.zimbra@redhat.com> Subject: pcp updates: pmdalinux fix + kenj merge MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: pmdalinux fix + kenj merge Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: pmdalinux fix + kenj merge Thread-Index: fbm8r58JKDWVpBhuTIyosNFlnDh25Q== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1424054579 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15365 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Nathan Scott (1): pmdalinux: tighten getinfo distro file validity checking src/pmdas/linux/getinfo.c | 10 +++++++--- 1 file changed, 7 insertions(+), 3 deletions(-) From kenj@internode.on.net Sun Feb 15 21:14:51 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id B99887F3F for ; Sun, 15 Feb 2015 21:14:51 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 99C44304043 for ; Sun, 15 Feb 2015 19:14:48 -0800 (PST) X-ASG-Debug-ID: 1424056482-04bdf06a5b39cd40001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id l6exhBt3u7N1xixn for ; Sun, 15 Feb 2015 19:14:43 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ArsBACJg4VR20Zu9PGdsb2JhbAANT4pfvzGCTwKBVQEBAQEBAQUBAQEBOIRIAQEEOFELGAklDwIyFBMIAQG9XJcqAQEIAgEfiwyEdBaEFAEEmgeLLoZHhCSDHgEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl2.internode.on.net with ESMTP; 16 Feb 2015 13:44:02 +1030 Message-ID: <54E160A2.50409@internode.on.net> Date: Mon, 16 Feb 2015 14:14:42 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] datetime 'next TODAY' References: <54DE35EA.2030509@redhat.com> <54E06B44.9030401@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] datetime 'next TODAY' In-Reply-To: <54E06B44.9030401@internode.on.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1424056483 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15366 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 15/02/15 20:47, Ken McDonell wrote: > ... > The qa test now exercises _every_ day of the week, so I'll update tomorrow if monday is now wrong in a similar way. Yep, as soon as UTC rolled to Monday, the test failure moved from Sunday to Monday. From kenj@internode.on.net Sun Feb 15 23:31:42 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 50CFC7F47 for ; Sun, 15 Feb 2015 23:31:42 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 30BF4304059 for ; Sun, 15 Feb 2015 21:31:41 -0800 (PST) X-ASG-Debug-ID: 1424064696-04cb6c6b093bedd0001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id pWCEjAPuDAQ3TpXt for ; Sun, 15 Feb 2015 21:31:37 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ArsBABWA4VR20Zu9PGdsb2JhbAANT4c1gyrDVwEBAQEBAQUBAQEBOIRxFUA2AgUWCwILAwIBAgExGg0IAQG9XXCWPiyBIZFHgUIFq3yEJIMeAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl2.internode.on.net with ESMTP; 16 Feb 2015 16:01:35 +1030 Message-ID: <54E180E0.8040505@internode.on.net> Date: Mon, 16 Feb 2015 16:32:16 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: PCP Subject: qa/720 - very unreliable Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: qa/720 - very unreliable Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1424064696 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15371 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- I have 15 different failures for qa/720 across 16 systems. Broadly they are 1. assortment of error message types, text, format, etc from pminfo, for example 101c101 < pminfo: Cannot connect to PMCD on host "pcp://localhost?user=NOsuchUSER&pass=DEFINITELYnotApassword": Authentication - authentication failure --- > Error: Authentication - user not found Is there any technically plausible reason that these should be treated as synonymous and magically filtered into a passing test? 2. valgrind failures in a blinding assortment of variations around _plug_get_password ... I'm currently trying a minimalist valgrind suppression of the form { cyrus-sasl callback leak, RHBZ1191183, common case variant Memcheck:Leak fun:calloc ... fun:_plug_get_password ... fun:sasl_client_step ... } Does this look OK? How are others going with this test? From kenj@internode.on.net Sun Feb 15 23:36:31 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 25DDF7F47 for ; Sun, 15 Feb 2015 23:36:31 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 10D90304043 for ; Sun, 15 Feb 2015 21:36:31 -0800 (PST) X-ASG-Debug-ID: 1424064988-04cbb011633765c0001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id QCpPxnAtmEEk3Rnv for ; Sun, 15 Feb 2015 21:36:28 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ArsBADiB4VR20Zu9PGdsb2JhbAANT4c1gyrDVwEBAQEBAQUBAQEBOIRxVT0WCwIEBwMCAQIBMRoNCAEBvWNwlj4BAQgBAQEBHpJogUIFkRKBLpk8giEfgWSDHgEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl2.internode.on.net with ESMTP; 16 Feb 2015 16:06:06 +1030 Message-ID: <54E181EE.7000504@internode.on.net> Date: Mon, 16 Feb 2015 16:36:46 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: PCP Subject: qa/977 failing a lot Content-Type: multipart/mixed; boundary="------------080605060209050707010208" X-ASG-Orig-Subj: qa/977 failing a lot X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1424064988 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15371 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- This is a multi-part message in MIME format. --------------080605060209050707010208 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit All failures are the same and involve extra lines: pmNewContext(host=pcp://localhost?container=fe4564ddf901): Connection refused and pmNewContext(host=local:?container=fe4564ddf901): Connection refused .out.bad attached. Any clues? --------------080605060209050707010208 Content-Type: text/plain; charset=UTF-8; name="977.out.bad" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="977.out.bad" UUEgb3V0cHV0IGNyZWF0ZWQgYnkgOTc3Cj09PSBzdGQgb3V0ID09PQpJdGVyYXRpb24gNAo9 PT0gc3RkIGVyciA9PT0KcG1OZXdDb250ZXh0KGhvc3Q9cGNwOi8vbG9jYWxob3N0P2NvbnRh aW5lcj1mZTQ1NjRkZGY5MDEpOiBDb25uZWN0aW9uIHJlZnVzZWQKPT09IGZpbHRlcmVkIHZh bGdyaW5kIHJlcG9ydCA9PT0KTWVtY2hlY2ssIGEgbWVtb3J5IGVycm9yIGRldGVjdG9yCkNv bW1hbmQ6IHNyYy9ncmluZF9jdHggLWggcGNwOi8vbG9jYWxob3N0P2NvbnRhaW5lcj1mZTQ1 NjRkZGY5MDEKTEVBSyBTVU1NQVJZOgpkZWZpbml0ZWx5IGxvc3Q6IDAgYnl0ZXMgaW4gMCBi bG9ja3MKaW5kaXJlY3RseSBsb3N0OiAwIGJ5dGVzIGluIDAgYmxvY2tzCkVSUk9SIFNVTU1B Ulk6IDAgZXJyb3JzIGZyb20gMCBjb250ZXh0cyAuLi4KPT09IHN0ZCBvdXQgPT09Ckl0ZXJh dGlvbiA0Cj09PSBzdGQgZXJyID09PQpwbU5ld0NvbnRleHQoaG9zdD1sb2NhbDo/Y29udGFp bmVyPWZlNDU2NGRkZjkwMSk6IENvbm5lY3Rpb24gcmVmdXNlZAo9PT0gZmlsdGVyZWQgdmFs Z3JpbmQgcmVwb3J0ID09PQpNZW1jaGVjaywgYSBtZW1vcnkgZXJyb3IgZGV0ZWN0b3IKQ29t bWFuZDogc3JjL2dyaW5kX2N0eCAtaCBsb2NhbDo/Y29udGFpbmVyPWZlNDU2NGRkZjkwMQpM RUFLIFNVTU1BUlk6CmRlZmluaXRlbHkgbG9zdDogMCBieXRlcyBpbiAwIGJsb2NrcwppbmRp cmVjdGx5IGxvc3Q6IDAgYnl0ZXMgaW4gMCBibG9ja3MKRVJST1IgU1VNTUFSWTogMCBlcnJv cnMgZnJvbSAwIGNvbnRleHRzIC4uLgo9PT0gc3RkIG91dCA9PT0KSXRlcmF0aW9uIDQKSXRl cmF0aW9uIDMKSXRlcmF0aW9uIDIKSXRlcmF0aW9uIDEKSXRlcmF0aW9uIDAKPT09IHN0ZCBl cnIgPT09Cj09PSBmaWx0ZXJlZCB2YWxncmluZCByZXBvcnQgPT09Ck1lbWNoZWNrLCBhIG1l bW9yeSBlcnJvciBkZXRlY3RvcgpDb21tYW5kOiBzcmMvZ3JpbmRfY3R4IC1MCkxFQUsgU1VN TUFSWToKZGVmaW5pdGVseSBsb3N0OiAwIGJ5dGVzIGluIDAgYmxvY2tzCmluZGlyZWN0bHkg bG9zdDogMCBieXRlcyBpbiAwIGJsb2NrcwpFUlJPUiBTVU1NQVJZOiAwIGVycm9ycyBmcm9t IDAgY29udGV4dHMgLi4uCg== --------------080605060209050707010208-- From nscott@redhat.com Sun Feb 15 23:46:49 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 304417F47 for ; Sun, 15 Feb 2015 23:46:49 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 104658F8035 for ; Sun, 15 Feb 2015 21:46:45 -0800 (PST) X-ASG-Debug-ID: 1424065603-04bdf06a593a1610001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id 7rQrVboRAYGGixk6 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sun, 15 Feb 2015 21:46:43 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1G5kdw9031201; Mon, 16 Feb 2015 00:46:39 -0500 Date: Mon, 16 Feb 2015 00:46:37 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: PCP Message-ID: <11603527.6946525.1424065597956.JavaMail.zimbra@redhat.com> In-Reply-To: <54E180E0.8040505@internode.on.net> References: <54E180E0.8040505@internode.on.net> Subject: Re: [pcp] qa/720 - very unreliable MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] qa/720 - very unreliable Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: qa/720 - very unreliable Thread-Index: qigXP9+mzKsJHXTTMh8O13COi/f+CA== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1424065603 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15371 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Ken, ----- Original Message ----- > I have 15 different failures for qa/720 across 16 systems. > [...] > Is there any technically plausible reason that these should be treated > as synonymous and magically filtered into a passing test? Yeah, SASL errors can come from different places depending on the local SASL (runtime) configuration - from the library code or from the plugin libraries, which may be activated in different orders for each platform. > 2. valgrind failures in a blinding assortment of variations around > _plug_get_password ... I'm currently trying a minimalist valgrind > suppression of the form > > { > cyrus-sasl callback leak, RHBZ1191183, common case variant > Memcheck:Leak > fun:calloc > ... > fun:_plug_get_password > ... > fun:sasl_client_step > ... > } > > Does this look OK? Will give it a go. > How are others going with this test? > Pretty ordinary - I'd begun extending the valgrind filter, but had it a whole lot more specific than the above (and it wasn't right yet) - I will try yours instead & get back to you. I also have a fix pending to make _valgrind_clean_assert (qa/666) work again for older valgrind versions without vgdb support. cheers. -- Nathan From nscott@redhat.com Sun Feb 15 23:52:15 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id EE3BA7F47 for ; Sun, 15 Feb 2015 23:52:14 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 7CCE6AC001 for ; Sun, 15 Feb 2015 21:52:11 -0800 (PST) X-ASG-Debug-ID: 1424065928-04cbb01162376ce0001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id BhEQLHXo8GzfgKA5 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sun, 15 Feb 2015 21:52:09 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1G5q6Ik060634; Mon, 16 Feb 2015 00:52:06 -0500 Date: Mon, 16 Feb 2015 00:52:05 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: PCP Message-ID: <1694578981.6950091.1424065925917.JavaMail.zimbra@redhat.com> In-Reply-To: <54E181EE.7000504@internode.on.net> References: <54E181EE.7000504@internode.on.net> Subject: Re: [pcp] qa/977 failing a lot MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] qa/977 failing a lot Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: qa/977 failing a lot Thread-Index: JCBfCKikadfZaHIINwzMxlaj/nMEbA== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1424065929 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15372 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > All failures are the same and involve extra lines: > > pmNewContext(host=pcp://localhost?container=fe4564ddf901): Connection refused > and > pmNewContext(host=local:?container=fe4564ddf901): Connection refused > > .out.bad attached. > > Any clues? Looks like its still possible to take out pmcd with --container option, and a subsequent context creation in the grind_ctx loop hits the error. Good information - we know to focus the bug search on the pmNewContext and pmDestroyContext paths though. Any details in pmcd.log after this test runs? (not failing here) cheers. -- Nathan From nscott@redhat.com Mon Feb 16 02:26:47 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id CE82F7F4E for ; Mon, 16 Feb 2015 02:26:47 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id AC3FF304059 for ; Mon, 16 Feb 2015 00:26:47 -0800 (PST) X-ASG-Debug-ID: 1424075200-04cb6c6b093c6610001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id YGGwjIqFwrwYDWdJ (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 16 Feb 2015 00:26:40 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1G8QdWL023473 for ; Mon, 16 Feb 2015 03:26:39 -0500 Date: Mon, 16 Feb 2015 03:26:39 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: PCP Message-ID: <537103356.7228684.1424075199484.JavaMail.zimbra@redhat.com> In-Reply-To: <1084655413.7228090.1424075166933.JavaMail.zimbra@redhat.com> Subject: pcp update: qa, martins+rdoyle merges MIME-Version: 1.0 X-ASG-Orig-Subj: pcp update: qa, martins+rdoyle merges Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp update: qa, martins+rdoyle merges Thread-Index: NcoLyTUQdgV6liR9OHiF5+bFOVDcRg== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1424075200 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15377 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Martins Innus (7): ganglia2pcp initial commit ganglia2pcp cleanups More ganglia2pcp work ganglia2pcp tweaks Fix commented code in ganglia2pcp qa ganglia2pcp add cpu indom support Fix qa output for latest ganglia changes Ryan Doyle (5): activemq PMDA: Introduce caching when fetching URLs activemq PMDA: Cache the already decoded JSON activemq PMDA: expire on each half second so we can sample at 1 second intervals activemq PMDA: fix ints to be signed as that is how they are in Java land activemq PMDA: fix tests to reflect changes in the caching behaviour (caching JSON, not the request object) Nathan Scott (2): ganglia2pcp: rpm packaging, qa host pkg checks, fix small typo qa: fix valgrind_clean_assert for older valgrind versions build/rpm/fedora.spec | 20 build/rpm/pcp.spec.in | 20 debian/GNUmakefile | 4 debian/control | 8 debian/control.master | 8 debian/pcp-import-ganglia2pcp.install | 2 debian/rules | 6 man/man1/ganglia2pcp.1 | 118 +++ qa/926 | 54 + qa/926.out | 1189 ++++++++++++++++++++++--------- qa/GNUmakefile | 2 qa/admin/check-vm | 2 qa/common.check | 7 qa/ganglia/GNUmakefile | 15 qa/ganglia/gangliatest/GNUmakefile | 18 qa/ganglia/gangliatest/boottime.rrd |binary qa/ganglia/gangliatest/bytes_in.rrd |binary qa/ganglia/gangliatest/bytes_out.rrd |binary qa/ganglia/gangliatest/cpu_aidle.rrd |binary qa/ganglia/gangliatest/cpu_idle.rrd |binary qa/ganglia/gangliatest/cpu_nice.rrd |binary qa/ganglia/gangliatest/cpu_num.rrd |binary qa/ganglia/gangliatest/cpu_speed.rrd |binary qa/ganglia/gangliatest/cpu_system.rrd |binary qa/ganglia/gangliatest/cpu_user.rrd |binary qa/ganglia/gangliatest/cpu_wio.rrd |binary qa/ganglia/gangliatest/disk_free.rrd |binary qa/ganglia/gangliatest/disk_total.rrd |binary qa/ganglia/gangliatest/load_fifteen.rrd |binary qa/ganglia/gangliatest/load_five.rrd |binary qa/ganglia/gangliatest/load_one.rrd |binary qa/ganglia/gangliatest/mem_buffers.rrd |binary qa/ganglia/gangliatest/mem_cached.rrd |binary qa/ganglia/gangliatest/mem_free.rrd |binary qa/ganglia/gangliatest/mem_shared.rrd |binary qa/ganglia/gangliatest/mem_total.rrd |binary qa/ganglia/gangliatest/part_max_used.rrd |binary qa/ganglia/gangliatest/pkts_in.rrd |binary qa/ganglia/gangliatest/pkts_out.rrd |binary qa/ganglia/gangliatest/proc_run.rrd |binary qa/ganglia/gangliatest/proc_total.rrd |binary qa/ganglia/gangliatest/swap_free.rrd |binary qa/ganglia/gangliatest/swap_total.rrd |binary qa/group | 1 src/GNUmakefile | 1 src/ganglia2pcp/GNUmakefile | 30 src/ganglia2pcp/README | 30 src/ganglia2pcp/ganglia2pcp | 750 +++++++++++++++++++ src/pmdas/activemq/Cache.pm | 46 + src/pmdas/activemq/CacheTest.pl | 32 src/pmdas/activemq/GNUmakefile | 6 src/pmdas/activemq/RESTClient.pm | 31 src/pmdas/activemq/RESTClientTest.pl | 24 src/pmdas/activemq/TimeSource.pm | 33 src/pmdas/activemq/pmdaactivemq.pl | 230 +++-- 55 files changed, 2223 insertions(+), 464 deletions(-) From kenj@internode.on.net Mon Feb 16 03:27:04 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 178467F4E for ; Mon, 16 Feb 2015 03:27:04 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 9BAE1AC002 for ; Mon, 16 Feb 2015 01:27:00 -0800 (PST) X-ASG-Debug-ID: 1424078813-04cbb011633819a0001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id 4Cd0JnRS19mG5doU for ; Mon, 16 Feb 2015 01:26:54 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AswBAFa34VR20Zu9PGdsb2JhbAANT4NYWoMDgyq8B4V5AoFWAQEBAQEBBQEBAQE4hEgBAQQjBFEBEAsYCRYLAgICBwMCAQIBMRQGDQEHAQG+QXCWUwEBAQEBAQEBAQEBAQEBAQEBAQEBAReLDIRSFgUHCYJfgUIFjUyDRoEuT5htgiQcgWRbgkMBAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl2.internode.on.net with ESMTP; 16 Feb 2015 19:56:52 +1030 Message-ID: <54E1B805.5010801@internode.on.net> Date: Mon, 16 Feb 2015 20:27:33 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Nathan Scott CC: PCP Subject: Re: [pcp] qa/977 failing a lot References: <54E181EE.7000504@internode.on.net> <1694578981.6950091.1424065925917.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] qa/977 failing a lot In-Reply-To: <1694578981.6950091.1424065925917.JavaMail.zimbra@redhat.com> Content-Type: multipart/mixed; boundary="------------050004050408000901040800" X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1424078813 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15379 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- This is a multi-part message in MIME format. --------------050004050408000901040800 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit On 16/02/15 16:52, Nathan Scott wrote: > ... > Good information - we know to focus the bug search on the pmNewContext > and pmDestroyContext paths though. Any details in pmcd.log after this > test runs? (not failing here) Attached. --------------050004050408000901040800 Content-Type: text/plain; charset=UTF-8; name="pmcd.log.prev" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="pmcd.log.prev" TG9nIGZvciBwbWNkIG9uIHZtMDMgc3RhcnRlZCBGcmkgRmViIDEzIDIzOjEyOjQ5IDIwMTUK CgphY3RpdmUgYWdlbnQgZG9tICAgcGlkICBpbiBvdXQgdmVyIHByb3RvY29sIHBhcmFtZXRl cnMKPT09PT09PT09PT09ID09PSA9PT09PSA9PT0gPT09ID09PSA9PT09PT09PSA9PT09PT09 PT09CnJvb3QgICAgICAgICAgIDEgMjE2MDggICA5ICAxMCAgIDIgYmluIHBpcGUgY21kPS92 YXIvbGliL3BjcC9wbWRhcy9yb290L3BtZGFyb290IC1kIDEKcG1jZCAgICAgICAgICAgMiAg ICAgICAgICAgICAgICAgMiBkc28gaTo2ICBsaWI9L3Zhci9saWIvcGNwL3BtZGFzL3BtY2Qv cG1kYV9wbWNkLnNvIGVudHJ5PXBtY2RfaW5pdCBbMHg3ZjJmYjQ4ZDAwZjBdCnByb2MgICAg ICAgICAgIDMgMjE2MjMgIDE0ICAxNSAgIDIgYmluIHBpcGUgY21kPS92YXIvbGliL3BjcC9w bWRhcy9wcm9jL3BtZGFwcm9jIC1kIDMKeGZzICAgICAgICAgICAxMSAyMTYzMCAgMTYgIDE3 ICAgMiBiaW4gcGlwZSBjbWQ9L3Zhci9saWIvcGNwL3BtZGFzL3hmcy9wbWRheGZzIC1kIDEx CnNhbXBsZSAgICAgICAgMjkgMjE2MzkgIDE4ICAxOSAgIDIgYmluIHBpcGUgY21kPS92YXIv bGliL3BjcC9wbWRhcy9zYW1wbGUvcG1kYXNhbXBsZSAtZCAyOQpzYW1wbGVkc28gICAgIDMw ICAgICAgICAgICAgICAgICAyIGRzbyBpOjYgIGxpYj0vdmFyL2xpYi9wY3AvcG1kYXMvc2Ft cGxlL3BtZGFfc2FtcGxlLnNvIGVudHJ5PXNhbXBsZV9pbml0IFsweDdmMmZiNDZjMWM5MF0K bGludXggICAgICAgICA2MCAgICAgICAgICAgICAgICAgMiBkc28gaTo2ICBsaWI9L3Zhci9s aWIvcGNwL3BtZGFzL2xpbnV4L3BtZGFfbGludXguc28gZW50cnk9bGludXhfaW5pdCBbMHg3 ZjJmYjQ0OWM4MjBdCm1tdiAgICAgICAgICAgNzAgICAgICAgICAgICAgICAgIDIgZHNvIGk6 NCAgbGliPS92YXIvbGliL3BjcC9wbWRhcy9tbXYvcG1kYV9tbXYuc28gZW50cnk9bW12X2lu aXQgWzB4N2YyZmI0Mjg4NDEwXQpzeXN0ZW1kICAgICAgMTE0IDIxNjQwICAyNSAgMjYgICAy IGJpbiBwaXBlIGNtZD0vdmFyL2xpYi9wY3AvcG1kYXMvc3lzdGVtZC9wbWRhc3lzdGVtZCAt ZCAxMTQgLVVyb290CmpiZDIgICAgICAgICAxMjIgICAgICAgICAgICAgICAgIDIgZHNvIGk6 NCAgbGliPS92YXIvbGliL3BjcC9wbWRhcy9qYmQyL3BtZGFfamJkMi5zbyBlbnRyeT1qYmQy X2luaXQgWzB4N2YyZmI0MDgyZDgwXQpzaW1wbGUgICAgICAgMjUzIDIxNjQ1ICAyOSAgMzAg ICAyIGJpbiBwaXBlIGNtZD0vdmFyL2xpYi9wY3AvcG1kYXMvc2ltcGxlL3BtZGFzaW1wbGUg LWQgMjUzCgpIb3N0IGFjY2VzcyBsaXN0OgowMCAwMSBDdXIvTWF4Q29ucyBob3N0LXNwZWMg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgaG9zdC1tYXNrICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgIGx2bCBob3N0LW5hbWUKPT0gPT0gPT09PT09PT09PT0gPT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09ID09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PSA9PT0gPT09PT09PT09PT09PT0KIHkgIHkgICAgIDAgICAg IDAgMTkyLjE2OC4xLjIwMyAgICAgICAgICAgICAgICAgICAgICAgICAgIDI1NS4yNTUuMjU1 LjI1NSAgICAgICAgICAgICAgICAgICAgICAgICAgIDAgbG9jYWxob3N0CiB5ICB5ICAgICAw ICAgICAwIC8gICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAvICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAxIHVuaXg6CiAgICBuICAgICAw ICAgICAwIDAuMC4wLjAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAwLjAuMC4w ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICA0IC4qCiAgICBuICAgICAwICAg ICAwIDo6ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICA6OiAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICA4IDoqClVzZXIgYWNjZXNzIGxpc3Qg ZW1wdHk6IHVzZXItYmFzZWQgYWNjZXNzIGNvbnRyb2wgdHVybmVkIG9mZgpHcm91cCBhY2Nl c3MgbGlzdCBlbXB0eTogZ3JvdXAtYmFzZWQgYWNjZXNzIGNvbnRyb2wgdHVybmVkIG9mZgoK CnBtY2Q6IFBJRCA9IDIxNTk4LCBQRFUgdmVyc2lvbiA9IDIKcG1jZCByZXF1ZXN0IHBvcnQo cyk6CiAgc3RzIGZkICAgcG9ydCAgZmFtaWx5IGFkZHJlc3MKICA9PT0gPT09PSA9PT09PSA9 PT09PT0gPT09PT09PQogIG9rICAgICA3ICAgICAgIHVuaXggICAvdmFyL3J1bi9wY3AvcG1j ZC5zb2NrZXQKICBvayAgICAgMCA0NDMyMSBpbmV0ICAgSU5BRERSX0FOWQogIG9rICAgICAz IDQ0MzIxIGlwdjYgICBJTkFERFJfQU5ZCltTYXQgRmViIDE0IDAyOjQ1OjI5XSBwbWNkKDIx NTk4KSBFcnJvcjogQ2xpZW50TG9vcDogZXJyb3Igc2VuZGluZyBDb25uIEFDSyBQRFUgdG8g bmV3IGNsaWVudCBJUEMgcHJvdG9jb2wgZmFpbHVyZQpbTW9uIEZlYiAxNiAyMDoyNDo0NV0g cG1jZCgyMTU5OCkgRXJyb3I6IENsaWVudExvb3Agc2VsZWN0OiBCYWQgZmlsZSBkZXNjcmlw dG9yCltNb24gRmViIDE2IDIwOjI0OjQ2XSBwbWNkKDIxNTk4KSBJbmZvOiBDbGVhbnVwQWdl bnQgLi4uCkNsZWFudXAgInJvb3QiIGFnZW50IChkb20gMSk6IHRlcm1pbmF0ZWQsIGV4aXQo MSkKCi0+UE1DRCBldmVudCB0cmFjZTogc3RhcnRpbmcgYXQgTW9uIEZlYiAxNiAyMDoyNDo0 NSAyMDE1Ci0+ICAgICAgICAgUmVjdjogUE1OU19OQU1FUyBQRFUsIGZkPTE1LCBwZHVidWY9 MHguLi5iOWNjYjAwMAotPiAgICAgICAgIFhtaXQ6IFBNTlNfVFJBVkVSU0UgUERVLCBmZD0x NAotPiAgICAgICAgIFJlY3Y6IFBNTlNfTkFNRVMgUERVLCBmZD0xNSwgcGR1YnVmPTB4Li4u YjljYzIwMDAKLT4gICAgICAgICBYbWl0OiBQTU5TX1RSQVZFUlNFIFBEVSwgZmQ9MTQKLT4g ICAgICAgICBSZWN2OiBQTU5TX05BTUVTIFBEVSwgZmQ9MTUsIHBkdWJ1Zj0weC4uLmI5Y2Ni MDAwCi0+ICAgICAgICAgWG1pdDogUE1OU19UUkFWRVJTRSBQRFUsIGZkPTE0Ci0+ICAgICAg ICAgUmVjdjogUE1OU19OQU1FUyBQRFUsIGZkPTE1LCBwZHVidWY9MHguLi5iOWNjMjAwMAot PiAgICAgICAgIFhtaXQ6IFBNTlNfVFJBVkVSU0UgUERVLCBmZD0xNAotPiAgICAgICAgIFJl Y3Y6IFBNTlNfTkFNRVMgUERVLCBmZD0xNSwgcGR1YnVmPTB4Li4uYjljY2IwMDAKLT4gICAg ICAgICBYbWl0OiBQTU5TX1RSQVZFUlNFIFBEVSwgZmQ9MTQKLT4gICAgICAgICBSZWN2OiBQ TU5TX05BTUVTIFBEVSwgZmQ9MTUsIHBkdWJ1Zj0weC4uLmI5Y2MyMDAwCi0+ICAgICAgICAg WG1pdDogUE1OU19UUkFWRVJTRSBQRFUsIGZkPTE0Ci0+ICAgICAgICAgUmVjdjogUE1OU19O QU1FUyBQRFUsIGZkPTE1LCBwZHVidWY9MHguLi5iOWNjYjAwMAotPiAgICAgICAgIFhtaXQ6 IFBNTlNfTkFNRVMgUERVLCBmZD0zNSwgbnVtcG1pZD0xNjY5Ci0+ICAgICAgICAgUmVjdjog UE1OU19OQU1FUyBQRFUsIGZkPTM1LCBwZHVidWY9MHguLi5iOWNkMzAwMAotPiAgICAgICAg IFhtaXQ6IFBNTlNfSURTIFBEVSwgZmQ9MzUsIG51bXBtaWQ9MjAKLT4gICAgICAgICBSZWN2 OiBQUk9GSUxFIFBEVSwgZmQ9MzUsIHBkdWJ1Zj0weC4uLmI5Y2NmMDAwCi0+ICAgICAgICAg UmVjdjogRkVUQ0ggUERVLCBmZD0zNSwgcGR1YnVmPTB4Li4uYjljZDMwMDAKLT4gICAgICAg ICBYbWl0OiBSRVNVTFQgUERVLCBmZD0zNSwgbnVtcG1pZD0yMAotPjIwOjI0OjQ2IERyb3Ag UE1EQTogZG9tYWluPTEsIGluZmQ9OSwgb3V0ZmQ9MTAKCltNb24gRmViIDE2IDIwOjI0OjQ2 XSBwbWNkKDIxNTk4KSBJbmZvOiBDbGVhbnVwQWdlbnQgLi4uCkNsZWFudXAgInByb2MiIGFn ZW50IChkb20gMyk6IHRlcm1pbmF0ZWQsIGV4aXQoMCkKCi0+UE1DRCBldmVudCB0cmFjZTog c3RhcnRpbmcgYXQgTW9uIEZlYiAxNiAyMDoyNDo0NiAyMDE1Ci0+ICAgICAgICAgRHJvcCBQ TURBOiBkb21haW49MywgaW5mZD0xNCwgb3V0ZmQ9MTUKCltNb24gRmViIDE2IDIwOjI0OjQ2 XSBwbWNkKDIxNTk4KSBJbmZvOiBDbGVhbnVwQWdlbnQgLi4uCkNsZWFudXAgInhmcyIgYWdl bnQgKGRvbSAxMSk6IHRlcm1pbmF0ZWQsIGV4aXQoMCkKCi0+UE1DRCBldmVudCB0cmFjZTog c3RhcnRpbmcgYXQgTW9uIEZlYiAxNiAyMDoyNDo0NiAyMDE1Ci0+ICAgICAgICAgRHJvcCBQ TURBOiBkb21haW49MTEsIGluZmQ9MTYsIG91dGZkPTE3CgpbTW9uIEZlYiAxNiAyMDoyNDo0 Nl0gcG1jZCgyMTU5OCkgSW5mbzogQ2xlYW51cEFnZW50IC4uLgpDbGVhbnVwICJzYW1wbGUi IGFnZW50IChkb20gMjkpOiB0ZXJtaW5hdGVkLCBleGl0KDApCgotPlBNQ0QgZXZlbnQgdHJh Y2U6IHN0YXJ0aW5nIGF0IE1vbiBGZWIgMTYgMjA6MjQ6NDYgMjAxNQotPiAgICAgICAgIERy b3AgUE1EQTogZG9tYWluPTI5LCBpbmZkPTE4LCBvdXRmZD0xOQoKW01vbiBGZWIgMTYgMjA6 MjQ6NDZdIHBtY2QoMjE1OTgpIEluZm86IENsZWFudXBBZ2VudCAuLi4KQ2xlYW51cCAic3lz dGVtZCIgYWdlbnQgKGRvbSAxMTQpOiB0ZXJtaW5hdGVkLCBleGl0KDEpCgotPlBNQ0QgZXZl bnQgdHJhY2U6IHN0YXJ0aW5nIGF0IE1vbiBGZWIgMTYgMjA6MjQ6NDYgMjAxNQotPiAgICAg ICAgIERyb3AgUE1EQTogZG9tYWluPTExNCwgaW5mZD0yNSwgb3V0ZmQ9MjYKCltNb24gRmVi IDE2IDIwOjI0OjQ2XSBwbWNkKDIxNTk4KSBJbmZvOiBDbGVhbnVwQWdlbnQgLi4uCkNsZWFu dXAgInNpbXBsZSIgYWdlbnQgKGRvbSAyNTMpOiB0ZXJtaW5hdGVkLCBleGl0KDApCgotPlBN Q0QgZXZlbnQgdHJhY2U6IHN0YXJ0aW5nIGF0IE1vbiBGZWIgMTYgMjA6MjQ6NDYgMjAxNQot PiAgICAgICAgIERyb3AgUE1EQTogZG9tYWluPTI1MywgaW5mZD0yOSwgb3V0ZmQ9MzAKCltN b24gRmViIDE2IDIwOjI0OjQ2XSBwbWNkKDIxNTk4KSBJbmZvOiBwbWNkIFNodXRkb3duCgpM b2cgZmluaXNoZWQgTW9uIEZlYiAxNiAyMDoyNDo0NiAyMDE1Cg== --------------050004050408000901040800-- From goodwinos@gmail.com Mon Feb 16 03:39:39 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=FREEMAIL_FROM autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id D0E427F4E for ; Mon, 16 Feb 2015 03:39:39 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 9DEC1304043 for ; Mon, 16 Feb 2015 01:39:39 -0800 (PST) X-ASG-Debug-ID: 1424079578-04bdf06a5c3abed0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 6yAZswXNwVTnZtaz (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 16 Feb 2015 01:39:38 -0800 (PST) X-Barracuda-Envelope-From: goodwinos@gmail.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1G9dcTZ018977 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 16 Feb 2015 04:39:38 -0500 Received: from [10.64.50.169] (vpn1-50-169.bne.redhat.com [10.64.50.169]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1G9daZZ032052 for ; Mon, 16 Feb 2015 04:39:37 -0500 Message-ID: <54E1BAD7.60705@gmail.com> Date: Mon, 16 Feb 2015 20:39:35 +1100 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] qa/977 failing a lot References: <54E181EE.7000504@internode.on.net> <1694578981.6950091.1424065925917.JavaMail.zimbra@redhat.com> <54E1B805.5010801@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] qa/977 failing a lot In-Reply-To: <54E1B805.5010801@internode.on.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424079578 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 02/16/2015 08:27 PM, Ken McDonell wrote: > On 16/02/15 16:52, Nathan Scott wrote: >> ... >> Good information - we know to focus the bug search on the pmNewContext >> and pmDestroyContext paths though. Any details in pmcd.log after this >> test runs? (not failing here) > > Attached. > just noticed the attachment shows the root PMDA is installed as a daemon but the Linux PMDA is still a DSO. Does that matter? (and if so, we need a DSO->daemon migration mechanism for upgrades). Cheers From kenj@internode.on.net Mon Feb 16 04:36:41 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 6BDE97F4E for ; Mon, 16 Feb 2015 04:36:41 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 4AD1D304039 for ; Mon, 16 Feb 2015 02:36:41 -0800 (PST) X-ASG-Debug-ID: 1424082997-04cbb01165385d10001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id Wf9wa4oQf9wwcI1A for ; Mon, 16 Feb 2015 02:36:38 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ArsBANzH4VR20Zu9PGdsb2JhbAANT4pfvzCCTwKBVwEBAQEBAQUBAQEBOIRIAQEEJxFAEQsYCRYPCQMCAQIBMRQTCAEBvhuXQAEBAQcCAR+LDIQrSRaEFAEEq3yEJIFfgT8BAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl2.internode.on.net with ESMTP; 16 Feb 2015 21:06:19 +1030 Message-ID: <54E1C84B.2050309@internode.on.net> Date: Mon, 16 Feb 2015 21:36:59 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] qa/977 failing a lot References: <54E181EE.7000504@internode.on.net> <1694578981.6950091.1424065925917.JavaMail.zimbra@redhat.com> <54E1B805.5010801@internode.on.net> <54E1BAD7.60705@gmail.com> X-ASG-Orig-Subj: Re: [pcp] qa/977 failing a lot In-Reply-To: <54E1BAD7.60705@gmail.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1424082997 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15381 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 16/02/15 20:39, Mark Goodwin wrote: > > just noticed the attachment shows the root PMDA is installed as a daemon > but the Linux > PMDA is still a DSO. Does that matter? (and if so, we need a DSO->daemon > migration > mechanism for upgrades). Mark, I play Mary-the-average sysadmin all the time ... get new packages and install 'em. If upgrade magic is needed I assume that *will* be part of the packaging scripts. From fche@redhat.com Mon Feb 16 08:30:09 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id E8C8E7F4E for ; Mon, 16 Feb 2015 08:30:08 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 786F5AC001 for ; Mon, 16 Feb 2015 06:30:05 -0800 (PST) X-ASG-Debug-ID: 1424097000-04cb6c6b0a3de820001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id n1LekaQznTMR561S (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 16 Feb 2015 06:30:01 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1GETvMK011803 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Mon, 16 Feb 2015 09:29:57 -0500 Received: from fche.csb (vpn-232-103.phx2.redhat.com [10.3.232.103]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1GETunI003390; Mon, 16 Feb 2015 09:29:57 -0500 Received: by fche.csb (Postfix, from userid 2569) id B59BA5850D; Mon, 16 Feb 2015 09:29:39 -0500 (EST) To: Ken McDonell Cc: pcp@oss.sgi.com Subject: Re: [Bug 1104] New: signal delivery may lead to deadlock References: <54E1116B.90003@internode.on.net> X-ASG-Orig-Subj: Re: [Bug 1104] New: signal delivery may lead to deadlock From: fche@redhat.com (Frank Ch. Eigler) Date: Mon, 16 Feb 2015 09:29:39 -0500 In-Reply-To: <54E1116B.90003@internode.on.net> (Ken McDonell's message of "Mon, 16 Feb 2015 08:36:43 +1100") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424097001 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Ken McDonell writes: > [...] >> Yeah, it's a textbook example. I was thinking at one point that the >> AF* functionality could be recast as something occurring synchronously >> rather than asynchronously. For example, we could define redefine the >> __pmAF* functions so that callbacks occur only as/after libpcp >> functions are about to return to the application. (A new __pmAFwait() >> could serve pmlogger's non-busy-looping.) > > Maybe. But pmlogger is sitting in select waiting for an AF timer > event _or_ i/o on the control port (via pmlc) ... not sure how a > __pmAFwait() could be helpful here. Right; alternatives would be needed for integration into fd-select-ish event loops. The thought was that if a relatively-unrestricted callback functionality is valuable to multiple areas of pcp, then a beefed-up AF facility would be a reasonable place to provide that. > Anyway, for the specific case of pmlogger, I've fixed this is the > proper POSIX.1 way, and made all of the AF callback routines > restricted to be async-signal-safe (indeed they call _no_ other > routines). All of the work is deferred to the main loop once the > global state change(s) are noticed. Yes, that roughly works - using the pmAF machinery only to store/recall a data value (the afid parameter). It doesn't solve the posix-signal-unsafe problems -within- the AF code, such as the memory allocation and fprintf stuff in onalarm(). > [...] > perl/PMDA/local.c - this is an issue, see bug#1069 > pmdas/bash/bash.c - safe > pmdas/linux_proc/proc_pid.c - would need a libpcp_pmda change to allow > some safe but async hook from pmdaMain() back into the pmda code, or > use its own main loop, like some other pmdas do (e.g. logger, trace) > pmdas/hotproc/src/hotproc.c - dead code > pmdas/logger/logger.c - safe > pmdas/papi/papi.c - same as linux_proc > pmdas/trace/src/trace.c and pmdas/trace/src/comms.c - has own main > loop, could be fixed easily > pmlogger/... - all done Thank you for the analysis. - FChE From nscott@redhat.com Mon Feb 16 16:35:43 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id CAD287F3F for ; Mon, 16 Feb 2015 16:35:43 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id AABAE304053 for ; Mon, 16 Feb 2015 14:35:40 -0800 (PST) X-ASG-Debug-ID: 1424126138-04bdf06a5b3f23f0001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id MdklYbqJUZEd5t0h (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 16 Feb 2015 14:35:38 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1GMZX7M030164; Mon, 16 Feb 2015 17:35:33 -0500 Date: Mon, 16 Feb 2015 17:35:32 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Mark Goodwin , Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <103054232.7813414.1424126132928.JavaMail.zimbra@redhat.com> In-Reply-To: <54E1BAD7.60705@gmail.com> References: <54E181EE.7000504@internode.on.net> <1694578981.6950091.1424065925917.JavaMail.zimbra@redhat.com> <54E1B805.5010801@internode.on.net> <54E1BAD7.60705@gmail.com> Subject: Re: [pcp] qa/977 failing a lot MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] qa/977 failing a lot Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: qa/977 failing a lot Thread-Index: hTRkN7he5R7jkCrw1eE3MBrKYc37ig== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1424126138 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15404 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > >> [...] > >> and pmDestroyContext paths though. Any details in pmcd.log after this > >> test runs? (not failing here) > > > > Attached. The client select loop failures are particularly interesting; scanning on some of my hosts here, I'm also seeing this intermittently... need to get to the bottom of that, methinks, to solve this issue. > just noticed the attachment shows the root PMDA is installed as a daemon but > the Linux PMDA is still a DSO. Does that matter? It doesn't matter. Some container functionality will not be present, but it should definitely not cause this class of failure. > (and if so, we need a DSO->daemon migration mechanism for upgrades). Either are valid configurations though. > I play Mary-the-average sysadmin all the time ... get new packages and > install 'em. If upgrade magic is needed I assume that *will* be part of > the packaging scripts. FWLIW, *some* level of intervention has happened here - the pmcd.conf has been modified to include pmdaroot (as per a fresh install, but that would not have been done automatically on upgrade). Maybe QA is to blame there? Hmm, qa/761 does appear to put pmcd.conf back as it found it though. cheers. -- Nathan From nscott@redhat.com Mon Feb 16 23:34:09 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id E725C7F6D for ; Mon, 16 Feb 2015 23:34:08 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 83856AC001 for ; Mon, 16 Feb 2015 21:34:05 -0800 (PST) X-ASG-Debug-ID: 1424151238-04cb6c6b0c41f1f0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id lt4Rj4lnFfXG7ovg (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 16 Feb 2015 21:33:59 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1H5XwW3002915 for ; Tue, 17 Feb 2015 00:33:58 -0500 Date: Tue, 17 Feb 2015 00:33:58 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: PCP Message-ID: <787152400.7993618.1424151238409.JavaMail.zimbra@redhat.com> In-Reply-To: <198007242.7991389.1424150649206.JavaMail.zimbra@redhat.com> Subject: pcp updates: qa, pmdaroot fix MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: qa, pmdaroot fix Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: qa, pmdaroot fix Thread-Index: AsTaQ32COhYvk1JI0LGAWd4FoypoGA== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1424151239 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15417 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Nathan Scott (3): qa: ensure qa/622 leaves no tmpfile leftovers behind qa: next set of workarounds for SASL/valgrind in qa/720 pmdaroot: improve detection of active docker containers qa/622 | 7 +++---- qa/720 | 18 +++++++++++++++++- qa/720.out | 2 +- qa/761.out | 22 ++++++++++++++++++++++ qa/linux/containers-docker-1.3.2-root-003.tgz |binary qa/valgrind-suppress | 15 +++++++++++++++ src/pmdas/root/docker.c | 5 +++-- 7 files changed, 61 insertions(+), 8 deletions(-) From kenj@internode.on.net Tue Feb 17 16:21:08 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 890837F60 for ; Tue, 17 Feb 2015 16:21:08 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 66FC1304032 for ; Tue, 17 Feb 2015 14:21:08 -0800 (PST) X-ASG-Debug-ID: 1424211660-04cb6c6b0c4861d0001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id wJCMv8elTdGyxhD8 for ; Tue, 17 Feb 2015 14:21:01 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2AmAgACvuNUPL2b0XYNToNYWoMDgy6yYIk4h1gBAQEBAQEFAQEBATiEcRVAMAYCBRYLAgsDAgECATEOGQYCAQHBBHCYHYEhjnmCUoFCBYVajTWHMJE9hCRbgkMBAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail04.adl6.internode.on.net with ESMTP; 18 Feb 2015 08:50:40 +1030 Message-ID: <54E3BEE3.6030204@internode.on.net> Date: Wed, 18 Feb 2015 09:21:23 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1424211661 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15451 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (4): qa/720: generalize filter and valgrind suppressions pmatop.py: make exception more specific qa/admin/check-vm: fix RRDs lines qa/660: remove ambiguous output and improve diagnostics qa/660 | 72 +++++++++++++++++++++++++++++++++++++-------------- qa/660.out.4 | 10 ++++--- qa/660.out.46 | 10 ++++--- qa/720 | 17 ++++++++++-- qa/admin/check-vm | 4 +- qa/valgrind-suppress | 16 ----------- src/pmatop/pmatop.py | 2 - 7 files changed, 86 insertions(+), 45 deletions(-) Details ... commit 818920d369237997824fc8743544b491f2081d7a Author: Ken McDonell Date: Wed Feb 18 09:19:03 2015 +1100 qa/660: remove ambiguous output and improve diagnostics commit 139c81d487a7071e5a6094820e50cfe81f57def6 Author: Ken McDonell Date: Wed Feb 18 07:20:22 2015 +1100 qa/admin/check-vm: fix RRDs lines commit a2c6ee3313a52311b804a9e47a1568206a45add2 Author: Ken McDonell Date: Wed Feb 18 07:19:19 2015 +1100 pmatop.py: make exception more specific Use OSError rather than Exception for last change. commit f29445723f9c0155e11f975fb9a51fa286c67aa1 Author: Ken McDonell Date: Wed Feb 18 07:15:53 2015 +1100 qa/720: generalize filter and valgrind suppressions This commit combines my changes and Nathan's most recent changes. From kenj@internode.on.net Wed Feb 18 01:02:16 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 3E80B7F72 for ; Wed, 18 Feb 2015 01:02:16 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 2D7558F804C for ; Tue, 17 Feb 2015 23:02:12 -0800 (PST) X-ASG-Debug-ID: 1424242927-04cb6c6b0c4b2940001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id C3ittgyac71qsrpG for ; Tue, 17 Feb 2015 23:02:08 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2AmAgCIOORUPL2b0XYNToNYWoMDgy68IYV1gWEBAQEBAQEFAQEBATiEcRVAASkMAgUWCwILAwIBAgExGg0BBwEBwCxwl3EBAQEBBgEBAQEegSGOXIJvgUIFkw+YbYIkHIFkWwGCQgEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 18 Feb 2015 17:31:31 +1030 Message-ID: <54E438F3.4070700@internode.on.net> Date: Wed, 18 Feb 2015 18:02:11 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Stan Cox CC: PCP Subject: getdate.y in libpcp Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: getdate.y in libpcp Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1424242928 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15468 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Stan, Where did the getdate.y source come from? qa/752 is now failing everyday after I extended the scope of the testing coverage. I've tried to locate the original source for getdate.y without success. The closest I can find is the (renamed from getdate.y) parse-datetime.y in the lib dir from git://git.savannah.gnu.org/gnulib.git but this contains at least one critical difference compared to getdate.y in the area where qa/752 is breaking. When we suck source code into PCP I think it is really important that we (a) don't do it unless there is no choice (accepted in this case), (b) clearly annotate the PCP source with the original source location (c) where possible provide some mechanism to track and (better) refresh our version when the external version moves (including reapplying PCP-specific patches, as has obviously been done with getdate.y). Any background would be most helpful. Cheers, Ken. From fche@redhat.com Wed Feb 18 10:21:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 4358E7F78 for ; Wed, 18 Feb 2015 10:21:18 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id D4F0EAC001 for ; Wed, 18 Feb 2015 08:21:14 -0800 (PST) X-ASG-Debug-ID: 1424276470-04cbb01165474af0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id oE7EjXQk0lqiPG4I (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 18 Feb 2015 08:21:10 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1IGL5ic010540 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Wed, 18 Feb 2015 11:21:06 -0500 Received: from fche.csb (vpn-233-48.phx2.redhat.com [10.3.233.48]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1IGL27A032080; Wed, 18 Feb 2015 11:21:05 -0500 Received: by fche.csb (Postfix, from userid 2569) id 4E58B58516; Wed, 18 Feb 2015 11:20:57 -0500 (EST) To: Ken McDonell Cc: Stan Cox , pcp@oss.sgi.com Subject: Re: getdate.y in libpcp References: <54E438F3.4070700@internode.on.net> X-ASG-Orig-Subj: Re: getdate.y in libpcp From: fche@redhat.com (Frank Ch. Eigler) Date: Wed, 18 Feb 2015 11:20:57 -0500 In-Reply-To: <54E438F3.4070700@internode.on.net> (Ken McDonell's message of "Wed, 18 Feb 2015 18:02:11 +1100") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424276470 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Ken McDonell writes: > [...] > Where did the getdate.y source come from? The initial pcp commit for getdate.y identified gnulib as the source. (It would ideally have given the exact version.) > The closest I can find is the (renamed from getdate.y) > parse-datetime.y in the lib dir from > git://git.savannah.gnu.org/gnulib.git but this contains at least one > critical difference compared to getdate.y in the area where qa/752 > is breaking. We'd have to forward-port that patch, except ... > [...] > (c) where possible provide some mechanism to track and (better) > refresh our version when the external version moves (including > reapplying PCP-specific patches, as has obviously been done with > getdate.y). ... a complication with this is that gnulib is now GPL3-licensed. Because PCP is LGPL2+/GPL2+, scox was forced to import a pre-GPL3 snapshot of the gnulib code. That means that any upstream improvements need to be sort of reinvented. - FChE From cwatson@netflix.com Wed Feb 18 11:31:22 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,T_DKIM_INVALID autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 0E1F029E05 for ; Wed, 18 Feb 2015 11:31:22 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id F1372304059 for ; Wed, 18 Feb 2015 09:31:18 -0800 (PST) X-ASG-Debug-ID: 1424280673-04cb6c6b0b4ce7d0001-S8gJnT Received: from mail-ie0-f182.google.com (mail-ie0-f182.google.com [209.85.223.182]) by cuda.sgi.com with ESMTP id BOAb89u5ibNiySNs (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Wed, 18 Feb 2015 09:31:14 -0800 (PST) X-Barracuda-Envelope-From: cwatson@netflix.com Received: by iecrd18 with SMTP id rd18so3037506iec.5 for ; Wed, 18 Feb 2015 09:31:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netflix.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=f7dXVfhHoJDVngWSoUbN2ZX3IAurG/D6s9XzSV7fnkI=; b=X4iXbe71WKaECEbmOQ/uLk74kPKasHJrPTylJZFedpf6Og4Qx83KN6PRp0JbQNK8by RPTOdAXyc0qA93YdykWDMbLQuXEgUftO3qDgq1mipGYNrGgaeATPxXwHoli/VO2sxodm AoYK/27mMvWM4pluCCj6ElVeUGABmQX5P5DcM= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-type; bh=f7dXVfhHoJDVngWSoUbN2ZX3IAurG/D6s9XzSV7fnkI=; b=iXP9UkK/pjHqEvIGW+upvwGCaK64ySm/495WYAzBRsz8z3jQxhomtSood1uD3+N4wn 3uilRzMPTwCmGX7FIluXKN6u9htkFovsQrqG7l/GfzaEeL1IEsT2qIS59Fs94/u2KYl2 qs2IjwXtHDJe9h7tQyO4v0EEc6vsjZh7vBRGVpkNpAMH+WFPpLGZSYdSBgnoNlFJcC1c xXiyJEqE/GP2zLJ54eEgHohn4iUoYk5xc6phKzLm/JtOhBsPadydLCxfZFFxbFrxYOEm HcBY53RejUWcj/j7969uhdnoIIx3OTjOevAyGPYdEa91WpP/RGh3d7QoYIv295Zu+YT3 QoYw== X-Gm-Message-State: ALoCoQlpaETvscPGHBKkg1/wmHNnDSSQklwUFPMKT53FsN4FltrYCJll3uXeXBqc+prYKgwhNG7Q X-Received: by 10.43.54.4 with SMTP id vs4mr1313769icb.72.1424280673749; Wed, 18 Feb 2015 09:31:13 -0800 (PST) MIME-Version: 1.0 Received: by 10.50.164.133 with HTTP; Wed, 18 Feb 2015 09:30:33 -0800 (PST) In-Reply-To: References: <1717887824.20744079.1401960303984.JavaMail.zimbra@redhat.com> <20140605115447.GC11474@redhat.com> <1295610433.21793898.1402006255252.JavaMail.zimbra@redhat.com> <878364148.23139544.1402347444401.JavaMail.zimbra@redhat.com> <1678088280.23964559.1402473510747.JavaMail.zimbra@redhat.com> <20140915174139.GA21897@redhat.com> From: Coburn Watson Date: Wed, 18 Feb 2015 09:30:33 -0800 Message-ID: Subject: Re: PCP web client on different domain To: Martin Spier X-ASG-Orig-Subj: Re: PCP web client on different domain Cc: "Frank Ch. Eigler" , Nathan Scott , Amer Ather , pcp@oss.sgi.com Content-Type: multipart/alternative; boundary=bcaec51b1c199ea2d8050f602fe5 X-Barracuda-Connect: mail-ie0-f182.google.com[209.85.223.182] X-Barracuda-Start-Time: 1424280674 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, DKIM_SIGNED, DKIM_VERIFIED, HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15490 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 HTML_MESSAGE BODY: HTML included in message 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain --bcaec51b1c199ea2d8050f602fe5 Content-Type: text/plain; charset=UTF-8 FYI for the PCP guys, we created a techblog post today which mentioned our utility built on top of PCP. You might see an uptick in hits on your site. Coburn On Tue, Sep 16, 2014 at 9:50 AM, Martin Spier wrote: > Awesome! Thank you Frank! > > On Mon, Sep 15, 2014 at 10:41 AM, Frank Ch. Eigler > wrote: > >> Hi, Martin - >> >> > Noticed today that the ACAO header is only being returned on success >> > responses (2xx). I have a few error cases where context might have >> expired >> > or some other problem, and an error response (4xx, 5xx) response is >> > expected. [...] >> >> OK, will shortly add ACAO to the error cases too. >> >> >> - FChE >> > > --bcaec51b1c199ea2d8050f602fe5 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
FYI for the PCP guys, we created a techblog post t= oday which mentioned our utility built on top of PCP.=C2=A0 You might s= ee an uptick in hits on your site.

Coburn

On Tue, Sep 16, 2014= at 9:50 AM, Martin Spier <mspier@netflix.com> wrote:
Awesome! Thank you Frank!

On Mon, Sep 15,= 2014 at 10:41 AM, Frank Ch. Eigler <fche@redhat.com> wrote:
Hi, Martin -

> Noticed today that the ACAO header is only being returned on success > responses (2xx). I have a few error cases where context might have exp= ired
> or some other problem, and an error response (4xx, 5xx) response is
> expected. [...]

OK, will shortly add ACAO to the error cases too.


- FChE


--bcaec51b1c199ea2d8050f602fe5-- From nscott@redhat.com Wed Feb 18 15:44:32 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 3AE4B7F9E for ; Wed, 18 Feb 2015 15:44:32 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 27CF68F804C for ; Wed, 18 Feb 2015 13:44:32 -0800 (PST) X-ASG-Debug-ID: 1424295863-04cb6c6b0a4d5460001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id CoNMALZkbQ6aZ2LE (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 18 Feb 2015 13:44:24 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1ILiL96006881; Wed, 18 Feb 2015 16:44:21 -0500 Date: Wed, 18 Feb 2015 16:44:20 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Coburn Watson Cc: Martin Spier , Amer Ather , pcp@oss.sgi.com Message-ID: <1210032350.9812593.1424295860560.JavaMail.zimbra@redhat.com> In-Reply-To: References: <878364148.23139544.1402347444401.JavaMail.zimbra@redhat.com> <1678088280.23964559.1402473510747.JavaMail.zimbra@redhat.com> <20140915174139.GA21897@redhat.com> Subject: Re: PCP web client on different domain MIME-Version: 1.0 X-ASG-Orig-Subj: Re: PCP web client on different domain Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: PCP web client on different domain Thread-Index: 3bx1gdaDtT4pBYTgHfFb1Ax0C9qCNA== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1424295863 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15500 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Coburn, ----- Original Message ----- > FYI for the PCP guys, we created a techblog post today > which > mentioned our utility built on top of PCP. You might see an uptick in hits > on your site. > Awesome, and makes for fascinating read - thanks for sharing! cheers. -- Nathan From nscott@redhat.com Wed Feb 18 17:59:22 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=T_FRT_FOLLOW1 autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 3C38F7FAB for ; Wed, 18 Feb 2015 17:59:22 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 1BC1B8F8049 for ; Wed, 18 Feb 2015 15:59:19 -0800 (PST) X-ASG-Debug-ID: 1424303953-04bdf06a5b4d5c60001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id yGhbeHRGVYAq9W0u (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 18 Feb 2015 15:59:13 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1INxDJp020915 for ; Wed, 18 Feb 2015 18:59:13 -0500 Date: Wed, 18 Feb 2015 18:59:13 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: PCP Message-ID: <92374664.9887879.1424303953153.JavaMail.zimbra@redhat.com> In-Reply-To: <1641258487.9887503.1424303826250.JavaMail.zimbra@redhat.com> Subject: pcp updates: pmatop MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: pmatop Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: pmatop Thread-Index: mtGoUjN8J9b8QSF6Aseiw4OS/EwrgA== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1424303953 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15506 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev man/man1/pmatop.1 | 78 ++++--- qa/722 | 42 +++- qa/722.out | 454 +++++++++++++++++++++++++++++++++++++++++++++ src/pmatop/pmatop.py | 69 +++--- src/python/pcp/pmsubsys.py | 6 5 files changed, 564 insertions(+), 85 deletions(-) commit f4a8fea2dc2208d842133b2efcb6aa9c7bd2ce22 Author: Nathan Scott Date: Thu Feb 19 10:53:04 2015 +1100 pmatop: add -a/--archive and related option support In addition to its existing archive folio read/write support, this adds direct archive access into pmatop(1). Requested by Red Hat support folks for a more user friendly experience. Test qa/722 is extended to verify the new functionality, and to compare folio vs archive access. The latter tickled some other bugs - pmatop was reporting live timestamps instead of those from the fetch request, and was directly accessing the localhost DM setup. These issues are resolved here as well. From kenj@internode.on.net Wed Feb 18 18:13:52 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 7F69E7FAD for ; Wed, 18 Feb 2015 18:13:52 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 5EA09304053 for ; Wed, 18 Feb 2015 16:13:49 -0800 (PST) X-ASG-Debug-ID: 1424304825-04bdf06a594d7e40001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id E6UHw5E5Uvihc6EJ for ; Wed, 18 Feb 2015 16:13:45 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2AnAgDjKeVUPL2b0XYNToc6gy7CGQGBbQEBAQEBAQUBAQEBOIRxFUA2AgUWCwILAwIBAgExGg0IAQHBe3CYcoEhkUuBQgWjZYgshCSDHgEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 19 Feb 2015 10:43:45 +1030 Message-ID: <54E52AE7.3030208@internode.on.net> Date: Thu, 19 Feb 2015 11:14:31 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: PCP Subject: perl-rddtool or rddtool-perl rpm for fc21 Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: perl-rddtool or rddtool-perl rpm for fc21 Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1424304825 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15506 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Recent ganglia additions have added to the packages dependency list for QA. But yum can't find either perl-rddtool or rddtool-perl rpms (there is some confusion about the name of the package) for fc21. What am I doing wrong? From kenj@internode.on.net Wed Feb 18 18:21:59 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 6393D7FAD for ; Wed, 18 Feb 2015 18:21:59 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 5174B304043 for ; Wed, 18 Feb 2015 16:21:59 -0800 (PST) X-ASG-Debug-ID: 1424305313-04cbb0116548f0d0001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id jx65QOM61boFAm6r for ; Wed, 18 Feb 2015 16:21:54 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DcAQBELOVUPL2b0XYNTopov1SCTwKBYgEBAQEBAQUBAQEBOIRIAQEEOEARCxgJFg8JAwIBAgExFBMIAQHBfJk2AQEIAgEfiw+EdRaEFAEErBqEJIMeAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 19 Feb 2015 10:51:21 +1030 Message-ID: <54E52CAF.2070800@internode.on.net> Date: Thu, 19 Feb 2015 11:22:07 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] perl-rddtool or rddtool-perl rpm for fc21 References: <54E52AE7.3030208@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] perl-rddtool or rddtool-perl rpm for fc21 In-Reply-To: <54E52AE7.3030208@internode.on.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1424305313 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15508 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 19/02/15 11:14, Ken McDonell wrote: > Recent ganglia additions have added to the packages dependency list for QA. > > But yum can't find either perl-rddtool or rddtool-perl rpms (there is > some confusion about the name of the package) for fc21. > > What am I doing wrong? Typing the wrong rpm name (rrd.. works better than rdd..) ... sorry for the noise. From nscott@redhat.com Wed Feb 18 21:11:08 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id A1D977FAF for ; Wed, 18 Feb 2015 21:11:08 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 7FB96304032 for ; Wed, 18 Feb 2015 19:11:05 -0800 (PST) X-ASG-Debug-ID: 1424315463-04cbb01163497300001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id l5SvjmErbGfcSGMx (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 18 Feb 2015 19:11:04 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1J3AlK6032443; Wed, 18 Feb 2015 22:10:47 -0500 Date: Wed, 18 Feb 2015 22:10:47 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: PCP Message-ID: <202268786.9935927.1424315447586.JavaMail.zimbra@redhat.com> In-Reply-To: <54E181EE.7000504@internode.on.net> References: <54E181EE.7000504@internode.on.net> Subject: Re: [pcp] qa/977 failing a lot MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] qa/977 failing a lot Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: qa/977 failing a lot Thread-Index: HwsWFj43+skvk4lCXXpv4ZpDUhqxuw== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1424315463 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15514 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi, ----- Original Message ----- > All failures are the same and involve extra lines: > > pmNewContext(host=pcp://localhost?container=fe4564ddf901): Connection refused > and > pmNewContext(host=local:?container=fe4564ddf901): Connection refused > > .out.bad attached. > > Any clues? I have a good reproducible test case for this one, tracking it down now... cheers. -- Nathan From kenj@internode.on.net Wed Feb 18 21:15:11 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id D9E357FB1 for ; Wed, 18 Feb 2015 21:15:11 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id C5283304053 for ; Wed, 18 Feb 2015 19:15:11 -0800 (PST) X-ASG-Debug-ID: 1424315709-04cbb01164497400001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id QO6fxH1kwsJtcHT1 for ; Wed, 18 Feb 2015 19:15:09 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2CiAQBoVOVU/72b0XYNToc6wwKCTwKBYgEBAQEBAYUIAQEBBCMVQAEMBAsYAgIFFgsCAgkDAgECAUUGDQEHAQHBQXCYQgEBAQEBAQEDAQEBAQEBARuBIYluhG4HgmiBQgEErBqEJIMeAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail07.adl2.internode.on.net with ESMTP; 19 Feb 2015 13:45:08 +1030 Message-ID: <54E5555E.5090805@internode.on.net> Date: Thu, 19 Feb 2015 14:15:42 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Nathan Scott CC: PCP Subject: Re: [pcp] qa/977 failing a lot References: <54E181EE.7000504@internode.on.net> <202268786.9935927.1424315447586.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] qa/977 failing a lot In-Reply-To: <202268786.9935927.1424315447586.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1424315709 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15514 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 19/02/15 14:10, Nathan Scott wrote: > Hi, > > ----- Original Message ----- >> All failures are the same and involve extra lines: >> >> pmNewContext(host=pcp://localhost?container=fe4564ddf901): Connection refused >> and >> pmNewContext(host=local:?container=fe4564ddf901): Connection refused >> >> .out.bad attached. >> >> Any clues? > > I have a good reproducible test case for this one, tracking it down now... I dug a little this morning and I think it is the $ pminfo -v --container=test in the pre-test check that kills pmcd. A little more work and I believe this is what kills pmcd (or at least this does for sure, there may be others hiding after this one) ... $ pminfo -v hinv.nfilesys --container=test From nscott@redhat.com Wed Feb 18 21:20:29 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 42DCA7F55 for ; Wed, 18 Feb 2015 21:20:29 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 207098F8033 for ; Wed, 18 Feb 2015 19:20:28 -0800 (PST) X-ASG-Debug-ID: 1424316024-04bdf06a5b4e22d0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id bcmeFPspabxhzhn2 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 18 Feb 2015 19:20:24 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1J3KLxu007134; Wed, 18 Feb 2015 22:20:21 -0500 Date: Wed, 18 Feb 2015 22:20:21 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: PCP Message-ID: <133611888.9936973.1424316021734.JavaMail.zimbra@redhat.com> In-Reply-To: <54E5555E.5090805@internode.on.net> References: <54E181EE.7000504@internode.on.net> <202268786.9935927.1424315447586.JavaMail.zimbra@redhat.com> <54E5555E.5090805@internode.on.net> Subject: Re: [pcp] qa/977 failing a lot MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] qa/977 failing a lot Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: qa/977 failing a lot Thread-Index: caoO1Ptv5OkoEl8BCOTRc24bA9zVuA== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1424316024 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15515 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > [...] > I dug a little this morning and I think it is the > $ pminfo -v --container=test > in the pre-test check that kills pmcd. > Yes, its definitely that step, and its definitely something inside the Linux kernel PMDA. cheers. -- Nathan From nscott@redhat.com Wed Feb 18 21:22:09 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id C8DD27F58 for ; Wed, 18 Feb 2015 21:22:09 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 9FEC6304053 for ; Wed, 18 Feb 2015 19:22:09 -0800 (PST) X-ASG-Debug-ID: 1424316126-04bdf06a5b4e2340001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id bO2El37Je75dKqSG (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 18 Feb 2015 19:22:07 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1J3M61J002580 for ; Wed, 18 Feb 2015 22:22:06 -0500 Date: Wed, 18 Feb 2015 22:22:06 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: PCP Message-ID: <48743451.9937378.1424316126605.JavaMail.zimbra@redhat.com> In-Reply-To: <1707044997.9920220.1424310059456.JavaMail.zimbra@redhat.com> Subject: Google Summer of Code MIME-Version: 1.0 X-ASG-Orig-Subj: Google Summer of Code Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Google Summer of Code Thread-Index: 8VEGkwryGMNWd4jNi0lT4wKOXl7KWA== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1424316127 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 1.02 X-Barracuda-Spam-Status: No, SCORE=1.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MV0613, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15515 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 1.00 BSF_SC0_MV0613 BSF_SC0_MV0613 Hi all, After gauging interest from all The Usual Suspects, it looks like we'll be able to put in a strong proposal for the PCP project to participate in this years Google Summer of Code. At this stage we have a number of interesting student tasks backed by a number of experienced developers. If there is anyone I have forgotten to ask who is interested in volunteering as a mentor or a backup mentor, please let me know ASAP. The list of our project ideas so far is here: http://pcp.io/gsoc/2015/ideas.html Information for potential mentors can be found at the FAQ here: https://www.google-melange.com/gsoc/homepage/google/gsoc2015 (see especially section 3, question 8 regarding time commitments) Many thanks to all those who have volunteered their time, and the people who have offered to be backup organisation administrators! I'll forward more details about the program once we hear back from Google - one way or the other - which should be early March AIUI. cheers. -- Nathan From mgoodwin@redhat.com Wed Feb 18 22:29:54 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 701E57FB1 for ; Wed, 18 Feb 2015 22:29:54 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 18403AC001 for ; Wed, 18 Feb 2015 20:29:50 -0800 (PST) X-ASG-Debug-ID: 1424320189-04bdf06a5b4e3250001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id cUpA0TVpSsHuWGZ7 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 18 Feb 2015 20:29:50 -0800 (PST) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1J4TnOE024257 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 18 Feb 2015 23:29:49 -0500 Received: from [10.64.51.25] (vpn1-51-25.bne.redhat.com [10.64.51.25]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1J4Tm99010399 for ; Wed, 18 Feb 2015 23:29:48 -0500 Message-ID: <54E566BB.1040206@redhat.com> Date: Thu, 19 Feb 2015 15:29:47 +1100 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] qa/977 failing a lot References: <54E181EE.7000504@internode.on.net> <202268786.9935927.1424315447586.JavaMail.zimbra@redhat.com> <54E5555E.5090805@internode.on.net> <133611888.9936973.1424316021734.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] qa/977 failing a lot In-Reply-To: <133611888.9936973.1424316021734.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424320190 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 02/19/2015 02:20 PM, Nathan Scott wrote: > > > ----- Original Message ----- >> [...] >> I dug a little this morning and I think it is the >> $ pminfo -v --container=test >> in the pre-test check that kills pmcd. >> > > Yes, its definitely that step, and its definitely something inside the Linux > kernel PMDA. pminfo -v --container=test seems to be erroneously calling close(0) (twice!) after a failed setns() call, and this ends up closing the pipe to the linux PMDA : The log message agrees : # cat /var/log/pcp/pmcd/linux.log Log for pmdalinux on snodgrass started Thu Feb 19 15:22:32 2015 [Thu Feb 19 15:23:16] pmdalinux(14177) Error: __pmGetPDU: fd=0 hdr read: len=-1: Bad file descriptor And here's the strace on the pmdalinux process : .... read(7, "", 1024) = 0 close(7) = 0 munmap(0x7f84752fc000, 4096) = 0 setns(0, 0) = -1 EINVAL (Invalid argument) setns(0, 0) = -1 EINVAL (Invalid argument) close(0) = 0 close(0) = -1 EBADF (Bad file descriptor) write(1, "\0\0\0\220\0\0p\1\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\6\17\0\4\t\0\0\0\1"..., 144) = 144 read(0, 0x1e5c000, 12) = -1 EBADF (Bad file descriptor) umask(0177) = 022 open("/var/tmp/pcp-RVI0sl", O_RDWR|O_CREAT|O_EXCL, 0600) = 0 umask(022) = 0177 fcntl(0, F_GETFL) = 0x8002 (flags O_RDWR|O_LARGEFILE) fcntl(0, F_SETFL, O_RDWR|O_APPEND|O_LARGEFILE) = 0 lseek(0, 0, SEEK_END) = 0 fstat(0, {st_mode=S_IFREG|0600, st_size=0, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f84752fc000 write(0, "[Thu Feb 19 15:23:16] pmdalinux("..., 101) = 101 lseek(0, 0, SEEK_SET) = 0 read(0, "[Thu Feb 19 15:23:16] pmdalinux("..., 256) = 101 write(2, "[Thu Feb 19 15:23:16] pmdalinux("..., 101) = 101 read(0, "", 256) = 0 close(0) = 0 munmap(0x7f84752fc000, 4096) = 0 unlink("/var/tmp/pcp-RVI0sl") = 0 write(2, "\n", 1) = 1 write(2, "Log finished Thu Feb 19 15:23:16"..., 38) = 38 exit_group(0) = ? +++ exited with 0 +++ From nscott@redhat.com Wed Feb 18 22:43:30 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id C28D77FB1 for ; Wed, 18 Feb 2015 22:43:30 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 5C642AC002 for ; Wed, 18 Feb 2015 20:43:30 -0800 (PST) X-ASG-Debug-ID: 1424321008-04cbb01163498750001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id x15XePAMHOyLPJX3 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 18 Feb 2015 20:43:28 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1J4hRvx013989; Wed, 18 Feb 2015 23:43:27 -0500 Date: Wed, 18 Feb 2015 23:43:27 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Mark Goodwin Cc: pcp@oss.sgi.com Message-ID: <992538925.9962917.1424321007847.JavaMail.zimbra@redhat.com> In-Reply-To: <54E566BB.1040206@redhat.com> References: <54E181EE.7000504@internode.on.net> <202268786.9935927.1424315447586.JavaMail.zimbra@redhat.com> <54E5555E.5090805@internode.on.net> <133611888.9936973.1424316021734.JavaMail.zimbra@redhat.com> <54E566BB.1040206@redhat.com> Subject: Re: [pcp] qa/977 failing a lot MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] qa/977 failing a lot Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: qa/977 failing a lot Thread-Index: wBab+d5g1lC1l+FHG8KpaKH20a1N7Q== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1424321008 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15517 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > On 02/19/2015 02:20 PM, Nathan Scott wrote: > [...] > pminfo -v --container=test > > seems to be erroneously calling close(0) (twice!) after a failed setns() > call, and this ends up closing the pipe to the linux PMDA : Yep, Ken & I are testing the fix as we speak (will commit shortly, let me know if you want it earlier). Thanks Mark! cheers. -- Nathan From nscott@redhat.com Wed Feb 18 23:21:13 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id CBD837FB1 for ; Wed, 18 Feb 2015 23:21:13 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id BA1B98F8039 for ; Wed, 18 Feb 2015 21:21:10 -0800 (PST) X-ASG-Debug-ID: 1424323265-04cbb01165499270001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id AQ9DkWKRFdHRzcAE (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 18 Feb 2015 21:21:06 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1J5L5eC023913 for ; Thu, 19 Feb 2015 00:21:05 -0500 Date: Thu, 19 Feb 2015 00:21:05 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: PCP Message-ID: <1144105873.9970613.1424323265347.JavaMail.zimbra@redhat.com> In-Reply-To: <576859181.9970203.1424323173243.JavaMail.zimbra@redhat.com> Subject: pcp updates: pmdalinux fix MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: pmdalinux fix Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: pmdalinux fix Thread-Index: PPWakQs/3H93YXAXhfKi3+SEfbxXSw== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1424323266 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15519 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Nathan Scott (1): pmdalinux: fix error handling in refresh with bad container names qa/767 | 38 ++++++++++++++++++++++++++++++++++++++ qa/767.out | 20 ++++++++++++++++++++ qa/group | 1 + src/libpcp_pmda/src/root.c | 4 ++-- src/pmdas/linux/pmda.c | 24 +++++++++++++----------- 5 files changed, 74 insertions(+), 13 deletions(-) From kenj@internode.on.net Thu Feb 19 03:31:50 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 2C6957FB3 for ; Thu, 19 Feb 2015 03:31:50 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id F1789304053 for ; Thu, 19 Feb 2015 01:31:46 -0800 (PST) X-ASG-Debug-ID: 1424338303-04bdf06a5c504b40001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id 8vyGDJFCL2jD8BqR for ; Thu, 19 Feb 2015 01:31:43 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2D4AQCOrOVUPL2b0XYNToQyhjbCKgKBWgEBAQEBAQUBAQEBOIRIAQEEOEABEAsYCRYPCQMCAQIBMRQGDQEFAgEBwU+ZMgEBAQEBAQEDAQEBAQEBARuLD4RuB4QqAQSNV55DgiQcgWRbgkMBAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail04.adl6.internode.on.net with ESMTP; 19 Feb 2015 20:01:42 +1030 Message-ID: <54E5ADAD.7000204@internode.on.net> Date: Thu, 19 Feb 2015 20:32:29 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: "Frank Ch. Eigler" CC: Stan Cox , pcp@oss.sgi.com Subject: Re: getdate.y in libpcp References: <54E438F3.4070700@internode.on.net> X-ASG-Orig-Subj: Re: getdate.y in libpcp In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1424338303 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15527 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header On 19/02/15 03:20, Frank Ch. Eigler wrote: > Ken McDonell writes: > >> [...] >> Where did the getdate.y source come from? > > The initial pcp commit for getdate.y identified gnulib as the source. > (It would ideally have given the exact version.) Thanks for the background Frank. Pending a decision on the questions I pose below, I'll add comments to the head of the file to capture this history. > ... > ... a complication with this is that gnulib is now GPL3-licensed. > Because PCP is LGPL2+/GPL2+, scox was forced to import a pre-GPL3 > snapshot of the gnulib code. That means that any upstream > improvements need to be sort of reinvented. OK. I can see 3 possible ways forward: 1. move PCP to GPL3 ... by itself this issue is not important enough to open that Pandora's box of worms! 2. use the FreeBSD version instead ... looks like a fair amount of work and the potential differences in implementation may mean that the end result will not mimic gnu date(1) and so qa/752 will still fail 3. leave sleeping dogs lie ... the problem is a corner case involving the semantics for -S (or -T) "" when today is , e.g. thursday as I type. I doubt anyone has used this, and even if they have I'd argue they should not be surprised by the semantics of being the "next " (in this one case), especially given the totally confusing semantics of "first " and "next " that are implemented in date(1) and copied in libpcp ... not to mention the irrelevance of all of this for non-English speakers! I vote for 3. If we agree, I'd split qa/752 into a passing part and a retired part that captures the failure scenario with a big explanation at in the both qa tests to explain what has happened and why. Opinions? From christlegaard17@hotmail.com Thu Feb 19 07:58:33 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: * X-Spam-Status: No, score=1.3 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT, FREEMAIL_FROM,FREEMAIL_REPLYTO autolearn=no version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 2C3B47FC1 for ; Thu, 19 Feb 2015 07:58:33 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id AB13CAC001 for ; Thu, 19 Feb 2015 05:58:29 -0800 (PST) X-ASG-Debug-ID: 1424354307-04cb6c6b0c523c30001-S8gJnT Received: from host.themainserver.com ([192.190.80.34]) by cuda.sgi.com with ESMTP id ApKQ2CGBFpq9LQuR (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 19 Feb 2015 05:58:27 -0800 (PST) X-Barracuda-Envelope-From: christlegaard17@hotmail.com X-Barracuda-Apparent-Source-IP: 192.190.80.34 Received: from localhost ([::1]:58367 helo=supernovacolor.com) by host.themainserver.com with esmtpa (Exim 4.82) (envelope-from ) id 1YORb4-0004EH-0c; Thu, 19 Feb 2015 06:56:54 -0700 Received: from 41.138.176.6 ([41.138.176.6]) (SquirrelMail authenticated user info@supernovacolor.com) by supernovacolor.com with HTTP; Thu, 19 Feb 2015 06:56:54 -0700 Message-ID: <3e63200e0e760bbb1fae731de5dc2182.squirrel@supernovacolor.com> Date: Thu, 19 Feb 2015 06:56:54 -0700 Subject: Delivery of Your Diplomatic Luggage 112 From: "International Monetary Funds" X-ASG-Orig-Subj: Delivery of Your Diplomatic Luggage 112 Reply-To: christlegaard17@gmail.com User-Agent: SquirrelMail/1.5.2 [SVN] MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - host.themainserver.com X-AntiAbuse: Original Domain - oss.sgi.com X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - hotmail.com X-Get-Message-Sender-Via: host.themainserver.com: authenticated_id: info@supernovacolor.com X-Source: X-Source-Args: X-Source-Dir: X-Barracuda-Connect: UNKNOWN[192.190.80.34] X-Barracuda-Start-Time: 1424354307 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 1.31 X-Barracuda-Spam-Status: No, SCORE=1.31 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=MISSING_HEADERS, RDNS_NONE, TO_CC_NONE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15535 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 1.21 MISSING_HEADERS Missing To: header 0.00 TO_CC_NONE No To: or Cc: header 0.10 RDNS_NONE Delivered to trusted network by a host with no rDNS To: undisclosed-recipients:; Attention To You: On behalf of the board and management of International Monetary Financial Committee. I Christine Lagarde, the Operations Manager wishes to inform you that your consignment/fund tagged diplomatic luggage 122 with Ref: No1226/X42/206 which was deposited in our vault for safe keeping is due for Immediate collection. Be informed that we have concluded all arrangements to deliver your consignment at your doorstep through diplomatic means. In line with the binding diplomatic consignment delivery policies, kindly furnish us with the following as set forth. . A copy of your international passport or any other means of identification as the true consignee. . The address where the above cargo/funds should be delivered to and your phone number. . List the nearest international airport to your address location. Meanwhile, we urge you to treat the above requirement with utmost urgency to enable us dispense our duties and obligation accordingly thereby allowing us to serve you in a timely fashion. Upon satisfactory receipt of all the above mentioned, you will be further acquainted with the detailed delivery itinerary including information of the diplomat who will accompany your consignment. We pledge our best service at all times. Yours Faithfully, Christine Lagarde Foreign Operations Manager From fche@redhat.com Thu Feb 19 17:16:35 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: ** X-Spam-Status: No, score=3.0 required=5.0 tests=TVD_SUBJ_NUM_OBFU_MINFP autolearn=no version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 793267F80 for ; Thu, 19 Feb 2015 17:16:35 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 6802E8F8059 for ; Thu, 19 Feb 2015 15:16:35 -0800 (PST) X-ASG-Debug-ID: 1424387790-04cbb011644cf310001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id XXgzxlQYBvp2bMPm (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 19 Feb 2015 15:16:31 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1JNGUbx009134 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 19 Feb 2015 18:16:30 -0500 Received: from fche.csb (vpn-233-48.phx2.redhat.com [10.3.233.48]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1JNGSDG003814 for ; Thu, 19 Feb 2015 18:16:30 -0500 Received: by fche.csb (Postfix, from userid 2569) id 2842858518; Thu, 19 Feb 2015 18:16:22 -0500 (EST) Date: Thu, 19 Feb 2015 18:16:22 -0500 From: "Frank Ch. Eigler" To: pcp developers Subject: pcp update: better pcp2graphite error tolerance Message-ID: <20150219231622.GF1101@redhat.com> X-ASG-Orig-Subj: pcp update: better pcp2graphite error tolerance Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424387791 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - Please see pcpfans.git fche/pcp2graphite: commit e4d49e6321d873123ba266eaf57d6f6524463f30 Author: Frank Ch. Eigler Date: Thu Feb 19 18:12:57 2015 -0500 pcp2graphite: tolerate errors better before/during run It was reported that for rapidly-changing indom metrics such as proc., pcp2graphite would miss a report entirely if an individual metric encountered a PM_ERR_INST during metadata lookup. Moving around python try/except blocks lets as much information pass to graphite/carbon as possible. qa/667 is updated to test this and a few more error scenarios using the sample pmda naughty metrics. From nscott@redhat.com Thu Feb 19 17:42:53 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id C95D17F81 for ; Thu, 19 Feb 2015 17:42:53 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id B8083304053 for ; Thu, 19 Feb 2015 15:42:53 -0800 (PST) X-ASG-Debug-ID: 1424389368-04cb6c6b0b531df0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id vfEwEHINc9yqqFTB (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 19 Feb 2015 15:42:48 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1JNgX80022170; Thu, 19 Feb 2015 18:42:33 -0500 Date: Thu, 19 Feb 2015 18:42:32 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell , Stan Cox Cc: pcp@oss.sgi.com Message-ID: <167042072.11083754.1424389352922.JavaMail.zimbra@redhat.com> In-Reply-To: <54E5ADAD.7000204@internode.on.net> References: <54E438F3.4070700@internode.on.net> <54E5ADAD.7000204@internode.on.net> Subject: Re: [pcp] getdate.y in libpcp MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] getdate.y in libpcp Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.12] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: getdate.y in libpcp Thread-Index: Cnbvzhof6SooKF22X8SWoZ6h6PzVSQ== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1424389368 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15555 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > > Ken McDonell writes: > [...] > > 3. leave sleeping dogs lie ... the problem is a corner case involving > the semantics for -S (or -T) "" when today is , e.g. > thursday as I type. I doubt anyone has used this, and even if they have > I'd argue they should not be surprised by the semantics of > being the "next " (in this one case), especially given the > totally confusing semantics of "first " and "next " > that are implemented in date(1) and copied in libpcp ... not to mention > the irrelevance of all of this for non-English speakers! > > I vote for 3. > > If we agree, I'd split qa/752 into a passing part and a retired part > that captures the failure scenario with a big explanation at in the both > qa tests to explain what has happened and why. > > Opinions? Sounds fine to me. We could also comment out the "NEXT" keyword in the libpcp code, so people cannot hit the bug? Not sure its worth it though just for the corner case. Stan, any idea why SECOND is commented out already, below? seems a bit odd. diff --git a/src/libpcp/src/getdate.y b/src/libpcp/src/getdate.y index cc72571..7bde338 100644 --- a/src/libpcp/src/getdate.y +++ b/src/libpcp/src/getdate.y @@ -622,7 +622,7 @@ static table const relative_time_table[] = { "NOW", tDAY_UNIT, 0 }, { "LAST", tORDINAL, -1 }, { "THIS", tORDINAL, 0 }, - { "NEXT", tORDINAL, 1 }, +/*{ "NEXT", tORDINAL, 1 },*/ { "FIRST", tORDINAL, 1 }, /*{ "SECOND", tORDINAL, 2 }, */ { "THIRD", tORDINAL, 3 }, cheers. -- Nathan From kenj@internode.on.net Thu Feb 19 19:31:58 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 11D5D7F7C for ; Thu, 19 Feb 2015 19:31:58 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 000798F8064 for ; Thu, 19 Feb 2015 17:31:57 -0800 (PST) X-ASG-Debug-ID: 1424395915-04cbb011654d1d20001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id ocbOOEeLmDGFN4s1 for ; Thu, 19 Feb 2015 17:31:55 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DCBQCQjeZU/2J3La9bgwaBLII6T4k0uyh+AoEdQwEBAQEBAXyEDwEBAQQIAhkFUQwBAwIGAw0IBQIjAwICGS0RAgQBEgsFiB67RJgmAQEIAgEfgSGJboRuB4JogUIFj0tZj1YDjDEihAIqMYJDAQEB Received: from unknown (HELO bozohorize) ([175.45.119.98]) by ipmail07.adl2.internode.on.net with ESMTP; 20 Feb 2015 12:01:53 +1030 From: "Ken McDonell" To: "'Nathan Scott'" , "'Stan Cox'" Cc: References: <54E438F3.4070700@internode.on.net> <54E5ADAD.7000204@internode.on.net> <167042072.11083754.1424389352922.JavaMail.zimbra@redhat.com> In-Reply-To: <167042072.11083754.1424389352922.JavaMail.zimbra@redhat.com> Subject: RE: [pcp] getdate.y in libpcp Date: Fri, 20 Feb 2015 12:31:39 +1100 X-ASG-Orig-Subj: RE: [pcp] getdate.y in libpcp Message-ID: <000901d04cad$012cc9b0$03865d10$@internode.on.net> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQI3ROsXNzZY1STX1pgstyyZP7ZJkAFy4+vXAncEQWcCtaAxMpv10x9Q Content-Language: en-au X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1424395915 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15559 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header > -----Original Message----- > From: Nathan Scott [mailto:nathans@redhat.com] > ... > We could also comment out the "NEXT" keyword in the libpcp code, so > people cannot hit the bug? Not sure its worth it though just for the = corner > case. Current problem in qa/752 is not related to NEXT ... it fails for = "Friday" but only when used on Friday! .. and repeat for the other six = days of the week. From wcohen@redhat.com Thu Feb 19 21:12:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 17FC67F3F for ; Thu, 19 Feb 2015 21:12:18 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 8B4A4AC002 for ; Thu, 19 Feb 2015 19:12:14 -0800 (PST) X-ASG-Debug-ID: 1424401932-04cbb011644d3340001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id oHzkIbKFcybGNzc6 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 19 Feb 2015 19:12:13 -0800 (PST) X-Barracuda-Envelope-From: wcohen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1K3CC6g022014 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 19 Feb 2015 22:12:12 -0500 Received: from [10.10.48.238] (vpn-48-238.rdu2.redhat.com [10.10.48.238]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1K3CCMo023810 for ; Thu, 19 Feb 2015 22:12:12 -0500 Message-ID: <54E6A60B.80608@redhat.com> Date: Thu, 19 Feb 2015 22:12:11 -0500 From: William Cohen User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp developers Subject: Pointing pcp to alternative location for papi Content-Type: multipart/mixed; boundary="------------030804090001060303020001" X-ASG-Orig-Subj: Pointing pcp to alternative location for papi X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424401933 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 This is a multi-part message in MIME format. --------------030804090001060303020001 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Hi All, On RHEL-6.5 there is are two version of papi available: papi-4.1.3 for compatibility and papi-5.1.1 for newer features. For compatibility reasons the papi-4.1.3 is the one generally visible to configures by default. The problem is that the pcp configuration find the older 4.1.3 version rather than the shiny new papi-5.1.1. I have been hacking away on on the pcp configuration to allow specifying an alternative directory for papi. There are certainly things wrong with the patch (like it doesn't verify that includes and libraries are really in that directory), but it does allow selection of the papi-5.1.1 directory. Suggestions on how to better handle this would be appreciated. Maybe have separate options to specify include and lib diretories. Note that a similar patch might be desired for the perfevent pmda because there is a newer version of libpfm associated with papi-5.1.1 on rhel6. Default build shows libpapi-4.1.3 being used: $ ./configure --with-papi $ make $ ldd src/pmdas/papi/pmda_papi.so linux-vdso.so.1 => (0x00007fffed675000) libpapi.so => /usr/lib64/papi-4.1.3/libpapi.so (0x00007f5c0b630000) libpcp_pmda.so.3 => not found libpcp.so.3 => not found libdl.so.2 => /lib64/libdl.so.2 (0x00007f5c0b42b000) libc.so.6 => /lib64/libc.so.6 (0x00007f5c0b097000) libpfm.so.3 => /usr/lib64/libpfm.so.3 (0x00007f5c0adb8000) /lib64/ld-linux-x86-64.so.2 (0x0000003143400000) Configure and build specifying the papi-5.1.1 shows papi-5.1. being linked in: $ make clean $ ./configure --with-papi=/usr/lib64/papi-5.1.1/usr $ make $ ldd src/pmdas/papi/pmda_papi.so linux-vdso.so.1 => (0x00007fff3ecf2000) libpapi.so.5 => /usr/lib64/papi-5.1.1/usr/lib/libpapi.so.5 (0x00007ffe44d92000) libpcp_pmda.so.3 => not found libpcp.so.3 => not found libdl.so.2 => /lib64/libdl.so.2 (0x00007ffe44b8d000) libc.so.6 => /lib64/libc.so.6 (0x00007ffe447f9000) libpfm.so.4 => /usr/lib64/papi-5.1.1/usr/lib/libpfm.so.4 (0x00007ffe444b1000) libsensors.so.4 => /usr/lib64/libsensors.so.4 (0x00007ffe442a1000) /lib64/ld-linux-x86-64.so.2 (0x0000003143400000) libm.so.6 => /lib64/libm.so.6 (0x00007ffe4401d000) -Will --------------030804090001060303020001 Content-Type: text/x-patch; name="papi_alt_config2.patch" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="papi_alt_config2.patch" diff --git a/configure b/configure index 85c15cb..6f1006e 100755 --- a/configure +++ b/configure @@ -705,6 +705,7 @@ PMDA_PERFEVENT PFM_LIBS PMDA_PAPI PAPI_LIBS +PAPI_CFLAGS PMDA_INFINIBAND IB_LIBS PMDA_SYSTEMD @@ -1598,7 +1599,10 @@ Optional Packages: --with-python3 enable support for tools requiring Python3 (default is on) --with-books enable building of the PCP books (default is off) - --with-papi enable performance api counter pmda (default is on) + --with-papi[=DIR] enable performance api counter pmda (default is on) + The optional DIR argument can be used to supply the + absolute path name for the primary PAPI installation + directory [default=/usr/local] --with-perfevent enable perfevent pmda (default is on) --with-manager enable daemon manager (default is on) --with-webapi enable REST API daemon (default is on) @@ -10071,7 +10075,18 @@ if test "x$do_papi" != "xno"; then : enable_papi=true + saved_LDFLAGS="$LDFLAGS" + saved_CFLAGS="$CFLAGS" savedLIBS=$LIBS + + case "$do_papi" in + yes|no) PAPI_ROOTDIR=/usr ;; + *) PAPI_ROOTDIR=$do_papi; + CFLAGS="-I$PAPI_ROOTDIR/include" + LDFLAGS="-L$PAPI_ROOTDIR/lib" + ;; + esac + { $as_echo "$as_me:${as_lineno-$LINENO}: checking for PAPI_library_init in -lpapi" >&5 $as_echo_n "checking for PAPI_library_init in -lpapi... " >&6; } if ${ac_cv_lib_papi_PAPI_library_init+:} false; then : @@ -10109,7 +10124,7 @@ fi { $as_echo "$as_me:${as_lineno-$LINENO}: result: $ac_cv_lib_papi_PAPI_library_init" >&5 $as_echo "$ac_cv_lib_papi_PAPI_library_init" >&6; } if test "x$ac_cv_lib_papi_PAPI_library_init" = xyes; then : - papi_libs="-lpapi" + papi_libs="$LDFLAGS -lpapi" else enable_papi=false fi @@ -10121,7 +10136,7 @@ if test "x$ac_cv_header_papi_h" = xyes; then : cat >>confdefs.h <<_ACEOF #define HAVE_PAPI_H 1 _ACEOF - + papi_cflags="$CFLAGS" else enable_papi=false fi @@ -10135,6 +10150,10 @@ done pmda_papi=$enable_papi fi LIBS=$savedLIBS + CFLAGS="$saved_CFLAGS" + LDFLAGS="$saved_LDFLAGS" + PAPI_CFLAGS=$papi_cflags + PAPI_LIBS=$papi_libs diff --git a/configure.ac b/configure.ac index 720ee08..ff90675 100644 --- a/configure.ac +++ b/configure.ac @@ -108,8 +108,12 @@ AC_ARG_WITH([books], [do_books=no]) AC_ARG_WITH([papi], - [AC_HELP_STRING([--with-papi], - [enable performance api counter pmda (default is on)])], + [AC_HELP_STRING([--with-papi@<:@=DIR@:>@], + [enable performance api counter pmda (default is on) + The optional DIR argument + can be used to supply the absolute path name + for the primary PAPI installation directory + @<:@default=/usr/local@:>@])], [do_papi=$withval; PACKAGE_CONFIGURE="$PACKAGE_CONFIGURE --with-papi=$withval"], [do_papi=check]) @@ -1286,11 +1290,22 @@ pmda_papi=false AS_IF([test "x$do_papi" != "xno"], [ enable_papi=true + saved_LDFLAGS="$LDFLAGS" + saved_CFLAGS="$CFLAGS" savedLIBS=$LIBS + + case "$do_papi" in + yes|no) PAPI_ROOTDIR=/usr ;; + *) PAPI_ROOTDIR=$do_papi; + CFLAGS="-I$PAPI_ROOTDIR/include" + LDFLAGS="-L$PAPI_ROOTDIR/lib" + ;; + esac + AC_CHECK_LIB([papi], [PAPI_library_init], - [papi_libs="-lpapi"], + [papi_libs="$LDFLAGS -lpapi"], [enable_papi=false]) - AC_CHECK_HEADERS([papi.h], [], [enable_papi=false]) + AC_CHECK_HEADERS([papi.h], [papi_cflags="$CFLAGS"], [enable_papi=false]) if test "$do_papi" != "check" -a "$enable_papi" != "true" then AC_MSG_ERROR(PAPI is not installed, cannot enable the PAPI PMDA) @@ -1298,6 +1313,9 @@ AS_IF([test "x$do_papi" != "xno"], [ pmda_papi=$enable_papi fi LIBS=$savedLIBS + CFLAGS="$saved_CFLAGS" + LDFLAGS="$saved_LDFLAGS" + AC_SUBST(PAPI_CFLAGS, $papi_cflags) AC_SUBST(PAPI_LIBS, $papi_libs) ]) AC_SUBST(PMDA_PAPI, $pmda_papi) diff --git a/src/include/builddefs.in b/src/include/builddefs.in index a3a08b1..34d9f4d 100644 --- a/src/include/builddefs.in +++ b/src/include/builddefs.in @@ -254,6 +254,7 @@ LIB_FOR_MICROHTTPD = @libmicrohttpd_LIBS@ # configuration state for optional performance domains SYSTEMD_CFLAGS = @SYSTEMD_CFLAGS@ SYSTEMD_LIBS = @SYSTEMD_LIBS@ +PAPI_CFLAGS = @PAPI_CFLAGS@ PAPI_LIBS = @PAPI_LIBS@ PFM_LIBS = @PFM_LIBS@ IB_LIBS = @IB_LIBS@ diff --git a/src/pmdas/papi/GNUmakefile b/src/pmdas/papi/GNUmakefile index 4d362a0..2174f63 100644 --- a/src/pmdas/papi/GNUmakefile +++ b/src/pmdas/papi/GNUmakefile @@ -24,7 +24,7 @@ PMDADIR = $(PCP_PMDAS_DIR)/$(IAM) PMDAINIT = $(IAM)_init LLDLIBS = $(PAPI_LIBS) $(PCP_PMDALIB) -LCFLAGS = $(INVISIBILITY) -I. +LCFLAGS = $(PAPI_CFLAGS) $(INVISIBILITY) -I. CFILES = papi.c DFILES = README help --------------030804090001060303020001-- From brolley@redhat.com Fri Feb 20 14:02:30 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: ** X-Spam-Status: No, score=3.0 required=5.0 tests=TVD_SUBJ_NUM_OBFU_MINFP autolearn=no version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id F22547F47 for ; Fri, 20 Feb 2015 14:02:29 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 8EDD8AC002 for ; Fri, 20 Feb 2015 12:02:26 -0800 (PST) X-ASG-Debug-ID: 1424462541-04cbb011c2041a0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 26s8z0eYheUEvJuK (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 20 Feb 2015 12:02:22 -0800 (PST) X-Barracuda-Envelope-From: brolley@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1KK2Li3015576 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Fri, 20 Feb 2015 15:02:21 -0500 Received: from [10.10.59.197] (vpn-59-197.rdu2.redhat.com [10.10.59.197]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1KK2K0u031944 for ; Fri, 20 Feb 2015 15:02:21 -0500 Message-ID: <54E79314.70009@redhat.com> Date: Fri, 20 Feb 2015 15:03:32 -0500 From: Dave Brolley User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: PCP Mailing List Subject: pcp updates: fche pcp2graphite Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: fche pcp2graphite Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424462542 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Changes committed to git://git.pcp.io/pcp.git dev Frank Ch. Eigler (1): pcp2graphite: tolerate errors better before/during run qa/667 | 23 +++++++ qa/667.out | 17 +++++ src/pcp2graphite/pcp2graphite.py | 116 ++++++++++++++++++++------------------- 3 files changed, 99 insertions(+), 57 deletions(-) From kenj@internode.on.net Fri Feb 20 15:02:52 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id A91567F56 for ; Fri, 20 Feb 2015 15:02:52 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 38819AC006 for ; Fri, 20 Feb 2015 13:02:48 -0800 (PST) X-ASG-Debug-ID: 1424466162-04cb6c02b004490001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id 0qo65pSnQ7JOeXFJ for ; Fri, 20 Feb 2015 13:02:43 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DNAQDun+dUPL2b0XYNToNYg2KDLrxKh1cBAQEBAQEFAQEBATiEdFUwBgIFFgsCCwMCAQIBMQ4ZBgIBAcMdcJhmgSGOeYJSgUMFkyyZFoQkW4JDAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail04.adl6.internode.on.net with ESMTP; 21 Feb 2015 07:32:41 +1030 Message-ID: <54E7A123.8060201@internode.on.net> Date: Sat, 21 Feb 2015 08:03:31 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1424466162 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15598 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (3): qa/667: add sort to make output deterministic qa/admin/check-vm: correct an rpm name qa/752: small change - does not fix big problem qa/667 | 7 +++++-- qa/667.out | 8 ++++---- qa/752 | 14 +++++++------- qa/admin/check-vm | 2 +- 4 files changed, 17 insertions(+), 14 deletions(-) Details ... commit 12c1c7da479e3bbffcf1472f4049bb8ab2657b1c Author: Ken McDonell Date: Sat Feb 21 08:01:30 2015 +1100 qa/752: small change - does not fix big problem commit 14cffae4ce3d2c00a2c7b0be340ef32cbd8ae07b Author: Ken McDonell Date: Sat Feb 21 08:01:09 2015 +1100 qa/admin/check-vm: correct an rpm name commit 877dc82b2afc609daefd75b69252358b6c5b9036 Author: Ken McDonell Date: Sat Feb 21 08:00:20 2015 +1100 qa/667: add sort to make output deterministic From fche@redhat.com Fri Feb 20 16:24:34 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 934797F56 for ; Fri, 20 Feb 2015 16:24:34 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 822E3304059 for ; Fri, 20 Feb 2015 14:24:31 -0800 (PST) X-ASG-Debug-ID: 1424471070-04cb6c4bd000130001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id R8QRKdADl1arZTgR (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 20 Feb 2015 14:24:30 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1KMOQVV006884 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Fri, 20 Feb 2015 17:24:26 -0500 Received: from fche.csb (vpn-233-48.phx2.redhat.com [10.3.233.48]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1KMOQYg016769; Fri, 20 Feb 2015 17:24:26 -0500 Received: by fche.csb (Postfix, from userid 2569) id 738C358518; Fri, 20 Feb 2015 17:24:25 -0500 (EST) To: Ken McDonell Cc: pcp@oss.sgi.com Subject: Re: pcp updates References: <54E3BEE3.6030204@internode.on.net> X-ASG-Orig-Subj: Re: pcp updates From: fche@redhat.com (Frank Ch. Eigler) Date: Fri, 20 Feb 2015 17:24:25 -0500 In-Reply-To: <54E3BEE3.6030204@internode.on.net> (Ken McDonell's message of "Wed, 18 Feb 2015 09:21:23 +1100") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424471070 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Ken McDonell writes: > [...] > commit 818920d369237997824fc8743544b491f2081d7a > Author: Ken McDonell > Date: Wed Feb 18 09:19:03 2015 +1100 > > qa/660: remove ambiguous output and improve diagnostics About this commit, it would probably be better to switch away from "curl -v" to "curl -i" (see my earlier email on 2015-02-04). In that mode, noise warnings like that are simply not printed (so don't need to be filtered). - FChE From kenj@kenj.com.au Fri Feb 20 23:56:07 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id ED3BC7F51 for ; Fri, 20 Feb 2015 23:56:06 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 7CB53AC002 for ; Fri, 20 Feb 2015 21:56:02 -0800 (PST) X-ASG-Debug-ID: 1424498155-04cbb0610f06ac0001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id D62K1AQoXmFUfQRm for ; Fri, 20 Feb 2015 21:55:56 -0800 (PST) X-Barracuda-Envelope-From: kenj@kenj.com.au X-Barracuda-Apparent-Source-IP: 150.101.137.129 Received: from ppp121-44-74-192.lns20.syd4.internode.on.net (HELO bozo-vm.localdomain) ([121.44.74.192]) by ipmail06.adl2.internode.on.net with ESMTP; 21 Feb 2015 16:25:54 +1030 Received: by bozo-vm.localdomain (Postfix, from userid 1000) id CA238A2FEA; Sat, 21 Feb 2015 16:55:50 +1100 (EST) To: pcp@oss.sgi.com Subject: pcp updates - qa/752 yipee Message-Id: <20150221055550.CA238A2FEA@bozo-vm.localdomain> X-ASG-Orig-Subj: pcp updates - qa/752 yipee Date: Sat, 21 Feb 2015 16:55:50 +1100 (EST) From: kenj@kenj.com.au (Ken McDonell) X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1424498155 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15615 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Thanks Stan. Changes committed to git://git.pcp.io/kenj/pcp dev Stan Cox (1): Match current parse-datetime.y behavior for 'next *TODAY*' qa/src/rtimetest.c | 2 +- src/libpcp/src/getdate.y | 8 +++++--- 2 files changed, 6 insertions(+), 4 deletions(-) Details ... commit 7320ddaaa7367d33c64e376142a9ce81c63444d1 Author: Stan Cox Date: Fri Feb 20 16:14:25 2015 -0500 Match current parse-datetime.y behavior for 'next *TODAY*' * libpcp/src/getdate.y (tDAY): Don't consider to be day_ordinal. From lberk@redhat.com Sun Feb 22 19:50:26 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 655807F47 for ; Sun, 22 Feb 2015 19:50:26 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id E97D0AC002 for ; Sun, 22 Feb 2015 17:50:22 -0800 (PST) X-ASG-Debug-ID: 1424656220-04cb6c4bd13cf20001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id iR4zTLVRbgcVRzV8 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sun, 22 Feb 2015 17:50:21 -0800 (PST) X-Barracuda-Envelope-From: lberk@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1N1oKd5030289 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Sun, 22 Feb 2015 20:50:20 -0500 Received: from toium (vpn-61-123.rdu2.redhat.com [10.10.61.123]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1N1oJqs000700 (version=TLSv1/SSLv3 cipher=AES128-GCM-SHA256 bits=128 verify=NO); Sun, 22 Feb 2015 20:50:20 -0500 From: Lukas Berk To: Nathan Scott Cc: pcp developers Subject: Re: pmdapapi buglets from Coverity scan References: <1730959537.2690842.1423612674835.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: pmdapapi buglets from Coverity scan Date: Sun, 22 Feb 2015 20:50:18 -0500 In-Reply-To: <1730959537.2690842.1423612674835.JavaMail.zimbra@redhat.com> (Nathan Scott's message of "Tue, 10 Feb 2015 18:57:54 -0500 (EST)") Message-ID: <8761atz99h.fsf@redhat.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424656221 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hey, Just got a chance to take a look at the bugs, comments inline. Nathan Scott writes: [...] > Coverity is reporting a couple of issues in pmdapapi that I > could use some help with if you could? It's saying the sts > setting here is dead code... > > /* > * This is where we'd see if a requested counter was > * "one too many". We must leave a note for the > * function to return an error, but must continue (so > * that reactivating other counters is still > * attempted). > */ > sts = PM_ERR_VALUE; > continue; > > which at first glance does indeed seem to be the case (it'll > be overwritten on subsequent loop iterations by PAPI_add_event). So, it was indeed looping over and re-writing sts. The only case that this variable would have returned PM_ERR_VALUE is if it occurred in the last iteration of the loop. This can be fixed by introducing a sts2 style variable, which the error value is stored, and at the end of the function, if sts == 0, then we return sts2, which would contain any error (if all is well it still returns 0). However I'm running into an issue that was previously hidden. When we loop over every available metric during the pmda installation, I'm getting errors with the eventset unable to add any more metrics to the eventset, even with mutliplexing enabled. AFAICT this occurs due to the auto-enable functionality. Would you have any suggestions on how to fix this? I'd prefer to not disable auto-enable functionality by default. > papi_store it then says has a loop control issue - apparently > it can only execute the "for (i = 0; i < result->numpmid; i++)" > loop once. I think this is because the switch always returns a > result for the first PMID, when we should really be continuing > on through all metrics being stored to. I've updated/fixed this in my lberk/dev branch. It also takes an sts, sts2 approach to the loop holding any errored states. Cheers, Lukas From kenj@internode.on.net Mon Feb 23 00:48:59 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 3BA607F47 for ; Mon, 23 Feb 2015 00:48:59 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id C77E4AC001 for ; Sun, 22 Feb 2015 22:48:55 -0800 (PST) X-ASG-Debug-ID: 1424674131-04cbb0610d419b0001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id 9zGiC0HCDj8DfM9V for ; Sun, 22 Feb 2015 22:48:52 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DtAQBFzOpUPL2b0XYNToc6boJAwkaBbgEBAQEBAQUBAQEBOIR0FUA2AgUWCwILAwIBAgExGg0IAQHCGXCYIIEhkU+BQwWsSIQkgx4BAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail04.adl6.internode.on.net with ESMTP; 23 Feb 2015 17:18:51 +1030 Message-ID: <54EACD89.7070409@internode.on.net> Date: Mon, 23 Feb 2015 17:49:45 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: PCP Subject: qa/926 hits the wall ... Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: qa/926 hits the wall ... Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1424674131 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15710 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Thusly ... QA output created by 926 === ./ganglia/gangliatest === Couldn't find indom information for cpu_speed.rrd Que? From nscott@redhat.com Mon Feb 23 04:55:51 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 7AE6B7F47 for ; Mon, 23 Feb 2015 04:55:51 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 1828DAC003 for ; Mon, 23 Feb 2015 02:55:47 -0800 (PST) X-ASG-Debug-ID: 1424688941-04bdf05c0048c60001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id 4wmns6AtWsTDB2kD (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 23 Feb 2015 02:55:42 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1NAtfQI039260 for ; Mon, 23 Feb 2015 05:55:41 -0500 Date: Mon, 23 Feb 2015 05:55:41 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: pcp@oss.sgi.com Message-ID: <763423700.13212590.1424688941302.JavaMail.zimbra@redhat.com> In-Reply-To: <368618270.13212567.1424688934926.JavaMail.zimbra@redhat.com> Subject: pcp updates: python3 work MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: python3 work Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: python3 work Thread-Index: +yUs36RgQ65WgggZ0VUbTxwE0hnSSQ== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1424688942 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15718 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Nathan Scott (2): pmns: reserve next free domain number for the Ceph PMDA python3: on-going work to support both python 2 and 3 build/rpm/fedora.spec | 39 +++- configure | 9 + configure.ac | 9 + qa/553 | 16 + qa/553.out | 24 +- qa/667 | 11 - qa/718 | 9 - qa/718.out | 4 qa/729 | 6 qa/754 | 16 + qa/754.out | 4 qa/972 | 31 +-- qa/972.out | 4 qa/985 | 24 +- qa/985.out | 4 qa/986 | 11 - qa/common.python | 3 qa/pmdas/memory_python/pmdamemory_python.python | 6 qa/pmdas/slow_python/pmdaslow_python.python | 24 +- qa/src/test_pcp.python | 50 +++-- qa/src/test_pmcc.python | 7 qa/src/test_webapi.python | 38 ++-- src/include/pcp.conf.in | 5 src/pcp/dmcache/pcp-dmcache.py | 5 src/pcp/free/pcp-free.py | 5 src/pcp/numastat/pcp-numastat.py | 7 src/pmcd/pmdaproc.sh | 13 - src/pmcollectl/pmcollectl.py | 216 +++++++++++------------- src/pmdas/dmcache/pmdadmcache.python | 18 +- src/pmdas/gluster/pmdagluster.python | 10 - src/pmdas/simple/pmdasimple.python | 4 src/pmdas/unbound/pmdaunbound.python | 11 - src/pmdas/zswap/pmdazswap.python | 5 src/pmiostat/pmiostat.py | 72 ++++---- src/pmns/stdpmid.pcp | 1 src/python/pcp/mmv.py | 71 +++++++ src/python/pcp/pmapi.py | 148 ++++++++++------ src/python/pcp/pmcc.py | 32 ++- src/python/pcp/pmda.py | 11 - src/python/pcp/pmi.py | 24 ++ src/python/pcp/pmsubsys.py | 9 - 41 files changed, 615 insertions(+), 401 deletions(-) From fche@redhat.com Mon Feb 23 08:54:23 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id ED4877F47 for ; Mon, 23 Feb 2015 08:54:23 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id CD26A8F8066 for ; Mon, 23 Feb 2015 06:54:23 -0800 (PST) X-ASG-Debug-ID: 1424703259-04cbb0610d52750001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id zBu9AgmjyQOPlb57 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 23 Feb 2015 06:54:19 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1NEsJdX018575 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 23 Feb 2015 09:54:19 -0500 Received: from fche.csb (vpn-233-48.phx2.redhat.com [10.3.233.48]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1NEsIVm010217; Mon, 23 Feb 2015 09:54:18 -0500 Received: by fche.csb (Postfix, from userid 2569) id 5ACAB58518; Mon, 23 Feb 2015 09:54:16 -0500 (EST) To: Nathan Scott Cc: pcp@oss.sgi.com Subject: Re: pcp updates: python3 work References: <368618270.13212567.1424688934926.JavaMail.zimbra@redhat.com> <763423700.13212590.1424688941302.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: pcp updates: python3 work From: fche@redhat.com (Frank Ch. Eigler) Date: Mon, 23 Feb 2015 09:54:16 -0500 In-Reply-To: <763423700.13212590.1424688941302.JavaMail.zimbra@redhat.com> (Nathan Scott's message of "Mon, 23 Feb 2015 05:55:41 -0500 (EST)") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424703259 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 > [...] > Nathan Scott (2): > python3: on-going work to support both python 2 and 3 > [...] Thank you. What are your thoughts about the longevity of this approach (conditionally rewriting the #! line of python scripts)? If only the build (or package-construction) scripts do rehashbanging, developers/qa may not see how to easily test that any given script source is and stays workable in both python languages. - FChE From fche@redhat.com Mon Feb 23 09:10:07 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id B02727F47 for ; Mon, 23 Feb 2015 09:10:07 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 903928F807A for ; Mon, 23 Feb 2015 07:10:04 -0800 (PST) X-ASG-Debug-ID: 1424704202-04cbb0611053240001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id K5w9KuEkwk2FgGkk (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 23 Feb 2015 07:10:03 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1NFA19g018197 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 23 Feb 2015 10:10:02 -0500 Received: from fche.csb (vpn-233-48.phx2.redhat.com [10.3.233.48]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1NFA0e0020859; Mon, 23 Feb 2015 10:10:00 -0500 Received: by fche.csb (Postfix, from userid 2569) id 4A81D58518; Mon, 23 Feb 2015 10:09:58 -0500 (EST) To: William Cohen Cc: pcp developers Subject: Re: Pointing pcp to alternative location for papi References: <54E6A60B.80608@redhat.com> X-ASG-Orig-Subj: Re: Pointing pcp to alternative location for papi From: fche@redhat.com (Frank Ch. Eigler) Date: Mon, 23 Feb 2015 10:09:58 -0500 In-Reply-To: <54E6A60B.80608@redhat.com> (William Cohen's message of "Thu, 19 Feb 2015 22:12:11 -0500") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424704203 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 wcohen wrote: > On RHEL-6.5 there is are two version of papi available: papi-4.1.3 > for compatibility and papi-5.1.1 for newer features. [...] Thank you, it looks good to me, at least as an interim measure before pkgconfig-ification of papi. (For completeness, to activate this facility in a RHEL build, the top-level .spec file would have to have hard-coded within it that --with-papi=.../papi-5.1.1 path and associated buildrequires:. - FChE From minnus@buffalo.edu Mon Feb 23 09:10:50 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 6836C7F4E for ; Mon, 23 Feb 2015 09:10:50 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 55F348F8066 for ; Mon, 23 Feb 2015 07:10:50 -0800 (PST) X-ASG-Debug-ID: 1424704249-04cb6c4bd350d00001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve11.acsu.buffalo.edu [128.205.6.22]) by cuda.sgi.com with ESMTP id NVTK1El9zwPqtAnc for ; Mon, 23 Feb 2015 07:10:49 -0800 (PST) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.6.22 Received: from localmailB.acsu.buffalo.edu (localmailb.acsu.buffalo.edu [128.205.5.200]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id CDE1C61F; Mon, 23 Feb 2015 10:10:48 -0500 (EST) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id C78E0BCF2; Mon, 23 Feb 2015 10:10:48 -0500 (EST) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailB.acsu.buffalo.edu (Postfix) with ESMTP id 596B3BCD6; Mon, 23 Feb 2015 10:10:47 -0500 (EST) Received: from smtp.buffalo.edu (smtp3.acsu.buffalo.edu [128.205.5.226]) by localmailB.acsu.buffalo.edu (Prefixe) with ESMTP id 4E20EBCD4; Mon, 23 Feb 2015 10:10:47 -0500 (EST) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 419B64F83; Mon, 23 Feb 2015 10:10:47 -0500 (EST) Message-ID: <54EB42F6.8030605@buffalo.edu> Date: Mon, 23 Feb 2015 10:10:46 -0500 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Ken McDonell , PCP Subject: Re: [pcp] qa/926 hits the wall ... References: <54EACD89.7070409@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] qa/926 hits the wall ... In-Reply-To: <54EACD89.7070409@internode.on.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve11.acsu.buffalo.edu[128.205.6.22] X-Barracuda-Start-Time: 1424704249 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15725 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Ken, On 2/23/15 1:49 AM, Ken McDonell wrote: > Thusly ... > > QA output created by 926 > > === ./ganglia/gangliatest === > Couldn't find indom information for cpu_speed.rrd > > Que? That's mine. Can you send me OS, perl version, and rrdtool-perl version or whatever the package is called in the failing OS? Thanks Martins From kenj@internode.on.net Mon Feb 23 13:34:28 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 75D357F47 for ; Mon, 23 Feb 2015 13:34:28 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 029BBAC002 for ; Mon, 23 Feb 2015 11:34:27 -0800 (PST) X-ASG-Debug-ID: 1424720061-04cbb0610d5ec30001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id m31vkfg0MxNR0IKW for ; Mon, 23 Feb 2015 11:34:22 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DOAQBKgOtUPL2b0XYNTg6KWsAGgk4CgWgBAQEBAQEFAQEBATiESwEBBDhAEQsOCgkWDwkDAgECATEUBgEMCAEBwiuZHwEBAQEBBQEBAQEBHYsThHWEKwEEjWGeZ4NTUYMeAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail04.adl6.internode.on.net with ESMTP; 24 Feb 2015 06:04:14 +1030 Message-ID: <54EB80ED.2020503@internode.on.net> Date: Tue, 24 Feb 2015 06:35:09 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Martins Innus , PCP Subject: Re: [pcp] qa/926 hits the wall ... References: <54EACD89.7070409@internode.on.net> <54EB42F6.8030605@buffalo.edu> X-ASG-Orig-Subj: Re: [pcp] qa/926 hits the wall ... In-Reply-To: <54EB42F6.8030605@buffalo.edu> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1424720061 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15736 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 24/02/15 02:10, Martins Innus wrote: > ... > That's mine. Can you send me OS, perl version, and rrdtool-perl version > or whatever the package is called in the failing OS? Will do (under separate cover). Thanks. Just a note to others developing QA scripts (which are extremely welcome I might add) ... consider the use of the $seq.full mechanisms to record useful debugging information (versions found, unfiltered output, logs, etc) that is not part of the pass/fail determination. From kenj@internode.on.net Mon Feb 23 14:17:39 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 63FD67F47 for ; Mon, 23 Feb 2015 14:17:39 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id D75F2AC003 for ; Mon, 23 Feb 2015 12:17:35 -0800 (PST) X-ASG-Debug-ID: 1424722652-04cbb0610e60850001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id 1pJmkuJs5QTkEsKI for ; Mon, 23 Feb 2015 12:17:33 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2ADAgDYietUPL2b0XYNToc6gy7EQAEBAQEBAQUBAQEBOIR0VT0WCwIEBwMCAQIBMRoNCAEBwiZwmDgBAQgCAR+ScIFDBZExgS6ZaYIhH4Fkgx4BAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail04.adl6.internode.on.net with ESMTP; 24 Feb 2015 06:47:32 +1030 Message-ID: <54EB8B14.7070605@internode.on.net> Date: Tue, 24 Feb 2015 07:18:28 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: PCP Subject: qa/767 failing most places Content-Type: multipart/mixed; boundary="------------020708020107070208010004" X-ASG-Orig-Subj: qa/767 failing most places X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1424722652 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15737 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- This is a multi-part message in MIME format. --------------020708020107070208010004 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Although the failure mode is not always the same. Attached are 3 different .out.bad files that are all seen on multiple but different systems. --------------020708020107070208010004 Content-Type: text/plain; charset=UTF-8; name="767.out.bad" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="767.out.bad" UUEgb3V0cHV0IGNyZWF0ZWQgYnkgNzY3Cj09IGtlcm5lbCBQTURBCmtlcm5lbC5hbGwubG9h ZCAtMTIzNTAgTWV0cmljIG5vdCBzdXBwb3J0ZWQgYnkgdGhpcyB2ZXJzaW9uIG9mIG1vbml0 b3JlZCBhcHBsaWNhdGlvbgpuZXR3b3JrLmludGVyZmFjZS5pbi5ieXRlcyAtMTIzNTAgTWV0 cmljIG5vdCBzdXBwb3J0ZWQgYnkgdGhpcyB2ZXJzaW9uIG9mIG1vbml0b3JlZCBhcHBsaWNh dGlvbgoKa2VybmVsLmFsbC5sb2FkCkVycm9yOiBNZXRyaWMgbm90IHN1cHBvcnRlZCBieSB0 aGlzIHZlcnNpb24gb2YgbW9uaXRvcmVkIGFwcGxpY2F0aW9uCgpuZXR3b3JrLmludGVyZmFj ZS5pbi5ieXRlcwpFcnJvcjogTWV0cmljIG5vdCBzdXBwb3J0ZWQgYnkgdGhpcyB2ZXJzaW9u IG9mIG1vbml0b3JlZCBhcHBsaWNhdGlvbgoKPT0gcHJvY2ZzIFBNREEKcHJvYy5tZW1vcnku cnNzIC0xMjM5OSBDb250YWluZXIgbm90IGZvdW5kCmNncm91cC5tZW1vcnkuc3RhdC5yc3Mg LTEyMzk5IENvbnRhaW5lciBub3QgZm91bmQKCnByb2MubWVtb3J5LnJzcwpFcnJvcjogQ29u dGFpbmVyIG5vdCBmb3VuZAoKY2dyb3VwLm1lbW9yeS5zdGF0LnJzcwpFcnJvcjogQ29udGFp bmVyIG5vdCBmb3VuZAo= --------------020708020107070208010004 Content-Type: text/plain; charset=UTF-8; name="767.out.bad" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="767.out.bad" UUEgb3V0cHV0IGNyZWF0ZWQgYnkgNzY3Cj09IGtlcm5lbCBQTURBCnBtcHJvYmU6IENhbm5v dCBjb25uZWN0IHRvIFBNQ0Qgb24gaG9zdCAibG9jYWw6IjogT3BlcmF0aW9uIG5vdCBzdXBw b3J0ZWQKcG1pbmZvOiBDYW5ub3QgY29ubmVjdCB0byBQTUNEIG9uIGhvc3QgImxvY2FsOiI6 IE9wZXJhdGlvbiBub3Qgc3VwcG9ydGVkCgo9PSBwcm9jZnMgUE1EQQpwbXByb2JlOiBDYW5u b3QgY29ubmVjdCB0byBQTUNEIG9uIGhvc3QgImxvY2FsOiI6IE9wZXJhdGlvbiBub3Qgc3Vw cG9ydGVkCnBtaW5mbzogQ2Fubm90IGNvbm5lY3QgdG8gUE1DRCBvbiBob3N0ICJsb2NhbDoi OiBPcGVyYXRpb24gbm90IHN1cHBvcnRlZAo= --------------020708020107070208010004 Content-Type: text/plain; charset=UTF-8; name="767.out.bad" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="767.out.bad" UUEgb3V0cHV0IGNyZWF0ZWQgYnkgNzY3Cj09IGtlcm5lbCBQTURBCmtlcm5lbC5hbGwubG9h ZCAwCm5ldHdvcmsuaW50ZXJmYWNlLmluLmJ5dGVzIDAKCmtlcm5lbC5hbGwubG9hZApObyB2 YWx1ZShzKSBhdmFpbGFibGUhCgpuZXR3b3JrLmludGVyZmFjZS5pbi5ieXRlcwpObyB2YWx1 ZShzKSBhdmFpbGFibGUhCgo9PSBwcm9jZnMgUE1EQQpwcm9jLm1lbW9yeS5yc3MgLTEyMzk5 IENvbnRhaW5lciBub3QgZm91bmQKY2dyb3VwLm1lbW9yeS5zdGF0LnJzcyAtMTIzOTkgQ29u dGFpbmVyIG5vdCBmb3VuZAoKcHJvYy5tZW1vcnkucnNzCkVycm9yOiBDb250YWluZXIgbm90 IGZvdW5kCgpjZ3JvdXAubWVtb3J5LnN0YXQucnNzCkVycm9yOiBDb250YWluZXIgbm90IGZv dW5kCg== --------------020708020107070208010004-- From nscott@redhat.com Mon Feb 23 17:08:44 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 8293E7F47 for ; Mon, 23 Feb 2015 17:08:44 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 701CA8F80A1 for ; Mon, 23 Feb 2015 15:08:44 -0800 (PST) X-ASG-Debug-ID: 1424732917-04cbb0610e66ad0001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id DGylIGnbJNoGrodE (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 23 Feb 2015 15:08:38 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1NN8bt6057235 for ; Mon, 23 Feb 2015 18:08:37 -0500 Date: Mon, 23 Feb 2015 18:08:37 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: pcp@oss.sgi.com Message-ID: <764225814.13871513.1424732917626.JavaMail.zimbra@redhat.com> In-Reply-To: References: <368618270.13212567.1424688934926.JavaMail.zimbra@redhat.com> <763423700.13212590.1424688941302.JavaMail.zimbra@redhat.com> Subject: Re: pcp updates: python3 work MIME-Version: 1.0 X-ASG-Orig-Subj: Re: pcp updates: python3 work Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: python3 work Thread-Index: N6ZoUjVuQb3VCR+h0IBEXDa1uR6A1Q== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1424732918 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15743 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > [...] > What are your thoughts about the longevity of this > approach (conditionally rewriting the #! line of python scripts)? If > only the build (or package-construction) scripts do rehashbanging, It seems to be the best option available & from talking to the python Fedora packagers, it's their recommended approach. > developers/qa may not see how to easily test that any given script > source is and stays workable in both python languages. If you look at the commits closely, you will notice that they make changes to QA allowing PCP_PYTHON_PROG (which defaults to python3 if it is available, via configure.ac) to override the hash-bang line - see e.g. qa/722, qa/985, etc. They also ensure python3 is used when new python PMDAs are installed in pmcd.conf. For those of us doing QA, this gives us excellent coverage in testing PCP using whichever python we choose to prefer. IOW, that is the case for either upstream QA runs from Makepkgs or internal Red Hat QE runs on fedpkg builds. It also gives platform distributors the freedom to choose whichever python version they want as their default (as in Arch Linux kind of default), and PCP will be ready and well-tested either way. So, in summary, yes I think this is a really good way forward and it is certainly going to get us to an end result of stable, widely-used support for both python2 and python3 runtimes with the PCP python-ey bits. cheers. -- Nathan From nscott@redhat.com Mon Feb 23 17:50:03 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id B25B67F47 for ; Mon, 23 Feb 2015 17:50:03 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id A1088304032 for ; Mon, 23 Feb 2015 15:50:00 -0800 (PST) X-ASG-Debug-ID: 1424735395-04cb6c4bd361460001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id Qfjkx4xWmqxU1gdn (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 23 Feb 2015 15:49:56 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1NNnpR7064574; Mon, 23 Feb 2015 18:49:51 -0500 Date: Mon, 23 Feb 2015 18:49:51 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: PCP Message-ID: <1281616127.13879459.1424735391627.JavaMail.zimbra@redhat.com> In-Reply-To: <54EB8B14.7070605@internode.on.net> References: <54EB8B14.7070605@internode.on.net> Subject: Re: [pcp] qa/767 failing most places MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] qa/767 failing most places Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: qa/767 failing most places Thread-Index: hvSAuSF3Yy8i3dSJRkoqoKxPYmV+4w== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1424735395 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15745 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > Although the failure mode is not always the same. > > Attached are 3 different .out.bad files that are all seen on multiple > but different systems. Thanks Ken - looks like an issue affecting the pmdalinux metrics but not the pmdaproc ones - will look into it. Ohhhhh... part of it is going to be a lack of kernel support for setns(2) - I'll need to get some way to detect that built into the QA test. Can you send through the kernel/distro versions on those failing hosts? cheers. -- Nathan From kenj@internode.on.net Mon Feb 23 18:29:59 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 9E5D37F47 for ; Mon, 23 Feb 2015 18:29:59 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 3BFE3AC001 for ; Mon, 23 Feb 2015 16:29:56 -0800 (PST) X-ASG-Debug-ID: 1424737790-04bdf05c016b3e0001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id ivMX55GidCKis36b for ; Mon, 23 Feb 2015 16:29:51 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2ACCQCixetU/3fG03ZbgwaBLII5T8V3BAQCAoElRAEBAQEBAXyEDwEBAQQIAhkFLiMMAQMCBgMVAQQCIwMCAhkgDRECBBMLBYgeuieYXgEBAQcBAQEBHoEhiXKEbgeCaIFDBY9SWpwcIoQCKjGCQwEBAQ Received: from ppp118-211-198-119.lns20.syd4.internode.on.net (HELO bozohorize) ([118.211.198.119]) by ipmail05.adl6.internode.on.net with ESMTP; 24 Feb 2015 10:59:21 +1030 From: "Ken McDonell" To: "'Nathan Scott'" Cc: "'PCP'" References: <54EB8B14.7070605@internode.on.net> <1281616127.13879459.1424735391627.JavaMail.zimbra@redhat.com> In-Reply-To: <1281616127.13879459.1424735391627.JavaMail.zimbra@redhat.com> Subject: RE: [pcp] qa/767 failing most places Date: Tue, 24 Feb 2015 11:29:15 +1100 X-ASG-Orig-Subj: RE: [pcp] qa/767 failing most places Message-ID: <000a01d04fc8$ef57b320$ce071960$@internode.on.net> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQHch2CjyImo8TZUu0YU/mQFSoNSUwJAQuapnNR/qlA= Content-Language: en-au X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1424737790 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15747 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header > -----Original Message----- > From: Nathan Scott [mailto:nathans@redhat.com] > Sent: Tuesday, 24 February 2015 10:50 AM > ... > Can you send through the kernel/distro versions on those failing hosts? Sure ... bozo-vm PCP 3.10.3 x86_64 Debian 7.6 grundy PCP 3.10.3 ia64 SUSE SLES11 SP1 vm02 PCP 3.10.3 i686 openSUSE 12.1 vm03 PCP 3.10.3 x86_64 Fedora 18 vm04 PCP 3.10.3 i586 CentOS 5.11 vm05 PCP 3.10.3 i486 Gentoo 2.0.3 vm07 PCP 3.10.3 x86_64 Debian 6.0.10 vm08 PCP 3.10.3 x86_64 CentOS Linux7.0.1406 vm11 PCP 3.10.3 i686 Debian 6.0.9 vm12 PCP 3.10.3 i686 Fedora 17 vm14 PCP 3.10.3 x86_64 CentOS6.5 vm18 PCP 3.10.3 x86_64 LinuxMint 12 vm19 PCP 3.10.3 x86_64 openSUSE 12.2 vm21 PCP 3.10.3 i686 Debian 7.4 vm22 PCP 3.10.3 x86_64 Fedora 19 vm23 PCP 3.10.3 i686 Fedora 20 vm24 PCP 3.10.3 i686 openSUSE 13.1 vm25 PCP 3.10.3 x86_64 CentOS 5.5 vm26 PCP 3.10.3 x86_64 Fedora 21 From kenj@internode.on.net Mon Feb 23 18:33:37 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 0A4AC7F47 for ; Mon, 23 Feb 2015 18:33:37 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id ECFD7304032 for ; Mon, 23 Feb 2015 16:33:33 -0800 (PST) X-ASG-Debug-ID: 1424738011-04cbb0610d68cf0001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id CFEjXXc21J2WvAFN for ; Mon, 23 Feb 2015 16:33:32 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2ABCQCixetU/3fG03ZbgwaBLII5T8V7BAICgSVEAQEBAQEBfIQPAQEBBAgCGQUuIwwBAwIGAxUBBAIjAwICGSANEQIEEwsFiB66J5heAQEBBwEBAQEegSGJcoRuB4JogUMFj1JanBwihAIqMYJDAQEB Received: from ppp118-211-198-119.lns20.syd4.internode.on.net (HELO bozohorize) ([118.211.198.119]) by ipmail05.adl6.internode.on.net with ESMTP; 24 Feb 2015 11:03:30 +1030 From: "Ken McDonell" To: "'Nathan Scott'" Cc: "'PCP'" References: <54EB8B14.7070605@internode.on.net> <1281616127.13879459.1424735391627.JavaMail.zimbra@redhat.com> In-Reply-To: <1281616127.13879459.1424735391627.JavaMail.zimbra@redhat.com> Subject: RE: [pcp] qa/767 failing most places Date: Tue, 24 Feb 2015 11:33:28 +1100 X-ASG-Orig-Subj: RE: [pcp] qa/767 failing most places Message-ID: <000d01d04fc9$8375ca60$8a615f20$@internode.on.net> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQHch2CjyImo8TZUu0YU/mQFSoNSUwJAQuapnNSBxZA= Content-Language: en-au X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1424738011 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15747 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header > -----Original Message----- > From: Nathan Scott [mailto:nathans@redhat.com] > Sent: Tuesday, 24 February 2015 10:50 AM > .... Ohhhhh... part of it is > going to be a lack of kernel support for setns(2) - I'll need to get = some way > to detect that built into the QA test. Check qa 377 or 480 for a (hacky) way to check in a qa script = HAVE_SOMETHING that maybe set by configure during the build. From nscott@redhat.com Mon Feb 23 18:52:09 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id A9AFF7F47 for ; Mon, 23 Feb 2015 18:52:09 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 943A8304032 for ; Mon, 23 Feb 2015 16:52:09 -0800 (PST) X-ASG-Debug-ID: 1424739127-04cb6c4bd362b40001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id 9vIeGkXwiK3yyEZx (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 23 Feb 2015 16:52:07 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1O0q3gj026501; Mon, 23 Feb 2015 19:52:03 -0500 Date: Mon, 23 Feb 2015 19:52:03 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: PCP Message-ID: <411990989.13897673.1424739123526.JavaMail.zimbra@redhat.com> In-Reply-To: <000d01d04fc9$8375ca60$8a615f20$@internode.on.net> References: <54EB8B14.7070605@internode.on.net> <1281616127.13879459.1424735391627.JavaMail.zimbra@redhat.com> <000d01d04fc9$8375ca60$8a615f20$@internode.on.net> Subject: Re: [pcp] qa/767 failing most places MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] qa/767 failing most places Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: qa/767 failing most places Thread-Index: AQHch2CjyImo8TZUu0YU/mQFSoNSUwJAQuapnNSBxZAFuvc4bA== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1424739127 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15747 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > > -----Original Message----- > > From: Nathan Scott [mailto:nathans@redhat.com] > > Sent: Tuesday, 24 February 2015 10:50 AM > > .... Ohhhhh... part of it is > > going to be a lack of kernel support for setns(2) - I'll need to get some > > way > > to detect that built into the QA test. > > Check qa 377 or 480 for a (hacky) way to check in a qa script HAVE_SOMETHING > that maybe set by configure during the build. > Taa. For this one, I think we can make the existing pmcd.feature.containers metric export zero if the needed kernel features were not present/found too, and then make the common.check _check_containers() routine use that. cheers. -- Nathan From kenj@internode.on.net Mon Feb 23 19:32:12 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 5633D7F47 for ; Mon, 23 Feb 2015 19:32:12 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 44A308F8066 for ; Mon, 23 Feb 2015 17:32:09 -0800 (PST) X-ASG-Debug-ID: 1424741526-04cb6c4bd163770001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id kC7DlkHlf98PCl78 for ; Mon, 23 Feb 2015 17:32:06 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DBAQDs0+tUPL2b0XYNToNYWoMIgy68W4djAQEBAQEBBQEBAQE4hHSBBQYCBSECEQIyDhkGAgEBwWlwmQ+BIY59glKBQwWTMINsgySSCIQkW4JDAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail04.adl6.internode.on.net with ESMTP; 24 Feb 2015 12:01:57 +1030 Message-ID: <54EBD4C5.20902@internode.on.net> Date: Tue, 24 Feb 2015 12:32:53 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1424741526 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15749 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (6): qa/admin/check-vm & qa/660: run on more hosts valgrind-suppress: another memory leak outside PCP ... nsswitch this time qa/730: don't rmdir for the current directory qa/660: more noise filtering qa/750: give rpm PMDA more of a chance to get started qa/admin/check-vm: handle rpm schizophrenia rrdtool-perl or perl-rrdtool qa/660 | 18 ++++++++++++++++-- qa/730 | 2 +- qa/750 | 25 +++++++++++++++++++++++++ qa/admin/check-vm | 4 +++- qa/valgrind-suppress | 11 +++++++++++ 5 files changed, 56 insertions(+), 4 deletions(-) Details ... commit 296d2034444b22f06692c22ac3475cdaa7f5521d Author: Ken McDonell Date: Tue Feb 24 12:24:03 2015 +1100 qa/admin/check-vm: handle rpm schizophrenia rrdtool-perl or perl-rrdtool commit 8a9e80bbc3c8d6f5b4eb9544cb4ec62b001b0203 Author: Ken McDonell Date: Tue Feb 24 09:39:13 2015 +1100 qa/750: give rpm PMDA more of a chance to get started commit a178108b477ae9d949b598742356f364240d20ac Author: Ken McDonell Date: Mon Feb 23 19:55:31 2015 +1100 qa/660: more noise filtering commit 6f6a2ca1bbff7e360dcd46922cb9ea8337922629 Author: Ken McDonell Date: Mon Feb 23 19:54:42 2015 +1100 qa/730: don't rmdir for the current directory commit 18f1c6b901026935e97147508fd9f9ff4ebb515f Author: Ken McDonell Date: Mon Feb 23 19:53:55 2015 +1100 valgrind-suppress: another memory leak outside PCP ... nsswitch this time commit abddb9f3c578503b052276e82eba18cfb472dd0e Author: Ken McDonell Date: Mon Feb 23 17:13:33 2015 +1100 qa/admin/check-vm & qa/660: run on more hosts 1. the dependence of qa/660 on the python-requests package had not been captured in any place where I was going to notice it, so it was not being run on lots of hosts. Fix qa/admin/check-vm to address this. 2. as a result of 1. lots more noisy messages that have nothing to do with pass/fail ... so expand the filter in the test to cull these out. From nscott@redhat.com Tue Feb 24 00:19:24 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 76A967F37 for ; Tue, 24 Feb 2015 00:19:24 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 04FAEAC002 for ; Mon, 23 Feb 2015 22:19:20 -0800 (PST) X-ASG-Debug-ID: 1424758755-04cbb0611071da0001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id idcVDsz26grRiBu7 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 23 Feb 2015 22:19:15 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1O6JENS012280 for ; Tue, 24 Feb 2015 01:19:15 -0500 Date: Tue, 24 Feb 2015 01:19:14 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: PCP Message-ID: <1472560534.13976221.1424758754872.JavaMail.zimbra@redhat.com> Subject: pcp updates: qa MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: qa Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: qa Thread-Index: Mzt7TMtJByavmVbCc06ulrIkwfZfdg== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1424758755 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15759 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Nathan Scott (3): qa: rename a container root image to match source version qa: rework detection of containers and setns syscall qa: filter docker, bridged interfaces from results dev/null |binary qa/359 | 7 ++++++- qa/359.out | 1 + qa/581 | 2 ++ qa/767 | 2 +- qa/common.check | 14 +++----------- qa/linux/containers-docker-1.5.0-root-003.tgz |binary src/libpcp/src/auxserver.c | 11 +++++++++-- 8 files changed, 22 insertions(+), 15 deletions(-) From nscott@redhat.com Tue Feb 24 00:55:35 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 4CF0D7F37 for ; Tue, 24 Feb 2015 00:55:35 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 3BD23304032 for ; Mon, 23 Feb 2015 22:55:32 -0800 (PST) X-ASG-Debug-ID: 1424760929-04cbb0611072e30001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id aCtPWlEgakLB6r9r (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 23 Feb 2015 22:55:30 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1O6tQpG017330; Tue, 24 Feb 2015 01:55:26 -0500 Date: Tue, 24 Feb 2015 01:55:26 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: PCP Message-ID: <79709270.13992459.1424760926263.JavaMail.zimbra@redhat.com> In-Reply-To: <411990989.13897673.1424739123526.JavaMail.zimbra@redhat.com> References: <54EB8B14.7070605@internode.on.net> <1281616127.13879459.1424735391627.JavaMail.zimbra@redhat.com> <000d01d04fc9$8375ca60$8a615f20$@internode.on.net> <411990989.13897673.1424739123526.JavaMail.zimbra@redhat.com> Subject: Re: [pcp] qa/767 failing most places MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] qa/767 failing most places Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: qa/767 failing most places Thread-Index: AQHch2CjyImo8TZUu0YU/mQFSoNSUwJAQuapnNSBxZAFuvc4bD0Qc+iQ X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1424760930 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15759 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Ken, ----- Original Message ----- > ----- Original Message ----- > > > -----Original Message----- > > > From: Nathan Scott [mailto:nathans@redhat.com] > > > Sent: Tuesday, 24 February 2015 10:50 AM > > > .... Ohhhhh... part of it is > > > going to be a lack of kernel support for setns(2) - I'll need to get some > > > way > > > to detect that built into the QA test. > > > > Check qa 377 or 480 for a (hacky) way to check in a qa script > > HAVE_SOMETHING > > that maybe set by configure during the build. > > > > Taa. For this one, I think we can make the existing pmcd.feature.containers > metric export zero if the needed kernel features were not present/found too, > and then make the common.check _check_containers() routine use that. I've pushed this one - I think it will resolve one or two of the cases, but the "No values" output isn't explained by this ... and I can't seem to reproduce that on any of my hosts. Hmm, will ponder some more. cheers. -- Nathan From minnus@buffalo.edu Tue Feb 24 13:02:58 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 8A6AB7F3F for ; Tue, 24 Feb 2015 13:02:58 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 37470AC001 for ; Tue, 24 Feb 2015 11:02:55 -0800 (PST) X-ASG-Debug-ID: 1424804572-04bdf05c018cd70001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve11.acsu.buffalo.edu [128.205.6.22]) by cuda.sgi.com with ESMTP id 9gAvmjjWGv9rew8l for ; Tue, 24 Feb 2015 11:02:53 -0800 (PST) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.6.22 Received: from localmailB.acsu.buffalo.edu (localmailb.acsu.buffalo.edu [128.205.5.200]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 7AF03F68; Tue, 24 Feb 2015 14:02:52 -0500 (EST) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 75169AC28; Tue, 24 Feb 2015 14:02:52 -0500 (EST) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailB.acsu.buffalo.edu (Postfix) with ESMTP id C7D15AC24; Tue, 24 Feb 2015 14:02:50 -0500 (EST) Received: from smtp.buffalo.edu (smtp3.acsu.buffalo.edu [128.205.5.226]) by localmailB.acsu.buffalo.edu (Prefixe) with ESMTP id B6274AC23; Tue, 24 Feb 2015 14:02:50 -0500 (EST) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 8D6A04E67; Tue, 24 Feb 2015 14:02:50 -0500 (EST) Message-ID: <54ECCADA.4040706@buffalo.edu> Date: Tue, 24 Feb 2015 14:02:50 -0500 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Ken McDonell , PCP Subject: Re: [pcp] qa/926 hits the wall ... References: <54EACD89.7070409@internode.on.net> <54EB42F6.8030605@buffalo.edu> <54EB80ED.2020503@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] qa/926 hits the wall ... In-Reply-To: <54EB80ED.2020503@internode.on.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve11.acsu.buffalo.edu[128.205.6.22] X-Barracuda-Start-Time: 1424804573 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15784 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Ken, On 2/23/15 2:35 PM, Ken McDonell wrote: > On 24/02/15 02:10, Martins Innus wrote: >> ... >> That's mine. Can you send me OS, perl version, and rrdtool-perl version >> or whatever the package is called in the failing OS? > > Will do (under separate cover). Thanks for the details. This came down to rrdtool not being able to handle 32 bit archives on a 64 bit system and vice versa. I updated QA to have separate test cases and data files for 32 bit and 64 bit hosts. Added some debugging info that would have made this more apparent. Also, updated the vagrant setup to have a 32 bit host. I think I got all the configuration correct for the multiple QA possibilities, let me know if you still see any issues. Can be updated from here: https://github.com/ubccr/pcp/tree/martins_working Thanks Martins commit 7f98e18a7ad4eb20aabf66082d9b78b204d847a7 Author: Martins Innus Date: Tue Feb 24 13:48:15 2015 -0500 Set the right python version in the Vagrantfile for build Vagrantfile | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) commit 1fa46281250dc8bcebdcbbd3c7fd85268033586a Author: Martins Innus Date: Tue Feb 24 13:39:58 2015 -0500 Fix an errant comment in the Vagrantfile Vagrantfile | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) commit d1c4670a57eb96f591020554da0e8d868d4d3982 Author: Martins Innus Date: Tue Feb 24 12:43:23 2015 -0500 Fix ganglia2pcp qa errors on 32 bit hosts The rrdtools can't handle 64 files on a 32 bit system and 32 bit files on a 64 bit system. So we create a seperate set of qa files for each Update the vagrant setup for a 32 bit host to test this. Vagrantfile | 24 +- qa/926 | 34 +- qa/926.out | 567 --------------------------- qa/926.out.32 | 567 +++++++++++++++++++++++++++ qa/926.out.64 | 567 +++++++++++++++++++++++++++ qa/ganglia/GNUmakefile | 2 +- qa/ganglia/gangliatest.32/GNUmakefile | 18 + qa/ganglia/gangliatest.32/boottime.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/bytes_in.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/bytes_out.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/cpu_aidle.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/cpu_idle.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/cpu_nice.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/cpu_num.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/cpu_speed.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/cpu_system.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/cpu_user.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/cpu_wio.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/disk_free.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/disk_total.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/load_fifteen.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/load_five.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/load_one.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/mem_buffers.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/mem_cached.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/mem_free.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/mem_shared.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/mem_total.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/part_max_used.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/pkts_in.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/pkts_out.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/proc_run.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/proc_total.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/swap_free.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.32/swap_total.rrd | Bin 0 -> 1056 bytes qa/ganglia/gangliatest.64/GNUmakefile | 18 + qa/ganglia/gangliatest.64/boottime.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/bytes_in.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/bytes_out.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/cpu_aidle.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/cpu_idle.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/cpu_nice.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/cpu_num.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/cpu_speed.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/cpu_system.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/cpu_user.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/cpu_wio.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/disk_free.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/disk_total.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/load_fifteen.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/load_five.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/load_one.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/mem_buffers.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/mem_cached.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/mem_free.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/mem_shared.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/mem_total.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/part_max_used.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/pkts_in.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/pkts_out.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/proc_run.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/proc_total.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/swap_free.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest.64/swap_total.rrd | Bin 0 -> 1112 bytes qa/ganglia/gangliatest/GNUmakefile | 18 - qa/ganglia/gangliatest/boottime.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/bytes_in.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/bytes_out.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/cpu_aidle.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/cpu_idle.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/cpu_nice.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/cpu_num.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/cpu_speed.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/cpu_system.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/cpu_user.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/cpu_wio.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/disk_free.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/disk_total.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/load_fifteen.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/load_five.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/load_one.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/mem_buffers.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/mem_cached.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/mem_free.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/mem_shared.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/mem_total.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/part_max_used.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/pkts_in.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/pkts_out.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/proc_run.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/proc_total.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/swap_free.rrd | Bin 1112 -> 0 bytes qa/ganglia/gangliatest/swap_total.rrd | Bin 1112 -> 0 bytes src/ganglia2pcp/ganglia2pcp | 6 +- 94 files changed, 1209 insertions(+), 612 deletions(-) From minnus@buffalo.edu Tue Feb 24 13:04:01 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 22E977F3F for ; Tue, 24 Feb 2015 13:04:01 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 1162E304043 for ; Tue, 24 Feb 2015 11:04:00 -0800 (PST) X-ASG-Debug-ID: 1424804636-04cbb0610e8b990001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve11.acsu.buffalo.edu [128.205.6.22]) by cuda.sgi.com with ESMTP id D4WUwhdwBb4WBknD for ; Tue, 24 Feb 2015 11:03:56 -0800 (PST) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.6.22 Received: from localmailD.acsu.buffalo.edu (localmaild.acsu.buffalo.edu [128.205.5.208]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 6A97FF94 for ; Tue, 24 Feb 2015 14:03:56 -0500 (EST) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 61FBDD30E for ; Tue, 24 Feb 2015 14:03:56 -0500 (EST) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailD.acsu.buffalo.edu (Postfix) with ESMTP id D1AE1D309 for ; Tue, 24 Feb 2015 14:03:55 -0500 (EST) Received: from smtp.buffalo.edu (smtp3.acsu.buffalo.edu [128.205.5.226]) by localmailD.acsu.buffalo.edu (Prefixe) with ESMTP id C0BFDD308 for ; Tue, 24 Feb 2015 14:03:55 -0500 (EST) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id A4F304EA2 for ; Tue, 24 Feb 2015 14:03:55 -0500 (EST) Message-ID: <54ECCB1B.7030705@buffalo.edu> Date: Tue, 24 Feb 2015 14:03:55 -0500 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: PCP Subject: Python requirement Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: Python requirement Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve11.acsu.buffalo.edu[128.205.6.22] X-Barracuda-Start-Time: 1424804636 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15784 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi, While tracking down a qa issue, I ended up with a machine (Centos 5.11 i386) that had a too old default version of python to build pcp python support. So python configuration was disabled. The core of pcp built fine and installed, but QA failed very early on with: ........... sample.dodgey.control old value=-1044 new value=5 rm -f reduce-gap.* pmlogextract reduce-1 reduce-2 reduce-gap make[1]: Leaving directory `/var/lib/pcp/testsuite/src' === pmdas === make[1]: Entering directory `/var/lib/pcp/testsuite/pmdas' make[1]: *** No rule to make target `slow_python', needed by `setup'. Stop. make[1]: Leaving directory `/var/lib/pcp/testsuite/pmdas' make: *** [setup] Error 2 Error: /usr/bin/make setup failed I know that there is ongoing python work currently, but since this is a new VM type for me, I'm not sure if this is a new issue or not. I was able to work around this by doing: env PYTHON=python2.6 Makepkgs and everything seems to work out fine, python pcp pieces are built, qa works etc. Is that the suggested procedure on older machines? Does QA require python to work in general? Thanks Martins From brolley@redhat.com Tue Feb 24 16:36:07 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id CC10D7F3F for ; Tue, 24 Feb 2015 16:36:07 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id BA3B88F8064 for ; Tue, 24 Feb 2015 14:36:04 -0800 (PST) X-ASG-Debug-ID: 1424817363-04cb6c4bd284db0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id CKB5GvI8HHVAfP1E (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 24 Feb 2015 14:36:03 -0800 (PST) X-Barracuda-Envelope-From: brolley@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1OMa3bb001355 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 24 Feb 2015 17:36:03 -0500 Received: from [10.10.61.198] (vpn-61-198.rdu2.redhat.com [10.10.61.198]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1OMa2OZ024842 for ; Tue, 24 Feb 2015 17:36:02 -0500 Message-ID: <54ECFD1F.5060707@redhat.com> Date: Tue, 24 Feb 2015 17:37:19 -0500 From: Dave Brolley User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: PCP Mailing List Subject: pcp updates: wcohen: --with-papi configuration Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: wcohen: --with-papi configuration Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424817363 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Changes committed to git://git.pcp.io/pcp.git dev Will Cohen (1): Allow an argument to the --with-papi configure option. configure | 25 ++++++++++++++++++++++--- configure.ac | 26 ++++++++++++++++++++++---- src/include/builddefs.in | 1 + src/pmdas/papi/GNUmakefile | 2 +- 4 files changed, 46 insertions(+), 8 deletions(-) From fche@redhat.com Tue Feb 24 19:07:33 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 388DC7F3F for ; Tue, 24 Feb 2015 19:07:33 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 275738F80A1 for ; Tue, 24 Feb 2015 17:07:30 -0800 (PST) X-ASG-Debug-ID: 1424826445-04cbb0610ea43c0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id JDUR06KIABWFZjdJ (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 24 Feb 2015 17:07:26 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1P17PE3017390 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 24 Feb 2015 20:07:25 -0500 Received: from fche.csb (vpn-233-48.phx2.redhat.com [10.3.233.48]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1P17OiI024583; Tue, 24 Feb 2015 20:07:25 -0500 Received: by fche.csb (Postfix, from userid 2569) id 86603586A7; Tue, 24 Feb 2015 20:07:21 -0500 (EST) To: Lukas Berk Cc: Nathan Scott , pcp@oss.sgi.com Subject: Re: pmdapapi buglets from Coverity scan References: <1730959537.2690842.1423612674835.JavaMail.zimbra@redhat.com> <8761atz99h.fsf@redhat.com> X-ASG-Orig-Subj: Re: pmdapapi buglets from Coverity scan From: fche@redhat.com (Frank Ch. Eigler) Date: Tue, 24 Feb 2015 20:07:21 -0500 In-Reply-To: <8761atz99h.fsf@redhat.com> (Lukas Berk's message of "Sun, 22 Feb 2015 20:50:18 -0500") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424826446 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Please see pcpfans.git fche/papi for a possible solution to the first problem Nathan's coverity note. commit d87918b71cd9d0b0a327325c80bf54105c7027e9 Author: Frank Ch. Eigler Date: Tue Feb 24 19:49:21 2015 -0500 papi pmda: improve papi auto-enable & batching, related error handling A coverity report [1] indicated problems in the way errors from a sequence of operations were being (not) propagated out properly. Defining what's proper is not easy, because when reading N counter metrics, especially in auto-enable mode, may involve partial failures. The recently added refresh-batching logic made this aspect of the situation more confusing. In the partial failure scenario, some counters give values, others lack them (never having been activated), yet others fail (an activation having been rejected). Now, per-counter fetch status is separated into those categories at papi_fetchCallBack time: success, vs. PMDA_FETCH_NOVALUES vs. PM_ERR_VALUE. This is accomplished by always batching a single refresh_counter() at the beginning of a papi_fetch(), so that by the time the individual counters are fetched, we know whether they were requested or not, and whether those requests succeeded. This also allows first-time fetches of auto-enabled counters to carry proper initial values (so no more "no values ..." initial warnings from a pmval over an auto-enabled papi counter). The papi.control.batch metric is no longer used and so eliminated. [1] http://oss.sgi.com/archives/pcp/2015-02/msg00081.html From kenj@internode.on.net Wed Feb 25 01:05:48 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 32C457F3F for ; Wed, 25 Feb 2015 01:05:48 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 016BA8F80D1 for ; Tue, 24 Feb 2015 23:05:44 -0800 (PST) X-ASG-Debug-ID: 1424847938-04bdf05c02ae670001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id 74Sc7cQW7VnWVOFa for ; Tue, 24 Feb 2015 23:05:38 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2CqAQB3c+1U/72b0XYNToNVWoMIwBmHXgEBAQEBAYU1VTAGAgUWCwILAwIBAgE/GQYCAQHCXnCZV4Ehjn2CUoFDBYVkjVeZIIQkW4JDAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail07.adl2.internode.on.net with ESMTP; 25 Feb 2015 17:35:38 +1030 Message-ID: <54ED7470.1050800@internode.on.net> Date: Wed, 25 Feb 2015 18:06:24 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1424847938 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15813 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (6): qa/666 and valgrind: more weird valgrind errors outside PCP code qa/518: pcp(1) output may contain newlines we're not expecting qa/555: more verbose output qa/647: a bit of extra diagnostics qa/744 & 745: need an altogether more cunning plan to find nvidia libraries qa/919: add dumplog output to $seq.full qa/518 | 10 +++++++ qa/555 | 58 ++++++++++++++++++++++++--------------------- qa/647 | 3 +- qa/666 | 11 +++++++- qa/666.out | 2 + qa/744 | 22 +++++++++++------ qa/745 | 24 ++++++++++++------ qa/919 | 1 qa/valgrind-suppress-3.8.1 | 43 +++++++++++++++++++++++++++++++++ 9 files changed, 130 insertions(+), 44 deletions(-) Details ... commit 7ccfc0ef20b64dcb5d8cc6b52b5a82f08b73b700 Author: Ken McDonell Date: Wed Feb 25 18:04:03 2015 +1100 qa/919: add dumplog output to $seq.full Trying to establish why the pmstat output from the created archive apparently contains missing values, but only sometimes. commit c16d2b73007bcdf22566cf48d86b5912030b1389 Author: Ken McDonell Date: Wed Feb 25 18:00:45 2015 +1100 qa/744 & 745: need an altogether more cunning plan to find nvidia libraries System installed nvidia libraries invalidate this test, so we need to look harder to detect their presence. On bozo-laptop they're hiding in /usr/lib/nvidia-310/. commit 98ed24a11b13c543c480da158c2390f1f54718b0 Author: Ken McDonell Date: Wed Feb 25 17:59:49 2015 +1100 qa/647: a bit of extra diagnostics Trying to understand why PMDA re-install sometimes races with pmcd not finished shutting down. commit 1c2cf8538712b8f3d5430d830da81e6f27dbc34f Author: Ken McDonell Date: Wed Feb 25 17:58:15 2015 +1100 qa/555: more verbose output Run pmie with -v, add filtering. Trying to track down why the {holdoff} lines do not appear in syslog every now and then. commit ecdbec354d7f451a71f34bbdbec44c6706fa1f99 Author: Ken McDonell Date: Wed Feb 25 17:56:58 2015 +1100 qa/518: pcp(1) output may contain newlines we're not expecting Needed some sed magic to make them go away. commit 12f5d7b90d83322854c80086735a71586adb0039 Author: Ken McDonell Date: Wed Feb 25 17:55:37 2015 +1100 qa/666 and valgrind: more weird valgrind errors outside PCP code On bozo-laptop this time. From wwwrun@oss.sgi.com Wed Feb 25 13:59:23 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id E2B167F50; Wed, 25 Feb 2015 13:59:23 -0600 (CST) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1078] ganglia=rrd importer Date: Wed, 25 Feb 2015 19:59:23 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: fche@redhat.com X-Bugzilla-Status: RESOLVED X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1424894363.A7D641.27645"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1424894363.A7D641.27645 Date: Wed, 25 Feb 2015 13:59:23 -0600 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1078 Frank Ch. Eigler changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution|--- |FIXED --- Comment #1 from Frank Ch. Eigler --- merged -- You are receiving this mail because: You are on the CC list for the bug. --1424894363.A7D641.27645 Date: Wed, 25 Feb 2015 13:59:23 -0600 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" changed bug 1078
What Removed Added
Status NEW RESOLVED
Resolution --- FIXED


You are receiving this mail because:
  • You are on the CC list for the bug.
--1424894363.A7D641.27645-- From kenj@internode.on.net Wed Feb 25 14:34:06 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 1B1037F47 for ; Wed, 25 Feb 2015 14:34:06 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id EDF258F80C5 for ; Wed, 25 Feb 2015 12:34:05 -0800 (PST) X-ASG-Debug-ID: 1424896431-04bdf05c00cb530001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id MfKYnGzHXv9lDTAF for ; Wed, 25 Feb 2015 12:33:52 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2AAAgBYMe5UPL2b0XYNToNUWoMJwBqHXQEBAQEBAQUBAQEBOIR0gQUGAgUhAhECMg4ZBgIBAYg4u3xwmTcggSGOfYJSgUMFkzyHOZFqhCRbAYJCAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl6.internode.on.net with ESMTP; 26 Feb 2015 07:03:43 +1030 Message-ID: <54EE31E3.70006@internode.on.net> Date: Thu, 26 Feb 2015 07:34:43 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1424896432 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15843 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Marius Vollmer (2): Whitespace pmlogger: Ensure that pmlogger starts after pmcd. Ken McDonell (1): assorted service configs: ensure After=... pmcd.service is present src/pmie/pmie.service.in | 6 +++--- src/pmlogger/pmlogger.service.in | 8 ++++---- src/pmmgr/pmmgr.service.in | 6 +++--- src/pmproxy/pmproxy.service.in | 7 +++---- src/pmwebapi/pmwebd.service.in | 2 +- 5 files changed, 14 insertions(+), 15 deletions(-) Details ... commit 6ce0123e85f1923a23f86584ac5cfb5056abb5ea Author: Ken McDonell Date: Thu Feb 26 07:31:36 2015 +1100 assorted service configs: ensure After=... pmcd.service is present Extension of mvollmer's commit via github so that services that may depend on pmcd for correct operation are started after pmcd. commit 9b45d26f9e3567aca6ae9a7b7f1e035fd2333df2 Author: Marius Vollmer Date: Wed Feb 25 14:51:17 2015 +0200 pmlogger: Ensure that pmlogger starts after pmcd. When pmlogger and pmcd are started at the same time by systemd (as happens during system boot), we need to make sure that pmlogger is not activated before pmcd is ready to accept connections from clients. https://bugzilla.redhat.com/show_bug.cgi?id=1185760 commit d5821f015da6fdc020626a6110a812ed7b0a40e9 Author: Marius Vollmer Date: Wed Feb 25 14:40:44 2015 +0200 Whitespace From brolley@redhat.com Wed Feb 25 17:05:12 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 94B7F7F47 for ; Wed, 25 Feb 2015 17:05:12 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 8395A8F8054 for ; Wed, 25 Feb 2015 15:05:09 -0800 (PST) X-ASG-Debug-ID: 1424905507-04cb6c4bd3bd510001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 79P5C2BVAiinGahN (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 25 Feb 2015 15:05:08 -0800 (PST) X-Barracuda-Envelope-From: brolley@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1PN57WK003899 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 25 Feb 2015 18:05:07 -0500 Received: from [10.15.16.142] ([10.15.16.142]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1PN555H029064 for ; Wed, 25 Feb 2015 18:05:07 -0500 Message-ID: <54EE556F.1000106@redhat.com> Date: Wed, 25 Feb 2015 18:06:23 -0500 From: Dave Brolley User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: PCP Mailing List Subject: pcp updates: kenj qa + services, mvollmer services Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: kenj qa + services, mvollmer services Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424905508 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Changes committed to git://git.pcp.io/pcp.git dev Ken McDonell (7): qa/666 and valgrind: more weird valgrind errors outside PCP code qa/518: pcp(1) output may contain newlines we're not expecting qa/555: more verbose output qa/647: a bit of extra diagnostics qa/744 & 745: need an altogether more cunning plan to find nvidia libraries qa/919: add dumplog output to $seq.full assorted service configs: ensure After=... pmcd.service is present Marius Vollmer (2): Whitespace pmlogger: Ensure that pmlogger starts after pmcd. qa/518 | 10 ++++++ qa/555 | 58 ++++++++++++++++++++------------------- qa/647 | 3 +- qa/666 | 11 ++++++- qa/666.out | 2 + qa/744 | 22 ++++++++++---- qa/745 | 24 ++++++++++------ qa/919 | 1 qa/valgrind-suppress-3.8.1 | 43 ++++++++++++++++++++++++++++ src/pmie/pmie.service.in | 6 ++-- src/pmlogger/pmlogger.service.in | 8 ++--- src/pmmgr/pmmgr.service.in | 6 ++-- src/pmproxy/pmproxy.service.in | 7 ++-- src/pmwebapi/pmwebd.service.in | 2 - 14 files changed, 144 insertions(+), 59 deletions(-) From nscott@redhat.com Wed Feb 25 17:10:35 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 90BD57F50 for ; Wed, 25 Feb 2015 17:10:35 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 20F12AC002 for ; Wed, 25 Feb 2015 15:10:31 -0800 (PST) X-ASG-Debug-ID: 1424905829-04cbb0610fce470001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id gwjCKV6bB89MBbqb (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 25 Feb 2015 15:10:29 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1PNASNH003714; Wed, 25 Feb 2015 18:10:28 -0500 Date: Wed, 25 Feb 2015 18:10:27 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus Cc: PCP Message-ID: <576677669.15613839.1424905827876.JavaMail.zimbra@redhat.com> In-Reply-To: <54ECCB1B.7030705@buffalo.edu> References: <54ECCB1B.7030705@buffalo.edu> Subject: Re: [pcp] Python requirement MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Python requirement Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Python requirement Thread-Index: Mla8VPdJXJCkxnYWJ456gHT67cPxpA== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1424905829 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15849 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Martins, ----- Original Message ----- > [...] So python configuration was disabled. The core of pcp > built fine and installed, but QA failed very early on with: > [...] > I know that there is ongoing python work currently, but since this is a > new VM type for me, I'm not sure if this is a new issue or not. It's a new issue. > I was able to work around this by doing: > > env PYTHON=python2.6 Makepkgs Oh that is interesting - there's a python 2.6 on RHEL5 after all - we could find ways to use it instead of disabling python entirely. > and everything seems to work out fine, python pcp pieces are built, qa > works etc. > > Is that the suggested procedure on older machines? Does QA require > python to work in general? It should not be required, but accidentally is at the moment - one of the makefiles is missing a guard, I'll push that fix in shortly. cheers. -- Nathan From minnus@buffalo.edu Wed Feb 25 18:50:06 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 014757F47 for ; Wed, 25 Feb 2015 18:50:06 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id D42358F8049 for ; Wed, 25 Feb 2015 16:50:02 -0800 (PST) X-ASG-Debug-ID: 1424911797-04bdf05c01d38c0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve11.acsu.buffalo.edu [128.205.6.22]) by cuda.sgi.com with ESMTP id sx9Ay8bDCzami9sN for ; Wed, 25 Feb 2015 16:49:57 -0800 (PST) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.6.22 Received: from localmailA.acsu.buffalo.edu (localmaila.acsu.buffalo.edu [128.205.5.196]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 2E0706B9; Wed, 25 Feb 2015 19:49:57 -0500 (EST) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 27693E03B; Wed, 25 Feb 2015 19:49:57 -0500 (EST) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailA.acsu.buffalo.edu (Postfix) with ESMTP id B3445E035; Wed, 25 Feb 2015 19:49:56 -0500 (EST) Received: from smtp.buffalo.edu (smtp2.acsu.buffalo.edu [128.205.5.254]) by localmailA.acsu.buffalo.edu (Prefixe) with ESMTP id A455BE033; Wed, 25 Feb 2015 19:49:56 -0500 (EST) Received: from [10.0.1.12] (cpe-69-204-8-250.buffalo.res.rr.com [69.204.8.250]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 625B94CA9; Wed, 25 Feb 2015 19:49:56 -0500 (EST) References: <54ECCB1B.7030705@buffalo.edu> <576677669.15613839.1424905827876.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 (1.0) In-Reply-To: <576677669.15613839.1424905827876.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-Id: <92AD6B0D-00DD-4DB8-926C-4C4E367AA94D@buffalo.edu> Cc: PCP X-Mailer: iPhone Mail (11D257) From: Martins Innus Subject: Re: [pcp] Python requirement Date: Wed, 25 Feb 2015 19:49:52 -0500 X-ASG-Orig-Subj: Re: [pcp] Python requirement To: Nathan Scott X-PM-EL-Spam-Prob: XX: 28% X-Barracuda-Connect: mtareserve11.acsu.buffalo.edu[128.205.6.22] X-Barracuda-Start-Time: 1424911797 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15853 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Nathan, > > >> I was able to work around this by doing: >> >> env PYTHON=python2.6 Makepkgs > > Oh that is interesting - there's a python 2.6 on RHEL5 after all - > we could find ways to use it instead of disabling python entirely. I think it may have come from epel, I can look for sure Tommorrow. Thanks Martins From nscott@redhat.com Wed Feb 25 19:07:34 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 15B3A7F47 for ; Wed, 25 Feb 2015 19:07:34 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 96F81AC005 for ; Wed, 25 Feb 2015 17:07:30 -0800 (PST) X-ASG-Debug-ID: 1424912844-04cbb0610dd1340001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id 1iqli3X7S62wFVJJ (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 25 Feb 2015 17:07:25 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1Q17NmM021172; Wed, 25 Feb 2015 20:07:23 -0500 Date: Wed, 25 Feb 2015 20:07:22 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus Cc: PCP Message-ID: <1212249336.15665421.1424912842983.JavaMail.zimbra@redhat.com> In-Reply-To: <92AD6B0D-00DD-4DB8-926C-4C4E367AA94D@buffalo.edu> References: <54ECCB1B.7030705@buffalo.edu> <576677669.15613839.1424905827876.JavaMail.zimbra@redhat.com> <92AD6B0D-00DD-4DB8-926C-4C4E367AA94D@buffalo.edu> Subject: Re: [pcp] Python requirement MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Python requirement Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: Python requirement Thread-Index: wK082pz7N2+XybLsOcq8g772Qn/dDw== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1424912845 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15853 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > >> I was able to work around this by doing: > >> > >> env PYTHON=python2.6 Makepkgs > > > > Oh that is interesting - there's a python 2.6 on RHEL5 after all - > > we could find ways to use it instead of disabling python entirely. > > I think it may have come from epel, I can look for sure Tommorrow. > Yep, found it there (package name is "python26") - which is the same place PCP would be coming from for alot of people, I guess. So it's probably OK for us to rely on this being there for us to use. cheers. -- Nathan From lberk@redhat.com Wed Feb 25 22:11:06 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id DDF047F47 for ; Wed, 25 Feb 2015 22:11:06 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id ABDC08F8050 for ; Wed, 25 Feb 2015 20:11:03 -0800 (PST) X-ASG-Debug-ID: 1424923859-04bdf05bffd93a0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 6AXjd4NNsq2RpkiC (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 25 Feb 2015 20:10:59 -0800 (PST) X-Barracuda-Envelope-From: lberk@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1Q4AwHI005081 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 25 Feb 2015 23:10:59 -0500 Received: from toium (vpn-51-123.rdu2.redhat.com [10.10.51.123]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1Q4AukN010375 (version=TLSv1/SSLv3 cipher=AES128-GCM-SHA256 bits=128 verify=NO); Wed, 25 Feb 2015 23:10:57 -0500 From: Lukas Berk To: fche@redhat.com (Frank Ch. Eigler) Cc: Nathan Scott , pcp@oss.sgi.com Subject: Re: pmdapapi buglets from Coverity scan References: <1730959537.2690842.1423612674835.JavaMail.zimbra@redhat.com> <8761atz99h.fsf@redhat.com> X-ASG-Orig-Subj: Re: pmdapapi buglets from Coverity scan Date: Wed, 25 Feb 2015 23:10:55 -0500 In-Reply-To: (Frank Ch. Eigler's message of "Tue, 24 Feb 2015 20:07:21 -0500") Message-ID: <87mw41s46o.fsf@redhat.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424923859 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hey Frank, Thanks for taking a hack at this. While taking a look at your patch, imo the papi.c portion is a good step of robustifying the fetch mechanism. However, I'd like to go a step further and eliminate the warnings completely from the installation of the pmda. How about the following small patch in addition to yours? It removes any warnings on startup, as we don't enable all the metrics we probe initially, and then returns the default to 120 seconds. The qa would need updating again, which I can provide. I would also like to remove the phrasing that warnings are reasonable in the testsuite, imo in this case, they aren't. On a side note, I'm not sure what the changes in pmdapapi.1 are supposed to mean? Are they mistakes? "#true -- ..." ? Cheers, Lukas diff --git a/src/pmdas/papi/Install b/src/pmdas/papi/Install index cdad731..e8cf05e 100644 --- a/src/pmdas/papi/Install +++ b/src/pmdas/papi/Install @@ -28,6 +28,8 @@ pmdaSetup # be activated at the same time, even with multiplexing: the excess will # come back with PM_ERR_VALUE. pmdaInstall +# Now allow for auto_enable functionality after iterating through metrics +pmstore papi.control.auto_enable 120 >/dev/null # Shut down any counters auto-enabled during the pmdaInstall step pmstore papi.control.reset "" >/dev/null diff --git a/src/pmdas/papi/papi.c b/src/pmdas/papi/papi.c index 16474ca..a37f60f 100644 --- a/src/pmdas/papi/papi.c +++ b/src/pmdas/papi/papi.c @@ -57,7 +57,7 @@ typedef struct { } papi_m_user_tuple; #define METRIC_ENABLED_FOREVER ((time_t)-1) -static __uint32_t auto_enable_time = 120; /* seconds; 0:disabled */ +static __uint32_t auto_enable_time = 0; /* seconds; 0:disabled */ static int auto_enable_afid = -1; /* pmaf(3) identifier for periodic callback */ static int enable_multiplexing = 1; /* on by default */ fche@redhat.com (Frank Ch. Eigler) writes: > Please see pcpfans.git fche/papi for a possible solution to the first > problem Nathan's coverity note. > > commit d87918b71cd9d0b0a327325c80bf54105c7027e9 > Author: Frank Ch. Eigler > Date: Tue Feb 24 19:49:21 2015 -0500 > > papi pmda: improve papi auto-enable & batching, related error handling > > A coverity report [1] indicated problems in the way errors from a > sequence of operations were being (not) propagated out properly. > Defining what's proper is not easy, because when reading N counter > metrics, especially in auto-enable mode, may involve partial > failures. The recently added refresh-batching logic made this aspect > of the situation more confusing. > > In the partial failure scenario, some counters give values, others > lack them (never having been activated), yet others fail (an > activation having been rejected). Now, per-counter fetch status is > separated into those categories at papi_fetchCallBack time: success, > vs. PMDA_FETCH_NOVALUES vs. PM_ERR_VALUE. > > This is accomplished by always batching a single refresh_counter() at > the beginning of a papi_fetch(), so that by the time the individual > counters are fetched, we know whether they were requested or not, and > whether those requests succeeded. This also allows first-time fetches > of auto-enabled counters to carry proper initial values (so no more > "no values ..." initial warnings from a pmval over an auto-enabled > papi counter). The papi.control.batch metric is no longer used and so > eliminated. > > [1] http://oss.sgi.com/archives/pcp/2015-02/msg00081.html From nscott@redhat.com Thu Feb 26 01:13:00 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 436ED7F47 for ; Thu, 26 Feb 2015 01:13:00 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id D24A3AC002 for ; Wed, 25 Feb 2015 23:12:56 -0800 (PST) X-ASG-Debug-ID: 1424934772-04cb6c4bd1d9490001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id L8sCJbw9cEo9zFTp (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 25 Feb 2015 23:12:53 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1Q7Cq7p029198 for ; Thu, 26 Feb 2015 02:12:52 -0500 Date: Thu, 26 Feb 2015 02:12:51 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: PCP Message-ID: <224887672.15976488.1424934771959.JavaMail.zimbra@redhat.com> Subject: pcp updates: qa, python3 work MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: qa, python3 work Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: qa, python3 work Thread-Index: 9MNZFvqv5EFd1N1mL5MdGCOnQ1wQFQ== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1424934772 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15864 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Nathan Scott (9): qa: resolve pcp-testsuite build issue with python disabled qa: ensure qa/359 works on non-containers hosts too pcp-uptime: python3 portability changes (int/float) pmatop: python2/python3 portability work qa: update test 145 to handle optional container feature bit qa: tests porting allowing python version switching pmiostat: python3 porting work, ensure sorted device output pmcollectl: python3 porting work, esp int/float and map issues pcp2graphite: python3 porting work, syntax + qa initially qa/145 | 1 qa/359 | 6 +- qa/667 | 10 +-- qa/742 | 10 +-- qa/743 | 13 +++-- qa/829 | 6 +- qa/842 | 2 qa/842.out | 8 +-- qa/991 | 15 +++-- qa/pmdas/GNUmakefile.install | 5 + src/pcp/uptime/pcp-uptime.py | 12 ++-- src/pcp2graphite/pcp2graphite.py | 79 +++++++++++++++---------------- src/pmatop/pmatop.py | 99 ++++++++++++++++++++++----------------- src/pmcollectl/pmcollectl.py | 27 +++++----- src/pmiostat/pmiostat.py | 2 src/python/pcp/pmgui.py | 12 ++++ src/python/pcp/pmsubsys.py | 35 +++++++------ 17 files changed, 193 insertions(+), 149 deletions(-) From kenj@internode.on.net Thu Feb 26 01:22:56 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 40D097F47 for ; Thu, 26 Feb 2015 01:22:56 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id BCF97AC005 for ; Wed, 25 Feb 2015 23:22:55 -0800 (PST) X-ASG-Debug-ID: 1424935372-04cb6c4bd3dc4c0001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id ZxAsvCYGv6vMZiQ7 for ; Wed, 25 Feb 2015 23:22:53 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DkAQDvyO5U/72b0XYNToNUWoMJvmmHXwEBAQEBAYU1FUAwBgIFFgsCCwMCAQIBWAYCAQHDfXCZNYEhjXyBAYJSgUMFk0OZJoQkW4ECgUEBAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail07.adl2.internode.on.net with ESMTP; 26 Feb 2015 17:52:51 +1030 Message-ID: <54EEC9FD.5060006@internode.on.net> Date: Thu, 26 Feb 2015 18:23:41 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - qa/752 once more Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates - qa/752 once more Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1424935372 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15866 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (1): qa/752: harder to fix than killing a horde of zombies qa/752 | 26 +++++++++++++++++++++++++- 1 file changed, 25 insertions(+), 1 deletion(-) Details ... commit 8c5c4b193d3848e1be83d5996cad8f61235a8c78 Author: Ken McDonell Date: Thu Feb 26 17:58:38 2015 +1100 qa/752: harder to fix than killing a horde of zombies Turns out that our gnulib-based code has evolved over time, as has the official version that is used by date(1). As a consequence, we may (on older platforms) have a fixed libpcp but a (semantically) broken date(1) ... which causes the QA test to fail. This commit does a Larry Wall-like sniff test to determine if date(1) is broken and then tweaks the filter to make the test pass ... don't look unless you have a strong stomach. From mgoodwin@redhat.com Thu Feb 26 01:58:44 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id A04227F47 for ; Thu, 26 Feb 2015 01:58:44 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 8E2F0304059 for ; Wed, 25 Feb 2015 23:58:41 -0800 (PST) X-ASG-Debug-ID: 1424937519-04cb6c4bd0df300001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id cIQA6MKyvJbGDTFe (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 25 Feb 2015 23:58:40 -0800 (PST) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1Q7wcOa012012 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 26 Feb 2015 02:58:39 -0500 Received: from [10.64.51.148] (vpn1-51-148.bne.redhat.com [10.64.51.148]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1Q7wK52025428 for ; Thu, 26 Feb 2015 02:58:31 -0500 Message-ID: <54EED206.3040009@redhat.com> Date: Thu, 26 Feb 2015 18:57:58 +1100 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp Subject: patch, rfc - pcp-gui upgrade issue Content-Type: multipart/mixed; boundary="------------050601050505090608020300" X-ASG-Orig-Subj: patch, rfc - pcp-gui upgrade issue X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424937520 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 This is a multi-part message in MIME format. --------------050601050505090608020300 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit On a RHEL7.1 system with 3.9.10-8.el7, trying to upgrade to 3.10.3 fails : $ sudo rpm -Uvh pcp-3.10.3/build/rpm/*.{x86_64,noarch}.rpm error: Failed dependencies: pcp-libs = 3.9.10-8.el7 is needed by (installed) pcp-gui-3.9.10-8.el7.x86_64 I suspect the pcp-gui build-requires clause should be '>=' not '>' but wanted to check if there really is a specific version dependency? The following patch seems to fix it. Thanks --------------050601050505090608020300 Content-Type: text/x-patch; name="pcp-gui_upgrade.patch" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="pcp-gui_upgrade.patch" diff --git a/build/rpm/pcp.spec.in b/build/rpm/pcp.spec.in index bdaa097..28d9ca6 100644 --- a/build/rpm/pcp.spec.in +++ b/build/rpm/pcp.spec.in @@ -404,7 +404,7 @@ License: GPLv2+ and LGPLv2+ and LGPLv2+ with exceptions Group: Applications/System Summary: Visualization tools for the Performance Co-Pilot toolkit URL: http://www.pcp.io -Requires: pcp-libs = %{version}-%{release} +Requires: pcp-libs >= %{version}-%{release} %description -n pcp-gui Visualization tools for the Performance Co-Pilot toolkit. --------------050601050505090608020300-- From mgoodwin@redhat.com Thu Feb 26 02:06:17 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 7D0F97F47 for ; Thu, 26 Feb 2015 02:06:17 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 26BA7AC01E for ; Thu, 26 Feb 2015 00:06:14 -0800 (PST) X-ASG-Debug-ID: 1424937973-04bdf05c01f9d00001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 2ZQK5a1blpASkdh3 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 26 Feb 2015 00:06:13 -0800 (PST) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1Q86CYK004046 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 26 Feb 2015 03:06:13 -0500 Received: from [10.64.51.148] (vpn1-51-148.bne.redhat.com [10.64.51.148]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1Q85nkQ009721 for ; Thu, 26 Feb 2015 03:06:05 -0500 Message-ID: <54EED3D5.3060804@redhat.com> Date: Thu, 26 Feb 2015 19:05:41 +1100 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] patch, rfc - pcp-gui upgrade issue References: <54EED206.3040009@redhat.com> X-ASG-Orig-Subj: Re: [pcp] patch, rfc - pcp-gui upgrade issue In-Reply-To: <54EED206.3040009@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424937973 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 02/26/2015 06:57 PM, Mark Goodwin wrote: > On a RHEL7.1 system with 3.9.10-8.el7, trying to upgrade to 3.10.3 fails : > > $ sudo rpm -Uvh pcp-3.10.3/build/rpm/*.{x86_64,noarch}.rpm > error: Failed dependencies: > pcp-libs = 3.9.10-8.el7 is needed by (installed) > pcp-gui-3.9.10-8.el7.x86_64 > > I suspect the pcp-gui build-requires clause should be '>=' not '>' sorry, I mean: should be '>=' not '=' From fche@redhat.com Thu Feb 26 05:31:05 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id AA98D7F47 for ; Thu, 26 Feb 2015 05:31:05 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 89F87304053 for ; Thu, 26 Feb 2015 03:31:02 -0800 (PST) X-ASG-Debug-ID: 1424950257-04cb6c4bd2e6e10001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id kl9J9dl2fWQX0r8O (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 26 Feb 2015 03:30:58 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1QBUvDT007760 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 26 Feb 2015 06:30:57 -0500 Received: from fche.csb (vpn-233-48.phx2.redhat.com [10.3.233.48]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1QBUvwE015436; Thu, 26 Feb 2015 06:30:57 -0500 Received: by fche.csb (Postfix, from userid 2569) id 20B5758518; Thu, 26 Feb 2015 06:30:53 -0500 (EST) Date: Thu, 26 Feb 2015 06:30:52 -0500 From: "Frank Ch. Eigler" To: Lukas Berk Cc: Nathan Scott , pcp@oss.sgi.com Subject: Re: pmdapapi buglets from Coverity scan Message-ID: <20150226113052.GA13422@redhat.com> X-ASG-Orig-Subj: Re: pmdapapi buglets from Coverity scan References: <1730959537.2690842.1423612674835.JavaMail.zimbra@redhat.com> <8761atz99h.fsf@redhat.com> <87mw41s46o.fsf@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <87mw41s46o.fsf@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424950258 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, Lukas - > [...] How about the following small patch in addition to yours? It > removes any warnings on startup, as we don't enable all the metrics > we probe initially, and then returns the default to 120 seconds. The effect of that patch would be not only to just disable auto-enable during the initial pmda install, but on every subsequent pmcd restart. That's harsh. > The qa would need updating again, which I can provide. I would also > like to remove the phrasing that warnings are reasonable in the > testsuite, imo in this case, they aren't. The warnings in this case are apropos: some counter values are just not available for the asking. By turning auto-enable off during install, as in your patch, this fact is obscured from the pmprobe/user, because then no counters are even attempted to be used! If the point of the pmdaInstall "pmprobe -i" is to exercise the pmda, then let's exercise it. > On a side note, I'm not sure what the changes in pmdapapi.1 are > supposed to mean? Are they mistakes? "#true -- ..." ? They're just comments, explaining each command. They're executable, in case a user copy&pastes that section of the man page into a shell. - FChE From brolley@redhat.com Thu Feb 26 10:05:40 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 05F877F50 for ; Thu, 26 Feb 2015 10:05:40 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id E7DBA8F8064 for ; Thu, 26 Feb 2015 08:05:36 -0800 (PST) X-ASG-Debug-ID: 1424966735-04cb6c4bd2f4210001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id IDBRieYbgfDhg1xD (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 26 Feb 2015 08:05:35 -0800 (PST) X-Barracuda-Envelope-From: brolley@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1QG5XWg010061 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 26 Feb 2015 11:05:34 -0500 Received: from [10.10.62.51] (vpn-62-51.rdu2.redhat.com [10.10.62.51]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1QG5Xw1020774 for ; Thu, 26 Feb 2015 11:05:33 -0500 Message-ID: <54EF449B.6060506@redhat.com> Date: Thu, 26 Feb 2015 11:06:51 -0500 From: Dave Brolley User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: PCP Mailing List Subject: PCP Release 3.10.3 Scheduled for Monday March 2, 2015 Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: PCP Release 3.10.3 Scheduled for Monday March 2, 2015 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424966735 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi all, This is just a reminder that PCP release 3.10.3 is scheduled for this coming Monday March 2. Since I will be doing the release, that means Monday here in North America. As a result we will be selective in deciding which pending patches are to be included starting about now. If you have something pending that you strongly feel should be in the release, then please let me and Nathan know. If you have time to run qa on the platforms available to you, please do so and please report/fix any problems or regressions. I hope to freeze the code at the end of the day on Friday (North America). Thanks, Dave From fche@redhat.com Thu Feb 26 11:51:21 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id BD36C29DF7 for ; Thu, 26 Feb 2015 11:51:21 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 9CF248F8037 for ; Thu, 26 Feb 2015 09:51:18 -0800 (PST) X-ASG-Debug-ID: 1424973073-04cbb06110108100001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id HgF04fvpt0gz1qxh (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 26 Feb 2015 09:51:14 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1QHpCrs026719 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 26 Feb 2015 12:51:13 -0500 Received: from fche.csb (vpn-233-48.phx2.redhat.com [10.3.233.48]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1QHpCxj012853; Thu, 26 Feb 2015 12:51:12 -0500 Received: by fche.csb (Postfix, from userid 2569) id 06A9258518; Thu, 26 Feb 2015 12:51:06 -0500 (EST) To: Mark Goodwin Cc: pcp Subject: Re: patch, rfc - pcp-gui upgrade issue References: <54EED206.3040009@redhat.com> X-ASG-Orig-Subj: Re: patch, rfc - pcp-gui upgrade issue From: fche@redhat.com (Frank Ch. Eigler) Date: Thu, 26 Feb 2015 12:51:06 -0500 In-Reply-To: <54EED206.3040009@redhat.com> (Mark Goodwin's message of "Thu, 26 Feb 2015 18:57:58 +1100") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424973074 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Mark Goodwin writes: > [...] > pcp-libs = 3.9.10-8.el7 is needed by (installed) > pcp-gui-3.9.10-8.el7.x86_64 > [...] This explicit -libs dependency is quite possibly not even needed. The rpm packaging machinery identifies shared library dependencies automatically, and by SONAME instead of rpm name, which is even better. % rpm -q --requires pcp-gui [...] libpcp.so.3()(64bit) libpcp.so.3(PCP_3.0)(64bit) libpcp.so.3(PCP_3.2)(64bit) libpcp.so.3(PCP_3.8)(64bit) [...] - FChE From fche@redhat.com Thu Feb 26 13:00:42 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id BD77E7F50 for ; Thu, 26 Feb 2015 13:00:42 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 4A84EAC008 for ; Thu, 26 Feb 2015 11:00:39 -0800 (PST) X-ASG-Debug-ID: 1424977237-04cbb0610f10c100001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id pgO1ZDxWMiifWOei (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 26 Feb 2015 11:00:38 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1QJ0bXj011306 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 26 Feb 2015 14:00:37 -0500 Received: from fche.csb (vpn-233-48.phx2.redhat.com [10.3.233.48]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1QJ0aLH002803; Thu, 26 Feb 2015 14:00:36 -0500 Received: by fche.csb (Postfix, from userid 2569) id 6CFBF58518; Thu, 26 Feb 2015 14:00:32 -0500 (EST) To: Lukas Berk Cc: pcp@oss.sgi.com Subject: Re: pmdapapi buglets from Coverity scan References: <1730959537.2690842.1423612674835.JavaMail.zimbra@redhat.com> <8761atz99h.fsf@redhat.com> <87mw41s46o.fsf@redhat.com> X-ASG-Orig-Subj: Re: pmdapapi buglets from Coverity scan From: fche@redhat.com (Frank Ch. Eigler) Date: Thu, 26 Feb 2015 14:00:32 -0500 In-Reply-To: <87mw41s46o.fsf@redhat.com> (Lukas Berk's message of "Wed, 25 Feb 2015 23:10:55 -0500") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424977238 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Lukas Berk writes: > [...] I would also like to remove the phrasing that warnings are > reasonable in the testsuite, imo in this case, they aren't. [...] (By the way, in case the existence of warnings during pmda install seems somehow offensive on principle, please be aware that many other pmdas produce them, and this is OK.) - FChE From lberk@redhat.com Thu Feb 26 13:23:20 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 9EBBC7F50 for ; Thu, 26 Feb 2015 13:23:20 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 7E84630406B for ; Thu, 26 Feb 2015 11:23:20 -0800 (PST) X-ASG-Debug-ID: 1424978595-04bdf05c02118930001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id hQVKufmZWVn1vLVQ (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 26 Feb 2015 11:23:16 -0800 (PST) X-Barracuda-Envelope-From: lberk@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1QJNEFs006970 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 26 Feb 2015 14:23:15 -0500 Received: from toium (dhcp-10-15-16-126.yyz.redhat.com [10.15.16.126]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1QJNBdL013734 (version=TLSv1/SSLv3 cipher=AES128-GCM-SHA256 bits=128 verify=NO) for ; Thu, 26 Feb 2015 14:23:13 -0500 From: Lukas Berk To: pcp@oss.sgi.com Subject: PR1073 - pmlogger PID lifetime-matched logging Date: Thu, 26 Feb 2015 14:23:11 -0500 X-ASG-Orig-Subj: PR1073 - pmlogger PID lifetime-matched logging Message-ID: <87sids32ao.fsf@redhat.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424978596 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, Please see commit 7347927a67849a74b67d8b25fb58c033ee79042d on git://sourceware.org/git/pcpfans.git lberk/dev Included is a proposed solution for PR1073, monitoring and matching the lifetime of a pmlogger instance to a PID specified. I've also included qa and have found no regressions when testing the pmlogger qa group. Any comments appreciated. Thanks, Lukas commit 7347927a67849a74b67d8b25fb58c033ee79042d Author: Lukas Berk Date: Thu Feb 26 14:13:21 2015 -0500 PR1073 - pmlogger --PID lifetime tracking functionality PR1073 detailed a request to run an instance of pmlogger, which matched the lifetime of a specified PID. Monitor return of a kill(PID, 0) style call, and exit once we get an ESRCH (no such process) error. Updated doc pmlogger (1), and additional qa (947) added to the pmlogger testing group From brolley@redhat.com Thu Feb 26 13:53:40 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 9A6127F4E for ; Thu, 26 Feb 2015 13:53:40 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 6AB2A8F804C for ; Thu, 26 Feb 2015 11:53:37 -0800 (PST) X-ASG-Debug-ID: 1424980416-04bdf05c00119580001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id fLGzlhxj723Iy5WU (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 26 Feb 2015 11:53:36 -0800 (PST) X-Barracuda-Envelope-From: brolley@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1QJrZQB018286 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 26 Feb 2015 14:53:35 -0500 Received: from [10.10.52.196] (vpn-52-196.rdu2.redhat.com [10.10.52.196]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1QJrZTU002103 for ; Thu, 26 Feb 2015 14:53:35 -0500 Message-ID: <54EF7A0E.1080900@redhat.com> Date: Thu, 26 Feb 2015 14:54:54 -0500 From: Dave Brolley User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: PCP Mailing List Subject: pcp updates: kenj qa/752, mvollmer rc_pmd Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: kenj qa/752, mvollmer rc_pmd Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424980416 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Changes committed to git://git.pcp.io/pcp.git dev Marius Vollmer (1): rc_pmcd: Wait for pmcd to be ready before reporting success. Ken McDonell (1): qa/752: harder to fix than killing a horde of zombies src/pmcd/rc_pmcd | 1 qa/752 | 26 +++++++++++++++++++++++++- From kenj@internode.on.net Thu Feb 26 14:42:13 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id D07087F4E for ; Thu, 26 Feb 2015 14:42:13 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id BB4C58F8087 for ; Thu, 26 Feb 2015 12:42:13 -0800 (PST) X-ASG-Debug-ID: 1424983327-04cbb0610e10ec40001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id c4l4zbsTZnqlFPyX for ; Thu, 26 Feb 2015 12:42:08 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2AoAgADhO9UPL2b0XYNToNUWoMJgy67SodsAQEBAQEBBQEBAQE4hHSBBQYCBSECEQIyDhkGAgEBxQZwmiOBIY59glKBQwWTT5kugiUcgWRbgkMBAQE Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl2.internode.on.net with ESMTP; 27 Feb 2015 07:12:07 +1030 Message-ID: <54EF855C.40900@internode.on.net> Date: Fri, 27 Feb 2015 07:43:08 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1424983327 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15891 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp dev Ken McDonell (1): pmlogger: -p pid option Lukas Berk (1): PR1073 - pmlogger --PID lifetime tracking functionality man/man1/pmlogger.1 | 20 +++++++++++++++---- qa/947 | 46 ++++++++++++++++++++++++++++++++++++++++++++ qa/947.out | 8 +++++++ qa/group | 1 src/pmlogger/src/pmlogger.c | 26 ++++++++++++++++++++++-- 5 files changed, 95 insertions(+), 6 deletions(-) Details ... commit 0560451af0237d9d98ae5070077f15d6cfe9c611 Author: Ken McDonell Date: Fri Feb 27 07:40:44 2015 +1100 pmlogger: -p pid option Fixed initialization that was a bug and caught by the compiler. Slight wordsmithing for the man page. commit 21a2eea73cbd20f5abeeaea734d955f72e4d806f Author: Lukas Berk Date: Thu Feb 26 14:13:21 2015 -0500 PR1073 - pmlogger --PID lifetime tracking functionality PR1073 detailed a request to run an instance of pmlogger, which matched the lifetime of a specified PID. Monitor return of a kill(PID, 0) style call, and exit once we get an ESRCH (no such process) error. Updated doc pmlogger (1), and additional qa (947) added to the pmlogger testing group. From kenj@internode.on.net Thu Feb 26 14:44:16 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 6CA7A29DF7 for ; Thu, 26 Feb 2015 14:44:16 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 0900FAC00D for ; Thu, 26 Feb 2015 12:44:12 -0800 (PST) X-ASG-Debug-ID: 1424983449-04cbb0611010ed30001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id 8MunOPV6BXQVraah for ; Thu, 26 Feb 2015 12:44:09 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2AGAgBjhe9UPL2b0XYNToNUWoY3u0qFeAKBcgEBAQEBAQUBAQEBOIRLAQEEOEARCxgJFg8JAwIBAgExFBMIAQEXxFWaaAEBAQcCAR+LE4E9gzgWhBUBBI12hVmHADmCZY8QgiUND4FkW4JDAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl2.internode.on.net with ESMTP; 27 Feb 2015 07:13:36 +1030 Message-ID: <54EF85B6.4010000@internode.on.net> Date: Fri, 27 Feb 2015 07:44:38 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] PR1073 - pmlogger PID lifetime-matched logging References: <87sids32ao.fsf@redhat.com> X-ASG-Orig-Subj: Re: [pcp] PR1073 - pmlogger PID lifetime-matched logging In-Reply-To: <87sids32ao.fsf@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1424983449 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15891 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 27/02/15 06:23, Lukas Berk wrote: > Hi, > > Please see commit 7347927a67849a74b67d8b25fb58c033ee79042d on > git://sourceware.org/git/pcpfans.git lberk/dev > > Included is a proposed solution for PR1073, monitoring and matching > the lifetime of a pmlogger instance to a PID specified. I've also > included qa and have found no regressions when testing the pmlogger qa > group. Any comments appreciated. Thanks Lukas. Looks good. I've committed a followup with a small code change (missing initialization) and some rewording of the man page. Please advise if either of these look wrong. From fche@redhat.com Thu Feb 26 14:46:25 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id D99CA7F4E for ; Thu, 26 Feb 2015 14:46:25 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id C41FE8F8071 for ; Thu, 26 Feb 2015 12:46:25 -0800 (PST) X-ASG-Debug-ID: 1424983584-04cbb0610d10eee0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id ixa6IAytOFgLGPKl (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 26 Feb 2015 12:46:24 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1QKkM6G025497 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Thu, 26 Feb 2015 15:46:22 -0500 Received: from fche.csb (vpn-233-48.phx2.redhat.com [10.3.233.48]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1QKkM0C031732; Thu, 26 Feb 2015 15:46:22 -0500 Received: by fche.csb (Postfix, from userid 2569) id D9C0958518; Thu, 26 Feb 2015 15:46:15 -0500 (EST) To: Lukas Berk Cc: pcp@oss.sgi.com, minnus@buffalo.edu, jpwhite4@buffalo.edu, tyearke@buffalo.edu Subject: Re: PR1073 - pmlogger PID lifetime-matched logging References: <87sids32ao.fsf@redhat.com> X-ASG-Orig-Subj: Re: PR1073 - pmlogger PID lifetime-matched logging From: fche@redhat.com (Frank Ch. Eigler) Date: Thu, 26 Feb 2015 15:46:15 -0500 In-Reply-To: <87sids32ao.fsf@redhat.com> (Lukas Berk's message of "Thu, 26 Feb 2015 14:23:11 -0500") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424983584 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, Lukas - > Please see commit 7347927a67849a74b67d8b25fb58c033ee79042d on > git://sourceware.org/git/pcpfans.git lberk/dev Thanks, nice work! Included some Buffalo folks on cc:, because the idea for this PR [1] came from their site needs at CCR, to have job-specific pmlogger data. It would be nice to know whether, with this facility, a "pmlc one-shot METRIC" widget would be helpful or redundant. > Included is a proposed solution for PR1073, monitoring and matching > the lifetime of a pmlogger instance to a PID specified. I've also > included qa and have found no regressions when testing the pmlogger > qa group. Any comments appreciated. I'd suggest just a couple of things. The man page should show that the $pid in question must be related to the pmlogger process to the degree that the kernel must permit a kill($pid,0) to it, which means in effect that only one's own processes may be monitored. Another thing is the timing of the checking done in the pmlogger main loop: it is done apprx. once per alarm-expiry, meaning no more frequently than the normal metric-polling interval (60s default). The test case looks nice & simple (though the exact number of recorded entries, 4, might oscillate to and fro on a busier test machine). (A total tool-shed nit would be to change "--PID" to "--pid".) [1] http://oss.sgi.com/bugzilla/show_bug.cgi?id=1073 - FChE From kenj@internode.on.net Thu Feb 26 14:47:59 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 5C4687F4E for ; Thu, 26 Feb 2015 14:47:59 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 3A9AE8F8040 for ; Thu, 26 Feb 2015 12:47:59 -0800 (PST) X-ASG-Debug-ID: 1424983676-04cb6c4bd1fccd0001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id zxm5K8ILMiJ9qLqp for ; Thu, 26 Feb 2015 12:47:56 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2AoAgBjhe9UPL2b0XYNToNUWoMJgy67SodsAQEBAQEBBQEBAQE4hHRVMAYCBRYLAgsDAgECATEnBgIBAcRscJokgSGOfYJSgUMFk0+ZLoIlHIFkW4JDAQEB Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl2.internode.on.net with ESMTP; 27 Feb 2015 07:17:54 +1030 Message-ID: <54EF86B8.3020609@internode.on.net> Date: Fri, 27 Feb 2015 07:48:56 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - in official tree this time Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - in official tree this time Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1424983676 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15891 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/pcp.git dev Ken McDonell (1): pmlogger: -p pid option Lukas Berk (1): PR1073 - pmlogger --PID lifetime tracking functionality man/man1/pmlogger.1 | 20 +++++++++++++++---- qa/947 | 46 ++++++++++++++++++++++++++++++++++++++++++++ qa/947.out | 8 +++++++ qa/group | 1 src/pmlogger/src/pmlogger.c | 26 ++++++++++++++++++++++-- 5 files changed, 95 insertions(+), 6 deletions(-) Details ... commit 0560451af0237d9d98ae5070077f15d6cfe9c611 Author: Ken McDonell Date: Fri Feb 27 07:40:44 2015 +1100 pmlogger: -p pid option Fixed initialization that was a bug and caught by the compiler. Slight wordsmithing for the man page. commit 21a2eea73cbd20f5abeeaea734d955f72e4d806f Author: Lukas Berk Date: Thu Feb 26 14:13:21 2015 -0500 PR1073 - pmlogger --PID lifetime tracking functionality PR1073 detailed a request to run an instance of pmlogger, which matched the lifetime of a specified PID. Monitor return of a kill(PID, 0) style call, and exit once we get an ESRCH (no such process) error. Updated doc pmlogger (1), and additional qa (947) added to the pmlogger testing group. From fche@redhat.com Thu Feb 26 15:44:23 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 2F5367F50 for ; Thu, 26 Feb 2015 15:44:23 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 000A4304053 for ; Thu, 26 Feb 2015 13:44:19 -0800 (PST) X-ASG-Debug-ID: 1424987055-04bdf05c0211c800001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id SEVJdDAccoGgZBy0 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 26 Feb 2015 13:44:15 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1QLiEnp017003 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 26 Feb 2015 16:44:14 -0500 Received: from fche.csb (vpn-233-48.phx2.redhat.com [10.3.233.48]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1QLiEek016428; Thu, 26 Feb 2015 16:44:14 -0500 Received: by fche.csb (Postfix, from userid 2569) id E90BE58518; Thu, 26 Feb 2015 16:44:09 -0500 (EST) Date: Thu, 26 Feb 2015 16:44:09 -0500 From: "Frank Ch. Eigler" To: pcp developers Cc: mvollmer@redhat.com Subject: pcp update: RHBZ1187588 - PM_CONTEXT_LOCAL crashes process when /etc/pcp.conf is unreadable Message-ID: <20150226214409.GH13422@redhat.com> X-ASG-Orig-Subj: pcp update: RHBZ1187588 - PM_CONTEXT_LOCAL crashes process when /etc/pcp.conf is unreadable Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424987055 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - Please see pcpfans.git fche/rhbz1187588. commit ce4c4b526b279e29e18b2f0805173be8ffe8b2b7 Author: Frank Ch. Eigler Date: Thu Feb 26 16:34:01 2015 -0500 RHBZ1187588: don't exit() from a failing pmGetConfig An eagle-eyed mvollmer noted the ominous warnings & code for pmGetConfig(), wherein a missing pcp.conf file was deemed a "FATAL PCP ERROR" and resulted in a process exit(). This sort of error handling is not appropriate within a library, as the application is better equipped to judge the severity of the problem. The caller must already handle return values of empty strings, so now a missing /etc/pcp.conf is treated just as a misformatted one, and results in the same "" result. QA 448 is updated to accept a rc=0 outcome from a non-crashing src/getconfig, and the pmgetconfig.3 man page scares less. From lberk@redhat.com Thu Feb 26 15:54:02 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id B43A57F50 for ; Thu, 26 Feb 2015 15:54:02 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id A1DCB304064 for ; Thu, 26 Feb 2015 13:54:02 -0800 (PST) X-ASG-Debug-ID: 1424987640-04cbb06110110910001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id lI5WSe13x58AkjYY (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 26 Feb 2015 13:54:01 -0800 (PST) X-Barracuda-Envelope-From: lberk@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1QLrxdf028132 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 26 Feb 2015 16:54:00 -0500 Received: from toium (dhcp-10-15-16-126.yyz.redhat.com [10.15.16.126]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1QLruj0021427 (version=TLSv1/SSLv3 cipher=AES128-GCM-SHA256 bits=128 verify=NO); Thu, 26 Feb 2015 16:53:58 -0500 From: Lukas Berk To: "Frank Ch. Eigler" Cc: Nathan Scott , pcp@oss.sgi.com Subject: Re: pmdapapi buglets from Coverity scan References: <1730959537.2690842.1423612674835.JavaMail.zimbra@redhat.com> <8761atz99h.fsf@redhat.com> <87mw41s46o.fsf@redhat.com> <20150226113052.GA13422@redhat.com> X-ASG-Orig-Subj: Re: pmdapapi buglets from Coverity scan Date: Thu, 26 Feb 2015 16:53:55 -0500 In-Reply-To: <20150226113052.GA13422@redhat.com> (Frank Ch. Eigler's message of "Thu, 26 Feb 2015 06:30:52 -0500") Message-ID: <87wq34tk3w.fsf@redhat.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424987641 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hey Frank, "Frank Ch. Eigler" writes: [...] > The effect of that patch would be not only to just disable auto-enable > during the initial pmda install, but on every subsequent pmcd restart. > That's harsh. Admittedly that was a side effect I had not considered, and I would agree it is undesirable. >> The qa would need updating again, which I can provide. I would also >> like to remove the phrasing that warnings are reasonable in the >> testsuite, imo in this case, they aren't. > > The warnings in this case are apropos: some counter values are just > not available for the asking. By turning auto-enable off during > install, as in your patch, this fact is obscured from the > pmprobe/user, because then no counters are even attempted to be used! > If the point of the pmdaInstall "pmprobe -i" is to exercise the pmda, > then let's exercise it. While I understand the warnings themselves are apropos, my issue with them was more along the lines of, how is a user discern between those warnings, and legitimate ones? Perhaps a good compromise could be to make mention/echo in the Install script (similar to pmdatrace), mentioning to a user that this may happen. >> On a side note, I'm not sure what the changes in pmdapapi.1 are >> supposed to mean? Are they mistakes? "#true -- ..." ? > > They're just comments, explaining each command. They're executable, > in case a user copy&pastes that section of the man page into a shell. Ok. Cheers, Lukas From minnus@buffalo.edu Thu Feb 26 15:55:20 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 8BA9E7F54 for ; Thu, 26 Feb 2015 15:55:20 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 791A98F8054 for ; Thu, 26 Feb 2015 13:55:17 -0800 (PST) X-ASG-Debug-ID: 1424987715-04cb6c4bd3fe7c0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve11.acsu.buffalo.edu [128.205.6.22]) by cuda.sgi.com with ESMTP id NDuMX4dIT4hH6kNv for ; Thu, 26 Feb 2015 13:55:15 -0800 (PST) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.6.22 Received: from localmailB.acsu.buffalo.edu (localmailb.acsu.buffalo.edu [128.205.5.200]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 5DFC33D2C; Thu, 26 Feb 2015 16:55:15 -0500 (EST) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 55544D989; Thu, 26 Feb 2015 16:55:15 -0500 (EST) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailB.acsu.buffalo.edu (Postfix) with ESMTP id B6432D982; Thu, 26 Feb 2015 16:55:13 -0500 (EST) Received: from smtp.buffalo.edu (smtp2.acsu.buffalo.edu [128.205.5.254]) by localmailB.acsu.buffalo.edu (Prefixe) with ESMTP id A1BD9D980; Thu, 26 Feb 2015 16:55:13 -0500 (EST) Received: from [128.205.40.46] (slash.ccr.buffalo.edu [128.205.40.46]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 916C343EE; Thu, 26 Feb 2015 16:55:13 -0500 (EST) Message-ID: <54EF9639.3000504@buffalo.edu> Date: Thu, 26 Feb 2015 16:55:05 -0500 From: Martins Innus User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: "Frank Ch. Eigler" , Lukas Berk CC: pcp@oss.sgi.com, jpwhite4@buffalo.edu, tyearke@buffalo.edu Subject: Re: PR1073 - pmlogger PID lifetime-matched logging References: <87sids32ao.fsf@redhat.com> X-ASG-Orig-Subj: Re: PR1073 - pmlogger PID lifetime-matched logging In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve11.acsu.buffalo.edu[128.205.6.22] X-Barracuda-Start-Time: 1424987715 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15894 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Lukas and Frank, On 2/26/2015 3:46 PM, Frank Ch. Eigler wrote: >> Please see commit 7347927a67849a74b67d8b25fb58c033ee79042d on >> git://sourceware.org/git/pcpfans.git lberk/dev > Thanks, nice work! Included some Buffalo folks on cc:, because the > idea for this PR [1] came from their site needs at CCR, to have > job-specific pmlogger data. It would be nice to know whether, with > this facility, a "pmlc one-shot METRIC" widget would be helpful or > redundant. Thanks for this! This will be useful to track pids on nodes running single jobs. I think it would still be useful to have a "pmlc one-shot set-of-metrics/configfile". That interleaves the results into a currently running primary logger. For now we are planning on setting up separate "once" loggers that we can fire off as needed and then merge the files afterwards. This may be good enough, but we haven't implemented it yet to be sure there are no issues. The use case is to, as exactly as possible, annotate times that may be "interesting" in some way. For instance during a single job, we may want to indicate the time and collect stats on the boundaries of preprocessing/compute/post processing that may be part of the same job, but we want to have a record at the exact moment these occur regardless of default sampling interval. We are able to run an arbitrary shell script at these times. We can't just increase the default logger interval, since we have a mix of jobs that run for less than a minute and others that run for days or weeks on the same nodes, and logging at a high enough frequency for the short jobs would generate too much data overall. We already log at 30 sec and miss some information. With these one-shot type events, we could probably decrease our default logging interval. If we didn't have shared resources, this would be much easier, but we could have 10-20 jobs per node, and running a separate resolution logger for each would create too much data. I think this solution is very useful, but we would also use the one-shot facility if it existed. Thanks. Martins From nscott@redhat.com Thu Feb 26 16:10:05 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id F00C37F58 for ; Thu, 26 Feb 2015 16:10:04 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 8CF68AC006 for ; Thu, 26 Feb 2015 14:10:01 -0800 (PST) X-ASG-Debug-ID: 1424988599-04bdf05bff11d480001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id tkgDLMZeWVyzeOB9 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 26 Feb 2015 14:09:59 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t1QM9xLm020881; Thu, 26 Feb 2015 17:09:59 -0500 Date: Thu, 26 Feb 2015 17:09:58 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: Mark Goodwin Cc: pcp Message-ID: <728632977.16726334.1424988598991.JavaMail.zimbra@redhat.com> In-Reply-To: <54EED206.3040009@redhat.com> References: <54EED206.3040009@redhat.com> Subject: Re: [pcp] patch, rfc - pcp-gui upgrade issue MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] patch, rfc - pcp-gui upgrade issue Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: patch, rfc - pcp-gui upgrade issue Thread-Index: 0RfVm2bBFNb6kxJ2XUqZ4Yna9fFpFQ== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1424988599 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15895 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi Mark, ----- Original Message ----- > On a RHEL7.1 system with 3.9.10-8.el7, trying to upgrade to 3.10.3 fails : > > $ sudo rpm -Uvh pcp-3.10.3/build/rpm/*.{x86_64,noarch}.rpm > error: Failed dependencies: > pcp-libs = 3.9.10-8.el7 is needed by (installed) > pcp-gui-3.9.10-8.el7.x86_64 (you are probably missing Qt devel packages? pcp-gui would usually exist here alongside the other freshly built rpms nowadays, FWLIW) > I suspect the pcp-gui build-requires clause should be '>=' not '>' > but wanted to check if there really is a specific version dependency? > ISTR the rpmdiff tool complains bitterly about this relationship not being "equals" (or if it is missing entirely) - not sure what exactly its rationale for mandating that is though. cheers. -- Nathan From kenj@internode.on.net Thu Feb 26 17:43:16 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 8657629DF7 for ; Thu, 26 Feb 2015 17:43:16 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 738B830405F for ; Thu, 26 Feb 2015 15:43:16 -0800 (PST) X-ASG-Debug-ID: 1424994190-04cb6c4bd01007c0001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id mUzlpAKaXgvJHvUV for ; Thu, 26 Feb 2015 15:43:11 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DPAQB8ru9UPL2b0XYNToplvnOCTgKBbQEBAQEBAQUBAQEBOIRLAQEEOEARCxgJFgQLCQMCAQIBMRQTCAEBxD+acgEBAQcCAR+LE4E9gzgWhBUBBJpPiWaBeIZQgjIjgVCBXySBGwEBAQ Received: from ppp118-209-155-189.lns20.mel8.internode.on.net (HELO [192.168.1.100]) ([118.209.155.189]) by ipmail06.adl2.internode.on.net with ESMTP; 27 Feb 2015 10:13:09 +1030 Message-ID: <54EFAFCB.3030400@internode.on.net> Date: Fri, 27 Feb 2015 10:44:11 +1100 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] pcp update: RHBZ1187588 - PM_CONTEXT_LOCAL crashes process when /etc/pcp.conf is unreadable References: <20150226214409.GH13422@redhat.com> X-ASG-Orig-Subj: Re: [pcp] pcp update: RHBZ1187588 - PM_CONTEXT_LOCAL crashes process when /etc/pcp.conf is unreadable In-Reply-To: <20150226214409.GH13422@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1424994190 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15898 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 27/02/15 08:44, Frank Ch. Eigler wrote: > ... wherein a missing pcp.conf file was deemed a "FATAL PCP > ERROR" and resulted in a process exit(). This sort of error handling > is not appropriate within a library, as the application is better > equipped to judge the severity of the problem. Ahem, I beg to differ here. If pcp.conf is missing then pretty much NOTHING works in pcpland ... this really is a fatal error. Now while I agree that libraries as a rule should not call exit() there are cases where it makes no sense to continue ... this is one of them in my humble view. And if the semantics of pmGetConfig() is to be changed, then we'd need to go find all the uses of pmGetConfig() and validate that they are indeed making an appropriate judgement ... a quick scan shows 179 uses of pmGetConfig none in the context of an if () only 37 of these are of the form ... = pmGetConfig() So I'd be willing to guess that there are 150+ cases where the code has been written with the assumption that if pcp.conf is not available there is no point continuing. Note that pcp.conf not being available is at a whole different level of severity to SOMEVAR not be defined in pcp.conf. From goodwinos@gmail.com Thu Feb 26 18:14:58 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=FREEMAIL_FROM autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id D37EF29DF7 for ; Thu, 26 Feb 2015 18:14:58 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 702EEAC008 for ; Thu, 26 Feb 2015 16:14:58 -0800 (PST) X-ASG-Debug-ID: 1424996094-04bdf05bff1206e0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id UcW6BGSStDjiD0RF (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 26 Feb 2015 16:14:54 -0800 (PST) X-Barracuda-Envelope-From: goodwinos@gmail.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1R0Eshd006728 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 26 Feb 2015 19:14:54 -0500 Received: from [10.64.51.228] (vpn1-51-228.bne.redhat.com [10.64.51.228]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1R0EqdG002182 for ; Thu, 26 Feb 2015 19:14:53 -0500 Message-ID: <54EFB6FA.3080202@gmail.com> Date: Fri, 27 Feb 2015 11:14:50 +1100 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] patch, rfc - pcp-gui upgrade issue References: <54EED206.3040009@redhat.com> <728632977.16726334.1424988598991.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] patch, rfc - pcp-gui upgrade issue In-Reply-To: <728632977.16726334.1424988598991.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1424996094 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 02/27/2015 09:09 AM, Nathan Scott wrote: > ----- Original Message ----- >> On a RHEL7.1 system with 3.9.10-8.el7, trying to upgrade to 3.10.3 fails : >> >> $ sudo rpm -Uvh pcp-3.10.3/build/rpm/*.{x86_64,noarch}.rpm >> error: Failed dependencies: >> pcp-libs = 3.9.10-8.el7 is needed by (installed) >> pcp-gui-3.9.10-8.el7.x86_64 > > (you are probably missing Qt devel packages? pcp-gui would usually exist > here alongside the other freshly built rpms nowadays, FWLIW) you are right - my build successfully didn't build pcp-gui (we need a Makepkgs --bozo option to warn about this) >> I suspect the pcp-gui build-requires clause should be '>=' not '>' >> but wanted to check if there really is a specific version dependency? >> > > ISTR the rpmdiff tool complains bitterly about this relationship not > being "equals" (or if it is missing entirely) - not sure what exactly > its rationale for mandating that is though. if it causes rpm{diff,verify,lint} pain to change it then let's just leave it how it is. Cheers -- Mark From fche@redhat.com Thu Feb 26 21:05:49 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 69C7A29DF7 for ; Thu, 26 Feb 2015 21:05:49 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 583E9304067 for ; Thu, 26 Feb 2015 19:05:49 -0800 (PST) X-ASG-Debug-ID: 1425006344-04cb6c4bd3103a00001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id MHFMu1nvEG718uZm (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 26 Feb 2015 19:05:45 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1R35fb4015978 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Thu, 26 Feb 2015 22:05:41 -0500 Received: from fche.csb (vpn-233-48.phx2.redhat.com [10.3.233.48]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1R35eeR017521; Thu, 26 Feb 2015 22:05:41 -0500 Received: by fche.csb (Postfix, from userid 2569) id 4DAFE581A9; Thu, 26 Feb 2015 22:05:36 -0500 (EST) To: Ken McDonell Cc: pcp@oss.sgi.com Subject: Re: pcp update: RHBZ1187588 - PM_CONTEXT_LOCAL crashes process when /etc/pcp.conf is unreadable References: <20150226214409.GH13422@redhat.com> <54EFAFCB.3030400@internode.on.net> X-ASG-Orig-Subj: Re: pcp update: RHBZ1187588 - PM_CONTEXT_LOCAL crashes process when /etc/pcp.conf is unreadable From: fche@redhat.com (Frank Ch. Eigler) Date: Thu, 26 Feb 2015 22:05:36 -0500 In-Reply-To: <54EFAFCB.3030400@internode.on.net> (Ken McDonell's message of "Fri, 27 Feb 2015 10:44:11 +1100") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1425006345 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, Ken - >> ... wherein a missing pcp.conf file was deemed a "FATAL PCP >> ERROR" and resulted in a process exit(). This sort of error handling >> is not appropriate within a library, as the application is better >> equipped to judge the severity of the problem. > > Ahem, I beg to differ here. > > If pcp.conf is missing then pretty much NOTHING works in pcpland > ... this really is a fatal error. But there is in general more to an application than pcpland; pcpland may not even be central to its purpose, or failures may require alternative cleanup, or recovery, or logging. libpcp cannot know and must not assume. > [...] > And if the semantics of pmGetConfig() is to be changed, then we'd need > to go find all the uses of pmGetConfig() and validate that they are > indeed making an appropriate judgement ... a quick scan shows > > 179 uses of pmGetConfig > none in the context of an if () > only 37 of these are of the form ... = pmGetConfig() > > So I'd be willing to guess that there are 150+ cases where the code > has been written with the assumption that if pcp.conf is not available > there is no point continuing. Thanks - I'll go audit them. If they can crash & burn with an empty-string return value (same as if SOMEVAR was not defined), I'll look into them closer. Are you expecting some code to be fragile with respect to misconfigured pcp.conf, such as with incorrect SOMEVAR values? > Note that pcp.conf not being available is at a whole different level > of severity to SOMEVAR not be defined in pcp.conf. Considering that pcp.conf is a list of many SOMEVAR's, which ones or how many of them build up to a whole different level of severity? - FChE From nscott@redhat.com Thu Feb 26 21:45:33 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 1166929DF7 for ; Thu, 26 Feb 2015 21:45:33 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id D76D18F8054 for ; Thu, 26 Feb 2015 19:45:29 -0800 (PST) X-ASG-Debug-ID: 1425008723-04bdf05c01127700001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id LCVOGITeqGGGbhQs (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 26 Feb 2015 19:45:24 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1R3jN3L017330 for ; Thu, 26 Feb 2015 22:45:23 -0500 Date: Thu, 26 Feb 2015 22:45:22 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: pcp@oss.sgi.com Message-ID: <1816639937.16899354.1425008722976.JavaMail.zimbra@redhat.com> In-Reply-To: <1208558303.16899016.1425008700464.JavaMail.zimbra@redhat.com> Subject: pcp updates: qa, python3 (done!), martins merge MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: qa, python3 (done!), martins merge Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: qa, python3 (done!), martins merge Thread-Index: DcxftRUg1DhAMeJfWiumiInaYjKLFA== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1425008723 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15906 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Nathan Scott (5): python3: support pmns traversal callbacks with bytes->strings pcp2graphite: working on python3 now, qa/667 updated pmlogger: use portable process check, exit with code zero build: add packaging/bugs notes to rpm spec changelog qa: tweak test 947 filtering for progname-prefixed message Martins Innus (3): Fix ganglia2pcp qa errors on 32 bit hosts Fix an errant comment in the Vagrantfile Set the right python version in the Vagrantfile for build Vagrantfile | 28 - build/rpm/fedora.spec | 3 dev/null |binary qa/667 | 66 +-- qa/667.out | 3 qa/904 | 33 + qa/904.out | 20 qa/926 | 34 - qa/926.out | 567 ---------------------------- qa/926.out.32 | 567 ++++++++++++++++++++++++++++ qa/926.out.64 | 567 ++++++++++++++++++++++++++++ qa/947 | 2 qa/947.out | 2 qa/ganglia/GNUmakefile | 2 qa/ganglia/gangliatest.32/GNUmakefile | 18 qa/ganglia/gangliatest.32/boottime.rrd |binary qa/ganglia/gangliatest.32/bytes_in.rrd |binary qa/ganglia/gangliatest.32/bytes_out.rrd |binary qa/ganglia/gangliatest.32/cpu_aidle.rrd |binary qa/ganglia/gangliatest.32/cpu_idle.rrd |binary qa/ganglia/gangliatest.32/cpu_nice.rrd |binary qa/ganglia/gangliatest.32/cpu_num.rrd |binary qa/ganglia/gangliatest.32/cpu_speed.rrd |binary qa/ganglia/gangliatest.32/cpu_system.rrd |binary qa/ganglia/gangliatest.32/cpu_user.rrd |binary qa/ganglia/gangliatest.32/cpu_wio.rrd |binary qa/ganglia/gangliatest.32/disk_free.rrd |binary qa/ganglia/gangliatest.32/disk_total.rrd |binary qa/ganglia/gangliatest.32/load_fifteen.rrd |binary qa/ganglia/gangliatest.32/load_five.rrd |binary qa/ganglia/gangliatest.32/load_one.rrd |binary qa/ganglia/gangliatest.32/mem_buffers.rrd |binary qa/ganglia/gangliatest.32/mem_cached.rrd |binary qa/ganglia/gangliatest.32/mem_free.rrd |binary qa/ganglia/gangliatest.32/mem_shared.rrd |binary qa/ganglia/gangliatest.32/mem_total.rrd |binary qa/ganglia/gangliatest.32/part_max_used.rrd |binary qa/ganglia/gangliatest.32/pkts_in.rrd |binary qa/ganglia/gangliatest.32/pkts_out.rrd |binary qa/ganglia/gangliatest.32/proc_run.rrd |binary qa/ganglia/gangliatest.32/proc_total.rrd |binary qa/ganglia/gangliatest.32/swap_free.rrd |binary qa/ganglia/gangliatest.32/swap_total.rrd |binary qa/ganglia/gangliatest.64/GNUmakefile | 18 qa/ganglia/gangliatest.64/boottime.rrd |binary qa/ganglia/gangliatest.64/bytes_in.rrd |binary qa/ganglia/gangliatest.64/bytes_out.rrd |binary qa/ganglia/gangliatest.64/cpu_aidle.rrd |binary qa/ganglia/gangliatest.64/cpu_idle.rrd |binary qa/ganglia/gangliatest.64/cpu_nice.rrd |binary qa/ganglia/gangliatest.64/cpu_num.rrd |binary qa/ganglia/gangliatest.64/cpu_speed.rrd |binary qa/ganglia/gangliatest.64/cpu_system.rrd |binary qa/ganglia/gangliatest.64/cpu_user.rrd |binary qa/ganglia/gangliatest.64/cpu_wio.rrd |binary qa/ganglia/gangliatest.64/disk_free.rrd |binary qa/ganglia/gangliatest.64/disk_total.rrd |binary qa/ganglia/gangliatest.64/load_fifteen.rrd |binary qa/ganglia/gangliatest.64/load_five.rrd |binary qa/ganglia/gangliatest.64/load_one.rrd |binary qa/ganglia/gangliatest.64/mem_buffers.rrd |binary qa/ganglia/gangliatest.64/mem_cached.rrd |binary qa/ganglia/gangliatest.64/mem_free.rrd |binary qa/ganglia/gangliatest.64/mem_shared.rrd |binary qa/ganglia/gangliatest.64/mem_total.rrd |binary qa/ganglia/gangliatest.64/part_max_used.rrd |binary qa/ganglia/gangliatest.64/pkts_in.rrd |binary qa/ganglia/gangliatest.64/pkts_out.rrd |binary qa/ganglia/gangliatest.64/proc_run.rrd |binary qa/ganglia/gangliatest.64/proc_total.rrd |binary qa/ganglia/gangliatest.64/swap_free.rrd |binary qa/ganglia/gangliatest.64/swap_total.rrd |binary qa/ganglia/gangliatest/GNUmakefile | 18 qa/group | 1 qa/src/test_pmnswalk.python | 69 +++ src/ganglia2pcp/ganglia2pcp | 6 src/pcp2graphite/pcp2graphite.py | 8 src/pmlogger/src/pmlogger.c | 32 - src/python/pcp/pmapi.py | 9 src/python/pmapi.c | 45 ++ 80 files changed, 1434 insertions(+), 684 deletions(-) From nscott@redhat.com Fri Feb 27 00:02:14 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 290DE7F50 for ; Fri, 27 Feb 2015 00:02:14 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 173288F8052 for ; Thu, 26 Feb 2015 22:02:11 -0800 (PST) X-ASG-Debug-ID: 1425016925-04cbb061101190b0001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id vJhZ2q6oRGycJO1f (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 26 Feb 2015 22:02:05 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1R624P0048042 for ; Fri, 27 Feb 2015 01:02:04 -0500 Date: Fri, 27 Feb 2015 01:02:04 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: pcp@oss.sgi.com Message-ID: <1864957772.16930065.1425016924726.JavaMail.zimbra@redhat.com> In-Reply-To: <1957042415.16929910.1425016892984.JavaMail.zimbra@redhat.com> Subject: pcp updates: qa MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: qa Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: qa Thread-Index: 6wa0byoq5Vyr9N4t75aIgFvZ4BsT7w== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1425016925 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15911 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Nathan Scott (5): qa: pmiostat devices are now sorted, update 536 output qa: add new test_pmnswalk.python into the installed set qa: handle missing zswap metrics return code in qa/999 checks qa: make 985 deterministic for all python versions qa: some /usr/lib subdirs require root read access in qa/{744,745} qa/536.out | 8 ++++---- qa/744 | 2 +- qa/745 | 2 +- qa/985 | 19 ++++++++++++++++++- qa/985.out | 30 ++++++++++++------------------ qa/999 | 4 +++- qa/src/GNUlocaldefs | 2 +- 7 files changed, 40 insertions(+), 27 deletions(-) From nscott@redhat.com Fri Feb 27 03:11:43 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id C4E5C7F50 for ; Fri, 27 Feb 2015 03:11:43 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 597A2AC004 for ; Fri, 27 Feb 2015 01:11:40 -0800 (PST) X-ASG-Debug-ID: 1425028290-04bdf05c0012d8c0001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id JVrSrwFUfKJwpx1V (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 27 Feb 2015 01:11:30 -0800 (PST) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1R9BUGq000662 for ; Fri, 27 Feb 2015 04:11:30 -0500 Date: Fri, 27 Feb 2015 04:11:30 -0500 (EST) From: Nathan Scott Reply-To: Nathan Scott To: pcp Message-ID: <909520328.17010265.1425028290363.JavaMail.zimbra@redhat.com> Subject: pcp updates: init scripts MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: init scripts Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.5.82.6] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF17 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: init scripts Thread-Index: A+8w4O/nIbAJ/cklQG7uzfeqwEI12A== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1425028290 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15917 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git dev Nathan Scott (1): rc: reinstate lost pmlogger verbosity for older init systems src/pmie/rc_pmie | 5 +++-- src/pmlogger/rc_pmlogger | 18 +++++++++++------- 2 files changed, 14 insertions(+), 9 deletions(-) From lberk@redhat.com Fri Feb 27 11:46:24 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id D2ABD7F54 for ; Fri, 27 Feb 2015 11:46:24 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id B2E39304043 for ; Fri, 27 Feb 2015 09:46:21 -0800 (PST) X-ASG-Debug-ID: 1425059179-04cbb0610d137bf0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 783KNP15yCJIsMx7 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 27 Feb 2015 09:46:20 -0800 (PST) X-Barracuda-Envelope-From: lberk@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1RHkJcV014231 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Fri, 27 Feb 2015 12:46:19 -0500 Received: from toium (vpn-60-21.rdu2.redhat.com [10.10.60.21]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1RHkIs2016920 (version=TLSv1/SSLv3 cipher=AES128-GCM-SHA256 bits=128 verify=NO) for ; Fri, 27 Feb 2015 12:46:19 -0500 From: Lukas Berk To: pcp@oss.sgi.com Subject: pcp updates pmdapapi coverity fixes Date: Fri, 27 Feb 2015 12:46:18 -0500 X-ASG-Orig-Subj: pcp updates pmdapapi coverity fixes Message-ID: <87a8zzs0wl.fsf@redhat.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1425059180 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, Please see git://sourceware.org/git/pcpfans.git fche/papi branch for fixes relating to the coverity errors found in pmdapapi. QA has been updated to match and tested locally for no regressions. qa/903 | 7 + qa/903.out | 2 qa/914.out | 10 -- qa/967 | 1 qa/967.out | 12 -- src/pmdas/papi/Install | 8 + src/pmdas/papi/help | 2 src/pmdas/papi/papi.c | 192 ++++++++++++++++++++++------------------------ src/pmdas/papi/pmdapapi.1 | 14 ++- src/pmdas/papi/pmns | 1 10 files changed, 122 insertions(+), 127 deletions(-) commit 1fac24250f888e0fbaf8ca7c73dddfec6b14d1e9 Author: Lukas Berk Date: Fri Feb 27 12:42:11 2015 -0500 Add note to pmdapapi Install script about the possible warnings Update pmdapapi to match new output (also remove lingering batch metric output from testsuite) commit bfe730fde2d2bfa9fe4552e221bf8587eca8d9f8 Author: Lukas Berk Date: Thu Feb 26 18:13:54 2015 -0500 Add sts2 assignments to auto_enable and multiplex papi_store statements assign sts values to sts2 variable in papi_store's switch statement as to preserve any error values commit d87918b71cd9d0b0a327325c80bf54105c7027e9 Author: Frank Ch. Eigler Date: Tue Feb 24 19:49:21 2015 -0500 papi pmda: improve papi auto-enable & batching, related error handling A coverity report [1] indicated problems in the way errors from a sequence of operations were being (not) propagated out properly. Defining what's proper is not easy, because when reading N counter metrics, especially in auto-enable mode, may involve partial failures. The recently added refresh-batching logic made this aspect of the situation more confusing. In the partial failure scenario, some counters give values, others lack them (never having been activated), yet others fail (an activation having been rejected). Now, per-counter fetch status is separated into those categories at papi_fetchCallBack time: success, vs. PMDA_FETCH_NOVALUES vs. PM_ERR_VALUE. This is accomplished by always batching a single refresh_counter() at the beginning of a papi_fetch(), so that by the time the individual counters are fetched, we know whether they were requested or not, and whether those requests succeeded. This also allows first-time fetches of auto-enabled counters to carry proper initial values (so no more "no values ..." initial warnings from a pmval over an auto-enabled papi counter). The papi.control.batch metric is no longer used and so eliminated. [1] http://oss.sgi.com/archives/pcp/2015-02/msg00081.html commit 8a6ef5c1474d43ad152f60c55c0e8227829c4718 Author: Lukas Berk Date: Sun Feb 22 20:12:06 2015 -0500 Update pmdapapi papi_store function to actually loop through pmid's src/pmdas/papi/papi.c - pmstore now loops through numpmid's instead of immediately breaking after the first pmid From brolley@redhat.com Fri Feb 27 14:26:35 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 78D377F3F for ; Fri, 27 Feb 2015 14:26:35 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 53403304053 for ; Fri, 27 Feb 2015 12:26:32 -0800 (PST) X-ASG-Debug-ID: 1425068787-04bdf05c0214f2c0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id FaqhhVQIUsB6pNsg (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 27 Feb 2015 12:26:28 -0800 (PST) X-Barracuda-Envelope-From: brolley@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1RKQR3q020703 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Fri, 27 Feb 2015 15:26:27 -0500 Received: from [10.10.62.92] (vpn-62-92.rdu2.redhat.com [10.10.62.92]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1RKQQFt006811 for ; Fri, 27 Feb 2015 15:26:27 -0500 Message-ID: <54F0D342.6010808@redhat.com> Date: Fri, 27 Feb 2015 15:27:46 -0500 From: Dave Brolley User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: PCP Mailing List Subject: pcp updates: fche+lberk papi pmda Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: fche+lberk papi pmda Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1425068788 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Changes committed to git://git.pcp.io/pcp.git dev Lukas Berk (3): Update pmdapapi papi_store function to actually loop through pmid's Add sts2 assignments to auto_enable and multiplex papi_store statements Add note to pmdapapi Install script about the possible warnings Frank Ch. Eigler (1): papi pmda: improve papi auto-enable & batching, related error handling qa/903 | 7 + qa/903.out | 2 qa/914.out | 10 -- qa/967 | 1 qa/967.out | 12 -- src/pmdas/papi/Install | 8 + src/pmdas/papi/help | 2 src/pmdas/papi/papi.c | 192 ++++++++++++++++++++++------------------------ src/pmdas/papi/pmdapapi.1 | 14 ++- src/pmdas/papi/pmns | 1 10 files changed, 122 insertions(+), 127 deletions(-) From brolley@redhat.com Fri Feb 27 14:29:09 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 5BE287F54 for ; Fri, 27 Feb 2015 14:29:09 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 05BF6AC001 for ; Fri, 27 Feb 2015 12:29:08 -0800 (PST) X-ASG-Debug-ID: 1425068948-04bdf05c0014f3d0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id nz7MUwVYrzqUG0D6 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 27 Feb 2015 12:29:08 -0800 (PST) X-Barracuda-Envelope-From: brolley@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1RKT7do025060 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Fri, 27 Feb 2015 15:29:08 -0500 Received: from [10.10.62.92] (vpn-62-92.rdu2.redhat.com [10.10.62.92]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1RKT7t5007982 for ; Fri, 27 Feb 2015 15:29:07 -0500 Message-ID: <54F0D3E2.9020207@redhat.com> Date: Fri, 27 Feb 2015 15:30:26 -0500 From: Dave Brolley User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] PCP Release 3.10.3 Scheduled for Monday March 2, 2015 References: <54EF449B.6060506@redhat.com> X-ASG-Orig-Subj: Re: [pcp] PCP Release 3.10.3 Scheduled for Monday March 2, 2015 In-Reply-To: <54EF449B.6060506@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1425068948 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 I've just pushed what I believe to be the final changes to be included for this release. If you have changes pending that have not been pushed, please let me know immediately so that they can be considered for inclusion. Thanks, Dave On 02/26/2015 11:06 AM, Dave Brolley wrote: > Hi all, > > This is just a reminder that PCP release 3.10.3 is scheduled for this > coming Monday March 2. Since I will be doing the release, that means > Monday here in North America. As a result we will be selective in > deciding which pending patches are to be included starting about now. > If you have something pending that you strongly feel should be in the > release, then please let me and Nathan know. > > If you have time to run qa on the platforms available to you, please > do so and please report/fix any problems or regressions. > > I hope to freeze the code at the end of the day on Friday (North > America). > > Thanks, > Dave > > _______________________________________________ > pcp mailing list > pcp@oss.sgi.com > http://oss.sgi.com/mailman/listinfo/pcp From kenj@internode.on.net Fri Feb 27 14:30:52 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id E35317F54 for ; Fri, 27 Feb 2015 14:30:52 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id B38A6304053 for ; Fri, 27 Feb 2015 12:30:52 -0800 (PST) X-ASG-Debug-ID: 1425069046-04bdf05c0214f480001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id vOJNDwCF4vsvyst6 for ; Fri, 27 Feb 2015 12:30:46 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2AiCwDq0vBUPGYC0XZbgwKDZ4N9wVQEgSlOAQEBAQEBBQEBAQE4O4QWCAIeEhwwBQZiIAoVAQQeBYgergipcJQyBY92W5w+gWgBCgEBAYIvKoJ0AQEB Received: from ppp118-209-2-102.lns20.mel4.internode.on.net (HELO bozohorize) ([118.209.2.102]) by ipmail04.adl6.internode.on.net with ESMTP; 28 Feb 2015 07:00:45 +1030 From: "Ken McDonell" To: "'PCP'" Subject: problem with containers support and qa/977 Date: Sat, 28 Feb 2015 07:30:43 +1100 X-ASG-Orig-Subj: problem with containers support and qa/977 Message-ID: <00a401d052cc$4349f230$c9ddd690$@internode.on.net> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdBSzBNZLVyKh4zhTHqYfm9jCAop4Q== Content-Language: en-au X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1425069046 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Barracuda-BRTS-Status: 1 X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15940 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== This is on opensuse13.1 ... kenj@vm24:~/src/pcp/qa$ pminfo -f pmcd.feature.containers pmcd.feature.containers value 1 kenj@vm24:~/src/pcp/qa$ src/grind_ctx -h local:?container=fe4564ddf901 Iteration 4 pmNewContext(host=local:?container=fe4564ddf901): Operation not supported Because pmcd.feature.contatiners is 1, qa/977 is run but immediately trips over the grind_ctx error. From fche@redhat.com Fri Feb 27 15:09:25 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id C59AB7F3F for ; Fri, 27 Feb 2015 15:09:25 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 6065EAC004 for ; Fri, 27 Feb 2015 13:09:22 -0800 (PST) X-ASG-Debug-ID: 1425071361-04bdf05c01150550001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id AvZTNx3qh69daCNs (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 27 Feb 2015 13:09:21 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1RL9L78007376 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Fri, 27 Feb 2015 16:09:21 -0500 Received: from fche.csb (vpn-233-48.phx2.redhat.com [10.3.233.48]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1RL9KoP021454; Fri, 27 Feb 2015 16:09:21 -0500 Received: by fche.csb (Postfix, from userid 2569) id CAC53581BA; Fri, 27 Feb 2015 16:09:15 -0500 (EST) To: Dave Brolley Cc: pcp@oss.sgi.com Subject: Re: PCP Release 3.10.3 Scheduled for Monday March 2, 2015 References: <54EF449B.6060506@redhat.com> <54F0D3E2.9020207@redhat.com> X-ASG-Orig-Subj: Re: PCP Release 3.10.3 Scheduled for Monday March 2, 2015 From: fche@redhat.com (Frank Ch. Eigler) Date: Fri, 27 Feb 2015 16:09:15 -0500 In-Reply-To: <54F0D3E2.9020207@redhat.com> (Dave Brolley's message of "Fri, 27 Feb 2015 15:30:26 -0500") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1425071361 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Dave Brolley writes: > I've just pushed what I believe to be the final changes to be included > for this release. [...] Last bits for main pcp: pcpfans.git fche/papi-pkgconfig. I also have some bits coming for the webjs repo, for whoever is in charge of that. commit 67bec4f21ddcc26a3604f57f927863b316fa33ba Author: Frank Ch. Eigler Date: Fri Feb 27 16:02:21 2015 -0500 pcp configury: let --with-papi=NNNN accept a pkgconfig module too With this change, it is possible to pick cflags/ldadd bits for any version of papi that has .pc pkgconfig files, e.g.: .../configure --with-papi=papi-5 Kindly tested by wcohen on in-progress rhel-6.7 work. From fche@redhat.com Fri Feb 27 15:26:38 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 05BE67F54 for ; Fri, 27 Feb 2015 15:26:38 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id C9C268F8064 for ; Fri, 27 Feb 2015 13:26:34 -0800 (PST) X-ASG-Debug-ID: 1425072393-04bdf05bff150df0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id m1OkmIyFThBIr67k (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 27 Feb 2015 13:26:33 -0800 (PST) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1RLQX68012925 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Fri, 27 Feb 2015 16:26:33 -0500 Received: from fche.csb (vpn-233-48.phx2.redhat.com [10.3.233.48]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1RLQWkn007972; Fri, 27 Feb 2015 16:26:33 -0500 Received: by fche.csb (Postfix, from userid 2569) id D3AC1581BA; Fri, 27 Feb 2015 16:26:27 -0500 (EST) To: Dave Brolley Cc: pcp@oss.sgi.com Subject: Re: PCP Release 3.10.3 Scheduled for Monday March 2, 2015 References: <54EF449B.6060506@redhat.com> <54F0D3E2.9020207@redhat.com> X-ASG-Orig-Subj: Re: PCP Release 3.10.3 Scheduled for Monday March 2, 2015 From: fche@redhat.com (Frank Ch. Eigler) Date: Fri, 27 Feb 2015 16:26:27 -0500 In-Reply-To: <54F0D3E2.9020207@redhat.com> (Dave Brolley's message of "Fri, 27 Feb 2015 15:30:26 -0500") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1425072393 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Dave Brolley writes: > [...] If you have changes pending that have not been pushed, please > let me know immediately so that they can be considered for > inclusion. [...] And the proposed commits for the webjs repository are also in pcpfans.git, branch fche/webjs. commit 5e473bcddf7ce87f598c7bcbd584c1d28d92d0f5 Author: Frank Ch. Eigler Date: Fri Feb 27 16:22:14 2015 -0500 grafana 1.9.1 default-dashboards & index reference Now pmwebd users have a choice of old & new. commit 5c4972c951b58674684d7a4c53b55111b093ba11 Author: Frank Ch. Eigler Date: Fri Feb 27 14:03:50 2015 -0500 pcp-graphite-grafana defaults commit 9ae306134e3244855a61cbf7d8af7b878141fc8d Author: Frank Ch. Eigler Date: Fri Feb 27 13:28:04 2015 -0500 import grafana 1.9.1 commit 68d76fee943d57e25295d6f84197553a44bc675f Author: Frank Ch. Eigler Date: Fri Feb 27 13:26:28 2015 -0500 grafana dashboards: add a memory available/used row Also, enforce UTC timezone throghout, json_reformat, dos2unix the lot. From brolley@redhat.com Fri Feb 27 16:35:48 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 2484E7F54 for ; Fri, 27 Feb 2015 16:35:48 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 02CEA304048 for ; Fri, 27 Feb 2015 14:35:44 -0800 (PST) X-ASG-Debug-ID: 1425076540-04bdf05c02152920001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id Z6YJbmW4mXprx1D5 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 27 Feb 2015 14:35:40 -0800 (PST) X-Barracuda-Envelope-From: brolley@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1RMZc5J010506 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Fri, 27 Feb 2015 17:35:39 -0500 Received: from [10.10.62.92] (vpn-62-92.rdu2.redhat.com [10.10.62.92]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1RMZcix018146 for ; Fri, 27 Feb 2015 17:35:38 -0500 Message-ID: <54F0F189.9090500@redhat.com> Date: Fri, 27 Feb 2015 17:36:57 -0500 From: Dave Brolley User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: PCP Mailing List Subject: pcp updates: fche+wcohen: papi pkgconfig Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: fche+wcohen: papi pkgconfig Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1425076540 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Changes committed to git://git.pcp.io/pcp.git dev Frank Ch. Eigler (1): pcp configury: let --with-papi=NNNN accept a pkgconfig module too configure | 115 ++++++++++++++++++++++++++++++++++++++++++++++++++++++----- configure.ac | 19 +++++---- 2 files changed, 117 insertions(+), 17 deletions(-) From mgoodwin@redhat.com Fri Feb 27 22:43:38 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 8C7277F54 for ; Fri, 27 Feb 2015 22:43:38 -0600 (CST) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 5E330304053 for ; Fri, 27 Feb 2015 20:43:35 -0800 (PST) X-ASG-Debug-ID: 1425098610-04bdf05bff15c7d0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id UN7EPwc8vpau2Gh9 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 27 Feb 2015 20:43:31 -0800 (PST) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t1S4hOu0006473 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Fri, 27 Feb 2015 23:43:25 -0500 Received: from [10.64.51.219] (vpn1-51-219.bne.redhat.com [10.64.51.219]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t1S4hMKx018743; Fri, 27 Feb 2015 23:43:23 -0500 Message-ID: <54F14768.10005@redhat.com> Date: Sat, 28 Feb 2015 15:43:20 +1100 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp@oss.sgi.com CC: Ken McDonell Subject: Re: [pcp] problem with containers support and qa/977 References: <00a401d052cc$4349f230$c9ddd690$@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] problem with containers support and qa/977 In-Reply-To: <00a401d052cc$4349f230$c9ddd690$@internode.on.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1425098610 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 02/28/2015 07:30 AM, Ken McDonell wrote: > This is on opensuse13.1 ... > > kenj@vm24:~/src/pcp/qa$ pminfo -f pmcd.feature.containers > > pmcd.feature.containers > value 1 > kenj@vm24:~/src/pcp/qa$ src/grind_ctx -h local:?container=fe4564ddf901 > Iteration 4 > pmNewContext(host=local:?container=fe4564ddf901): Operation not supported > > Because pmcd.feature.contatiners is 1, qa/977 is run but immediately trips > over the grind_ctx error. I'm seeing this on FC19 but not on RHEL7.1. Both were built from top-of-tree source using Makepkgs. Here's RHEL7.1, which succeeds : [root@ocean ~]# pminfo -DCONTEXT --container 6ea85ce8e3c4 -f hinv.ncpu __pmSetSocketIPC: fd=3 IPC table fd(PDU version): __pmDecodeXtendError: got error PDU (code=0, datum=1459618050, version=2) __pmSetVersionIPC: fd=3 version=2 IPC table fd(PDU version): 3(2,1) __pmSendCreds: #0 = 1020040 __pmSetDataIPC: fd=3 data=0x7fff0b4df7c0(sz=32) IPC table fd(PDU version): 3(2,1) connect.c:__pmConnectHandshake container="6ea85ce8e3c4" [12] __pmConnectPMCD(/var/run/pcp/pmcd.socket): pmcd connection path=/var/run/pcp/pmcd.socket fd=3 PDU version=2 IPC table fd(PDU version): 3(2,1) pmNewContext(1, local:) -> 0 Dump Contexts: current context = 0 Context[0] host /var/run/pcp/pmcd.socket: pmcd=CONNECTED profile=NOT_SENT fd=3 refcnt=1 flags=4000 origin=0.000000 delta=0 Dump Instance Profile state=INCLUDE, 0 profiles pmWhichContext() -> 0, cur=0 pmWhichContext() -> 0, cur=0 pmWhichContext() -> 0, cur=0 pmWhichContext() -> 0, cur=0 pmWhichContext() -> 0, cur=0 pmWhichContext() -> 0, cur=0 hinv.ncpu value 2 And here's FC19, which fails : [mgoodwin@fletch pcp]$ pminfo -DCONTEXT --container cee2a80b5f61 -f hinv.ncpu __pmSetSocketIPC: fd=3 IPC table fd(PDU version): __pmDecodeXtendError: got error PDU (code=0, datum=1073742082, version=2) __pmSetVersionIPC: fd=3 version=2 IPC table fd(PDU version): 3(2,1) __pmSendCreds: #0 = 1020040 __pmSetSocketIPC: fd=3 IPC table fd(PDU version): __pmDecodeXtendError: got error PDU (code=0, datum=1073742082, version=2) __pmSetVersionIPC: fd=3 version=2 IPC table fd(PDU version): 3(2,1) __pmSendCreds: #0 = 1020040 __pmConnectPMCD(/var/run/pcp/pmcd.socket): pmcd connection port=44321 failed: Operation not supported pmNewContext(1, local:) -> -95, curcontext=-1 pminfo: Cannot connect to PMCD on host "local:": Operation not supported [mgoodwin@fletch pcp]$ pminfo -f pmcd.feature pmcd.feature.secure value 0 pmcd.feature.compress value 0 pmcd.feature.ipv6 value 1 pmcd.feature.authentication value 0 pmcd.feature.creds_required value 0 pmcd.feature.unix_domain_sockets value 1 pmcd.feature.service_discovery value 1 pmcd.feature.containers value 1 Both systems have just one container running with the given Id. The only difference seems to be that pmcd.feature.authentication is 0 in the failing case and 1 in the succeeding case. Maybe there's yet another missing build dep that's been silently configured away? I'll try and debug it some more later this week-end. Regards -- Mark From kenj@internode.on.net Sat Feb 28 01:14:22 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 875D77F54 for ; Sat, 28 Feb 2015 01:14:22 -0600 (CST) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 617B98F8068 for ; Fri, 27 Feb 2015 23:14:19 -0800 (PST) X-ASG-Debug-ID: 1425107653-04cbb0610d14a470001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id KzvEiKGu3MMnR2Sk for ; Fri, 27 Feb 2015 23:14:14 -0800 (PST) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 Received: from ppp121-44-14-54.lns20.syd4.internode.on.net (HELO bozohorize) ([121.44.14.54]) by ipmail06.adl2.internode.on.net with ESMTP; 28 Feb 2015 17:43:41 +1030 From: "Ken McDonell" To: "'PCP'" Subject: QA State of the Nation Date: Sat, 28 Feb 2015 18:13:38 +1100 X-ASG-Orig-Subj: QA State of the Nation Message-ID: <005e01d05326$13e48370$3bad8a50$@internode.on.net> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_NextPart_000_005F_01D05382.47613070" X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdBTJbaEdsEW/Lt4TZWgwS7N1UI/OA== Content-Language: en-au X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1425107653 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=HTML_MESSAGE, THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.15962 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.00 HTML_MESSAGE BODY: HTML included in message This is a multipart message in MIME format. ------=_NextPart_000_005F_01D05382.47613070 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Here we are as of today ... 787 is expected pending interp.c rework that is not in the forthcoming release . beyond that it is the way it is. kenj@bozo:~/src/pcp$ pcp-qa-summary -fr ==== QA Summary ==== Date Run Pass Fail Nrun Host 2015-02-24 723 720 3 67|bozo PCP 3.10.3 x86_64 Ubuntu 14.04 2015-02-27 712 708 4 79|bozo-laptop PCP 3.10.3 i686 LinuxMint 15 2015-02-24 717 714 3 73|bozo-vm PCP 3.10.3 x86_64 Debian 7.6 Daily runs, but no QA |fuji PCP pmcd.ver i386 Darwin 10.8.0 2015-02-27 639 632 7 106|grundy PCP 3.10.3 ia64 SUSE SLES11 SP1 2015-02-27 715 710 5 75|vm00 PCP 3.10.3 x86_64 Ubuntu 12.04 2015-02-24 722 720 2 68|vm01 PCP 3.10.3 i686 Ubuntu 12.10 2015-02-27 715 707 8 77|vm02 PCP 3.10.3 i686 openSUSE 12.1 2015-02-27 736 729 7 56|vm03 PCP 3.10.3 x86_64 Fedora 18 2015-02-28 661 657 4 131|vm04 PCP 3.10.3 i586 CentOS 5.11 2015-02-28 647 637 10 145|vm05 PCP 3.10.3 i486 Gentoo 2.0.3 2015-02-28 60 60 0 4|vm06 PCP 3.10.3 amd64 FreeBSD 8.2-RELEASE-p9 2015-02-28 715 711 4 77|vm07 PCP 3.10.3 x86_64 Debian 6.0.10 2015-02-28 733 729 4 59|vm08 PCP 3.10.3 x86_64 CentOS Linux7.0.1406 Daily runs, but no QA |vm09 PCP 3.10.2 i386 NetBSD 6.1.5 2015-02-27 60 60 0 4|vm10 PCP 3.10.3 i386 FreeBSD 8.2-RELEASE-p9 2015-02-25 716 709 7 74|vm11 PCP 3.10.3 i686 Debian 6.0.9 2015-02-25 726 722 4 64|vm12 PCP 3.10.3 i686 Fedora 17 2015-02-26 732 725 7 58|vm14 PCP 3.10.3 x86_64 CentOS6.5 No daily runs |vm15 PCP 3.9.1 x86_64 Slackware 13.37.0 2015-02-26 714 712 2 76|vm18 PCP 3.10.3 x86_64 LinuxMint 12 2015-02-26 711 708 3 79|vm19 PCP 3.10.3 x86_64 openSUSE 12.2 2015-02-26 717 715 2 73|vm20 PCP 3.10.3 x86_64 Ubuntu 13.04 2015-02-26 718 716 2 72|vm21 PCP 3.10.3 i686 Debian 7.4 2015-02-26 729 725 4 61|vm22 PCP 3.10.3 x86_64 Fedora 19 2015-02-27 728 718 10 62|vm23 PCP 3.10.3 i686 Fedora 20 2015-02-27 682 676 6 108|vm24 PCP 3.10.3 i686 openSUSE 13.1 2015-02-27 654 649 5 138|vm25 PCP 3.10.3 x86_64 CentOS 5.5 2015-02-27 730 723 7 62|vm26 PCP 3.10.3 x86_64 Fedora 21 Summary: 17112 run, 120 failed (0.70%) ==== QA Failure (X) Map ==== Host bo bl bv gr 00 01 02 03 04 05 07 08 11 12 14 18 19 20 21 22 23 24 25 26 Test %bad Test QA groups 787 92% X X X X X X X X X X X X X X X X X X X X X X X X 787 archive pmie pmlogrewrite pmdumplog pmval 767 54% X X X X X X X X X X X X X X 767 pmda.linux containers 904 31% X X X X X X X X 904 python 832 23% X X X X X X 832 pmda.sample pmstore secure 536 19% X X X X X 536 pmimport 667 19% X X X X X 667 python 720 19% X X X X X 720 libpcp valgrind 666 15% X X X X 666 pmmgr 555 12% X X X 555 pmie 040 8% X X 040 pmlogger mem_leak 145 8% X X 145 pmns 359 8% X X 359 pmcd pminfo 578 8% X X 578 pmcd pmda.install pmval 721 8% X X 721 dbpmda 753 8% X X 753 derive pmie 837 8% X X 837 pmda.sample containers 926 8% X X 926 other 977 8% X X 977 libpcp valgrind containers Host bo bl bv gr 00 01 02 03 04 05 07 08 11 12 14 18 19 20 21 22 23 24 25 26 115 4% X 115 pmie 152 4% X 152 pmda.pmcd pmval 178 4% X 178 logutil pmval pmlogextract pmdumplog 241 4% X 241 pmda.mmv pmval perl 279 4% X 279 pmcd 282 4% X 282 pmcd pmprobe logutil pmlc 322 4% X 322 pmlc pmlogger 366 4% X 366 pmlogconf 393 4% X 393 archive mem_leak valgrind 394 4% X 394 archive mem_leak valgrind flakey 395 4% X 395 archive mem_leak valgrind 398 4% X 398 pmcd 514 4% X 514 pmie 518 4% X 518 other flakey pmie 519 4% X 519 pmie 583 4% X 583 pmie 647 4% X 647 pmda.mmv 652 4% X 652 pmda.systemd event flakey 660 4% X 660 pmwebapi 730 4% X 730 pmda.proc cgroups 769 4% X 769 other Host bo bl bv gr 00 01 02 03 04 05 07 08 11 12 14 18 19 20 21 22 23 24 25 26 813 4% X 813 pmda.papi 823 4% X 823 pmda.sample pmstore secure 947 4% X 947 pmlogger 967 4% X 967 pmda.papi 1044 4% X 1044 pmie pmieconf 1045 4% X 1045 pmie pmieconf 1046 4% X 1046 pmie pmieconf Host bo bl bv gr 00 01 02 03 04 05 07 08 11 12 14 18 19 20 21 22 23 24 25 26 ------=_NextPart_000_005F_01D05382.47613070 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Here = we are as of today ...

 

787 is expected pending interp.c = rework that is not in the forthcoming release … beyond that it is = the way it is.

 

kenj@bozo:~/src/pcp$ pcp-qa-summary -fr

=3D=3D=3D=3D QA Summary =3D=3D=3D=3D

 

Date        Run Pass Fail Nrun = Host

2015-02-24  723  = 720    3   67|bozo PCP 3.10.3 x86_64 Ubuntu = 14.04

2015-02-27  712  = 708    4   79|bozo-laptop PCP 3.10.3 i686 = LinuxMint 15

2015-02-24  717  = 714    3   73|bozo-vm PCP 3.10.3 x86_64 Debian = 7.6

Daily runs, but no = QA         |fuji PCP pmcd.ver = i386 Darwin 10.8.0

2015-02-27  639  = 632    7  106|grundy PCP 3.10.3 ia64 SUSE SLES11 = SP1

2015-02-27  715  = 710    5   75|vm00 PCP 3.10.3 x86_64 Ubuntu = 12.04

2015-02-24  722  = 720    2   68|vm01 PCP 3.10.3 i686 Ubuntu = 12.10

2015-02-27  715  = 707    8   77|vm02 PCP 3.10.3 i686 openSUSE = 12.1

2015-02-27  736  = 729    7   56|vm03 PCP 3.10.3 x86_64 Fedora = 18

2015-02-28  661  = 657    4  131|vm04 PCP 3.10.3 i586 CentOS = 5.11

2015-02-28  647  = 637   10  145|vm05 PCP 3.10.3 i486 Gentoo = 2.0.3

2015-02-28   = 60   60    0    4|vm06 PCP = 3.10.3 amd64 FreeBSD 8.2-RELEASE-p9

2015-02-28  715  711    4   = 77|vm07 PCP 3.10.3 x86_64 Debian 6.0.10

2015-02-28  733  729    4   = 59|vm08 PCP 3.10.3 x86_64 CentOS Linux7.0.1406

Daily = runs, but no QA         |vm09 = PCP 3.10.2 i386 NetBSD 6.1.5

2015-02-27   60   60    = 0    4|vm10 PCP 3.10.3 i386 FreeBSD = 8.2-RELEASE-p9

2015-02-25  716  = 709    7   74|vm11 PCP 3.10.3 i686 Debian = 6.0.9

2015-02-25  726  = 722    4   64|vm12 PCP 3.10.3 i686 Fedora = 17

2015-02-26  732  = 725    7   58|vm14 PCP 3.10.3 x86_64 = CentOS6.5

No daily = runs           &nb= sp;     |vm15 PCP 3.9.1 x86_64 Slackware = 13.37.0

2015-02-26  714  = 712    2   76|vm18 PCP 3.10.3 x86_64 LinuxMint = 12

2015-02-26  711  = 708    3   79|vm19 PCP 3.10.3 x86_64 openSUSE = 12.2

2015-02-26  717  = 715    2   73|vm20 PCP 3.10.3 x86_64 Ubuntu = 13.04

2015-02-26  718  = 716    2   72|vm21 PCP 3.10.3 i686 Debian = 7.4

2015-02-26  729  = 725    4   61|vm22 PCP 3.10.3 x86_64 Fedora = 19

2015-02-27  728  = 718   10   62|vm23 PCP 3.10.3 i686 Fedora = 20

2015-02-27  682  = 676    6  108|vm24 PCP 3.10.3 i686 openSUSE = 13.1

2015-02-27  654  = 649    5  138|vm25 PCP 3.10.3 x86_64 CentOS = 5.5

2015-02-27  730  = 723    7   62|vm26 PCP 3.10.3 x86_64 Fedora = 21

Summary: 17112 run, 120 failed = (0.70%)

 

=3D=3D=3D=3D QA Failure (X) Map = =3D=3D=3D=3D

 

Host      bo bl bv gr 00 01 02 03 04 05 = 07 08 11 12 14 18 19 20 21 22 23 24 25 26

Test = %bad           &nb= sp;           &nbs= p;            = ;            =             &= nbsp;            = Test QA groups

787  92%  X  = X  X  X  X  X  X  X  X  X  = X  X  X  X  X  X  X  X  X  = X  X  X  X  X  787 archive pmie pmlogrewrite = pmdumplog pmval

767  = 54%        = X           X  = X           X  = X  X  X  X  X     X  = X  X  X     X  767 pmda.linux = containers

904  31% =             &= nbsp;      X  X  X  X  = X  = X            =             &= nbsp;       X  X  904 = python

832  = 23%           &nbs= p;           X  = X        = X        = X            =            X  = X  832 pmda.sample pmstore secure

= 536  19%     X     X  = X            =             &= nbsp;         =           X  = X           536 = pmimport

667  = 19%           &nbs= p;        X  = X        = X            =             &= nbsp;    X  = X        667 = python

720  = 19%           &nbs= p;        = X            =      X     = X     = X            =      X     720 libpcp = valgrind

666  = 15%            =   X          =        = X            =         = X        = X           666 = pmmgr

555  = 12%     = X            =      = X            =      = X            =             &= nbsp;       555 = pmie

040   = 8%            = ;  X        = X            =             &= nbsp;           &n= bsp;           &nb= sp; 040 pmlogger mem_leak

= 145   = 8%           = X            =      = X            =             &= nbsp;           &n= bsp;       145 = pmns

359   = 8%            = ;        = X            =             &= nbsp;    =             &= nbsp;  X        359 pmcd = pminfo

578   = 8%     X     = X            =             &= nbsp;           &n= bsp;           &nb= sp;           &nbs= p; 578 pmcd pmda.install pmval

= 721   = 8%            = ;            =      = X            =             &= nbsp;           &n= bsp; X     721 dbpmda

= 753   8%  =          X   =             &= nbsp; = X            =             &= nbsp;           &n= bsp;       753 derive = pmie

837   = 8%            = ;        = X            =             &= nbsp;           &n= bsp;       = X        837 pmda.sample = containers

926   = 8%            = ;     = X            =            = X       =             &= nbsp;           &n= bsp;926 other

977   = 8%            = ;        = X            =             &= nbsp;           &n= bsp;       = X        977 libpcp valgrind = containers

Host      bo bl bv gr 00 01 02 03 04 05 = 07 08 11 12 14 18 19 20 21 22 23 24 25 26

= 115   = 4%            = ;    =             &= nbsp;X           &= nbsp;           &n= bsp;           &nb= sp;        115 = pmie

152   = 4%            = ;            =      = X            =             &= nbsp;           &n= bsp;       152 pmda.pmcd = pmval

178   = 4%            = ;            =      = X            =             &= nbsp;           &n= bsp;       178 logutil pmval pmlogextract = pmdumplog

241   = 4%            = ;            =             &= nbsp; = X            =             &= nbsp;          241 pmda.mmv = pmval perl

279   = 4%            = ;            =             &= nbsp;           &n= bsp;           &nb= sp;          X  279 = pmcd

282   = 4%          =             &= nbsp;           &n= bsp;           &nb= sp;           &nbs= p;            = ;X  282 pmcd pmprobe logutil pmlc

= 322   4%  = X            =             &= nbsp;           &n= bsp;           &nb= sp;           &nbs= p;          322 pmlc = pmlogger

366   = 4%            = ;  = X            =             &= nbsp;            =             &= nbsp;         366 = pmlogconf

393   = 4%            = ;            =             &= nbsp; = X            =             &= nbsp;          393 archive = mem_leak valgrind

394   = 4%            = ;            =             &= nbsp; = X            =             &= nbsp;          394 archive = mem_leak valgrind flakey

= 395   = 4%            = ;            =             &= nbsp; = X            =             &= nbsp;          395 archive = mem_leak valgrind

398   = 4%            = ;            =             &= nbsp;           &n= bsp;           &nb= sp;          X  398 = pmcd

514   = 4%            = ;            =      =             &= nbsp;           &n= bsp;        X   &n= bsp;       514 = pmie

518   = 4%            = ;            =   = X            =             &= nbsp;           &n= bsp;          518 other = flakey pmie

519   = 4%            = ;            =             &= nbsp;           &n= bsp;           &nb= sp; X           519 = pmie

583   4%  = X            =             &= nbsp;           &n= bsp;           &nb= sp;           &nbs= p;          583 = pmie

647   = 4%           = X            =             &= nbsp;           &n= bsp;           &nb= sp;           &nbs= p; 647 pmda.mmv

652   = 4%            = ;            =             &= nbsp;           &n= bsp;          = X    =           652 = pmda.systemd event flakey

= 660   4%        = X            =             &= nbsp;           &n= bsp;           &nb= sp;           &nbs= p;    660 pmwebapi

= 730   = 4%           = X            =             &= nbsp;           &n= bsp;           &nb= sp;           &nbs= p; 730 pmda.proc cgroups

= 769   = 4%            = ;            =      = X            =             &= nbsp;           &n= bsp;       769 = other

Host      bo bl bv gr 00 01 02 03 04 05 = 07 08 11 12 14 18 19 20 21 22 23 24 25 26

= 813   = 4%            = ;            =             &= nbsp;       = X            =             &= nbsp;    813 pmda.papi

= 823   = 4%            = ;            =             &= nbsp;       = X            =             &= nbsp;    823 pmda.sample pmstore = secure

947   = 4%            = ;            =      = X            =             &= nbsp;           &n= bsp;       947 = pmlogger

967   = 4%            = ;         =             &= nbsp;          X &= nbsp;           &n= bsp;           &nb= sp;   967 pmda.papi

1044   = 4%            = ;            =             &= nbsp;           &n= bsp;           &nb= sp; X          1044 pmie = pmieconf

1045   = 4%            = ;            =             &= nbsp;           &n= bsp;           &nb= sp; X          1045 pmie = pmieconf

1046   = 4%            = ;            =             &= nbsp;           &n= bsp;           &nb= sp; X          1046 pmie = pmieconf

Host      bo bl bv gr 00 01 02 03 04 05 = 07 08 11 12 14 18 19 20 21 22 23 24 25 = 26

------=_NextPart_000_005F_01D05382.47613070--