From rdelval1@binghamton.edu Wed Apr 1 16:30:22 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id C3D9A7F62 for ; Wed, 1 Apr 2015 16:30:22 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 67697AC002 for ; Wed, 1 Apr 2015 14:30:19 -0700 (PDT) X-ASG-Debug-ID: 1427923816-04bdf036252dc9b0001-S8gJnT Received: from mail-ob0-f170.google.com (mail-ob0-f170.google.com [209.85.214.170]) by cuda.sgi.com with ESMTP id LyZrRHBp5IR8hEKc (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Wed, 01 Apr 2015 14:30:17 -0700 (PDT) X-Barracuda-Envelope-From: rdelval1@binghamton.edu X-Barracuda-Apparent-Source-IP: 209.85.214.170 Received: by obbfy7 with SMTP id fy7so15493249obb.2 for ; Wed, 01 Apr 2015 14:30:16 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:from:date:message-id:subject:to :content-type; bh=Wj2mXqwVi0PAMFxmENJ0aPKShIPOPUUgZ5W6OCNc/pQ=; b=NW5DLioRIQxevf/P7m6xwlXqfAAoyM7zC2BvBxHsZQSI8514QU7u0D9XVmlUOxZpFi BJAAuQY+nDZcGGNHle+k/py1fr0dYyKO7Cfb2hcE8VJciRg03qm2s5s3WuIJs9fc+V2z W+Kyi0++60dI01EoCXG6QILXix+nML9FdbSr/4R5VvE70+KAXPskCUqtQE97wasBgAbX J2VfDjQQtjg23K8hIjoM3JzV0AagSmjTwVf0zCDatsB8UeW06iK3n3g8w+pMrhyrz0Aw NyepwBumnJskGHTb428eA1qSmX5rwPFZ4Lsa8KhQksl5r8f1mEvqUL21BSLdDy7sfXaY R3Tw== X-Gm-Message-State: ALoCoQnm2JyPy4K3ONnWvQQui8fHH+HHlBSxtzzKpQX6ZV+pqTQQQLzNG6pdlyhhw3vDU8YMkD9K X-Received: by 10.182.33.98 with SMTP id q2mr43178032obi.79.1427923816617; Wed, 01 Apr 2015 14:30:16 -0700 (PDT) MIME-Version: 1.0 Received: by 10.202.111.1 with HTTP; Wed, 1 Apr 2015 14:29:56 -0700 (PDT) From: Renan DelValle Date: Wed, 1 Apr 2015 17:29:56 -0400 Message-ID: Subject: Installing perfevents on Ubuntu 14.04 To: pcp@oss.sgi.com X-ASG-Orig-Subj: Installing perfevents on Ubuntu 14.04 Content-Type: text/plain; charset=UTF-8 X-Barracuda-Connect: mail-ob0-f170.google.com[209.85.214.170] X-Barracuda-Start-Time: 1427923817 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17454 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi, I've installed PCP successfully through the apt package manager, however, there is no folder "perfevent" inside of /var/lib/pcp/pdmas I've tried downloading, compiling, and installing 3.10.3 from github, but the perfevent folder is still not included in the $PCP_PMDAS_DIR . The perfevent folder is indeed inside of the src and performing an install from there installs perfevent but upon trying to fetch information from the perfevent, all fields return a " No PMCD agent for domain of request" leading me to believe I must do something else in order to get this working. Any help would be greatly appreciated. -Renan From chandana@desilva.id.au Thu Apr 2 01:44:47 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,WEIRD_PORT autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 4039E7F66 for ; Thu, 2 Apr 2015 01:44:47 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id B209EAC003 for ; Wed, 1 Apr 2015 23:44:43 -0700 (PDT) X-ASG-Debug-ID: 1427957075-04cb6c3fde287550001-S8gJnT Received: from relay.mailchannels.net (aso-006-i431.relay.mailchannels.net [23.91.64.112]) by cuda.sgi.com with ESMTP id GtnAsyTMz7q2LHEk for ; Wed, 01 Apr 2015 23:44:36 -0700 (PDT) X-Barracuda-Envelope-From: chandana@desilva.id.au X-Barracuda-Apparent-Source-IP: 23.91.64.112 X-Sender-Id: duocircle|x-authuser|chandana Received: from smtp4.ore.mailhop.org (ip-10-237-13-110.us-west-2.compute.internal [10.237.13.110]) by relay.mailchannels.net (Postfix) with ESMTPA id 985D61D0601 for ; Thu, 2 Apr 2015 06:44:34 +0000 (UTC) X-Sender-Id: duocircle|x-authuser|chandana Received: from smtp4.ore.mailhop.org (smtp4.ore.mailhop.org [10.83.15.107]) (using TLSv1 with cipher DHE-RSA-AES256-SHA) by 0.0.0.0:2500 (trex/5.4.8); Thu, 02 Apr 2015 06:44:34 +0000 X-MC-Relay: Neutral X-MailChannels-SenderId: duocircle|x-authuser|chandana X-MailChannels-Auth-Id: duocircle X-MC-Loop-Signature: 1427957074746:962755299 X-MC-Ingress-Time: 1427957074746 Received: from ec2-54-252-74-219.ap-southeast-2.compute.amazonaws.com ([54.252.74.219] helo=mail.desilva.id.au) by smtp4.ore.mailhop.org with esmtpa (Exim 4.82) (envelope-from ) id 1YdYrg-0003jw-Mf for pcp@oss.sgi.com; Thu, 02 Apr 2015 06:44:33 +0000 Received: from tardis (unknown [175.45.119.98]) by mail.desilva.id.au (Postfix) with ESMTPSA id D4EDE25AD6 for ; Thu, 2 Apr 2015 06:44:30 +0000 (UTC) X-Mail-Handler: DuoCircle Outbound SMTP X-Originating-IP: 54.252.74.219 X-Report-Abuse-To: abuse@duocircle.com (see https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information for abuse reporting information) X-MHO-User: U2FsdGVkX19EKgDbrFMMZFIQAqFhQgAoMt5ZVEo/DdA= Message-ID: <1427957070.8765.30.camel@desilva.id.au> Subject: Trying out ElasticSearch PMDA for the first time From: Chandana De Silva X-ASG-Orig-Subj: Trying out ElasticSearch PMDA for the first time Reply-To: chandana@desilva.id.au To: pcp@oss.sgi.com Date: Thu, 02 Apr 2015 17:44:30 +1100 Content-Type: multipart/alternative; boundary="=-T/SzPPmipq1ZRSI//8XS" X-Mailer: Evolution 3.12.11 (3.12.11-1.fc21) Mime-Version: 1.0 X-AuthUser: chandana X-Barracuda-Connect: aso-006-i431.relay.mailchannels.net[23.91.64.112] X-Barracuda-Start-Time: 1427957075 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.70 X-Barracuda-Spam-Status: No, SCORE=0.70 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA038b, HTML_MESSAGE, WEIRD_PORT X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17471 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.50 WEIRD_PORT URI: Uses non-standard port number for HTTP 0.00 HTML_MESSAGE BODY: HTML included in message 0.20 BSF_SC0_SA038b Custom Rule SA038b --=-T/SzPPmipq1ZRSI//8XS Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit Hello All I am trying out the ES pmda, and not having much luck. The error in the PMCD log says: [Thu Apr 2 06:20:40] pmcd(2564) Warning: pduread: timeout (after 5.000 sec) while attempting to read 12 bytes out of 12 in HDR on fd=21 [Thu Apr 2 06:20:40] pmcd(2564) Info: CleanupAgent ... Cleanup "elasticsearch" agent (dom 108): protocol failure for fd=21 This is what I have: elasticsearch-1.4.4-1.noarch java-1.7.0-openjdk-1.7.0.75-2.5.4.0.53.amzn1.x86_64 pcp-3.9.10-1.x86_64 $ sudo ./Install You will need to choose an appropriate configuration for installation of the "elasticsearch" Performance Metrics Domain Agent (PMDA). collector collect performance statistics on this system monitor allow this system to monitor local and/or remote systems both collector and monitor configuration for this system Please enter c(ollector) or m(onitor) or b(oth) [b] Updating the Performance Metrics Name Space (PMNS) ... Terminate PMDA if already installed ... Updating the PMCD control file, and notifying PMCD ... Check elasticsearch metrics have appeared ... 110 warnings, 110 metrics and 0 values ELlasticSearch.log ============= $ cat /var/log/pcp/pmcd/elasticsearch.log Log for pmdaelasticsearch on elsrch.dev.syd.mmd started Thu Apr 2 06:34:25 2015 Log finished Thu Apr 2 06:34:36 2015 /usr/bin/java -Xms7G -Xmx7G -Xss256k -Djava.awt.headless=true -XX: +UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+HeapDumpOnOutOfMemoryError -XX:+DisableExplicitGC -Dfile.encoding=UTF-8 -Xmx7g -Xms7g -Delasticsearch -Des.pidfile=/var/run/elasticsearch/elasticsearch.pid -Des.path.home=/usr/share/elasticsearch -cp :/usr/share/elasticsearch/lib/elasticsearch-1.4.4.jar:/usr/share/elasticsearch/lib/*:/usr/share/elasticsearch/lib/sigar/* -Des.default.path.home=/usr/share/elasticsearch -Des.default.path.logs=/var/log/elasticsearch -Des.default.path.data=/var/lib/elasticsearch -Des.default.path.work=/tmp/elasticsearch -Des.default.path.conf=/etc/elasticsearch org.elasticsearch.bootstrap.Elasticsearch [chandana@elsrch.dev elasticsearch]$ pminfo -f mem.util.used mem.util.used value 13578396 [chandana@elsrch.dev elasticsearch]$ pminfo -f mem.util.free mem.util.free value 2091624 [chandana@elsrch.dev elasticsearch]$ pminfo -f mem.physmem mem.physmem value 15670012 $ curl http://localhost:9200/ { "status" : 200, "name" : "Stonewall", "cluster_name" : "mmelasticsearch", "version" : { "number" : "1.4.4", "build_hash" : "c88f77ffc81301dfa9dfd81ca2232f09588bd512", "build_timestamp" : "2015-02-19T13:05:36Z", "build_snapshot" : false, "lucene_version" : "4.10.3" }, "tagline" : "You Know, for Search" } PMCD LOG ========= [Thu Apr 2 06:20:30] pmcd(2564) Info: pmcd RESTARTED at Thu Apr 2 06:20:30 2015 Current PMCD clients ... fd client connection from ipc ver operations denied == ======================================== ======= ================= 17 10.17.1.18 2 store 16 /var/run/pcp/pmcd.socket 2 active agent dom pid in out ver protocol parameters ============ === ===== === === === ======== ========== pmcd 2 2 dso i:5 lib=/var/lib/pcp/pmdas/pmcd/pmda_pmcd.so entry=pmcd_init [(nil)] linux 60 2 dso i:4 lib=/var/lib/pcp/pmdas/linux/pmda_linux.so entry=linux_init [(nil)] proc 3 2571 10 11 2 bin pipe cmd=/var/lib/pcp/pmdas/proc/pmdaproc -d 3 mmv 70 2 dso i:4 lib=/var/lib/pcp/pmdas/mmv/pmda_mmv.so entry=mmv_init [(nil)] xfs 11 2579 12 13 2 bin pipe cmd=/var/lib/pcp/pmdas/xfs/pmdaxfs -d 11 jbd2 122 2 dso i:4 lib=/var/lib/pcp/pmdas/jbd2/pmda_jbd2.so entry=jbd2_init [(nil)] elasticsearch 108 18426 20 21 2 bin pipe cmd=perl /var/lib/pcp/pmdas/elasticsearch/pmdaelasticsearch.pl Host access list: 00 01 Cur/MaxCons host-spec host-mask lvl host-name == == =========== ======================================= ======================================= === ============== y y 0 0 10.25.20.90 255.255.255.255 0 localhost y y 0 0 / / 1 unix: n 0 0 0.0.0.0 0.0.0.0 4 .* n 0 0 :: :: 8 :* User access list empty: user-based access control turned off Group access list empty: group-based access control turned off [Thu Apr 2 06:20:30] pmcd(2564) Info: PMNS file "DEFAULT" is unchanged [Thu Apr 2 06:20:40] pmcd(2564) Warning: pduread: timeout (after 5.000 sec) while attempting to read 12 bytes out of 12 in HDR on fd=21 [Thu Apr 2 06:20:40] pmcd(2564) Info: CleanupAgent ... Cleanup "elasticsearch" agent (dom 108): protocol failure for fd=21 --=-T/SzPPmipq1ZRSI//8XS Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: 7bit Hello All
I am trying out the ES pmda, and not having much luck.

The error in the PMCD log says:
[Thu Apr  2 06:20:40] pmcd(2564) Warning: pduread: timeout (after 5.000 sec) while attempting to read 12 bytes out of 12 in HDR on fd=21
[Thu Apr  2 06:20:40] pmcd(2564) Info: CleanupAgent ...
Cleanup "elasticsearch" agent (dom 108): protocol failure for fd=21


This is what I have:
elasticsearch-1.4.4-1.noarch
java-1.7.0-openjdk-1.7.0.75-2.5.4.0.53.amzn1.x86_64
pcp-3.9.10-1.x86_64

$ sudo ./Install 
You will need to choose an appropriate configuration for installation of
the "elasticsearch" Performance Metrics Domain Agent (PMDA).

  collector	collect performance statistics on this system
  monitor	allow this system to monitor local and/or remote systems
  both		collector and monitor configuration for this system

Please enter c(ollector) or m(onitor) or b(oth) [b] 
Updating the Performance Metrics Name Space (PMNS) ...
Terminate PMDA if already installed ...
Updating the PMCD control file, and notifying PMCD ...
Check elasticsearch metrics have appeared ... 110 warnings, 110 metrics and 0 values
ELlasticSearch.log
=============
$ cat /var/log/pcp/pmcd/elasticsearch.log
Log for pmdaelasticsearch on elsrch.dev.syd.mmd started Thu Apr  2 06:34:25 2015

Log finished Thu Apr  2 06:34:36 2015

/usr/bin/java -Xms7G -Xmx7G -Xss256k -Djava.awt.headless=true -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+HeapDumpOnOutOfMemoryError -XX:+DisableExplicitGC -Dfile.encoding=UTF-8 -Xmx7g -Xms7g -Delasticsearch -Des.pidfile=/var/run/elasticsearch/elasticsearch.pid -Des.path.home=/usr/share/elasticsearch -cp :/usr/share/elasticsearch/lib/elasticsearch-1.4.4.jar:/usr/share/elasticsearch/lib/*:/usr/share/elasticsearch/lib/sigar/* -Des.default.path.home=/usr/share/elasticsearch -Des.default.path.logs=/var/log/elasticsearch -Des.default.path.data=/var/lib/elasticsearch -Des.default.path.work=/tmp/elasticsearch -Des.default.path.conf=/etc/elasticsearch org.elasticsearch.bootstrap.Elasticsearch

[chandana@elsrch.dev elasticsearch]$ pminfo -f mem.util.used
mem.util.used
    value 13578396
[chandana@elsrch.dev elasticsearch]$ pminfo -f mem.util.free
mem.util.free
    value 2091624
[chandana@elsrch.dev elasticsearch]$ pminfo -f mem.physmem
mem.physmem
    value 15670012

$ curl http://localhost:9200/
{
  "status" : 200,
  "name" : "Stonewall",
  "cluster_name" : "mmelasticsearch",
  "version" : {
    "number" : "1.4.4",
    "build_hash" : "c88f77ffc81301dfa9dfd81ca2232f09588bd512",
    "build_timestamp" : "2015-02-19T13:05:36Z",
    "build_snapshot" : false,
    "lucene_version" : "4.10.3"
  },
  "tagline" : "You Know, for Search"
}

PMCD LOG
========= 
[Thu Apr  2 06:20:30] pmcd(2564) Info: 

pmcd RESTARTED at Thu Apr  2 06:20:30 2015


Current PMCD clients ...
     fd  client connection from                    ipc ver  operations denied
     ==  ========================================  =======  =================
     17  10.17.1.18                                      2  store 
     16  /var/run/pcp/pmcd.socket                        2


active agent dom   pid  in out ver protocol parameters
============ === ===== === === === ======== ==========
pmcd           2                 2 dso i:5  lib=/var/lib/pcp/pmdas/pmcd/pmda_pmcd.so entry=pmcd_init [(nil)]
linux         60                 2 dso i:4  lib=/var/lib/pcp/pmdas/linux/pmda_linux.so entry=linux_init [(nil)]
proc           3  2571  10  11   2 bin pipe cmd=/var/lib/pcp/pmdas/proc/pmdaproc -d 3
mmv           70                 2 dso i:4  lib=/var/lib/pcp/pmdas/mmv/pmda_mmv.so entry=mmv_init [(nil)]
xfs           11  2579  12  13   2 bin pipe cmd=/var/lib/pcp/pmdas/xfs/pmdaxfs -d 11
jbd2         122                 2 dso i:4  lib=/var/lib/pcp/pmdas/jbd2/pmda_jbd2.so entry=jbd2_init [(nil)]
elasticsearch 108 18426  20  21   2 bin pipe cmd=perl /var/lib/pcp/pmdas/elasticsearch/pmdaelasticsearch.pl

Host access list:
00 01 Cur/MaxCons host-spec                               host-mask                               lvl host-name
== == =========== ======================================= ======================================= === ==============
 y  y     0     0 10.25.20.90                             255.255.255.255                           0 localhost
 y  y     0     0 /                                       /                                         1 unix:
    n     0     0 0.0.0.0                                 0.0.0.0                                   4 .*
    n     0     0 ::                                      ::                                        8 :*
User access list empty: user-based access control turned off
Group access list empty: group-based access control turned off

[Thu Apr  2 06:20:30] pmcd(2564) Info: PMNS file "DEFAULT" is unchanged
[Thu Apr  2 06:20:40] pmcd(2564) Warning: pduread: timeout (after 5.000 sec) while attempting to read 12 bytes out of 12 in HDR on fd=21
[Thu Apr  2 06:20:40] pmcd(2564) Info: CleanupAgent ...
Cleanup "elasticsearch" agent (dom 108): protocol failure for fd=21
--=-T/SzPPmipq1ZRSI//8XS-- From minnus@buffalo.edu Thu Apr 2 12:49:20 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 446EE7F59 for ; Thu, 2 Apr 2015 12:49:20 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 37FBA8F8059 for ; Thu, 2 Apr 2015 10:49:20 -0700 (PDT) X-ASG-Debug-ID: 1427996955-04cbb043b807a00001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id CqkuzBBofwGXwDw7 for ; Thu, 02 Apr 2015 10:49:15 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmailD.acsu.buffalo.edu (localmaild.acsu.buffalo.edu [128.205.5.208]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 39058A7E for ; Thu, 2 Apr 2015 13:49:15 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 31AD0C1AA for ; Thu, 2 Apr 2015 13:49:15 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailD.acsu.buffalo.edu (Postfix) with ESMTP id 8215DC1A4 for ; Thu, 2 Apr 2015 13:49:14 -0400 (EDT) Received: from smtp.buffalo.edu (smtp3.acsu.buffalo.edu [128.205.5.226]) by localmailD.acsu.buffalo.edu (Prefixe) with ESMTP id 73235C1A3 for ; Thu, 2 Apr 2015 13:49:14 -0400 (EDT) Received: from [128.205.28.168] (slash.eng.buffalo.edu [128.205.28.168]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 614BB4264 for ; Thu, 2 Apr 2015 13:49:14 -0400 (EDT) Message-ID: <551D8119.5010404@buffalo.edu> Date: Thu, 02 Apr 2015 13:49:13 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: pcp Subject: pmLookupName sts differences Content-Type: multipart/mixed; boundary="------------050101030000010901000507" X-ASG-Orig-Subj: pmLookupName sts differences X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1427996955 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17495 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- This is a multi-part message in MIME format. --------------050101030000010901000507 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Hi, Please see the attached code for an example of differences in return value for pmLookupName when a metric is not found depending on whether the top level namespace is handled by a dynamic pmda. For a regular metric (non dynamic) if we give it a bogus metric name, the function returns fine, the appropriate pmID is set to NULL and "sts" reflects the valid number of names converted, as expected. For a metric that would be rooted at a dynamic tree, it seems the lookups all happen properly, NULL is set for the bogus metric properly, but "sts" returns PM_ERR_NAME. I think it is somewhere in the pmns<->pdu interaction that the status is being propagated all the way back for dynamic metrics but not normal ones. I'm not familiar enough with this code to figure out the right way to fix it. Thanks for any insight. Martins --------------050101030000010901000507 Content-Type: text/plain; charset=windows-1252; name="lookuptest.c" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="lookuptest.c" I2luY2x1ZGUgInBtYXBpLmgiCiNpbmNsdWRlICJpbXBsLmgiCgojaW5jbHVkZSA8c3RkaW8u aD4KCmludCBtYWluKCl7CgogICAgLy8gVGhpcyByZXR1cm5zIHN0cyAxCiAgICAvL2NoYXIg Km5hbWVzWzI1Nl0gPSB7ICJoaW52Lm5jcHUiLCAiaGludi5mb28ifTsKCiAgICAvLyBUaGlz IHJldHVybnMgc3RzIC0xMjM1NwogICAgY2hhciAqbmFtZXNbMjU2XSA9IHsgImhpbnYubmNw dSIsICJwcm9jLnBzaW5mby5mb28ifTsKCiAgICBwbUlEICppZHM7CgogICAgaW50IHN0czsK CiAgICBpZHMgPSAocG1JRCopbWFsbG9jKDIqIHNpemVvZihwbUlEKSk7CgogICAgcG1OZXdD b250ZXh0KFBNX0NPTlRFWFRfSE9TVCwgImxvY2FsOiIpOwoKICAgIHN0cyA9IHBtTG9va3Vw TmFtZSggMiwgbmFtZXMsIGlkcyApOwoKICAgIHByaW50ZigiU1RTOiAlZFxuIiwgc3RzKTsK CgogICAgcmV0dXJuIDA7Cn0KCg== --------------050101030000010901000507-- From minnus@buffalo.edu Thu Apr 2 13:54:43 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id F23AB7F59 for ; Thu, 2 Apr 2015 13:54:42 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id D6F578F804B for ; Thu, 2 Apr 2015 11:54:39 -0700 (PDT) X-ASG-Debug-ID: 1428000878-04cbb043b610990001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id 3fQMw4ewl8S7eGa2 for ; Thu, 02 Apr 2015 11:54:38 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmailA.acsu.buffalo.edu (localmaila.acsu.buffalo.edu [128.205.5.196]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 0424CBD for ; Thu, 2 Apr 2015 14:54:38 -0400 (EDT) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id F37775F11 for ; Thu, 2 Apr 2015 14:54:37 -0400 (EDT) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailA.acsu.buffalo.edu (Postfix) with ESMTP id B8EA85F09 for ; Thu, 2 Apr 2015 14:54:36 -0400 (EDT) Received: from smtp.buffalo.edu (smtp3.acsu.buffalo.edu [128.205.5.226]) by localmailA.acsu.buffalo.edu (Prefixe) with ESMTP id ACD8E5F08 for ; Thu, 2 Apr 2015 14:54:36 -0400 (EDT) Received: from [128.205.28.168] (slash.eng.buffalo.edu [128.205.28.168]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id A0EA9488D for ; Thu, 2 Apr 2015 14:54:36 -0400 (EDT) Message-ID: <551D906B.9010208@buffalo.edu> Date: Thu, 02 Apr 2015 14:54:35 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: pcp Subject: Re: [pcp] pmLookupName sts differences References: <551D8119.5010404@buffalo.edu> X-ASG-Orig-Subj: Re: [pcp] pmLookupName sts differences In-Reply-To: <551D8119.5010404@buffalo.edu> Content-Type: multipart/alternative; boundary="------------000302010408000306020307" X-PM-EL-Spam-Prob: X: 10% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1428000878 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17496 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 HTML_MESSAGE BODY: HTML included in message This is a multi-part message in MIME format. --------------000302010408000306020307 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit What appears to be happening is that in DoPMNSNames of pmcd/src/dopdus.c that it is required that all PMDA_INTERFACE_4 metrics must be valid, else an error is generated. That doesn't seem to be enforced for static lookups in that same function. sts is just set to the number found. Also not for PMNS_LOCAL lookups for PMDA_INTERFACE_4 metrics in pmLookupName directly. "lsts" is ignored if the lookup fails. So would the appropriate thing be do ignore PM_ERR_NAME errors, increment sts on success, and propagate the number of names converted back to the caller through sts? Sorry for the convoluted descriptions, just trying to work my way through this code. Thanks Martins On 4/2/2015 1:49 PM, Martins Innus wrote: > Hi, > Please see the attached code for an example of differences in > return value for pmLookupName when a metric is not found depending on > whether the top level namespace is handled by a dynamic pmda. For a > regular metric (non dynamic) if we give it a bogus metric name, the > function returns fine, the appropriate pmID is set to NULL and "sts" > reflects the valid number of names converted, as expected. > > For a metric that would be rooted at a dynamic tree, it seems the > lookups all happen properly, NULL is set for the bogus metric > properly, but "sts" returns PM_ERR_NAME. > > I think it is somewhere in the pmns<->pdu interaction that the > status is being propagated all the way back for dynamic metrics but > not normal ones. I'm not familiar enough with this code to figure out > the right way to fix it. > > Thanks for any insight. > > Martins > > > _______________________________________________ > pcp mailing list > pcp@oss.sgi.com > http://oss.sgi.com/mailman/listinfo/pcp --------------000302010408000306020307 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: 8bit What appears to be happening is that in DoPMNSNames of pmcd/src/dopdus.c that it is required that all PMDA_INTERFACE_4 metrics must be valid, else an error is generated. 

That doesn't seem to be enforced for static lookups in that same function. sts is just set to the number found.

Also not  for PMNS_LOCAL lookups for  PMDA_INTERFACE_4 metrics in pmLookupName directly. "lsts" is ignored if the lookup fails.

So would the appropriate thing be do ignore PM_ERR_NAME  errors, increment sts on success, and propagate the number of names converted back to the caller through sts?

Sorry for the convoluted descriptions, just trying to work my way through this code.

Thanks

Martins

On 4/2/2015 1:49 PM, Martins Innus wrote:
Hi,
    Please see the attached code for an example of differences in return value for pmLookupName when a metric is not found depending on whether the top level namespace is handled by a dynamic pmda. For a regular metric (non dynamic)  if we give it a bogus metric name, the function returns fine, the appropriate pmID is set to NULL and "sts" reflects the valid number of names converted, as expected.

    For a metric that would be rooted at a dynamic tree, it seems the lookups all happen properly, NULL is set for the bogus metric properly, but "sts" returns PM_ERR_NAME.

    I think it is somewhere in the pmns<->pdu interaction that the status is being propagated all the way back for dynamic metrics but not normal ones.  I'm not familiar enough with this code to figure out the right way to fix it.

Thanks for any insight.

Martins 


_______________________________________________
pcp mailing list
pcp@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/pcp

--------------000302010408000306020307-- From lberk@redhat.com Fri Apr 3 15:58:52 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 8A84E7F3F for ; Fri, 3 Apr 2015 15:58:52 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 357BDAC001 for ; Fri, 3 Apr 2015 13:58:49 -0700 (PDT) X-ASG-Debug-ID: 1428094727-04bdf04f806d8e0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id odm7dZ2DIsUJ491w (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 03 Apr 2015 13:58:48 -0700 (PDT) X-Barracuda-Envelope-From: lberk@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (Postfix) with ESMTPS id A5844AC7A5 for ; Fri, 3 Apr 2015 20:58:47 +0000 (UTC) Received: from toium (unused [10.10.52.72] (may be forged)) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t33KwjW0018257 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Fri, 3 Apr 2015 16:58:46 -0400 From: Lukas Berk To: pcp@oss.sgi.com Subject: trivial patch - adding pcp-summary subdir to makefile Date: Fri, 03 Apr 2015 16:58:45 -0400 X-ASG-Orig-Subj: trivial patch - adding pcp-summary subdir to makefile Message-ID: <87ego17wu2.fsf@redhat.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4 (gnu/linux) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1428094728 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 --=-=-= Content-Type: text/plain Hey, Please see the trivial patch to add the pcp/summary subdir to the GNUMakefile. It should apply directly to master. --=-=-= Content-Type: application/octet-stream Content-Disposition: attachment; filename=commit Content-Transfer-Encoding: base64 Y29tbWl0IDA3YTU0MmRhOGE5ODE3YjliMWU3NzE2YzdhYTQwMjEzMGZkZTRjMDYKQXV0aG9yOiBM dWthcyBCZXJrIDxsYmVya0ByZWRoYXQuY29tPgpEYXRlOiAgIEZyaSBBcHIgMyAxNjo1MzozMyAy MDE1IC0wNDAwCgogICAgQWRkIHBjcC1zdW1tYXJ5IGRpcmVjdG9yeSB0byBzcmMvcGNwL0dOVU1h a2VmaWxlCiAgICAKICAgIE5vdyB0aGF0IHBjcC1zdW1tYXJ5IGhhcyBiZWVuIHBsYWNlZCBpbiBp dCdzIG93biBzdWJkaXIsIHdlIG5lZWQgdG8gYWRkCiAgICB0aGUgc3ViZGlyIHRvIHRoZSBhcHBy b3ByaWF0ZSBtYWtlZmlsZSB0byBiZSBidWlsdCBhbmQgaW5jbHVkZWQuCgpkaWZmIC0tZ2l0IGEv c3JjL3BjcC9HTlVtYWtlZmlsZSBiL3NyYy9wY3AvR05VbWFrZWZpbGUKaW5kZXggYWM2OWVhYi4u NGZkNTg2NiAxMDA2NDQKLS0tIGEvc3JjL3BjcC9HTlVtYWtlZmlsZQorKysgYi9zcmMvcGNwL0dO VW1ha2VmaWxlCkBAIC0xNyw3ICsxNyw3IEBAIFRPUERJUiA9IC4uLy4uCiBpbmNsdWRlICQoVE9Q RElSKS9zcmMvaW5jbHVkZS9idWlsZGRlZnMKIAogTFNSQ0ZJTEVTID0gcGNwLnNoCi1TVUJESVJT ID0gZnJlZSB1cHRpbWUgbnVtYXN0YXQgZG1jYWNoZSB2ZXJpZnkKK1NVQkRJUlMgPSBmcmVlIHVw dGltZSBudW1hc3RhdCBkbWNhY2hlIHZlcmlmeSBzdW1tYXJ5CiAKIGRlZmF1bHQgOjogZGVmYXVs dF9wY3AKIAo= --=-=-=-- From fche@redhat.com Sat Apr 4 09:23:37 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id ED9537F3F for ; Sat, 4 Apr 2015 09:23:37 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id DBABB8F8035 for ; Sat, 4 Apr 2015 07:23:37 -0700 (PDT) X-ASG-Debug-ID: 1428157413-04cbb043b98dfc0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id i3yUMp3DNMsLeLOz (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sat, 04 Apr 2015 07:23:34 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (Postfix) with ESMTPS id 398F6AB117; Sat, 4 Apr 2015 14:23:32 +0000 (UTC) Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t34ENV1e018930; Sat, 4 Apr 2015 10:23:31 -0400 Received: by fche.csb (Postfix, from userid 2569) id 26D16585F1; Sat, 4 Apr 2015 10:23:29 -0400 (EDT) To: Renan DelValle Cc: pcp@oss.sgi.com Subject: Re: Installing perfevents on Ubuntu 14.04 References: X-ASG-Orig-Subj: Re: Installing perfevents on Ubuntu 14.04 From: fche@redhat.com (Frank Ch. Eigler) Date: Sat, 04 Apr 2015 10:23:29 -0400 In-Reply-To: (Renan DelValle's message of "Wed, 1 Apr 2015 17:29:56 -0400") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1428157414 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Renan DelValle writes: > [...] upon trying to fetch information from the perfevent, all > fields return a " No PMCD agent for domain of request" leading me to > believe I must do something else in order to get this working. [...] It Just Works (tm) here; the perfevent pmda install should restart pmcd a /var/lib/pcp/pmdas/perfevent/pmdaperfevent process started, along with a /var/log/pcp/pmcd/perfevent.log file. On your CPU, it may need manual configuration in the form of the perfevent.conf file. See also the papi pmda. It requires no configuration, is somewhat more secure (in the sense that it allows only pcp clients running as root to fetch potentially security-sensitive performance counters), but has a known bug with multi-processor systems (sampling only one of the cpus). - FChE From wwwrun@oss.sgi.com Sun Apr 5 16:11:43 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 11F477F3F; Sun, 5 Apr 2015 16:11:43 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1106] New: pmdalinux / pmdaroot container problems Date: Sun, 05 Apr 2015 21:11:42 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: fche@redhat.com X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@oss.sgi.com X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter cc classification Message-ID: Content-Type: multipart/alternative; boundary="1428268303.E3f30.26633"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1428268303.E3f30.26633 Date: Sun, 5 Apr 2015 16:11:43 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1106 Bug ID: 1106 Summary: pmdalinux / pmdaroot container problems Product: pcp Version: unspecified Hardware: All OS: Linux Status: NEW Severity: major Priority: P5 Component: pcp Assignee: pcp@oss.sgi.com Reporter: fche@redhat.com CC: pcp@oss.sgi.com Classification: Unclassified With a realistic test scenario with pcpfans.git fche/pmmgr, the pcp --container mode support shows problems at least with pmdalinux and pmdaroot. The gist of it is that it is not possible to have two concurrent pcp clients like pmlogger against the same pmce, one with and one without --container (whether specified as a separate option or as a part of a pcp:// url). The symptoms vary: corrupted data (host data showing up in container, or vice versa), or missing data (container side accesses getting "Error: Operation not permitted"). The easiest reproduction would be to fire up the aforementioned branch, set up a copy of container-logging pmmgr (touch /etc/pcp/pmmgr/subtarget-containers), and fire up a few docker containers. The resulting /var/log/pcp/pmmgr/$HOST and $HOST--$CONTAINER log files will not be right. A more manual example: (in another terminal) # docker run -i busybox sh (and just leave it alone) # docker ps # to fetch running container id # service pmcd restart % pminfo -f --container=SUBSTRING network.interface.inet_addr ... probably will show a reasonable "172.17.0.*" IP address for the container ... now to mess things up ... generate actual pcp traffic: % cd /tmp % pmlogconf -c -r -h 'local:' FOO.conf & % pmlogconf -c -r -h 'local:?container=SUBSTRING' FOO2.conf & % wait ... examine the two different FOO*.conf files, as one might expect % pminfo -f --container=SUBSTRING network.interface.inet_addr % pminfo -f network.interface.inet_addr ... these generally do not show correct results already (both the same, or EPERM) % pmlogger -h 'local:?container=SUBSTRING' -c FOO2.conf FOO2 & % pmlogger -h 'local:' -c FOO.conf FOO & % pminfo -f --container=SUBSTRING network.interface.inet_addr % pminfo -f network.interface.inet_addr ... no correct results before long In one incantation of the problem (the EPERM variant), pmdaroot appears to go dumb: Over three separate pminfo queries, it receives messages but sends nothing. # strace -f -p `pgrep pmdaroot` select(8, [0 3 6 7], NULL, NULL, NULL) = 1 (in [0]) read(0, "\0\0\0\20\0\0p\0\0\0\0\1", 12) = 12 read(0, "\377\377\317\231", 4) = 4 select(8, [0 3 6 7], NULL, NULL, NULL) = 1 (in [0]) read(0, "\0\0\0\20\0\0p\0\0\0\0\1", 12) = 12 read(0, "\377\377\317\231", 4) = 4 select(8, [0 3 6 7], NULL, NULL, NULL) = 1 (in [0]) read(0, "\0\0\0\20\0\0p\0\0\0\0\1", 12) = 12 read(0, "\377\377\317\231", 4) = 4 # cat /var/log/pcp/pmcd/root.log Log for pmdaroot on vm-rawhide-64 started Sun Apr 5 15:40:26 2015 [Sun Apr 5 15:40:27] pmdaroot(22640) Error: bad protocol exchange (fd=8) In another incantation (host & container side data coming back perpetually identical, reflecting container side ... even if later more containers are started and their --container=XXXX is passed): # strace -f -p `pgrep pmdalinux` Process 11264 attached read(0, "\0\0\0\26\0\0p\21\0\0\0\4", 12) = 12 read(0, "\0\0\0\01629921\0", 10) = 10 read(0, "\0\0\0\24\0\0p\21\0\0\0\4", 12) = 12 read(0, "\0\0\0\f100\0", 8) = 8 read(0, "\0\0\0\24\0\0p\21\0\0\0\4", 12) = 12 read(0, "\0\0\0\v500\0", 8) = 8 read(0, "\0\0\0\34\0\0p\2\0\0\0\4", 12) = 12 read(0, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 16) = 16 read(0, "\0\0\0 \0\0p\3\0\0\0\4", 12) = 12 read(0, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\1\17\0\204\0", 20) = 20 ioctl(8, SIOCGIFCONF, {80, {{"lo", {AF_INET, inet_addr("127.0.0.1")}}, {"eth0", {AF_INET, inet_addr("172.17.0.1")}}}}) = 0 ioctl(8, SIOCGIFADDR, {ifr_name="lo", ifr_addr={AF_INET, inet_addr("127.0.0.1")}}) = 0 open("/sys/class/net/lo/address", O_RDONLY) = 681 fstat(681, {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4b90d08000 read(681, "00:00:00:00:00:00\n", 4096) = 18 close(681) = 0 munmap(0x7f4b90d08000, 4096) = 0 ioctl(8, SIOCGIFADDR, {ifr_name="eth0", ifr_addr={AF_INET, inet_addr("172.17.0.1")}}) = 0 open("/sys/class/net/eth0/address", O_RDONLY) = 681 fstat(681, {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4b90d08000 read(681, "52:54:00:47:b3:cc\n", 4096) = 18 close(681) = 0 munmap(0x7f4b90d08000, 4096) = 0 open("/proc/net/if_inet6", O_RDONLY) = -1 ENOENT (No such file or directory) write(1, "\0\0\0T\0\0p\1\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\1\17\0\204\0\0\0\0\2"..., 84) = 84 read(0, "\0\0\0\20\0\0p\4\0\0\0\4", 12) = 12 read(0, "\17\0\204\0", 4) = 4 write(1, "\0\0\0 \0\0p\5\0\0\0\0\17\0\204\0\0\0\0\6\17\0\0\21\0\0\0\3\0\0\0\0", 32) = 32 read(0, "\0\0\0 \0\0p\6\0\0\0\4", 12) = 12 read(0, "\17\0\0\21\0\0\0\0\0\0\0\0\377\377\377\377\0\0\0\0", 20) = 20 ioctl(8, SIOCGIFCONF, {80, {{"lo", {AF_INET, inet_addr("127.0.0.1")}}, {"eth0", {AF_INET, inet_addr("172.17.0.1")}}}}) = 0 ioctl(8, SIOCGIFADDR, {ifr_name="lo", ifr_addr={AF_INET, inet_addr("127.0.0.1")}}) = 0 open("/sys/class/net/lo/address", O_RDONLY) = 681 fstat(681, {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4b90d08000 read(681, "00:00:00:00:00:00\n", 4096) = 18 close(681) = 0 munmap(0x7f4b90d08000, 4096) = 0 ioctl(8, SIOCGIFADDR, {ifr_name="eth0", ifr_addr={AF_INET, inet_addr("172.17.0.1")}}) = 0 open("/sys/class/net/eth0/address", O_RDONLY) = 681 fstat(681, {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4b90d08000 read(681, "52:54:00:47:b3:cc\n", 4096) = 18 close(681) = 0 munmap(0x7f4b90d08000, 4096) = 0 open("/proc/net/if_inet6", O_RDONLY) = -1 ENOENT (No such file or directory) write(1, "\0\0\0,\0\0p\7\0\0\0\0\17\0\0\21\0\0\0\2\0\0\0\0\0\0\0\2lo~~"..., 44) = 44 read(0, "\0\0\0\20\0\0p\0\0\0\0\4", 12) = 12 read(0, "\377\377\317\231", 4) = 4 It's as though the pmdalinux process has in the past entered the container namespace, but never left it. Note also the high file descriptor number (681 here), suggesting another file descriptor leak: # lsof -p `pgrep pmdalinux` pmdalinux 11264 root 0r FIFO 0,8 0t0 414788 pipe pmdalinux 11264 root 1w FIFO 0,8 0t0 414789 pipe pmdalinux 11264 root 2w REG 253,1 64 552572 /var/log/pcp/pmcd/linux.log pmdalinux 11264 root 3u unix 0xffff880003c39e00 0t0 414790 socket pmdalinux 11264 root 4r REG 253,1 8268 69116911 /var/lib/pcp/pmdas/linux/help.dir pmdalinux 11264 root 5r REG 253,1 70277 69159003 /var/lib/pcp/pmdas/linux/help.pag pmdalinux 11264 root 6r REG 0,3 0 4026531956 net pmdalinux 11264 root 7r REG 0,3 0 4026531956 net pmdalinux 11264 root 8u sock 0,6 0t0 414919 protocol: UDP pmdalinux 11264 root 9r REG 0,3 0 4026532028 /proc/stat pmdalinux 11264 root 10r REG 0,3 0 4026531956 net pmdalinux 11264 root 11r REG 0,3 0 4026531956 net pmdalinux 11264 root 12r REG 0,3 0 4026531838 uts pmdalinux 11264 root 13r REG 0,3 0 4026531956 net pmdalinux 11264 root 14r REG 0,3 0 4026531956 net pmdalinux 11264 root 15r REG 0,3 0 4026531840 mnt pmdalinux 11264 root 16r REG 0,3 0 4026531840 mnt pmdalinux 11264 root 17r REG 0,3 0 4026531840 mnt pmdalinux 11264 root 18r REG 0,3 0 4026531840 mnt pmdalinux 11264 root 19r REG 0,3 0 4026531840 mnt pmdalinux 11264 root 20r REG 0,3 0 4026531840 mnt pmdalinux 11264 root 21r REG 0,3 0 4026531838 uts pmdalinux 11264 root 22r REG 0,3 0 4026531838 uts pmdalinux 11264 root 23r REG 0,3 0 4026531838 uts pmdalinux 11264 root 24r REG 0,3 0 4026531838 uts pmdalinux 11264 root 25r REG 0,3 0 4026531838 uts pmdalinux 11264 root 26r REG 0,3 0 4026531838 uts pmdalinux 11264 root 27r REG 0,3 0 4026531838 uts pmdalinux 11264 root 28r REG 0,3 0 4026531838 uts pmdalinux 11264 root 29r REG 0,3 0 4026531838 uts pmdalinux 11264 root 30r REG 0,3 0 4026531838 uts pmdalinux 11264 root 31r REG 0,3 0 4026531838 uts pmdalinux 11264 root 32r REG 0,3 0 4026531838 uts pmdalinux 11264 root 33r REG 0,3 0 4026531838 uts pmdalinux 11264 root 34r REG 0,3 0 4026531838 uts pmdalinux 11264 root 35r REG 0,3 0 4026531838 uts pmdalinux 11264 root 36r REG 0,3 0 4026531838 uts pmdalinux 11264 root 37r REG 0,3 0 4026531956 net pmdalinux 11264 root 38r REG 0,3 0 4026531956 net pmdalinux 11264 root 39r REG 0,3 0 4026531840 mnt pmdalinux 11264 root 40r REG 0,3 0 4026531840 mnt pmdalinux 11264 root 41r REG 0,3 0 4026531840 mnt pmdalinux 11264 root 42r REG 0,3 0 4026531840 mnt pmdalinux 11264 root 43r REG 0,3 0 4026531840 mnt pmdalinux 11264 root 44r REG 0,3 0 4026531840 mnt pmdalinux 11264 root 45r REG 0,3 0 4026531838 uts pmdalinux 11264 root 46r REG 0,3 0 4026531838 uts pmdalinux 11264 root 47r REG 0,3 0 4026531838 uts pmdalinux 11264 root 48r REG 0,3 0 4026531838 uts pmdalinux 11264 root 49r REG 0,3 0 4026531838 uts [...etc...] This is reproducible with git master or fche/pmmgr pcp on rawhide, rhel7.1, fedora21 docker versions. It is not limited to the network.interface.inet_addr metric; most others are affected. -- You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug. --1428268303.E3f30.26633 Date: Sun, 5 Apr 2015 16:11:43 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8"
Bug ID 1106
Summary pmdalinux / pmdaroot container problems
Product pcp
Version unspecified
Hardware All
OS Linux
Status NEW
Severity major
Priority P5
Component pcp
Assignee pcp@oss.sgi.com
Reporter fche@redhat.com
CC pcp@oss.sgi.com
Classification Unclassified 

With a realistic test scenario with pcpfans.git fche/pmmgr, the pcp --container
mode support shows problems at least with pmdalinux and pmdaroot.  The gist of
it is that it is not possible to have two concurrent pcp clients like pmlogger
against the same pmce, one with and one without --container (whether specified
as a separate option or as a part of a pcp:// url).  The symptoms vary:
corrupted data (host data showing up in container, or vice versa), or missing
data (container side accesses getting "Error: Operation not permitted").

The easiest reproduction would be to fire up the aforementioned branch, set up
a copy of container-logging pmmgr (touch /etc/pcp/pmmgr/subtarget-containers),
and fire up a few docker containers.  The resulting /var/log/pcp/pmmgr/$HOST
and $HOST--$CONTAINER log files will not be right.

A more manual example:

(in another terminal) # docker run -i busybox sh   (and just leave it alone)
# docker ps   # to fetch running container id
# service pmcd restart
% pminfo -f --container=SUBSTRING network.interface.inet_addr
... probably will show a reasonable "172.17.0.*" IP address for the container
... now to mess things up ... generate actual pcp traffic:
% cd /tmp
% pmlogconf -c -r -h 'local:' FOO.conf &
% pmlogconf -c -r -h 'local:?container=SUBSTRING' FOO2.conf &
% wait
... examine the two different FOO*.conf files, as one might expect
% pminfo -f --container=SUBSTRING network.interface.inet_addr
% pminfo -f                       network.interface.inet_addr
... these generally do not show correct results already (both the same, or
EPERM)
% pmlogger -h 'local:?container=SUBSTRING' -c FOO2.conf FOO2 &
% pmlogger -h 'local:'                     -c FOO.conf FOO &
% pminfo -f --container=SUBSTRING network.interface.inet_addr
% pminfo -f                       network.interface.inet_addr
... no correct results before long


In one incantation of the problem (the EPERM variant), pmdaroot appears to go
dumb: Over three separate pminfo queries, it receives messages but sends
nothing.

# strace -f -p `pgrep pmdaroot`
select(8, [0 3 6 7], NULL, NULL, NULL)  = 1 (in [0])
read(0, "\0\0\0\20\0\0p\0\0\0\0\1", 12) = 12
read(0, "\377\377\317\231", 4)          = 4
select(8, [0 3 6 7], NULL, NULL, NULL)  = 1 (in [0])
read(0, "\0\0\0\20\0\0p\0\0\0\0\1", 12) = 12
read(0, "\377\377\317\231", 4)          = 4
select(8, [0 3 6 7], NULL, NULL, NULL)  = 1 (in [0])
read(0, "\0\0\0\20\0\0p\0\0\0\0\1", 12) = 12
read(0, "\377\377\317\231", 4)          = 4

# cat /var/log/pcp/pmcd/root.log
Log for pmdaroot on vm-rawhide-64 started Sun Apr  5 15:40:26 2015

[Sun Apr  5 15:40:27] pmdaroot(22640) Error: bad protocol exchange (fd=8)


In another incantation (host & container side data coming back perpetually
identical, reflecting container side ... even if later more containers are
started and their --container=XXXX is passed):

# strace -f -p `pgrep pmdalinux`
Process 11264 attached
read(0, 

"\0\0\0\26\0\0p\21\0\0\0\4", 12) = 12
read(0, "\0\0\0\01629921\0", 10)        = 10
read(0, "\0\0\0\24\0\0p\21\0\0\0\4", 12) = 12
read(0, "\0\0\0\f100\0", 8)             = 8
read(0, "\0\0\0\24\0\0p\21\0\0\0\4", 12) = 12
read(0, "\0\0\0\v500\0", 8)             = 8
read(0, "\0\0\0\34\0\0p\2\0\0\0\4", 12) = 12
read(0, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 16) = 16
read(0, "\0\0\0 \0\0p\3\0\0\0\4", 12)   = 12
read(0, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\1\17\0\204\0", 20) = 20
ioctl(8, SIOCGIFCONF, {80, {{"lo", {AF_INET, inet_addr("127.0.0.1")}}, {"eth0",
{AF_INET, inet_addr("172.17.0.1")}}}}) = 0
ioctl(8, SIOCGIFADDR, {ifr_name="lo", ifr_addr={AF_INET,
inet_addr("127.0.0.1")}}) = 0
open("/sys/class/net/lo/address", O_RDONLY) = 681
fstat(681, {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) =
0x7f4b90d08000
read(681, "00:00:00:00:00:00\n", 4096)  = 18
close(681)                              = 0
munmap(0x7f4b90d08000, 4096)            = 0
ioctl(8, SIOCGIFADDR, {ifr_name="eth0", ifr_addr={AF_INET,
inet_addr("172.17.0.1")}}) = 0
open("/sys/class/net/eth0/address", O_RDONLY) = 681
fstat(681, {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) =
0x7f4b90d08000
read(681, "52:54:00:47:b3:cc\n", 4096)  = 18
close(681)                              = 0
munmap(0x7f4b90d08000, 4096)            = 0
open("/proc/net/if_inet6", O_RDONLY)    = -1 ENOENT (No such file or directory)
write(1,
"\0\0\0T\0\0p\1\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\1\17\0\204\0\0\0\0\2"..., 84) =
84
read(0, "\0\0\0\20\0\0p\4\0\0\0\4", 12) = 12
read(0, "\17\0\204\0", 4)               = 4
write(1, "\0\0\0 \0\0p\5\0\0\0\0\17\0\204\0\0\0\0\6\17\0\0\21\0\0\0\3\0\0\0\0",
32) = 32
read(0, "\0\0\0 \0\0p\6\0\0\0\4", 12)   = 12
read(0, "\17\0\0\21\0\0\0\0\0\0\0\0\377\377\377\377\0\0\0\0", 20) = 20
ioctl(8, SIOCGIFCONF, {80, {{"lo", {AF_INET, inet_addr("127.0.0.1")}}, {"eth0",
{AF_INET, inet_addr("172.17.0.1")}}}}) = 0
ioctl(8, SIOCGIFADDR, {ifr_name="lo", ifr_addr={AF_INET,
inet_addr("127.0.0.1")}}) = 0
open("/sys/class/net/lo/address", O_RDONLY) = 681
fstat(681, {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) =
0x7f4b90d08000
read(681, "00:00:00:00:00:00\n", 4096)  = 18
close(681)                              = 0
munmap(0x7f4b90d08000, 4096)            = 0
ioctl(8, SIOCGIFADDR, {ifr_name="eth0", ifr_addr={AF_INET,
inet_addr("172.17.0.1")}}) = 0
open("/sys/class/net/eth0/address", O_RDONLY) = 681
fstat(681, {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) =
0x7f4b90d08000
read(681, "52:54:00:47:b3:cc\n", 4096)  = 18
close(681)                              = 0
munmap(0x7f4b90d08000, 4096)            = 0
open("/proc/net/if_inet6", O_RDONLY)    = -1 ENOENT (No such file or directory)
write(1, "\0\0\0,\0\0p\7\0\0\0\0\17\0\0\21\0\0\0\2\0\0\0\0\0\0\0\2lo~~"..., 44)
= 44
read(0, "\0\0\0\20\0\0p\0\0\0\0\4", 12) = 12
read(0, "\377\377\317\231", 4)          = 4

It's as though the pmdalinux process has in the past entered the container
namespace, but never left it.  Note also the high file descriptor number (681
here), suggesting another file descriptor leak:

# lsof -p `pgrep pmdalinux`
pmdalinux 11264 root    0r  FIFO                0,8      0t0     414788 pipe
pmdalinux 11264 root    1w  FIFO                0,8      0t0     414789 pipe
pmdalinux 11264 root    2w   REG              253,1       64     552572
/var/log/pcp/pmcd/linux.log
pmdalinux 11264 root    3u  unix 0xffff880003c39e00      0t0     414790 socket
pmdalinux 11264 root    4r   REG              253,1     8268   69116911
/var/lib/pcp/pmdas/linux/help.dir
pmdalinux 11264 root    5r   REG              253,1    70277   69159003
/var/lib/pcp/pmdas/linux/help.pag
pmdalinux 11264 root    6r   REG                0,3        0 4026531956 net
pmdalinux 11264 root    7r   REG                0,3        0 4026531956 net
pmdalinux 11264 root    8u  sock                0,6      0t0     414919
protocol: UDP
pmdalinux 11264 root    9r   REG                0,3        0 4026532028
/proc/stat
pmdalinux 11264 root   10r   REG                0,3        0 4026531956 net
pmdalinux 11264 root   11r   REG                0,3        0 4026531956 net
pmdalinux 11264 root   12r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   13r   REG                0,3        0 4026531956 net
pmdalinux 11264 root   14r   REG                0,3        0 4026531956 net
pmdalinux 11264 root   15r   REG                0,3        0 4026531840 mnt
pmdalinux 11264 root   16r   REG                0,3        0 4026531840 mnt
pmdalinux 11264 root   17r   REG                0,3        0 4026531840 mnt
pmdalinux 11264 root   18r   REG                0,3        0 4026531840 mnt
pmdalinux 11264 root   19r   REG                0,3        0 4026531840 mnt
pmdalinux 11264 root   20r   REG                0,3        0 4026531840 mnt
pmdalinux 11264 root   21r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   22r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   23r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   24r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   25r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   26r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   27r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   28r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   29r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   30r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   31r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   32r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   33r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   34r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   35r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   36r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   37r   REG                0,3        0 4026531956 net
pmdalinux 11264 root   38r   REG                0,3        0 4026531956 net
pmdalinux 11264 root   39r   REG                0,3        0 4026531840 mnt
pmdalinux 11264 root   40r   REG                0,3        0 4026531840 mnt
pmdalinux 11264 root   41r   REG                0,3        0 4026531840 mnt
pmdalinux 11264 root   42r   REG                0,3        0 4026531840 mnt
pmdalinux 11264 root   43r   REG                0,3        0 4026531840 mnt
pmdalinux 11264 root   44r   REG                0,3        0 4026531840 mnt
pmdalinux 11264 root   45r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   46r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   47r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   48r   REG                0,3        0 4026531838 uts
pmdalinux 11264 root   49r   REG                0,3        0 4026531838 uts
[...etc...]



This is reproducible with git master or fche/pmmgr pcp on rawhide, rhel7.1,
fedora21 docker versions.  It is not limited to the network.interface.inet_addr
metric; most others are affected.

You are receiving this mail because:
  • You are on the CC list for the bug.
  • You are the assignee for the bug.
--1428268303.E3f30.26633-- From nscott@redhat.com Mon Apr 6 22:24:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 394BA29E01 for ; Mon, 6 Apr 2015 22:24:18 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id ADCEBAC001 for ; Mon, 6 Apr 2015 20:24:14 -0700 (PDT) X-ASG-Debug-ID: 1428377048-04cb6c1cc831a00001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id letxpVqnHzHUSH9Q (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 06 Apr 2015 20:24:09 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t373O4WC043316; Mon, 6 Apr 2015 23:24:04 -0400 Date: Mon, 6 Apr 2015 23:24:03 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus , Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <1054712300.13181698.1428377043948.JavaMail.zimbra@redhat.com> In-Reply-To: <551AB41F.6050409@buffalo.edu> References: <551AB41F.6050409@buffalo.edu> Subject: Re: [pcp] pmlogger configuration changes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pmlogger configuration changes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.49.200] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pmlogger configuration changes Thread-Index: 4YMueaJ+1660sq2ZOHe/10yw+lg9lQ== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1428377049 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17626 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Sounds like an accidental regression - any ideas so far Ken?, else I'll queue it up for further investigation here. thanks. ----- Original Message ----- > Hi, > I am trying to track down some strangeness I'm seeing in pmlogger > configuration between 3.10.0 and recent git. > > On a 3.10.0 system i have the following in /etc/pcp/pmlogger/control. All > defaults except the primary logger line: > > #### > LOCALHOSTNAME y n PCP_LOG_DIR/pmlogger/LOCALHOSTNAME -r -c primary.logger > #### > > The file: > > /etc/pcp/pmlogger/primary.logger > > exists and everything works as expected. > > > On a recent git system, with the same config, pmlogger does not find the > primary.logger file and seems to construct a new (unrelated) one with > pmlogconf in /var/lib/pcp/config/pmlogger/primary.logger that appears to be > some sort of default config on startup. > > The change seems to come from here: > > 0020568401cefe9df692e2f705b8133a8ab87f0d > > I guess I have 2 questions: > > 1. The comment led me to believe that everything should still work since it > says "." is searched first and I would expect "." to map to > /etc/pcp/pmlogger since that is where the control file lives. Is that not > correct? > > 2. This was on a clean install with rpms built from git on a Centos 6.5 > machine. I can deal with this on new systems by putting the config in the > right place, but what is the expected behavior on upgrade? I am setting up a > test system that I can upgrade shortly, because I got lost in the config > file logic in the spec file, and am not sure if the right thing will happen > in terms of moving existing config files to the new right place. > > Thanks > > Martins > > > > > > > > > > _______________________________________________ > pcp mailing list > pcp@oss.sgi.com > http://oss.sgi.com/mailman/listinfo/pcp > From nscott@redhat.com Mon Apr 6 22:27:47 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id EE1F829E01 for ; Mon, 6 Apr 2015 22:27:46 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 8B45AAC004 for ; Mon, 6 Apr 2015 20:27:46 -0700 (PDT) X-ASG-Debug-ID: 1428377261-04bdf0632037170001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id dYlb657GnFEoaYCf (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 06 Apr 2015 20:27:41 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t373Rd5a029296; Mon, 6 Apr 2015 23:27:39 -0400 Date: Mon, 6 Apr 2015 23:27:39 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: chandana@desilva.id.au Cc: pcp@oss.sgi.com Message-ID: <1446889888.13182385.1428377259368.JavaMail.zimbra@redhat.com> In-Reply-To: <1427957070.8765.30.camel@desilva.id.au> References: <1427957070.8765.30.camel@desilva.id.au> Subject: Re: [pcp] Trying out ElasticSearch PMDA for the first time MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Trying out ElasticSearch PMDA for the first time Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.49.200] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Trying out ElasticSearch PMDA for the first time Thread-Index: HfJXicjQN1J5oO2HfIRG7+TNCBgfnw== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1428377261 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.52 X-Barracuda-Spam-Status: No, SCORE=0.52 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, THREAD_INDEX, THREAD_TOPIC, WEIRD_PORT X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17627 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.50 WEIRD_PORT URI: Uses non-standard port number for HTTP Hi Chandana, ----- Original Message ----- > Hello All > I am trying out the ES pmda, and not having much luck. > > The error in the PMCD log says: > [Thu Apr 2 06:20:40] pmcd(2564) Warning: pduread: timeout (after 5.000 sec) Suggests pmdaelasticsearch is blocking for a long time on the initial fetch. If you sighup pmcd after the install, does the situation change on subsequent "pminfo -f elasticsearch"? > $ curl http://localhost:9200/ Does this curl command take a long time to complete? (should be instant) cheers. -- Nathan From nscott@redhat.com Mon Apr 6 22:28:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id BF02029E01 for ; Mon, 6 Apr 2015 22:28:18 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id AD8F58F804C for ; Mon, 6 Apr 2015 20:28:18 -0700 (PDT) X-ASG-Debug-ID: 1428377295-04cbb056b330c00001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id FDPM1FVjMCH3AFl4 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 06 Apr 2015 20:28:15 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t373SC56043497; Mon, 6 Apr 2015 23:28:12 -0400 Date: Mon, 6 Apr 2015 23:28:12 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Renan DelValle , Joseph White Cc: pcp@oss.sgi.com Message-ID: <1292025640.13182460.1428377292321.JavaMail.zimbra@redhat.com> In-Reply-To: References: Subject: Re: [pcp] Installing perfevents on Ubuntu 14.04 MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Installing perfevents on Ubuntu 14.04 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.49.200] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Installing perfevents on Ubuntu 14.04 Thread-Index: 9aU0tHB3AuPO8rZMvNAqtPZLGbXBtw== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1428377295 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17626 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Renan, ----- Original Message ----- > Hi, > > I've installed PCP successfully through the apt package manager, > however, there is no folder "perfevent" inside of /var/lib/pcp/pdmas > > I've tried downloading, compiling, and installing 3.10.3 from github, > but the perfevent folder is still not included in the $PCP_PMDAS_DIR > . You'll need the libpfm4-dev deb installed, otherwise building perfevent is switched off by configure.ac via... AC_CHECK_LIB([pfm], [pfm_get_os_event_encoding], [pfm_libs="-lpfm"], [enable_perfevent=false]) AC_CHECK_HEADERS([perfmon/pfmlib_perf_event.h], [], [enable_perfevent=false]) (Joe, do you want to add packaging for this PMDA in debian/* to help out the punters? See debian/pcp-pmda-infiniband* for an example, as well as the control and rules files below debian/). cheers. -- Nathan From nscott@redhat.com Mon Apr 6 23:37:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 917FC29E01 for ; Mon, 6 Apr 2015 23:37:18 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 1F738AC001 for ; Mon, 6 Apr 2015 21:37:14 -0700 (PDT) X-ASG-Debug-ID: 1428381432-04cbb056b432d40001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id p731HeeDH0fYBzVy (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 06 Apr 2015 21:37:12 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t374bCG2007877 for ; Tue, 7 Apr 2015 00:37:12 -0400 Date: Tue, 7 Apr 2015 00:37:11 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp Message-ID: <1195328272.13197447.1428381431964.JavaMail.zimbra@redhat.com> In-Reply-To: <1199155075.13197280.1428381377648.JavaMail.zimbra@redhat.com> Subject: pcp updates: build, getopts fix MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: build, getopts fix Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.49.200] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: build, getopts fix Thread-Index: afx51oNw1iGA4QgxYFdDnNn7U0ygtw== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1428381432 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17627 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git master Nathan Scott (2): build: spec changelog updates ahead of next release libpcp: fix getopt --hostsfile parsing, add to qa/728 cases Lukas Berk (1): pcp-summary: add directory to src/pcp/GNUMakefile build/rpm/fedora.spec | 3 +++ qa/728 | 5 +++++ qa/728.out | 25 +++++++++++++++++++++++++ src/libpcp/src/getopt.c | 5 +++-- src/pcp/GNUmakefile | 2 +- 5 files changed, 37 insertions(+), 3 deletions(-) From chandana@desilva.id.au Tue Apr 7 00:05:51 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,WEIRD_PORT autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id A3E607F51 for ; Tue, 7 Apr 2015 00:05:51 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 92CDD304032 for ; Mon, 6 Apr 2015 22:05:48 -0700 (PDT) X-ASG-Debug-ID: 1428383145-04cbb056b1338d0001-S8gJnT Received: from relay.mailchannels.net (aso-006-i440.relay.mailchannels.net [23.91.64.121]) by cuda.sgi.com with ESMTP id SGOIOwSXkAHtg5zs for ; Mon, 06 Apr 2015 22:05:46 -0700 (PDT) X-Barracuda-Envelope-From: chandana@desilva.id.au X-Barracuda-Apparent-Source-IP: 23.91.64.121 X-Sender-Id: duocircle|x-authuser|chandana Received: from smtp4.ore.mailhop.org (ip-10-204-4-183.us-west-2.compute.internal [10.204.4.183]) by relay.mailchannels.net (Postfix) with ESMTPA id 5ED8A100597; Tue, 7 Apr 2015 05:05:43 +0000 (UTC) X-Sender-Id: duocircle|x-authuser|chandana Received: from smtp4.ore.mailhop.org (smtp4.ore.mailhop.org [10.21.145.197]) (using TLSv1 with cipher DHE-RSA-AES256-SHA) by 0.0.0.0:2500 (trex/5.4.8); Tue, 07 Apr 2015 05:05:43 +0000 X-MC-Relay: Neutral X-MailChannels-SenderId: duocircle|x-authuser|chandana X-MailChannels-Auth-Id: duocircle X-MC-Loop-Signature: 1428383143466:3073654100 X-MC-Ingress-Time: 1428383143466 Received: from ec2-54-252-74-219.ap-southeast-2.compute.amazonaws.com ([54.252.74.219] helo=mail.desilva.id.au) by smtp4.ore.mailhop.org with esmtpa (Exim 4.82) (envelope-from ) id 1YfLhl-0007P6-DT; Tue, 07 Apr 2015 05:05:41 +0000 Received: from tardis (unknown [175.45.119.98]) by mail.desilva.id.au (Postfix) with ESMTPSA id EC4E622D68; Tue, 7 Apr 2015 05:05:39 +0000 (UTC) X-Mail-Handler: DuoCircle Outbound SMTP X-Originating-IP: 54.252.74.219 X-Report-Abuse-To: abuse@duocircle.com (see https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information for abuse reporting information) X-MHO-User: U2FsdGVkX18lBUroHQbyeK3zC44qtMMfPayUGBCIEV8= Message-ID: <1428383139.24854.1.camel@desilva.id.au> Subject: Re: [pcp] Trying out ElasticSearch PMDA for the first time From: Chandana De Silva X-ASG-Orig-Subj: Re: [pcp] Trying out ElasticSearch PMDA for the first time Reply-To: chandana@desilva.id.au To: Nathan Scott Cc: pcp@oss.sgi.com Date: Tue, 07 Apr 2015 15:05:39 +1000 In-Reply-To: <1446889888.13182385.1428377259368.JavaMail.zimbra@redhat.com> References: <1427957070.8765.30.camel@desilva.id.au> <1446889888.13182385.1428377259368.JavaMail.zimbra@redhat.com> Content-Type: multipart/alternative; boundary="=-JqozyM0Bcp7pvVBu0EkS" X-Mailer: Evolution 3.12.11 (3.12.11-1.fc21) Mime-Version: 1.0 X-AuthUser: chandana X-Barracuda-Connect: aso-006-i440.relay.mailchannels.net[23.91.64.121] X-Barracuda-Start-Time: 1428383145 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.70 X-Barracuda-Spam-Status: No, SCORE=0.70 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA038b, HTML_MESSAGE, WEIRD_PORT X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17628 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.50 WEIRD_PORT URI: Uses non-standard port number for HTTP 0.00 HTML_MESSAGE BODY: HTML included in message 0.20 BSF_SC0_SA038b Custom Rule SA038b --=-JqozyM0Bcp7pvVBu0EkS Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit Hello Nathan, Thanks for replying, and Happy Easter! SIGHUP did not help, and the http query to localhost:9020 returns instantly Chandana On Mon, 2015-04-06 at 23:27 -0400, Nathan Scott wrote: > Hi Chandana, > > ----- Original Message ----- > > Hello All > > I am trying out the ES pmda, and not having much luck. > > > > The error in the PMCD log says: > > [Thu Apr 2 06:20:40] pmcd(2564) Warning: pduread: timeout (after 5.000 sec) > > Suggests pmdaelasticsearch is blocking for a long time on the initial fetch. > If you sighup pmcd after the install, does the situation change on subsequent > "pminfo -f elasticsearch"? > > > $ curl http://localhost:9200/ > > Does this curl command take a long time to complete? (should be instant) > > cheers. > > -- > Nathan --=-JqozyM0Bcp7pvVBu0EkS Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: 7bit Hello Nathan,
Thanks for replying, and Happy Easter!

SIGHUP did not help, and the http query to localhost:9020 returns instantly

Chandana

On Mon, 2015-04-06 at 23:27 -0400, Nathan Scott wrote: 
Hi Chandana,

----- Original Message -----
> Hello All
> I am trying out the ES pmda, and not having much luck.
> 
> The error in the PMCD log says:
> [Thu Apr 2 06:20:40] pmcd(2564) Warning: pduread: timeout (after 5.000 sec)

Suggests pmdaelasticsearch is blocking for a long time on the initial fetch.
If you sighup pmcd after the install, does the situation change on subsequent
"pminfo -f elasticsearch"?

> $ curl http://localhost:9200/

Does this curl command take a long time to complete?  (should be instant)

cheers.

--
Nathan
--=-JqozyM0Bcp7pvVBu0EkS-- From myllynen@redhat.com Tue Apr 7 03:26:47 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id ED4127F63 for ; Tue, 7 Apr 2015 03:26:46 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 585FCAC003 for ; Tue, 7 Apr 2015 01:26:46 -0700 (PDT) X-ASG-Debug-ID: 1428395204-04cb6c1cc7452f0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id qKMdlY9lqvyaLBcS (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 07 Apr 2015 01:26:45 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (Postfix) with ESMTPS id 60043A10D9 for ; Tue, 7 Apr 2015 08:26:44 +0000 (UTC) Received: from mmyllyne.csb (vpn1-5-150.ams2.redhat.com [10.36.5.150]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t378QhGj017133 for ; Tue, 7 Apr 2015 04:26:43 -0400 Message-ID: <552394C2.3010008@redhat.com> Date: Tue, 07 Apr 2015 11:26:42 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: pcp developers Subject: [PATCH] ds389/ds389log: simplify metrics data structure Content-Type: text/plain; charset=UTF-8 X-ASG-Orig-Subj: [PATCH] ds389/ds389log: simplify metrics data structure Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1428395205 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Fixes a pasto/braino. --- src/pmdas/ds389/pmdads389.pl | 6 ++---- src/pmdas/ds389log/pmdads389log.pl | 13 +++++-------- 2 files changed, 7 insertions(+), 12 deletions(-) diff --git a/src/pmdas/ds389/pmdads389.pl b/src/pmdas/ds389/pmdads389.pl index c4ecec5..901cc8d 100644 --- a/src/pmdas/ds389/pmdads389.pl +++ b/src/pmdas/ds389/pmdads389.pl @@ -66,7 +66,6 @@ sub ds389_process_entry { my $currtime; foreach my $attr ($entry->attributes) { - my @metric; my $value = $entry->get_value($attr); if ($attr eq 'currenttime') { @@ -80,8 +79,7 @@ sub ds389_process_entry { $attr = 'uptime'; } - @metric = ('ds389.' . $prefix . $attr, $value); - $metrics{$metric[0]} = \@metric; + $metrics{'ds389.' . $prefix . $attr} = $value; } } @@ -131,7 +129,7 @@ sub ds389_fetch_callback { if (!defined($value)) { return (PM_ERR_APPVERSION, 0); } - return ($value->[1], 1); + return ($value, 1); } $pmda = PCP::PMDA->new('ds389', 130); diff --git a/src/pmdas/ds389log/pmdads389log.pl b/src/pmdas/ds389log/pmdads389log.pl index dcea107..890a5ed 100644 --- a/src/pmdas/ds389log/pmdads389log.pl +++ b/src/pmdas/ds389log/pmdads389log.pl @@ -106,7 +106,6 @@ sub ds389log_fetch { my $errors = 0; # combined foreach my $line (@stats) { my $key; - my @metric; if ($line =~ /^.*:/ || $line =~ /^U1/ || $line =~ /^B1/) { $key = $&; @@ -132,14 +131,13 @@ sub ds389log_fetch { my $id = 'ds389log.' . $data{$key}[1] . '.' . $data{$key}[0]; if ($data{$key}[4] eq 1) { - my $prev = $metrics{$id}[1]; + my $prev = $metrics{$id}; $value = $prev if $prev > $value; } else { - $value = $metrics{$id}[1] + $value; + $value = $metrics{$id} + $value; } - @metric = ($id , $value); - $metrics{$id} = \@metric; + $metrics{$id} = $value; } } } @@ -155,7 +153,7 @@ sub ds389log_fetch_callback { if (!defined($value)) { return (PM_ERR_APPVERSION, 0); } - return ($value->[1], 1); + return ($value, 1); } $pmda = PCP::PMDA->new('ds389log', 131); @@ -167,8 +165,7 @@ foreach my $key (keys %data) { PM_TYPE_U32, PM_INDOM_NULL, PM_SEM_COUNTER, pmda_units(0,0,1,0,0,PM_COUNT_ONE), $name, '', ''); - my @value = ($name, 0); - $metrics{$name} = \@value; + $metrics{$name} = 0; } $pmda->set_refresh(\&ds389log_fetch); -- 1.7.1 From nscott@redhat.com Tue Apr 7 17:39:39 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 7AD207F7E for ; Tue, 7 Apr 2015 17:39:39 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 693698F8073 for ; Tue, 7 Apr 2015 15:39:36 -0700 (PDT) X-ASG-Debug-ID: 1428446370-04cb6c1cc86ed20001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id ex6Mz7e3d3ZwSToq (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 07 Apr 2015 15:39:31 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t37MdT6N024771; Tue, 7 Apr 2015 18:39:29 -0400 Date: Tue, 7 Apr 2015 18:39:28 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: chandana@desilva.id.au Cc: pcp@oss.sgi.com Message-ID: <882410516.13878102.1428446368567.JavaMail.zimbra@redhat.com> In-Reply-To: <1428383139.24854.1.camel@desilva.id.au> References: <1427957070.8765.30.camel@desilva.id.au> <1446889888.13182385.1428377259368.JavaMail.zimbra@redhat.com> <1428383139.24854.1.camel@desilva.id.au> Subject: Re: [pcp] Trying out ElasticSearch PMDA for the first time MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Trying out ElasticSearch PMDA for the first time Content-Type: multipart/mixed; boundary="----=_Part_13878100_1133094691.1428446368565" X-Originating-IP: [10.64.50.1] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Trying out ElasticSearch PMDA for the first time Thread-Index: b2daDVgEOCFQGsAHWSAsQ5Je+n8U+w== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1428446371 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17651 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header ------=_Part_13878100_1133094691.1428446368565 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit ----- Original Message ----- > Hello Nathan, > Thanks for replying, and Happy Easter! > No problem, and thanks! > SIGHUP did not help, and the http query to localhost:9020 returns > instantly Hmm. So, the PMDA is supposed to be doing simple http requests just like your curl. We'll need to figure out where that big latency is coming from - can you try the attached patch and see what extra info appears in the log? This should help us trace it back to a specific query. It also adds in use of Kens recent more-rapid-er pmcd connection API, so we should certainly see some kind of behaviour change here - with any luck, for the better. :) (but it wont fix the underlying issue; need the extra elasticsearch.log diagnostics to discover which query is slow - assuming it is one of the http queries) cheers. -- Nathan ------=_Part_13878100_1133094691.1428446368565 Content-Type: text/x-patch; name=es.patch Content-Disposition: attachment; filename=es.patch Content-Transfer-Encoding: base64 ZGlmZiAtLWdpdCBhL3NyYy9wbWRhcy9lbGFzdGljc2VhcmNoL3BtZGFlbGFzdGljc2VhcmNoLnBs IGIvc3JjL3BtZGFzL2VsYXN0aWNzZWFyY2gvcG1kYWVsYXN0aWNzZWFyY2gucGwKaW5kZXggZTky NmIxOC4uZWRmYTkyMSAxMDA3NTUKLS0tIGEvc3JjL3BtZGFzL2VsYXN0aWNzZWFyY2gvcG1kYWVs YXN0aWNzZWFyY2gucGwKKysrIGIvc3JjL3BtZGFzL2VsYXN0aWNzZWFyY2gvcG1kYWVsYXN0aWNz ZWFyY2gucGwKQEAgLTQ5LDcgKzQ5LDEyIEBAICRodHRwLT50aW1lb3V0KCRodHRwX3RpbWVvdXQp OwkjIGlmIGVsYXN0aWNzZWFyY2ggbm90IHRpbWVseSwgbm8gc291cCBmb3IgeW91CiAjIGh0dHAg R0VUIG9mIGVsYXN0aWNzZWFyY2gganNvbiBmcm9tIGEgZ2l2ZW4gdXJsCiBzdWIgZXNfYWdlbnRf Z2V0CiB7Ci0gICAgbXkgJHJlc3BvbnNlID0gJGh0dHAtPmdldChzaGlmdCk7CisgICAgbXkgJHJl cXVlc3QgPSBzaGlmdDsKKworICAgICRwbWRhLT5sb2coImVzX2FnZW50X2dldDogJHJlcXVlc3Qi KTsKKyAgICBteSAkcmVzcG9uc2UgPSAkaHR0cC0+Z2V0KCRyZXF1ZXN0KTsKKyAgICAkcG1kYS0+ bG9nKCJlc19hZ2VudF9nZXQgc3VjY2VzczogJHJlc3BvbnNlLT5pc19zdWNjZXNzIik7CisKICAg ICByZXR1cm4gdW5kZWYgdW5sZXNzICRyZXNwb25zZS0+aXNfc3VjY2VzczsKICAgICByZXR1cm4g JHJlc3BvbnNlLT5kZWNvZGVkX2NvbnRlbnQ7CiB9CkBAIC0zNjksNiArMzc0LDcgQEAgc3ViIGVz X2ZldGNoX2NhbGxiYWNrCiB9CiAKICRwbWRhID0gUENQOjpQTURBLT5uZXcoJ2VsYXN0aWNzZWFy Y2gnLCAxMDgpOworJHBtZGEtPmNvbm5lY3RfcG1jZDsKIAogIyBjbHVzdGVyIHN0YXRzCiAkcG1k YS0+YWRkX21ldHJpYyhwbWRhX3BtaWQoMCwwKSwgUE1fVFlQRV9TVFJJTkcsIFBNX0lORE9NX05V TEwsCg== ------=_Part_13878100_1133094691.1428446368565-- From psmith@aconex.com Tue Apr 7 18:22:06 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 0FD0A7F7E for ; Tue, 7 Apr 2015 18:22:06 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id E3A8C304071 for ; Tue, 7 Apr 2015 16:22:02 -0700 (PDT) X-ASG-Debug-ID: 1428448918-04cbb056b185910001-S8gJnT Received: from postoffice2.aconex.com (mail.aconex.com [175.45.105.35]) by cuda.sgi.com with ESMTP id hADBH8bQA3j3HkAr for ; Tue, 07 Apr 2015 16:21:59 -0700 (PDT) X-Barracuda-Envelope-From: psmith@aconex.com X-Barracuda-Apparent-Source-IP: 175.45.105.35 Received: from postoffice.aconex.com (postoffice.yarra.acx [192.168.35.100]) by postoffice2.aconex.com with ESMTP id sWH6ZE3dxjSAWIMD; Wed, 08 Apr 2015 09:21:56 +1000 (EST) Received: from gatekeeper.aconex.com (gatekeeper.yarra.acx [192.168.35.102]) by postoffice.aconex.com (Postfix) with ESMTP id D21AC3CE009F; Wed, 8 Apr 2015 09:21:56 +1000 (EST) Received: from localhost (localhost.localdomain [127.0.0.1]) by gatekeeper.aconex.com (Postfix) with ESMTP id CAFE0243A9B5; Wed, 8 Apr 2015 09:21:56 +1000 (EST) Received: from gatekeeper.aconex.com ([127.0.0.1]) by localhost (gatekeeper.aconex.com [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id RNHKWDgNzzgd; Wed, 8 Apr 2015 09:21:55 +1000 (EST) Received: from localhost (localhost.localdomain [127.0.0.1]) by gatekeeper.aconex.com (Postfix) with ESMTP id AAFEC243A9EB; Wed, 8 Apr 2015 09:21:55 +1000 (EST) X-Virus-Scanned: amavisd-new at aconex.com Received: from gatekeeper.aconex.com ([127.0.0.1]) by localhost (gatekeeper.aconex.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id aVOh0eA4CI9X; Wed, 8 Apr 2015 09:21:55 +1000 (EST) Received: from paul.engr.acx (paul.engr.acx [192.168.7.130]) by gatekeeper.aconex.com (Postfix) with ESMTPSA id 87033243A999; Wed, 8 Apr 2015 09:21:55 +1000 (EST) Content-Type: multipart/alternative; boundary="Apple-Mail=_D244B360-3C3D-41F8-A2A4-54FD3216C84F" Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2070.6\)) Subject: Re: [pcp] Trying out ElasticSearch PMDA for the first time From: Paul Smith X-ASG-Orig-Subj: Re: [pcp] Trying out ElasticSearch PMDA for the first time In-Reply-To: <882410516.13878102.1428446368567.JavaMail.zimbra@redhat.com> Date: Wed, 8 Apr 2015 09:21:58 +1000 Cc: chandana@desilva.id.au, pcp@oss.sgi.com Message-Id: References: <1427957070.8765.30.camel@desilva.id.au> <1446889888.13182385.1428377259368.JavaMail.zimbra@redhat.com> <1428383139.24854.1.camel@desilva.id.au> <882410516.13878102.1428446368567.JavaMail.zimbra@redhat.com> To: Nathan Scott X-Mailer: Apple Mail (2.2070.6) X-Virus-Scanned: by bsmtpd at aconex.com X-Barracuda-Connect: mail.aconex.com[175.45.105.35] X-Barracuda-Start-Time: 1428448918 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17653 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 HTML_MESSAGE BODY: HTML included in message --Apple-Mail=_D244B360-3C3D-41F8-A2A4-54FD3216C84F Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi, almost certain the current PMDA won't work with the later version of = ES. The PMDA currently works with 0.19 and 0.20 I think of ES, but that = is so ancient now, I suspect many of the URL endpoints are gone or = different. The 'good' news is that the current version of ES has a very nice simple = _cat API (see [1]) that would be a more useful (and simpler to parse) = basis for a newer PMDA. The bad news, we ain't using the new version = yet so not currently able to upgrade the PMDA, so hoping for some = community support there..=20 cheers, Paul [1] = http://www.elastic.co/guide/en/elasticsearch/reference/current/cat.html = > On 8 Apr 2015, at 8:39 am, Nathan Scott wrote: >=20 >=20 >=20 > ----- Original Message ----- >> Hello Nathan, >> Thanks for replying, and Happy Easter! >>=20 >=20 > No problem, and thanks! >=20 >> SIGHUP did not help, and the http query to localhost:9020 returns >> instantly >=20 > Hmm. So, the PMDA is supposed to be doing simple http requests just > like your curl. We'll need to figure out where that big latency is > coming from - can you try the attached patch and see what extra info > appears in the log? This should help us trace it back to a specific > query. >=20 > It also adds in use of Kens recent more-rapid-er pmcd connection API, > so we should certainly see some kind of behaviour change here - with > any luck, for the better. :) (but it wont fix the underlying issue; > need the extra elasticsearch.log diagnostics to discover which query > is slow - assuming it is one of the http queries) >=20 > cheers. >=20 > -- > Nathan > _______________________________________________ > pcp mailing list > pcp@oss.sgi.com > http://oss.sgi.com/mailman/listinfo/pcp --Apple-Mail=_D244B360-3C3D-41F8-A2A4-54FD3216C84F Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii Hi, almost certain the current PMDA won't work with the later = version of ES. The PMDA currently works with 0.19 and 0.20 I think of = ES, but that is so ancient now, I suspect many of the URL endpoints are = gone or different.

The= 'good' news is that the current version of ES has a very nice simple = _cat API (see [1]) that would be a more useful (and simpler to parse) = basis for a newer PMDA.  The bad news, we ain't using the new = version yet so not currently able to upgrade the PMDA, so hoping for = some community support there.. 

cheers,

Paul

[1] http://www.elastic.co/guide/en/elasticsearch/reference/current/= cat.html

On 8 Apr 2015, at 8:39 am, = Nathan Scott <nathans@redhat.com> wrote:



----- Original Message -----
Hello Nathan,
Thanks for = replying, and Happy Easter!


No problem, and thanks!

SIGHUP did not help, and = the http query to localhost:9020 returns
instantly

Hmm.  So, the PMDA is = supposed to be doing simple http requests just
like your = curl.  We'll need to figure out where that big latency is
coming from - can you try the attached patch and see what = extra info
appears in the log?  This should help us = trace it back to a specific
query.

It also adds in use of Kens recent more-rapid-er pmcd = connection API,
so we should certainly see some kind of = behaviour change here - with
any luck, for the better. :) =  (but it wont fix the underlying issue;
need the = extra elasticsearch.log diagnostics to discover which query
is slow - assuming it is one of the http queries)

cheers.

--
Nathan
<es.patch>___= ____________________________________________
pcp mailing = list
pcp@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/pcp

= --Apple-Mail=_D244B360-3C3D-41F8-A2A4-54FD3216C84F-- From nscott@redhat.com Tue Apr 7 18:32:28 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 963E17F7E for ; Tue, 7 Apr 2015 18:32:28 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 41243AC002 for ; Tue, 7 Apr 2015 16:32:24 -0700 (PDT) X-ASG-Debug-ID: 1428449540-04bdf0632284be0001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id DLsrO1TkUdnBGXzu (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 07 Apr 2015 16:32:20 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t37NWGUo013257; Tue, 7 Apr 2015 19:32:16 -0400 Date: Tue, 7 Apr 2015 19:32:16 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Paul Smith , chandana@desilva.id.au Cc: pcp@oss.sgi.com Message-ID: <211702903.13890461.1428449536086.JavaMail.zimbra@redhat.com> In-Reply-To: References: <1427957070.8765.30.camel@desilva.id.au> <1446889888.13182385.1428377259368.JavaMail.zimbra@redhat.com> <1428383139.24854.1.camel@desilva.id.au> <882410516.13878102.1428446368567.JavaMail.zimbra@redhat.com> Subject: Re: [pcp] Trying out ElasticSearch PMDA for the first time MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Trying out ElasticSearch PMDA for the first time Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.1] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Trying out ElasticSearch PMDA for the first time Thread-Index: cFl7XhDDIakLQgoZ09xatn3yP7xN1g== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1428449540 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17653 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > Hi, almost certain the current PMDA won't work with the later version of ES. > The PMDA currently works with 0.19 and 0.20 I think of ES, but that is so > ancient now, I suspect many of the URL endpoints are gone or different. Mkay, thanks Paul. > The 'good' news is that the current version of ES has a very nice simple _cat > API (see [1]) that would be a more useful (and simpler to parse) basis for a > newer PMDA. The bad news, we ain't using the new version yet so not > currently able to upgrade the PMDA, so hoping for some community support > there.. OK. I guess we should continue to debug a bit further here, find the failing GETs (not clear why they dont fail immediately if theres no endpoint) and add some version/sanity checking into the PMDA to fail gracefully for ES versions without the supported functionality. cheers. -- Nathan From chandana@desilva.id.au Tue Apr 7 20:28:58 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id CDEEE7F7E for ; Tue, 7 Apr 2015 20:28:58 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 908578F8089 for ; Tue, 7 Apr 2015 18:28:55 -0700 (PDT) X-ASG-Debug-ID: 1428456529-04bdf063209e7a0001-S8gJnT Received: from relay.mailchannels.net (nov-007-i574.relay.mailchannels.net [46.232.183.128]) by cuda.sgi.com with ESMTP id zlAdwuB8960zQO1B for ; Tue, 07 Apr 2015 18:28:51 -0700 (PDT) X-Barracuda-Envelope-From: chandana@desilva.id.au X-Barracuda-Apparent-Source-IP: 46.232.183.128 X-Sender-Id: duocircle|x-authuser|chandana Received: from smtp3.ore.mailhop.org (ip-10-229-11-165.us-west-2.compute.internal [10.229.11.165]) by relay.mailchannels.net (Postfix) with ESMTPA id E639F600E6; Wed, 8 Apr 2015 01:28:46 +0000 (UTC) X-Sender-Id: duocircle|x-authuser|chandana Received: from smtp3.ore.mailhop.org (smtp3.ore.mailhop.org [10.45.8.167]) (using TLSv1 with cipher DHE-RSA-AES256-SHA) by 0.0.0.0:2500 (trex/5.4.8); Wed, 08 Apr 2015 01:28:47 +0000 X-MC-Relay: Neutral X-MailChannels-SenderId: duocircle|x-authuser|chandana X-MailChannels-Auth-Id: duocircle X-MC-Loop-Signature: 1428456527030:546730615 X-MC-Ingress-Time: 1428456527029 Received: from ec2-54-252-74-219.ap-southeast-2.compute.amazonaws.com ([54.252.74.219] helo=mail.desilva.id.au) by smtp3.ore.mailhop.org with esmtpa (Exim 4.82) (envelope-from ) id 1YfenN-0003YI-Ls; Wed, 08 Apr 2015 01:28:46 +0000 Received: from tardis (unknown [175.45.119.98]) by mail.desilva.id.au (Postfix) with ESMTPSA id 11CCD27EFC; Wed, 8 Apr 2015 01:28:44 +0000 (UTC) X-Mail-Handler: DuoCircle Outbound SMTP X-Originating-IP: 54.252.74.219 X-Report-Abuse-To: abuse@duocircle.com (see https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information for abuse reporting information) X-MHO-User: U2FsdGVkX18DFlf4ZTLYhoU0hKTbOJHLc4HdIylH97U= Message-ID: <1428456523.6304.35.camel@desilva.id.au> Subject: Re: [pcp] Trying out ElasticSearch PMDA for the first time From: Chandana De Silva X-ASG-Orig-Subj: Re: [pcp] Trying out ElasticSearch PMDA for the first time Reply-To: chandana@desilva.id.au To: Nathan Scott Cc: Paul Smith , pcp@oss.sgi.com Date: Wed, 08 Apr 2015 11:28:43 +1000 In-Reply-To: <211702903.13890461.1428449536086.JavaMail.zimbra@redhat.com> References: <1427957070.8765.30.camel@desilva.id.au> <1446889888.13182385.1428377259368.JavaMail.zimbra@redhat.com> <1428383139.24854.1.camel@desilva.id.au> <882410516.13878102.1428446368567.JavaMail.zimbra@redhat.com> <211702903.13890461.1428449536086.JavaMail.zimbra@redhat.com> Content-Type: multipart/alternative; boundary="=-4FBbDoAgpSJ7IEcAMhdB" X-Mailer: Evolution 3.12.11 (3.12.11-1.fc21) Mime-Version: 1.0 X-AuthUser: chandana X-Barracuda-Connect: nov-007-i574.relay.mailchannels.net[46.232.183.128] X-Barracuda-Start-Time: 1428456529 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17657 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 HTML_MESSAGE BODY: HTML included in message --=-4FBbDoAgpSJ7IEcAMhdB Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit Nathan and Paul, Many thanks and the cat api looks very nice. It will even help us work out some performance issues ( > 300k events per minute). I will try and look through the PMDA and work out which of the GET's are failing, looking at the pminfo output it seems all of them are. So it is possible that they have been removed from the API, as Paul says. I will try and locate the GET API doc. Paul if you know it off the top of your head, let me know Chandana On Tue, 2015-04-07 at 19:32 -0400, Nathan Scott wrote: > > ----- Original Message ----- > > Hi, almost certain the current PMDA won't work with the later version of ES. > > The PMDA currently works with 0.19 and 0.20 I think of ES, but that is so > > ancient now, I suspect many of the URL endpoints are gone or different. > > Mkay, thanks Paul. > > > The 'good' news is that the current version of ES has a very nice simple _cat > > API (see [1]) that would be a more useful (and simpler to parse) basis for a > > newer PMDA. The bad news, we ain't using the new version yet so not > > currently able to upgrade the PMDA, so hoping for some community support > > there.. > > OK. I guess we should continue to debug a bit further here, find the failing > GETs (not clear why they dont fail immediately if theres no endpoint) and add > some version/sanity checking into the PMDA to fail gracefully for ES versions > without the supported functionality. > > cheers. > > -- > Nathan --=-4FBbDoAgpSJ7IEcAMhdB Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: 7bit Nathan and Paul,

Many thanks and the cat api looks very nice. It will even help us work out some performance issues ( > 300k events per minute).

I will try and look through the PMDA and work out which of the GET's are failing, looking at the pminfo output it seems all of them are. So it is possible that they have been removed from the API, as Paul says.

I will try and locate the GET API doc. Paul if you know it off the top of your head, let me know

Chandana

On Tue, 2015-04-07 at 19:32 -0400, Nathan Scott wrote: 

----- Original Message -----
> Hi, almost certain the current PMDA won't work with the later version of ES.
> The PMDA currently works with 0.19 and 0.20 I think of ES, but that is so
> ancient now, I suspect many of the URL endpoints are gone or different.

Mkay, thanks Paul.

> The 'good' news is that the current version of ES has a very nice simple _cat
> API (see [1]) that would be a more useful (and simpler to parse) basis for a
> newer PMDA.  The bad news, we ain't using the new version yet so not
> currently able to upgrade the PMDA, so hoping for some community support
> there..

OK.  I guess we should continue to debug a bit further here, find the failing
GETs (not clear why they dont fail immediately if theres no endpoint) and add
some version/sanity checking into the PMDA to fail gracefully for ES versions
without the supported functionality.

cheers.

--
Nathan
--=-4FBbDoAgpSJ7IEcAMhdB-- From fche@redhat.com Tue Apr 7 20:50:25 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id C755B7F7E for ; Tue, 7 Apr 2015 20:50:25 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 5123FAC003 for ; Tue, 7 Apr 2015 18:50:22 -0700 (PDT) X-ASG-Debug-ID: 1428457820-04cb6c1cc785350001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 1HxzcHdzaZKjFEIJ (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 07 Apr 2015 18:50:21 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t381oFpB015025 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Tue, 7 Apr 2015 21:50:16 -0400 Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t381oEMj015306; Tue, 7 Apr 2015 21:50:15 -0400 Received: by fche.csb (Postfix, from userid 2569) id 86C2B5869E; Tue, 7 Apr 2015 21:50:12 -0400 (EDT) To: Paul Smith Cc: Nathan Scott , pcp@oss.sgi.com, chandana@desilva.id.au Subject: Re: Trying out ElasticSearch PMDA for the first time References: <1427957070.8765.30.camel@desilva.id.au> <1446889888.13182385.1428377259368.JavaMail.zimbra@redhat.com> <1428383139.24854.1.camel@desilva.id.au> <882410516.13878102.1428446368567.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: Trying out ElasticSearch PMDA for the first time From: fche@redhat.com (Frank Ch. Eigler) Date: Tue, 07 Apr 2015 21:50:12 -0400 In-Reply-To: (Paul Smith's message of "Wed, 8 Apr 2015 09:21:58 +1000") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1428457821 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Paul Smith writes: > Hi, almost certain the current PMDA won't work with the later > version of ES. [...] While there appears to exist no pcpqa for this pmda, this episode is another example of why pcp/pmda testing against real live host software should be considered the gold standard (so we can notice obsolescence or incompatibility), rather than synthetic/snapshotted artifacts (which can give false assurance). > The 'good' news is that the current version of ES has a very nice > simple _cat API (see [1]) [...] See also dsmith/dev's json pmda. It may take even less work to write some json-metadata for the interesting-version elasticsearch json stats, than to update|rewrite the old elasticsearch pmda. - FChE From rdelval1@binghamton.edu Tue Apr 7 21:12:34 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 9C4447F78 for ; Tue, 7 Apr 2015 21:12:34 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 392D0AC003 for ; Tue, 7 Apr 2015 19:12:30 -0700 (PDT) X-ASG-Debug-ID: 1428459147-04bdf063219f890001-S8gJnT Received: from mail-ob0-f169.google.com (mail-ob0-f169.google.com [209.85.214.169]) by cuda.sgi.com with ESMTP id mi8F5X9q076bKl2t (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Tue, 07 Apr 2015 19:12:27 -0700 (PDT) X-Barracuda-Envelope-From: rdelval1@binghamton.edu X-Barracuda-Apparent-Source-IP: 209.85.214.169 Received: by obbgh1 with SMTP id gh1so113045523obb.1 for ; Tue, 07 Apr 2015 19:12:27 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-type; bh=Mynx0DJj2FJKeQtxS3nyKLzCZ7tUlTWGNzfaXCWqyZQ=; b=VZnJ19IZbtPS45b6qNBYa774XMaHVjXoyebr02/YZCL0txZowHjB8094WZewBwUONp UTa6cTWgOt37nLCaq7W+kIbvUHQ7dT8DN8EWBNJl3xNAIUqeTrw384VMUjaIxltcqYRn QiPeopydYk1UsJ54lGdM+/LT0i4SHg++p8l+kS7ayjwniXRuOSZpcFRUNeRXwzzlW4SL WYTQiJbGzNUcO+gOCh9V5Htvuf4zQQZQOoqWBJfhMtD3vyMFDoJDKEVzLy+F3E1YHT7n 2BIuWPjUeBYml7qXsdAfVd+iFLS6M3EWONiy7kiHW9Eosc179NYI5Y5MfogKZyMzRbqa TZ7Q== X-Gm-Message-State: ALoCoQk8Ujtk9NRrbry7PadrHpJmFurWJDJqGnbneiYlbjzzuC3O5oVcqXC9F/g7wsbZuuSUURA3 X-Received: by 10.182.33.98 with SMTP id q2mr29261139obi.79.1428459146978; Tue, 07 Apr 2015 19:12:26 -0700 (PDT) MIME-Version: 1.0 Received: by 10.202.111.1 with HTTP; Tue, 7 Apr 2015 19:12:06 -0700 (PDT) In-Reply-To: <1292025640.13182460.1428377292321.JavaMail.zimbra@redhat.com> References: <1292025640.13182460.1428377292321.JavaMail.zimbra@redhat.com> From: Renan DelValle Date: Tue, 7 Apr 2015 22:12:06 -0400 Message-ID: Subject: Re: [pcp] Installing perfevents on Ubuntu 14.04 To: Nathan Scott X-ASG-Orig-Subj: Re: [pcp] Installing perfevents on Ubuntu 14.04 Cc: Joseph White , pcp@oss.sgi.com, Madhusudhan Govindaraju , Jessica L Hartog Content-Type: text/plain; charset=UTF-8 X-Barracuda-Connect: mail-ob0-f169.google.com[209.85.214.169] X-Barracuda-Start-Time: 1428459147 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17657 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi Nathan, Thanks for the reply. I was able to get in touch with Joe White a day or two ago and he told me to do the same thing which allowed me to at least install it. Since the version of PCP in the Ubuntu 14.04 repository is an earlier version that did not include perfevent I had to install from source. So now the next biggest hurdle is the fact that the servers CPUs we have are Haswell-EP based. Although the newest libpfm4 supports Haswell-EP, unfortunately, the linux kernel (even the mainline) doesn't detect this processor model (63) as having RAPL support. Thus to get the intel_rapl module in the kernel to detect that the Haswell-EP support, one has to modify the kernel and recompile it to support the processor model, otherwise perf events for RAPL will not be activated. To complicate things a bit more, Intel changed some things about RAPL for Haswell. They removed the ability to get energy per core (https://software.intel.com/fr-fr/forums/topic/542271) and have set unit of measurements for some domains to be static (https://software.intel.com/en-us/forums/topic/535025). Jacob Pan has submitted a patch for the latter which has made it into the mainline kernel. (https://lkml.org/lkml/2015/3/20/582) Hopefully this helps someone else trying to get PCP to work with Haswell-EP server processors. -Renan On Mon, Apr 6, 2015 at 11:28 PM, Nathan Scott wrote: > Hi Renan, > > ----- Original Message ----- >> Hi, >> >> I've installed PCP successfully through the apt package manager, >> however, there is no folder "perfevent" inside of /var/lib/pcp/pdmas >> >> I've tried downloading, compiling, and installing 3.10.3 from github, >> but the perfevent folder is still not included in the $PCP_PMDAS_DIR >> . > > You'll need the libpfm4-dev deb installed, otherwise building perfevent > is switched off by configure.ac via... > > AC_CHECK_LIB([pfm], [pfm_get_os_event_encoding], > [pfm_libs="-lpfm"], > [enable_perfevent=false]) > AC_CHECK_HEADERS([perfmon/pfmlib_perf_event.h], [], [enable_perfevent=false]) > > > (Joe, do you want to add packaging for this PMDA in debian/* to help out > the punters? See debian/pcp-pmda-infiniband* for an example, as well as > the control and rules files below debian/). > > cheers. > > -- > Nathan From nscott@redhat.com Tue Apr 7 23:47:22 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 24FA47F87 for ; Tue, 7 Apr 2015 23:47:22 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 057F88F8070 for ; Tue, 7 Apr 2015 21:47:21 -0700 (PDT) X-ASG-Debug-ID: 1428468436-04bdf06322a6b50001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id zbIEkIdoB6VAKoDK (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 07 Apr 2015 21:47:17 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t384lDC5018729; Wed, 8 Apr 2015 00:47:13 -0400 Date: Wed, 8 Apr 2015 00:47:13 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Renan DelValle Cc: Joseph White , pcp@oss.sgi.com, Madhusudhan Govindaraju , Jessica L Hartog Message-ID: <1323886042.14045793.1428468433248.JavaMail.zimbra@redhat.com> In-Reply-To: References: <1292025640.13182460.1428377292321.JavaMail.zimbra@redhat.com> Subject: Re: [pcp] Installing perfevents on Ubuntu 14.04 MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Installing perfevents on Ubuntu 14.04 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.1] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Installing perfevents on Ubuntu 14.04 Thread-Index: lQnK0NgFNCaBHoOcrbxb06p8XjgkbA== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1428468436 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17662 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > [...] > Hopefully this helps someone else trying to get PCP to work with > Haswell-EP server processors. Interesting stuff - thanks for sharing the details Renan. cheers. -- Nathan From kenj@internode.on.net Wed Apr 8 00:14:49 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id BD8447F88 for ; Wed, 8 Apr 2015 00:14:49 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 58FD7AC003 for ; Tue, 7 Apr 2015 22:14:46 -0700 (PDT) X-ASG-Debug-ID: 1428470082-04bdf06322a72d0001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id mzRmhbKxSto4G4D8 for ; Tue, 07 Apr 2015 22:14:43 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DoAQB6uCRVPKEh0XYNT4NaXIMVgy2/BogDAQEBAQEBBwEBAQE4hQNVMAYCBRYLAgsDAgECATEOGQYCAQG8MnCXFYEhjyOCUoFFBYYejk6aaoQjXYJDAQEB Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 08 Apr 2015 14:44:41 +0930 Message-ID: <5524B9D4.4080708@internode.on.net> Date: Wed, 08 Apr 2015 15:17:08 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1428470082 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17662 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp master Ken McDonell (5): libpcp/interp.c: refactoring libpcp/interp.c: small changes qa/group: add 907 to the pmdumplog group pmdumplog: new options and new log reading logic qa/135: add some diagnostic output to 135.full man/man1/pmdumplog.1 | 32 ++++++++- qa/135 | 13 +++ qa/177 | 2 qa/177.out | 2 qa/180.out.1 | 2 qa/180.out.2 | 2 qa/180.out.3 | 2 qa/787 | 29 +++++--- qa/787.out | 6 - qa/921 | 71 ++++++++++++++++++++ qa/921.out | 60 +++++++++++++++++ qa/group | 3 src/libpcp/src/interp.c | 162 ++++++++++++++++++++++++++++------------------ src/pmdumplog/pmdumplog.c | 95 ++++++++++++++++++++++---- 14 files changed, 381 insertions(+), 100 deletions(-) Details ... commit 739476fe1e98692cc420ac623a30a5cced159ec0 Author: Ken McDonell Date: Wed Apr 8 15:14:17 2015 +1000 qa/135: add some diagnostic output to 135.full commit 6dffb718b2e8866a4a6625a02c0accb12817eabb Author: Ken McDonell Date: Wed Apr 8 14:50:58 2015 +1000 pmdumplog: new options and new log reading logic New options -M (force mark records to be reported) and -xx (report timestamps as offset in seconds from the start of the archive). But the more substantive change is to replace calls to pmFetch() and pmFetchArchive() with calls to __pmLogFetch() ... the lower level interface gives us a better chance of seeing what's really in the archive. commit 329e6a5b9a1512d65a45653461b0efa4f01ebee0 Author: Ken McDonell Date: Wed Apr 8 09:35:37 2015 +1000 qa/group: add 907 to the pmdumplog group commit 4fba8abcc018f5cfd72f94658b07140766bee029 Author: Ken McDonell Date: Mon Apr 6 07:09:28 2015 +1000 libpcp/interp.c: small changes - reworked the handling of "undefined" values for the prior and next regions before they have been searched - provided some small performance improvements (and so QA output changes) - returned values remain the same commit c7b3d77a57e204cd71fab25747791669db7df710 Author: Ken McDonell Date: Fri Apr 3 07:15:13 2015 +1100 libpcp/interp.c: refactoring Trying to improve the readability of the code without changing the logic or functionality. This is in preparation for another round of effort to improve performance when interpolating corner-case archives (especially ones with lots of records and sparse logging of some metrics). From kenj@internode.on.net Wed Apr 8 00:20:07 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id E243D7F88 for ; Wed, 8 Apr 2015 00:20:07 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id D12098F8049 for ; Tue, 7 Apr 2015 22:20:04 -0700 (PDT) X-ASG-Debug-ID: 1428470402-04cb6c1cca8cdd0001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id zMSSsruvmR0COPOt for ; Tue, 07 Apr 2015 22:20:02 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DoAQCmuSRVPKEh0XYNT4NaXIMVgy2/BogDAQEBAQEBBwEBAQE4hQNVMAYCBRYLAgsDAgECATEnBgIBAbwpcJcUgSGPI4JSgUUFlGyaaoQjXYJDAQEB Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 08 Apr 2015 14:49:38 +0930 Message-ID: <5524BAFD.6050009@internode.on.net> Date: Wed, 08 Apr 2015 15:22:05 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - and a small one Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - and a small one Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1428470402 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17663 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp master Ken McDonell (1): qa/368: fix error introduced in last commit qa/368 | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) Details ... commit 7c6d8a88b992499fcb26674a78e582ba3201a6f9 Author: Ken McDonell Date: Wed Apr 8 15:20:21 2015 +1000 qa/368: fix error introduced in last commit From kenj@internode.on.net Wed Apr 8 02:56:30 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 3C2DC29E01 for ; Wed, 8 Apr 2015 02:56:30 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 2A3508F8070 for ; Wed, 8 Apr 2015 00:56:29 -0700 (PDT) X-ASG-Debug-ID: 1428479784-04cbb056b1b7700001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id l2ZVPWCSDmz9FfMZ for ; Wed, 08 Apr 2015 00:56:24 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DBAQD53SRVPKEh0XYNT4NYXIMVgy2+eYd9AQEBAQEBBwEBAQE4hQQVQDAGAgUWCwILAwIBAgExJwYCAQG8PnCXF4EhjyOCUoFFBZRsmmqEI12CQwEBAQ Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 08 Apr 2015 17:26:23 +0930 Message-ID: <5524DFB9.6030508@internode.on.net> Date: Wed, 08 Apr 2015 17:58:49 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - qa nit Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates - qa nit Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1428479784 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17666 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp master Ken McDonell (1): qa/657: echo -e does not work for some sh(1) variants qa/657 | 7 ++++--- 1 file changed, 4 insertions(+), 3 deletions(-) Details ... commit 5679147407e956185dedb80be3297b65ea03d245 Author: Ken McDonell Date: Wed Apr 8 17:56:50 2015 +1000 qa/657: echo -e does not work for some sh(1) variants sh is not bash From nscott@redhat.com Wed Apr 8 02:59:35 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 46E4829E01 for ; Wed, 8 Apr 2015 02:59:35 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 329798F8084 for ; Wed, 8 Apr 2015 00:59:35 -0700 (PDT) X-ASG-Debug-ID: 1428479972-04cbb056b1b7810001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id nvKaWgjBDznUwtim (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 08 Apr 2015 00:59:33 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t387xWPK013149 for ; Wed, 8 Apr 2015 03:59:32 -0400 Date: Wed, 8 Apr 2015 03:59:32 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp Message-ID: <1842133996.14114660.1428479972642.JavaMail.zimbra@redhat.com> In-Reply-To: <600472624.14110902.1428479689163.JavaMail.zimbra@redhat.com> Subject: QA and bugfix focus MIME-Version: 1.0 X-ASG-Orig-Subj: QA and bugfix focus Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.1] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: QA and bugfix focus Thread-Index: OefrqdIKOt9c38lmtMNdhCkL/LNvEA== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1428479973 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17666 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi all, Just a friendly reminder that we are in the week long quiet time in the leadup to 3.10.4 - if you could focus on QA work and fixing bugs at this stage, that would be most excellent. There are several must-fix bugs on the release list already, and several other possibles needing further investigation - let me know if you're looking for something to do. cheers. -- Nathan From kenj@internode.on.net Wed Apr 8 16:14:03 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id CC6757F67 for ; Wed, 8 Apr 2015 16:14:03 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 9ED698F8035 for ; Wed, 8 Apr 2015 14:14:00 -0700 (PDT) X-ASG-Debug-ID: 1428527634-04bdf06321e7510001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id AGMPAK7WCXiwKnc1 for ; Wed, 08 Apr 2015 14:13:54 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DwAQB3mSVVPKEh0XYNT4NaXIMVgy2+fYgBAQEBAQEBBwEBAQE4hQRVMAYCBRYLAgsDAgECATEnBgIBAb4OcJcCgSGPI4JSgUUFlGyaaoQjXYJDAQEB Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail06.adl6.internode.on.net with ESMTP; 09 Apr 2015 06:43:30 +0930 Message-ID: <55259A8E.9070508@internode.on.net> Date: Thu, 09 Apr 2015 07:15:58 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - qa and libpcp for qa Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - qa and libpcp for qa Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1428527634 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17683 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp master Ken McDonell (3): libpcp/logutil.c: tighten error handling in __pmGetArchiveEnd() qa/valgrind: more suppressions for Debian 6.0.9 qa/566: send all diagnostic to 566.full qa/566 | 48 ++++++++--------- qa/valgrind-suppress-3.6.0.SVN-Debian | 91 ++++++++++++++++++++++++++-------- src/libpcp/src/logutil.c | 16 ++++- 3 files changed, 108 insertions(+), 47 deletions(-) Details ... commit 5a4665c93c9a658448c0233fa9a37d1dee38d72a Author: Ken McDonell Date: Thu Apr 9 07:13:45 2015 +1000 qa/566: send all diagnostic to 566.full $seq.full does not work after a cd ... $here/$seq.full is much better. commit ca0db930ccad442adbd1fd62139c2a7cfd155bb3 Author: Ken McDonell Date: Thu Apr 9 07:12:00 2015 +1000 qa/valgrind: more suppressions for Debian 6.0.9 The code below dlopen() is just broken on this platform ... more bizarre suppressions added. commit 0df88367ba98ba56f197b5c44c13b57ba09096f9 Author: Ken McDonell Date: Thu Apr 9 07:09:01 2015 +1000 libpcp/logutil.c: tighten error handling in __pmGetArchiveEnd() qa/566 with bad archives was exposing some flakey logic when trying to get the end of the archive timestamp and some of the archive volumes are missing or dodgey. From wwwrun@oss.sgi.com Wed Apr 8 18:14:17 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 3DFFB7F81; Wed, 8 Apr 2015 18:14:17 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1067] linux pmda does too much work for network.interface queries Date: Wed, 08 Apr 2015 23:14:17 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: cltorrespr@gmail.com X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1428534857.1561DaC2.16755"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1428534857.1561DaC2.16755 Date: Wed, 8 Apr 2015 18:14:17 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1067 --- Comment #1 from Carlos L. Torres --- Created attachment 327 --> http://oss.sgi.com/bugzilla/attachment.cgi?id=327&action=edit strace_pmdalinux -- You are receiving this mail because: You are on the CC list for the bug. --1428534857.1561DaC2.16755 Date: Wed, 8 Apr 2015 18:14:17 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8"

You are receiving this mail because:
  • You are on the CC list for the bug.
--1428534857.1561DaC2.16755-- From wwwrun@oss.sgi.com Wed Apr 8 18:17:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id DE3F929DFC; Wed, 8 Apr 2015 18:17:18 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1067] linux pmda does too much work for network.interface queries Date: Wed, 08 Apr 2015 23:17:18 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: cltorrespr@gmail.com X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1428535038.7Af222.17144"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1428535038.7Af222.17144 Date: Wed, 8 Apr 2015 18:17:18 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1067 Carlos L. Torres changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |cltorrespr@gmail.com --- Comment #2 from Carlos L. Torres --- attachment 327 shows strace output of process pmdalinux when requesting the following metrics over pmwebd, from a host with 25 interfaces (bridges, bonds). network.interface.in.bytes, network.interface.out.bytes, network.interface.in.packets, network.interface.out.packets It takes more than 1 second to return a response, and pmwebd times out when using the default time-out for PMCD_REQUEST in pmwebd.options of 1 second. -- You are receiving this mail because: You are on the CC list for the bug. --1428535038.7Af222.17144 Date: Wed, 8 Apr 2015 18:17:18 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" changed bug 1067
What Removed Added
CC   cltorrespr@gmail.com

Comment # 2 on bug 1067 from 
attachment 327 [details] shows strace output of process pmdalinux when requesting the
following metrics over pmwebd, from a host with 25 interfaces (bridges, bonds).

network.interface.in.bytes,
network.interface.out.bytes,
network.interface.in.packets,
network.interface.out.packets

It takes more than 1 second to return a response, and pmwebd times out when
using the default time-out for PMCD_REQUEST in pmwebd.options of 1 second.

You are receiving this mail because:
  • You are on the CC list for the bug.
--1428535038.7Af222.17144-- From nscott@redhat.com Wed Apr 8 19:23:06 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 545387F72 for ; Wed, 8 Apr 2015 19:23:06 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 420C18F8037 for ; Wed, 8 Apr 2015 17:23:03 -0700 (PDT) X-ASG-Debug-ID: 1428538977-04cb6c1cc8d6300001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id ZRYAlFOur7zvYSb2 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 08 Apr 2015 17:22:58 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t390MqYp015575; Wed, 8 Apr 2015 20:22:53 -0400 Date: Wed, 8 Apr 2015 20:22:52 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: chandana@desilva.id.au, Paul Smith Cc: pcp@oss.sgi.com Message-ID: <727464076.14748488.1428538972267.JavaMail.zimbra@redhat.com> In-Reply-To: <1428456523.6304.35.camel@desilva.id.au> References: <1427957070.8765.30.camel@desilva.id.au> <1446889888.13182385.1428377259368.JavaMail.zimbra@redhat.com> <1428383139.24854.1.camel@desilva.id.au> <882410516.13878102.1428446368567.JavaMail.zimbra@redhat.com> <211702903.13890461.1428449536086.JavaMail.zimbra@redhat.com> <1428456523.6304.35.camel@desilva.id.au> Subject: Re: [pcp] Trying out ElasticSearch PMDA for the first time MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Trying out ElasticSearch PMDA for the first time Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.10] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Trying out ElasticSearch PMDA for the first time Thread-Index: lpVC7ISUQ6PIZHm1FVie4fgU0jisxQ== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1428538978 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17691 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi guys, ----- Original Message ----- > Nathan and Paul, > > Many thanks and the cat api looks very nice. It will even help us work > out some performance issues ( > 300k events per minute). > > I will try and look through the PMDA and work out which of the GET's are > failing, looking at the pminfo output it seems all of them are. So it is > possible that they have been removed from the API, as Paul says. Installed latest elasticsearch (1.5) and AFAICT they all seem to be there - the PMDA functions fine here and values are returned after a minimal setup (so no actual indices, single node cluster, etc) ... hmm, so not clear what is going on in your case there Chandana. When I said earlier the pmda was "same as issuing a curl" - thats not quite correct. The PMDA uses the perl lightweight http client (LWP::UserAgent is the name of the module - perhaps it has global configuration state somewhere outside the PMDA?). Or do you have elasticsearch on a non-default port? cheers. -- Nathan From pcp-announce-bounces@oss.sgi.com Thu Apr 9 02:31:02 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=RP_MATCHES_RCVD autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from oss.sgi.com (localhost [IPv6:::1]) by oss.sgi.com (Postfix) with ESMTP id 03BB47F8D; Thu, 9 Apr 2015 02:31:02 -0500 (CDT) X-Original-To: pcp-announce@oss.sgi.com Delivered-To: pcp-announce@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 0137D7F8B for ; Thu, 9 Apr 2015 02:31:00 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id D99A4304048 for ; Thu, 9 Apr 2015 00:30:59 -0700 (PDT) X-ASG-Debug-ID: 1428564649-04cbb056b31514c0001-87ZIJf Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id imQFSGGBlzDc1BTj (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 09 Apr 2015 00:30:50 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t397Unif021870 for ; Thu, 9 Apr 2015 03:30:49 -0400 Date: Thu, 9 Apr 2015 03:30:49 -0400 (EDT) From: Nathan Scott To: pcp-announce Message-ID: <1223591011.14871478.1428564649079.JavaMail.zimbra@redhat.com> In-Reply-To: <174950250.14862829.1428563357363.JavaMail.zimbra@redhat.com> MIME-Version: 1.0 X-ASG-Orig-Subj: Vector X-Originating-IP: [10.64.50.10] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Vector Thread-Index: ju7mwT2jnUzuu6LxwEC3m3tU/aebNw== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1428564649 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17702 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Subject: [pcp-announce] Vector X-BeenThere: pcp-announce@oss.sgi.com X-Mailman-Version: 2.1.14 Precedence: list Reply-To: Nathan Scott List-Id: Performance Co-Pilot announcements List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: pcp-announce-bounces@oss.sgi.com Sender: pcp-announce-bounces@oss.sgi.com Hi all, If you've not come across it already, please give this new PCP web interface from the good folks at Netflix a try: http://techblog.netflix.com/2015/04/introducing-vector-netflixs-on-host.html For the PCP developers here, lets get behind this effort and resolve as many PCP issues uncovered here as we can for the pcp-3.10.4 release (scheduled for the middle of next week) - thanks! cheers. -- Nathan _______________________________________________ pcp-announce mailing list pcp-announce@oss.sgi.com http://oss.sgi.com/mailman/listinfo/pcp-announce From nscott@redhat.com Thu Apr 9 05:29:56 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id F30697F8C for ; Thu, 9 Apr 2015 05:29:55 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id C8FE38F8049 for ; Thu, 9 Apr 2015 03:29:55 -0700 (PDT) X-ASG-Debug-ID: 1428575388-04bdf06321141cc0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id WfTgufobMWC5zqdM (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 09 Apr 2015 03:29:48 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t39ATmbV027151 for ; Thu, 9 Apr 2015 06:29:48 -0400 Date: Thu, 9 Apr 2015 06:29:48 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp Message-ID: <765204112.14979385.1428575388121.JavaMail.zimbra@redhat.com> Subject: pcp updates: qa, docs, fixes MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: qa, docs, fixes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.10] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: qa, docs, fixes Thread-Index: 89n5/J/X7qC+wjHVw6sTOEVZTFdS6g== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1428575388 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17706 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git master Ken McDonell (10): libpcp/interp.c: refactoring libpcp/interp.c: small changes qa/group: add 907 to the pmdumplog group pmdumplog: new options and new log reading logic qa/135: add some diagnostic output to 135.full qa/368: fix error introduced in last commit qa/657: echo -e does not work for some sh(1) variants libpcp/logutil.c: tighten error handling in __pmGetArchiveEnd() qa/valgrind: more suppressions for Debian 6.0.9 qa/566: send all diagnostic to 566.full Nathan Scott (5): configure: fix AC_MSG_ERROR parameter passing packaging: add missing pcp-webapi dep for pcp-webjs elasticsearch: add some diagnostics to aid debugging docs: fix some doc errors pointed out by frew on IRC pmchart: fix metric/host selection for containers Marko Myllynen (1): ds389 pmdas: simplify data structure - fixes a pasto/braino build/rpm/fedora.spec | 2 configure | 12 configure.ac | 50 images/container.png |binary images/container.svg | 2014 +++++++++++++++++++++++++++ man/html/contacts.html | 4 man/man1/pmdumplog.1 | 32 qa/135 | 13 qa/177 | 2 qa/177.out | 2 qa/180.out.1 | 2 qa/180.out.2 | 2 qa/180.out.3 | 2 qa/368 | 4 qa/566 | 48 qa/657 | 7 qa/787 | 29 qa/787.out | 6 qa/921 | 71 qa/921.out | 60 qa/group | 3 qa/valgrind-suppress-3.6.0.SVN-Debian | 91 - src/libpcp/src/interp.c | 162 +- src/libpcp/src/logutil.c | 16 src/libpcp_qed/src/qed_fileiconprovider.cpp | 3 src/libpcp_qed/src/qed_fileiconprovider.h | 5 src/libpcp_qmc/src/qmc_source.cpp | 34 src/libpcp_qmc/src/qmc_source.h | 6 src/pmchart/chart.cpp | 20 src/pmchart/chartdialog.cpp | 4 src/pmchart/namespace.cpp | 33 src/pmchart/namespace.h | 5 src/pmchart/openviewdialog.cpp | 38 src/pmchart/openviewdialog.h | 4 src/pmchart/pmchart.cpp | 2 src/pmchart/pmchart.qrc | 1 src/pmchart/view.cpp | 3 src/pmdas/ds389/pmdads389.pl | 8 src/pmdas/ds389log/pmdads389log.pl | 15 src/pmdas/elasticsearch/pmdaelasticsearch.pl | 11 src/pmdumplog/pmdumplog.c | 95 + 41 files changed, 2667 insertions(+), 254 deletions(-) From dsmith@redhat.com Thu Apr 9 10:26:00 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id A695F7F91 for ; Thu, 9 Apr 2015 10:26:00 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 8DD848F8040 for ; Thu, 9 Apr 2015 08:25:57 -0700 (PDT) X-ASG-Debug-ID: 1428593153-04bdf063231571a0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 7b4EE1zH4ARmCr0n (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 09 Apr 2015 08:25:53 -0700 (PDT) X-Barracuda-Envelope-From: dsmith@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t39FPrDQ023008 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 9 Apr 2015 11:25:53 -0400 Received: from t540p.usersys.redhat.com (dhcp-10-15-1-2.hsv.redhat.com [10.15.1.2]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t39FPp1q018661 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 9 Apr 2015 11:25:53 -0400 Message-ID: <552699FE.7040801@redhat.com> Date: Thu, 09 Apr 2015 10:25:50 -0500 From: David Smith User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp Subject: Re: [pcp] JSON PMDA References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] JSON PMDA In-Reply-To: <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1428593153 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 03/29/2015 09:52 PM, Nathan Scott wrote: > Hi David, > > Noticed a couple of little things when we were looking at that install > failure you saw recently... > > # pmParseUnitsStr() doesn't handle unicode > utf8_units = units.encode("utf-8") > > this has been resolved below the API since you encountered this I think, > so you should be able to safely remove that now and pass native strings > around directly. Please let me know if not the case, cos there's a bug > lurking there still then. I got rid of the utf-8 encoding, and I get the following error (using "count" as the unit): PM_ERR_CONV Impossible value or scale conversion count So, there must be a bug still lurking there. > Also, the strategy for generating pmids and indom ids ... > > self.__pmda.indom_idx += 1 > self.__metric_idx += 1 > self.cluster_idx += 1 > > ... needs to be deterministic, else bugs - see mail re dmcache/dmthin a > little earlier for more details. IOW, restarting/reconfiguring the PMDA > needs to ensure the same IDs are generated for the same metrics/indoms. I couldn't find the email you were referring to, but I see the problem with keeping the IDs the same for the same metrics/indoms. I'm not sure I can think of a good scheme to fix that problem. Do any of the other PMDAs solve this problem for non-static metrics? We could use a crypto hash function, but we've only got 22-bits to encode the cluster/item in. -- David Smith dsmith@redhat.com Red Hat http://www.redhat.com 256.217.0141 (direct) 256.837.0057 (fax) From nscott@redhat.com Thu Apr 9 20:30:52 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 0FFB47F8E for ; Thu, 9 Apr 2015 20:30:52 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id E31748F8040 for ; Thu, 9 Apr 2015 18:30:48 -0700 (PDT) X-ASG-Debug-ID: 1428629445-04cbb056b3191490001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id ew5VZz5uR134phhC (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 09 Apr 2015 18:30:46 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3A1UiKT046485 for ; Thu, 9 Apr 2015 21:30:44 -0400 Date: Thu, 9 Apr 2015 21:30:44 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp Message-ID: <1154001552.15562681.1428629444682.JavaMail.zimbra@redhat.com> In-Reply-To: <1100007876.15562526.1428629404270.JavaMail.zimbra@redhat.com> Subject: pcp updates: configure script MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: configure script Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: configure script Thread-Index: JeVTIxgxTX5MlFrqtrjl2ofe7f8T0A== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1428629445 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17731 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git master configure | 272 ++++++++++++++++++++++++++++++----------------------------- configure.ac | 11 ++ 2 files changed, 152 insertions(+), 131 deletions(-) commit 1e7698cdd651cf1210013d0e4be9b284d353bdc8 Author: Nathan Scott Date: Fri Apr 10 10:27:00 2015 +1000 build: add missing configure check for pkg-config requirement Some folks trying out building PCP for subsequent Vector use have reported obscure configure errors when they don't have pkg-config installed. We use this unilaterally now, so we need to check for it on the local system before using it. Make It So. From nscott@redhat.com Thu Apr 9 21:58:29 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 604EF7F95 for ; Thu, 9 Apr 2015 21:58:29 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 456B98F8037 for ; Thu, 9 Apr 2015 19:58:29 -0700 (PDT) X-ASG-Debug-ID: 1428634701-04cbb056b4193180001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id ZKd1bpAnVlcFZKFL (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 09 Apr 2015 19:58:22 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3A2wLnl027171; Thu, 9 Apr 2015 22:58:21 -0400 Date: Thu, 9 Apr 2015 22:58:21 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: David Smith Cc: pcp Message-ID: <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> In-Reply-To: <552699FE.7040801@redhat.com> References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> Subject: Re: [pcp] JSON PMDA MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] JSON PMDA Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: JSON PMDA Thread-Index: Y913zHNgvdsy+6kWIs+vfQd6ei6EQQ== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1428634702 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17733 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain G'day David, ----- Original Message ----- > [...] > I got rid of the utf-8 encoding, and I get the following error (using > "count" as the unit): > > PM_ERR_CONV Impossible value or scale conversion count > > So, there must be a bug still lurking there. > Hmmm. Below the API the code looks like this: @staticmethod def pmParseUnitsStr(string): if type(string) != type('') and type(string) != type(b''): raise pmErr(c_api.PM_ERR_CONV, str(string)) if type(string) != type(b''): string = string.encode('utf-8') I'm not sure what you meant by 'using the "count" as unit' above - what's the type of "count"? I guess its failing that check on the first line, which is expecting either unicode or string of bytes. > > ... needs to be deterministic, else bugs - see mail re dmcache/dmthin a > > little earlier for more details. IOW, restarting/reconfiguring the PMDA > > needs to ensure the same IDs are generated for the same metrics/indoms. > > I couldn't find the email you were referring to, but I see the problem Oh, sorry, that was an obscure reference - this is the one I meant: http://www.pcp.io/pipermail/pcp/2015-March/006876.html > with keeping the IDs the same for the same metrics/indoms. I'm not sure > I can think of a good scheme to fix that problem. Nor I - unfortunately I don't think there's an easy answer here. :( > Do any of the other > PMDAs solve this problem for non-static metrics? No, there aren't really many in the same class - other PMDAs either encode fixed IDs (the vast majority), or do it poorly for small subsets of their names (like the percpu interrupts metrics - known bug) ... and those latter cases are hanging out for a real solution too. :) In the case of MMV which is probably conceptually closest to this PMDA, the numbering is pushed all the way out to the application, which encodes fixed identifiers. > We could use a crypto hash function, Yeah - something like that - have a look at src/libpcp_pmda/src/cache.c as thats how the instance cache number stability is achieved. Perhaps we can extend that with additional APIs to help us out here. If we start extending libpcp_pmda, we should also think about routines like generate_pcp_name() and your name() validity checker - the folks at Buffalo recently expressed need for those same interfaces for C PMDAs, so it would be great to have a common implementation. > but we've only got 22-bits to encode the cluster/item in. Yeah. Actually that's another little limit lurking here I guess - each JSON source can provide a max of 1024 metrics ("item" limits us, as cluster used for distinguishing JSON sources)? I've seen that passed sometimes with some large instrumented applications, but its infrequent. Just something else to keep in mind here I guess, maybe the end hash/numbering solution can seek a way to lift that restriction too, somehow. cheers. -- Nathan From nscott@redhat.com Fri Apr 10 00:10:13 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 458C17F98 for ; Fri, 10 Apr 2015 00:10:13 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 1540E8F8040 for ; Thu, 9 Apr 2015 22:10:09 -0700 (PDT) X-ASG-Debug-ID: 1428642607-04bdf06320180dd0001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id Cv7VV3374i3NUapZ (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 09 Apr 2015 22:10:07 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3A5A7EH016939; Fri, 10 Apr 2015 01:10:07 -0400 Date: Fri, 10 Apr 2015 01:10:06 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: David Smith Cc: pcp Message-ID: <2037935605.15616473.1428642606665.JavaMail.zimbra@redhat.com> In-Reply-To: <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> Subject: Re: [pcp] JSON PMDA MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] JSON PMDA Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.11] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: JSON PMDA Thread-Index: Y913zHNgvdsy+6kWIs+vfQd6ei6EQQSMg4lt X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1428642607 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17735 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > ----- Original Message ----- > > [...] > > I got rid of the utf-8 encoding, and I get the following error (using > > "count" as the unit): > > > > PM_ERR_CONV Impossible value or scale conversion count > > > > So, there must be a bug still lurking there. > > > > Hmmm. Below the API the code looks like this: > > @staticmethod > def pmParseUnitsStr(string): > if type(string) != type('') and type(string) != type(b''): > raise pmErr(c_api.PM_ERR_CONV, str(string)) > if type(string) != type(b''): > string = string.encode('utf-8') > > I'm not sure what you meant by 'using the "count" as unit' above - what's > the type of "count"? I guess its failing that check on the first line, > which is expecting either unicode or string of bytes. Tick, tick, tick ... neurons finally fire ... oh, I think I see what you meant now - "count", as in the literal string "count", not a variable, heh. However I'm still getting good results with that here: $ python Python 2.7.5 (default, Nov 3 2014, 14:26:24) [GCC 4.8.3 20140911 (Red Hat 4.8.3-7)] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> from pcp import pmapi >>> import cpmapi as c_api >>> context = pmapi.pmContext() >>> context.pmParseUnitsStr("count") (, 1.0) >>> ^D $ python3 Python 3.3.2 (default, Dec 4 2014, 12:49:00) [GCC 4.8.3 20140911 (Red Hat 4.8.3-7)] on linux Type "help", "copyright", "credits" or "license" for more information. >>> from pcp import pmapi >>> import cpmapi as c_api >>> context = pmapi.pmContext() >>> context.pmParseUnitsStr("count") (, 1.0) >>> ^D I guess one of those fails with an exception for you locally? cheers. -- Nathan From dsmith@redhat.com Fri Apr 10 09:11:20 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id E78AD7FAB for ; Fri, 10 Apr 2015 09:11:20 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id D4081304032 for ; Fri, 10 Apr 2015 07:11:17 -0700 (PDT) X-ASG-Debug-ID: 1428675076-04cb6c1cc71795a0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id Lhc0ZXae5h57EjvU (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 10 Apr 2015 07:11:16 -0700 (PDT) X-Barracuda-Envelope-From: dsmith@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (Postfix) with ESMTPS id EE3F38E6E8 for ; Fri, 10 Apr 2015 14:11:15 +0000 (UTC) Received: from t540p.usersys.redhat.com (vpn-54-79.rdu2.redhat.com [10.10.54.79]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3AEBDd8015949 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 10 Apr 2015 10:11:15 -0400 Message-ID: <5527DA01.50301@redhat.com> Date: Fri, 10 Apr 2015 09:11:13 -0500 From: David Smith User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp Subject: Re: [pcp] JSON PMDA References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <2037935605.15616473.1428642606665.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] JSON PMDA In-Reply-To: <2037935605.15616473.1428642606665.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1428675076 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 04/10/2015 12:10 AM, Nathan Scott wrote: > ----- Original Message ----- >> ----- Original Message ----- >>> [...] >>> I got rid of the utf-8 encoding, and I get the following error (using >>> "count" as the unit): >>> >>> PM_ERR_CONV Impossible value or scale conversion count >>> >>> So, there must be a bug still lurking there. >>> >> >> Hmmm. Below the API the code looks like this: >> >> @staticmethod >> def pmParseUnitsStr(string): >> if type(string) != type('') and type(string) != type(b''): >> raise pmErr(c_api.PM_ERR_CONV, str(string)) >> if type(string) != type(b''): >> string = string.encode('utf-8') >> >> I'm not sure what you meant by 'using the "count" as unit' above - what's >> the type of "count"? I guess its failing that check on the first line, >> which is expecting either unicode or string of bytes. > > Tick, tick, tick ... neurons finally fire ... oh, I think I see what you meant > now - "count", as in the literal string "count", not a variable, heh. However > I'm still getting good results with that here: > > $ python > Python 2.7.5 (default, Nov 3 2014, 14:26:24) > [GCC 4.8.3 20140911 (Red Hat 4.8.3-7)] on linux2 > Type "help", "copyright", "credits" or "license" for more information. >>>> from pcp import pmapi >>>> import cpmapi as c_api >>>> context = pmapi.pmContext() >>>> context.pmParseUnitsStr("count") > (, 1.0) >>>> ^D > > $ python3 > Python 3.3.2 (default, Dec 4 2014, 12:49:00) > [GCC 4.8.3 20140911 (Red Hat 4.8.3-7)] on linux > Type "help", "copyright", "credits" or "license" for more information. >>>> from pcp import pmapi >>>> import cpmapi as c_api >>>> context = pmapi.pmContext() >>>> context.pmParseUnitsStr("count") > (, 1.0) >>>> ^D > > > I guess one of those fails with an exception for you locally? Your example works fine: >>> from pcp import pmapi >>> context = pmapi.pmContext() >>> context.pmParseUnitsStr("count") (, 1.0) But the following fails: >>> context.pmParseUnitsStr(u'count') Traceback (most recent call last): File "", line 1, in File "/usr/lib64/python2.7/site-packages/pcp/pmapi.py", line 1927, in pmParseUnitsStr raise pmErr(c_api.PM_ERR_CONV, str(string)) pcp.pmapi.pmErr: PM_ERR_CONV Impossible value or scale conversion count You weren't passing in a unicode string. -- David Smith dsmith@redhat.com Red Hat http://www.redhat.com 256.217.0141 (direct) 256.837.0057 (fax) From pevans@redhat.com Fri Apr 10 10:19:23 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id C57B87F8E for ; Fri, 10 Apr 2015 10:19:23 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id B09F6304039 for ; Fri, 10 Apr 2015 08:19:20 -0700 (PDT) X-ASG-Debug-ID: 1428679155-04cbb056b11a8140001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id xXBErklGAKtrft8w (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 10 Apr 2015 08:19:16 -0700 (PDT) X-Barracuda-Envelope-From: pevans@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3AFJFXV010506 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Fri, 10 Apr 2015 11:19:15 -0400 Received: from [10.36.6.64] (vpn1-6-64.ams2.redhat.com [10.36.6.64]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3AFJDIc027158; Fri, 10 Apr 2015 11:19:14 -0400 Message-ID: <5527E9F0.2010909@redhat.com> Date: Fri, 10 Apr 2015 16:19:12 +0100 From: Paul Evans User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Nathan Scott , pcp@oss.sgi.com Subject: pcp updates: upgrade path fixes Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: upgrade path fixes Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1428679156 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, As suggested by Nathan I have had a look at his patches for implementing the update path from pmdadmcache to pmdadm and implemented the changes. The updates have been tested on and work correctly for me on RHEL 6, Fedora and Ubuntu 14.04. There was a small bug in rc_pmcd with _pmda_enact() where we would change from PCP_PMDA_DIR when running the current action and not revert back to the directory (which was expected by _pmda_setup()) for moving to the next _pmda_enact() action. Changes committed to git://github.com/pauljevans/pcp.git master build/rpm/pcp.spec.in | 11 +++++++++++ debian/pcp.postinst.tail | 11 +++++++++++ src/pmcd/rc_pmcd | 2 ++ 3 files changed, 24 insertions(+) commit 56b0a446db3f063bf1fb9d00cc8e6de4cb533ad2 Author: Paul Evans Date: Fri Apr 10 16:00:19 2015 +0100 pcp: Fix current directory location issue in _pmda_setup() when leaving enact "Remove" and moving to enact "Install". commit 6611297e70e111e07c65ef979bbc839dcabb5464 Author: Paul Evans Date: Fri Apr 10 15:59:56 2015 +0100 pcp: Ensure that older pmdadmcache is removed and newer replacement pmdadm is installed as a replacement when updating release. Cheers, Paul From fche@redhat.com Fri Apr 10 10:55:38 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id E00067FA9 for ; Fri, 10 Apr 2015 10:55:38 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id BA36030404E for ; Fri, 10 Apr 2015 08:55:38 -0700 (PDT) X-ASG-Debug-ID: 1428681337-04cbb056b21a9400001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id l94qwM4lawKEvytp (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 10 Apr 2015 08:55:37 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (Postfix) with ESMTPS id 4685C18AEC1 for ; Fri, 10 Apr 2015 15:55:37 +0000 (UTC) Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3AFta0U029362; Fri, 10 Apr 2015 11:55:37 -0400 Received: by fche.csb (Postfix, from userid 2569) id 3C1435869E; Fri, 10 Apr 2015 11:55:34 -0400 (EDT) To: Nathan Scott Cc: pcp Subject: Re: pcp updates: qa, docs, fixes References: <765204112.14979385.1428575388121.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: pcp updates: qa, docs, fixes From: fche@redhat.com (Frank Ch. Eigler) Date: Fri, 10 Apr 2015 11:55:34 -0400 In-Reply-To: <765204112.14979385.1428575388121.JavaMail.zimbra@redhat.com> (Nathan Scott's message of "Thu, 9 Apr 2015 06:29:48 -0400 (EDT)") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1428681337 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Nathan Scott writes: > [...] > Nathan Scott (5): > packaging: add missing pcp-webapi dep for pcp-webjs > [...] Re. this part, it would probably be better if pcp-webjs's %files just included %dir /usr/share/pcp/webapps (whether or not that duplicates pcp-webapi). That way, the webjs stuff is not forced to match to any particular version of pcp, as technically indeed it does not need to. So people fond of older or newer webjs can install it without fretting about core pcp. (Similarly, the "pcp-libs = %{version}-%{release}" explicit dependencies should be dropped throughout the .spec file, relying instead on rpm's solib/soname analysis magic.) - FChE From wwwrun@oss.sgi.com Sat Apr 11 11:41:06 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 89C417F85; Sat, 11 Apr 2015 11:41:06 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1067] linux pmda does too much work for network.interface queries Date: Sat, 11 Apr 2015 16:41:06 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: michele@acksyn.org X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1428770466.6fAd3.7605"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1428770466.6fAd3.7605 Date: Sat, 11 Apr 2015 11:41:06 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1067 Michele Baldessari changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |michele@acksyn.org --- Comment #3 from Michele Baldessari --- Seems that when we call refresh_proc_net_dev(INDOM(NET_DEV_INDOM)) we then unconditionally call: ... /* Issue ioctls for remaining data, not exported through proc */ memset(&netip->ioc, 0, sizeof(netip->ioc)); if (refresh_net_dev_ioctl(p, netip) < 0) refresh_net_dev_sysfs(p, netip); ... Those two functions do the whole ioctl/sysfs dance. I assume we could cache the values we fill in those functions, namely: netip->ioc.mtu netip->ioc.linkup netip->ioc.running netip->ioc.speed netip->ioc.duplex Any other thoughts here? -- You are receiving this mail because: You are on the CC list for the bug. --1428770466.6fAd3.7605 Date: Sat, 11 Apr 2015 11:41:06 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" changed bug 1067
What Removed Added
CC   michele@acksyn.org

Comment # 3 on bug 1067 from 
Seems that when we call refresh_proc_net_dev(INDOM(NET_DEV_INDOM)) we then
unconditionally call:
...  
 /* Issue ioctls for remaining data, not exported through proc */
 memset(&netip->ioc, 0, sizeof(netip->ioc));
 if (refresh_net_dev_ioctl(p, netip) < 0)
     refresh_net_dev_sysfs(p, netip);
...

Those two functions do the whole ioctl/sysfs dance.
I assume we could cache the values we fill in those functions, namely:
netip->ioc.mtu
netip->ioc.linkup
netip->ioc.running
netip->ioc.speed
netip->ioc.duplex

Any other thoughts here?

You are receiving this mail because:
  • You are on the CC list for the bug.
--1428770466.6fAd3.7605-- From wwwrun@oss.sgi.com Sat Apr 11 11:43:38 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 41CF27F85; Sat, 11 Apr 2015 11:43:38 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1067] linux pmda does too much work for network.interface queries Date: Sat, 11 Apr 2015 16:43:38 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: fche@redhat.com X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1428770618.2FD5fa543.8008"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1428770618.2FD5fa543.8008 Date: Sat, 11 Apr 2015 11:43:38 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1067 --- Comment #4 from Frank Ch. Eigler --- IMHO, we should barely cache anything - and certainly not intentionally prefetch unrelated information. -- You are receiving this mail because: You are on the CC list for the bug. --1428770618.2FD5fa543.8008 Date: Sat, 11 Apr 2015 11:43:38 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8"

Comment # 4 on bug 1067 from 
IMHO, we should barely cache anything - and certainly not intentionally
prefetch unrelated information.

You are receiving this mail because:
  • You are on the CC list for the bug.
--1428770618.2FD5fa543.8008-- From wwwrun@oss.sgi.com Sun Apr 12 15:22:08 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 109887F66; Sun, 12 Apr 2015 15:22:08 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1067] linux pmda does too much work for network.interface queries Date: Sun, 12 Apr 2015 20:22:07 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: michele@acksyn.org X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1428870128.D2EB3.24962"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1428870128.D2EB3.24962 Date: Sun, 12 Apr 2015 15:22:08 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1067 --- Comment #5 from Michele Baldessari --- One fairly non intrusive and quick ameliorating change (it's not a full fix obviously) would be to always fetch most/all the interface attributes via sysfs via the SIOCETHTOOL/SIOC* calls. At least in Carlos' strace it took one whole second: 23:06:19.435643 ioctl(8, SIOCETHTOOL, 0x7fff7d76d0e0) = 0 <1.038297> Since SIOCETHTOOL does poke the driver itself, whereas the sysfs attributes won't, it seems this could be a fairly quick win (at least RHEL 5 has those files for most interfaces) and should an older kernel not have them we can always fall back to SIOCETHTOOL. We could then discuss separately how the linux pmda is fetching too much data when poked for a few metrics and maybe tackle that in a more intrusive/ architectural way (I have a hunch that network.interface.* is not the only one). This is likely to at least improve Carlos' situation where a driver might decide to take a long time to reply to an ethtool poking. -- You are receiving this mail because: You are on the CC list for the bug. --1428870128.D2EB3.24962 Date: Sun, 12 Apr 2015 15:22:08 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8"

Comment # 5 on bug 1067 from 
One fairly non intrusive and quick ameliorating change (it's not a full fix
obviously) would be to always fetch most/all the interface attributes via
sysfs via the SIOCETHTOOL/SIOC* calls.

At least in Carlos' strace it took one whole second:
23:06:19.435643 ioctl(8, SIOCETHTOOL, 0x7fff7d76d0e0) = 0 <1.038297>

Since SIOCETHTOOL does poke the driver itself, whereas the sysfs attributes
won't, it seems this could be a fairly quick win (at least RHEL 5 has those
files for most interfaces) and should an older kernel not have them
we can always fall back to SIOCETHTOOL.

We could then discuss separately how the linux pmda is fetching too much
data when poked for a few metrics and maybe tackle that in a more intrusive/
architectural way (I have a hunch that network.interface.* is not the only
one). This is likely to at least improve Carlos' situation where a driver might
decide to take a long time to reply to an ethtool poking.

You are receiving this mail because:
  • You are on the CC list for the bug.
--1428870128.D2EB3.24962-- From wwwrun@oss.sgi.com Sun Apr 12 18:44:37 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id BD5FE7F6A; Sun, 12 Apr 2015 18:44:37 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1067] linux pmda does too much work for network.interface queries Date: Sun, 12 Apr 2015 23:44:37 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: nathans@debian.org X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1428882277.05f8eaE4.8605"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1428882277.05f8eaE4.8605 Date: Sun, 12 Apr 2015 18:44:37 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1067 Nathan Scott changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |nathans@debian.org --- Comment #6 from Nathan Scott --- (In reply to comment #5) > One fairly non intrusive and quick ameliorating change (it's not a full fix > obviously) would be to always fetch most/all the interface attributes via > sysfs via the SIOCETHTOOL/SIOC* calls. > > At least in Carlos' strace it took one whole second: > 23:06:19.435643 ioctl(8, SIOCETHTOOL, 0x7fff7d76d0e0) = 0 <1.038297> > > Since SIOCETHTOOL does poke the driver itself, whereas the sysfs attributes > won't, it seems this could be a fairly quick win (at least RHEL 5 has those > files for most interfaces) and should an older kernel not have them > we can always fall back to SIOCETHTOOL. +1 ... this should be a fairly simple, low-risk change. > We could then discuss separately how the linux pmda is fetching too much > data when poked for a few metrics and maybe tackle that in a more intrusive/ > architectural way (I have a hunch that network.interface.* is not the only > one). This is likely to at least improve Carlos' situation where a driver > might > decide to take a long time to reply to an ethtool poking. There's an existing Linux PMDA model to handle this in linux_refresh(), problem is its designed around each cluster having a single sampling mechanism and in this case that's not what happens. So, yes, need to rethink that, but that's a fair bit more invasive. -- You are receiving this mail because: You are on the CC list for the bug. --1428882277.05f8eaE4.8605 Date: Sun, 12 Apr 2015 18:44:37 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" changed bug 1067
What Removed Added
CC   nathans@debian.org

Comment # 6 on bug 1067 from 
(In reply to comment #5)
> One fairly non intrusive and quick ameliorating change (it's not a full fix
> obviously) would be to always fetch most/all the interface attributes via
> sysfs via the SIOCETHTOOL/SIOC* calls.
> 
> At least in Carlos' strace it took one whole second:
> 23:06:19.435643 ioctl(8, SIOCETHTOOL, 0x7fff7d76d0e0) = 0 <1.038297>
> 
> Since SIOCETHTOOL does poke the driver itself, whereas the sysfs attributes
> won't, it seems this could be a fairly quick win (at least RHEL 5 has those
> files for most interfaces) and should an older kernel not have them
> we can always fall back to SIOCETHTOOL.

+1 ... this should be a fairly simple, low-risk change.

> We could then discuss separately how the linux pmda is fetching too much
> data when poked for a few metrics and maybe tackle that in a more intrusive/
> architectural way (I have a hunch that network.interface.* is not the only
> one). This is likely to at least improve Carlos' situation where a driver
> might
> decide to take a long time to reply to an ethtool poking.

There's an existing Linux PMDA model to handle this in linux_refresh(), problem
is its designed around each cluster having a single sampling mechanism and in
this case that's not what happens.  So, yes, need to rethink that, but that's a
fair bit more invasive.

You are receiving this mail because:
  • You are on the CC list for the bug.
--1428882277.05f8eaE4.8605-- From nscott@redhat.com Sun Apr 12 21:23:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 520AC7F67 for ; Sun, 12 Apr 2015 21:23:18 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id C50DBAC003 for ; Sun, 12 Apr 2015 19:23:14 -0700 (PDT) X-ASG-Debug-ID: 1428891788-04cb6c1cc71c9070001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id OyAJiAUHacZVEMv0 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sun, 12 Apr 2015 19:23:08 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3D2N7TE062667; Sun, 12 Apr 2015 22:23:07 -0400 Date: Sun, 12 Apr 2015 22:23:06 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: David Smith Cc: pcp Message-ID: <6380668.16929160.1428891786036.JavaMail.zimbra@redhat.com> In-Reply-To: <5527DA01.50301@redhat.com> References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <2037935605.15616473.1428642606665.JavaMail.zimbra@redhat.com> <5527DA01.50301@redhat.com> Subject: Re: [pcp] JSON PMDA MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] JSON PMDA Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: JSON PMDA Thread-Index: QTyXPXkh6xY/X5LaiecHJxJpRzbyxA== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1428891788 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17851 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > [...] > > $ python > > Python 2.7.5 (default, Nov 3 2014, 14:26:24) > > [GCC 4.8.3 20140911 (Red Hat 4.8.3-7)] on linux2 > > Type "help", "copyright", "credits" or "license" for more information. > >>>> from pcp import pmapi > >>>> import cpmapi as c_api > >>>> context = pmapi.pmContext() > >>>> context.pmParseUnitsStr("count") > > (, 1.0) > >>>> ^D > > > > $ python3 > > Python 3.3.2 (default, Dec 4 2014, 12:49:00) > > [GCC 4.8.3 20140911 (Red Hat 4.8.3-7)] on linux > > Type "help", "copyright", "credits" or "license" for more information. > >>>> from pcp import pmapi > >>>> import cpmapi as c_api > >>>> context = pmapi.pmContext() > >>>> context.pmParseUnitsStr("count") > > (, 1.0) > >>>> ^D > > > > > > I guess one of those fails with an exception for you locally? > > Your example works fine: > > >>> from pcp import pmapi > >>> context = pmapi.pmContext() > >>> context.pmParseUnitsStr("count") > (, 1.0) > > But the following fails: > > >>> context.pmParseUnitsStr(u'count') > Traceback (most recent call last): > File "", line 1, in > File "/usr/lib64/python2.7/site-packages/pcp/pmapi.py", line 1927, in > pmParseUnitsStr > raise pmErr(c_api.PM_ERR_CONV, str(string)) > pcp.pmapi.pmErr: PM_ERR_CONV Impossible value or scale conversion count > > You weren't passing in a unicode string. In python3, strings are unicode. So, I guess you are using Unicode strings on python2? (explicitly?) $ python3 Python 3.3.2 (default, Dec 4 2014, 12:49:00) [GCC 4.8.3 20140911 (Red Hat 4.8.3-7)] on linux Type "help", "copyright", "credits" or "license" for more information. >>> type('x') >>> type(u'x') >>> type(b'x') >>> $ python Python 2.7.5 (default, Nov 3 2014, 14:26:24) [GCC 4.8.3 20140911 (Red Hat 4.8.3-7)] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> type('x') >>> type(u'x') >>> type(b'x') >>> Anyway, we should certainly tackle this below the API; we'll need to audit all the byte/unicode conversion points and make sure they explicitly check for unicode, e.g. this: @staticmethod def pmParseUnitsStr(string): if type(string) != type('') and type(string) != type(b''): raise pmErr(c_api.PM_ERR_CONV, str(string)) if type(string) != type(b''): string = string.encode('utf-8') should become @staticmethod def pmParseUnitsStr(string): if type(string) != type(u'') and type(string) != type(b''): raise pmErr(c_api.PM_ERR_CONV, str(string)) if type(string) != type(b''): string = string.encode('utf-8') and the exception you're seeing will be avoided I think. Thanks David! cheers. -- Nathan From nscott@redhat.com Mon Apr 13 02:04:23 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 94FA17F5D for ; Mon, 13 Apr 2015 02:04:23 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 790138F8035 for ; Mon, 13 Apr 2015 00:04:20 -0700 (PDT) X-ASG-Debug-ID: 1428908658-04bdf063231e76f0001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id 0qdcDlZqbY3LR8Z5 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 13 Apr 2015 00:04:19 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3D74Ikr043029; Mon, 13 Apr 2015 03:04:18 -0400 Date: Mon, 13 Apr 2015 03:04:17 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: pcp Message-ID: <1283758678.17040206.1428908657815.JavaMail.zimbra@redhat.com> In-Reply-To: References: <765204112.14979385.1428575388121.JavaMail.zimbra@redhat.com> Subject: Re: pcp updates: qa, docs, fixes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: pcp updates: qa, docs, fixes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: qa, docs, fixes Thread-Index: LWL4Bv4sjamkJBY8y3g+et+KbM+vOQ== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1428908659 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17858 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > > [...] it would probably be better if pcp-webjs's %files > just included > > %dir /usr/share/pcp/webapps > > (whether or not that duplicates pcp-webapi). That way, the webjs > stuff is not forced to match to any particular version of pcp, as > technically indeed it does not need to. Michael Schwendt pointed out (over in RHBZ 1204467) that there is actually a dependency on pcp, and in this particular case, on both the base pcp and the pcp-webapi packages - he provided this link: https://fedoraproject.org/wiki/Packaging:UnownedDirectories So, /usr/share/pcp comes from package "pcp" and /usr/share/pcp/webapps comes from package "pcp-webapi". Hence we need to depend on a version of pcp-webapi that we know provides that directory, and there's a dep (via pcp-webapi) on a pcp version that provides the base directory. $ rpm -qlp pcp-webapi-3.10.1-1.fc20.x86_64.rpm | grep webapps$ /usr/share/pcp/webapps $ rpm -qlp pcp-3.10.1-1.fc20.x86_64.rpm | grep share/pcp$ /usr/share/pcp > So people fond of older > or newer webjs can install it without fretting about core pcp. That'd break the above Fedora packaging requirement, recently fixed. > (Similarly, the "pcp-libs = %{version}-%{release}" explicit > dependencies should be dropped throughout the .spec file, relying > instead on rpm's solib/soname analysis magic.) This has come up before - the issue is rpmdiff reports problems if this explicit versioned dependency is removed. If that has now been verified as resolved, then yep, send through a patch to remove 'em. cheers. -- Nathan From nscott@redhat.com Mon Apr 13 02:29:15 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 4219E7F5D for ; Mon, 13 Apr 2015 02:29:15 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id D26ECAC002 for ; Mon, 13 Apr 2015 00:29:11 -0700 (PDT) X-ASG-Debug-ID: 1428910145-04cbb056b31fb650001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id D8W8y08AiTlbKpWW (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 13 Apr 2015 00:29:06 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3D7T5hg032139 for ; Mon, 13 Apr 2015 03:29:05 -0400 Date: Mon, 13 Apr 2015 03:29:05 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp Message-ID: <2005032793.17074722.1428910145740.JavaMail.zimbra@redhat.com> In-Reply-To: <1633079747.17066054.1428909690168.JavaMail.zimbra@redhat.com> Subject: pcp fixes: python unicode fix, rc scripts, build, qa MIME-Version: 1.0 X-ASG-Orig-Subj: pcp fixes: python unicode fix, rc scripts, build, qa Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp fixes: python unicode fix, rc scripts, build, qa Thread-Index: J64dvfMqiIvOXubX0FsaGSDk7U8ovQ== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1428910146 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17859 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git master Nathan Scott (4): rc scripts: ensure rundir directory created when needed build: make pcp.spec.in match fedora.spec re webapi files python: do not assume unicode is only for python3 qa: allow test 999 to pass with basic elasticsearch install Paul Evans (2): pcp: Ensure that older pmdadmcache is removed and newer replacement pmdadm is installed as a replacement when updating release. pcp: Fix current directory location issue in _pmda_setup() when leaving enact "Remove" and moving to enact "Install". build/rpm/fedora.spec | 1 + build/rpm/pcp.spec.in | 13 ++++++++++++- debian/pcp.postinst.tail | 11 +++++++++++ qa/999 | 1 + qa/src/test_pcp.python | 2 +- src/pmcd/rc_pmcd | 2 ++ src/pmlogger/pmlogger_daily.sh | 10 ++++++---- src/pmmgr/rc_pmmgr | 7 +++++++ src/pmproxy/rc_pmproxy | 7 +++++++ src/pmwebapi/rc_pmwebd | 15 +++++++++++++-- src/python/pcp/pmapi.py | 6 +++--- src/python/pcp/pmsubsys.py | 2 +- 12 files changed, 65 insertions(+), 12 deletions(-) From nscott@redhat.com Mon Apr 13 02:36:54 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 30AF77F5D for ; Mon, 13 Apr 2015 02:36:54 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 02E578F8035 for ; Mon, 13 Apr 2015 00:36:53 -0700 (PDT) X-ASG-Debug-ID: 1428910611-04bdf063221e8540001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id hHScLNgoZAdI6zvW (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 13 Apr 2015 00:36:52 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3D7apeo050496; Mon, 13 Apr 2015 03:36:51 -0400 Date: Mon, 13 Apr 2015 03:36:51 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Paul Evans Cc: pcp@oss.sgi.com Message-ID: <1869223420.17079494.1428910611524.JavaMail.zimbra@redhat.com> In-Reply-To: <5527E9F0.2010909@redhat.com> References: <5527E9F0.2010909@redhat.com> Subject: Re: pcp updates: upgrade path fixes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: pcp updates: upgrade path fixes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: upgrade path fixes Thread-Index: fhSDsN47vfCoqLx1JUc9P3ReAUyljQ== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1428910612 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17859 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > Hi, > > As suggested by Nathan I have had a look at his patches for implementing the > update path from pmdadmcache to pmdadm and implemented the changes. The > updates have been tested on and work correctly for me on RHEL 6, Fedora > and Ubuntu 14.04. Good stuff - thanks Paul - all merged in now. cheers. -- Nathan From fche@redhat.com Mon Apr 13 08:03:11 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id B7E237F4E for ; Mon, 13 Apr 2015 08:03:11 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 52E7EAC002 for ; Mon, 13 Apr 2015 06:03:10 -0700 (PDT) X-ASG-Debug-ID: 1428930183-04cbb056b2205d70001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id W93isoIJUxKkJZPq (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 13 Apr 2015 06:03:06 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (Postfix) with ESMTPS id 07C768E754 for ; Mon, 13 Apr 2015 13:03:03 +0000 (UTC) Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3DD32Ne001088; Mon, 13 Apr 2015 09:03:02 -0400 Received: by fche.csb (Postfix, from userid 2569) id 76D825869C; Mon, 13 Apr 2015 09:02:59 -0400 (EDT) Date: Mon, 13 Apr 2015 09:02:59 -0400 From: "Frank Ch. Eigler" To: Nathan Scott Cc: pcp Subject: Re: pcp updates: qa, docs, fixes Message-ID: <20150413130259.GJ13158@redhat.com> X-ASG-Orig-Subj: Re: pcp updates: qa, docs, fixes References: <765204112.14979385.1428575388121.JavaMail.zimbra@redhat.com> <1283758678.17040206.1428908657815.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1283758678.17040206.1428908657815.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1428930185 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - On Mon, Apr 13, 2015 at 03:04:17AM -0400, Nathan Scott wrote: > [...] > > %dir /usr/share/pcp/webapps > > > > (whether or not that duplicates pcp-webapi). That way, the webjs > > stuff is not forced to match to any particular version of pcp, as > > technically indeed it does not need to. > > Michael Schwendt pointed out (over in RHBZ 1204467) that there is > actually a dependency on pcp, and in this particular case, on both > the base pcp and the pcp-webapi packages - he provided this link: > > https://fedoraproject.org/wiki/Packaging:UnownedDirectories > > So, /usr/share/pcp comes from package "pcp" and /usr/share/pcp/webapps > comes from package "pcp-webapi". [...] The confusion here is between "unowned" and "multiply-owned" directories. /usr/share/pcp and /usr/share/pcp/webapps are both multiply-ownable by the main pcp rpm and the -webjs subrpm: we can put both %dir's in both %files lists. > [...] > > (Similarly, the "pcp-libs = %{version}-%{release}" explicit > > dependencies should be dropped throughout the .spec file, relying > > instead on rpm's solib/soname analysis magic.) > > This has come up before - the issue is rpmdiff reports problems if > this explicit versioned dependency is removed. If that has now been > verified as resolved, then yep, send through a patch to remove 'em. rpmdiff supplies warnings when it thinks something may be wrong. We waive them when rpmdiff is mistaken. - FChE From mkblackwell@gmail.com Mon Apr 13 09:39:37 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE, T_DKIM_INVALID autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id E3F8E7F4E for ; Mon, 13 Apr 2015 09:39:37 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id E50CD8F8064 for ; Mon, 13 Apr 2015 07:39:34 -0700 (PDT) X-ASG-Debug-ID: 1428935969-04cbb056b3209710001-S8gJnT Received: from mail-wi0-f178.google.com (mail-wi0-f178.google.com [209.85.212.178]) by cuda.sgi.com with ESMTP id N8kYaApV7jaM7iai (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Mon, 13 Apr 2015 07:39:30 -0700 (PDT) X-Barracuda-Envelope-From: mkblackwell@gmail.com X-Barracuda-Apparent-Source-IP: 209.85.212.178 X-Barracuda-IPDD: Level1 [gmail.com/209.85.212.178] Received: by widdi4 with SMTP id di4so54515647wid.0 for ; Mon, 13 Apr 2015 07:39:29 -0700 (PDT) X-Barracuda-IPDD: Level1 [gmail.com/209.85.212.178] X-Barracuda-IPDD: Level1 [gmail.com/209.85.212.178] DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=9JGH31uuskQ7feTbRpB5uqQd0srG8h3gwn69yHDastc=; b=wv/1sd+1xUZGtkvKm4amsU4LOsGzX97oqFjq7R47VGcayp2szQBnWhFJwYPKchtwVg YDQUXN1FBtYh2TUXOX6kWsz6W9bjNhoZcYNdU/3tcs51o89Bws6UaHGB8oWnQai0LzxE U1eh9jdwKpR3IaSSnKqLpfxBJJWzRFa4Nh1T9netbcyDF4OMqYj2Js/WeZLdEkgQAxDd K7JPbyO5ihzASbBtTvJAwCFgKuq6lQiZpZIOZkSbNXttTfFNAxQBKxPts8csOyFnT8EA JiQCDjaOAznRxcADN93SY8Uhsiyg4DSO6SYttyjzrDfN7Tsj8uPrrolmAD4YcGUfKrZN PHpQ== MIME-Version: 1.0 X-Received: by 10.180.92.161 with SMTP id cn1mr21795541wib.91.1428935969207; Mon, 13 Apr 2015 07:39:29 -0700 (PDT) Received: by 10.28.85.195 with HTTP; Mon, 13 Apr 2015 07:39:29 -0700 (PDT) Date: Mon, 13 Apr 2015 10:39:29 -0400 Message-ID: Subject: make install problem on Gentoo From: Mike Blackwell X-ASG-Orig-Subj: make install problem on Gentoo To: pcp@oss.sgi.com Content-Type: multipart/alternative; boundary=f46d0435c052d9fbc405139c1499 X-Barracuda-Connect: mail-wi0-f178.google.com[209.85.212.178] X-Barracuda-Start-Time: 1428935970 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-BRTS-Evidence: josefsipek.net X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED, HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17868 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 HTML_MESSAGE BODY: HTML included in message --f46d0435c052d9fbc405139c1499 Content-Type: text/plain; charset=UTF-8 I'm having an issue building the latest master branch on Gentoo linux. Configure and make succeed as expected, but "sudo make install" fails on PMDA, and I'm having trouble unwinding the nested make-ing that's going on to figure out the problem... Here's the output: === PMDA === rm -rf PCP-PMDA-* MYMETA.yml MYMETA.json make -f Makefile dist rm -rf PCP-PMDA-1.15 /usr/bin/perl5.12.4 "-MExtUtils::Manifest=manicopy,maniread" \ -e "manicopy(maniread(),'PCP-PMDA-1.15', 'best');" mkdir PCP-PMDA-1.15 Generating META.yml Generating META.json tar cvf PCP-PMDA-1.15.tar PCP-PMDA-1.15 PCP-PMDA-1.15/ PCP-PMDA-1.15/MANIFEST PCP-PMDA-1.15/META.yml PCP-PMDA-1.15/Changes PCP-PMDA-1.15/cvalue.c PCP-PMDA-1.15/PMDA.pm PCP-PMDA-1.15/COPYING PCP-PMDA-1.15/META.json PCP-PMDA-1.15/local.c PCP-PMDA-1.15/local.h PCP-PMDA-1.15/typemap PCP-PMDA-1.15/PMDA.xs PCP-PMDA-1.15/test.pl PCP-PMDA-1.15/Makefile.PL rm -rf PCP-PMDA-1.15 gzip --best PCP-PMDA-1.15.tar make -f Makefile install DESTDIR=$DIST_ROOT | tee pack.list; sed -n -e '/\.bs$/d' -e 's/\.[0-9]pm$/&.gz/' -e "s@^Installing $DIST_ROOT@@p" ../../../perl-pcp-pmda.list || exit 1; if [ -s ../../../perl-pcp-pmda.list ]; then rm -f pack.list; else echo "Arrgh ... no files to include in package via ../../../perl-pcp-pmda.list, see pack.list"; exit 1; fi; find $DIST_ROOT//usr -name perllocal.pod -exec rm -f '{}' ';' ; find $DIST_ROOT//usr -name \*.bs -exec rm -f '{}' ';' ; find $DIST_ROOT//usr -name PMDA.so -exec chmod 755 '{}' ';' Files found in blib/arch: installing files in blib/lib into architecture dependent library tree Arrgh ... no files to include in package via ../../../perl-pcp-pmda.list, see pack.list make[3]: *** [install] Error 1 make[2]: *** [install] Error 2 make[1]: *** [install_pcp] Error 2 make[1]: Leaving directory `/home/mblackwell/src/pcp/src' make: *** [install_pcp] Error 2 There's a blog post from back in 2011 that maybe hints at the problem but doesn't fully explain the solution for PMDA (and I'm not trying to make an ebuild): http://blahg.josefsipek.net/?p=440. Any insight appreciated! --f46d0435c052d9fbc405139c1499 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
I'm having an issue building the latest mast= er branch on Gentoo linux. Configure and make succeed as expected, but &quo= t;sudo make install" fails on PMDA, and I'm having trouble unwindi= ng the nested make-ing that's going on to figure out the problem... Her= e's the output:

=3D=3D=3D PMDA =3D=3D=3D
rm -rf PCP-PMDA-* MY= META.yml MYMETA.json
make -f Makefile dist
rm -rf PCP-PMDA-1.15
/u= sr/bin/perl5.12.4 "-MExtUtils::Manifest=3Dmanicopy,maniread" \=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -e "manicopy(maniread(),&#= 39;PCP-PMDA-1.15', 'best');"
mkdir PCP-PMDA-1.15
Gen= erating META.yml
Generating META.json
tar cvf PCP-PMDA-1.15.tar PCP-P= MDA-1.15
PCP-PMDA-1.15/
PCP-PMDA-1.15/MANIFEST
PCP-PMDA-1.15/META.= yml
PCP-PMDA-1.15/Changes
PCP-PMDA-1.15/cvalue.c
PCP-PMDA-1.15/PMD= A.pm
PCP-PMDA-1.15/COPYING
PCP-PMDA-1.15/META.json
PCP-PMDA-1.15/l= ocal.c
PCP-PMDA-1.15/local.h
PCP-PMDA-1.15/typemap
PCP-PMDA-1.15/P= MDA.xs
PCP-PMDA-1.15/test.pl
PCP-PMDA-= 1.15/Makefile.PL
rm -rf PCP-PMDA-1.15
gzip --best PCP-PMDA-1.15.tarmake -f Makefile install DESTDIR=3D$DIST_ROOT | tee pack.list; sed -n -e = '/\.bs$/d' -e 's/\.[0-9]pm$/&.gz/' -e "s@^Installi= ng $DIST_ROOT@@p" <pack.list >../../../perl-pcp-pmda.list || exi= t 1; if [ -s ../../../perl-pcp-pmda.list ]; then rm -f pack.list; else echo= "Arrgh ... no files to include in package via ../../../perl-pcp-pmda.= list, see pack.list"; exit 1; fi; find $DIST_ROOT//usr -name perllocal= .pod -exec rm -f '{}' ';' ; find $DIST_ROOT//usr -name \*.b= s=C2=A0 -exec rm -f '{}' ';' ; find $DIST_ROOT//usr -name P= MDA.so -exec chmod 755 '{}' ';'
Files found in blib/arch= : installing files in blib/lib into architecture dependent library tree
= Arrgh ... no files to include in package via ../../../perl-pcp-pmda.list, s= ee pack.list
make[3]: *** [install] Error 1
make[2]: *** [install] Er= ror 2
make[1]: *** [install_pcp] Error 2
make[1]: Leaving directory `= /home/mblackwell/src/pcp/src'
make: *** [install_pcp] Error 2
There's a blog post from back in 2011 that maybe hints at the pr= oblem but doesn't fully explain the solution for PMDA (and I'm not = trying to make an ebuild): http://blahg.josefsipek.net/?p=3D440.

Any insight appreci= ated!

--f46d0435c052d9fbc405139c1499-- From minnus@buffalo.edu Mon Apr 13 15:12:38 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 31FA77F51 for ; Mon, 13 Apr 2015 15:12:38 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id CFE41AC004 for ; Mon, 13 Apr 2015 13:12:37 -0700 (PDT) X-ASG-Debug-ID: 1428955952-04bdf06320203b40001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id ukeqliCmc8qssdTZ for ; Mon, 13 Apr 2015 13:12:32 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmailB.acsu.buffalo.edu (localmailb.acsu.buffalo.edu [128.205.5.200]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id CA216CCD for ; Mon, 13 Apr 2015 16:12:31 -0400 (EDT) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id C412CE117 for ; Mon, 13 Apr 2015 16:12:31 -0400 (EDT) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailB.acsu.buffalo.edu (Postfix) with ESMTP id 1C92CE112 for ; Mon, 13 Apr 2015 16:12:31 -0400 (EDT) Received: from smtp.buffalo.edu (smtp2.acsu.buffalo.edu [128.205.5.254]) by localmailB.acsu.buffalo.edu (Prefixe) with ESMTP id 0E45EE111 for ; Mon, 13 Apr 2015 16:12:31 -0400 (EDT) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 0499B2ACE for ; Mon, 13 Apr 2015 16:12:31 -0400 (EDT) Message-ID: <552C232E.6050802@buffalo.edu> Date: Mon, 13 Apr 2015 16:12:30 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: reserve domain number Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: reserve domain number Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1428955952 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA717 X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17879 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC0_SA717 Custom Rule BSF_SC0_SA717 Hi, Could i get a domain number reserved for a Slurm pmda? http://slurm.schedmd.com/ No code to show yet, but with the recent pmns cleanup, I wasn't sure if there is a preference where it should slot in. Thanks Martins From fche@redhat.com Mon Apr 13 15:24:11 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 60CFE7F51 for ; Mon, 13 Apr 2015 15:24:11 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id EF9EFAC002 for ; Mon, 13 Apr 2015 13:24:10 -0700 (PDT) X-ASG-Debug-ID: 1428956649-04cb6c1cca1e7940001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id JwdrB9w6jdSHsrrC (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 13 Apr 2015 13:24:09 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (Postfix) with ESMTPS id 0E9148EA48 for ; Mon, 13 Apr 2015 20:24:09 +0000 (UTC) Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3DKO8Ok030446 for ; Mon, 13 Apr 2015 16:24:08 -0400 Received: by fche.csb (Postfix, from userid 2569) id AF9A15869C; Mon, 13 Apr 2015 16:24:05 -0400 (EDT) Date: Mon, 13 Apr 2015 16:24:05 -0400 From: "Frank Ch. Eigler" To: pcp developers Subject: pcp update: pmwebd crasher bug fix (vector issue #31) Message-ID: <20150413202405.GA7017@redhat.com> X-ASG-Orig-Subj: pcp update: pmwebd crasher bug fix (vector issue #31) Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1428956649 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - On pcpfans.git fche/pmwebd, a patch to consider cherry-picking:: commit 188db3452a06303c2992f9f6e2f858779a29c33b Author: Frank Ch. Eigler Date: Mon Apr 13 16:17:08 2015 -0400 pmwebd: correct _indom array-allocation logic As reported by Carlos Torres, pmwebd had a bug with handling pmapi/_indom queries with many instance=XXX items, because of the way it calculated a limit from the string parameters. With enough of them, pmwebd could throw an assertion failure: [Mon Apr 13 18:29:03] pmwebd(8855): [:39386] HTTP/1.1 GET /pmapi/66857211/_indom instance=0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23 name=kernel.percpu.cpu.user pmwebd: pmwebapi.cxx:918: int pmwebapi_respond_instance_list(MHD_Connection*, const http_params&, webcontext*): Assertion `num_instances < max_num_instances' failed. A one-line typo was responsible. QA included. From nscott@redhat.com Mon Apr 13 19:01:43 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 336497CBF for ; Mon, 13 Apr 2015 19:01:43 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id C4716AC002 for ; Mon, 13 Apr 2015 17:01:39 -0700 (PDT) X-ASG-Debug-ID: 1428969694-04cb6c1cc71ecc70001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id nIbjNRpCEVDgHbef (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 13 Apr 2015 17:01:35 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3E01XbN032515; Mon, 13 Apr 2015 20:01:33 -0400 Date: Mon, 13 Apr 2015 20:01:33 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: pcp Message-ID: <1849056065.17884758.1428969693402.JavaMail.zimbra@redhat.com> In-Reply-To: <20150413130259.GJ13158@redhat.com> References: <765204112.14979385.1428575388121.JavaMail.zimbra@redhat.com> <1283758678.17040206.1428908657815.JavaMail.zimbra@redhat.com> <20150413130259.GJ13158@redhat.com> Subject: Re: pcp updates: qa, docs, fixes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: pcp updates: qa, docs, fixes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: qa, docs, fixes Thread-Index: D6BbBpLVv9doJWb5VG1qrdZCjsbyaw== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1428969694 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17886 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > > [...] > > > %dir /usr/share/pcp/webapps > > [...] > > So, /usr/share/pcp comes from package "pcp" and /usr/share/pcp/webapps > > comes from package "pcp-webapi". [...] > > The confusion here is between "unowned" and "multiply-owned" > directories. Oh, interesting! I didn't realise rpm supported this - good to know, yes, we should definitely do that then. cheers. -- Nathan From nscott@redhat.com Mon Apr 13 19:02:47 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 7EB687CBF for ; Mon, 13 Apr 2015 19:02:47 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id EC94CAC001 for ; Mon, 13 Apr 2015 17:02:46 -0700 (PDT) X-ASG-Debug-ID: 1428969762-04cbb056b221a3d0001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id 7IiQyzO7j8uUlThX (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 13 Apr 2015 17:02:43 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3E02g8B044695 for ; Mon, 13 Apr 2015 20:02:42 -0400 Date: Mon, 13 Apr 2015 20:02:42 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp Message-ID: <1477102999.17885346.1428969762507.JavaMail.zimbra@redhat.com> In-Reply-To: <1698495953.17885326.1428969750796.JavaMail.zimbra@redhat.com> Subject: pcp updates: pmwebd, rpm spec, qa MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: pmwebd, rpm spec, qa Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: pmwebd, rpm spec, qa Thread-Index: 5E0xui7fISN7Tfz1DEKFjqQrCEJpeA== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1428969763 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17886 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git master Nathan Scott (3): qa: extend python api test with extra bytes/unicode checking build: simplify rpm dependencies on pcp-webjs package pmns: reserve a domain identifier for the slurm PMDA Frank Ch. Eigler (1): pmwebd: correct _indom array-allocation logic build/rpm/fedora.spec | 10 +++++++--- qa/662.out.4 | 3 +++ qa/662.out.46 | 6 ++++++ qa/src/test_pcp.python | 14 +++++++++++--- qa/src/test_webapi.python | 3 ++- src/pmns/stdpmid.pcp | 1 + src/pmwebapi/pmwebapi.cxx | 4 ++-- 7 files changed, 32 insertions(+), 9 deletions(-) From nscott@redhat.com Mon Apr 13 19:03:41 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id BC0D77CBF for ; Mon, 13 Apr 2015 19:03:40 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id B257E8F8052 for ; Mon, 13 Apr 2015 17:03:40 -0700 (PDT) X-ASG-Debug-ID: 1428969818-04cb6c1cc71ecd00001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id XfWYAiRUHo3l0Z7H (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 13 Apr 2015 17:03:39 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3E03bj0032639; Mon, 13 Apr 2015 20:03:37 -0400 Date: Mon, 13 Apr 2015 20:03:37 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus Cc: pcp@oss.sgi.com Message-ID: <16010883.17885445.1428969817237.JavaMail.zimbra@redhat.com> In-Reply-To: <552C232E.6050802@buffalo.edu> References: <552C232E.6050802@buffalo.edu> Subject: Re: [pcp] reserve domain number MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] reserve domain number Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: reserve domain number Thread-Index: KxNlufRE4MbW3NZIPwN4dFhCIppKPw== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1428969819 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17886 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > Hi, > Could i get a domain number reserved for a Slurm pmda? > > http://slurm.schedmd.com/ > > No code to show yet, but with the recent pmns cleanup, I wasn't sure if > there is a preference where it should slot in. No problem - done in master branch now. cheers. -- Nathan From kenj@internode.on.net Tue Apr 14 00:34:23 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 8ECF67F37 for ; Tue, 14 Apr 2015 00:34:23 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 3A06AAC003 for ; Mon, 13 Apr 2015 22:34:20 -0700 (PDT) X-ASG-Debug-ID: 1428989654-04bdf06320210c50001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id BcGMuormIsIeoLWn for ; Mon, 13 Apr 2015 22:34:14 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2CWAQDtpSxV/6Eh0XYNT4NeXMcKhgUCghEBAQEBAQGFHgEBBCcRQBELGAkWDwkDAgECAUUTCAEBvW+XDAEBCAIBH4JNiF6FAxaEFwEEjnKGE4czOoJ9kBiCJRyBYl0BgkIBAQE Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail07.adl2.internode.on.net with ESMTP; 14 Apr 2015 15:04:13 +0930 Message-ID: <552CA769.1070607@internode.on.net> Date: Tue, 14 Apr 2015 15:36:41 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] pmLookupName sts differences References: <551D8119.5010404@buffalo.edu> X-ASG-Orig-Subj: Re: [pcp] pmLookupName sts differences In-Reply-To: <551D8119.5010404@buffalo.edu> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1428989654 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17894 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 03/04/15 04:49, Martins Innus wrote: > Hi, > Please see the attached code for an example of differences in > return value for pmLookupName when a metric is not found depending on > whether the top level namespace is handled by a dynamic pmda. For a > regular metric (non dynamic) if we give it a bogus metric name, the > function returns fine, the appropriate pmID is set to NULL and "sts" > reflects the valid number of names converted, as expected. Martins, The pmLookupName API is broken for error cases in more ways than just dynamic metrics. 1. the man page is ambiguous 2. the code in libpcp and pmcd is not consistent, e.g. pmLookupName -> -12357: Unknown metric name [0] bad.metric.name PM_ID_NULL pmLookupName -> 2 [0] sampledso.long.one 30.0.10 [1] sampledso.no.such.name PM_ID_NULL [2] sampledso.long.ten 30.0.11 [3] bad.metric.name PM_ID_NULL 3. the function is executed in 4 different contexts (local PMNS, PM_CONTEXT_LOCAL, PM_CONTEXT_HOST and PM_CONTEXT_ARCHIVE) and the error cases are not handled the same in all contexts. 4. a metric name may fail to be looked up for a myriad of reasons. Sigh. I have a growing qa test (909) that is mapping out the places where this appears to be broken, then (after the next release is done) I'll start making code changes ... this will change the semantics of the ABI so I am very nervous about which path to take. More details when I know how deep and smelly the bog is. Thanks for bringing this up ... 8^)> From mgoodwin@redhat.com Tue Apr 14 00:57:55 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 44F0B7F37 for ; Tue, 14 Apr 2015 00:57:55 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id C345FAC001 for ; Mon, 13 Apr 2015 22:57:54 -0700 (PDT) X-ASG-Debug-ID: 1428991072-04cbb056b1221840001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id XV7BETBTxoQl3PWq (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 13 Apr 2015 22:57:53 -0700 (PDT) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (Postfix) with ESMTPS id C77A38EA47 for ; Tue, 14 Apr 2015 05:57:52 +0000 (UTC) Received: from [10.64.50.121] (vpn1-50-121.bne.redhat.com [10.64.50.121]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3E5vp0F023481 for ; Tue, 14 Apr 2015 01:57:52 -0400 Message-ID: <552CAC5E.2020201@redhat.com> Date: Tue, 14 Apr 2015 15:57:50 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp Subject: libpfm-devel-4.4 not available for older fedora Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: libpfm-devel-4.4 not available for older fedora Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1428991073 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Trying to build on f19, which isn't that old, but configure is insisting on libpfm-4.4 or later, which isn't available for f19. Is that really a version dependency, or would 4.3 still be OK? == Building rpm packages, log is in /home/mgoodwin/src/git/pcp/Logs/pcp make: Entering directory `/home/mgoodwin/src/git/pcp/pcp-3.10.4/build/rpm' Generating pcp.spec from pcp.spec.in DEFS=`grep '^--define' rpmmacros`; \ eval /usr/bin/rpmbuild -ba $DEFS \ --clean pcp.spec error: Failed build dependencies: libpfm-devel >= 4.4 is needed by pcp-3.10.4-1.x86_64 make: *** [pack_pcp] Error 1 make: Leaving directory `/home/mgoodwin/src/git/pcp/pcp-3.10.4/build/rpm' # sudo yum install libpfm-devel Loaded plugins: auto-update-debuginfo, langpacks, refresh-packagekit http://download.lab.bos.redhat.com/rel-eng/dist-git/fedora/19/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found Trying other mirror. Package libpfm-devel-4.3.0-3.fc19.x86_64 already installed and latest version Nothing to do From nscott@redhat.com Tue Apr 14 01:10:04 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 868417F3F for ; Tue, 14 Apr 2015 01:10:04 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 13C36AC002 for ; Mon, 13 Apr 2015 23:10:00 -0700 (PDT) X-ASG-Debug-ID: 1428991796-04cbb056b1221d40001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id 2eFITvenweFdRdaD (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 13 Apr 2015 23:09:57 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3E69ucY019833; Tue, 14 Apr 2015 02:09:56 -0400 Date: Tue, 14 Apr 2015 02:09:55 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Mark Goodwin Cc: pcp Message-ID: <1035731988.17998482.1428991795561.JavaMail.zimbra@redhat.com> In-Reply-To: <552CAC5E.2020201@redhat.com> References: <552CAC5E.2020201@redhat.com> Subject: Re: [pcp] libpfm-devel-4.4 not available for older fedora MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] libpfm-devel-4.4 not available for older fedora Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: libpfm-devel-4.4 not available for older fedora Thread-Index: hNdVceXDU2IUx3bM/Qd2G23T3mMNdg== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1428991797 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17895 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi Mark, ----- Original Message ----- > Trying to build on f19, which isn't that old, but configure > is insisting on libpfm-4.4 or later, which isn't available > for f19. Is that really a version dependency, or would 4.3 > still be OK? In order to get as far as you did, the configure checks have all passed & we've attempted a build with the perfevent PMDA in the mix. Unless Joe can point out the specific reason that we've got 4.4 there (not triggering any memory here) maybe try lowering the specific version# dep and try a fresh build? Else, we should tighten up the configure.ac checks so that the Makepkgs build doesn't attempt to build that component. cheers. -- Nathan From myllynen@redhat.com Tue Apr 14 05:04:30 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 3760A7F56 for ; Tue, 14 Apr 2015 05:04:30 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id B8F2FAC001 for ; Tue, 14 Apr 2015 03:04:26 -0700 (PDT) X-ASG-Debug-ID: 1429005861-04cbb056b2229aa0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 1Exu9Pz2N7doWINe (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 03:04:22 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (Postfix) with ESMTPS id 81FAF8EB0B for ; Tue, 14 Apr 2015 10:04:21 +0000 (UTC) Received: from mmyllyne.csb (vpn1-7-113.ams2.redhat.com [10.36.7.113]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3EA4K5k027805 for ; Tue, 14 Apr 2015 06:04:20 -0400 Message-ID: <552CE623.6000103@redhat.com> Date: Tue, 14 Apr 2015 13:04:19 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: pcp developers Subject: Using PCP to log sysstat metrics Content-Type: text/plain; charset=UTF-8 X-ASG-Orig-Subj: Using PCP to log sysstat metrics Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429005862 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, there was some off-list discussion what it would require to use PCP to collect the exact same metrics which sysstat collects by default on many distributions with: # Run system activity accounting tool every 10 minutes */10 * * * * root /usr/lib64/sa/sa1 1 1 I wonder does anyone see any issues with a simple solution like this which relies on sar2pcp to generate the list of the needed metrics: # sar2pcp /var/log/sa/sa13 /tmp/sa13-pcp # echo 'log mandatory on every 10 minutes {' > /etc/pcp/pmlogger/pcp-sa # pminfo -a /tmp/sa13-pcp | sort >> /etc/pcp/pmlogger/pcp-sa # echo '}' >> /etc/pcp/pmlogger/pcp-sa # rm -f /tmp/sa13-pcp* # echo 'LOCALHOSTNAME n n PCP_LOG_DIR/pmlogger/pcp-sa/LOCALHOSTNAME -r -T24h10m -c config.pcp-sa' >> /etc/pcp/pmlogger/control # chkconfig pmlogger on # service pmlogger restart Thanks, -- Marko Myllynen From fche@redhat.com Tue Apr 14 07:11:07 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 668267F47 for ; Tue, 14 Apr 2015 07:11:07 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 5D350304039 for ; Tue, 14 Apr 2015 05:11:06 -0700 (PDT) X-ASG-Debug-ID: 1429013462-04cbb056b4230dd0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id QGGxTV0Jq44etvJf (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 05:11:02 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3ECAwxo029588 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Tue, 14 Apr 2015 08:10:58 -0400 Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3ECAw3k002867; Tue, 14 Apr 2015 08:10:58 -0400 Received: by fche.csb (Postfix, from userid 2569) id 51817585D2; Tue, 14 Apr 2015 08:10:55 -0400 (EDT) To: Ken McDonell Cc: pcp@oss.sgi.com Subject: Re: pmLookupName sts differences References: <551D8119.5010404@buffalo.edu> <552CA769.1070607@internode.on.net> X-ASG-Orig-Subj: Re: pmLookupName sts differences From: fche@redhat.com (Frank Ch. Eigler) Date: Tue, 14 Apr 2015 08:10:55 -0400 In-Reply-To: <552CA769.1070607@internode.on.net> (Ken McDonell's message of "Tue, 14 Apr 2015 15:36:41 +1000") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429013462 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 > [...] More details when I know how deep and smelly the bog is. For the record, I first read that as dog and it made me shudder. - FChE From fche@redhat.com Tue Apr 14 07:15:27 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 2EBD87F47 for ; Tue, 14 Apr 2015 07:15:27 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 206E18F8050 for ; Tue, 14 Apr 2015 05:15:24 -0700 (PDT) X-ASG-Debug-ID: 1429013722-04cbb056b1231260001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id Rj9W7Ux7JVi1gyHf (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 05:15:23 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (Postfix) with ESMTPS id CBA348EFE0 for ; Tue, 14 Apr 2015 12:15:22 +0000 (UTC) Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3ECFMFN018796; Tue, 14 Apr 2015 08:15:22 -0400 Received: by fche.csb (Postfix, from userid 2569) id 69D07585D2; Tue, 14 Apr 2015 08:15:14 -0400 (EDT) To: myllynen@redhat.com Cc: pcp developers Subject: Re: Using PCP to log sysstat metrics References: <552CE623.6000103@redhat.com> X-ASG-Orig-Subj: Re: Using PCP to log sysstat metrics From: fche@redhat.com (Frank Ch. Eigler) Date: Tue, 14 Apr 2015 08:15:14 -0400 In-Reply-To: <552CE623.6000103@redhat.com> (Marko Myllynen's message of "Tue, 14 Apr 2015 13:04:19 +0300") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429013723 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Marko Myllynen writes: > [...] there was some off-list discussion what it would require to > use PCP to collect the exact same metrics which sysstat collects by > default on many distributions with: [...] Have you seen the src/pmlogconf/tools/sar file? It sounds like someone's already done the analysis. It's even activated by default, at the 1-minute sampling interval. Or are you specifically interested in not recording anything but the sar stuff? - FChE From nscott@redhat.com Tue Apr 14 07:28:35 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 147A57F47 for ; Tue, 14 Apr 2015 07:28:35 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 08D948F8059 for ; Tue, 14 Apr 2015 05:28:34 -0700 (PDT) X-ASG-Debug-ID: 1429014512-04cbb056b4232380001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id F3spHoBuQPWVTrM1 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 05:28:33 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3ECSUPH007426; Tue, 14 Apr 2015 08:28:30 -0400 Date: Tue, 14 Apr 2015 08:28:29 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp Message-ID: <851000231.18273995.1429014509380.JavaMail.zimbra@redhat.com> In-Reply-To: <2139626475.18057292.1428997991667.JavaMail.zimbra@redhat.com> Subject: Mac OS X builds MIME-Version: 1.0 X-ASG-Orig-Subj: Mac OS X builds Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Mac OS X builds Thread-Index: pZHnTlWJUvyMyS0mR5UjCp8mp491Kw== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1429014512 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17905 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Ken, Just some notes from recent build updates I found I needed for Mac OS X. Previously Makepkgs failed, configure failed, then the libpcp build check-statics failed - these are fixed up now. We'll permanently need the following additions to a stock Mac install, for building on OS X: - XCode (as always, needs an Apple developer ID now too) - Auxillary Tools for XCode (for packagemaker) - MacPorts.org (now needed for pkg-config, gnutar) - Qt (install and set QTDIR, as before) Not sure if there's a spot we keep these kinds of notes? It doesn't look like INSTALL is the right place, that's more end- user focussed. cheers. -- Nathan From nscott@redhat.com Tue Apr 14 07:30:55 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 8A8317F47 for ; Tue, 14 Apr 2015 07:30:55 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 7DA22304032 for ; Tue, 14 Apr 2015 05:30:55 -0700 (PDT) X-ASG-Debug-ID: 1429014651-04cb6c1cc7202b60001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id HBLDWLB9UXNA8p0H (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 05:30:52 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3ECUp21042305 for ; Tue, 14 Apr 2015 08:30:51 -0400 Date: Tue, 14 Apr 2015 08:30:51 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp Message-ID: <873772944.18274498.1429014651634.JavaMail.zimbra@redhat.com> Subject: pcp updates: mac + rpm packaging MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: mac + rpm packaging Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: mac + rpm packaging Thread-Index: JnXHTuyQbBjy2EsDvhA8d8MTxQXiSQ== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1429014652 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17905 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git master INSTALL | 11 +---- Makepkgs | 4 +- build/rpm/fedora.spec | 82 ++++++++++++++++++++++++++++++++++++++----- configure | 7 +++ configure.ac | 6 ++- src/libpcp/src/check-statics | 12 ++++-- src/libpcp/src/rtime.c | 5 ++ src/libpcp/src/util.c | 6 ++- 8 files changed, 104 insertions(+), 29 deletions(-) commit 60d3274f565716448547f3d2fa0be1991472f158 Author: Nathan Scott Date: Tue Apr 14 17:40:37 2015 +1000 build: get Mac builds going on current Mac OS X (10.9/10.10) Updated INSTALL file, was a bit out of date. Update Makepkgs to find Apple gzip. Several check-statics related changes to get the libpcp build going with LLVM compilers. Get configure to look in more places for a PackageMaker installation. Note: latest Mac releases have removed gnutar, and pkg-config does not come pre-installed on Mac. These have to be sourced from MacPorts.org now to get a successful build. commit e456a8c367bbb6292c0175aca2515b85e3873be7 Author: Nathan Scott Date: Tue Apr 14 12:04:45 2015 +1000 build: rpm sub-packages for web applications Finer-grained rpm installations for folks using PCP web services. This creates sub-packages for pcp-webjs such that small footprint installations are possible (e.g. production installs, container installs) and users get to pick and choose the webapps they want. Installing pcp-webjs gets you everything as before, but specific frontends (graphite, grafana or vector) can now be individually installed as well. From nscott@redhat.com Tue Apr 14 07:32:19 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 12BA27F47 for ; Tue, 14 Apr 2015 07:32:19 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 05E59304039 for ; Tue, 14 Apr 2015 05:32:18 -0700 (PDT) X-ASG-Debug-ID: 1429014737-04cb6c1cca202d50001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id l7I6khbQplOopKoe (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 05:32:17 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3ECWFjE008490; Tue, 14 Apr 2015 08:32:15 -0400 Date: Tue, 14 Apr 2015 08:32:15 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" , Martin Spier Cc: pcp Message-ID: <295852369.18275288.1429014735251.JavaMail.zimbra@redhat.com> In-Reply-To: <1032054518.18050620.1428997704479.JavaMail.zimbra@redhat.com> Subject: PCP webapps packaging split MIME-Version: 1.0 X-ASG-Orig-Subj: PCP webapps packaging split Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: PCP webapps packaging split Thread-Index: 0aHg940EYjT7Mmut84ruGSorNHg9uw== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1429014737 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17905 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi guys, I've pushed in the RPM spec changes to do the webapp packaging split discussed on IRC the other day, allowing folks to choose just the webapp(s) they/need want to use. The disk utilisation was very different to the 25% number that was bandied around (where did that come from?) - Vector gives a ~100% increase in webjs size, and the other numbers didn't seem to reflect current reality either (all together upward of ~30MB not sub-20MB as earlier thought). $ rpm -qi pcp-webapp-vector | grep ^Size Size : 16169540 $ rpm -qi pcp-webapp-graphite | grep ^Size Size : 8392868 $ rpm -qi pcp-webapp-grafana | grep ^Size Size : 3675204 $ rpm -qi pcp-webjs | grep ^Size Size : 3725242 (for comparison & these will soon be smaller...) $ rpm -qi pcp | grep ^Size Size : 4998259 $ rpm -qi pcp-libs | grep ^Size Size : 673440 Anyway, my testing today suggests it's looking good, so please take a close look and try it out if on an rpm distro if you can. Martin, if your deb packaging for Vector could use the same conventions (dropping files into /usr/share/pcp/webapps/vector, same package name for docs consistency) that would be ideal. cheers. -- Nathan From nscott@redhat.com Tue Apr 14 07:41:36 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 657787F47 for ; Tue, 14 Apr 2015 07:41:36 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 01584AC001 for ; Tue, 14 Apr 2015 05:41:32 -0700 (PDT) X-ASG-Debug-ID: 1429015290-04bdf06322223110001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id UJ6Q2gqcdZ514uxl (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 05:41:31 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3ECfThl009715; Tue, 14 Apr 2015 08:41:29 -0400 Date: Tue, 14 Apr 2015 08:41:29 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Mike Blackwell Cc: pcp@oss.sgi.com Message-ID: <1695957904.18280613.1429015289170.JavaMail.zimbra@redhat.com> In-Reply-To: References: Subject: Re: [pcp] make install problem on Gentoo MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] make install problem on Gentoo Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: make install problem on Gentoo Thread-Index: RuBlG717NcbumInF0oRb0lLTvekEfA== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1429015291 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17905 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > I'm having an issue building the latest master branch on Gentoo linux. > Configure and make succeed as expected, but "sudo make install" fails on > PMDA, (so, this is building the perl PCP::PMDA module, for reference - you don't really need this for a functional PCP, but it enables PCP agents written in perl) > and I'm having trouble unwinding the nested make-ing that's going on > to figure out the problem... Here's the output: > [...] > make -f Makefile install DESTDIR=$DIST_ROOT | tee pack.list; sed -n -e > '/\.bs$/d' -e 's/\.[0-9]pm$/&.gz/' -e "s@^Installing $DIST_ROOT@@p" > ../../../perl-pcp-pmda.list || exit 1; if [ -s Locate "pack.list" in your build tree, which is built based on the contents of what MakeMaker thinks should be in the new perl module. Then see if it has anything useful in it & if so, why the file list there isn't making it into perl-pcp-pmda after the above sed command. > ../../../perl-pcp-pmda.list ]; then rm -f pack.list; else echo "Arrgh ... no > files to include in package via ../../../perl-pcp-pmda.list, see pack.list"; > [...] > Arrgh ... no files to include in package via ../../../perl-pcp-pmda.list, see > pack.list Refer to the src/include/builddefs file in the tree, which has some gentoo- specific code (i.e. in the PERL_GET_FILELIST macro). cheers. -- Nathan From myllynen@redhat.com Tue Apr 14 07:46:12 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id AFA3D7F51 for ; Tue, 14 Apr 2015 07:46:12 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 91E8430404E for ; Tue, 14 Apr 2015 05:46:12 -0700 (PDT) X-ASG-Debug-ID: 1429015570-04cbb056b2233a20001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id HTS8FUgTSUEGGml1 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 05:46:11 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (Postfix) with ESMTPS id 9514E325561 for ; Tue, 14 Apr 2015 12:46:10 +0000 (UTC) Received: from mmyllyne.csb (vpn1-4-235.ams2.redhat.com [10.36.4.235]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3ECk6YY014622; Tue, 14 Apr 2015 08:46:09 -0400 Message-ID: <552D0C0E.6050703@redhat.com> Date: Tue, 14 Apr 2015 15:46:06 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: "Frank Ch. Eigler" CC: pcp developers Subject: Re: Using PCP to log sysstat metrics References: <552CE623.6000103@redhat.com> X-ASG-Orig-Subj: Re: Using PCP to log sysstat metrics In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429015571 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, On 2015-04-14 15:15, Frank Ch. Eigler wrote: > Marko Myllynen writes: > >> [...] there was some off-list discussion what it would require to >> use PCP to collect the exact same metrics which sysstat collects by >> default on many distributions with: [...] > > Have you seen the src/pmlogconf/tools/sar file? It sounds like > someone's already done the analysis. It's even activated by default, > at the 1-minute sampling interval. Or are you specifically interested > in not recording anything but the sar stuff? no and yes, I hadn't seen it before and I was interested in minimal steps to create something that records just the sar stuff. But looks like there are now several ways to achieve it so should be easy to do so if needed. Thanks, -- Marko Myllynen From fche@redhat.com Tue Apr 14 07:47:15 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id C52217F51 for ; Tue, 14 Apr 2015 07:47:15 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 4DB02AC002 for ; Tue, 14 Apr 2015 05:47:15 -0700 (PDT) X-ASG-Debug-ID: 1429015633-04cbb056b4233b10001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 4q6mnXF8UDhVn6QB (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 05:47:13 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3EClBre027911 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Tue, 14 Apr 2015 08:47:11 -0400 Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3EClB2k003809; Tue, 14 Apr 2015 08:47:11 -0400 Received: by fche.csb (Postfix, from userid 2569) id 098BA585D2; Tue, 14 Apr 2015 08:47:07 -0400 (EDT) Date: Tue, 14 Apr 2015 08:47:07 -0400 From: "Frank Ch. Eigler" To: Nathan Scott Cc: Martin Spier , pcp Subject: Re: PCP webapps packaging split Message-ID: <20150414124707.GB7017@redhat.com> X-ASG-Orig-Subj: Re: PCP webapps packaging split References: <1032054518.18050620.1428997704479.JavaMail.zimbra@redhat.com> <295852369.18275288.1429014735251.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <295852369.18275288.1429014735251.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429015633 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - > I've pushed in the RPM spec changes to do the webapp packaging > split discussed on IRC the other day, allowing folks to choose > just the webapp(s) they/need want to use. It seems like solving a non-problem. > The disk utilisation was very different to the 25% number that > was bandied around (where did that come from?) (It was compared to prior version install tree; that latter also shrank as an earlier verson of grafana was retired.) > $ rpm -qi pcp-webapp-vector | grep ^Size > Size : 16169540 > $ rpm -qi pcp-webapp-graphite | grep ^Size > Size : 8392868 > $ rpm -qi pcp-webapp-grafana | grep ^Size > Size : 3675204 > $ rpm -qi pcp-webjs | grep ^Size > Size : 3725242 What of the index.html file? - FChE From nscott@redhat.com Tue Apr 14 07:58:59 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 74B807F51 for ; Tue, 14 Apr 2015 07:58:59 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 56D108F8039 for ; Tue, 14 Apr 2015 05:58:59 -0700 (PDT) X-ASG-Debug-ID: 1429016336-04bdf06323224440001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id YzBRBrz1pxaxZEjx (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 05:58:57 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3ECwsmE013291; Tue, 14 Apr 2015 08:58:54 -0400 Date: Tue, 14 Apr 2015 08:58:54 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: Martin Spier , pcp Message-ID: <1279062620.18288766.1429016334583.JavaMail.zimbra@redhat.com> In-Reply-To: <20150414124707.GB7017@redhat.com> References: <1032054518.18050620.1428997704479.JavaMail.zimbra@redhat.com> <295852369.18275288.1429014735251.JavaMail.zimbra@redhat.com> <20150414124707.GB7017@redhat.com> Subject: Re: PCP webapps packaging split MIME-Version: 1.0 X-ASG-Orig-Subj: Re: PCP webapps packaging split Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: PCP webapps packaging split Thread-Index: mtcgbSsnqW8g1VAlZgO/UOZEdeW5Ug== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1429016336 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17906 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > [...] > What of the index.html file? Please take the time to actually look at the changes before replying. That said, there should be few surprises - its simply implementing the IRC discussion from Monday. cheers. -- Nathan From minnus@buffalo.edu Tue Apr 14 09:06:32 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 87C827F47 for ; Tue, 14 Apr 2015 09:06:32 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 69F9C304032 for ; Tue, 14 Apr 2015 07:06:29 -0700 (PDT) X-ASG-Debug-ID: 1429020387-04cb6c1cc9209070001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id Cgs1lFrj0mApGxDD for ; Tue, 14 Apr 2015 07:06:27 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmailD.acsu.buffalo.edu (localmaild.acsu.buffalo.edu [128.205.5.208]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id D4735279; Tue, 14 Apr 2015 10:06:26 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id CA7882FFE5; Tue, 14 Apr 2015 10:06:26 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailD.acsu.buffalo.edu (Postfix) with ESMTP id E275B2FFE2; Tue, 14 Apr 2015 10:06:25 -0400 (EDT) Received: from smtp.buffalo.edu (smtp3.acsu.buffalo.edu [128.205.5.226]) by localmailD.acsu.buffalo.edu (Prefixe) with ESMTP id CE6D62FFDB; Tue, 14 Apr 2015 10:06:25 -0400 (EDT) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id C380C2DA6; Tue, 14 Apr 2015 10:06:25 -0400 (EDT) Message-ID: <552D1EE1.5000600@buffalo.edu> Date: Tue, 14 Apr 2015 10:06:25 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Ken McDonell , pcp@oss.sgi.com Subject: Re: [pcp] pmLookupName sts differences References: <551D8119.5010404@buffalo.edu> <552CA769.1070607@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] pmLookupName sts differences In-Reply-To: <552CA769.1070607@internode.on.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1429020387 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17907 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Ken, On 4/14/15 1:36 AM, Ken McDonell wrote: >> Hi, >> Please see the attached code for an example of differences in >> return value for pmLookupName when a metric is not found depending on >> whether the top level namespace is handled by a dynamic pmda. For a >> regular metric (non dynamic) if we give it a bogus metric name, the >> function returns fine, the appropriate pmID is set to NULL and "sts" >> reflects the valid number of names converted, as expected. > > Martins, > > The pmLookupName API is broken for error cases in more ways than just > dynamic metrics. > > 1. the man page is ambiguous > 2. the code in libpcp and pmcd is not consistent, e.g. > > pmLookupName -> -12357: Unknown metric name > [0] bad.metric.name PM_ID_NULL > > pmLookupName -> 2 > [0] sampledso.long.one 30.0.10 > [1] sampledso.no.such.name PM_ID_NULL > [2] sampledso.long.ten 30.0.11 > [3] bad.metric.name PM_ID_NULL > > 3. the function is executed in 4 different contexts (local PMNS, > PM_CONTEXT_LOCAL, PM_CONTEXT_HOST and PM_CONTEXT_ARCHIVE) and the > error cases are not handled the same in all contexts. > > 4. a metric name may fail to be looked up for a myriad of reasons. OK, thanks for digging deeper into this. > > Sigh. > > I have a growing qa test (909) that is mapping out the places where > this appears to be broken, then (after the next release is done) I'll > start making code changes ... this will change the semantics of the > ABI so I am very nervous about which path to take. Yes, I had figured as much. From my perspective, it would be desirable for pmLookupName give back correct information on valid metrics even if the input list contains some bogus names. Also, the python (and maybe perl, haven't checked) bindings will be affected by any changes here. This was all triggered by my use of the python bindings where the python implementation of pmLookupName does different things depending on the status returned. > > More details when I know how deep and smelly the bog is. > > Thanks for bringing this up ... 8^)> You're welcome? :) Martins From fche@redhat.com Tue Apr 14 10:32:24 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 8DA857F47 for ; Tue, 14 Apr 2015 10:32:24 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 290D2AC003 for ; Tue, 14 Apr 2015 08:32:21 -0700 (PDT) X-ASG-Debug-ID: 1429025540-04bdf063222302e0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id ZFTjhn0pPW5EYXno (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 08:32:20 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (Postfix) with ESMTPS id 4DDE8A0BB5; Tue, 14 Apr 2015 15:32:20 +0000 (UTC) Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3EFWJeH004124; Tue, 14 Apr 2015 11:32:20 -0400 Received: by fche.csb (Postfix, from userid 2569) id C81BE586B1; Tue, 14 Apr 2015 11:32:16 -0400 (EDT) Date: Tue, 14 Apr 2015 11:32:16 -0400 From: "Frank Ch. Eigler" To: Ken McDonell Cc: pcp developers Subject: Re: pmmgr and qa/666 Message-ID: <20150414153216.GA23825@redhat.com> X-ASG-Orig-Subj: Re: pmmgr and qa/666 References: <009801d07567$cb543880$61fca980$@internode.on.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <009801d07567$cb543880$61fca980$@internode.on.net> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429025540 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, Ken - > I'm trying to diagnose a systemic failure in qa/666 that seems to have crept > in over the past month or two. > At step 8. (recheck the directories past retain/merge) we're seeing 5 > archives remaining, not 2 as expected. [...] The key seems to be a couple of archives created by pmloggers, where the pmlogger processes were killed (with SIGTERM then failing that, a SIGKILL). In this case, pmloggers left behind 3 archives that were deemed bad by pmlogcheck (see the "corrupt" lines in 666.full, and the history of the relevant archive files), and thus not eligible for merging/etc. processing. So, the question is why those files were deemed rejected by pmlogcheck; whether pmlogger was interrupted with SIGKILL (because it failed to respond to SIGTERM soon enough - 250ms in the code atm); whether pmlogger SIGKILL should be expected to possibly leave the archives corrupt; whether the 250ms SIGKILL timeout is too short. (That last one's easy to bump up (pmmgr.cxx:658), and adding a diagnostic at line :666 could help too.) - FChE From jpwhite4@buffalo.edu Tue Apr 14 12:51:35 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id AC7B87F47 for ; Tue, 14 Apr 2015 12:51:35 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 47AFFAC002 for ; Tue, 14 Apr 2015 10:51:32 -0700 (PDT) X-ASG-Debug-ID: 1429033885-04bdf0632123b470001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id mYkniGRoFAkEEH6b for ; Tue, 14 Apr 2015 10:51:25 -0700 (PDT) X-Barracuda-Envelope-From: jpwhite4@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmailD.acsu.buffalo.edu (localmaild.acsu.buffalo.edu [128.205.5.208]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id B9784B4E for ; Tue, 14 Apr 2015 13:51:24 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id B233D1FDB7 for ; Tue, 14 Apr 2015 13:51:24 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailD.acsu.buffalo.edu (Postfix) with ESMTP id 15E731FDB1 for ; Tue, 14 Apr 2015 13:51:24 -0400 (EDT) Received: from smtp.buffalo.edu (smtp1.acsu.buffalo.edu [128.205.5.253]) by localmailD.acsu.buffalo.edu (Prefixe) with ESMTP id 0A5AF1FDAF for ; Tue, 14 Apr 2015 13:51:24 -0400 (EDT) Received: from [128.205.40.1] (unknown [128.205.40.1]) (Authenticated sender: jpwhite4@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id E7C242ACC for ; Tue, 14 Apr 2015 13:51:23 -0400 (EDT) Message-ID: <552D539B.6080002@buffalo.edu> Date: Tue, 14 Apr 2015 13:51:23 -0400 From: Joseph White User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] libpfm-devel-4.4 not available for older fedora References: <552CAC5E.2020201@redhat.com> <1035731988.17998482.1428991795561.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] libpfm-devel-4.4 not available for older fedora In-Reply-To: <1035731988.17998482.1428991795561.JavaMail.zimbra@redhat.com> Content-Type: multipart/mixed; boundary="------------030709020207020107010908" X-PM-EL-Spam-Prob: X: 10% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1429033885 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17917 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- This is a multi-part message in MIME format. --------------030709020207020107010908 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit It should be compatible with libpfm4.3, although I have only personally tested with libpfm4.4 and 4.6 Attached patch file fixes the dependencies in the spec files. Joe On 04/14/2015 02:09 AM, Nathan Scott wrote: > Hi Mark, > > ----- Original Message ----- >> Trying to build on f19, which isn't that old, but configure >> is insisting on libpfm-4.4 or later, which isn't available >> for f19. Is that really a version dependency, or would 4.3 >> still be OK? > In order to get as far as you did, the configure checks have > all passed & we've attempted a build with the perfevent PMDA > in the mix. Unless Joe can point out the specific reason that > we've got 4.4 there (not triggering any memory here) maybe try > lowering the specific version# dep and try a fresh build? > > Else, we should tighten up the configure.ac checks so that the > Makepkgs build doesn't attempt to build that component. > > cheers. > > -- > Nathan > > _______________________________________________ > pcp mailing list > pcp@oss.sgi.com > http://oss.sgi.com/mailman/listinfo/pcp --------------030709020207020107010908 Content-Type: text/x-patch; name="perfevent_dependencies.patch" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="perfevent_dependencies.patch" diff --git a/build/rpm/fedora.spec b/build/rpm/fedora.spec index b957cd9..81463ca 100644 --- a/build/rpm/fedora.spec +++ b/build/rpm/fedora.spec @@ -76,7 +76,7 @@ BuildRequires: cyrus-sasl-devel BuildRequires: papi-devel %endif %if !%{disable_perfevent} -BuildRequires: libpfm-devel >= 4.4 +BuildRequires: libpfm-devel >= 4 %endif %if !%{disable_microhttpd} BuildRequires: libmicrohttpd-devel @@ -499,8 +499,8 @@ Group: Applications/System Summary: Performance Co-Pilot (PCP) metrics for hardware counters URL: http://www.pcp.io Requires: pcp = %{version}-%{release} pcp-libs = %{version}-%{release} -Requires: libpfm >= 4.4 -BuildRequires: libpfm-devel >= 4.4 +Requires: libpfm >= 4 +BuildRequires: libpfm-devel >= 4 %description pmda-perfevent This package contains the PCP Performance Metrics Domain Agent (PMDA) for diff --git a/build/rpm/pcp.spec.in b/build/rpm/pcp.spec.in index 964b76c..89eb5fa 100644 --- a/build/rpm/pcp.spec.in +++ b/build/rpm/pcp.spec.in @@ -45,7 +45,7 @@ BuildRequires: rpm-devel BuildRequires: papi-devel %endif %if "@pmda_perfevent@" == "true" -BuildRequires: libpfm-devel >= 4.4 +BuildRequires: libpfm-devel >= 4 %endif %if "@have_cairo@" == "true" BuildRequires: cairo-devel @@ -484,8 +484,8 @@ Group: Applications/System Summary: Performance Co-Pilot (PCP) metrics for hardware counters URL: http://www.pcp.io Requires: pcp = @package_version@ pcp-libs = @package_version@ -Requires: libpfm >= 4.4 -BuildRequires: libpfm-devel >= 4.4 +Requires: libpfm >= 4 +BuildRequires: libpfm-devel >= 4 %description pmda-perfevent This package contains the PCP Performance Metrics Domain Agent (PMDA) for --------------030709020207020107010908-- From mspier@netflix.com Tue Apr 14 13:15:20 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,T_DKIM_INVALID autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id A2ACA7F47 for ; Tue, 14 Apr 2015 13:15:20 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 3C20DAC001 for ; Tue, 14 Apr 2015 11:15:20 -0700 (PDT) X-ASG-Debug-ID: 1429035316-04bdf0632323d4b0001-S8gJnT Received: from mail-wg0-f53.google.com (mail-wg0-f53.google.com [74.125.82.53]) by cuda.sgi.com with ESMTP id 1Ds4z9VYeEpbbFhI (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Tue, 14 Apr 2015 11:15:18 -0700 (PDT) X-Barracuda-Envelope-From: mspier@netflix.com X-Barracuda-Apparent-Source-IP: 74.125.82.53 Received: by wgso17 with SMTP id o17so21415209wgs.1 for ; Tue, 14 Apr 2015 11:15:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netflix.com; s=google; h=mime-version:date:message-id:subject:from:to:cc:content-type; bh=gAtHx6V5VzgMVCujsKw4PT927e25WcI5wEkqLSbLRCk=; b=RZZcAGo/13poS4iM4nYWuRZnSrMioKiwj720lHCVGiBBbqTUikNckJNAsJOzWopbpc 9bPFZ5iRz65ds3Y7bu39JaCwolEX9JjH1oq+UIEAJ2n/5vwdmqVvkherddIBOZaLR/22 m4BFhR3dcrgodOuV6sM5VABkHKdy473OTL11k= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to:cc :content-type; bh=gAtHx6V5VzgMVCujsKw4PT927e25WcI5wEkqLSbLRCk=; b=gDhoISevGYaCtv0xm1VjNVW5cVwjAzVVW4nYpJbbVB4S3rKfKHaZOiA6yju2+nyIsn PdxeNvSuViAI7KELw/EE+kQ1YglQp4mPa9SSoBXpX9Q/r+WBoTIF0n+EGAkZthjVrGcn Oq4uAP2N2XgORpAKA0bTmbkeJVs7PknIjC/2jLokMW4IvbnqGfUq8t5SZGtWUJ4PZqVR uNmgsNeoiQ/lUCVsNtLowKlfFQt4oCs/PfhKkSb6+le8o2ABtpS05iV4nRwjKf9aKI4Q 7OXiumyWr29qHZ9kCY4QRjvqGYvyh+IQSBTHiPtMddDItKP8f1S6P2E92Lz1OKaeboTV Ug+A== X-Gm-Message-State: ALoCoQkz9Y0qOsiWUZ9DXAnrItMWldpeawMitTHnZRDVkoLbxdWQmiL63JXbqM2HHn0HU2Kzb2/x MIME-Version: 1.0 X-Received: by 10.180.101.138 with SMTP id fg10mr27637208wib.46.1429035316539; Tue, 14 Apr 2015 11:15:16 -0700 (PDT) Received: by 10.180.72.227 with HTTP; Tue, 14 Apr 2015 11:15:16 -0700 (PDT) Date: Tue, 14 Apr 2015 11:15:16 -0700 Message-ID: Subject: ACAO Header and Background Install diffs From: Martin Spier X-ASG-Orig-Subj: ACAO Header and Background Install diffs To: pcp@oss.sgi.com Cc: Amer Ather Content-Type: multipart/mixed; boundary=f46d0444e9a56aa5950513b3362c X-Barracuda-Connect: mail-wg0-f53.google.com[74.125.82.53] X-Barracuda-Start-Time: 1429035317 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED, HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17917 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 HTML_MESSAGE BODY: HTML included in message --f46d0444e9a56aa5950513b3362c Content-Type: multipart/alternative; boundary=f46d0444e9a56aa58f0513b3362a --f46d0444e9a56aa58f0513b3362a Content-Type: text/plain; charset=UTF-8 Last year Amer made a few changes to include the ACAO header on files created by one of our pmdas and also allow background install. These changes were never pushed up so I'm attaching the diffs to make sure they make sense in the big picture. Cheers, Martin --f46d0444e9a56aa58f0513b3362a Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Last year Amer made a few changes to include the ACAO head= er on files created by one of our pmdas and also allow background install. = These changes were never pushed up so I'm attaching the diffs to make s= ure they make sense in the big picture.

Cheers,

Martin
--f46d0444e9a56aa58f0513b3362a-- --f46d0444e9a56aa5950513b3362c Content-Type: text/plain; charset=US-ASCII; name="patch0004.diff" Content-Disposition: attachment; filename="patch0004.diff" Content-Transfer-Encoding: base64 X-Attachment-Id: f_i8hmnsxz0 RnJvbSBmMmM5NTU1MjkzNDVmODA4NTRhYTcyOGM3NDhlMDQyYTFkODM1ODQxIE1vbiBTZXAgMTcg MDA6MDA6MDAgMjAwMQpGcm9tOiBBbWVyIEF0aGVyIDxhYXRoZXJAbmV0ZmxpeC5jb20+CkRhdGU6 IE1vbiwgMSBEZWMgMjAxNCAyMjowNjozMCArMDAwMApTdWJqZWN0OiBbUEFUQ0hdIEFkZGVkIG9u ZSBtb3JlIEFDQU8gaGVhZGVyCgotLS0KIHNyYy9wbXdlYmFwaS9wbXJlc2FwaS5jeHggfCA3ICsr KysrLS0KIDEgZmlsZSBjaGFuZ2VkLCA1IGluc2VydGlvbnMoKyksIDIgZGVsZXRpb25zKC0pCgpk aWZmIC0tZ2l0IGEvc3JjL3Btd2ViYXBpL3BtcmVzYXBpLmN4eCBiL3NyYy9wbXdlYmFwaS9wbXJl c2FwaS5jeHgKaW5kZXggYTY1N2I3Mi4uMTMwMWUzMCAxMDA2NDQKLS0tIGEvc3JjL3Btd2ViYXBp L3BtcmVzYXBpLmN4eAorKysgYi9zcmMvcG13ZWJhcGkvcG1yZXNhcGkuY3h4CkBAIC0xNTgsNiAr MTU4LDEwIEBAIHBtd2VicmVzX3Jlc3BvbmQgKHN0cnVjdCBNSERfQ29ubmVjdGlvbiAqY29ubmVj dGlvbiwgY29uc3QgaHR0cF9wYXJhbXMmIHBhcmFtcywKICAgICAgICAgICAgIGlmIChyYyAhPSBN SERfWUVTKSB7CiAgICAgICAgICAgICAgICAgY29ubnN0YW1wIChjZXJyLCBjb25uZWN0aW9uKSA8 PCAiTUhEX2FkZF9yZXNwb25zZV9oZWFkZXIgTG9jYXRpb246IGZhaWxlZCIgPDwgZW5kbDsKICAg ICAgICAgICAgIH0KKworCSAvKiBBZGRpbmcgQUNBTyBoZWFkZXIgKi8KKyAgICAgICAgICAodm9p ZCkgTUhEX2FkZF9yZXNwb25zZV9oZWFkZXIgKHJlc3AsICJBY2Nlc3MtQ29udHJvbC1BbGxvdy1P cmlnaW4iLCAiKiIpOworCiAgICAgICAgICAgICByYyA9IE1IRF9xdWV1ZV9yZXNwb25zZSAoY29u bmVjdGlvbiwgTUhEX0hUVFBfRk9VTkQgLyogMzAyICovICwgcmVzcCk7CiAgICAgICAgICAgICBp ZiAocmMgIT0gTUhEX1lFUykgewogICAgICAgICAgICAgICAgIGNvbm5zdGFtcCAoY2VyciwgY29u bmVjdGlvbikgPDwgIk1IRF9xdWV1ZV9yZXNwb25zZSBmYWlsZWQiIDw8IGVuZGw7CkBAIC0yMDks OCArMjEzLDcgQEAgcG13ZWJyZXNfcmVzcG9uZCAoc3RydWN0IE1IRF9Db25uZWN0aW9uICpjb25u ZWN0aW9uLCBjb25zdCBodHRwX3BhcmFtcyYgcGFyYW1zLAogCiAgICAgKHZvaWQpIE1IRF9hZGRf cmVzcG9uc2VfaGVhZGVyIChyZXNwLCAiQ2FjaGUtQ29udHJvbCIsICJwdWJsaWMiKTsKIAotICAg IC8vIFBlciBGcmFuayBzdWdnZXN0aW9uLCBhZGRlZCB0aGlzIGhlYWRlciB0byBoYXZlIGphdmFz Y3JpcHQgIAotICAgIC8vIGFiaWxpdHkgdG8gbGlzdCBmaWxlcyBhdCB0aGUgdXJsIHNlcnZlZCBi eSBwbXdlYmQgCisgICAgLyogQWRkaW5nIEFDQU8gaGVhZGVyICovCiAKICAgICAodm9pZCkgTUhE X2FkZF9yZXNwb25zZV9oZWFkZXIgKHJlc3AsICJBY2Nlc3MtQ29udHJvbC1BbGxvdy1PcmlnaW4i LCAiKiIpOwogCi0tIAoxLjguNC4yCgo= --f46d0444e9a56aa5950513b3362c Content-Type: text/plain; charset=US-ASCII; name="patch0005.diff" Content-Disposition: attachment; filename="patch0005.diff" Content-Transfer-Encoding: base64 X-Attachment-Id: f_i8hmnsya1 RnJvbSA3MzM3MDA1ZjcwNjY2ZTRiMmM0NzQ2OTRmOTBhMTIyYjRkZGIzNGFlIE1vbiBTZXAgMTcg MDA6MDA6MDAgMjAwMQpGcm9tOiBBbWVyIEF0aGVyIDxhYXRoZXJAbmV0ZmxpeC5jb20+CkRhdGU6 IEZyaSwgNSBEZWMgMjAxNCAxNzo1OTo1MCArMDAwMApTdWJqZWN0OiBbUEFUQ0hdIEFsbG93IHBt ZGEgaW5zdGFsbCBpbiB0aGUgYmFja2dyb3VuZAoKLS0tCiBzcmMvcG1jZC9yY19wbWNkIHwgMiAr LQogMSBmaWxlIGNoYW5nZWQsIDEgaW5zZXJ0aW9uKCspLCAxIGRlbGV0aW9uKC0pCgpkaWZmIC0t Z2l0IGEvc3JjL3BtY2QvcmNfcG1jZCBiL3NyYy9wbWNkL3JjX3BtY2QKaW5kZXggNDliNzQzMC4u YzAyMjY3YiAxMDA2NDQKLS0tIGEvc3JjL3BtY2QvcmNfcG1jZAorKysgYi9zcmMvcG1jZC9yY19w bWNkCkBAIC00ODgsNyArNDg4LDcgQEAgRXJyb3I6IHBtY2QgY29udHJvbCBmaWxlICciJFBDUF9Q TUNEQ09ORl9QQVRIIicgaXMgbWlzc2luZywgY2Fubm90IHN0YXJ0IHBtY2QuJwogCiAJICAgICRQ Q1BfQklOQURNX0RJUi9wbXBvc3QgInN0YXJ0IHBtY2QgZnJvbSAkcHJvZyIKIAotCSAgICBfcG1k YV9zZXR1cAorCSAgICBfcG1kYV9zZXR1cCAmCiAKIAkgICAgIyBmb3JjZSByZW1vdmFsIG9mIHBy aW1hcnkgcG1sb2dnZXIgbGluayAuLi4gaWYgcHJpbWFyeQogCSAgICAjIHBtbG9nZ2VyIGlzIHN0 YXJ0ZWQsIHRoaXMgd2lsbCByZS1jcmVhdGUgdGhlIGxpbmsKLS0gCjEuOC40LjIKCg== --f46d0444e9a56aa5950513b3362c Content-Type: text/plain; charset=US-ASCII; name="patch0003.diff" Content-Disposition: attachment; filename="patch0003.diff" Content-Transfer-Encoding: base64 X-Attachment-Id: f_i8hmnsye2 RnJvbSBhN2ZkY2E2NWUxZmI5ZWI2NDVmYTY2MTZlMzBjMTdmOTU0NzkxNThmIE1vbiBTZXAgMTcg MDA6MDA6MDAgMjAwMQpGcm9tOiByb290IDxyb290QFBDUC1URVNUPgpEYXRlOiBUaHUsIDIwIE5v diAyMDE0IDE3OjUzOjE3ICswMDAwClN1YmplY3Q6IFtQQVRDSF0gIEFDQU8gaGVhZGVyIGlzIGFk ZGVkCgotLS0KIHNyYy9wbXdlYmFwaS9wbXJlc2FwaS5jeHggfCA1ICsrKysrCiAxIGZpbGUgY2hh bmdlZCwgNSBpbnNlcnRpb25zKCspCgpkaWZmIC0tZ2l0IGEvc3JjL3Btd2ViYXBpL3BtcmVzYXBp LmN4eCBiL3NyYy9wbXdlYmFwaS9wbXJlc2FwaS5jeHgKaW5kZXggYWYxNGQ4MS4uYTY1N2I3MiAx MDA2NDQKLS0tIGEvc3JjL3Btd2ViYXBpL3BtcmVzYXBpLmN4eAorKysgYi9zcmMvcG13ZWJhcGkv cG1yZXNhcGkuY3h4CkBAIC0yMDksNiArMjA5LDExIEBAIHBtd2VicmVzX3Jlc3BvbmQgKHN0cnVj dCBNSERfQ29ubmVjdGlvbiAqY29ubmVjdGlvbiwgY29uc3QgaHR0cF9wYXJhbXMmIHBhcmFtcywK IAogICAgICh2b2lkKSBNSERfYWRkX3Jlc3BvbnNlX2hlYWRlciAocmVzcCwgIkNhY2hlLUNvbnRy b2wiLCAicHVibGljIik7CiAKKyAgICAvLyBQZXIgRnJhbmsgc3VnZ2VzdGlvbiwgYWRkZWQgdGhp cyBoZWFkZXIgdG8gaGF2ZSBqYXZhc2NyaXB0ICAKKyAgICAvLyBhYmlsaXR5IHRvIGxpc3QgZmls ZXMgYXQgdGhlIHVybCBzZXJ2ZWQgYnkgcG13ZWJkIAorCisgICAgKHZvaWQpIE1IRF9hZGRfcmVz cG9uc2VfaGVhZGVyIChyZXNwLCAiQWNjZXNzLUNvbnRyb2wtQWxsb3ctT3JpZ2luIiwgIioiKTsK KwogICAgIHJjID0gTUhEX3F1ZXVlX3Jlc3BvbnNlIChjb25uZWN0aW9uLCByZXNwX2NvZGUsIHJl c3ApOwogICAgIE1IRF9kZXN0cm95X3Jlc3BvbnNlIChyZXNwKTsKICAgICByZXR1cm4gcmM7Ci0t IAoxLjguNC4yCgo= --f46d0444e9a56aa5950513b3362c-- From dsmith@redhat.com Tue Apr 14 14:06:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id B5AAF7F47 for ; Tue, 14 Apr 2015 14:06:18 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 34B2BAC002 for ; Tue, 14 Apr 2015 12:06:14 -0700 (PDT) X-ASG-Debug-ID: 1429038373-04cb6c1cc821cfc0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id ZsncXt75eMXd5eE8 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 12:06:13 -0700 (PDT) X-Barracuda-Envelope-From: dsmith@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3EJ6DB9026738 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 14 Apr 2015 15:06:13 -0400 Received: from t540p.usersys.redhat.com (dhcp-10-15-1-2.hsv.redhat.com [10.15.1.2]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3EJ6CAo030600 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 14 Apr 2015 15:06:12 -0400 Message-ID: <552D6524.1030803@redhat.com> Date: Tue, 14 Apr 2015 14:06:12 -0500 From: David Smith User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp Subject: Re: [pcp] JSON PMDA References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] JSON PMDA In-Reply-To: <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429038373 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 04/09/2015 09:58 PM, Nathan Scott wrote: >>> ... needs to be deterministic, else bugs - see mail re dmcache/dmthin a >>> little earlier for more details. IOW, restarting/reconfiguring the PMDA >>> needs to ensure the same IDs are generated for the same metrics/indoms. >> >> I couldn't find the email you were referring to, but I see the problem > > Oh, sorry, that was an obscure reference - this is the one I meant: > http://www.pcp.io/pipermail/pcp/2015-March/006876.html > >> with keeping the IDs the same for the same metrics/indoms. I'm not sure >> I can think of a good scheme to fix that problem. > > Nor I - unfortunately I don't think there's an easy answer here. :( > >> Do any of the other >> PMDAs solve this problem for non-static metrics? > > No, there aren't really many in the same class - other PMDAs either encode > fixed IDs (the vast majority), or do it poorly for small subsets of their > names (like the percpu interrupts metrics - known bug) ... and those latter > cases are hanging out for a real solution too. :) > > In the case of MMV which is probably conceptually closest to this PMDA, the > numbering is pushed all the way out to the application, which encodes fixed > identifiers. > >> We could use a crypto hash function, > > Yeah - something like that - have a look at src/libpcp_pmda/src/cache.c as > thats how the instance cache number stability is achieved. Perhaps we can > extend that with additional APIs to help us out here. > > If we start extending libpcp_pmda, we should also think about routines like > generate_pcp_name() and your name() validity checker - the folks at Buffalo > recently expressed need for those same interfaces for C PMDAs, so it would > be great to have a common implementation. > >> but we've only got 22-bits to encode the cluster/item in. > > Yeah. Actually that's another little limit lurking here I guess - each JSON > source can provide a max of 1024 metrics ("item" limits us, as cluster used > for distinguishing JSON sources)? I've seen that passed sometimes with some > large instrumented applications, but its infrequent. Just something else to > keep in mind here I guess, maybe the end hash/numbering solution can seek a > way to lift that restriction too, somehow. I've looked into the idea of using a hash/crypto hash function, and I just don't see a way to do it within the current api. 22-bits to encode the cluster/item just isn't enough, especially if we want a unique hash value. For the JSON PMDA, we put each JSON source in its own cluster, so it can support 4096 JSON sources, each with 1024 metrics. If we don't want to break the current api/abi, the JSON PMDA could just store its state (which JSON source maps to which cluster and which metrics within a source map to which item) in a file when it quits, then restore it at startup. Is it safe to ever reuse a cluster/item? -- David Smith dsmith@redhat.com Red Hat http://www.redhat.com 256.217.0141 (direct) 256.837.0057 (fax) From minnus@buffalo.edu Tue Apr 14 15:18:59 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 3F8627F47 for ; Tue, 14 Apr 2015 15:18:59 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 3B2AC304043 for ; Tue, 14 Apr 2015 13:18:59 -0700 (PDT) X-ASG-Debug-ID: 1429042734-04cb6c1cca220ca0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id qJjHnyHc9DnGTWfM for ; Tue, 14 Apr 2015 13:18:54 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmailB.acsu.buffalo.edu (localmailb.acsu.buffalo.edu [128.205.5.200]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 991F09E1 for ; Tue, 14 Apr 2015 16:18:54 -0400 (EDT) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 94C8ED333 for ; Tue, 14 Apr 2015 16:18:54 -0400 (EDT) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailB.acsu.buffalo.edu (Postfix) with ESMTP id 28BA9D330 for ; Tue, 14 Apr 2015 16:18:54 -0400 (EDT) Received: from smtp.buffalo.edu (smtp2.acsu.buffalo.edu [128.205.5.254]) by localmailB.acsu.buffalo.edu (Prefixe) with ESMTP id 1FF16D32F for ; Tue, 14 Apr 2015 16:18:54 -0400 (EDT) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 0850424F2 for ; Tue, 14 Apr 2015 16:18:54 -0400 (EDT) Message-ID: <552D762D.2080400@buffalo.edu> Date: Tue, 14 Apr 2015 16:18:53 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: pcp Subject: specify instance id's with pmdaCacheStore Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: specify instance id's with pmdaCacheStore Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1429042734 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17921 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi, I was looking through the source and don't think there is a way to do this, but thought I would ask. In the case of a pmda where the instance names are strictly numeric, is it possible to have the pmdaCache* routines use the instance name (which would be numeric) when generating the instance id? More specifically, I am using the perl pmda api and the implementation that converts a perl hash to the pmdaCache* routines. It seems like the 2 choices are an auto-incrementing internally assigned id or a deterministic value generated by hashing in pmdaCache*Key functions. Hope this makes sense. Thanks Martins From kenj@internode.on.net Tue Apr 14 15:49:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 23D627F47 for ; Tue, 14 Apr 2015 15:49:18 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id B4EE1AC001 for ; Tue, 14 Apr 2015 13:49:14 -0700 (PDT) X-ASG-Debug-ID: 1429044551-04cb6c1cc8222480001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id WUIjZn8OOG7UDZNW for ; Tue, 14 Apr 2015 13:49:12 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2AAAgChfC1VPKEh0XYNTw6KbsQlglwCghUBAQEBAQEHAQEBATiEWwEBBDhAEQsOCgkWDwkDAgECATEUBgEMCAEBvG2WbwEBAQEGAQEBAQEdgk2IXoUDhC0BBI50jUiQAoNNgiUcgRNPgyABAQE Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 15 Apr 2015 06:19:11 +0930 Message-ID: <552D7DE8.4030706@internode.on.net> Date: Wed, 15 Apr 2015 06:51:52 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Martins Innus , pcp@oss.sgi.com Subject: Re: [pcp] pmLookupName sts differences References: <551D8119.5010404@buffalo.edu> <552CA769.1070607@internode.on.net> <552D1EE1.5000600@buffalo.edu> X-ASG-Orig-Subj: Re: [pcp] pmLookupName sts differences In-Reply-To: <552D1EE1.5000600@buffalo.edu> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1429044552 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17923 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 15/04/15 00:06, Martins Innus wrote: > > ... From my perspective, it would be desirable > for pmLookupName give back correct information on valid metrics even if > the input list contains some bogus names. Indeed. My first inclination would be something like this ... 1. if numpmid == 1, then return 1 for success else an error code (<0) ... this special case is really required to allow a caller to discover _why_ a lookup failed for a particular metric 2. if numpmid > 1, then 3 cases apply - fatal error (no context, pmcd or pmns, ...) => return an error (<0) - all OK, return numpmid - otherwise, return n (0 <= n < numpmid) as the count for those that are OK On return, we guarantee that the first numpmid elements of pmidlist[] will be either PM_ID_NULL or a valid PMID. This is not too far off the actual implementation today, so I think we're looking at (a) fixing the man page to accurately reflect the intended API, and (b) some bug fixes for some corner cases, and (c) audit all the callers of pmLookupName() in the PCP code base (there are lots of these O(100), but only a handful involve numpmid > 1). This is much better than the ABI change I was fearing. If someone can see a problem with this, now would be a good time to raise your concerns. From kenj@internode.on.net Tue Apr 14 16:13:27 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id DB0F17F47 for ; Tue, 14 Apr 2015 16:13:27 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id D4028304048 for ; Tue, 14 Apr 2015 14:13:24 -0700 (PDT) X-ASG-Debug-ID: 1429046002-04cb6c1cc9223740001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id VIPUHmOGZ943anHH for ; Tue, 14 Apr 2015 14:13:23 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2AAAgCigi1VPKEh0XYNT4p8xCWCXAKCFQEBAQEBAQcBAQEBOIRaAQEBAwE4QAYLCxgJFg8JAwIBAgExFBMIAQGIHrQVlngBAQgCAR+CTYhehQMWhBcBBLALgiQdgWKDIAEBAQ Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 15 Apr 2015 06:43:09 +0930 Message-ID: <552D8386.6090401@internode.on.net> Date: Wed, 15 Apr 2015 07:15:50 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] specify instance id's with pmdaCacheStore References: <552D762D.2080400@buffalo.edu> X-ASG-Orig-Subj: Re: [pcp] specify instance id's with pmdaCacheStore In-Reply-To: <552D762D.2080400@buffalo.edu> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1429046002 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17923 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 15/04/15 06:18, Martins Innus wrote: > Hi, > > I was looking through the source and don't think there is a way to > do this, but thought I would ask. In the case of a pmda where the > instance names are strictly numeric, is it possible to have the > pmdaCache* routines use the instance name (which would be numeric) when > generating the instance id? Outside the scope when I designed and built the pmdaCache stuff, I'm afraid. But if the external name is numeric (and >=0 and <= 2^22) then you don't really need the cache routines ... atoi() should suffice n'est ce pas? > More specifically, I am using the perl pmda api and the > implementation that converts a perl hash to the pmdaCache* routines. > > It seems like the 2 choices are an auto-incrementing internally > assigned id or a deterministic value generated by hashing in > pmdaCache*Key functions. > > Hope this makes sense. I may be missing something ... can't you use the "list" rather than the "hash" version of the perl API and populate the list with the internal instance ids you want? Certainly the "hash" version from perl appears to give you no control, but the "list" version does not use the pmdaCache routines at all (if I'm reading the PMDA.xs code correctly). From nscott@redhat.com Tue Apr 14 18:03:27 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 7B9C57F47 for ; Tue, 14 Apr 2015 18:03:27 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 6269C8F8084 for ; Tue, 14 Apr 2015 16:03:27 -0700 (PDT) X-ASG-Debug-ID: 1429052578-04cb6c1cca228030001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id q1iICFNu2jHXfYlB (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 16:02:59 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3EN2sVs009070; Tue, 14 Apr 2015 19:02:55 -0400 Date: Tue, 14 Apr 2015 19:02:54 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <1538747746.18653396.1429052574897.JavaMail.zimbra@redhat.com> In-Reply-To: <552D8386.6090401@internode.on.net> References: <552D762D.2080400@buffalo.edu> <552D8386.6090401@internode.on.net> Subject: Re: [pcp] specify instance id's with pmdaCacheStore MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] specify instance id's with pmdaCacheStore Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: specify instance id's with pmdaCacheStore Thread-Index: tfux53fZKVUArOtAkL5w0u+BgIO6Fw== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1429052579 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17926 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > On 15/04/15 06:18, Martins Innus wrote: > [...] > I may be missing something ... can't you use the "list" rather than the > "hash" version of the perl API and populate the list with the internal > instance ids you want? > > Certainly the "hash" version from perl appears to give you no control, > but the "list" version does not use the pmdaCache routines at all (if > I'm reading the PMDA.xs code correctly). That's correct. The perl pmdasimple example uses both indom management forms, as a point of reference. cheers. -- Nathan From nscott@redhat.com Tue Apr 14 18:39:33 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id B585E7F3F for ; Tue, 14 Apr 2015 18:39:33 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 44FC6AC004 for ; Tue, 14 Apr 2015 16:39:29 -0700 (PDT) X-ASG-Debug-ID: 1429054767-04cb6c1cc7229570001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id ZdFsNHFBzAryZZSn (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 16:39:28 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3ENdRW0005830; Tue, 14 Apr 2015 19:39:27 -0400 Date: Tue, 14 Apr 2015 19:39:27 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: David Smith Cc: pcp Message-ID: <1237712965.18667183.1429054767135.JavaMail.zimbra@redhat.com> In-Reply-To: <552D6524.1030803@redhat.com> References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> Subject: Re: [pcp] JSON PMDA MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] JSON PMDA Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: JSON PMDA Thread-Index: ZqGGMxBM/xZ/BHcGblGCq57ukqWoQQ== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1429054767 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17927 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi David, ----- Original Message ----- > > [...] > > Yeah - something like that - have a look at src/libpcp_pmda/src/cache.c as > > thats how the instance cache number stability is achieved. Perhaps we can > > extend that with additional APIs to help us out here. > > > > I've looked into the idea of using a hash/crypto hash function, and I > just don't see a way to do it within the current api. 22-bits to encode > the cluster/item just isn't enough, especially if we want a unique hash > value. *nod*. > For the JSON PMDA, we put each JSON source in its own cluster, so it can > support 4096 JSON sources, each with 1024 metrics. *nod*. > If we don't want to break the current api/abi, the JSON PMDA could just Its OK to extend the API/ABI, but not to break it. Which should be all we need to do here, I think. Maybe see if we can reduce the range that those cache.c interfaces accept - the two lines with "if (inst == 0x7fffffff) {" there look promising. If we had a h->maxinst there perhaps, instead of the hard-coded 2^32-1 limit (may need to change the test to '>=' too) we might be done and dusted here. That'll turn out to be a gross oversimplification I'm sure ... but maybe, just maybe it will work. > store its state (which JSON source maps to which cluster and which > metrics within a source map to which item) in a file when it quits, then > restore it at startup. The cache routines provide mechanisms for persistence too, so we should be able to leverage that concept here and not need to write new code, hopefully (although I think that will need to be exposed to python land for use here, nothing else has needed those interfaces so far). > Is it safe to ever reuse a cluster/item? Unfortunately not. cheers. -- Nathan From fche@redhat.com Tue Apr 14 19:09:59 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 8580A7F3F for ; Tue, 14 Apr 2015 19:09:59 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 732CD8F8084 for ; Tue, 14 Apr 2015 17:09:56 -0700 (PDT) X-ASG-Debug-ID: 1429056594-04cb6c1cca22a350001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id v4dv9ssXv8vcXMda (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 17:09:55 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3F09ooQ028560 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Tue, 14 Apr 2015 20:09:50 -0400 Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3F09nAn006348; Tue, 14 Apr 2015 20:09:49 -0400 Received: by fche.csb (Postfix, from userid 2569) id 5ADD358519; Tue, 14 Apr 2015 20:09:46 -0400 (EDT) To: Ken McDonell Cc: Martins Innus , pcp@oss.sgi.com Subject: Re: pmLookupName sts differences References: <551D8119.5010404@buffalo.edu> <552CA769.1070607@internode.on.net> <552D1EE1.5000600@buffalo.edu> <552D7DE8.4030706@internode.on.net> X-ASG-Orig-Subj: Re: pmLookupName sts differences From: fche@redhat.com (Frank Ch. Eigler) Date: Tue, 14 Apr 2015 20:09:46 -0400 In-Reply-To: <552D7DE8.4030706@internode.on.net> (Ken McDonell's message of "Wed, 15 Apr 2015 06:51:52 +1000") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429056595 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Ken McDonell writes: > [...] > 1. if numpmid == 1, then return 1 for success else an error code (<0) > ... this special case is really required to allow a caller to discover > _why_ a lookup failed for a particular metric > 2. if numpmid > 1, then 3 cases apply > [...] > - otherwise, return n (0 <= n < numpmid) as the count for those > that are OK I don't quite understand why 1 and >1 cases are different. What reason could the caller discover in the first case, that she wouldn't also want to know about the others? - FChE From fche@redhat.com Tue Apr 14 19:14:50 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 57B677F3F for ; Tue, 14 Apr 2015 19:14:50 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 542AD304043 for ; Tue, 14 Apr 2015 17:14:47 -0700 (PDT) X-ASG-Debug-ID: 1429056885-04cbb056b325b450001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id WoGlCYGkkU7kgIOs (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 17:14:46 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3F0EhX1029207 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Tue, 14 Apr 2015 20:14:43 -0400 Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3F0EgsU016915; Tue, 14 Apr 2015 20:14:43 -0400 Received: by fche.csb (Postfix, from userid 2569) id EC2A358519; Tue, 14 Apr 2015 20:14:39 -0400 (EDT) To: Martin Spier Cc: pcp@oss.sgi.com, Amer Ather Subject: Re: ACAO Header and Background Install diffs References: X-ASG-Orig-Subj: Re: ACAO Header and Background Install diffs From: fche@redhat.com (Frank Ch. Eigler) Date: Tue, 14 Apr 2015 20:14:39 -0400 In-Reply-To: (Martin Spier's message of "Tue, 14 Apr 2015 11:15:16 -0700") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429056886 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 mspier wrote: > Last year Amer made a few changes to include the ACAO header [...] The two ACAO-related patches look good to me. - FHE From nscott@redhat.com Tue Apr 14 19:38:12 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 9FD697F3F for ; Tue, 14 Apr 2015 19:38:12 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 8D41C30404E for ; Tue, 14 Apr 2015 17:38:12 -0700 (PDT) X-ASG-Debug-ID: 1429058283-04bdf06321250930001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id 1VtqVvYRCKwJt6Hw (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 17:38:04 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3F0c1Gr054177; Tue, 14 Apr 2015 20:38:01 -0400 Date: Tue, 14 Apr 2015 20:38:01 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" , Martin Spier , Amer Ather Cc: pcp@oss.sgi.com Message-ID: <1888768778.18692984.1429058281580.JavaMail.zimbra@redhat.com> In-Reply-To: References: Subject: Re: [pcp] ACAO Header and Background Install diffs MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] ACAO Header and Background Install diffs Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: ACAO Header and Background Install diffs Thread-Index: BS2szEVkLqc9sNR1dKKtF5hOhIhl9Q== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1429058284 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17930 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > > mspier wrote: > > > Last year Amer made a few changes to include the ACAO header [...] > > The two ACAO-related patches look good to me. Thanks, I'll run it through the testsuite shortly also. The third patch was merged awhile back ... commit 739fdda0cb46c67812e3bbf5cf99c51e83f5d80c Author: Nathan Scott Date: Mon Dec 8 16:36:56 2014 +1100 rc_pmcd: execute _pmda_setup in the background Amer reports that use of the .NeedInstall mechanism for PMDAs introduces longer image startup times due to the rc_pmcd script performing PMDA installation serially. There's no reason for that - this processing can be done in the background as soon as pmcd has started (just like we do with pmloggers in the rc_pmlogger script already). Test qa/300 is tweaked to give a little more time before verifying the .NeedInstall processing has / has not been done. From nscott@redhat.com Tue Apr 14 19:43:51 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 119657F3F for ; Tue, 14 Apr 2015 19:43:51 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 07DE5304048 for ; Tue, 14 Apr 2015 17:43:50 -0700 (PDT) X-ASG-Debug-ID: 1429058629-04cb6c1cc822b540001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id 1zlrLPfmh6UrIUL1 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 17:43:49 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3F0hmCq055320; Tue, 14 Apr 2015 20:43:48 -0400 Date: Tue, 14 Apr 2015 20:43:48 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: pcp Message-ID: <1584443116.18694211.1429058628802.JavaMail.zimbra@redhat.com> In-Reply-To: <1765856075.18693163.1429058314850.JavaMail.zimbra@redhat.com> Subject: [patch] fix graphite build on Mac OS X MIME-Version: 1.0 X-ASG-Orig-Subj: [patch] fix graphite build on Mac OS X Content-Type: multipart/mixed; boundary="----=_Part_18694209_1339915740.1429058628795" X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: fix graphite build on Mac OS X Thread-Index: yUeMV6rQr3CDDSgyBBcG5zMEbP45aw== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1429058629 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17929 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ------=_Part_18694209_1339915740.1429058628795 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Hi Frank, Could you look this pmwebd patch over please? I've tried to follow your coding style there, but, *shrug* ... its all non-pcp style and there's many ways we could fix this one. It should resolve the Mac OS X build issue being reported over in the Vector issue tracker (I can't verify it since I don't have the same setup yet but its pretty clear what the problem is & seems a safe enough change to me). cheers. -- Nathan ------=_Part_18694209_1339915740.1429058628795 Content-Type: text/x-patch; name=macosx-graphite.patch Content-Disposition: attachment; filename=macosx-graphite.patch Content-Transfer-Encoding: base64 ZGlmZiAtLWdpdCBhL3NyYy9wbXdlYmFwaS9wbWdyYXBoaXRlLmN4eCBiL3NyYy9wbXdlYmFwaS9w bWdyYXBoaXRlLmN4eAppbmRleCA4NmE1MmI3Li41N2IwNWUxIDEwMDY0NAotLS0gYS9zcmMvcG13 ZWJhcGkvcG1ncmFwaGl0ZS5jeHgKKysrIGIvc3JjL3Btd2ViYXBpL3BtZ3JhcGhpdGUuY3h4CkBA IC0xLDcgKzEsNyBAQAogLyoKICAqIFBNV0VCRCBncmFwaGl0ZS1hcGkgZW11bGF0aW9uCiAgKgot ICogQ29weXJpZ2h0IChjKSAyMDE0IFJlZCBIYXQgSW5jLgorICogQ29weXJpZ2h0IChjKSAyMDE0 LTIwMTUgUmVkIEhhdCBJbmMuCiAgKgogICogVGhpcyBwcm9ncmFtIGlzIGZyZWUgc29mdHdhcmU7 IHlvdSBjYW4gcmVkaXN0cmlidXRlIGl0IGFuZC9vciBtb2RpZnkgaXQKICAqIHVuZGVyIHRoZSB0 ZXJtcyBvZiB0aGUgR05VIEdlbmVyYWwgUHVibGljIExpY2Vuc2UgYXMgcHVibGlzaGVkIGJ5IHRo ZQpAQCAtMzMsNyArMzMsNiBAQCB1c2luZyBuYW1lc3BhY2Ugc3RkOwogZXh0ZXJuICJDIgogewog I2luY2x1ZGUgPGN0eXBlLmg+Ci0jaW5jbHVkZSA8bWF0aC5oPgogI2lmZGVmIEhBVkVfRlRTX0gK ICNpbmNsdWRlIDxmdHMuaD4KICNlbmRpZgpAQCAtNDIsNiArNDEsMTIgQEAgZXh0ZXJuICJDIgog I2lmZGVmIEhBVkVfUFRIUkVBRF9ICiAjaW5jbHVkZSA8cHRocmVhZC5oPgogI2VuZGlmCisjaWZk ZWYgSEFWRV9JRUVFRlBfSAorI2luY2x1ZGUgPGllZWVmcC5oPgorI2VuZGlmCisjaWZkZWYgSEFW RV9NQVRIX0gKKyNpbmNsdWRlIDxtYXRoLmg+CisjZW5kaWYKICNpZmRlZiBIQVZFX0NBSVJPCiAj aW5jbHVkZSA8Y2Fpcm8vY2Fpcm8uaD4KICNlbmRpZgpAQCAtNDksNiArNTQsNDMgQEAgZXh0ZXJu ICJDIgogCiAKIC8qCisgKiBQbGF0Zm9ybS1pbmRlcGVuZGVudCBub3QtYS1udW1iZXIgaGVscGVy cyAoYmFzZWQgb24gbGlicGNwIGNvZGUpLgorICovCitzdGF0aWMgaW50CitwbWdyYXBoaXRlX2lz bmFuZiAoZmxvYXQgdmFsdWUpCit7CisgICAgaW50IGZwX2JhZCA9IDA7CisKKyNpZmRlZiBIQVZF X0ZQQ0xBU1NJRlkKKyAgICBmcF9iYWQgPSBmcGNsYXNzaWZ5ICh2YWx1ZSkgPT0gRlBfTkFOOwor I2Vsc2UKKyNpZmRlZiBIQVZFX0lTTkFORgorICAgIGZwX2JhZCA9IGlzbmFuZiAodmFsdWUpOwor I2Vsc2UKKyMgd2FybmluZyAiVGhpcyBwbGF0Zm9ybSBoYXMgbm8gaXNuYW4gZm9yIGZsb2F0Igor I2VuZGlmCisjZW5kaWYKKyAgICByZXR1cm4gZnBfYmFkOworfQorCitzdGF0aWMgaW50CitwbWdy YXBoaXRlX2lzbmFuZCAoZG91YmxlIHZhbHVlKQoreworICAgIGludCBmcF9iYWQgPSAwOworCisj aWZkZWYgSEFWRV9GUENMQVNTSUZZCisgICAgZnBfYmFkID0gZnBjbGFzc2lmeSAodmFsdWUpID09 IEZQX05BTjsKKyNlbHNlCisjaWZkZWYgSEFWRV9JU05BTgorICAgIGZwX2JhZCA9IGlzbmFuICh2 YWx1ZSk7CisjZWxzZQorIyB3YXJuaW5nICJUaGlzIHBsYXRmb3JtIGhhcyBubyBpc25hbiBmb3Ig ZG91YmxlIgorI2VuZGlmCisjZW5kaWYKKyAgICByZXR1cm4gZnBfYmFkOworfQorCisvKgogICog V2UgbmVlZCBhIHJldmVyc2libGUgZW5jb2RpbmcgZnJvbSBhcmJpdHJhcnkgbm9uLWVtcHR5IHN0 cmluZ3MKICAqIChzdWNoIGFzIGFyY2hpdmUgcGF0aCBuYW1lcywgcGNwIG1ldHJpYyBuYW1lIGNv bXBvbmVudHMgKD8pLCBwY3AKICAqIGluc3RhbmNlIG5hbWVzKSB0byB0aGUgZG90LXNlcGFyYXRl ZCBjb21wb25lbnRzIG9mIGdyYXBoaXRlIG1ldHJpYwpAQCAtOTY2LDcgKzEwMDgsNyBAQCB2b2lk IHBtZ3JhcGhpdGVfZmV0Y2hfc2VyaWVzIChmZXRjaF9zZXJpZXNfam9ic3BlYyAqc3BlYykKICAg ICAgICAgICAgICAgICBkZWx0YSA9IDE7ICAgIC8vIHNvbWUgdG9rZW4gcHJvdGVjdGlvbiBhZ2Fp bnN0IGRpdi1ieS16ZXJvCiAgICAgICAgICAgICB9CiAKLSAgICAgICAgICAgIGlmIChpc25hbmYg KGxhc3RfdmFsdWUpIHx8IGlzbmFuZiAodGhpc192YWx1ZSkpIHsKKyAgICAgICAgICAgIGlmIChw bWdyYXBoaXRlX2lzbmFuZiAobGFzdF92YWx1ZSkgfHwgcG1ncmFwaGl0ZV9pc25hbmYgKHRoaXNf dmFsdWUpKSB7CiAgICAgICAgICAgICAgICAgb3V0cHV0W2ldLndoYXQgPSBuYW5mICgiIik7CiAg ICAgICAgICAgICB9IGVsc2UgewogICAgICAgICAgICAgICAgIC8vIGF2b2lkIGxvc3Mgb2Ygc2ln bmlmaWNhbmNlIHJpc2sgb2YgbmFpdmVseSBjYWxjdWxhdGluZwpAQCAtMTY5OCwxMCArMTc0MCwx MCBAQCBwbWdyYXBoaXRlX3Jlc3BvbmRfcmVuZGVyX2dmeCAoc3RydWN0IE1IRF9Db25uZWN0aW9u ICpjb25uZWN0aW9uLAogICAgICAgICB5bWluID0gbmFuZiAoIiIpOwogICAgICAgICBmb3IgKHVu c2lnbmVkIGk9MDsgaTxhbGxfcmVzdWx0cy5zaXplICgpOyBpKyspCiAgICAgICAgICAgICBmb3Ig KHVuc2lnbmVkIGo9MDsgajxhbGxfcmVzdWx0c1tpXS5zaXplICgpOyBqKyspIHsKLSAgICAgICAg ICAgICAgICBpZiAoaXNuYW5mIChhbGxfcmVzdWx0c1tpXVtqXS53aGF0KSkgeworICAgICAgICAg ICAgICAgIGlmIChwbWdyYXBoaXRlX2lzbmFuZiAoYWxsX3Jlc3VsdHNbaV1bal0ud2hhdCkpIHsK ICAgICAgICAgICAgICAgICAgICAgY29udGludWU7CiAgICAgICAgICAgICAgICAgfQotICAgICAg ICAgICAgICAgIGlmIChpc25hbmYgKHltaW4pKSB7CisgICAgICAgICAgICAgICAgaWYgKHBtZ3Jh cGhpdGVfaXNuYW5mICh5bWluKSkgewogICAgICAgICAgICAgICAgICAgICB5bWluID0gYWxsX3Jl c3VsdHNbaV1bal0ud2hhdDsKICAgICAgICAgICAgICAgICB9IGVsc2UgewogICAgICAgICAgICAg ICAgICAgICB5bWluID0gbWluICh5bWluLCBhbGxfcmVzdWx0c1tpXVtqXS53aGF0KTsKQEAgLTE3 MTUsMTAgKzE3NTcsMTAgQEAgcG1ncmFwaGl0ZV9yZXNwb25kX3JlbmRlcl9nZnggKHN0cnVjdCBN SERfQ29ubmVjdGlvbiAqY29ubmVjdGlvbiwKICAgICAgICAgeW1heCA9IG5hbmYgKCIiKTsKICAg ICAgICAgZm9yICh1bnNpZ25lZCBpPTA7IGk8YWxsX3Jlc3VsdHMuc2l6ZSAoKTsgaSsrKQogICAg ICAgICAgICAgZm9yICh1bnNpZ25lZCBqPTA7IGo8YWxsX3Jlc3VsdHNbaV0uc2l6ZSAoKTsgaisr KSB7Ci0gICAgICAgICAgICAgICAgaWYgKGlzbmFuZiAoYWxsX3Jlc3VsdHNbaV1bal0ud2hhdCkp IHsKKyAgICAgICAgICAgICAgICBpZiAocG1ncmFwaGl0ZV9pc25hbmYgKGFsbF9yZXN1bHRzW2ld W2pdLndoYXQpKSB7CiAgICAgICAgICAgICAgICAgICAgIGNvbnRpbnVlOwogICAgICAgICAgICAg ICAgIH0KLSAgICAgICAgICAgICAgICBpZiAoaXNuYW5mICh5bWF4KSkgeworICAgICAgICAgICAg ICAgIGlmIChwbWdyYXBoaXRlX2lzbmFuZiAoeW1heCkpIHsKICAgICAgICAgICAgICAgICAgICAg eW1heCA9IGFsbF9yZXN1bHRzW2ldW2pdLndoYXQ7CiAgICAgICAgICAgICAgICAgfSBlbHNlIHsK ICAgICAgICAgICAgICAgICAgICAgeW1heCA9IG1heCAoeW1heCwgYWxsX3Jlc3VsdHNbaV1bal0u d2hhdCk7CkBAIC0xNzI3LDcgKzE3NjksNyBAQCBwbWdyYXBoaXRlX3Jlc3BvbmRfcmVuZGVyX2dm eCAoc3RydWN0IE1IRF9Db25uZWN0aW9uICpjb25uZWN0aW9uLAogICAgIH0KIAogICAgIC8vIEFu eSBkYXRhIHRvIHNob3c/Ci0gICAgaWYgKGlzbmFuZiAoeW1pbikgfHwgaXNuYW5mICh5bWF4KSB8 fCBhbGxfcmVzdWx0cy5lbXB0eSAoKSkgeworICAgIGlmIChwbWdyYXBoaXRlX2lzbmFuZiAoeW1p bikgfHwgcG1ncmFwaGl0ZV9pc25hbmYgKHltYXgpIHx8IGFsbF9yZXN1bHRzLmVtcHR5ICgpKSB7 CiAgICAgICAgIGNhaXJvX3RleHRfZXh0ZW50c190IGV4dDsKICAgICAgICAgc3RyaW5nIG1lc3Nh Z2UgPSAibm8gZGF0YSBpbiByYW5nZSI7CiAgICAgICAgIGNhaXJvX3NhdmUgKGNyKTsKQEAgLTE4 MjYsNyArMTg2OCw3IEBAIHBtZ3JhcGhpdGVfcmVzcG9uZF9yZW5kZXJfZ2Z4IChzdHJ1Y3QgTUhE X0Nvbm5lY3Rpb24gKmNvbm5lY3Rpb24sCiAgICAgICAgIHRvdGFsX3Zpc2liaWxpdHlfc2NvcmUu cHVzaF9iYWNrICgwKTsKICAgICAgICAgY29uc3QgdmVjdG9yPHRpbWVzdGFtcGVkX2Zsb2F0PiYg ZiA9IGFsbF9yZXN1bHRzW2ldOwogICAgICAgICBmb3IgKHVuc2lnbmVkIGo9MDsgajxmLnNpemUg KCk7IGorKykgewotICAgICAgICAgICAgaWYgKGlzbmFuIChmW2pdLndoYXQpKSB7CisgICAgICAg ICAgICBpZiAocG1ncmFwaGl0ZV9pc25hbmQgKGZbal0ud2hhdCkpIHsKICAgICAgICAgICAgICAg ICBjb250aW51ZTsKICAgICAgICAgICAgIH0KICAgICAgICAgICAgIHRvdGFsX3Zpc2liaWxpdHlf c2NvcmVbaV0gKys7CkBAIC0xODQyLDcgKzE4ODQsNyBAQCBwbWdyYXBoaXRlX3Jlc3BvbmRfcmVu ZGVyX2dmeCAoc3RydWN0IE1IRF9Db25uZWN0aW9uICpjb25uZWN0aW9uLAogICAgICAgICAgICAg ICAgIGlmIChpID09IGspIHsKICAgICAgICAgICAgICAgICAgICAgY29udGludWU7CiAgICAgICAg ICAgICAgICAgfQotICAgICAgICAgICAgICAgIGlmIChpc25hbiAoZjJbal0ud2hhdCkpIHsKKyAg ICAgICAgICAgICAgICBpZiAocG1ncmFwaGl0ZV9pc25hbmQgKGYyW2pdLndoYXQpKSB7CiAgICAg ICAgICAgICAgICAgICAgIGNvbnRpbnVlOwogICAgICAgICAgICAgICAgIH0KICAgICAgICAgICAg ICAgICBhc3NlcnQgKGYyW2pdLndoZW4udHZfc2VjID09IGZbal0ud2hlbi50dl9zZWMpOwpAQCAt MjA1NiwxMCArMjA5OCwxMCBAQCBwbWdyYXBoaXRlX3Jlc3BvbmRfcmVuZGVyX2dmeCAoc3RydWN0 IE1IRF9Db25uZWN0aW9uICpjb25uZWN0aW9uLAogCiAgICAgICAgICAgICAvLyBjbG9nIDw8ICIo IiA8PCBsYXN0eCA8PCAiLCIgPDwgbGFzdHkgPDwgIikiOwogCi0gICAgICAgICAgICBpZiAoaXNu YW5mICh0aGlzeSkpIHsKKyAgICAgICAgICAgIGlmIChwbWdyYXBoaXRlX2lzbmFuZiAodGhpc3kp KSB7CiAgICAgICAgICAgICAgICAgLy8gVGhpcyBkYXRhIHNsb3QgaXMgbWlzc2luZywgc28gcHV0 IGEgY2lyY2xlIGF0IHRoZSBwcmV2aW91cyBlbmQsIGlmCiAgICAgICAgICAgICAgICAgLy8gcG9z c2libGUsIHRvIGluZGljYXRlIHRoZSBkaXNjb250aW51aXR5Ci0gICAgICAgICAgICAgICAgaWYg KCEgaXNuYW4gKGxhc3R4KSAmJiAhIGlzbmFuIChsYXN0eSkpIHsKKyAgICAgICAgICAgICAgICBp ZiAoISBwbWdyYXBoaXRlX2lzbmFuZCAobGFzdHgpICYmICEgcG1ncmFwaGl0ZV9pc25hbmQgKGxh c3R5KSkgewogICAgICAgICAgICAgICAgICAgICBjYWlyb19tb3ZlX3RvIChjciwgbGFzdHgsIGxh c3R5KTsKICAgICAgICAgICAgICAgICAgICAgY2Fpcm9fYXJjIChjciwgbGFzdHgsIGxhc3R5LCBs aW5lX3dpZHRoKjAuNSwgMC4sIDIqTV9QSSk7CiAgICAgICAgICAgICAgICAgICAgIGNhaXJvX3N0 cm9rZSAoY3IpOwpAQCAtMjA4MSw3ICsyMTIzLDcgQEAgcG1ncmFwaGl0ZV9yZXNwb25kX3JlbmRl cl9nZnggKHN0cnVjdCBNSERfQ29ubmVjdGlvbiAqY29ubmVjdGlvbiwKICAgICAgICAgICAgIC8v IGNsb2cgPDwgIi0oIiA8PCB4IDw8ICIsIiA8PCB5IDw8ICIpICI7CiAKICAgICAgICAgICAgIGNh aXJvX21vdmVfdG8gKGNyLCB4LCB5KTsKLSAgICAgICAgICAgIGlmICghIGlzbmFuIChsYXN0eCkg JiYgISBpc25hbiAobGFzdHkpKSB7CisgICAgICAgICAgICBpZiAoISBwbWdyYXBoaXRlX2lzbmFu ZCAobGFzdHgpICYmICEgcG1ncmFwaGl0ZV9pc25hbmQgKGxhc3R5KSkgewogICAgICAgICAgICAg ICAgIC8vIGRyYXcgaXQgYXMgYSBsaW5lCiAgICAgICAgICAgICAgICAgY2Fpcm9fbGluZV90byAo Y3IsIGxhc3R4LCBsYXN0eSk7CiAgICAgICAgICAgICB9IGVsc2UgewpAQCAtMjIzMSw3ICsyMjcz LDcgQEAgcG1ncmFwaGl0ZV9yZXNwb25kX3JlbmRlcl9qc29uIChzdHJ1Y3QgTUhEX0Nvbm5lY3Rp b24gKmNvbm5lY3Rpb24sCiAgICAgICAgICAgICAgICAgICAgIG91dHB1dCA8PCAiLCI7CiAgICAg ICAgICAgICAgICAgfQogICAgICAgICAgICAgICAgIG91dHB1dCA8PCAiWyI7Ci0gICAgICAgICAg ICAgICAgaWYgKGlzbmFuZiAocmVzdWx0c1tpXS53aGF0KSkgeworICAgICAgICAgICAgICAgIGlm IChwbWdyYXBoaXRlX2lzbmFuZiAocmVzdWx0c1tpXS53aGF0KSkgewogICAgICAgICAgICAgICAg ICAgICBvdXRwdXQgPDwgIm51bGwiOwogICAgICAgICAgICAgICAgIH0gZWxzZSB7CiAgICAgICAg ICAgICAgICAgICAgIG91dHB1dCA8PCByZXN1bHRzW2ldLndoYXQ7Cg== ------=_Part_18694209_1339915740.1429058628795-- From nscott@redhat.com Tue Apr 14 19:49:53 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id F16367F3F for ; Tue, 14 Apr 2015 19:49:53 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id DF0408F8089 for ; Tue, 14 Apr 2015 17:49:53 -0700 (PDT) X-ASG-Debug-ID: 1429058991-04bdf06322251000001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id ZrR0pf9I2zetz9kZ (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 17:49:52 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3F0npt3055656 for ; Tue, 14 Apr 2015 20:49:51 -0400 Date: Tue, 14 Apr 2015 20:49:51 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp Message-ID: <1874744806.18695118.1429058991425.JavaMail.zimbra@redhat.com> In-Reply-To: <1584443116.18694211.1429058628802.JavaMail.zimbra@redhat.com> References: <1584443116.18694211.1429058628802.JavaMail.zimbra@redhat.com> Subject: Re: [pcp] [patch] fix graphite build on Mac OS X MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] [patch] fix graphite build on Mac OS X Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: fix graphite build on Mac OS X Thread-Index: yUeMV6rQr3CDDSgyBBcG5zMEbP45a4s8VHtF X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1429058991 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17931 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > [...] > It should resolve the Mac OS X build issue being reported over in > the Vector issue tracker (I can't verify it since I don't have the Oops, that's the pcp issue tracker, not Vector - https://github.com/performancecopilot/pcp/issues/5 cheers. -- Nathan From kenj@internode.on.net Tue Apr 14 21:01:29 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 295507F3F for ; Tue, 14 Apr 2015 21:01:29 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id A56BDAC005 for ; Tue, 14 Apr 2015 19:01:25 -0700 (PDT) X-ASG-Debug-ID: 1429063279-04cb6c1cca22df50001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id ejp5eyhTmOylFfeA for ; Tue, 14 Apr 2015 19:01:20 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DBAQC4xS1VPKEh0XYNT4Q6hkLHCwKCEQEBAQEBAQcBAQEBOIRcAQEEOEABEAsYCRYPCQMCAQIBMRQGDQEFAgEBuEOXEwEBAQEBAQEDAQEBAQEBARuCTYhehHwHhC0BBLAOhCNdgkMBAQE Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 15 Apr 2015 11:31:16 +0930 Message-ID: <552DC70D.5060600@internode.on.net> Date: Wed, 15 Apr 2015 12:03:57 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: "Frank Ch. Eigler" CC: Martins Innus , pcp@oss.sgi.com Subject: Re: pmLookupName sts differences References: <551D8119.5010404@buffalo.edu> <552CA769.1070607@internode.on.net> <552D1EE1.5000600@buffalo.edu> <552D7DE8.4030706@internode.on.net> X-ASG-Orig-Subj: Re: pmLookupName sts differences In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1429063279 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17932 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header On 15/04/15 10:09, Frank Ch. Eigler wrote: > Ken McDonell writes: > >> [...] >> 1. if numpmid == 1, then return 1 for success else an error code (<0) >> ... this special case is really required to allow a caller to discover >> _why_ a lookup failed for a particular metric >> 2. if numpmid > 1, then 3 cases apply >> [...] >> - otherwise, return n (0 <= n < numpmid) as the count for those >> that are OK > > I don't quite understand why 1 and >1 cases are different. What > reason could the caller discover in the first case, that she wouldn't > also want to know about the others? Fair question, Frank. Given there are numpmid lookups to be done, when numpmid > 1, there are > 1 possible "error" conditions that we have to map to a single integer return value ... we flag the individual PMIDs as PM_ID_NULL if the corresponding lookup fails, but we really need a short-hand way to know if all is well or not (to avoid scanning the array of PMIDs). So the common code template would be something like ... if ((sts = pmLookupName(numpmid, namelist, pmidlist)) != numpmid) { /* error case */ } But now, the problem is in the error case, what to do? We can skip the PM_ID_NULL ones in the code that follows and/or report something more useful to the punter. With the API as proposed (and indeed as implemented today), the error code might look like: int i; for (i = 0; i < numpmid; i++) { if (pmidlist[i] == PM_ID_NULL) { sts = pmLookupName(1, &namelist[i], &pmidlist[i]); printf("failed lookup for %s: %s\n", namelist[i], pmErrStr(sts)); } } From fche@redhat.com Tue Apr 14 21:19:20 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 9EECD7F3F for ; Tue, 14 Apr 2015 21:19:20 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 364E1AC003 for ; Tue, 14 Apr 2015 19:19:19 -0700 (PDT) X-ASG-Debug-ID: 1429064357-04bdf06323254640001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id DcAwUsKbnfvLbJxv (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 19:19:19 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3F2JH1k026046 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 14 Apr 2015 22:19:17 -0400 Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3F2JHUO015577; Tue, 14 Apr 2015 22:19:17 -0400 Received: by fche.csb (Postfix, from userid 2569) id 38DAD58519; Tue, 14 Apr 2015 22:19:14 -0400 (EDT) Date: Tue, 14 Apr 2015 22:19:14 -0400 From: "Frank Ch. Eigler" To: Nathan Scott Cc: pcp Subject: Re: [patch] fix graphite build on Mac OS X Message-ID: <20150415021914.GB29344@redhat.com> X-ASG-Orig-Subj: Re: [patch] fix graphite build on Mac OS X References: <1765856075.18693163.1429058314850.JavaMail.zimbra@redhat.com> <1584443116.18694211.1429058628802.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1584443116.18694211.1429058628802.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429064359 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - > Could you look this pmwebd patch over please? I've tried to follow > your coding style there, but, *shrug* ... its all non-pcp style and > there's many ways we could fix this one. Thanks a lot, looks good to me. - FChE From fche@redhat.com Tue Apr 14 21:24:44 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 83D2E7F3F for ; Tue, 14 Apr 2015 21:24:44 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 82EB3304048 for ; Tue, 14 Apr 2015 19:24:44 -0700 (PDT) X-ASG-Debug-ID: 1429064682-04cbb056b425f8e0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 43M3j6ku6Cl3vyHK (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 14 Apr 2015 19:24:43 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3F2OaUK014227 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Tue, 14 Apr 2015 22:24:36 -0400 Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3F2OZwd020201; Tue, 14 Apr 2015 22:24:35 -0400 Received: by fche.csb (Postfix, from userid 2569) id 947AC58519; Tue, 14 Apr 2015 22:24:32 -0400 (EDT) Date: Tue, 14 Apr 2015 22:24:32 -0400 From: "Frank Ch. Eigler" To: Ken McDonell Cc: Martins Innus , pcp@oss.sgi.com Subject: Re: pmLookupName sts differences Message-ID: <20150415022432.GC29344@redhat.com> X-ASG-Orig-Subj: Re: pmLookupName sts differences References: <551D8119.5010404@buffalo.edu> <552CA769.1070607@internode.on.net> <552D1EE1.5000600@buffalo.edu> <552D7DE8.4030706@internode.on.net> <552DC70D.5060600@internode.on.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <552DC70D.5060600@internode.on.net> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429064683 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, Ken - Thanks, the explanation (special-casing #pmids=1 to assist in detailed diagnostics even for >1 cases) makes sense. It'd be good to give that hint to programmers to in the man page. - FChE From kenj@internode.on.net Wed Apr 15 01:26:26 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 1E0957F3F for ; Wed, 15 Apr 2015 01:26:26 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 24BEF304048 for ; Tue, 14 Apr 2015 23:26:22 -0700 (PDT) X-ASG-Debug-ID: 1429079176-04cb6c1cca237760001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id lpDWQPMS73Xd8OLK for ; Tue, 14 Apr 2015 23:26:16 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DBAQAJBC5VPKEh0XYNT4NeXIMVgy3BCIgRAQEBAQEBBwEBAQE4hQUVcAYCBSECEQIyJwYCAQG3TnCWT4Ehi0cBg1uCUoFFBZUHmweCMoFxXYEEJIEbAQEB Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 15 Apr 2015 15:55:46 +0930 Message-ID: <552E050C.30402@internode.on.net> Date: Wed, 15 Apr 2015 16:28:28 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - fix pmlogcheck regression Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates - fix pmlogcheck regression Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1429079176 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17938 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp master Ken McDonell (2): pmlogcheck: fix basename regression qa/566: extend to check pmlogcheck bug exposed by pmmgr qa/566 | 7 ++++++ qa/566.out | 10 ++++++++ src/pmlogcheck/pmlogcheck.c | 50 ++++++++++++++++++++++++++++++++++++-------- 3 files changed, 58 insertions(+), 9 deletions(-) Details ... commit 25042461c0763a2e1b134f53e73ca407efd44127 Author: Ken McDonell Date: Wed Apr 15 16:27:05 2015 +1000 qa/566: extend to check pmlogcheck bug exposed by pmmgr commit 6b7ea0fdf895e2d6b11968bb7e156e14b523a257 Author: Ken McDonell Date: Wed Apr 15 15:04:24 2015 +1000 pmlogcheck: fix basename regression When I merged the two versions of pmlogcheck I broke the logic for determining the basename of the PCP archive from the command line argument. The problem was exposed by pmmgr which uses pmlogcheck to validate archives with names like archive-20150415.044829.0 but uses the basename archive-20150415.044829 as a command line argument to pmlogcheck. The old code (correctly) interpreted this as meaning all files matching the pattern archive-20150415.044829.{index,meta,digit...}, the new code (incorrectly) thought this was volume 044829 of the archive with basename archive-20150415 and then failed to find any files matching the pattern archive-20150415.{index,meta,digit...} ... doh! This was causing qa/666 to fail, and is fixed in this commit. From kenj@internode.on.net Wed Apr 15 01:41:47 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id A79C47F3F for ; Wed, 15 Apr 2015 01:41:47 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 43218AC004 for ; Tue, 14 Apr 2015 23:41:46 -0700 (PDT) X-ASG-Debug-ID: 1429080101-04bdf0632325eb30001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id lgu5Tgqj5meiRgPa for ; Tue, 14 Apr 2015 23:41:41 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DBAQDFBy5VPKEh0XYNT4p8xDeCXAKCBAEBAQEBAQcBAQEBOIRcAQEEOEABEAsYCRYPCQMCAQIBMRQGDQEHAQG3OZcSAQEBAQEBAQMBAQEBAQEBG4JNiF6EfAeELQEEsA6EI4MgAQEB Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 15 Apr 2015 16:11:04 +0930 Message-ID: <552E0892.8070109@internode.on.net> Date: Wed, 15 Apr 2015 16:43:30 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: "Frank Ch. Eigler" CC: Martins Innus , pcp@oss.sgi.com Subject: Re: pmLookupName sts differences References: <551D8119.5010404@buffalo.edu> <552CA769.1070607@internode.on.net> <552D1EE1.5000600@buffalo.edu> <552D7DE8.4030706@internode.on.net> <552DC70D.5060600@internode.on.net> <20150415022432.GC29344@redhat.com> X-ASG-Orig-Subj: Re: pmLookupName sts differences In-Reply-To: <20150415022432.GC29344@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1429080101 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17938 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header On 15/04/15 12:24, Frank Ch. Eigler wrote: > Hi, Ken - > > Thanks, the explanation (special-casing #pmids=1 to assist in detailed > diagnostics even for >1 cases) makes sense. It'd be good to give that > hint to programmers to in the man page. OK, I'll add that to the queue ... that man page will get a make over in this process. From nscott@redhat.com Wed Apr 15 02:05:24 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 42BC77F3F for ; Wed, 15 Apr 2015 02:05:24 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 1B08E8F8071 for ; Wed, 15 Apr 2015 00:05:21 -0700 (PDT) X-ASG-Debug-ID: 1429081519-04bdf0632325fc50001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id ndNpbff9Ei8YRj5f (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 15 Apr 2015 00:05:19 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3F75H2s026743; Wed, 15 Apr 2015 03:05:17 -0400 Date: Wed, 15 Apr 2015 03:05:17 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus Cc: pcp@oss.sgi.com Message-ID: <2008103064.18776145.1429081517471.JavaMail.zimbra@redhat.com> In-Reply-To: <551AB41F.6050409@buffalo.edu> References: <551AB41F.6050409@buffalo.edu> Subject: Re: [pcp] pmlogger configuration changes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pmlogger configuration changes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pmlogger configuration changes Thread-Index: aDfQADKVJJeEGi9EmF6uuPP71f4jLw== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1429081519 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17940 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Martins, ----- Original Message ----- > [...] > I am trying to track down some strangeness I'm seeing in pmlogger > configuration between 3.10.0 and recent git. > > All defaults except the primary logger line: > > #### > LOCALHOSTNAME y n PCP_LOG_DIR/pmlogger/LOCALHOSTNAME -r -c > primary.logger > #### > > The file: > > /etc/pcp/pmlogger/primary.logger > > exists and everything works as expected. > > On a recent git system, with the same config, pmlogger does not find the > primary.logger file and seems to construct a new (unrelated) one with > pmlogconf in /var/lib/pcp/config/pmlogger/primary.logger that appears to > be some sort of default config on startup. > > The change seems to come from here: > > 0020568401cefe9df692e2f705b8133a8ab87f0d Yes, that's the one - its missing an update to the specfile script to reflect the change it makes (i.e. making /var/lib/pcp/config/pmlogger the default location for configs once more; for a variety of exciting reasons - mainly around permissions - we have come full circle). > I guess I have 2 questions: > > 1. The comment led me to believe that everything should still work since > it says "." is searched first and I would expect "." to map to > /etc/pcp/pmlogger since that is where the control file lives. Is that > not correct? In this context, "." is the current working directory for the pmlogger process, which is /var/log/pcp/pmlogger/ from pmlogger_check(1). > 2. This was on a clean install with rpms built from git on a Centos 6.5 > machine. I can deal with this on new systems by putting the config in > the right place, but what is the expected behavior on upgrade? I am > setting up a test system that I can upgrade shortly, because I got lost > in the config file logic in the spec file, and am not sure if the right > thing will happen in terms of moving existing config files to the new > right place. After an upgrade we *should* be ending up with the right config to use below /var/lib/pcp/config/pmlogger (the rpm script didn't reflect this though the deb script did - fixed now, should be in pcp-3.10.4 soon). You can avoid this whole situation by using fully qualified paths to the configuration files - being explicit means we don't drop into the search algorithm at all - or storing your configs in those individual (per-control-file-line) pmlogger directories. cheers. -- Nathan From mgoodwin@redhat.com Wed Apr 15 02:07:14 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: ** X-Spam-Status: No, score=3.0 required=5.0 tests=TVD_SUBJ_NUM_OBFU_MINFP autolearn=no version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 3AA557F3F for ; Wed, 15 Apr 2015 02:07:14 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 2EEA18F8074 for ; Wed, 15 Apr 2015 00:07:14 -0700 (PDT) X-ASG-Debug-ID: 1429081632-04cbb056b126a9b0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id Fr6HvXYyuHGBTfUu (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 15 Apr 2015 00:07:13 -0700 (PDT) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3F74V4i019458 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 15 Apr 2015 03:07:12 -0400 Received: from [10.64.50.55] (vpn1-50-55.bne.redhat.com [10.64.50.55]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3F57mMV014514 for ; Wed, 15 Apr 2015 01:07:49 -0400 Message-ID: <552DF223.1090403@redhat.com> Date: Wed, 15 Apr 2015 15:07:47 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp Subject: pcp updates: improve collectl2pcp for disk.dm metrics and associated qa updates Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: improve collectl2pcp for disk.dm metrics and associated qa updates Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429081632 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Changes committed to git://git.performancecopilot.org/markgw/pcp/pcp.git master commit d7477092b25e29ac6022d116d03ca0fe4cd6e19f Author: Mark Goodwin Date: Tue Apr 14 15:34:11 2015 +1000 Support pmiostat -x dm for archives converted by collectl2pcp. Collectl doesn't collect persistent dm-* mapped names, so just export the dm-* name from /proc/diskstats as the instances for disk.dm metrics rather than lump them all together as disk.dev. PCP archives created by collectl2pcp now work with pmiostat -x dm modified: src/collectl2pcp/disk.c modified: src/collectl2pcp/metrics.c modified: src/collectl2pcp/pmdesc.c commit a89b9591e55a96bf5ab4d29c5e04063a43b4e1d6 Author: Mark Goodwin Date: Wed Apr 15 14:21:13 2015 +1000 remake since checksum changed after collectl2pcp changes. modified: qa/544.out commit f672b43b9e18b105ece4f90528b89ff93d90ac8a Author: Mark Goodwin Date: Wed Apr 15 14:18:23 2015 +1000 split pmiostat tests for sd and dm metrics on collectl2pcp archive. modified: qa/536 modified: qa/536.out From nscott@redhat.com Wed Apr 15 02:10:11 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id CC9F57F3F for ; Wed, 15 Apr 2015 02:10:11 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 67EE0AC005 for ; Wed, 15 Apr 2015 00:10:08 -0700 (PDT) X-ASG-Debug-ID: 1429081805-04cb6c1cc82394b0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id jCmy0FHnHD1tOykl (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 15 Apr 2015 00:10:06 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3F7A5A1003464 for ; Wed, 15 Apr 2015 03:10:05 -0400 Date: Wed, 15 Apr 2015 03:10:05 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp Message-ID: <1993317025.18778856.1429081805485.JavaMail.zimbra@redhat.com> In-Reply-To: <2103383829.18778760.1429081762535.JavaMail.zimbra@redhat.com> Subject: pcp updates: bug fixes, release prep MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: bug fixes, release prep Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.63] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: bug fixes, release prep Thread-Index: f7aqfesIdyZoqgtenuCWvT6BtKtnMQ== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1429081806 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17939 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git master Nathan Scott (4): build: commit the correct rtime.c update for Mac builds to work pmcd: fix a broken diagnostic found by the Mac OS X compiler configs: ensure spec config file copying matches current code build: update changelog, prepare for release Amer Ather (2): pmwebd: additional ACAO headers to resource responses pmwebd: fix compilation issues on Mac OS X in graphite code Joseph White (1): packaging: relax the allowed-libpfm-version checks a little CHANGELOG | 34 +++++++++++++++++++++ build/rpm/fedora.spec | 19 ++++++++--- build/rpm/pcp.spec.in | 19 ++++++++--- debian/changelog | 2 - src/libpcp/src/rtime.c | 4 +- src/pmcd/src/pmcd.c | 4 +- src/pmwebapi/pmgraphite.cxx | 70 +++++++++++++++++++++++++++++++++++--------- src/pmwebapi/pmresapi.cxx | 7 ++++ 8 files changed, 128 insertions(+), 31 deletions(-) From minnus@buffalo.edu Wed Apr 15 10:27:26 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id CDE187F3F for ; Wed, 15 Apr 2015 10:27:26 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id B8112304053 for ; Wed, 15 Apr 2015 08:27:23 -0700 (PDT) X-ASG-Debug-ID: 1429111641-04cb6c1cca24c2b0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id eyQ8KX4A6dbSW2IS for ; Wed, 15 Apr 2015 08:27:21 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmailB.acsu.buffalo.edu (localmailb.acsu.buffalo.edu [128.205.5.200]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 6B0EF7AF; Wed, 15 Apr 2015 11:27:21 -0400 (EDT) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 653B6EF4A; Wed, 15 Apr 2015 11:27:21 -0400 (EDT) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailB.acsu.buffalo.edu (Postfix) with ESMTP id C241DEF46; Wed, 15 Apr 2015 11:27:20 -0400 (EDT) Received: from smtp.buffalo.edu (smtp3.acsu.buffalo.edu [128.205.5.226]) by localmailB.acsu.buffalo.edu (Prefixe) with ESMTP id B21A5EF45; Wed, 15 Apr 2015 11:27:20 -0400 (EDT) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id A873F272D; Wed, 15 Apr 2015 11:27:20 -0400 (EDT) Message-ID: <552E8358.3060700@buffalo.edu> Date: Wed, 15 Apr 2015 11:27:20 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Ken McDonell , pcp@oss.sgi.com Subject: Re: [pcp] pmLookupName sts differences References: <551D8119.5010404@buffalo.edu> <552CA769.1070607@internode.on.net> <552D1EE1.5000600@buffalo.edu> <552D7DE8.4030706@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] pmLookupName sts differences In-Reply-To: <552D7DE8.4030706@internode.on.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1429111641 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17951 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Ken, On 4/14/15 4:51 PM, Ken McDonell wrote: > On 15/04/15 00:06, Martins Innus wrote: >> >> ... From my perspective, it would be desirable >> for pmLookupName give back correct information on valid metrics even if >> the input list contains some bogus names. > > Indeed. > > My first inclination would be something like this ... > > 1. if numpmid == 1, then return 1 for success else an error code (<0) > ... this special case is really required to allow a caller to discover > _why_ a lookup failed for a particular metric > > 2. if numpmid > 1, then 3 cases apply > - fatal error (no context, pmcd or pmns, ...) => return an error (<0) > - all OK, return numpmid > - otherwise, return n (0 <= n < numpmid) as the count for those > that are OK > > On return, we guarantee that the first numpmid elements of pmidlist[] > will be either PM_ID_NULL or a valid PMID. > > This is not too far off the actual implementation today, so I think > we're looking at (a) fixing the man page to accurately reflect the > intended API, and (b) some bug fixes for some corner cases, and (c) > audit all the callers of pmLookupName() in the PCP code base (there > are lots of these O(100), but only a handful involve numpmid > 1). > > This is much better than the ABI change I was fearing. > > If someone can see a problem with this, now would be a good time to > raise your concerns. Looks great to me. Thanks Martins From minnus@buffalo.edu Wed Apr 15 12:48:47 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id A22627F3F for ; Wed, 15 Apr 2015 12:48:47 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 79E3C8F804C for ; Wed, 15 Apr 2015 10:48:44 -0700 (PDT) X-ASG-Debug-ID: 1429120122-04bdf0632227d0b0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id u3WlDj7rYp1g6YyB for ; Wed, 15 Apr 2015 10:48:42 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmailA.acsu.buffalo.edu (localmaila.acsu.buffalo.edu [128.205.5.196]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id F25927AC; Wed, 15 Apr 2015 13:48:41 -0400 (EDT) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id DEB1953EF; Wed, 15 Apr 2015 13:48:41 -0400 (EDT) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailA.acsu.buffalo.edu (Postfix) with ESMTP id 7BB6B53EC; Wed, 15 Apr 2015 13:48:41 -0400 (EDT) Received: from smtp.buffalo.edu (smtp2.acsu.buffalo.edu [128.205.5.254]) by localmailA.acsu.buffalo.edu (Prefixe) with ESMTP id 6EBE153EB; Wed, 15 Apr 2015 13:48:41 -0400 (EDT) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 64B1D2745; Wed, 15 Apr 2015 13:48:41 -0400 (EDT) Message-ID: <552EA478.70505@buffalo.edu> Date: Wed, 15 Apr 2015 13:48:40 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp@oss.sgi.com Subject: Re: [pcp] pmlogger configuration changes References: <551AB41F.6050409@buffalo.edu> <2008103064.18776145.1429081517471.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] pmlogger configuration changes In-Reply-To: <2008103064.18776145.1429081517471.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1429120122 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17956 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Nathan, On 4/15/15 3:05 AM, Nathan Scott wrote: > > You can avoid this whole situation by using fully qualified paths to > the configuration files - being explicit means we don't drop into the > search algorithm at all - or storing your configs in those individual > (per-control-file-line) pmlogger directories. > Thanks, that's what we will probably do. Martins From lberk@redhat.com Wed Apr 15 12:55:44 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 8EBFD7F3F for ; Wed, 15 Apr 2015 12:55:44 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 76898304043 for ; Wed, 15 Apr 2015 10:55:41 -0700 (PDT) X-ASG-Debug-ID: 1429120539-04cb6c1cc7250d80001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id WJXhpCAOlrZUYKIT (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 15 Apr 2015 10:55:40 -0700 (PDT) X-Barracuda-Envelope-From: lberk@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3FHtdNK018320 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 15 Apr 2015 13:55:39 -0400 Received: from toium (unused-10-15-17-233.yyz.redhat.com [10.15.17.233]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3FHtcjt027344 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Wed, 15 Apr 2015 13:55:38 -0400 From: Lukas Berk To: pcp@oss.sgi.com Subject: pcp update: Fix 903 QA Test Date: Wed, 15 Apr 2015 13:55:38 -0400 X-ASG-Orig-Subj: pcp update: Fix 903 QA Test Message-ID: <878udtcm3p.fsf@redhat.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4 (gnu/linux) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429120540 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 --=-=-= Content-Type: text/plain Hi, I still found qa/903 failing on one of my virtual machines due to the $num_metrics variable being unset. This patch fixes the issue. --=-=-= Content-Type: text/x-patch Content-Disposition: inline; filename=0001-Correct-903-testcase-where-no-papi-counters-are-avai.patch Content-Description: Patch >From 09e8ba9efaf1ba7a84fa9a134e86971e3e340144 Mon Sep 17 00:00:00 2001 From: Lukas Berk Date: Wed, 15 Apr 2015 13:48:50 -0400 Subject: [PATCH] Correct 903 testcase where no papi counters are available qa/903 - $num_couters variable is not set in cases where there are no papi counters, not just a value of 0 should be checked. Signed-off-by: Lukas Berk --- qa/903 | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/qa/903 b/qa/903 index dafaff3..6cfdadd 100755 --- a/qa/903 +++ b/qa/903 @@ -47,7 +47,7 @@ pmdapapi_install() $sudo ./Install $tmp.out 2>&1 # some warnings are reasonable (e.g., too many concurrent counters) num_metrics=`$sudo pminfo -f papi.available.num_counters | grep value | awk '{print $2}'` - if [ "$num_metrics" -eq "0" ]; then + if [ -z "$num_metrics" ] || [ "$num_metrics" -eq "0" ]; then _notrun "PAPI metrics not found on hardware" fi # Check papi metrics have appeared ... X metrics and Y values -- 2.1.0 --=-=-=-- From minnus@buffalo.edu Wed Apr 15 12:55:50 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id C3D2D7F3F for ; Wed, 15 Apr 2015 12:55:50 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 99FD1304043 for ; Wed, 15 Apr 2015 10:55:50 -0700 (PDT) X-ASG-Debug-ID: 1429120548-04bdf0632227d850001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id DJpJNXc4g6GjcfeK for ; Wed, 15 Apr 2015 10:55:48 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmailA.acsu.buffalo.edu (localmaila.acsu.buffalo.edu [128.205.5.196]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 4B4E6836; Wed, 15 Apr 2015 13:55:48 -0400 (EDT) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 4540A104F6; Wed, 15 Apr 2015 13:55:48 -0400 (EDT) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailA.acsu.buffalo.edu (Postfix) with ESMTP id 98659104F2; Wed, 15 Apr 2015 13:55:47 -0400 (EDT) Received: from smtp.buffalo.edu (smtp3.acsu.buffalo.edu [128.205.5.226]) by localmailA.acsu.buffalo.edu (Prefixe) with ESMTP id 849C7104F1; Wed, 15 Apr 2015 13:55:47 -0400 (EDT) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 7957B2BD4; Wed, 15 Apr 2015 13:55:47 -0400 (EDT) Message-ID: <552EA623.6040207@buffalo.edu> Date: Wed, 15 Apr 2015 13:55:47 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Ken McDonell , pcp@oss.sgi.com Subject: Re: [pcp] specify instance id's with pmdaCacheStore References: <552D762D.2080400@buffalo.edu> <552D8386.6090401@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] specify instance id's with pmdaCacheStore In-Reply-To: <552D8386.6090401@internode.on.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1429120548 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17957 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Ken, On 4/14/15 5:15 PM, Ken McDonell wrote: > On 15/04/15 06:18, Martins Innus wrote: >> Hi, >> >> I was looking through the source and don't think there is a way to >> do this, but thought I would ask. In the case of a pmda where the >> instance names are strictly numeric, is it possible to have the >> pmdaCache* routines use the instance name (which would be numeric) when >> generating the instance id? > > Outside the scope when I designed and built the pmdaCache stuff, I'm > afraid. > > But if the external name is numeric (and >=0 and <= 2^22) then you > don't really need the cache routines ... atoi() should suffice n'est > ce pas? > Range is 0 to just under 2^32 and sparsely populated, so out of range for that. They are job numbers from a batch scheduler where there are probably ~10K instances at a time, that over time march through that range. >> More specifically, I am using the perl pmda api and the >> implementation that converts a perl hash to the pmdaCache* routines. >> >> It seems like the 2 choices are an auto-incrementing internally >> assigned id or a deterministic value generated by hashing in >> pmdaCache*Key functions. >> >> Hope this makes sense. > > I may be missing something ... can't you use the "list" rather than > the "hash" version of the perl API and populate the list with the > internal instance ids you want? Thanks, I just implemented that and it works. I was stuck in the mindset that I needed to use one or the other, but not both at the same time in a pmda, which is obviously not the case. Thanks Martins From ggunselm@emporia.edu Wed Apr 15 14:45:54 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 0F2E57F3F for ; Wed, 15 Apr 2015 14:45:54 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 9DB7FAC004 for ; Wed, 15 Apr 2015 12:45:50 -0700 (PDT) X-ASG-Debug-ID: 1429127143-04bdf06320283340001-S8gJnT Received: from enterprise.emporia.edu ([198.248.24.127]) by cuda.sgi.com with ESMTP id v8zMn4JHhvDGz1dC (version=TLSv1 cipher=AES128-SHA bits=128 verify=NO) for ; Wed, 15 Apr 2015 12:45:44 -0700 (PDT) X-Barracuda-Envelope-From: ggunselm@emporia.edu X-Barracuda-Apparent-Source-IP: 198.248.24.127 Received: from STINGRAY.esuad.ds ([fe80::75ed:4f4e:9de1:926e]) by HUDSON2.esuad.ds ([fe80::5d0b:7981:c9a7:c682%16]) with mapi id 14.02.0387.000; Wed, 15 Apr 2015 14:45:42 -0500 From: Glen Gunselman To: pcp Subject: PCP build on CentOS 6.6 - VirtualBox 4.3.26 Thread-Topic: PCP build on CentOS 6.6 - VirtualBox 4.3.26 X-ASG-Orig-Subj: PCP build on CentOS 6.6 - VirtualBox 4.3.26 Thread-Index: AdB3s01HEK0vG4MgTsSVfk6k7Fv2kg== Date: Wed, 15 Apr 2015 19:45:42 +0000 Message-ID: <83904B8EF53D51499A9B43662BC670A9017F987E89@STINGRAY.esuad.ds> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [2001:49d0:141:100:80f3:9316:bb4d:a9b6] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Barracuda-Connect: UNKNOWN[198.248.24.127] X-Barracuda-Start-Time: 1429127144 X-Barracuda-Encrypted: AES128-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.12 X-Barracuda-Spam-Status: No, SCORE=0.12 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=RDNS_NONE, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17962 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.10 RDNS_NONE Delivered to trusted network by a host with no rDNS I am researching PCP (and friends) as a replacement for Orca/SE Toolkit. [this morning, sometime after 8 AM CDT] I created a virtual machine using: VirtualBox 4.3.26-r98988 on Windows 7 Enterprise SP1 and the CentOS-6.6-x86_64-bin-DVD1.iso (selected "Basic Server") The VM was updated using: # yum update At this point I created a Forwarding rule and switched to PuTTY. I created a user account (and group): # useradd -K PASS_MAX_DAYS=3D-1 -f -1 -e "" -c "for Performance Co-Pilot" = pcp added the following: # yum install git # yum install gcc # yum install bison # yum install flex # yum install gcc-c++ # yum install qt-devel-4.6.2-28.el6_5.x86_64 switched to user pcp and $ git clone git://git.pcp.io/pcp $ cd pcp $ ./configure --prefix=3D/usr --sysconfdir=3D/etc --localstatedir=3D/var (Note: configure produced the following warning but otherwise I see no c= omplaints - I ignored the warning) WARNING: Python version 2.6 header file missing. Cannot proceed with the Python 2 installation found. $ make $ su root # make install # chkconfig pmcd on # service pmcd start =20 It failed with the following output: [root@CentOS66BasicServer ~]# chkconfig pmcd on [root@CentOS66BasicServer ~]# service pmcd start Rebuilding PMNS ... pmnsmerge: error while loading shared libraries: libpcp= .so.3: cannot open shared object file: No such file or directory Rebuilding the Performance Metrics Name Space (PMNS) in /var/lib/pcp/pmns .= .. Rebuild: PCP upgrade processing for "root" PMNS changes ... Rebuild: merging the following PMNS files: root root_jbd2 root_linux root_mmv root_pmcd root_proc root_root root_xfs Rebuild: pmnsmerge failed "root" has not been changed. failed (status=3D1) Starting pmcd ... /usr/libexec/pcp/bin/pmcd: error while loading shared lib= raries: libpcp_pmda.so.3: cannot open shared object file: No such file or d= irectory pmcd_wait: error while loading shared libraries: libpcp.so.3: cannot open s= hared object file: No such file or directory /usr/libexec/pcp/bin/pmpost: error while loading shared libraries: libpcp.s= o.3: cannot open shared object file: No such file or directory /usr/libexec/pcp/bin/pmpost: error while loading shared libraries: libpcp.s= o.3: cannot open shared object file: No such file or directory [root@CentOS66BasicServer ~]# The showing the following: # find / -name 'libpcp.so*' /usr/lib/libpcp.so.3 /usr/lib/libpcp.so /home/pcp/pcp/src/libpcp/src/libpcp.so.3 /home/pcp/pcp/src/libpcp/src/libpcp.so I see the following pcp(?) related links in /usr/lib # ls -l /usr/lib | grep pcp -rwxr-xr-x. 1 root root 2665548 Apr 15 10:19 libpcp.a -rwxr-xr-x. 1 root root 89588 Apr 15 10:19 libpcp_gui.a lrwxrwxrwx. 1 root root 15 Apr 15 10:19 libpcp_gui.so -> libpcp_gui.so= .2 -rwxr-xr-x. 1 root root 59434 Apr 15 10:19 libpcp_gui.so.2 -rwxr-xr-x. 1 root root 101882 Apr 15 10:19 libpcp_import.a lrwxrwxrwx. 1 root root 18 Apr 15 10:19 libpcp_import.so -> libpcp_imp= ort.so.1 -rwxr-xr-x. 1 root root 65082 Apr 15 10:19 libpcp_import.so.1 -rwxr-xr-x. 1 root root 50266 Apr 15 10:19 libpcp_mmv.a lrwxrwxrwx. 1 root root 15 Apr 15 10:19 libpcp_mmv.so -> libpcp_mmv.so= .1 -rwxr-xr-x. 1 root root 40397 Apr 15 10:19 libpcp_mmv.so.1 -rwxr-xr-x. 1 root root 428214 Apr 15 10:19 libpcp_pmda.a lrwxrwxrwx. 1 root root 16 Apr 15 10:19 libpcp_pmda.so -> libpcp_pmda.= so.3 -rwxr-xr-x. 1 root root 261621 Apr 15 10:19 libpcp_pmda.so.3 lrwxrwxrwx. 1 root root 11 Apr 15 10:19 libpcp.so -> libpcp.so.3 -rwxr-xr-x. 1 root root 1489545 Apr 15 10:19 libpcp.so.3 -rwxr-xr-x. 1 root root 168728 Apr 15 10:19 libpcp_trace.a lrwxrwxrwx. 1 root root 17 Apr 15 10:19 libpcp_trace.so -> libpcp_trac= e.so.2 -rwxr-xr-x. 1 root root 102032 Apr 15 10:19 libpcp_trace.so.2 I have very little experience with Linux but have been working with Solaris= for the last 10 years. The symbolic links look iffy to me. I hope this is something simple that I overlooked or missed in the docs. Is CentOS a good environment for experimenting with PCP and friends? Thanks for any advice, Glen Gunselman From pcolby@gmail.com Wed Apr 15 16:04:45 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE, T_DKIM_INVALID autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 0F3757F3F for ; Wed, 15 Apr 2015 16:04:45 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id C7D97304039 for ; Wed, 15 Apr 2015 14:04:41 -0700 (PDT) X-ASG-Debug-ID: 1429131875-04bdf06320285b60001-S8gJnT Received: from mail-la0-f49.google.com (mail-la0-f49.google.com [209.85.215.49]) by cuda.sgi.com with ESMTP id er7BhVMDng9Xe9Y8 (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Wed, 15 Apr 2015 14:04:36 -0700 (PDT) X-Barracuda-Envelope-From: pcolby@gmail.com X-Barracuda-Apparent-Source-IP: 209.85.215.49 X-Barracuda-IPDD: Level1 [gmail.com/209.85.215.49] Received: by labbd9 with SMTP id bd9so42357063lab.2 for ; Wed, 15 Apr 2015 14:04:34 -0700 (PDT) X-Barracuda-IPDD: Level1 [gmail.com/209.85.215.49] X-Barracuda-IPDD: Level1 [gmail.com/209.85.215.49] DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=c9Scg4GxQE2cevqgh6FhjUeDn5um6Mgefv2OBmXnEWI=; b=F8LlvLvb1MQrhN4NXd6bmhr3tFc3MPsDItlSC8mzNSxBp3G2iKwDD3YHWKCPFjosWT 7oQLy8CwNoiIJANiih08UvWOY9LRIyh/kco1U2t+Q+7J+4jpZZoF/qp360Jld/C7IotZ M/D8bxr4YWuWkYERzkr5krt763k4pFF9Fv36K1QnXbhswuNRf6imSJD1U09zlcTdTC77 LoK+249LqNemLR3ltgnd6o657Ej/yCz5b2dMLzOtLi0MuDop6vb2PekjjVwmxqloNikX K10tw0bawP1Iyvxr8hBk9mvOavaD8Bw0GZLdUKXPBfCu9Aoj/Wf+tXF/4ZTk+FuzjLqq YltQ== MIME-Version: 1.0 X-Received: by 10.152.25.167 with SMTP id d7mr4403346lag.108.1429131874413; Wed, 15 Apr 2015 14:04:34 -0700 (PDT) Sender: pcolby@gmail.com Received: by 10.152.134.180 with HTTP; Wed, 15 Apr 2015 14:04:34 -0700 (PDT) In-Reply-To: <83904B8EF53D51499A9B43662BC670A9017F987E89@STINGRAY.esuad.ds> References: <83904B8EF53D51499A9B43662BC670A9017F987E89@STINGRAY.esuad.ds> Date: Thu, 16 Apr 2015 07:04:34 +1000 X-Google-Sender-Auth: bzXW3aqOXOZNGgFSQkkIB-ARxzE Message-ID: Subject: Re: [pcp] PCP build on CentOS 6.6 - VirtualBox 4.3.26 From: Paul Colby X-ASG-Orig-Subj: Re: [pcp] PCP build on CentOS 6.6 - VirtualBox 4.3.26 To: Glen Gunselman Cc: pcp Content-Type: multipart/alternative; boundary=089e0158cb5ab634610513c9b160 X-Barracuda-Connect: mail-la0-f49.google.com[209.85.215.49] X-Barracuda-Start-Time: 1429131875 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED, HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17964 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 HTML_MESSAGE BODY: HTML included in message --089e0158cb5ab634610513c9b160 Content-Type: text/plain; charset=UTF-8 You might need to run `ldconfig` (not sure if `make install` is doing that for you). See: man ldconfig Cheers. pc. On Thu, Apr 16, 2015 at 5:45 AM, Glen Gunselman wrote: > I am researching PCP (and friends) as a replacement for Orca/SE Toolkit. > > [this morning, sometime after 8 AM CDT] > I created a virtual machine using: > VirtualBox 4.3.26-r98988 on Windows 7 Enterprise SP1 > and the > CentOS-6.6-x86_64-bin-DVD1.iso (selected "Basic Server") > > The VM was updated using: > # yum update > > At this point I created a Forwarding rule and switched to PuTTY. > > I created a user account (and group): > # useradd -K PASS_MAX_DAYS=-1 -f -1 -e "" -c "for Performance Co-Pilot" > pcp > > added the following: > > # yum install git > # yum install gcc > # yum install bison > # yum install flex > # yum install gcc-c++ > # yum install qt-devel-4.6.2-28.el6_5.x86_64 > > switched to user pcp and > $ git clone git://git.pcp.io/pcp > $ cd pcp > $ ./configure --prefix=/usr --sysconfdir=/etc --localstatedir=/var > > (Note: configure produced the following warning but otherwise I see no > complaints - I ignored the warning) > WARNING: Python version 2.6 header file missing. > Cannot proceed with the Python 2 installation found. > > $ make > > $ su root > # make install > > # chkconfig pmcd on > # service pmcd start > > It failed with the following output: > > > [root@CentOS66BasicServer ~]# chkconfig pmcd on > [root@CentOS66BasicServer ~]# service pmcd start > Rebuilding PMNS ... pmnsmerge: error while loading shared libraries: > libpcp.so.3: cannot open shared object file: No such file or directory > Rebuilding the Performance Metrics Name Space (PMNS) in /var/lib/pcp/pmns > ... > Rebuild: PCP upgrade processing for "root" PMNS changes ... > Rebuild: merging the following PMNS files: > root root_jbd2 root_linux root_mmv root_pmcd root_proc root_root root_xfs > Rebuild: pmnsmerge failed > "root" has not been changed. > failed (status=1) > Starting pmcd ... /usr/libexec/pcp/bin/pmcd: error while loading shared > libraries: libpcp_pmda.so.3: cannot open shared object file: No such file > or directory > pmcd_wait: error while loading shared libraries: libpcp.so.3: cannot open > shared object file: No such file or directory > /usr/libexec/pcp/bin/pmpost: error while loading shared libraries: > libpcp.so.3: cannot open shared object file: No such file or directory > > /usr/libexec/pcp/bin/pmpost: error while loading shared libraries: > libpcp.so.3: cannot open shared object file: No such file or directory > [root@CentOS66BasicServer ~]# > > > The showing the following: > > # find / -name 'libpcp.so*' > /usr/lib/libpcp.so.3 > /usr/lib/libpcp.so > /home/pcp/pcp/src/libpcp/src/libpcp.so.3 > /home/pcp/pcp/src/libpcp/src/libpcp.so > > I see the following pcp(?) related links in /usr/lib > > # ls -l /usr/lib | grep pcp > -rwxr-xr-x. 1 root root 2665548 Apr 15 10:19 libpcp.a > -rwxr-xr-x. 1 root root 89588 Apr 15 10:19 libpcp_gui.a > lrwxrwxrwx. 1 root root 15 Apr 15 10:19 libpcp_gui.so -> > libpcp_gui.so.2 > -rwxr-xr-x. 1 root root 59434 Apr 15 10:19 libpcp_gui.so.2 > -rwxr-xr-x. 1 root root 101882 Apr 15 10:19 libpcp_import.a > lrwxrwxrwx. 1 root root 18 Apr 15 10:19 libpcp_import.so -> > libpcp_import.so.1 > -rwxr-xr-x. 1 root root 65082 Apr 15 10:19 libpcp_import.so.1 > -rwxr-xr-x. 1 root root 50266 Apr 15 10:19 libpcp_mmv.a > lrwxrwxrwx. 1 root root 15 Apr 15 10:19 libpcp_mmv.so -> > libpcp_mmv.so.1 > -rwxr-xr-x. 1 root root 40397 Apr 15 10:19 libpcp_mmv.so.1 > -rwxr-xr-x. 1 root root 428214 Apr 15 10:19 libpcp_pmda.a > lrwxrwxrwx. 1 root root 16 Apr 15 10:19 libpcp_pmda.so -> > libpcp_pmda.so.3 > -rwxr-xr-x. 1 root root 261621 Apr 15 10:19 libpcp_pmda.so.3 > lrwxrwxrwx. 1 root root 11 Apr 15 10:19 libpcp.so -> libpcp.so.3 > -rwxr-xr-x. 1 root root 1489545 Apr 15 10:19 libpcp.so.3 > -rwxr-xr-x. 1 root root 168728 Apr 15 10:19 libpcp_trace.a > lrwxrwxrwx. 1 root root 17 Apr 15 10:19 libpcp_trace.so -> > libpcp_trace.so.2 > -rwxr-xr-x. 1 root root 102032 Apr 15 10:19 libpcp_trace.so.2 > > > I have very little experience with Linux but have been working with > Solaris for the last 10 years. The symbolic links look iffy to me. > > I hope this is something simple that I overlooked or missed in the docs. > > Is CentOS a good environment for experimenting with PCP and friends? > > > Thanks for any advice, > Glen Gunselman > > _______________________________________________ > pcp mailing list > pcp@oss.sgi.com > http://oss.sgi.com/mailman/listinfo/pcp > --089e0158cb5ab634610513c9b160 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
You might need to run `ldconfig` (not sure if `make instal= l` is doing that for you).

See: man ldconfig
<= br>
Cheers.

pc.

On Thu, Apr 16, 2015 at 5:45 AM, Glen = Gunselman <ggunselm@emporia.edu> wrote:
I am researching PCP (and friends) as a replacement for Or= ca/SE Toolkit.

[this morning, sometime after 8 AM CDT]
I created a virtual machine using:
VirtualBox 4.3.26-r98988 on Windows 7 Enterprise SP1
and the
CentOS-6.6-x86_64-bin-DVD1.iso (selected "Basic Server")

The VM was updated using:
# yum update

At this point I created a Forwarding rule and switched to PuTTY.

I created a user account (and group):
# useradd -K PASS_MAX_DAYS=3D-1 -f -1 -e ""=C2=A0 -c "for Pe= rformance Co-Pilot"=C2=A0 pcp

added the following:

# yum install git
# yum install gcc
# yum install bison
# yum install flex
# yum install gcc-c++
# yum install qt-devel-4.6.2-28.el6_5.x86_64

switched to user pcp and
$ git clone git://git.p= cp.io/pcp
$ cd pcp
$ ./configure --prefix=3D/usr --sysconfdir=3D/etc --localstatedir=3D/var
=C2=A0 =C2=A0(Note: configure produced the following warning but otherwise = I see no complaints - I ignored the warning)
WARNING: Python version 2.6 header file missing.
Cannot proceed with the Python 2 installation found.

$ make

$ su root
# make install

# chkconfig pmcd on
# service pmcd start

It failed with the following output:


[root@CentOS66BasicServer ~]# chkconfig pmcd on
[root@CentOS66BasicServer ~]# service pmcd start
Rebuilding PMNS ... pmnsmerge: error while loading shared libraries: libpcp= .so.3: cannot open shared object file: No such file or directory
Rebuilding the Performance Metrics Name Space (PMNS) in /var/lib/pcp/pmns .= ..
Rebuild: PCP upgrade processing for "root" PMNS changes ...
Rebuild: merging the following PMNS files:
root root_jbd2 root_linux root_mmv root_pmcd root_proc root_root root_xfs Rebuild: pmnsmerge failed
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0"root" has not been changed. failed (status=3D1)
Starting pmcd ... /usr/libexec/pcp/bin/pmcd: error while loading shared lib= raries: libpcp_pmda.so.3: cannot open shared object file: No such file or d= irectory
pmcd_wait: error while loading shared libraries: libpcp.so.3: cannot open s= hared object file: No such file or directory
/usr/libexec/pcp/bin/pmpost: error while loading shared libraries: libpcp.s= o.3: cannot open shared object file: No such file or directory

/usr/libexec/pcp/bin/pmpost: error while loading shared libraries: libpcp.s= o.3: cannot open shared object file: No such file or directory
[root@CentOS66BasicServer ~]#


The showing the following:

# find / -name 'libpcp.so*'
/usr/lib/libpcp.so.3
/usr/lib/libpcp.so
/home/pcp/pcp/src/libpcp/src/libpcp.so.3
/home/pcp/pcp/src/libpcp/src/libpcp.so

I see the following pcp(?) related links in /usr/lib

# ls -l /usr/lib | grep pcp
-rwxr-xr-x. 1 root root 2665548 Apr 15 10:19 libpcp.a
-rwxr-xr-x. 1 root root=C2=A0 =C2=A089588 Apr 15 10:19 libpcp_gui.a
lrwxrwxrwx. 1 root root=C2=A0 =C2=A0 =C2=A0 15 Apr 15 10:19 libpcp_gui.so -= > libpcp_gui.so.2
-rwxr-xr-x. 1 root root=C2=A0 =C2=A059434 Apr 15 10:19 libpcp_gui.so.2
-rwxr-xr-x. 1 root root=C2=A0 101882 Apr 15 10:19 libpcp_import.a
lrwxrwxrwx. 1 root root=C2=A0 =C2=A0 =C2=A0 18 Apr 15 10:19 libpcp_import.s= o -> libpcp_import.so.1
-rwxr-xr-x. 1 root root=C2=A0 =C2=A065082 Apr 15 10:19 libpcp_import.so.1 -rwxr-xr-x. 1 root root=C2=A0 =C2=A050266 Apr 15 10:19 libpcp_mmv.a
lrwxrwxrwx. 1 root root=C2=A0 =C2=A0 =C2=A0 15 Apr 15 10:19 libpcp_mmv.so -= > libpcp_mmv.so.1
-rwxr-xr-x. 1 root root=C2=A0 =C2=A040397 Apr 15 10:19 libpcp_mmv.so.1
-rwxr-xr-x. 1 root root=C2=A0 428214 Apr 15 10:19 libpcp_pmda.a
lrwxrwxrwx. 1 root root=C2=A0 =C2=A0 =C2=A0 16 Apr 15 10:19 libpcp_pmda.so = -> libpcp_pmda.so.3
-rwxr-xr-x. 1 root root=C2=A0 261621 Apr 15 10:19 libpcp_pmda.so.3
lrwxrwxrwx. 1 root root=C2=A0 =C2=A0 =C2=A0 11 Apr 15 10:19 libpcp.so ->= libpcp.so.3
-rwxr-xr-x. 1 root root 1489545 Apr 15 10:19 libpcp.so.3
-rwxr-xr-x. 1 root root=C2=A0 168728 Apr 15 10:19 libpcp_trace.a
lrwxrwxrwx. 1 root root=C2=A0 =C2=A0 =C2=A0 17 Apr 15 10:19 libpcp_trace.so= -> libpcp_trace.so.2
-rwxr-xr-x. 1 root root=C2=A0 102032 Apr 15 10:19 libpcp_trace.so.2


I have very little experience with Linux but have been working with Solaris= for the last 10 years.=C2=A0 The symbolic links look iffy to me.

I hope this is something simple that I overlooked or missed in the docs.
Is CentOS a good environment for experimenting with PCP and friends?


Thanks for any advice,
Glen Gunselman

_______________________________________________
pcp mailing list
pcp@oss.sgi.com
http:= //oss.sgi.com/mailman/listinfo/pcp

--089e0158cb5ab634610513c9b160-- From kenj@internode.on.net Wed Apr 15 16:17:11 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 810C37F3F for ; Wed, 15 Apr 2015 16:17:11 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 1CE3FAC004 for ; Wed, 15 Apr 2015 14:17:07 -0700 (PDT) X-ASG-Debug-ID: 1429132624-04bdf06320286000001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id I9WMGJyytHApNJp2 for ; Wed, 15 Apr 2015 14:17:05 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DbAQCU1C5VPKEh0XYNT4p8xDOCXAKCCwEBAQEBAQcBAQEBOIRcAQEEODwEEQsYCRYPCQMCAQIBMRQTCAEBuACWVQELIIJNiF6FAxaEFwEEnEuQD4NNhCODIAEBAQ Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 16 Apr 2015 06:47:04 +0930 Message-ID: <552ED5F4.5060906@internode.on.net> Date: Thu, 16 Apr 2015 07:19:48 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] PCP build on CentOS 6.6 - VirtualBox 4.3.26 References: <83904B8EF53D51499A9B43662BC670A9017F987E89@STINGRAY.esuad.ds> X-ASG-Orig-Subj: Re: [pcp] PCP build on CentOS 6.6 - VirtualBox 4.3.26 In-Reply-To: <83904B8EF53D51499A9B43662BC670A9017F987E89@STINGRAY.esuad.ds> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1429132625 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17964 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 16/04/15 05:45, Glen Gunselman wrote: > I am researching PCP (and friends) as a replacement for Orca/SE Toolkit. Welcome, Glen. > ... > $ su root > # make install This is really not the best recipe ... Makepkgs is preferred and will create rpms for your environment (and suitable packages for other environments) ... from the INSTALL file (as recently updated) ... == B. Building from source 0. Preliminaries The PCP code base is targeted for many different operating systems and many different combinations of related packages, so a little planning is needed before launching into a build from source. Package dependencies come in several flavours: (a) hard build dependencies - without these PCP cannot be build from source, and the build will fail in various ways at the compilation or packaging stages, e.g. gmake, autoconf, flex, bison, ...; (b) optional build dependences - if these components are not installed the build will work, but the resultant packages may be missing some features or entire applications, e.g. extended authentication, secure connections, service discovery, pmwebd, ...; (c) QA dependencies - you can ignore these unless you want to run the (extensive) PCP QA suite. It is strongly recommended that you run the script: $ qa/admin/check-vm and review the output before commencing a build. 1. Configure, build and install the package The pcp package uses autoconf/configure and expects a GNU build environment (your platform must at least have gmake). If you just want to spin a .RPM, .DEB, .DMG, .EXE and/or tar file, use the Makepkgs script in the top level directory. This will configure and build the package for your platform and leave binary and src packages in the build/ directory. It will also leave binary and source tar file in the build/tar directory. $ ./Makepkgs --verbose From kenj@internode.on.net Wed Apr 15 17:51:25 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id EAEDF7CBE for ; Wed, 15 Apr 2015 17:51:25 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id DD912304053 for ; Wed, 15 Apr 2015 15:51:25 -0700 (PDT) X-ASG-Debug-ID: 1429138279-04cb6c1cc82593a0001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id mVgMZHarNlqrUG5M for ; Wed, 15 Apr 2015 15:51:20 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DbAQD06i5VPKEh0XYNT4NeXIMVgy3BBIgYAQEBAQEBBwEBAQE4hQVVMAYCBRYLAgsDAgECATEnBgIBAbgFcJYXgSGPI4JSgUUFlRGHOoxOhw6EI12CQwEBAQ Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 16 Apr 2015 08:21:19 +0930 Message-ID: <552EEC0A.8000202@internode.on.net> Date: Thu, 16 Apr 2015 08:54:02 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - INSTALL update and qa prep for next release Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - INSTALL update and qa prep for next release Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1429138279 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17966 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp master Ken McDonell (3): INSTALL: add notes about Makepkgs and qa/admin/check-vm qa/findmetric: add archives dir as a place to search qa/src/lookupnametest: ready for pmLookupName() rework INSTALL | 29 +++++++ qa/findmetric | 2 qa/src/GNUlocaldefs | 3 qa/src/lookupnametest.c | 194 ++++++++++++++++++++++++++++++++++++++++++++++++ 4 files changed, 226 insertions(+), 2 deletions(-) Details ... commit 0a90c3d520fbca8169a9f5004ccef5d802591396 Author: Ken McDonell Date: Wed Apr 15 16:39:27 2015 +1000 qa/src/lookupnametest: ready for pmLookupName() rework commit 08380e2378b04a90adfc0ef88e056ac0f7dcb8f0 Author: Ken McDonell Date: Wed Apr 15 16:38:44 2015 +1000 qa/findmetric: add archives dir as a place to search commit 3c5a615ec096e0bede5bbc8a8f42438a083a77b7 Author: Ken McDonell Date: Wed Apr 15 16:37:24 2015 +1000 INSTALL: add notes about Makepkgs and qa/admin/check-vm From kenj@internode.on.net Wed Apr 15 18:20:10 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 861497F50 for ; Wed, 15 Apr 2015 18:20:10 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 22EEEAC007 for ; Wed, 15 Apr 2015 16:20:06 -0700 (PDT) X-ASG-Debug-ID: 1429139999-04cbb056b228d850001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id b0xHMZmeJ5SnztF3 for ; Wed, 15 Apr 2015 16:19:59 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DbAQCP8C5VPKEh0XYNT4p8xDOCXAKCCwEBAQEBAQcBAQEBOIRcAQEEJxFAEQsYCRYPCQMCAQIBMRQTCAEBuA2WXQEBCAIBH4srhCRfFoQXAQScS4YejT6EI4FggUABAQE Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 16 Apr 2015 08:39:05 +0930 Message-ID: <552EF035.6040803@internode.on.net> Date: Thu, 16 Apr 2015 09:11:49 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] JSON PMDA References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <1237712965.18667183.1429054767135.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] JSON PMDA In-Reply-To: <1237712965.18667183.1429054767135.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1429139999 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17968 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 15/04/15 09:39, Nathan Scott wrote: > ... > Its OK to extend the API/ABI, but not to break it. Which should be all we > need to do here, I think. Maybe see if we can reduce the range that those > cache.c interfaces accept - the two lines with "if (inst == 0x7fffffff) {" > there look promising. If we had a h->maxinst there perhaps, instead of the > hard-coded 2^32-1 limit (may need to change the test to '>=' too) we might > be done and dusted here. That'll turn out to be a gross oversimplification > I'm sure ... but maybe, just maybe it will work. Can we tease out the h->maxinst part here? How would that get set? A new "op" to pmdaCacheOp I presume (the ioctl() way of making ABI changes without breaking the ABI!). But it would need to get preserved for persistent caches, and re-read when the cache was reloaded ... so that would be a VERSION bump (to 2) for the external file format and backwards compatibility code (set maxinst to 2^31-1 for VERSION 1). Is this what was intended? If so, it sounds OK to me, so far ... From fche@redhat.com Wed Apr 15 19:56:57 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 60D367F3F for ; Wed, 15 Apr 2015 19:56:57 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 554F330404E for ; Wed, 15 Apr 2015 17:56:54 -0700 (PDT) X-ASG-Debug-ID: 1429145812-04cbb056b328f2a0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id l4wUV5CJZ8DJgGUN (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 15 Apr 2015 17:56:53 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3G0uqYX014406 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 15 Apr 2015 20:56:52 -0400 Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3G0up97029942; Wed, 15 Apr 2015 20:56:51 -0400 Received: by fche.csb (Postfix, from userid 2569) id 65FFD58392; Wed, 15 Apr 2015 20:56:48 -0400 (EDT) To: David Smith Cc: Nathan Scott , pcp@oss.sgi.com Subject: Re: JSON PMDA References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> X-ASG-Orig-Subj: Re: JSON PMDA From: fche@redhat.com (Frank Ch. Eigler) Date: Wed, 15 Apr 2015 20:56:48 -0400 In-Reply-To: <552D6524.1030803@redhat.com> (David Smith's message of "Tue, 14 Apr 2015 14:06:12 -0500") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429145813 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - >>>> ... needs to be deterministic, else bugs - see mail re dmcache/dmthin a >>>> little earlier for more details. IOW, restarting/reconfiguring the PMDA >>>> needs to ensure the same IDs are generated for the same metrics/indoms. >>> >>> I couldn't find the email you were referring to, but I see the problem >> >> Oh, sorry, that was an obscure reference - this is the one I meant: >> http://www.pcp.io/pipermail/pcp/2015-March/006876.html Can we back up a minute and assess why exactly this constraint is being suggested? I'm aware of no place in the documentation that claims that numeric PMIDs can be assumed stable across pcp contexts - so every pcp client I've seen does an explicit name-to-pmid resolution step. Is this true? What is the origin of the referenced email's concern about pmlogrewrite? Each archive is self-describing, and in isolation has no need to match name-to-pmid mappings to any other archive. When/if archives are appended to each other, sure, pmlogextract(merge) may not handle this case well today, but that's a problem only of that tool. Other multi-archive tools work fine (pmwebd/graphite, and I hope pmchart). Even if it were desirable to work around pmlogextract shortcomings, this need not mean that there has to be a sophisticated or long-term uniqueness guarantee. It may well be sufficient to make it likely that if pmcd is restarted, with no change to json metadata files, that the same numbers be produced. That in turn could be handled straightforwardly by deterministic traversal of the json metadata files (such as by sorting by their pathnames). - FChE From nscott@redhat.com Wed Apr 15 20:51:15 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id E4A517F3F for ; Wed, 15 Apr 2015 20:51:15 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id CA5348F8071 for ; Wed, 15 Apr 2015 18:51:12 -0700 (PDT) X-ASG-Debug-ID: 1429149065-04bdf0632328cef0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id 58SE9yVhbxjaBy2n (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 15 Apr 2015 18:51:06 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3G1p5Zo023942 for ; Wed, 15 Apr 2015 21:51:05 -0400 Date: Wed, 15 Apr 2015 21:51:05 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp@oss.sgi.com Message-ID: <601698345.692931.1429149065411.JavaMail.zimbra@redhat.com> Subject: pcp updates: docs, qa MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: docs, qa Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.141] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: docs, qa Thread-Index: AlhlQg9fTnvlgynou+xTN5VpxtsPSA== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1429149066 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17971 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/pcp.git master Ken McDonell (1): INSTALL: add notes about Makepkgs and qa/admin/check-vm Lukas Berk (1): qa: correct 903 testcase where no papi counters are available INSTALL | 29 +++++++++++++++++++++++++++++ qa/903 | 2 +- 2 files changed, 30 insertions(+), 1 deletion(-) From nscott@redhat.com Wed Apr 15 21:35:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 5BECE7F3F for ; Wed, 15 Apr 2015 21:35:18 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 411E68F8040 for ; Wed, 15 Apr 2015 19:35:15 -0700 (PDT) X-ASG-Debug-ID: 1429151711-04bdf0632328dde0001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id A1B0M6V20INVwynR (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 15 Apr 2015 19:35:12 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3G2Z7KP025683; Wed, 15 Apr 2015 22:35:07 -0400 Date: Wed, 15 Apr 2015 22:35:07 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <413488814.713207.1429151707274.JavaMail.zimbra@redhat.com> In-Reply-To: <552EF035.6040803@internode.on.net> References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <1237712965.18667183.1429054767135.JavaMail.zimbra@redhat.com> <552EF035.6040803@internode.on.net> Subject: Re: [pcp] JSON PMDA MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] JSON PMDA Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.141] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: JSON PMDA Thread-Index: ej7PliGo4C7rb6/X8gehbKuVzz/lkg== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1429151712 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17972 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > On 15/04/15 09:39, Nathan Scott wrote: > > ... > > Its OK to extend the API/ABI, but not to break it. Which should be all we > > need to do here, I think. Maybe see if we can reduce the range that those > > cache.c interfaces accept - the two lines with "if (inst == 0x7fffffff) {" > > there look promising. If we had a h->maxinst there perhaps, instead of the > > hard-coded 2^32-1 limit (may need to change the test to '>=' too) we might > > be done and dusted here. That'll turn out to be a gross oversimplification > > I'm sure ... but maybe, just maybe it will work. > > Can we tease out the h->maxinst part here? > > How would that get set? A new "op" to pmdaCacheOp I presume (the > ioctl() way of making ABI changes without breaking the ABI!). Well, we'd also need a way to set the size limit, so I guess a new API would be needed - perhaps a pmdaCacheResize(3)? probably with unsigned integer as second parameter. > But it would need to get preserved for persistent caches, and re-read > when the cache was reloaded ... so that would be a VERSION bump (to 2) > for the external file format and backwards compatibility code (set > maxinst to 2^31-1 for VERSION 1). > > Is this what was intended? Hadn't thought of the format change, but now that you mention it, yes. > If so, it sounds OK to me, so far ... cheers. -- Nathan From kenj@internode.on.net Wed Apr 15 22:04:21 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 12A157F3F for ; Wed, 15 Apr 2015 22:04:21 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id CD45B304053 for ; Wed, 15 Apr 2015 20:04:17 -0700 (PDT) X-ASG-Debug-ID: 1429153454-04bdf0632128e940001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id WiBzaPuxaaHW3JDM for ; Wed, 15 Apr 2015 20:04:14 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DZAQCTJS9VPKEh0XYNT4NeXIMVgy3BBIgTAQEBAQEBBwEBAQE4hQVVNgIFFgsCCwMCAQIBMQ4MDQgBAbdncJY6gSGRdYFFBY56hhiHOjqFZY0/hCNdgkMBAQE Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 16 Apr 2015 12:32:22 +0930 Message-ID: <552F26E2.5070506@internode.on.net> Date: Thu, 16 Apr 2015 13:05:06 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: PCP Subject: pcp qa status Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp qa status Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1429153454 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17973 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Looking pretty good. 787 has one read in reverse case in interp.c I have not been able to make go faster, yet. 666 is recently fixed. Others are onesies and twosies for the most part. $ pcp-qa-summary -fr ==== QA Summary ==== Date Run Pass Fail Nrun Host 2015-04-11 727 722 5 67|bozo PCP 3.10.3 x86_64 Ubuntu 14.04 2015-04-14 719 715 4 75|bozo-laptop PCP 3.10.3 i686 LinuxMint 15 2015-04-14 720 716 4 74|bozo-vm PCP 3.10.3 x86_64 Debian 7.6 Daily runs, but no QA |fuji PCP pmcd.ver i386 Darwin 10.8.0 Daily runs, but no QA |grundy PCP 3.10.3 ia64 SUSE SLES11 SP1 2015-04-14 722 717 5 72|vm00 PCP 3.10.3 x86_64 Ubuntu 12.04 2015-04-14 728 726 2 66|vm01 PCP 3.10.3 i686 Ubuntu 12.10 2015-04-14 716 711 5 78|vm02 PCP 3.10.3 i686 openSUSE 12.1 2015-04-14 737 731 6 57|vm03 PCP 3.10.3 x86_64 Fedora 18 2015-04-15 665 662 3 129|vm04 PCP 3.10.3 i586 CentOS 5.11 2015-04-15 649 643 6 145|vm05 PCP 3.10.3 i486 Gentoo 2.0.3 2015-04-15 60 60 0 4|vm06 PCP 3.10.3 amd64 FreeBSD 8.2-RELEASE-p9 2015-04-15 719 715 4 75|vm07 PCP 3.10.3 x86_64 Debian 6.0.10 Daily runs, but no QA |vm08 PCP 3.10.3 x86_64 CentOS Linux7.0.1406 Daily runs, but no QA |vm09 PCP 3.10.2 i386 NetBSD 6.1.5 2015-04-13 60 60 0 4|vm10 PCP 3.10.3 i386 FreeBSD 8.2-RELEASE-p9 2015-04-15 719 717 2 75|vm11 PCP 3.10.3 i686 Debian 6.0.9 2015-04-15 729 728 1 65|vm12 PCP 3.10.3 i686 Fedora 17 2015-04-16 732 728 4 62|vm14 PCP 3.10.3 x86_64 CentOS6.5 No daily runs |vm15 PCP 3.9.1 x86_64 Slackware 13.37.0 2015-04-16 717 716 1 77|vm18 PCP 3.10.3 x86_64 LinuxMint 12 2015-04-16 716 710 6 78|vm19 PCP 3.10.3 x86_64 openSUSE 12.2 2015-04-12 723 719 4 71|vm20 PCP 3.10.3 x86_64 Ubuntu 13.04 2015-04-12 721 718 3 73|vm21 PCP 3.10.3 i686 Debian 7.4 2015-04-12 732 730 2 62|vm22 PCP 3.10.3 x86_64 Fedora 19 2015-04-13 731 729 2 63|vm23 PCP 3.10.3 i686 Fedora 20 2015-04-13 690 686 4 104|vm24 PCP 3.10.3 i686 openSUSE 13.1 2015-04-13 658 653 5 136|vm25 PCP 3.10.3 x86_64 CentOS 5.5 2015-04-13 731 729 2 63|vm26 PCP 3.10.3 x86_64 Fedora 21 Summary: 15821 run, 80 failed (0.51%) ==== QA Failure (X) Map ==== Host bo bl bv 00 01 02 03 04 05 07 11 12 14 18 19 20 21 22 23 24 25 26 Test %bad Test QA groups 787 92% X X X X X X X X X X X X X X X X X X X X X X 787 archive pmie pmlogrewrite pmdumplog pmval flakey 666 63% X X X X X X X X X X X X X X X 666 pmmgr 721 17% X X X X 721 dbpmda 115 13% X X X 115 pmie 145 13% X X X 145 pmns 956 13% X X X 956 pmcd 984 13% X X X 984 cgroups 152 8% X X 152 pmda.pmcd pmval 769 8% X X 769 other 069 4% X 069 pmcd pmval 083 4% X 083 pmlc pmlogger compat 087 4% X 087 archive 088 4% X 088 archive pmval 090 4% X 090 archive 166 4% X 166 pmlogreduce pmval pmdumplog archive 198 4% X 198 pmda context 241 4% X 241 pmda.mmv pmval perl 251 4% X 251 archive pmval Host bo bl bv 00 01 02 03 04 05 07 11 12 14 18 19 20 21 22 23 24 25 26 257 4% X 257 libpcp pmns compat 366 4% X 366 pmlogconf 370 4% X 370 pmimport derive pmdumplog perl 374 4% X 374 pmlc pmlogger 375 4% X 375 pmlc pmlogger 381 4% X 381 logutil pmlc 406 4% X 406 libpcp event 458 4% X 458 pmda.logger pmda.install event 508 4% X 508 archive pmlogreduce pmlogextract 566 4% X 566 pmlogcheck 657 4% X 657 pmda.dm 823 4% X 823 pmda.sample pmstore secure 832 4% X 832 pmda.sample pmstore secure 837 4% X 837 pmda.sample containers Host bo bl bv 00 01 02 03 04 05 07 11 12 14 18 19 20 21 22 23 24 25 26 From dak-unpriv@franck.debian.org Thu Apr 16 01:02:02 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 6B3287F3F for ; Thu, 16 Apr 2015 01:02:02 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 044D0AC003 for ; Wed, 15 Apr 2015 23:01:58 -0700 (PDT) X-ASG-Debug-ID: 1429164113-04cb6c1cc9265cf0001-S8gJnT Received: from muffat.debian.org (muffat.debian.org [206.12.19.146]) by cuda.sgi.com with ESMTP id KCSiS5AALCzLGBcy (version=TLSv1 cipher=AES128-SHA bits=128 verify=NO) for ; Wed, 15 Apr 2015 23:01:53 -0700 (PDT) X-Barracuda-Envelope-From: dak-unpriv@franck.debian.org X-Barracuda-Apparent-Source-IP: 206.12.19.146 Received: from franck.debian.org ([138.16.160.12]) from C=NA,ST=NA,L=Ankh Morpork,O=Debian SMTP,OU=Debian SMTP CA,CN=franck.debian.org,EMAIL=hostmaster@franck.debian.org (verified) by muffat.debian.org with esmtps (TLS1.2:DHE_RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from ) id 1Yics4-00065T-Eq for pcp@oss.sgi.com; Thu, 16 Apr 2015 06:01:52 +0000 Received: from dak-unpriv by franck.debian.org with local (Exim 4.80) (envelope-from ) id 1Yics3-0000I5-Am for pcp@oss.sgi.com; Thu, 16 Apr 2015 06:01:51 +0000 To: pcp@oss.sgi.com From: Debian FTP Masters Subject: Processing of pcp_3.10.4_i386.changes Date: Thu, 16 Apr 2015 06:01:51 +0000 X-ASG-Orig-Subj: Processing of pcp_3.10.4_i386.changes X-Debian: DAK X-DAK: DAK Precedence: bulk Auto-Submitted: auto-generated X-Debian-Package: pcp Message-Id: X-Barracuda-Connect: muffat.debian.org[206.12.19.146] X-Barracuda-Start-Time: 1429164113 X-Barracuda-Encrypted: AES128-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17978 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- pcp_3.10.4_i386.changes uploaded successfully to localhost along with the files: pcp_3.10.4.dsc pcp_3.10.4.tar.xz pcp_3.10.4_i386.deb pcp-conf_3.10.4_i386.deb libpcp3-dev_3.10.4_i386.deb libpcp3_3.10.4_i386.deb libpcp-gui2-dev_3.10.4_i386.deb libpcp-gui2_3.10.4_i386.deb libpcp-mmv1-dev_3.10.4_i386.deb libpcp-mmv1_3.10.4_i386.deb libpcp-pmda3-dev_3.10.4_i386.deb libpcp-pmda3_3.10.4_i386.deb libpcp-trace2-dev_3.10.4_i386.deb libpcp-trace2_3.10.4_i386.deb libpcp-import1-dev_3.10.4_i386.deb libpcp-import1_3.10.4_i386.deb python-pcp_3.10.4_i386.deb libpcp-pmda-perl_3.10.4_i386.deb libpcp-import-perl_3.10.4_i386.deb libpcp-logsummary-perl_3.10.4_i386.deb libpcp-mmv-perl_3.10.4_i386.deb pcp-import-sar2pcp_3.10.4_all.deb pcp-import-ganglia2pcp_3.10.4_all.deb pcp-import-mrtg2pcp_3.10.4_all.deb pcp-import-sheet2pcp_3.10.4_all.deb pcp-import-iostat2pcp_3.10.4_all.deb pcp-import-collectl2pcp_3.10.4_i386.deb pcp-doc_3.10.4_all.deb pcp-testsuite_3.10.4_i386.deb pcp-manager_3.10.4_i386.deb pcp-webapi_3.10.4_i386.deb pcp-gui_3.10.4_i386.deb Greetings, Your Debian queue daemon (running on host franck.debian.org) From envelope@ftp-master.debian.org Thu Apr 16 01:04:42 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 09AB47F3F for ; Thu, 16 Apr 2015 01:04:42 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id EF215304059 for ; Wed, 15 Apr 2015 23:04:41 -0700 (PDT) X-ASG-Debug-ID: 1429164280-04cbb056b4299b00001-S8gJnT Received: from muffat.debian.org (muffat.debian.org [206.12.19.146]) by cuda.sgi.com with ESMTP id 6doXe4vhZKOCu8BI (version=TLSv1 cipher=AES128-SHA bits=128 verify=NO) for ; Wed, 15 Apr 2015 23:04:40 -0700 (PDT) X-Barracuda-Envelope-From: envelope@ftp-master.debian.org X-Barracuda-Apparent-Source-IP: 206.12.19.146 Received: from franck.debian.org ([138.16.160.12]) from C=NA,ST=NA,L=Ankh Morpork,O=Debian SMTP,OU=Debian SMTP CA,CN=franck.debian.org,EMAIL=hostmaster@franck.debian.org (verified) by muffat.debian.org with esmtps (TLS1.2:DHE_RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from ) id 1Yicul-0006I6-D9; Thu, 16 Apr 2015 06:04:39 +0000 Received: from dak by franck.debian.org with local (Exim 4.80) (envelope-from ) id 1Yicuk-0001on-4o; Thu, 16 Apr 2015 06:04:38 +0000 From: Debian FTP Masters To: PCP Development Team , Nathan Scott X-DAK: dak process-upload X-Debian: DAK X-Debian-Package: pcp Precedence: bulk Auto-Submitted: auto-generated MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit Subject: pcp_3.10.4_i386.changes is NEW Message-Id: X-ASG-Orig-Subj: pcp_3.10.4_i386.changes is NEW Date: Thu, 16 Apr 2015 06:04:38 +0000 X-Barracuda-Connect: muffat.debian.org[206.12.19.146] X-Barracuda-Start-Time: 1429164280 X-Barracuda-Encrypted: AES128-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17978 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- binary:pcp-import-ganglia2pcp is NEW. Your package has been put into the NEW queue, which requires manual action from the ftpteam to process. The upload was otherwise valid (it had a good OpenPGP signature and file hashes are valid), so please be patient. Packages are routinely processed through to the archive, and do feel free to browse the NEW queue[1]. If there is an issue with the upload, you will recieve an email from a member of the ftpteam. If you have any questions, you may reply to this email. [1]: https://ftp-master.debian.org/new.html From pcp-announce-bounces@oss.sgi.com Thu Apr 16 03:41:38 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=RP_MATCHES_RCVD autolearn=unavailable version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from oss.sgi.com (localhost [IPv6:::1]) by oss.sgi.com (Postfix) with ESMTP id 971E37F50; Thu, 16 Apr 2015 03:41:38 -0500 (CDT) X-Original-To: pcp-announce@oss.sgi.com Delivered-To: pcp-announce@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 4E5317F3F for ; Thu, 16 Apr 2015 03:41:37 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 40AD18F8054 for ; Thu, 16 Apr 2015 01:41:34 -0700 (PDT) X-ASG-Debug-ID: 1429173688-04cb6c1cc926b2d0001-87ZIJf Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id zhA4SbCFEAvNRf6B (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 16 Apr 2015 01:41:29 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3G8fShr030129 for ; Thu, 16 Apr 2015 04:41:28 -0400 Date: Thu, 16 Apr 2015 04:41:28 -0400 (EDT) From: Nathan Scott To: pcp-announce Message-ID: <2052088528.957261.1429173688311.JavaMail.zimbra@redhat.com> In-Reply-To: <1452430715.949522.1429172533380.JavaMail.zimbra@redhat.com> MIME-Version: 1.0 X-ASG-Orig-Subj: Performance Co-Pilot 3.10.4 released X-Originating-IP: [10.64.50.141] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Performance Co-Pilot 3.10.4 released Thread-Index: 5HYlJnWqb8ox47c7Kv1I9adDEcusjA== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1429173689 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.17982 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Subject: [pcp-announce] Performance Co-Pilot 3.10.4 released X-BeenThere: pcp-announce@oss.sgi.com X-Mailman-Version: 2.1.14 Precedence: list Reply-To: Nathan Scott List-Id: Performance Co-Pilot announcements List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: pcp-announce-bounces@oss.sgi.com Sender: pcp-announce-bounces@oss.sgi.com Hi all, PCP version 3.10.4 has been tagged and released into the wild. You can find the sources on http://pcp.io - binary builds will be slowly making their way up over the next day or so. There is an experimental Copr repository for those on Fedora/RHEL here: https://copr.fedoraproject.org/coprs/nathans/pcp/ We'll be working on improving access to binary builds on other platforms in the coming days and weeks. This release is an excellent base for trying out the Vector web frontend (included in the above Copr repo) -- https://github.com/Netflix/vector ! Planning for the next release (pcp-3.10.5) is well underway. We will be aiming for a container-flavoured release, with improved packaging and new tools aimed specifically at analysing containers. Mark Goodwin will be assisting with release duties for this next round - thanks Mark! But for now, please enjoy pcp-3.10.4! pcp-3.10.4 (15 April 2015) - pmdalinux: fixed kernel.pernode.cpu.* for systems with only one CPU. - pmdadm: merged in pmdadmcache, added thin provisioning metrics - pmcd: fix failure to recover from errors sending client attrs - pmcd: don't advertise presence if -A specified. - pmchart: fix metric/host selection for containers - python build: support for epel5 builds using python26 packages - python api: do not assume unicode is only for python3 - stdpmid: updated the reserved domain number ranges - libpcp: fix instance request memory corruption for large requests - libpcp: multi-threading fixes and pdubuf optimisations - libpcp: fix Avahi-related memory corruption - libpcp: fix an interpolation performance issue - libpcp: fix getopt --hostsfile parsing - libpcp: tighten error handling in __pmGetArchiveEnd() - pmwebd: enable multi-threading by default - pmwebd: correct _indom array-allocation logic - pmwebd: additional ACAO headers to resource responses - pcp2graphite: python version neutral handling of stdout flush - pcp-verify: a new utility for verifying collector setups, especially for use with containers - pcp sh: fix tempfile leak with sub-commands, refactor pcp-summary - rc scripts: ensure rundir directories created when needed - rc scripts: ensure tmpfiles not leftover from helper scripts - rc_pmcd: add .NeedRemove option for pmcd start script also - pmpause: lightweight pmsleep extension for a pmcd container - pmlogcheck: merge previous versions, added documentation and tests - pmdumplog: new options and new log reading logic - build: add missing configure check for pkg-config requirement - build: Dockerfile for a pcp-pmcd container image based on Fedora - build: get Mac builds going on current Mac OS X (10.9/10.10) - configure: fix AC_MSG_ERROR parameter passing - packaging: fix default pmlogger/pmie configs directory location - packaging: simplify rpm dependencies on pcp-webjs package via %dir - packaging: relax the allowed-libpfm-version checks a little cheers. -- Nathan _______________________________________________ pcp-announce mailing list pcp-announce@oss.sgi.com http://oss.sgi.com/mailman/listinfo/pcp-announce From dsmith@redhat.com Thu Apr 16 10:21:21 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 73D3F29DFC for ; Thu, 16 Apr 2015 10:21:21 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 588408F8074 for ; Thu, 16 Apr 2015 08:21:18 -0700 (PDT) X-ASG-Debug-ID: 1429197673-04bdf063202aa420001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id kKlfXjOqrNNKtwcW (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 16 Apr 2015 08:21:14 -0700 (PDT) X-Barracuda-Envelope-From: dsmith@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3GFLDbL018320 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 16 Apr 2015 11:21:13 -0400 Received: from t540p.usersys.redhat.com (dhcp-10-15-1-2.hsv.redhat.com [10.15.1.2]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3GFLDvP032694 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 16 Apr 2015 11:21:13 -0400 Message-ID: <552FD368.6030602@redhat.com> Date: Thu, 16 Apr 2015 10:21:12 -0500 From: David Smith User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: "Frank Ch. Eigler" CC: Nathan Scott , pcp@oss.sgi.com Subject: Re: JSON PMDA References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> X-ASG-Orig-Subj: Re: JSON PMDA In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429197674 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 04/15/2015 07:56 PM, Frank Ch. Eigler wrote: ... stuff deleted ... > Even if it were desirable to work around pmlogextract shortcomings, > this need not mean that there has to be a sophisticated or long-term > uniqueness guarantee. It may well be sufficient to make it likely > that if pmcd is restarted, with no change to json metadata files, that > the same numbers be produced. That in turn could be handled > straightforwardly by deterministic traversal of the json metadata > files (such as by sorting by their pathnames). That sounds good, except in the case where when the JSON PMDA was started there were 3 JSON sources, and during the run a 4th was added. Now the JSON PMDA gets restarted and a simple sort of the pathnames gives different cluster values. In case the above isn't clear, let's say that on startup the JSON PMDA sees the following sources: bar (cluster #1), foo (cluster #2), zoo (cluster #3) Then the following gets added: dog (cluster #4) Then the PMDA gets restarted. A sort of the pathnames would give: bar (cluster #1), dog, (cluster #2), foo (cluster #3), zoo (cluster #4) -- David Smith dsmith@redhat.com Red Hat http://www.redhat.com 256.217.0141 (direct) 256.837.0057 (fax) From fche@redhat.com Thu Apr 16 10:28:43 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 2D61F29DFC for ; Thu, 16 Apr 2015 10:28:43 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 0ECC6304039 for ; Thu, 16 Apr 2015 08:28:39 -0700 (PDT) X-ASG-Debug-ID: 1429198118-04cb6c1cca2771e0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id hjKRE8Il34eLmLKF (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 16 Apr 2015 08:28:39 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (Postfix) with ESMTPS id 8E5E68E703 for ; Thu, 16 Apr 2015 15:28:38 +0000 (UTC) Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3GFScip012625; Thu, 16 Apr 2015 11:28:38 -0400 Received: by fche.csb (Postfix, from userid 2569) id DA42658519; Thu, 16 Apr 2015 11:28:34 -0400 (EDT) Date: Thu, 16 Apr 2015 11:28:34 -0400 From: "Frank Ch. Eigler" To: David Smith Cc: Nathan Scott , pcp@oss.sgi.com Subject: Re: JSON PMDA Message-ID: <20150416152834.GB6822@redhat.com> X-ASG-Orig-Subj: Re: JSON PMDA References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <552FD368.6030602@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <552FD368.6030602@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429198119 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, David - > [...] > That sounds good, except in the case where when the JSON PMDA was > started there were 3 JSON sources, and during the run a 4th was added. > Now the JSON PMDA gets restarted ... but according to normal practice, a "restarted pmda" means "restarted pmcd", which means active pcp contexts are dropped, which means clients are to reconnect & recalculate name->pmid mappings. > In case the above isn't clear, let's say that on startup the JSON PMDA > sees the following sources: > bar (cluster #1), foo (cluster #2), zoo (cluster #3) > Then the following gets added: > dog (cluster #4) > > Then the PMDA gets restarted. A sort of the pathnames would give: > bar (cluster #1), dog, (cluster #2), foo (cluster #3), zoo (cluster #4) Yes, or the same sort of thing (for pmid "instance" numbers) if the contents of the metadata files change across a pmda/pmcd restart. Or if the indoms inside the data files drastically. My point is that this may not be worth protecting against. - FChE From kenj@internode.on.net Thu Apr 16 15:54:55 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 487A67F3F for ; Thu, 16 Apr 2015 15:54:55 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id C8DFEAC006 for ; Thu, 16 Apr 2015 13:54:54 -0700 (PDT) X-ASG-Debug-ID: 1429217689-04cb6c1cca281ae0001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id pTHINDMiUE1HPIpt for ; Thu, 16 Apr 2015 13:54:49 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2BpBwDMIDBVPHhy0XZdgwyBLoZCxxYEAgKBUk0BAQEBAQEHAQEBATg7hCABAQEDAQgCHQESHCMFBwEDAgYDEQQBASgHGSAKAwkIAgQBEgsFiBIHyRABAQEBBgEBAQEeiymEI1kHBoQnBZEaYp47giUcgWIsMYECgUEBAQE Received: from ppp118-209-114-120.lns20.mel4.internode.on.net (HELO bozohorize) ([118.209.114.120]) by ipmail06.adl2.internode.on.net with ESMTP; 17 Apr 2015 06:24:47 +0930 From: "Ken McDonell" To: "'Frank Ch. Eigler'" , "'David Smith'" Cc: References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <552FD368.6030602@redhat.com> <20150416152834.GB6822@redhat.com> In-Reply-To: <20150416152834.GB6822@redhat.com> Subject: RE: [pcp] JSON PMDA Date: Fri, 17 Apr 2015 06:54:42 +1000 X-ASG-Orig-Subj: RE: [pcp] JSON PMDA Message-ID: <003f01d07887$90ee5180$b2caf480$@internode.on.net> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQFYOq9bahNwUT06oBaSKQVOPtgLAAEsFordAgjZiUQBJi6JAQFNfkXUAgEvk0ABV5vkLQLGGJxyneJWcIA= Content-Language: en-au X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1429217689 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18010 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header > -----Original Message----- > From: pcp-bounces@oss.sgi.com [mailto:pcp-bounces@oss.sgi.com] On Behalf > Of Frank Ch. Eigler > Sent: Friday, 17 April 2015 1:29 AM > To: David Smith > Cc: pcp@oss.sgi.com > Subject: Re: [pcp] JSON PMDA > > Hi, David - > > > [...] > > That sounds good, except in the case where when the JSON PMDA was > > started there were 3 JSON sources, and during the run a 4th was added. > > Now the JSON PMDA gets restarted > > ... but according to normal practice, a "restarted pmda" means "restarted > pmcd", which means active pcp contexts are dropped, which means clients are > to reconnect & recalculate name->pmid mappings. I think we need to be a bit more careful. Clients may or may not re-explore the PMNS in this situation ... I just experimented with pmie and it does NOT do this. Most clients that keep running when a PMDA or PMCD is missing have been written with some assumptions about the consistency of metric names and metadata across invocations of a PMDA. I can think of a whole raft of changes that a PMDA might make that are pretty sure to break one or more clients, e.g. change metric semantics or units, change the semantics of an instance domain (so "foo" is instance 0 now and instance "1" later on), ... and I think changing the name --> pmid mapping falls into this camp. But there is another class of issues around archives. pmlogextract (and indeed anything that processes a set of archives that claim to be from the same host) must assume that the PMNS and the metadata for the metrics are consistent from one archive to the next. In the PCP data model, an instance domain is the only metadata that is timestamped and expected and allowed to change over time ... and even then the changes are expected to be limited to "some instance(s) appear", "some instance(s) go away", and if an instance re-appears it will have the same external and internal instance ids. Any PMDA that wishes to change it's metadata outside this envelope needs to be careful. If the changes are rare and driven by extensions or bug fixes to the code then most clients may see some oddness when the change happens, and pmlogrewrite provides the bridge to smooth the transition for the historical archives. If the changes need to be more frequent (because the base data is dynamic) then we need to try and make the PMDA as temporally consistent as possible, so that if object X exists some time ago and still exists now, we are using the same PCP data (metrics and instances) to describe X at both points in time. > > > In case the above isn't clear, let's say that on startup the JSON PMDA > > sees the following sources: > > bar (cluster #1), foo (cluster #2), zoo (cluster #3) Then the > > following gets added: > > dog (cluster #4) > > > > Then the PMDA gets restarted. A sort of the pathnames would give: > > bar (cluster #1), dog, (cluster #2), foo (cluster #3), zoo (cluster > > #4) I think you'd want to avoid the "sort" here if possible, so bar stays cluster #1 (I assume this is the cluster component of the PMID). And in this context, the sort of extension to the pmdaCache services being discussed yesterday might provide a means to maintain a persistent "name" to "id" map where the "id" values are constrained to the range that would work for a pmid's cluster component. > Yes, or the same sort of thing (for pmid "instance" numbers) if the contents of > the metadata files change across a pmda/pmcd restart. Or if the indoms inside > the data files drastically. As I said above, indom's are special and treated differently). From fche@redhat.com Thu Apr 16 17:27:42 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 436C17F3F for ; Thu, 16 Apr 2015 17:27:42 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id C4C65AC007 for ; Thu, 16 Apr 2015 15:27:41 -0700 (PDT) X-ASG-Debug-ID: 1429223256-04cbb056b32b9700001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id WK4EJXHlADcfgy9v (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 16 Apr 2015 15:27:37 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3GMRWWM017355 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Thu, 16 Apr 2015 18:27:32 -0400 Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3GMRW4i032605; Thu, 16 Apr 2015 18:27:32 -0400 Received: by fche.csb (Postfix, from userid 2569) id BCFD958519; Thu, 16 Apr 2015 18:27:28 -0400 (EDT) Date: Thu, 16 Apr 2015 18:27:28 -0400 From: "Frank Ch. Eigler" To: Ken McDonell Cc: "'David Smith'" , pcp@oss.sgi.com Subject: Re: [pcp] JSON PMDA Message-ID: <20150416222728.GD6822@redhat.com> X-ASG-Orig-Subj: Re: [pcp] JSON PMDA References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <552FD368.6030602@redhat.com> <20150416152834.GB6822@redhat.com> <003f01d07887$90ee5180$b2caf480$@internode.on.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <003f01d07887$90ee5180$b2caf480$@internode.on.net> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429223257 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, Ken - > > ... but according to normal practice, a "restarted pmda" means > > "restarted pmcd", which means active pcp contexts are dropped, > > which means clients are to reconnect & recalculate name->pmid > > mappings. > > I think we need to be a bit more careful. > > Clients may or may not re-explore the PMNS in this situation ... I just > experimented with pmie and it does NOT do this. That's unfortunate. (OTOH, in src/pmie/eval.c enable() / reconnect(), it calls reinitMetric(), which does redo all the pmLookup* business; in what scenario doesn't and cannot pmie do this?) > Most clients that keep running when a PMDA or PMCD is missing have > been written with some assumptions about the consistency of metric > names and metadata across invocations of a PMDA. [...] Can you point at another example by any chance? > But there is another class of issues around archives. pmlogextract > (and indeed anything that processes a set of archives that claim to > be from the same host) must assume that the PMNS and the metadata > for the metrics are consistent from one archive to the next. This sounds like that single tool's limitation. (Certainly pmwebd is not affected, and it looks like pmchart isn't either.) It would not be a big deal for pmlogextract to canonicalize the output PMNS as it goes along. (Similar canonicalization logic could come in handy for making brolley's multi-archive-transparency project even more powerful.) > [...] And in this context, the sort of extension to the pmdaCache > services being discussed yesterday might provide a means to maintain > a persistent "name" to "id" map where the "id" values are > constrained to the range that would work for a pmid's cluster > component. [...] (For what it's worth, I'm not suggesting that more persistent numbering would be harmful.) But even such a cache is by nature temporary & lossy, so sooner or later those pmids will be mixed up again, and the tooling will have to deal. Why not make the consumer tooling robust now? - FChE From nscott@redhat.com Thu Apr 16 17:37:12 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id BE9637F3F for ; Thu, 16 Apr 2015 17:37:12 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id AFB628F8089 for ; Thu, 16 Apr 2015 15:37:09 -0700 (PDT) X-ASG-Debug-ID: 1429223827-04cb6c1cca284a20001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id JsQthGDuESvrGW0D (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 16 Apr 2015 15:37:08 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3GMb4Gg004698; Thu, 16 Apr 2015 18:37:04 -0400 Date: Thu, 16 Apr 2015 18:37:04 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" , David Smith , Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <973741994.1544247.1429223824192.JavaMail.zimbra@redhat.com> In-Reply-To: <20150416152834.GB6822@redhat.com> References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <552FD368.6030602@redhat.com> <20150416152834.GB6822@redhat.com> Subject: Re: JSON PMDA MIME-Version: 1.0 X-ASG-Orig-Subj: Re: JSON PMDA Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.100] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: JSON PMDA Thread-Index: OZRDuipW7RHbdf7Q0aRvV1G+yTtDfw== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1429223827 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18013 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > > [...] > > That sounds good, except in the case where when the JSON PMDA was > > started there were 3 JSON sources, and during the run a 4th was added. > > Now the JSON PMDA gets restarted > > ... but according to normal practice, a "restarted pmda" means > "restarted pmcd", which means active pcp contexts are dropped, which > means clients are to reconnect & recalculate name->pmid mappings. Some more context :- historically (and still now for many PMDAs) a SIGHUP to pmcd was the default agent-restart/pmcd-reconfigure mechanism & that'll become the default again soon for all PMDAs (so, no loss of connection for clients). The current situation requiring a pmcd restart was a compromise (aka a bug :|) that was introduced with the unprivileged-pmcd changes, and which will be fixed. Is there any reason not to tackle this problem, Frank? There's a possible solution proposed reusing existing code, & other PMDAs that will benefit - seems like a no-brainer that we should Just Do It. cheers. -- Nathan From kenj@internode.on.net Thu Apr 16 17:54:54 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.5 required=5.0 tests=SUBJ_ALL_CAPS autolearn=no version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 6411B7F3F for ; Thu, 16 Apr 2015 17:54:54 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 556A2304032 for ; Thu, 16 Apr 2015 15:54:51 -0700 (PDT) X-ASG-Debug-ID: 1429224888-04cbb056b12b9d60001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id Fq6f3Nd40lxEiAqu for ; Thu, 16 Apr 2015 15:54:49 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2BrBwASPTBVPHhy0XZdgwyBLoMVgy3HFgQCAoFTTQEBAQEBAQcBAQEBOCcUhCABAQEECAIZBAEuIwwBAwIGAxUBBAIjAwICGSAKAxECBAESCwULiA6ycpVvAQEBBwEBAQEegSGKCIR8B4JogUUFkRpinjuCJRyBYiwxgkMBAQE Received: from ppp118-209-114-120.lns20.mel4.internode.on.net (HELO bozohorize) ([118.209.114.120]) by ipmail06.adl2.internode.on.net with ESMTP; 17 Apr 2015 08:24:47 +0930 From: "Ken McDonell" To: "'Nathan Scott'" , "'Frank Ch. Eigler'" , "'David Smith'" Cc: References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <552FD368.6030602@redhat.com> <20150416152834.GB6822@redhat.com> <973741994.1544247.1429223824192.JavaMail.zimbra@redhat.com> In-Reply-To: <973741994.1544247.1429223824192.JavaMail.zimbra@redhat.com> Subject: RE: JSON PMDA Date: Fri, 17 Apr 2015 08:54:42 +1000 X-ASG-Orig-Subj: RE: JSON PMDA Message-ID: <004f01d07898$54558fc0$fd00af40$@internode.on.net> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQFYOq9bahNwUT06oBaSKQVOPtgLAAEsFordAgjZiUQBJi6JAQFNfkXUAgEvk0ABV5vkLQLGGJxyAgbIUOud0kadEA== Content-Language: en-au X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1429224888 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 1.65 X-Barracuda-Spam-Status: No, SCORE=1.65 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, SUBJ_ALL_CAPS, SUBJ_ALL_CAPS_2, THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18014 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 SUBJ_ALL_CAPS Subject is all capitals 1.62 SUBJ_ALL_CAPS_2 SUBJ_ALL_CAPS_2 > -----Original Message----- > From: Nathan Scott [mailto:nathans@redhat.com] > Sent: Friday, 17 April 2015 8:37 AM > To: Frank Ch. Eigler; David Smith; Ken McDonell > ... > Is there any reason not to tackle this problem, Frank? There's a = possible > solution proposed reusing existing code, & other PMDAs that will = benefit - > seems like a no-brainer that we should Just Do It. I suspect this discussion needs to fork, as there appears to be 2 = related, but different, "topics" 1. seeing if the pmdaCache code could be reused to provide a more = general, optionally persistent, name <--> id mapping cache that could be = used instance domain management and other tasks that might help the PMDA = implementer .... on this topic I suspect there is probably not much more = to be said, I'm with the "Just Do It" camp here. 2. trying to properly document what is expected of a PMDA implementer in = terms of data invariance over time ... we have lots of implicit = assumptions here, and fleshing out all of the issues would probably help = people new to PMDA development and at the same time give us a framework = to judge how well client tools might operate if the data from a PMDA was = to change over time (I'm using "data" here to mean not the values for = metrics, but all of the metadata, the metric names, their PMIDs, ...). From fche@redhat.com Thu Apr 16 17:57:17 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id E57087F3F for ; Thu, 16 Apr 2015 17:57:17 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id B55B38F8081 for ; Thu, 16 Apr 2015 15:57:17 -0700 (PDT) X-ASG-Debug-ID: 1429225036-04cbb056b32b9e20001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id y31b82IiFKrAjWUM (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 16 Apr 2015 15:57:16 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (Postfix) with ESMTPS id 17E7AAC7C8; Thu, 16 Apr 2015 22:57:16 +0000 (UTC) Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3GMvF9F027980; Thu, 16 Apr 2015 18:57:15 -0400 Received: by fche.csb (Postfix, from userid 2569) id 5AD4D58519; Thu, 16 Apr 2015 18:57:12 -0400 (EDT) Date: Thu, 16 Apr 2015 18:57:12 -0400 From: "Frank Ch. Eigler" To: Nathan Scott Cc: David Smith , Ken McDonell , pcp@oss.sgi.com Subject: Re: JSON PMDA Message-ID: <20150416225712.GE6822@redhat.com> X-ASG-Orig-Subj: Re: JSON PMDA References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <552FD368.6030602@redhat.com> <20150416152834.GB6822@redhat.com> <973741994.1544247.1429223824192.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <973741994.1544247.1429223824192.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429225036 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - > > ... but according to normal practice, a "restarted pmda" means > > "restarted pmcd", which means active pcp contexts are dropped, which > > means clients are to reconnect & recalculate name->pmid mappings. > > Some more context :- historically (and still now for many PMDAs) a SIGHUP > to pmcd was the default agent-restart/pmcd-reconfigure mechanism & that'll > become the default again soon for all PMDAs (so, no loss of connection for > clients). [...] OK, that does change the picture (with respect to demands on the pmdas, not with respect to expectations by the clients). I hope it will not be difficult to audit them. > Is there any reason not to tackle this problem, Frank? There's a > possible solution proposed reusing existing code, & other PMDAs that > will benefit - seems like a no-brainer that we should Just Do It. If it's a reasonably small amount of incremental work, agreed. - FChE From kenj@internode.on.net Thu Apr 16 18:16:21 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 9853C7F3F for ; Thu, 16 Apr 2015 18:16:21 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 89FB6304032 for ; Thu, 16 Apr 2015 16:16:18 -0700 (PDT) X-ASG-Debug-ID: 1429226175-04cbb056b32ba410001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id eoG4gSiOwQQyh8Fv for ; Thu, 16 Apr 2015 16:16:16 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2BrBwCYQTBVPHhy0XZdgwxSXIZCwRGGBQQCAoFMTQEBAQEBAQcBAQEBODuEIAEBAQMBCAIeEhwjBQcBAwIGAxUqBxkgCgMRAgQTCwUJiAkHyF8siymEKgEBUAeELQWRGmKDGpshgiUcgWIsMYECCRcEgR0BAQE Received: from ppp118-209-114-120.lns20.mel4.internode.on.net (HELO bozohorize) ([118.209.114.120]) by ipmail06.adl2.internode.on.net with ESMTP; 17 Apr 2015 08:38:03 +0930 From: "Ken McDonell" To: "'Frank Ch. Eigler'" Cc: "'David Smith'" , References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <552FD368.6030602@redhat.com> <20150416152834.GB6822@redhat.com> <003f01d07887$90ee5180$b2caf480$@internode.on.net> <20150416222728.GD6822@redhat.com> In-Reply-To: <20150416222728.GD6822@redhat.com> Subject: RE: [pcp] JSON PMDA Date: Fri, 17 Apr 2015 09:07:58 +1000 X-ASG-Orig-Subj: RE: [pcp] JSON PMDA Message-ID: <005301d0789a$2ecae550$8c60aff0$@internode.on.net> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQFYOq9bahNwUT06oBaSKQVOPtgLAAEsFordAgjZiUQBJi6JAQFNfkXUAgEvk0ABV5vkLQLGGJxyAm2Pb2gCVrjgXp28XQhw Content-Language: en-au X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1429226175 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18014 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header > -----Original Message----- > From: Frank Ch. Eigler [mailto:fche@redhat.com] > ... > > Clients may or may not re-explore the PMNS in this situation ... I > > just experimented with pmie and it does NOT do this. > > That's unfortunate. (OTOH, in src/pmie/eval.c enable() / reconnect(), it calls > reinitMetric(), which does redo all the pmLookup* business; in what scenario > doesn't and cannot pmie do this?) If a PMDA is installed/removed/restarted, this may (or may not) involve losing the connection to PMCD ... the reconnect code in pmie is triggered when the PMCD connection is lost ... so this won't help if the PMCD connection is maintained while the PMDA is reconfigured. > > Most clients that keep running when a PMDA or PMCD is missing have > > been written with some assumptions about the consistency of metric > > names and metadata across invocations of a PMDA. [...] > > Can you point at another example by any chance? Sure ... pmchart, pmval, pmdumptext, pmlogger (and probably others) will all fetch the pmDesc for a metric once and assume that does not change for the life of their execution. > This sounds like that single tool's limitation. (Certainly pmwebd is not affected, > and it looks like pmchart isn't either.) It would not be a big deal for > pmlogextract to canonicalize the output PMNS as it goes along. (Similar > canonicalization logic could come in handy for making brolley's multi-archive- > transparency project even more powerful.) If it is a limitation it is in the archive format ... the PMNS is not timestamped in the archive, so there is no scope for describing foo.bar is PMID 1.2.3 now and foo.bar is 1.3.3 at some later point in time in the same archive. > ... But even such a cache is by nature temporary & lossy, so sooner > or later those pmids will be mixed up again, and the tooling will have to deal. > Why not make the consumer tooling robust now? I think this is may hinge on the timescale over which the changes (and possible reuse) might occur ... and this all sounds like more reason to invest in the effort to document what's expected here from a PMDA as I foreshadowed in my earlier mail. From fche@redhat.com Thu Apr 16 19:48:00 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id D500E7F3F for ; Thu, 16 Apr 2015 19:48:00 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id B79F28F809B for ; Thu, 16 Apr 2015 17:47:57 -0700 (PDT) X-ASG-Debug-ID: 1429231672-04cb6c1cc7287e30001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id tOLAZkNr1lpojp1D (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 16 Apr 2015 17:47:53 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3H0lm6q013630 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Thu, 16 Apr 2015 20:47:48 -0400 Received: from fche.csb (vpn-239-102.phx2.redhat.com [10.3.239.102]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3GNZC3T012719; Thu, 16 Apr 2015 19:35:12 -0400 Received: by fche.csb (Postfix, from userid 2569) id B96E858519; Thu, 16 Apr 2015 19:35:08 -0400 (EDT) Date: Thu, 16 Apr 2015 19:35:08 -0400 From: "Frank Ch. Eigler" To: Ken McDonell Cc: "'David Smith'" , pcp@oss.sgi.com Subject: Re: [pcp] JSON PMDA Message-ID: <20150416233508.GF6822@redhat.com> X-ASG-Orig-Subj: Re: [pcp] JSON PMDA References: <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <552FD368.6030602@redhat.com> <20150416152834.GB6822@redhat.com> <003f01d07887$90ee5180$b2caf480$@internode.on.net> <20150416222728.GD6822@redhat.com> <005301d0789a$2ecae550$8c60aff0$@internode.on.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <005301d0789a$2ecae550$8c60aff0$@internode.on.net> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429231673 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, Ken - > If a PMDA is installed/removed/restarted, this may (or may not) > involve losing the connection to PMCD ... the reconnect code in pmie > is triggered when the PMCD connection is lost ... so this won't help > if the PMCD connection is maintained while the PMDA is > reconfigured. [...] (AIUI the status quo is that such a pmda restart involves a pmcd restart, so then pmie, pmlogger, and the other pmcd-connecting tools you listed would notice and stop or pmLookup* upon reconnect.) - FChE From kenj@internode.on.net Thu Apr 16 22:16:51 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id C17D67F3F for ; Thu, 16 Apr 2015 22:16:51 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id B3954304032 for ; Thu, 16 Apr 2015 20:16:48 -0700 (PDT) X-ASG-Debug-ID: 1429240606-04cbb056b22c49e0001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id zu1LKvfzssyn64PQ for ; Thu, 16 Apr 2015 20:16:46 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DyBQBUejBVPHhy0XZdgwyHcMYagQICgVFMAQEBAQEBBwEBAQE4O4QhAQEECAIeEj8NAwIGAw05GSoUAgQeBYgZyBcsiymEfAeELQWRGmKHNoMwhgQDjU6EIyyCdAEBAQ Received: from unknown (HELO bozohorize) ([118.209.114.120]) by ipmail06.adl6.internode.on.net with ESMTP; 17 Apr 2015 12:46:45 +0930 From: "Ken McDonell" To: "'Frank Ch. Eigler'" Cc: "'David Smith'" , References: <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <552FD368.6030602@redhat.com> <20150416152834.GB6822@redhat.com> <003f01d07887$90ee5180$b2caf480$@internode.on.net> <20150416222728.GD6822@redhat.com> <005301d0789a$2ecae550$8c60aff0$@internode.on.net> <20150416233508.GF6822@redhat.com> In-Reply-To: <20150416233508.GF6822@redhat.com> Subject: RE: [pcp] JSON PMDA Date: Fri, 17 Apr 2015 13:16:39 +1000 X-ASG-Orig-Subj: RE: [pcp] JSON PMDA Message-ID: <006901d078bc$ec1ddff0$c4599fd0$@internode.on.net> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQEsFordHoUvuMtbVEHoa9Ri4iN7VgII2YlEASYuiQEBTX5F1AIBL5NAAVeb5C0CxhiccgJtj29oAla44F4B/NxIjQKEmVZunfpCVEA= Content-Language: en-au X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1429240606 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18021 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header G'day Frank. > (AIUI the status quo is that such a pmda restart involves a pmcd restart, so > then pmie, pmlogger, and the other pmcd-connecting tools you listed would > notice and stop or pmLookup* upon reconnect.) As Nathan noted earlier, the status quo is (IMHO) broken ... in the classical PCP world, pmcd kept running as PMDA's were installed, removed, died or restarted. It is only relatively recently that the "don't run pmcd as root" mantra caused changes in pmcd behaviour so that pmcd is now more likely to be stopped and restarted. And this would indeed cause pmie down that path. But my test was - start pmie fetching simple.now - kill the simple PMDA - send a SIGHUP to pmcd, which restarts the simple PMDA In this scenario pmie does not go through the reconnect path. From mspier@netflix.com Fri Apr 17 00:05:57 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,T_DKIM_INVALID autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id EAF5C7F3F for ; Fri, 17 Apr 2015 00:05:57 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id DD1BE304039 for ; Thu, 16 Apr 2015 22:05:57 -0700 (PDT) X-ASG-Debug-ID: 1429247152-04cb6c1cc7293340001-S8gJnT Received: from mail-wg0-f43.google.com (mail-wg0-f43.google.com [74.125.82.43]) by cuda.sgi.com with ESMTP id 5AoKXo6u2lRDljyS (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Thu, 16 Apr 2015 22:05:53 -0700 (PDT) X-Barracuda-Envelope-From: mspier@netflix.com X-Barracuda-Apparent-Source-IP: 74.125.82.43 Received: by wgsk9 with SMTP id k9so101299469wgs.3 for ; Thu, 16 Apr 2015 22:05:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netflix.com; s=google; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=C3HukFTqIMJctYlLLY85ZQWVqZueJL8fkUhRA5v3IvU=; b=TsozL0vvM1bCKGNy0Ko7eymshoFcSmX+NG4ZGdr1gOH1znMID81mlAfiAN6OgK8Ns1 DUDy8U6qxICjqkAYay0bl/GRhbopzBuWcGANeSnTrx1mGiqwTe5W5sHpEX+Csztj7xEA 85T5pmbYv8aj0irNBQLb8n7bVgpWY3ur4l+Ww= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=C3HukFTqIMJctYlLLY85ZQWVqZueJL8fkUhRA5v3IvU=; b=Iq7GHgbBEkbOhVwN6hPvTdBQfUAv7MN3eBkUvzIHJOs0qOazYNMS8D1fEQxnT2w6Bw v2H7KjCBbWF7X/r2OHUZAT+RCE0IcvyCrSlRZX/6IXygbic51URWwgAcAHCePPHtLMRh 0fM3MMoJp1htaIEq9DDWGbQV3TwckPm/f1nd0bsmCPvIZYNRcwEZuzAJDnkNyggbsq8/ TEjoZ4u7tfK/XS2bwuH8gno7YMiO/5hTSLh98eP5w5BTR9QtHH0d4Mz7xRI7tD9sGYZy ZK/JINr5S+s+CklNeQZjAJOJFwJTWL0U+r+vkgSX4/UpBA04q32VA8kjL+WfAj3FUXQQ G+/A== X-Gm-Message-State: ALoCoQljgR3+S+Iaya4fWmjOC2Gs9a7fh3Zq/F+YYL+nJONn5JDcW5Z2WnkuusVHKtfObEQh+k9z MIME-Version: 1.0 X-Received: by 10.180.7.134 with SMTP id j6mr1000733wia.9.1429247151925; Thu, 16 Apr 2015 22:05:51 -0700 (PDT) Received: by 10.180.72.227 with HTTP; Thu, 16 Apr 2015 22:05:51 -0700 (PDT) In-Reply-To: <1888768778.18692984.1429058281580.JavaMail.zimbra@redhat.com> References: <1888768778.18692984.1429058281580.JavaMail.zimbra@redhat.com> Date: Thu, 16 Apr 2015 22:05:51 -0700 Message-ID: Subject: Re: [pcp] ACAO Header and Background Install diffs From: Martin Spier X-ASG-Orig-Subj: Re: [pcp] ACAO Header and Background Install diffs To: Nathan Scott Cc: "Frank Ch. Eigler" , Amer Ather , pcp@oss.sgi.com Content-Type: multipart/alternative; boundary=f46d04428288c975140513e48887 X-Barracuda-Connect: mail-wg0-f43.google.com[74.125.82.43] X-Barracuda-Start-Time: 1429247152 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED, HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18023 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 HTML_MESSAGE BODY: HTML included in message --f46d04428288c975140513e48887 Content-Type: text/plain; charset=UTF-8 Great! Everything is in 3.10.4 then. Tks guys! On Tue, Apr 14, 2015 at 5:38 PM, Nathan Scott wrote: > > > ----- Original Message ----- > > > > mspier wrote: > > > > > Last year Amer made a few changes to include the ACAO header [...] > > > > The two ACAO-related patches look good to me. > > > Thanks, I'll run it through the testsuite shortly also. The third patch > was merged awhile back ... > > commit 739fdda0cb46c67812e3bbf5cf99c51e83f5d80c > Author: Nathan Scott > Date: Mon Dec 8 16:36:56 2014 +1100 > > rc_pmcd: execute _pmda_setup in the background > > Amer reports that use of the .NeedInstall mechanism for > PMDAs introduces longer image startup times due to the > rc_pmcd script performing PMDA installation serially. > There's no reason for that - this processing can be done > in the background as soon as pmcd has started (just like > we do with pmloggers in the rc_pmlogger script already). > > Test qa/300 is tweaked to give a little more time before > verifying the .NeedInstall processing has / has not been > done. > --f46d04428288c975140513e48887 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Great! Everything is in 3.10.4 then. Tks guys!

On Tue, Apr 14, 2015 at= 5:38 PM, Nathan Scott <nathans@redhat.com> wrote:


----- Original Message -----
>
> mspier wrote:
>
> > Last year Amer made a few changes to include the ACAO header [...= ]
>
> The two ACAO-related patches look good to me.


Thanks, I'll run it through the testsuite shortly also.=C2= =A0 The third patch
was merged awhile back ...

commit 739fdda0cb46c67812e3bbf5cf99c51e83f5d80c
Author: Nathan Scott <nathans@redh= at.com>
Date:=C2=A0 =C2=A0Mon Dec 8 16:36:56 2014 +1100

=C2=A0 =C2=A0 rc_pmcd: execute _pmda_setup in the background

=C2=A0 =C2=A0 Amer reports that use of the .NeedInstall mechanism for
=C2=A0 =C2=A0 PMDAs introduces longer image startup times due to the
=C2=A0 =C2=A0 rc_pmcd script performing PMDA installation serially.
=C2=A0 =C2=A0 There's no reason for that - this processing can be done<= br> =C2=A0 =C2=A0 in the background as soon as pmcd has started (just like
=C2=A0 =C2=A0 we do with pmloggers in the rc_pmlogger script already).

=C2=A0 =C2=A0 Test qa/300 is tweaked to give a little more time before
=C2=A0 =C2=A0 verifying the .NeedInstall processing has / has not been
=C2=A0 =C2=A0 done.

--f46d04428288c975140513e48887-- From nscott@redhat.com Fri Apr 17 00:59:11 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 741CE7F3F for ; Fri, 17 Apr 2015 00:59:11 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 55E5A304039 for ; Thu, 16 Apr 2015 22:59:11 -0700 (PDT) X-ASG-Debug-ID: 1429250348-04bdf063202cb430001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id 2lVlhr5r5bxtKTBd (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 16 Apr 2015 22:59:09 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3H5x7Hl031912; Fri, 17 Apr 2015 01:59:07 -0400 Date: Fri, 17 Apr 2015 01:59:07 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Glen Gunselman Cc: pcp Message-ID: <1051645710.1709173.1429250347543.JavaMail.zimbra@redhat.com> In-Reply-To: <83904B8EF53D51499A9B43662BC670A9017F987E89@STINGRAY.esuad.ds> References: <83904B8EF53D51499A9B43662BC670A9017F987E89@STINGRAY.esuad.ds> Subject: Re: [pcp] PCP build on CentOS 6.6 - VirtualBox 4.3.26 MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] PCP build on CentOS 6.6 - VirtualBox 4.3.26 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.100] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: PCP build on CentOS 6.6 - VirtualBox 4.3.26 Thread-Index: AdB3s01HEK0vG4MgTsSVfk6k7Fv2knND/8fl X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1429250349 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18025 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Glen, ----- Original Message ----- > I am researching PCP (and friends) as a replacement for Orca/SE Toolkit. > [...] > I have very little experience with Linux but have been working with Solaris > for the last 10 years. The symbolic links look iffy to me. > > I hope this is something simple that I overlooked or missed in the docs. I think the other folks have answered these - let us know if there's still issues. If you're interested in Solaris, the PCP port to that platform is compatible (wire protocol and on-disk format) with the Linux and all other platforms. I'd be keen to hear how it goes if you try out PCP on Solaris (the Makepkgs script should work for you there too) - sometimes theres been shared library link issues there with different paths to other platforms. > Is CentOS a good environment for experimenting with PCP and friends? Yes, definitely. cheers. -- Nathan From phanisrinivas@gmail.com Fri Apr 17 08:26:26 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: *** X-Spam-Status: No, score=3.1 required=5.0 tests=FREEMAIL_FROM, NO_RDNS_DOTCOM_HELO,T_DKIM_INVALID autolearn=no version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id BAD817F3F for ; Fri, 17 Apr 2015 08:26:26 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 913798F8096 for ; Fri, 17 Apr 2015 06:26:23 -0700 (PDT) X-ASG-Debug-ID: 1429277178-04bdf063202da2d0001-S8gJnT Received: from mail-wg0-f54.google.com (mail-wg0-f54.google.com [74.125.82.54]) by cuda.sgi.com with ESMTP id po0n6XACTzvzhSy7 (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Fri, 17 Apr 2015 06:26:19 -0700 (PDT) X-Barracuda-Envelope-From: phanisrinivas@gmail.com X-Barracuda-Apparent-Source-IP: 74.125.82.54 Received: by wgso17 with SMTP id o17so113437748wgs.1 for ; Fri, 17 Apr 2015 06:26:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:subject:message-id:date :to:mime-version; bh=sWd7arIcsuTgFb3eLi4Qwt4fpBvaz434BestmiASMgc=; b=UfTCP8iA2bgRRKr6pxzGzwylkehfsCv5dXQn0sY/mTwSTEN++AROOv0DOi2lggRASt wYWc0hwX0LT/ysQJgrQSslCI+aat6bB+rthpSG+75gdoqn2DZdO936329WFHVznE3Kfq llp8zgLyvwCb/z6DU0HXARlJa86pm6e02jixPRS2T7WtZoGyB0GPb+EBL3LQNDzaBtZ6 Ctj8EmtI1/G/ENQlQLUBFHzTyRMd/IMTS7E/9PWaPr50wxrzkX/RSMgLG7B5nok6T9kP jLMgh6m1b6OuUI74SjcG5IscDCl7hUwcpGPKta+arn8VOF43xkZ2WTOs8cdjcLVFI0lr 1uog== X-Received: by 10.194.171.1 with SMTP id aq1mr6167687wjc.38.1429277177405; Fri, 17 Apr 2015 06:26:17 -0700 (PDT) Received: from acac064c.ipt.aol.com ([143.252.1.30]) by mx.google.com with ESMTPSA id mv11sm2649616wic.23.2015.04.17.06.26.16 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 17 Apr 2015 06:26:16 -0700 (PDT) From: Phani Salapaka Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Subject: =?utf-8?Q?Installing_=E2=80=9CPMWEBD=E2=80=9D_on_Mac?= Message-Id: <328152F5-F8EE-4737-B301-CAF0B7A7C8BD@gmail.com> X-ASG-Orig-Subj: =?utf-8?Q?Installing_=E2=80=9CPMWEBD=E2=80=9D_on_Mac?= Date: Fri, 17 Apr 2015 14:26:14 +0100 To: pcp@oss.sgi.com Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2098\)) X-Mailer: Apple Mail (2.2098) X-Barracuda-Connect: mail-wg0-f54.google.com[74.125.82.54] X-Barracuda-Start-Time: 1429277178 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.80 X-Barracuda-Spam-Status: No, SCORE=0.80 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED, NO_RDNS_DOTCOM_HELO X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18037 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.80 NO_RDNS_DOTCOM_HELO Host HELO'd as a big ISP, but had no rDNS -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature HI,=20 I have installed PCP (pcp-3.10.4-1.dmg) on my MAC. I am trying to = configure netflix=E2=80=99s vector dashboard. But I found out that = =E2=80=9CPMWEBD=E2=80=9D is not installed along with the default = installer.=20 And also I have tried through compiling sources, but installation failed = with errors. So can you please help me in understanding the steps to = install =E2=80=9CPMWEBD=E2=80=9D on my mac? Your help is much appreciated. Regards, Phani= From ggunselm@emporia.edu Fri Apr 17 12:17:07 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id F00897F3F for ; Fri, 17 Apr 2015 12:17:06 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id D373F8F809B for ; Fri, 17 Apr 2015 10:17:06 -0700 (PDT) X-ASG-Debug-ID: 1429291021-04bdf063222dfd60001-S8gJnT Received: from enterprise.emporia.edu ([198.248.24.127]) by cuda.sgi.com with ESMTP id R06aYHvViVlHUFwu (version=TLSv1 cipher=AES128-SHA bits=128 verify=NO) for ; Fri, 17 Apr 2015 10:17:01 -0700 (PDT) X-Barracuda-Envelope-From: ggunselm@emporia.edu X-Barracuda-Apparent-Source-IP: 198.248.24.127 Received: from STINGRAY.esuad.ds ([fe80::75ed:4f4e:9de1:926e]) by HUDSON2.esuad.ds ([fe80::5d0b:7981:c9a7:c682%16]) with mapi id 14.02.0387.000; Fri, 17 Apr 2015 12:17:00 -0500 From: Glen Gunselman To: Nathan Scott CC: pcp Subject: RE: [pcp] PCP build on CentOS 6.6 - VirtualBox 4.3.26 Thread-Topic: [pcp] PCP build on CentOS 6.6 - VirtualBox 4.3.26 X-ASG-Orig-Subj: RE: [pcp] PCP build on CentOS 6.6 - VirtualBox 4.3.26 Thread-Index: AdB3s01HEK0vG4MgTsSVfk6k7Fv2knND/8flcuSdtAA= Date: Fri, 17 Apr 2015 17:16:59 +0000 Message-ID: <83904B8EF53D51499A9B43662BC670A9017F990EFC@STINGRAY.esuad.ds> References: <83904B8EF53D51499A9B43662BC670A9017F987E89@STINGRAY.esuad.ds> <1051645710.1709173.1429250347543.JavaMail.zimbra@redhat.com> In-Reply-To: <1051645710.1709173.1429250347543.JavaMail.zimbra@redhat.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [2001:49d0:141:100:80f3:9316:bb4d:a9b6] Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-Barracuda-Connect: UNKNOWN[198.248.24.127] X-Barracuda-Start-Time: 1429291021 X-Barracuda-Encrypted: AES128-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.12 X-Barracuda-Spam-Status: No, SCORE=0.12 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=RDNS_NONE, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18043 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.10 RDNS_NONE Delivered to trusted network by a host with no rDNS PiBJIHRoaW5rIHRoZSBvdGhlciBmb2xrcyBoYXZlIGFuc3dlcmVkIHRoZXNlIC0gbGV0IHVzIGtu b3cgaWYgdGhlcmUncyBzdGlsbCBpc3N1ZXMuDQoNCkkgaGF2ZSBub3QgZ2l2ZW4gdXAsIGJ1dCBu byBzdWNjZXNzIGVpdGhlciAtIGxvb2tzIGxpa2UgSSBoYXZlIG90aGVyIHByb2plY3RzIHRvIHdv cmsgb24gdG9kYXkuDQoNCj4gSWYgeW91J3JlIGludGVyZXN0ZWQgaW4gU29sYXJpcw0KDQpJIGFt IGZvciBTb2xhcmlzIDEwDQoNCi0tLQ0KDQpBdCB3b3JrIEknbSBsb29raW5nIGF0IFNvbGFyaXMg MTAgKFNQQVJDIGFuZCBYNjQpIGFuZCBDZW50T1MgNi42IChWQiBvbiBXaW5kb3dzIDcpDQoNCkF0 IGhvbWUgaXQgd291bGQgYmUgUmFzcGJpYW4gYW5kIE1hYyBPUy4NCg0KDQpUaGFua3MsDQpHbGVu IEd1bnNlbG1hbg0K From minnus@buffalo.edu Fri Apr 17 14:54:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 3AE237F3F for ; Fri, 17 Apr 2015 14:54:18 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 0E374304043 for ; Fri, 17 Apr 2015 12:54:17 -0700 (PDT) X-ASG-Debug-ID: 1429300452-04bdf063222e4260001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id unrPmdTpFCYHAoVj for ; Fri, 17 Apr 2015 12:54:13 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmailD.acsu.buffalo.edu (localmaild.acsu.buffalo.edu [128.205.5.208]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 959FC5A4 for ; Fri, 17 Apr 2015 15:54:12 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 8CA1B3226D for ; Fri, 17 Apr 2015 15:54:12 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailD.acsu.buffalo.edu (Postfix) with ESMTP id B3D143226A for ; Fri, 17 Apr 2015 15:54:11 -0400 (EDT) Received: from smtp.buffalo.edu (smtp2.acsu.buffalo.edu [128.205.5.254]) by localmailD.acsu.buffalo.edu (Prefixe) with ESMTP id A33B232269 for ; Fri, 17 Apr 2015 15:54:11 -0400 (EDT) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 99FE52AF0 for ; Fri, 17 Apr 2015 15:54:11 -0400 (EDT) Message-ID: <553164E3.7040405@buffalo.edu> Date: Fri, 17 Apr 2015 15:54:11 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: pcp Subject: New proc metrics Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: New proc metrics Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1429300453 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18051 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi, Here are a few additional proc metrics that I thought we had submitted, but must have missed. Adds the "cpusallowed" and "environ" metrics from proc. Written by Joe, I just updated to current pcp. I think I got all the changed qa files as well. We've been running these for a while with no issue. https://github.com/ubccr/pcp/tree/proc_additions Martins commit eaa5ca865f005464f107162f14ffcc995c91fef4 Author: Martins Innus Date: Fri Apr 17 19:46:00 2015 +0000 Another qa fixup for the cpusallowed and environment proc metrics qa/943.out | 4 ++++ 1 files changed, 4 insertions(+), 0 deletions(-) commit 0e2e083f2be31ac0673addef4f40836c8a97b0d7 Merge: 546f56c e852abb Author: Martins Innus Date: Fri Apr 17 13:48:27 2015 -0400 Merge branch 'master' into proc_additions commit 546f56c0505d08969989b8dc2f2772afcde585ef Author: Martins Innus Date: Thu Apr 9 20:17:22 2015 +0000 Fixup QA and some other misses during the addition of new proc metrics qa/022.out.linux | 2 ++ src/pmdas/linux_proc/pmda.c | 1 + src/pmdas/linux_proc/proc_dynamic.c | 2 +- src/pmdas/linux_proc/proc_pid.c | 5 ++++- 4 files changed, 8 insertions(+), 2 deletions(-) commit 6b98199cc54088dd29a2c5d0b61e5616c37c5c82 Author: Martins Innus Date: Thu Apr 9 14:38:07 2015 -0400 Add dynamic metric changes for the cpus allowed and environment proc metrics src/pmdas/linux_proc/help_text.h | 2 ++ src/pmdas/linux_proc/proc_dynamic.c | 2 ++ src/pmdas/linux_proc/proc_pid.c | 2 -- 3 files changed, 4 insertions(+), 2 deletions(-) commit d64ac42097bc899392ecfe702e187cbf3a73dc86 Author: Joe White Date: Wed Oct 1 20:09:40 2014 +0100 Merge Joe's cpus allowed and environment proc metrics with current pcp source src/pmdas/linux_proc/pmda.c | 4 ++++ src/pmdas/linux_proc/proc_pid.c | 2 ++ 2 files changed, 6 insertions(+), 0 deletions(-) commit ac809ae28d5765d18277c13983e8fdf97d6642ad Author: Joe White Date: Wed Oct 1 20:40:42 2014 +0100 Cherry pick the environment and cpus allowed metrics src/pmdas/linux_proc/pmda.c | 14 +++++++++++- src/pmdas/linux_proc/proc_pid.c | 42 +++++++++++++++++++++++++++++++++++++++ src/pmdas/linux_proc/proc_pid.h | 12 +++++++++- 3 files changed, 64 insertions(+), 4 deletions(-) From terry.d.kimber@lmco.com Fri Apr 17 15:43:28 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 0BC807F3F for ; Fri, 17 Apr 2015 15:43:28 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id F0AF58F804B for ; Fri, 17 Apr 2015 13:43:24 -0700 (PDT) X-ASG-Debug-ID: 1429303402-04cb6c1cc72b3ee0001-S8gJnT Received: from mailfo01.lmco.com ([192.31.106.12]) by cuda.sgi.com with ESMTP id JEYki7IUqSHgTtqW (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 17 Apr 2015 13:43:23 -0700 (PDT) X-Barracuda-Envelope-From: terry.d.kimber@lmco.com X-Barracuda-Apparent-Source-IP: 192.31.106.12 X-Barracuda-IPDD: Level2 [lmco.com/192.31.106.12] Received: from HVXHTPN10.us.lmco.com (hvxhtpn10.ems.lmco.com [158.186.149.28]) by mailfo01.lmco.com (8.14.5/8.14.5) with ESMTP id t3HKhJHX005045 for ; Fri, 17 Apr 2015 21:43:21 +0100 X-Barracuda-IPDD: Level2 [lmco.com/192.31.106.12] X-Barracuda-IPDD: Level2 [lmco.com/192.31.106.12] X-Barracuda-IPDD: Level2 [lmco.com/192.31.106.12] Received: from HVXDSP43.us.lmco.com ([fe80::5543:1687:6d89:22a6]) by HVXHTPN10.us.lmco.com ([fe80::ed1d:9a54:1e81:8133%15]) with mapi id 14.03.0174.001; Fri, 17 Apr 2015 16:43:00 -0400 From: "Kimber, Terry D (N-ZENITH PROFESSIONAL SERVICES INC.)" To: "'pcp@oss.sgi.com'" Subject: PCP on AIX? Thread-Topic: PCP on AIX? X-ASG-Orig-Subj: PCP on AIX? Thread-Index: AdB5TjaWNoICEs4LTgujf7NoCihvPA== Date: Fri, 17 Apr 2015 20:42:59 +0000 Message-ID: <8810BA87C1DEFC4B94304B2A80D53326A7F82A@HVXDSP43.us.lmco.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [158.186.156.95] Content-Type: multipart/alternative; boundary="_000_8810BA87C1DEFC4B94304B2A80D53326A7F82AHVXDSP43uslmcocom_" MIME-Version: 1.0 X-LM-Outbound: External 158.186.149.28 cntry=us g=bc6112c32b2f30efc95c9e7004bbf80a q=t3HKhJHX005045 m=3 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:5.13.68,1.0.33,0.0.0000 definitions=2015-04-17_07:2015-04-17,2015-04-17,1970-01-01 signatures=0 X-Barracuda-Connect: UNKNOWN[192.31.106.12] X-Barracuda-Start-Time: 1429303403 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 --_000_8810BA87C1DEFC4B94304B2A80D53326A7F82AHVXDSP43uslmcocom_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable I'm looking for information on using Performance CoPilot to monitor AIX hos= ts. Any information (documentation, downloads, source code, etc.) is appre= ciated. Thanks, Terry Kimber --_000_8810BA87C1DEFC4B94304B2A80D53326A7F82AHVXDSP43uslmcocom_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

I’m looking for information on using Performan= ce CoPilot to monitor AIX hosts.  Any information (documentation, down= loads, source code, etc.) is appreciated.

 

Thanks,

 

Terry Kimber

 

--_000_8810BA87C1DEFC4B94304B2A80D53326A7F82AHVXDSP43uslmcocom_-- From kenj@internode.on.net Fri Apr 17 23:27:54 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 3D8E97F3F for ; Fri, 17 Apr 2015 23:27:54 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 1D82E8F808E for ; Fri, 17 Apr 2015 21:27:50 -0700 (PDT) X-ASG-Debug-ID: 1429331268-04bdf063222ec250001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id F0qsnHq1C9Hpd7Dt for ; Fri, 17 Apr 2015 21:27:48 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2BHBwB43DFVPJwcLHldgwyBLoZExz8EAgKBOk0BAQEBAQEHAQEBATg7hCABAQEECAIeEhwvAQMCBgMRBAEBKAcZIAoDCQgCBAESCwWIGsdUAQsBH4sphQMGhCcFkSNiilyQIYNOgkCBZywxgkQBAQE Received: from ppp121-44-28-156.lns20.syd4.internode.on.net (HELO bozohorize) ([121.44.28.156]) by ipmail04.adl6.internode.on.net with ESMTP; 18 Apr 2015 13:57:47 +0930 From: "Ken McDonell" To: "'Kimber, Terry D \(N-ZENITH PROFESSIONAL SERVICES INC.\)'" , References: <8810BA87C1DEFC4B94304B2A80D53326A7F82A@HVXDSP43.us.lmco.com> In-Reply-To: <8810BA87C1DEFC4B94304B2A80D53326A7F82A@HVXDSP43.us.lmco.com> Subject: RE: [pcp] PCP on AIX? Date: Sat, 18 Apr 2015 14:27:42 +1000 X-ASG-Orig-Subj: RE: [pcp] PCP on AIX? Message-ID: <001c01d07990$03ffc650$0bff52f0$@internode.on.net> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQECoa7QVk6oOSsMJf9YfpFLM13COp7t24BA Content-Language: en-au X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1429331268 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18066 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== We had a minimalist AIX port and kernel PMDA about 12, or maybe 15, years ago. The PMDA code is still in the PCP source tree (src/pmdas/aix). Unfortunately no one involved in PCP has had access to an AIX system since then, so there will be bit rot and no testing. So you're going to be pretty much on your own building from source I'm afraid ... unless someone offers access to a development AIX system we could use. > -----Original Message----- > From: pcp-bounces@oss.sgi.com [mailto:pcp-bounces@oss.sgi.com] On Behalf > Of Kimber, Terry D (N-ZENITH PROFESSIONAL SERVICES INC.) > Sent: Saturday, 18 April 2015 6:43 AM > To: 'pcp@oss.sgi.com' > Subject: [pcp] PCP on AIX? > > I'm looking for information on using Performance CoPilot to monitor AIX hosts. > Any information (documentation, downloads, source code, etc.) is appreciated. > > > > Thanks, > > > > Terry Kimber > > From wwwrun@oss.sgi.com Sun Apr 19 03:52:03 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 600A629E00; Sun, 19 Apr 2015 03:52:03 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1067] linux pmda does too much work for network.interface queries Date: Sun, 19 Apr 2015 08:52:02 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: michele@acksyn.org X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1429433523.A5b445.15777"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1429433523.A5b445.15777 Date: Sun, 19 Apr 2015 03:52:03 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1067 --- Comment #7 from Michele Baldessari --- Created attachment 328 --> http://oss.sgi.com/bugzilla/attachment.cgi?id=328&action=edit Initial draft of improvement-patch Carlos, can you give this one a try and see if it improves things on your system? I still need to make the code a bit prettier, but functionally this should favour the /sys/class/net interface when available. Thanks, Michele -- You are receiving this mail because: You are on the CC list for the bug. --1429433523.A5b445.15777 Date: Sun, 19 Apr 2015 03:52:03 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8"

Comment # 7 on bug 1067 from 
Created attachment 328 [details]
Initial draft of improvement-patch

Carlos,

can you give this one a try and see if it improves things
on your system?

I still need to make the code a bit prettier, but functionally this
should favour the /sys/class/net interface when available.

Thanks,
Michele

You are receiving this mail because:
  • You are on the CC list for the bug.
--1429433523.A5b445.15777-- From nscott@redhat.com Sun Apr 19 18:03:40 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id B559C29DFE for ; Sun, 19 Apr 2015 18:03:40 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 418D2AC001 for ; Sun, 19 Apr 2015 16:03:37 -0700 (PDT) X-ASG-Debug-ID: 1429484611-04cbb056b1330710001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id v1HnZNSUb4P9GonJ (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sun, 19 Apr 2015 16:03:31 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3JN3TH9020131; Sun, 19 Apr 2015 19:03:29 -0400 Date: Sun, 19 Apr 2015 19:03:29 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Phani Salapaka Cc: pcp@oss.sgi.com Message-ID: <1607239628.2921398.1429484609767.JavaMail.zimbra@redhat.com> In-Reply-To: <328152F5-F8EE-4737-B301-CAF0B7A7C8BD@gmail.com> References: <328152F5-F8EE-4737-B301-CAF0B7A7C8BD@gmail.com> Subject: =?utf-8?Q?Re:_[pcp]_Installing_=E2=80=9CPMWEBD=E2=80=9D_on_Mac?= MIME-Version: 1.0 X-ASG-Orig-Subj: =?utf-8?Q?Re:_[pcp]_Installing_=E2=80=9CPMWEBD=E2=80=9D_on_Mac?= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Originating-IP: [10.64.50.115] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Installing =?utf-8?B?4oCcUE1XRUJE4oCd?= on Mac Thread-Index: M0kr179BjBdOPmKJP10PQhYOcKR6TA== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1429484611 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18131 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Phani, ----- Original Message ----- > [...] > I have installed PCP (pcp-3.10.4-1.dmg) on my MAC. I am trying to configu= re > netflix=E2=80=99s vector dashboard. But I found out that =E2=80=9CPMWEBD= =E2=80=9D is not installed > along with the default installer. > And also I have tried through compiling sources, but installation failed = with > errors. So can you please help me in understanding the steps to install > =E2=80=9CPMWEBD=E2=80=9D on my mac? >=20 There has been some initial success in getting a pmwebd-enabled Mac build g= oing as described here... https://github.com/performancecopilot/pcp/issues/5 ... its not yet at the point that the dmg files we provide have pmwebd enab= led, however. You could try a local PCP build (and microhttpd build as mentione= d in the github issue) to generate pmwebd (or the full PCP dmg, via the PCP Make= pkgs script) yourself though. cheers. -- Nathan From mgoodwin@redhat.com Sun Apr 19 23:09:45 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 1465A29DFE for ; Sun, 19 Apr 2015 23:09:45 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id E9E418F8035 for ; Sun, 19 Apr 2015 21:09:41 -0700 (PDT) X-ASG-Debug-ID: 1429502976-04cbb056b33350f0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id hDb5S9fQSmO9GWo6 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sun, 19 Apr 2015 21:09:37 -0700 (PDT) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3K49a5L019681 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 20 Apr 2015 00:09:36 -0400 Received: from [10.64.50.149] (vpn1-50-149.bne.redhat.com [10.64.50.149]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3K49YrD021836 for ; Mon, 20 Apr 2015 00:09:35 -0400 Message-ID: <55347BFD.9080301@redhat.com> Date: Mon, 20 Apr 2015 14:09:33 +1000 From: Mark Goodwin Reply-To: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates: kenj+mgoodwin+minnus+joe+nathans merges Content-Type: text/plain; charset=windows-1252; format=flowed X-ASG-Orig-Subj: pcp updates: kenj+mgoodwin+minnus+joe+nathans merges Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429502976 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Changes committed to git://git.pcp.io/pcp.git master Ken McDonell (3): INSTALL: add notes about Makepkgs and qa/admin/check-vm qa/findmetric: add archives dir as a place to search qa/src/lookupnametest: ready for pmLookupName() rework Mark Goodwin (3): Support pmiostat -x dm for archives converted by collectl2pcp. split pmiostat tests for sd and dm metrics on collectl2pcp archive. remake since checksum changed after collectl2pcp changes. Martins Innus (3): Add dynamic metric changes for the cpus allowed and environment proc metrics Fixup QA and some other misses during the addition of new proc metrics Another qa fixup for the cpusallowed and environment proc metrics Joe White (2): Cherry pick the environment and cpus allowed metrics Merge Joe's cpus allowed and environment proc metrics with current pcp source Nathan Scott (2): build: update version for next release, source-only Makepkgs option pmchart: porting work to current macosx compiler CHANGELOG | 2 INSTALL | 29 Makepkgs | 6 VERSION.pcp | 2 build/rpm/fedora.spec | 10 debian/changelog | 6 qa/022.out.linux | 2 qa/536 | 5 qa/536.out | 8 qa/544.out | 2 qa/943.out | 4 qa/findmetric | 2 qa/src/GNUlocaldefs | 3 qa/src/lookupnametest.c | 194 ++++++ src/collectl2pcp/disk.c | 66 +- src/collectl2pcp/metrics.c | 1084 +++++++++++++++++++++++------------- src/collectl2pcp/pmdesc.c | 16 src/pmchart/chart.cpp | 15 src/pmchart/chart.h | 10 src/pmchart/gadget.cpp | 4 src/pmchart/gadget.h | 6 src/pmchart/sampling.cpp | 4 src/pmchart/tracing.cpp | 3 src/pmchart/view.cpp | 2 src/pmdas/linux_proc/help_text.h | 2 src/pmdas/linux_proc/pmda.c | 19 src/pmdas/linux_proc/proc_dynamic.c | 4 src/pmdas/linux_proc/proc_pid.c | 51 + src/pmdas/linux_proc/proc_pid.h | 12 29 files changed, 1124 insertions(+), 449 deletions(-) Details ... commit eaa5ca865f005464f107162f14ffcc995c91fef4 Author: Martins Innus Date: Fri Apr 17 19:46:00 2015 +0000 Another qa fixup for the cpusallowed and environment proc metrics commit de131425d4cb7ff5c7add71d5a6c153c85f97289 Author: Nathan Scott Date: Fri Apr 17 17:15:24 2015 +1000 pmchart: porting work to current macosx compiler All small stuff causing build failures - missing const declarations, conflicting method names with recent Qt variants, and so. commit b22f4d260ae6bb3cd2a9ae44cb77688d0f1b4fbc Author: Nathan Scott Date: Thu Apr 16 18:17:16 2015 +1000 build: update version for next release, source-only Makepkgs option commit 0a90c3d520fbca8169a9f5004ccef5d802591396 Author: Ken McDonell Date: Wed Apr 15 16:39:27 2015 +1000 qa/src/lookupnametest: ready for pmLookupName() rework commit 08380e2378b04a90adfc0ef88e056ac0f7dcb8f0 Author: Ken McDonell Date: Wed Apr 15 16:38:44 2015 +1000 qa/findmetric: add archives dir as a place to search commit 3c5a615ec096e0bede5bbc8a8f42438a083a77b7 Author: Ken McDonell Date: Wed Apr 15 16:37:24 2015 +1000 INSTALL: add notes about Makepkgs and qa/admin/check-vm commit a89b9591e55a96bf5ab4d29c5e04063a43b4e1d6 Author: Mark Goodwin Date: Wed Apr 15 14:21:13 2015 +1000 remake since checksum changed after collectl2pcp changes. modified: qa/544.out commit f672b43b9e18b105ece4f90528b89ff93d90ac8a Author: Mark Goodwin Date: Wed Apr 15 14:18:23 2015 +1000 split pmiostat tests for sd and dm metrics on collectl2pcp archive. modified: qa/536 modified: qa/536.out commit d7477092b25e29ac6022d116d03ca0fe4cd6e19f Author: Mark Goodwin Date: Tue Apr 14 15:34:11 2015 +1000 Support pmiostat -x dm for archives converted by collectl2pcp. Collectl doesn't collect persistent dm-* mapped names, so just export the dm-* name from /proc/diskstats as the instances for disk.dm metrics rather than lump them all together as disk.dev. PCP archives created by collectl2pcp now work with pmiostat -x modified: src/collectl2pcp/disk.c modified: src/collectl2pcp/metrics.c modified: src/collectl2pcp/pmdesc.c commit 546f56c0505d08969989b8dc2f2772afcde585ef Author: Martins Innus Date: Thu Apr 9 20:17:22 2015 +0000 Fixup QA and some other misses during the addition of new proc metrics commit 6b98199cc54088dd29a2c5d0b61e5616c37c5c82 Author: Martins Innus Date: Thu Apr 9 14:38:07 2015 -0400 Add dynamic metric changes for the cpus allowed and environment proc metrics commit d64ac42097bc899392ecfe702e187cbf3a73dc86 Author: Joe White Date: Wed Oct 1 20:09:40 2014 +0100 Merge Joe's cpus allowed and environment proc metrics with current pcp source commit ac809ae28d5765d18277c13983e8fdf97d6642ad Author: Joe White Date: Wed Oct 1 20:40:42 2014 +0100 Cherry pick the environment and cpus allowed metrics From myllynen@redhat.com Mon Apr 20 02:47:59 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 109917F50 for ; Mon, 20 Apr 2015 02:47:59 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 815FEAC004 for ; Mon, 20 Apr 2015 00:47:58 -0700 (PDT) X-ASG-Debug-ID: 1429516073-04cb6c1cc92f5050001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id PICXS2jdIhF38Jbk (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 20 Apr 2015 00:47:54 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (Postfix) with ESMTPS id 3FC698F301 for ; Mon, 20 Apr 2015 07:47:53 +0000 (UTC) Received: from mmyllyne.csb (vpn1-4-18.ams2.redhat.com [10.36.4.18]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3K7lpCi011389 for ; Mon, 20 Apr 2015 03:47:52 -0400 Message-ID: <5534AF27.8020709@redhat.com> Date: Mon, 20 Apr 2015 10:47:51 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: pcp developers Subject: [PATCH] ds389log: tabify Content-Type: text/plain; charset=UTF-8 X-ASG-Orig-Subj: [PATCH] ds389log: tabify Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429516073 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Let's use tabs with ds389log as we're using with ds389. --- src/pmdas/ds389log/pmdads389log.pl | 224 ++++++++++++++++++------------------ 1 files changed, 112 insertions(+), 112 deletions(-) diff --git a/src/pmdas/ds389log/pmdads389log.pl b/src/pmdas/ds389log/pmdads389log.pl index 38ba006..f12de75 100644 --- a/src/pmdas/ds389log/pmdads389log.pl +++ b/src/pmdas/ds389log/pmdads389log.pl @@ -25,26 +25,26 @@ my $ds_logd = '/var/log/dirsrv'; my $ds_user = 'nobody'; # empty - use root my %data = ( - # logconv.pl string - name - subtree - cluster - id - type - # type : 0 - cumulative, 1 - peak - 'Total Connections:' => [ 'totalconns', 'conns', 0, 0, 0 ], - 'Peak Concurrent Connections:' => [ 'peakconns', 'conns', 0, 1, 1 ], - 'U1' => [ 'cleanclose', 'conns', 0, 2, 0 ], - 'B1' => [ 'badclose', 'conns', 0, 3, 0 ], - 'Total Operations:' => [ 'totalops', 'ops', 1, 0, 0 ], - 'Total Results:' => [ 'totalres', 'ops', 1, 1, 0 ], - 'Searches:' => [ 'searches', 'ops', 1, 2, 0 ], - 'Modifications:' => [ 'mods', 'ops', 1, 3, 0 ], - 'Adds:' => [ 'adds', 'ops', 1, 4, 0 ], - 'Deletes:' => [ 'dels', 'ops', 1, 5, 0 ], - 'Mod RDNs:' => [ 'modrdns', 'ops', 1, 6, 0 ], - 'Compares:' => [ 'comps', 'ops', 1, 7, 0 ], - 'Binds:' => [ 'binds', 'ops', 1, 8, 0 ], - 'Paged Searches:' => [ 'pagedsearches', 'searches', 2, 0, 0 ], - 'Unindexed Searches:' => [ 'unindexedsearches', 'searches', 2, 1, 0 ], - 'err=0' => [ 'noerror', 'errors', 3, 0, 0 ], - 'err=X' => [ 'error', 'errors', 3, 1, 0 ], # custom - 'Highest FD Taken:' => [ 'fdhigh', 'fd', 4, 0, 1 ], + # logconv.pl string - name - subtree - cluster - id - type + # type : 0 - cumulative, 1 - peak + 'Total Connections:' => [ 'totalconns', 'conns', 0, 0, 0 ], + 'Peak Concurrent Connections:' => [ 'peakconns', 'conns', 0, 1, 1 ], + 'U1' => [ 'cleanclose', 'conns', 0, 2, 0 ], + 'B1' => [ 'badclose', 'conns', 0, 3, 0 ], + 'Total Operations:' => [ 'totalops', 'ops', 1, 0, 0 ], + 'Total Results:' => [ 'totalres', 'ops', 1, 1, 0 ], + 'Searches:' => [ 'searches', 'ops', 1, 2, 0 ], + 'Modifications:' => [ 'mods', 'ops', 1, 3, 0 ], + 'Adds:' => [ 'adds', 'ops', 1, 4, 0 ], + 'Deletes:' => [ 'dels', 'ops', 1, 5, 0 ], + 'Mod RDNs:' => [ 'modrdns', 'ops', 1, 6, 0 ], + 'Compares:' => [ 'comps', 'ops', 1, 7, 0 ], + 'Binds:' => [ 'binds', 'ops', 1, 8, 0 ], + 'Paged Searches:' => [ 'pagedsearches', 'searches', 2, 0, 0 ], + 'Unindexed Searches:' => [ 'unindexedsearches', 'searches', 2, 1, 0 ], + 'err=0' => [ 'noerror', 'errors', 3, 0, 0 ], + 'err=X' => [ 'error', 'errors', 3, 1, 0 ], # custom + 'Highest FD Taken:' => [ 'fdhigh', 'fd', 4, 0, 1 ], ); use vars qw( $pmda %metrics ); @@ -55,117 +55,117 @@ my @lc_curr; # Configuration files for overriding the above settings for my $file (pmda_config('PCP_PMDAS_DIR') . '/ds389log/ds389log.conf', './ds389log.conf') { - eval `cat $file` unless ! -f $file; + eval `cat $file` unless ! -f $file; } sub ds389log_set_ds_access_log { - $ds_alog = `ls -1 $ds_logd/slapd-*/access 2>/dev/null | tail -n 1`; - my $un = `id -un`; - chomp($ds_alog); chomp($un); - die "$un can't read access log file \"$ds_alog\"" unless -f $ds_alog; - $pmda->log("Using access log file $ds_alog"); + $ds_alog = `ls -1 $ds_logd/slapd-*/access 2>/dev/null | tail -n 1`; + my $un = `id -un`; + chomp($ds_alog); chomp($un); + die "$un can't read access log file \"$ds_alog\"" unless -f $ds_alog; + $pmda->log("Using access log file $ds_alog"); } sub ds389log_fetch { - ds389log_set_ds_access_log() if $ds_alog eq ''; - return if $ds_alog eq ''; - - # Server might not have written entries for operations during - # the past few seconds yet so we will collect them next round. - @lc_curr = localtime(); - $lc_curr[0] -= 30; # secs - - if ((strftime("%s", @lc_curr) - strftime("%s", @lc_prev)) < $lc_ival) { - return; - } - - # Don't include anything twice - $lc_prev[0] += 1; # secs - - # Include the previous rotated log only if needed - my $prev_log = `ls -1rt $ds_alog.2* 2>/dev/null | tail -n 1`; - if ($prev_log ne '') { - my $lastline = `tail -n 1 $prev_log`; - $lastline =~ tr/\[//d; $lastline =~ s/\].*//; - my $log_ts = UnixDate($lastline, "%s"); - if (strftime("%s", @lc_prev) > $log_ts) { - $prev_log = ''; - } - } - - my $lc_start = strftime("[%d/%m/%Y:%H:%M:%S %z]", @lc_prev); - my $lc_end = strftime("[%d/%m/%Y:%H:%M:%S %z]", @lc_curr); - @lc_prev = @lc_curr; - - my $ds_stats = "logconv.pl -cpe $lc_opts -S $lc_start -E $lc_end $ds_alog $prev_log 2>/dev/null"; - open(STATS, "$ds_stats |") or - die $pmda->err("pmda389log failed to open $ds_stats pipe: $!"); - my @stats = ; - close(STATS); - - my $errors = 0; # combined - foreach my $line (@stats) { - my $key; - - if ($line =~ /^.*:/ || $line =~ /^U1/ || $line =~ /^B1/) { - $key = $&; - } - if ($line =~ /^err=.?/) { - $key = 'err=X'; - } - if ($line =~ /^err=0/) { - $key = 'err=0'; - } - - if (defined($key) && defined $data{$key}) { - $key = 'err=' if $key eq 'err=X'; - if ($line =~ /($key)\s+(\d+)/ || $line =~ /($key\d+)\s+(\d+)/) { - my $value = $2; - - if ($key eq 'err=') { - $key = 'err=X'; - $errors += $value; - $value = $errors; - } - - my $id = 'ds389log.' . $data{$key}[1] . '.' . $data{$key}[0]; - - if ($data{$key}[4] eq 1) { - my $prev = $metrics{$id}; - $value = $prev if $prev > $value; - } else { - $value = $metrics{$id} + $value; - } - - $metrics{$id} = $value; - } - } - } + ds389log_set_ds_access_log() if $ds_alog eq ''; + return if $ds_alog eq ''; + + # Server might not have written entries for operations during + # the past few seconds yet so we will collect them next round. + @lc_curr = localtime(); + $lc_curr[0] -= 30; # secs + + if ((strftime("%s", @lc_curr) - strftime("%s", @lc_prev)) < $lc_ival) { + return; + } + + # Don't include anything twice + $lc_prev[0] += 1; # secs + + # Include the previous rotated log only if needed + my $prev_log = `ls -1rt $ds_alog.2* 2>/dev/null | tail -n 1`; + if ($prev_log ne '') { + my $lastline = `tail -n 1 $prev_log`; + $lastline =~ tr/\[//d; $lastline =~ s/\].*//; + my $log_ts = UnixDate($lastline, "%s"); + if (strftime("%s", @lc_prev) > $log_ts) { + $prev_log = ''; + } + } + + my $lc_start = strftime("[%d/%m/%Y:%H:%M:%S %z]", @lc_prev); + my $lc_end = strftime("[%d/%m/%Y:%H:%M:%S %z]", @lc_curr); + @lc_prev = @lc_curr; + + my $ds_stats = "logconv.pl -cpe $lc_opts -S $lc_start -E $lc_end $ds_alog $prev_log 2>/dev/null"; + open(STATS, "$ds_stats |") or + die $pmda->err("pmda389log failed to open $ds_stats pipe: $!"); + my @stats = ; + close(STATS); + + my $errors = 0; # combined + foreach my $line (@stats) { + my $key; + + if ($line =~ /^.*:/ || $line =~ /^U1/ || $line =~ /^B1/) { + $key = $&; + } + if ($line =~ /^err=.?/) { + $key = 'err=X'; + } + if ($line =~ /^err=0/) { + $key = 'err=0'; + } + + if (defined($key) && defined $data{$key}) { + $key = 'err=' if $key eq 'err=X'; + if ($line =~ /($key)\s+(\d+)/ || $line =~ /($key\d+)\s+(\d+)/) { + my $value = $2; + + if ($key eq 'err=') { + $key = 'err=X'; + $errors += $value; + $value = $errors; + } + + my $id = 'ds389log.' . $data{$key}[1] . '.' . $data{$key}[0]; + + if ($data{$key}[4] eq 1) { + my $prev = $metrics{$id}; + $value = $prev if $prev > $value; + } else { + $value = $metrics{$id} + $value; + } + + $metrics{$id} = $value; + } + } + } } sub ds389log_fetch_callback { - my ($cluster, $item, $inst) = @_; + my ($cluster, $item, $inst) = @_; - if ($inst != PM_INDOM_NULL) { return (PM_ERR_INST, 0); } + if ($inst != PM_INDOM_NULL) { return (PM_ERR_INST, 0); } - my $pmnm = pmda_pmid_name($cluster, $item); - my $value = $metrics{$pmnm}; + my $pmnm = pmda_pmid_name($cluster, $item); + my $value = $metrics{$pmnm}; - if (!defined($value)) { return (PM_ERR_APPVERSION, 0); } + if (!defined($value)) { return (PM_ERR_APPVERSION, 0); } - return ($value, 1); + return ($value, 1); } $pmda = PCP::PMDA->new('ds389log', 131); # Add and zero metrics foreach my $key (keys %data) { - my $name = 'ds389log.' . $data{$key}->[1] . '.' . $data{$key}->[0]; - $pmda->add_metric(pmda_pmid($data{$key}->[2], $data{$key}->[3]), - PM_TYPE_U32, PM_INDOM_NULL, PM_SEM_COUNTER, - pmda_units(0,0,1,0,0,PM_COUNT_ONE), - $name, '', ''); - $metrics{$name} = 0; + my $name = 'ds389log.' . $data{$key}->[1] . '.' . $data{$key}->[0]; + $pmda->add_metric(pmda_pmid($data{$key}->[2], $data{$key}->[3]), + PM_TYPE_U32, PM_INDOM_NULL, PM_SEM_COUNTER, + pmda_units(0,0,1,0,0,PM_COUNT_ONE), + $name, '', ''); + $metrics{$name} = 0; } $pmda->set_refresh(\&ds389log_fetch); -- 1.7.1 From myllynen@redhat.com Mon Apr 20 02:48:56 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id A21E07F50 for ; Mon, 20 Apr 2015 02:48:56 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 3DA93AC001 for ; Mon, 20 Apr 2015 00:48:56 -0700 (PDT) X-ASG-Debug-ID: 1429516134-04bdf0632032a220001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id O2cO0cVBvvqBiyrz (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 20 Apr 2015 00:48:55 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3K7mr8a025443 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 20 Apr 2015 03:48:54 -0400 Received: from mmyllyne.csb (vpn1-4-18.ams2.redhat.com [10.36.4.18]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3K7mpd1013569 for ; Mon, 20 Apr 2015 03:48:52 -0400 Message-ID: <5534AF62.5000909@redhat.com> Date: Mon, 20 Apr 2015 10:48:50 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: pcp developers Subject: [PATCH] ds389: make more resilient to server failures Content-Type: text/plain; charset=UTF-8 X-ASG-Orig-Subj: [PATCH] ds389: make more resilient to server failures Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429516135 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Retry connecting to the server if a connection fails, for example during server restart. Add a bit of logging. --- src/pmdas/ds389/pmdads389.pl | 11 +++++++++-- 1 files changed, 9 insertions(+), 2 deletions(-) diff --git a/src/pmdas/ds389/pmdads389.pl b/src/pmdas/ds389/pmdads389.pl index d4a2287..5c00c29 100644 --- a/src/pmdas/ds389/pmdads389.pl +++ b/src/pmdas/ds389/pmdads389.pl @@ -40,13 +40,18 @@ my $ts_ur = 0; sub ds389_connection_setup { if (!defined($ldap)) { + $pmda->log("binding to $server"); $ldap = Net::LDAP->new($server); - return if (!defined($ldap)); + if (!defined($ldap)) { + $pmda->log("bind failed, server down?"); + return; + } my $mesg = $ldap->bind($binddn, password => $bindpw); if ($mesg->code) { $pmda->log("bind failed: " . $mesg->error); - die; + return; } + $pmda->log("bind to $server ok"); } } @@ -99,6 +104,7 @@ sub ds389_fetch { $mesg = $ldap->search(scope => $scope, base => $cnbase, filter => $filter); if ($mesg->code) { $pmda->log("search failed: " . $mesg->error); + undef $ldap; return; } ds389_process_entry($mesg->entry, 'cn.', 0); @@ -112,6 +118,7 @@ sub ds389_fetch { $mesg = $ldap->search(scope => $scope, base => $urbase, filter => $filter); if ($mesg->code) { $pmda->log("search failed: " . $mesg->error); + undef $ldap; return; } ds389_process_entry($mesg->entry, 'userroot.', 1); -- 1.7.1 From myllynen@redhat.com Mon Apr 20 02:50:01 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 6430F7F50 for ; Mon, 20 Apr 2015 02:50:01 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 09C6BAC001 for ; Mon, 20 Apr 2015 00:50:00 -0700 (PDT) X-ASG-Debug-ID: 1429516199-04bdf0632232a280001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id L0XwcBkEsqCdmHtN (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 20 Apr 2015 00:50:00 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3K7nwIx009550 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 20 Apr 2015 03:49:59 -0400 Received: from mmyllyne.csb (vpn1-4-18.ams2.redhat.com [10.36.4.18]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3K7nuvJ022655 for ; Mon, 20 Apr 2015 03:49:58 -0400 Message-ID: <5534AFA4.9040405@redhat.com> Date: Mon, 20 Apr 2015 10:49:56 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: pcp developers Subject: [PATCH] ds389/ds389log: make configuration variables actually configurable.. Content-Type: text/plain; charset=UTF-8 X-ASG-Orig-Subj: [PATCH] ds389/ds389log: make configuration variables actually configurable.. Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429516199 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 --- src/pmdas/ds389/pmdads389.pl | 20 ++++++++++---------- src/pmdas/ds389log/pmdads389log.pl | 20 ++++++++++---------- 2 files changed, 20 insertions(+), 20 deletions(-) diff --git a/src/pmdas/ds389/pmdads389.pl b/src/pmdas/ds389/pmdads389.pl index 5c00c29..4fa4fa2 100644 --- a/src/pmdas/ds389/pmdads389.pl +++ b/src/pmdas/ds389/pmdads389.pl @@ -18,22 +18,22 @@ use PCP::PMDA; use Net::LDAP; use POSIX; -my $server = 'localhost'; -my $binddn = 'cn=Directory Manager'; -my $bindpw = 'Manager12'; -my $scope = 'base'; -my $cnbase = 'cn=monitor'; -my $urbase = 'cn=monitor,cn=userRoot,cn=ldbm database,cn=plugins,cn=config'; -my $filter = '(objectclass=*)'; -my $query_interval = 2; # seconds - -use vars qw( $ldap $pmda %metrics ); +our $server = 'localhost'; +our $binddn = 'cn=Directory Manager'; +our $bindpw = 'Manager12'; +our $scope = 'base'; +our $cnbase = 'cn=monitor'; +our $urbase = 'cn=monitor,cn=userRoot,cn=ldbm database,cn=plugins,cn=config'; +our $filter = '(objectclass=*)'; +our $query_interval = 2; # seconds # Configuration files for overriding the above settings for my $file (pmda_config('PCP_PMDAS_DIR') . '/ds389/ds389.conf', './ds389.conf') { eval `cat $file` unless ! -f $file; } +use vars qw( $ldap $pmda %metrics ); + # Timestamps my $ts_cn = 0; my $ts_ur = 0; diff --git a/src/pmdas/ds389log/pmdads389log.pl b/src/pmdas/ds389log/pmdads389log.pl index f12de75..4f6e8bb 100644 --- a/src/pmdas/ds389log/pmdads389log.pl +++ b/src/pmdas/ds389log/pmdads389log.pl @@ -18,11 +18,16 @@ use PCP::PMDA; use Date::Manip; use POSIX; -my $lc_opts = '-D /dev/shm -s all'; -my $lc_ival = 30; # minimal query interval in seconds, must be >= 30 -my $ds_alog = ''; # empty - guess; ok if only one DS instance in use -my $ds_logd = '/var/log/dirsrv'; -my $ds_user = 'nobody'; # empty - use root +our $lc_opts = '-D /dev/shm -s all'; +our $lc_ival = 30; # minimal query interval in seconds, must be >= 30 +our $ds_alog = ''; # empty - guess; ok if only one DS instance in use +our $ds_logd = '/var/log/dirsrv'; +our $ds_user = 'nobody'; # empty - use root + +# Configuration files for overriding the above settings +for my $file (pmda_config('PCP_PMDAS_DIR') . '/ds389log/ds389log.conf', './ds389log.conf') { + eval `cat $file` unless ! -f $file; +} my %data = ( # logconv.pl string - name - subtree - cluster - id - type @@ -53,11 +58,6 @@ use vars qw( $pmda %metrics ); my @lc_prev = localtime(); my @lc_curr; -# Configuration files for overriding the above settings -for my $file (pmda_config('PCP_PMDAS_DIR') . '/ds389log/ds389log.conf', './ds389log.conf') { - eval `cat $file` unless ! -f $file; -} - sub ds389log_set_ds_access_log { $ds_alog = `ls -1 $ds_logd/slapd-*/access 2>/dev/null | tail -n 1`; my $un = `id -un`; -- 1.7.1 From myllynen@redhat.com Mon Apr 20 04:27:38 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id D246C7F50 for ; Mon, 20 Apr 2015 04:27:38 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 86D3D8F8035 for ; Mon, 20 Apr 2015 02:27:35 -0700 (PDT) X-ASG-Debug-ID: 1429522053-04bdf0632032c7e0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id CfvHtOkzeJAYkD1F (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 20 Apr 2015 02:27:34 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (Postfix) with ESMTPS id 865BA8EA57 for ; Mon, 20 Apr 2015 09:27:33 +0000 (UTC) Received: from mmyllyne.csb (vpn1-4-18.ams2.redhat.com [10.36.4.18]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3K9RTiK026741 for ; Mon, 20 Apr 2015 05:27:32 -0400 Message-ID: <5534C680.2020709@redhat.com> Date: Mon, 20 Apr 2015 12:27:28 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: pcp developers Subject: [PATCH] PCP pidstat PMDA Content-Type: text/plain; charset=UTF-8 X-ASG-Orig-Subj: [PATCH] PCP pidstat PMDA Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429522054 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, please see below for a proposal for a new process level PMDA. There are other related PMDAs already (at least hotproc, linux_proc, and process) but I think this one complements the offering nicely with the ability to easily monitor certain processes (e.g., just say $procs = 'java' on the fly to start monitoring all java processes regardless of their PIDs) and also by providing e.g. per-process IO stats which are not easily (if at all) available from other PMDAs. It would be good to hear whether all the types are looking correct and if someone could think of any other "crucial" metric that could be added. I did not use separate clusters for threads/vmswap nor wchan as the overhead they add should be negligible but if more metrics are added then perhaps clusters could be used. One mostly cosmetic thing I noticed with Perl PCP::PMDA is that while proc.psinfo maps instance numbers to PIDs (e.g. a process with PID 21641 is listed as 'inst [21641 or "021641 zsh"]'), with PCP::PMDA instance domain numbers are starting from 0 and can't be affected. Not sure does that actually matter in practice at all but if there's a trick to follow the proc.psinfo convention I could use it. Thanks. ----- Add a new PMDA which monitors cpu/mem/io for given processes. Does nothing if no processes are specified, the list of monitored processes can be updated on-the-fly. Uses pidstat to do most work. --- src/pmdas/pidstat/Install | 32 ++++++ src/pmdas/pidstat/Remove | 23 ++++ src/pmdas/pidstat/pidstat.conf | 6 + src/pmdas/pidstat/pmdapidstat.pl | 209 ++++++++++++++++++++++++++++++++++++++ 4 files changed, 270 insertions(+), 0 deletions(-) create mode 100755 src/pmdas/pidstat/Install create mode 100755 src/pmdas/pidstat/Remove create mode 100644 src/pmdas/pidstat/pidstat.conf create mode 100644 src/pmdas/pidstat/pmdapidstat.pl diff --git a/src/pmdas/pidstat/Install b/src/pmdas/pidstat/Install new file mode 100755 index 0000000..47a67bd --- /dev/null +++ b/src/pmdas/pidstat/Install @@ -0,0 +1,32 @@ +#!/bin/sh +# +# Copyright (C) 2015 Marko Myllynen +# +# This program is free software; you can redistribute it and/or modify it +# under the terms of the GNU General Public License as published by the +# Free Software Foundation; either version 2 of the License, or (at your +# option) any later version. +# +# This program is distributed in the hope that it will be useful, but +# WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY +# or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License +# for more details. +# + +. $PCP_DIR/etc/pcp.env +. $PCP_SHARE_DIR/lib/pmdaproc.sh + +iam=pidstat +perl_opt=true +daemon_opt=false +forced_restart=true + +which pidof pidstat > /dev/null 2>&1 +if test $? -ne 0; then + echo "pidof and pidstat are needed" + exit 1 +fi + +pmdaSetup +pmdaInstall +exit 0 diff --git a/src/pmdas/pidstat/Remove b/src/pmdas/pidstat/Remove new file mode 100755 index 0000000..36437d0 --- /dev/null +++ b/src/pmdas/pidstat/Remove @@ -0,0 +1,23 @@ +#!/bin/sh +# +# Copyright (C) 2015 Marko Myllynen +# +# This program is free software; you can redistribute it and/or modify it +# under the terms of the GNU General Public License as published by the +# Free Software Foundation; either version 2 of the License, or (at your +# option) any later version. +# +# This program is distributed in the hope that it will be useful, but +# WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY +# or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License +# for more details. +# + +. $PCP_DIR/etc/pcp.env +. $PCP_SHARE_DIR/lib/pmdaproc.sh + +iam=pidstat + +pmdaSetup +pmdaRemove +exit 0 diff --git a/src/pmdas/pidstat/pidstat.conf b/src/pmdas/pidstat/pidstat.conf new file mode 100644 index 0000000..732088a --- /dev/null +++ b/src/pmdas/pidstat/pidstat.conf @@ -0,0 +1,6 @@ +# Space-separated list of process names and/or PIDs to monitor +# Non-existing processes are ignored, empty means no monitoring +#our $procs = '1 java'; + +# Only root can read I/O stats of other users' processes +#our $user = 'pcp'; diff --git a/src/pmdas/pidstat/pmdapidstat.pl b/src/pmdas/pidstat/pmdapidstat.pl new file mode 100644 index 0000000..747bcbc --- /dev/null +++ b/src/pmdas/pidstat/pmdapidstat.pl @@ -0,0 +1,209 @@ +# +# Copyright (C) 2015 Marko Myllynen +# +# This program is free software; you can redistribute it and/or modify it +# under the terms of the GNU General Public License as published by the +# Free Software Foundation; either version 2 of the License, or (at your +# option) any later version. +# +# This program is distributed in the hope that it will be useful, but +# WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY +# or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License +# for more details. +# + +use strict; +use warnings; +use PCP::PMDA; +use POSIX; + +our $procs = ''; # space-separated list of process names or PIDs +our $user = 'root'; # only root can read I/O stats of others procs + +# Config file for overriding the above settings, will be monitored for updates +my $config_file = pmda_config('PCP_PMDAS_DIR') . '/pidstat/pidstat.conf'; +my $config_ts = 0; +if (-f $config_file) { + eval `cat $config_file`; + $config_ts = (stat($config_file))[9]; # mtime +} + +# Metrics for each process found keyed with PID/cmd +my %metrics = (); + +my $pmda = PCP::PMDA->new('pidstat', 505); + +# Return comma-separated list of PIDs to check +sub get_pids { + my ($cmds, $pids) = ("", ""); + + # Monitor the configuration file for changes if it exists + if ($config_ts > 0) { + my $update_ts = (stat($config_file))[9]; + if (defined($update_ts) and $update_ts > $config_ts) { + eval `cat $config_file`; + $config_ts = $update_ts; + } + } + + foreach my $p (split(' ', $procs)) { + if (isdigit($p)) { + $pids = $p . "," . $pids; + } else { + $cmds = $p . " " . $cmds; + } + } + $pids =~ s/,$//; + + if ($cmds =~ /\S/) { + my $output = `pidof $cmds 2>/dev/null`; + chomp($output); + + $pids = $pids . "," . $output; + $pids =~ s/ /,/g; + $pids =~ s/,$//; + } + + return $pids; +} + +# Update metrics +sub pidstat_fetch { + my $pids = get_pids(); + %metrics = (); # clear any previous content + + if ($pids !~ /\S/) { + $pmda->replace_indom(0, \%metrics); + return; + } + + my $output = `pidstat -h -I -l -p $pids -d -r -u -w 2>/dev/null`; + + foreach my $line (split('\n', $output)) { + my @data = split(' ', $line); + + next unless defined($data[0]) and isdigit($data[0]); + + my $pid = $data[1]; + + my $cmd = $data[17]; + $cmd =~ s/.*\///g; + + my $key = $pid . " " . $cmd; + + $metrics{$key}->{'pidstat.pid'} = $pid; + $metrics{$key}->{'pidstat.cmd'} = $cmd; + $metrics{$key}->{'pidstat.cpu_usr'} = $data[2]; + $metrics{$key}->{'pidstat.cpu_system'} = $data[3]; + $metrics{$key}->{'pidstat.cpu_guest'} = $data[4]; + $metrics{$key}->{'pidstat.cpu_total'} = $data[5]; + $metrics{$key}->{'pidstat.cpu_last'} = $data[6]; + $metrics{$key}->{'pidstat.minflt'} = $data[7]; + $metrics{$key}->{'pidstat.majflt'} = $data[8]; + $metrics{$key}->{'pidstat.vsz'} = $data[9]; + $metrics{$key}->{'pidstat.rss'} = $data[10]; + $metrics{$key}->{'pidstat.mem_percent'} = $data[11]; + $metrics{$key}->{'pidstat.disk_read'} = $data[12]; + $metrics{$key}->{'pidstat.disk_write'} = $data[13]; + $metrics{$key}->{'pidstat.disk_write_cancel'} = $data[14]; + $metrics{$key}->{'pidstat.cswch'} = $data[15]; + $metrics{$key}->{'pidstat.nvcswch'} = $data[16]; + for (my $j = 17; $j < scalar @data; $j++) { + $metrics{$key}->{'pidstat.psargs'} .= $data[$j] . " "; + } + $metrics{$key}->{'pidstat.psargs'} =~ s/ $//; + + # Add few hand-picked metrics from /proc/ + + # threads, vmswap + open(my $fh, "<", "/proc/$pid/status") or next; + foreach my $l (<$fh>) { + if ($l =~ /^Threads:/) { + $metrics{$key}->{'pidstat.threads'} = (split(' ', $l))[1]; + } + if ($l =~ /^VmSwap:/) { + $metrics{$key}->{'pidstat.vmswap'} = (split(' ', $l))[1]; + } + } + close($fh); + + # wchan + open($fh, "<", "/proc/$pid/wchan") or next; + $metrics{$key}->{'pidstat.wchan'} = <$fh>; + close($fh); + } + + $pmda->replace_indom(0, \%metrics); +} + +# Return metric +sub pidstat_fetch_callback { + my ($cluster, $item, $inst) = @_; + + if ($inst == PM_IN_NULL) { return (PM_ERR_INST, 0); } + + my $lookup = pmda_inst_lookup(0, $inst); + my $pmnm = pmda_pmid_name($cluster, $item); + + if (!defined($lookup)) { return (PM_ERR_INST, 0); } + if (!defined($pmnm)) { return (PM_ERR_PMID, 0); } + + return ($lookup->{$pmnm}, 1); +} + +$pmda->add_metric(pmda_pmid(0,0), PM_TYPE_U32, 0, PM_SEM_INSTANT, + pmda_units(0,0,0,0,0,0), 'pidstat.pid', '', ''); +$pmda->add_metric(pmda_pmid(0,1), PM_TYPE_STRING, 0, PM_SEM_INSTANT, + pmda_units(0,0,0,0,0,0), 'pidstat.cmd', '', ''); + +$pmda->add_metric(pmda_pmid(0,2), PM_TYPE_FLOAT, 0, PM_SEM_INSTANT, + pmda_units(0,0,0,0,0,0), 'pidstat.cpu_usr', '', ''); +$pmda->add_metric(pmda_pmid(0,3), PM_TYPE_FLOAT, 0, PM_SEM_INSTANT, + pmda_units(0,0,0,0,0,0), 'pidstat.cpu_system', '', ''); +$pmda->add_metric(pmda_pmid(0,4), PM_TYPE_FLOAT, 0, PM_SEM_INSTANT, + pmda_units(0,0,0,0,0,0), 'pidstat.cpu_guest', '', ''); +$pmda->add_metric(pmda_pmid(0,5), PM_TYPE_FLOAT, 0, PM_SEM_INSTANT, + pmda_units(0,0,0,0,0,0), 'pidstat.cpu_total', '', ''); +$pmda->add_metric(pmda_pmid(0,6), PM_TYPE_U32, 0, PM_SEM_INSTANT, + pmda_units(0,0,0,0,0,0), 'pidstat.cpu_last', '', ''); + +$pmda->add_metric(pmda_pmid(0,7), PM_TYPE_FLOAT, 0, PM_SEM_INSTANT, + pmda_units(0,-1,1,0,PM_TIME_SEC,PM_COUNT_ONE), 'pidstat.minflt', '', ''); +$pmda->add_metric(pmda_pmid(0,8), PM_TYPE_FLOAT, 0, PM_SEM_INSTANT, + pmda_units(0,-1,1,0,PM_TIME_SEC,PM_COUNT_ONE), 'pidstat.majflt', '', ''); + +$pmda->add_metric(pmda_pmid(0,9), PM_TYPE_U64, 0, PM_SEM_INSTANT, + pmda_units(1,0,0,PM_SPACE_KBYTE,0,0), 'pidstat.vsz', '', ''); +$pmda->add_metric(pmda_pmid(0,10), PM_TYPE_U64, 0, PM_SEM_INSTANT, + pmda_units(1,0,0,PM_SPACE_KBYTE,0,0), 'pidstat.rss', '', ''); + +$pmda->add_metric(pmda_pmid(0,11), PM_TYPE_FLOAT, 0, PM_SEM_INSTANT, + pmda_units(0,0,0,0,0,0), 'pidstat.mem_percent', '', ''); + +$pmda->add_metric(pmda_pmid(0,12), PM_TYPE_FLOAT, 0, PM_SEM_INSTANT, + pmda_units(1,-1,0,PM_SPACE_KBYTE,PM_TIME_SEC,0), 'pidstat.disk_read', '', ''); +$pmda->add_metric(pmda_pmid(0,13), PM_TYPE_FLOAT, 0, PM_SEM_INSTANT, + pmda_units(1,-1,0,PM_SPACE_KBYTE,PM_TIME_SEC,0), 'pidstat.disk_write', '', ''); +$pmda->add_metric(pmda_pmid(0,14), PM_TYPE_FLOAT, 0, PM_SEM_INSTANT, + pmda_units(1,-1,0,PM_SPACE_KBYTE,PM_TIME_SEC,0), 'pidstat.disk_write_cancel', '', ''); + +$pmda->add_metric(pmda_pmid(0,15), PM_TYPE_FLOAT, 0, PM_SEM_INSTANT, + pmda_units(0,-1,1,0,PM_TIME_SEC,PM_COUNT_ONE), 'pidstat.cswch', '', ''); +$pmda->add_metric(pmda_pmid(0,16), PM_TYPE_FLOAT, 0, PM_SEM_INSTANT, + pmda_units(0,-1,1,0,PM_TIME_SEC,PM_COUNT_ONE), 'pidstat.nvcswch', '', ''); + +$pmda->add_metric(pmda_pmid(0,17), PM_TYPE_STRING, 0, PM_SEM_INSTANT, + pmda_units(0,0,0,0,0,0), 'pidstat.psargs', '', ''); + +$pmda->add_metric(pmda_pmid(0,18), PM_TYPE_STRING, 0, PM_SEM_INSTANT, + pmda_units(0,0,0,0,0,0), 'pidstat.threads', '', ''); +$pmda->add_metric(pmda_pmid(0,19), PM_TYPE_U64, 0, PM_SEM_INSTANT, + pmda_units(1,0,0,PM_SPACE_KBYTE,0,0), 'pidstat.vmswap', '', ''); +$pmda->add_metric(pmda_pmid(0,20), PM_TYPE_STRING, 0, PM_SEM_INSTANT, + pmda_units(0,0,0,0,0,0), 'pidstat.wchan', '', ''); + +$pmda->add_indom(0, {}, '', ''); +$pmda->set_fetch(\&pidstat_fetch); +$pmda->set_fetch_callback(\&pidstat_fetch_callback); +$pmda->set_user($user) if $user ne ''; +$pmda->run; -- 1.7.1 From myllynen@redhat.com Mon Apr 20 05:39:19 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 826CA7F50 for ; Mon, 20 Apr 2015 05:39:19 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 11786AC003 for ; Mon, 20 Apr 2015 03:39:18 -0700 (PDT) X-ASG-Debug-ID: 1429526353-04cbb056b433c700001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id jcx80eXi3lTHjEMK (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 20 Apr 2015 03:39:14 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3KAdDgc005495 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 20 Apr 2015 06:39:13 -0400 Received: from mmyllyne.csb (vpn1-4-18.ams2.redhat.com [10.36.4.18]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3KAdAoo008911 for ; Mon, 20 Apr 2015 06:39:12 -0400 Message-ID: <5534D74D.9040709@redhat.com> Date: Mon, 20 Apr 2015 13:39:09 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] PCP / RHEL 5 Update Issue References: <54FD554B.3020403@redhat.com> <87442315.2740208.1425964225318.JavaMail.zimbra@redhat.com> <54FE9A8F.60908@redhat.com> X-ASG-Orig-Subj: Re: [pcp] PCP / RHEL 5 Update Issue In-Reply-To: <54FE9A8F.60908@redhat.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429526354 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, On 2015-03-10 09:17, Marko Myllynen wrote: > On 2015-03-10 07:10, Nathan Scott wrote: >>> >>> on few remaining RHEL 5 systems I'm seeing this update issue: >>> [...] >>> Is this is a known issue and/or will this be fixed in RHEL 5 packaging >>> or should I manually uninstall/install to be able to update? >> >> The rpm spec file updates have been done & tested now, so this will be >> resolved by the next PCP release (pcp-3.10.4). > > sounds good, thanks! FYI, PCP 3.10.4 packages in EPEL 5 testing solved the issue, yum upgrade works ok again. Thanks, -- Marko Myllynen From nscott@redhat.com Mon Apr 20 06:22:53 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 1502E7F50 for ; Mon, 20 Apr 2015 06:22:53 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 88089AC002 for ; Mon, 20 Apr 2015 04:22:49 -0700 (PDT) X-ASG-Debug-ID: 1429528963-04cb6c1cc82f9b10001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id 4zSQOH8DABovn5LV (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 20 Apr 2015 04:22:44 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3KBMghX026101; Mon, 20 Apr 2015 07:22:42 -0400 Date: Mon, 20 Apr 2015 07:22:42 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: myllynen@redhat.com, Martins Innus Cc: pcp developers Message-ID: <493537984.3276058.1429528962326.JavaMail.zimbra@redhat.com> In-Reply-To: <5534C680.2020709@redhat.com> References: <5534C680.2020709@redhat.com> Subject: Re: [pcp] [PATCH] PCP pidstat PMDA MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] [PATCH] PCP pidstat PMDA Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.115] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: PCP pidstat PMDA Thread-Index: Wj40XTZ2bSXCsZfvlgJugVjqRRv8lA== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1429528964 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18150 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Marko, ----- Original Message ----- > Hi, > > please see below for a proposal for a new process level PMDA. > > There are other related PMDAs already (at least hotproc, linux_proc, > and process) but I think this one complements the offering nicely > with the ability to easily monitor certain processes (e.g., just say > $procs = 'java' on the fly to start monitoring all java processes > regardless of their PIDs) and also by providing e.g. per-process > IO stats which are not easily (if at all) available from other PMDAs. It sounds like there's alot of overlap here with hotproc.* - pmdaproc nowadays provides hotproc.* metrics, thanks to Martins recent efforts, which may not be widely known yet (not really following the advantage to parsing pidstat over accessing proc.* via hotproc ... am I missing something subtle there?). Those new hotproc.* metrics do allow both a configuration file-based mechanism (like this new PMDA) & also support a very dynamic pmstore update model too, like: # pmstore hotproc.control.config 'fname = "java"' to set the process filtering on-the-fly (the above syntax may not be 100% correct, thats just from memory - it'll be close though). Is there something missing from the hotproc.* metrics that this new PMDA would provide Marko? I don't really follow the IO-stats comment - there's no magic that pidstat can do that pmdaproc cannot AFAIK in terms of querying the kernel for stats. >From a quick look, the docs for the (recently-added-to-Linux) hotproc metrics could be improved - Martins, could we find a way to report help text for hotproc.control, hotproc.predicate, and hotproc.total? And the pmdaproc(1) man page is a bit lacking in coverage of how to use hotproc. Maybe a tutorial page would suit here too? On a vaguely related note, we have had several requests for a PMAPI pcp-pidstat(1) tool (that uses the proc.* metrics, supports archives, and could swap in hotproc.* for proc.* via command line option). We could also think of extending pcp-collectl(1) in a similar way, which might answer that other question you had (elsewhere) perhaps. cheers. -- Nathan From myllynen@redhat.com Mon Apr 20 07:06:12 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id EE61A7F50 for ; Mon, 20 Apr 2015 07:06:11 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id B0ABF8F8049 for ; Mon, 20 Apr 2015 05:06:08 -0700 (PDT) X-ASG-Debug-ID: 1429531564-04bdf06321330860001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id cFRXhoYvYsuctKWF (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 20 Apr 2015 05:06:04 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3KC62Eq015102 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Mon, 20 Apr 2015 08:06:02 -0400 Received: from mmyllyne.csb (vpn1-4-18.ams2.redhat.com [10.36.4.18]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3KC60u3017019; Mon, 20 Apr 2015 08:06:01 -0400 Message-ID: <5534EBA8.4030509@redhat.com> Date: Mon, 20 Apr 2015 15:06:00 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Nathan Scott , Martins Innus CC: pcp developers Subject: Re: [pcp] [PATCH] PCP pidstat PMDA References: <5534C680.2020709@redhat.com> <493537984.3276058.1429528962326.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] [PATCH] PCP pidstat PMDA In-Reply-To: <493537984.3276058.1429528962326.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429531564 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, On 2015-04-20 14:22, Nathan Scott wrote: >> >> please see below for a proposal for a new process level PMDA. >> >> There are other related PMDAs already (at least hotproc, linux_proc, >> and process) but I think this one complements the offering nicely >> with the ability to easily monitor certain processes (e.g., just say >> $procs = 'java' on the fly to start monitoring all java processes >> regardless of their PIDs) and also by providing e.g. per-process >> IO stats which are not easily (if at all) available from other PMDAs. > > It sounds like there's alot of overlap here with hotproc.* - pmdaproc > nowadays provides hotproc.* metrics, thanks to Martins recent efforts, hmm, which hotproc are we talking about? When looking at src/pmdas/hotproc, I don't see any notable recent changes, copyright dates are mostly from the previous millennium. Hmm, perhaps you are referring to linux_proc/hotproc.c which seems to have received updates recently? > which may not be widely known yet (not really following the advantage > to parsing pidstat over accessing proc.* via hotproc ... am I missing > something subtle there?). Btw, a general question, is there a way to access other metrics from PMDA? (Think of writing a PMDA which would provide custom metrics under "foo." but some special metrics would be calculated with help of some external metric like hinv or so.) > Those new hotproc.* metrics do allow both a configuration file-based > mechanism (like this new PMDA) & also support a very dynamic pmstore > update model too, like: > > # pmstore hotproc.control.config 'fname = "java"' > > to set the process filtering on-the-fly (the above syntax may not be > 100% correct, thats just from memory - it'll be close though). Ok, I wasn't aware of this, would be great to know how to do that, the above example doesn't seem to work and the pmdahotproc.1 man isn't really that helpful. > Is there something missing from the hotproc.* metrics that this new > PMDA would provide Marko? I don't really follow the IO-stats comment > - there's no magic that pidstat can do that pmdaproc cannot AFAIK in > terms of querying the kernel for stats. The reason for using pidstat was mainly that it was quick to write the PMDA. As a bonus it also provided those read/s and write/s metrics which I didn't see readily available elsewhere. > From a quick look, the docs for the (recently-added-to-Linux) hotproc > metrics could be improved - Martins, could we find a way to report > help text for hotproc.control, hotproc.predicate, and hotproc.total? > And the pmdaproc(1) man page is a bit lacking in coverage of how to > use hotproc. Maybe a tutorial page would suit here too? Yes, that would be great. The use case I was thinking for the pidstat PMDA was that it would be suitable almost anyone to add certain processes to be monitored without necessarily knowing anything about PCP. For pidstat the required documentation to achieve this was more or less those two lines in the configuration file. Thanks, -- Marko Myllynen From michele@acksyn.org Mon Apr 20 12:47:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=T_DKIM_INVALID autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id BF5C67F50 for ; Mon, 20 Apr 2015 12:47:18 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 3D65EAC001 for ; Mon, 20 Apr 2015 10:47:18 -0700 (PDT) X-ASG-Debug-ID: 1429552034-04cbb056b13466a0001-S8gJnT Received: from palahniuk.acksyn.org (palahniuk.acksyn.org [5.9.7.26]) by cuda.sgi.com with ESMTP id CbjgRIDjjk26lMYn for ; Mon, 20 Apr 2015 10:47:15 -0700 (PDT) X-Barracuda-Envelope-From: michele@acksyn.org X-Barracuda-Apparent-Source-IP: 5.9.7.26 Received: from localhost (localhost [127.0.0.1]) by palahniuk.acksyn.org (Postfix) with ESMTP id 5CE9D200AE for ; Mon, 20 Apr 2015 13:47:14 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=acksyn.org; h= user-agent:content-disposition:content-type:content-type :mime-version:message-id:subject:subject:from:from:date:date :received:received; s=2010; t=1429552033; bh=WRy4785NKIOOeODaNN4 rFtVJBhgfrBa4NyYdaHed+I8=; b=gL7TZB8haTctoJtcp+X75G70cjO9lFROkh7 Gasl6eWbCD4ozRmaQWGn+QzK/DosMtnfbVf75k6Jr5sBQu2dmPRFngb3Hn9Y2Tvr GpwlnBcIs/YEwC7yOg0i3l7H1fouVXkmWbxgk6Wz3EkRbhi/IMiV1xirSbav3+L+ 19qBy2MI= Received: from palahniuk.acksyn.org ([127.0.0.1]) by localhost (mail.acksyn.org [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id yemeh22LjqBA for ; Mon, 20 Apr 2015 13:47:13 -0400 (EDT) Received: from localhost (host89-178-dynamic.6-79-r.retail.telecomitalia.it [79.6.178.89]) by palahniuk.acksyn.org (Postfix) with ESMTPSA id 65784200AA for ; Mon, 20 Apr 2015 13:47:13 -0400 (EDT) Date: Mon, 20 Apr 2015 19:47:12 +0200 From: Michele Baldessari To: pcp developers Subject: Bug/Issue tracker Message-ID: <20150420174712.GH18943@marquez.int.rhx> X-ASG-Orig-Subj: Bug/Issue tracker MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.23.1-rc1 (2014-03-12) X-Barracuda-Connect: palahniuk.acksyn.org[5.9.7.26] X-Barracuda-Start-Time: 1429552034 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC5_SA210e, DKIM_SIGNED, DKIM_VERIFIED X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18164 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 BSF_SC5_SA210e Custom Rule SA210e Hi all, we currently have issues/enhancements filed in three different places: 1. SGI Bugzilla (92 bugs open atm) 2. Github Issue Tracker (9 issues open atm) 3. Red Hat Bugzilla (mainly for issues with packaging in RHEL/Fedora or any Red Hat specific process - I am excluding this one from the proposal below) Since I'd like to add a simple "Bug Reporting" webpage to pcp.io, I think it makes sense to consolidate 1. and 2. into a single source. Here are the pro/contra I can think of for choosing the main bug DB. - Github Pro: integrates well with existing git workflow massive userbase so no need to create an account just to file a bug much more user friendly to file an issue Contra: some migration work issue tracking is a bit more simplistic than bugzilla - SGI Bugzilla Pro: most bugs are already there Contra: cumbersome to use and to file new issues requires an account which users are unlikely to have I think that to make things easier for users it makes more sense to switch to github fully for issue tracking purposes. If there is rough consensus on this, I'll work on some test scripts to migrate all bugs w/comments and attachments. If there is vast disagreement we can also move everything to SGI's bugzilla instance. I think in the long term it might be a bit easier to do some roadmap/release planning in the open by using a single source of issues. Thoughts on this? cheers, Michele -- Michele Baldessari C2A5 9DA3 9961 4FFB E01B D0BC DDD4 DCCB 7515 5C6D From lberk@redhat.com Mon Apr 20 13:37:58 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 928CD7F50 for ; Mon, 20 Apr 2015 13:37:58 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 824158F8052 for ; Mon, 20 Apr 2015 11:37:55 -0700 (PDT) X-ASG-Debug-ID: 1429555073-04cbb056b13479f0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id QUPn82xZSSaHXvIX (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 20 Apr 2015 11:37:54 -0700 (PDT) X-Barracuda-Envelope-From: lberk@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (Postfix) with ESMTPS id C84368E663; Mon, 20 Apr 2015 18:37:53 +0000 (UTC) Received: from toium (unused-10-15-17-233.yyz.redhat.com [10.15.17.233]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3KIbqqs005002 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Mon, 20 Apr 2015 14:37:53 -0400 From: Lukas Berk To: Michele Baldessari Cc: pcp developers Subject: Re: [pcp] Bug/Issue tracker References: <20150420174712.GH18943@marquez.int.rhx> X-ASG-Orig-Subj: Re: [pcp] Bug/Issue tracker Date: Mon, 20 Apr 2015 14:37:52 -0400 In-Reply-To: <20150420174712.GH18943@marquez.int.rhx> (Michele Baldessari's message of "Mon, 20 Apr 2015 19:47:12 +0200") Message-ID: <87twwad4sf.fsf@redhat.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429555074 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hey Michele, Michele Baldessari writes: [...] > Since I'd like to add a simple "Bug Reporting" webpage to pcp.io, I think it > makes sense to consolidate 1. and 2. into a single source. Would it be possible to list both as an option, so the user/bug reporter could decide what they would prefer? Something like "We have an official bugzilla if you'd like to report an issue [link here], or, feel free to open a github issue if it's easier for you[link to issue creation here]." Or just a simple link to each? I just want to make the bar as low as possible for folks trying to help us improve PCP, aka, "drive-by bug reports/patches". Whatever their preference is. > Here are the pro/contra I can think of for choosing the main bug DB. > - Github > Pro: > integrates well with existing git workflow > massive userbase so no need to create an account just to file a bug > much more user friendly to file an issue > Contra: > some migration work > issue tracking is a bit more simplistic than bugzilla I'd also add it's not Open Source software to the list. Furthermore, to elaborate on the last 'con', perhaps I'm just being obtuse, but I can't tell from github's UI how to only subscribe to 'issues', not to every push as well as issues. Personally, I prefer the more focused mail of bugzilla. :) > - SGI Bugzilla > Pro: > most bugs are already there > Contra: > cumbersome to use and to file new issues > requires an account which users are unlikely to have Perhaps I am mistaken, however, consdering the Pro of "most bugs are already there", does that not indicate that the immediate pcp community is using the bugzilla? I think it would make sense to continue that way and not disrupt the established workflow. As an additional pro, "open source" :) > I think that to make things easier for users it makes more sense to > switch to github fully for issue tracking purposes. If there is rough > consensus on this, I'll work on some test scripts to migrate all bugs > w/comments and attachments. If there is vast disagreement we can also > move everything to SGI's bugzilla instance. I'll go along with whatever concensus is determined, however, I do wonder if we can't continue to use both, giving potential bug reporters whichever avenue they prefer. What if we could write some test scripts, mirroring the issues onto Bugzilla, and allow the immediate community to consume information that way? Does Github allow that amount of freedom with information in their system? Cheers, Lukas From michele@acksyn.org Mon Apr 20 13:49:45 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=T_DKIM_INVALID autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 131A37F50 for ; Mon, 20 Apr 2015 13:49:45 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 84538AC002 for ; Mon, 20 Apr 2015 11:49:41 -0700 (PDT) X-ASG-Debug-ID: 1429555779-04cb6c1cca305960001-S8gJnT Received: from palahniuk.acksyn.org (palahniuk.acksyn.org [5.9.7.26]) by cuda.sgi.com with ESMTP id zWGi8qx94ijSVfpd for ; Mon, 20 Apr 2015 11:49:39 -0700 (PDT) X-Barracuda-Envelope-From: michele@acksyn.org X-Barracuda-Apparent-Source-IP: 5.9.7.26 Received: from localhost (localhost [127.0.0.1]) by palahniuk.acksyn.org (Postfix) with ESMTP id CFBB629CEE; Mon, 20 Apr 2015 14:49:38 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=acksyn.org; h= user-agent:in-reply-to:content-disposition:content-type :content-type:mime-version:references:message-id:subject:subject :from:from:date:date:received:received; s=2010; t=1429555778; bh=hGQVabyRxScjsxIdJPLGHxqYsDC8v5cZlJxmm9zSCeg=; b=bQMPyPXUMult +yDfUlE3NZGM8EE+upvq9VZb3UkpTRI3qF1O+y1gY2Rqu/RhfiIuzWNYXsDjUACo OECFSpdhw8r3NtL67Y8fdFPE4nhKVJMu31lOV9wl3qZFugk3e1eAnCYBFe/iSOgs HznsvI9a+GfEmmOluOKMOYjZC3LH594= Received: from palahniuk.acksyn.org ([127.0.0.1]) by localhost (mail.acksyn.org [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id TyksSK_TxD0a; Mon, 20 Apr 2015 14:49:38 -0400 (EDT) Received: from localhost (host89-178-dynamic.6-79-r.retail.telecomitalia.it [79.6.178.89]) by palahniuk.acksyn.org (Postfix) with ESMTPSA id DCC8F29CEC; Mon, 20 Apr 2015 14:49:37 -0400 (EDT) Date: Mon, 20 Apr 2015 20:49:37 +0200 From: Michele Baldessari To: Lukas Berk Cc: pcp developers Subject: Re: [pcp] Bug/Issue tracker Message-ID: <20150420184937.GJ18943@marquez.int.rhx> X-ASG-Orig-Subj: Re: [pcp] Bug/Issue tracker References: <20150420174712.GH18943@marquez.int.rhx> <87twwad4sf.fsf@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <87twwad4sf.fsf@redhat.com> User-Agent: Mutt/1.5.23.1-rc1 (2014-03-12) X-Barracuda-Connect: palahniuk.acksyn.org[5.9.7.26] X-Barracuda-Start-Time: 1429555779 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC5_SA210e, DKIM_SIGNED, DKIM_VERIFIED X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18167 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 BSF_SC5_SA210e Custom Rule SA210e Hi Lukas, On Mon, Apr 20, 2015 at 02:37:52PM -0400, Lukas Berk wrote: > > Since I'd like to add a simple "Bug Reporting" webpage to pcp.io, I think it > > makes sense to consolidate 1. and 2. into a single source. > > Would it be possible to list both as an option, so the user/bug reporter > could decide what they would prefer? Something like "We have an > official bugzilla if you'd like to report an issue [link here], or, feel > free to open a github issue if it's easier for you[link to issue > creation here]." Or just a simple link to each? Sure we could do that as well. I think we should reach consensus on using only one though. It will be easier to track things, plan releases, let users search for existing issues etc in a single place. I think having both won't help in the long run. > I just want to make the bar as low as possible for folks trying to > help us improve PCP, aka, "drive-by bug reports/patches". Whatever > their preference is. > > > Here are the pro/contra I can think of for choosing the main bug DB. > > - Github > > Pro: > > integrates well with existing git workflow > > massive userbase so no need to create an account just to file a bug > > much more user friendly to file an issue > > Contra: > > some migration work > > issue tracking is a bit more simplistic than bugzilla > > I'd also add it's not Open Source software to the list. Furthermore, > to elaborate on the last 'con', perhaps I'm just being obtuse, but I > can't tell from github's UI how to only subscribe to 'issues', not to > every push as well as issues. Personally, I prefer the more focused > mail of bugzilla. :) > > > - SGI Bugzilla > > Pro: > > most bugs are already there > > Contra: > > cumbersome to use and to file new issues > > requires an account which users are unlikely to have > > Perhaps I am mistaken, however, consdering the Pro of "most bugs are > already there", does that not indicate that the immediate pcp community > is using the bugzilla? I think it would make sense to continue that way > and not disrupt the established workflow. As an additional pro, "open > source" :) I managed to miss a pretty fat contra with github not being open-source haven't I. Sorry about that ;) The amount of open bugs in BZ is because it goes way back in time (the oldest open bug is 2009) whereas github is fairly recent in comparison. > > I think that to make things easier for users it makes more sense to > > switch to github fully for issue tracking purposes. If there is rough > > consensus on this, I'll work on some test scripts to migrate all bugs > > w/comments and attachments. If there is vast disagreement we can also > > move everything to SGI's bugzilla instance. > > I'll go along with whatever concensus is determined, however, I do > wonder if we can't continue to use both, giving potential bug reporters > whichever avenue they prefer. What if we could write some test scripts, > mirroring the issues onto Bugzilla, and allow the immediate community to > consume information that way? Does Github allow that amount of freedom > with information in their system? I can investigate that avenue as well, but I definitely prefer that we use a single DB for issues. We cannot sensibly ask users to look for open issues in multiple DB's. I am fine with both choices (with a slight preference for github), but I think we should pick one in the end. If the proprietary nature of github is a concern, we can also investigate backing that data up, so we'd be covered in case they change business model, fail or whatnot. Cheers, Michele -- Michele Baldessari C2A5 9DA3 9961 4FFB E01B D0BC DDD4 DCCB 7515 5C6D From fche@redhat.com Mon Apr 20 15:02:12 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id E2EE07F4E for ; Mon, 20 Apr 2015 15:02:12 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 6FEB7AC001 for ; Mon, 20 Apr 2015 13:02:09 -0700 (PDT) X-ASG-Debug-ID: 1429560125-04cb6c1cc83072b0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id GvxPR84qIVuD28KO (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 20 Apr 2015 13:02:06 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (Postfix) with ESMTPS id C84948E773; Mon, 20 Apr 2015 20:02:05 +0000 (UTC) Received: from fche.csb (vpn-225-93.phx2.redhat.com [10.3.225.93]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3KK25TN024728; Mon, 20 Apr 2015 16:02:05 -0400 Received: by fche.csb (Postfix, from userid 2569) id AC5335853A; Mon, 20 Apr 2015 16:02:01 -0400 (EDT) To: Michele Baldessari Cc: Lukas Berk , pcp@oss.sgi.com Subject: Re: Bug/Issue tracker References: <20150420174712.GH18943@marquez.int.rhx> <87twwad4sf.fsf@redhat.com> <20150420184937.GJ18943@marquez.int.rhx> X-ASG-Orig-Subj: Re: Bug/Issue tracker From: fche@redhat.com (Frank Ch. Eigler) Date: Mon, 20 Apr 2015 16:02:01 -0400 In-Reply-To: <20150420184937.GJ18943@marquez.int.rhx> (Michele Baldessari's message of "Mon, 20 Apr 2015 20:49:37 +0200") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429560126 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 michele wrote: > [...] I can investigate that avenue as well, but I definitely > prefer that we use a single DB for issues. We cannot sensibly ask > users to look for open issues in multiple DB's. [...] We don't have to ask them to do so - it is at most a courtesy. We'd like to make it easy for people to report problems. It is our responsibility to triage / duplicate-eliminate if -we- can handle three separate bugtrackers, then the status quo is IMHO ok. - FChE From nscott@redhat.com Mon Apr 20 15:57:27 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 6A7D77F50 for ; Mon, 20 Apr 2015 15:57:27 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 3A0B38F8050 for ; Mon, 20 Apr 2015 13:57:27 -0700 (PDT) X-ASG-Debug-ID: 1429563444-04cbb056b434a710001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id veioLB3C6LvA8r4a (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 20 Apr 2015 13:57:25 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3KKvNem015165; Mon, 20 Apr 2015 16:57:23 -0400 Date: Mon, 20 Apr 2015 16:57:22 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: myllynen@redhat.com Cc: Martins Innus , pcp developers Message-ID: <1644393599.3651017.1429563442835.JavaMail.zimbra@redhat.com> In-Reply-To: <5534EBA8.4030509@redhat.com> References: <5534C680.2020709@redhat.com> <493537984.3276058.1429528962326.JavaMail.zimbra@redhat.com> <5534EBA8.4030509@redhat.com> Subject: Re: [pcp] [PATCH] PCP pidstat PMDA MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] [PATCH] PCP pidstat PMDA Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.116] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: PCP pidstat PMDA Thread-Index: PUNQI02ZyO/ueON26fI5LgJMoiVM2A== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1429563445 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18172 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi Marko, ----- Original Message ----- > Hi, > > On 2015-04-20 14:22, Nathan Scott wrote: > >> > >> please see below for a proposal for a new process level PMDA. > >> > >> There are other related PMDAs already (at least hotproc, linux_proc, > >> and process) but I think this one complements the offering nicely > >> with the ability to easily monitor certain processes (e.g., just say > >> $procs = 'java' on the fly to start monitoring all java processes > >> regardless of their PIDs) and also by providing e.g. per-process > >> IO stats which are not easily (if at all) available from other PMDAs. > > > > It sounds like there's alot of overlap here with hotproc.* - pmdaproc > > nowadays provides hotproc.* metrics, thanks to Martins recent efforts, > > hmm, which hotproc are we talking about? When looking at > src/pmdas/hotproc, I don't see any notable recent changes, copyright > dates are mostly from the previous millennium. Hmm, perhaps you are > referring to linux_proc/hotproc.c which seems to have received updates > recently? Yes, the code is primarily in src/pmdas/linux_proc/hotproc.[ch] now. (which reminds me, the old hotproc code should be dropped now, will do) > > which may not be widely known yet (not really following the advantage > > to parsing pidstat over accessing proc.* via hotproc ... am I missing > > something subtle there?). > > Btw, a general question, is there a way to access other metrics from > PMDA? (Think of writing a PMDA which would provide custom metrics under > "foo." but some special metrics would be calculated with help of some > external metric like hinv or so.) Yep, have a look at sample.secret.foo.bar.max.redirect in pmdas/sample. > Ok, I wasn't aware of this, would be great to know how to do that, the > above example doesn't seem to work and the pmdahotproc.1 man isn't > really that helpful. Yeah, docs need some love here I think. Anyone able to volunteer? > > Is there something missing from the hotproc.* metrics that this new > > PMDA would provide Marko? I don't really follow the IO-stats comment > > - there's no magic that pidstat can do that pmdaproc cannot AFAIK in > > terms of querying the kernel for stats. > > The reason for using pidstat was mainly that it was quick to write the > PMDA. As a bonus it also provided those read/s and write/s metrics which > I didn't see readily available elsewhere. I think those will be the values behind the proc.io.* metrics, FWIW, but have not checked closely (see e.g. /proc/self/io). > > From a quick look, the docs for the (recently-added-to-Linux) hotproc > > metrics could be improved - Martins, could we find a way to report > > help text for hotproc.control, hotproc.predicate, and hotproc.total? > > And the pmdaproc(1) man page is a bit lacking in coverage of how to > > use hotproc. Maybe a tutorial page would suit here too? > > Yes, that would be great. The use case I was thinking for the pidstat > PMDA was that it would be suitable almost anyone to add certain > processes to be monitored without necessarily knowing anything about > PCP. For pidstat the required documentation to achieve this was more or > less those two lines in the configuration file. +1 ... pmdaproc is on-by-default already, and its hotproc metrics share those goals - I think we should focus on adding anything that's missing that you need into that PMDA. Also, writing a pcp-pidstat and making pcp-collectl mirror the behaviour you're seeking for OpenStack analysis would also go a long way to making it user-friendly. cheers. -- Nathan From minnus@buffalo.edu Mon Apr 20 16:55:27 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id EA5857F50 for ; Mon, 20 Apr 2015 16:55:27 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id BD4BF8F8052 for ; Mon, 20 Apr 2015 14:55:24 -0700 (PDT) X-ASG-Debug-ID: 1429566922-04bdf06322341380001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id lPStR79Kdm2ysXP4 for ; Mon, 20 Apr 2015 14:55:22 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmaile.acsu.buffalo.edu (localmaile.acsu.buffalo.edu [128.205.4.3]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id C2BD53D0; Mon, 20 Apr 2015 17:55:21 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id B6061160070; Mon, 20 Apr 2015 17:55:21 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localmaile.acsu.buffalo.edu (Postfix) with ESMTP id 80CA6160094; Mon, 20 Apr 2015 17:55:21 -0400 (EDT) Received: from smtp.buffalo.edu (smtp1.acsu.buffalo.edu [128.205.5.253]) by localmaile.acsu.buffalo.edu (Prefixe) with ESMTP id 750F3160070; Mon, 20 Apr 2015 17:55:21 -0400 (EDT) Received: from [10.0.1.12] (cpe-69-204-8-250.buffalo.res.rr.com [69.204.8.250]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 5C7442240; Mon, 20 Apr 2015 17:55:21 -0400 (EDT) References: <5534C680.2020709@redhat.com> <493537984.3276058.1429528962326.JavaMail.zimbra@redhat.com> <5534EBA8.4030509@redhat.com> <1644393599.3651017.1429563442835.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 (1.0) In-Reply-To: <1644393599.3651017.1429563442835.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-Id: <55EF4990-2D1B-46FF-9F9D-6D21F2A9625E@buffalo.edu> Cc: "myllynen@redhat.com" , pcp developers X-Mailer: iPhone Mail (11D257) From: Martins Innus Subject: Re: [pcp] [PATCH] PCP pidstat PMDA Date: Mon, 20 Apr 2015 17:55:18 -0400 X-ASG-Orig-Subj: Re: [pcp] [PATCH] PCP pidstat PMDA To: Nathan Scott X-PM-EL-Spam-Prob: XX: 28% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1429566922 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18174 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- This is on my list to look at Tommorrow, just ran out of time today. Martins > On Apr 20, 2015, at 4:57 PM, Nathan Scott wrote: > > Hi Marko, > > ----- Original Message ----- >> Hi, >> >> On 2015-04-20 14:22, Nathan Scott wrote: >>>> >>>> please see below for a proposal for a new process level PMDA. >>>> >>>> There are other related PMDAs already (at least hotproc, linux_proc, >>>> and process) but I think this one complements the offering nicely >>>> with the ability to easily monitor certain processes (e.g., just say >>>> $procs = 'java' on the fly to start monitoring all java processes >>>> regardless of their PIDs) and also by providing e.g. per-process >>>> IO stats which are not easily (if at all) available from other PMDAs. >>> >>> It sounds like there's alot of overlap here with hotproc.* - pmdaproc >>> nowadays provides hotproc.* metrics, thanks to Martins recent efforts, >> >> hmm, which hotproc are we talking about? When looking at >> src/pmdas/hotproc, I don't see any notable recent changes, copyright >> dates are mostly from the previous millennium. Hmm, perhaps you are >> referring to linux_proc/hotproc.c which seems to have received updates >> recently? > > Yes, the code is primarily in src/pmdas/linux_proc/hotproc.[ch] now. > (which reminds me, the old hotproc code should be dropped now, will do) > >>> which may not be widely known yet (not really following the advantage >>> to parsing pidstat over accessing proc.* via hotproc ... am I missing >>> something subtle there?). >> >> Btw, a general question, is there a way to access other metrics from >> PMDA? (Think of writing a PMDA which would provide custom metrics under >> "foo." but some special metrics would be calculated with help of some >> external metric like hinv or so.) > > Yep, have a look at sample.secret.foo.bar.max.redirect in pmdas/sample. > >> Ok, I wasn't aware of this, would be great to know how to do that, the >> above example doesn't seem to work and the pmdahotproc.1 man isn't >> really that helpful. > > Yeah, docs need some love here I think. Anyone able to volunteer? > >>> Is there something missing from the hotproc.* metrics that this new >>> PMDA would provide Marko? I don't really follow the IO-stats comment >>> - there's no magic that pidstat can do that pmdaproc cannot AFAIK in >>> terms of querying the kernel for stats. >> >> The reason for using pidstat was mainly that it was quick to write the >> PMDA. As a bonus it also provided those read/s and write/s metrics which >> I didn't see readily available elsewhere. > > I think those will be the values behind the proc.io.* metrics, FWIW, but > have not checked closely (see e.g. /proc/self/io). > >>> From a quick look, the docs for the (recently-added-to-Linux) hotproc >>> metrics could be improved - Martins, could we find a way to report >>> help text for hotproc.control, hotproc.predicate, and hotproc.total? >>> And the pmdaproc(1) man page is a bit lacking in coverage of how to >>> use hotproc. Maybe a tutorial page would suit here too? >> >> Yes, that would be great. The use case I was thinking for the pidstat >> PMDA was that it would be suitable almost anyone to add certain >> processes to be monitored without necessarily knowing anything about >> PCP. For pidstat the required documentation to achieve this was more or >> less those two lines in the configuration file. > > +1 ... pmdaproc is on-by-default already, and its hotproc metrics share > those goals - I think we should focus on adding anything that's missing > that you need into that PMDA. Also, writing a pcp-pidstat and making > pcp-collectl mirror the behaviour you're seeking for OpenStack analysis > would also go a long way to making it user-friendly. > > cheers. > > -- > Nathan > > From tim.simpson@fieldnation.net Mon Apr 20 17:22:51 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 6C4247F4E for ; Mon, 20 Apr 2015 17:22:51 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 5BD888F804C for ; Mon, 20 Apr 2015 15:22:48 -0700 (PDT) X-ASG-Debug-ID: 1429568565-04cb6c1cc8309f90001-S8gJnT Received: from smtp64.iad3a.emailsrvr.com (smtp64.iad3a.emailsrvr.com [173.203.187.64]) by cuda.sgi.com with ESMTP id 0UCi9xJUhqhswXFi (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 20 Apr 2015 15:22:46 -0700 (PDT) X-Barracuda-Envelope-From: tim.simpson@fieldnation.net X-Barracuda-Apparent-Source-IP: 173.203.187.64 Received: from smtp9.relay.iad3a.emailsrvr.com (localhost.localdomain [127.0.0.1]) by smtp9.relay.iad3a.emailsrvr.com (SMTP Server) with ESMTP id 945E83801D3 for ; Mon, 20 Apr 2015 18:22:45 -0400 (EDT) Received: from app48.wa-webapps.iad3a (relay-webapps.rsapps.net [172.27.255.140]) by smtp9.relay.iad3a.emailsrvr.com (SMTP Server) with ESMTP id 7AF253803BA for ; Mon, 20 Apr 2015 18:22:45 -0400 (EDT) X-Sender-Id: tim.simpson@fieldnation.net Received: from app48.wa-webapps.iad3a (relay-webapps.rsapps.net [172.27.255.140]) by 0.0.0.0:25 (trex/5.4.2); Mon, 20 Apr 2015 22:22:45 GMT Received: from fieldnation.net (localhost.localdomain [127.0.0.1]) by app48.wa-webapps.iad3a (Postfix) with ESMTP id 6A77F38004A for ; Mon, 20 Apr 2015 18:22:45 -0400 (EDT) Received: by apps.rackspace.com (Authenticated sender: tim.simpson@fieldnation.net, from: tim.simpson@fieldnation.net) with HTTP; Mon, 20 Apr 2015 18:22:45 -0400 (EDT) Date: Mon, 20 Apr 2015 18:22:45 -0400 (EDT) Subject: =?utf-8?Q?Question=3F?= From: tim.simpson@fieldnation.net X-ASG-Orig-Subj: =?utf-8?Q?Question=3F?= To: pcp@oss.sgi.com MIME-Version: 1.0 Content-Type: multipart/alternative;boundary="----=_20150420182245000000_39098" Importance: Normal X-Priority: 3 (Normal) X-Type: html X-Auth-ID: tim.simpson@fieldnation.net Message-ID: <1429568565.434413192@apps.rackspace.com> X-Mailer: webmail/11.4.0-RC X-Barracuda-Connect: smtp64.iad3a.emailsrvr.com[173.203.187.64] X-Barracuda-Start-Time: 1429568565 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.20 X-Barracuda-Spam-Status: No, SCORE=0.20 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA038b, HTML_MESSAGE, NO_REAL_NAME X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18174 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 NO_REAL_NAME From: does not include a real name 0.00 HTML_MESSAGE BODY: HTML included in message 0.20 BSF_SC0_SA038b Custom Rule SA038b ------=_20150420182245000000_39098 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable =0ADimitri,=0A=0ACan I show you Field Nation? =0A=0AYou can access our mark= etplace of over 45,000 technical contractors tied directly to an amazing wo= rkflow management software system. I would like to see if we can demonstrat= e our service. =0A=0AThe following does a good job showing how we work: = =0A=0Ahttps://www.fieldnation.com/=0A=0AField Nation was ranked #43 on Inc.= 500 for growth from 2010-2013, #3 in Business Services. There is no charg= e to utilize our system. =0A=0AAre you the right contact or could you poin= t me in the right direction? =0A=0A=0AThanks for the help, =0A=0ATim=0A=0A = =0A=0A=0A Tim Simpson=0AAccount Executive=0A [ www.Fieldnation.com ]( http:= //www.fieldnation.com/ )=0ADirect Line: [ 952-223-1157 ]( tel:+19522231157 = )=0A Email: [ tim.simpson@fieldnation.net ]( mailto:tim.simpson@fieldnation= .net ) =0A=0A =0A=0AConnect. Do Business.=0A ------=_20150420182245000000_39098 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable

Dimitri,

=0A


Can I show you Field Nation?

You can access our mar= ketplace of over 45,000 technical contractors tied directly to an amazing w= orkflow management software system. I would like to see if we can demonstra= te our service.  

The following does a good job showing how= we work:

https://www.fieldnation.com/

Field Nation = was ranked #43 on Inc. 500 for growth from 2010-2013, #3 in Business Servic= es.  There is no charge to utilize our system.  

Are y= ou the right contact or could you point me in the right direction?

Thanks for the help,

Tim

=0A=0A

= =0A

=0A
=0A

= Tim Simpson<= /span>
Account Executive www.Fieldnati= on.com=0A

Direct Line: 952-223-1157
Email: tim.simpson@fieldnation.net

=0A
=0A
=0A
 
=0A
3D""
=0A
Connect. Do Business.
=0A
=0A
=0A

=  

=0A ------=_20150420182245000000_39098-- From nscott@redhat.com Mon Apr 20 20:37:09 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 333F77F4E for ; Mon, 20 Apr 2015 20:37:09 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id A73CFAC001 for ; Mon, 20 Apr 2015 18:37:05 -0700 (PDT) X-ASG-Debug-ID: 1429580222-04cbb056b234f530001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id SPGhGtYOM465gdAX (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 20 Apr 2015 18:37:03 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3L1awTa018153; Mon, 20 Apr 2015 21:36:58 -0400 Date: Mon, 20 Apr 2015 21:36:58 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Michele Baldessari Cc: pcp developers Message-ID: <880380200.3717668.1429580218242.JavaMail.zimbra@redhat.com> In-Reply-To: <20150420174712.GH18943@marquez.int.rhx> References: <20150420174712.GH18943@marquez.int.rhx> Subject: Re: [pcp] Bug/Issue tracker MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Bug/Issue tracker Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.116] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Bug/Issue tracker Thread-Index: 5l2aR/rzyL07wJwNv8aWOGOWvkJHkw== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1429580223 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18181 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Michele, ----- Original Message ----- > Hi all, > > we currently have issues/enhancements filed in three different places: > 1. SGI Bugzilla (92 bugs open atm) It'd be interesting to see a histogram of users-who-opened-upstream-bzs - it'll be highly skewed to just two/three people I think (all developers). > 2. Github Issue Tracker (9 issues open atm) Versus this histogram, which will be the opposite I expect. > 3. Red Hat Bugzilla (mainly for issues with packaging in RHEL/Fedora or > any Red Hat specific process - I am excluding this one from the > proposal below) 4. Debian bug tracker. 5. Ubuntu bug tracker. 6. ... etc. For this discussion, I think including the distro trackers is going to be a distraction - so, I recommend we ignore those here. On 1 & 2, I think the user base has voted with their feet - I don't recall the last time someone other than a regular contributor opened an upstream bugzilla bug for pcp. And even there, most pcp developers will just fix the bugs they see as they encounter them (or speak directly to someone who will & hand the problem over for immediate resolution), rather than opening a bug. OTOH, there's a steady trickle of bugs coming in from actual pcp users via github. And this is despite us listing only bugzilla on the pcp website for years, and only having the github pcp mirror for a short time. We are going to have to embrace it in order to work with people using pcp IMO. And I tend to agree that there's no value to having two trackers if we can have just one. > - SGI Bugzilla > Pro: > most bugs are already there > Contra: > cumbersome to use and to file new issues > requires an account which users are unlikely to have There's also no proactive administration of bugzilla on oss (we tend to have to do it ourselves, which is not a good use of our time) - whereas the github service is obviously well funded, well maintained and it is highly available. > I think that to make things easier for users it makes more sense to > switch to github fully for issue tracking purposes. If there is rough > consensus on this, I'll work on some test scripts to migrate all bugs > w/comments and attachments. If there is vast disagreement we can also > move everything to SGI's bugzilla instance. I don't see any situation where the latter makes long-term sense. We also have a series of pcp sub-projects on github now for which there is no way to open bugs in bugzilla. It'd be great to be using an open source tracker, but its not practical in this situation IMO. At best its going to mean continuing on with the duplicated systems, just for developers (and just those two/three, all of whom are also using the github issue tracker already). My vote is for a switch to github & retiring the bugzilla use. cheers. -- Nathan From nscott@redhat.com Mon Apr 20 23:09:49 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 51E377F4E for ; Mon, 20 Apr 2015 23:09:49 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 230BE8F8052 for ; Mon, 20 Apr 2015 21:09:45 -0700 (PDT) X-ASG-Debug-ID: 1429589383-04bdf063213489b0001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id TQrMa1q6jXkoFkkr (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 20 Apr 2015 21:09:44 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3L49fwJ022111; Tue, 21 Apr 2015 00:09:41 -0400 Date: Tue, 21 Apr 2015 00:09:40 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell , Lukas Berk Cc: pcp developers Message-ID: <852862416.3748569.1429589380945.JavaMail.zimbra@redhat.com> In-Reply-To: <2142101767.3718573.1429580600364.JavaMail.zimbra@redhat.com> Subject: [patch] speed pmie startup MIME-Version: 1.0 X-ASG-Orig-Subj: [patch] speed pmie startup Content-Type: multipart/mixed; boundary="----=_Part_3748567_726811235.1429589380942" X-Originating-IP: [10.64.50.116] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: speed pmie startup Thread-Index: jZmdtbk8GPFF3zl/F+vRTYrwfuAS4Q== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1429589384 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18185 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ------=_Part_3748567_726811235.1429589380942 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Hi Ken, Lukas and I were looking into an intermittent qa/312 failure he is observing. If the sleep in that test is increased (to 3) its then back to always passing (312 is a very simple pmie test). But, seemed odd that pmie takes so long to startup and dump out the result from that initial sample. ltrace pointed toward some calls to nanosleep and following that led to unexpected time differences for scheduled tasks vs the initial notion of "now". It turned out those delays were due to some places where we do 'now = now + 1sec' - see attached patch. Do you know the reason behind adding in that one second difference there? (and is it safe to remove, or reduce, as the patch does?) thanks! -- Nathan ------=_Part_3748567_726811235.1429589380942 Content-Type: text/x-patch; name=slow-pmie.patch Content-Disposition: attachment; filename=slow-pmie.patch Content-Transfer-Encoding: base64 ZGlmZiAtLWdpdCBhL3FhLzMxMiBiL3FhLzMxMgppbmRleCA2ZjAzNWJjLi5mM2UwZDc1IDEwMDc1 NQotLS0gYS9xYS8zMTIKKysrIGIvcWEvMzEyCkBAIC0yNSw3ICsyNSw3IEBAIHRyYXAgInJtIC1m ICR0bXAuKjsgZXhpdCBcJHN0YXR1cyIgMCAxIDIgMyAxNQogZWNobyAnbG9hZCA9IHNhbXBsZS5s b2FkOycgfCBwbWllIC12IC10IDFob3VyID4kdG1wLm91dCAyPiR0bXAuZXJyICYKIHBtaWVfcGlk PSQhCiAKLXNsZWVwIDIKK3Btc2xlZXAgMC41CiAkc2lnbmFsIC1zIFRFUk0gJHBtaWVfcGlkCiB3 YWl0CiAKZGlmZiAtLWdpdCBhL3FhLzUxOCBiL3FhLzUxOAppbmRleCBiMTZmMTA2Li4yYWYzOTA3 IDEwMDc1NQotLS0gYS9xYS81MTgKKysrIGIvcWEvNTE4CkBAIC0zOSw3ICszOSw3IEBAIHNsZWVw IDIKICMgNTE4Lm91dCBleHBlY3RzIGV4YWN0bHkgdGhyZWUgZXZhbHVhdGlvbiByb3VuZHMgdG8g YmUgY29tcGxldGUgYnkgdGhlCiAjIHRpbWUgdGhlIGZvbGxvd2luZyBvcGVyYXRpb24gaXMgaW52 b2tlZC4gIElmIHN1ZG8vcG1pZSBpcyB0b28gc2xvdywKICMgaXQnbGwgbG9zZSB0aGUgcmFjZSAo YWN0aW9uczw1KS4gIElmIHRoaXMgdGhyZWFkIGlzIHRvbyBzbG93LCBwbWllCi0jIHdpbGwgZ28g YWhlYWQgKGFjdGlvbnM+NSkuICBTbyB3ZSB0b2xlcmF0ZSB2YWx1ZXMgaW4gdGhlIHJhbmdlIDQs NSw2CisjIHdpbGwgZ28gYWhlYWQgKGFjdGlvbnM+NSkuICBTbyB3ZSB0b2xlcmF0ZSB2YWx1ZXMg aW4gdGhlIHJhbmdlIDQsNSw2LTkKICMgZm9yIHRoZSB0cnVlLCBmYWxzZSBhbmQgYWN0aW9uIGNv dW50cywgYnV0IHRoZSBjb3VudHMgZm9yIGVhY2ggbXVzdAogIyBiZSBlcXVhbC4KIApAQCAtNzks OSArNzksOSBAQCBzLykkLyApLwogJyRkZWJ1ZycgPT0gInRydWUiCQl7IHByaW50ICJzdGF0ZT0i IHN0YXRlICIgd2FudD0iIHdhbnQgIjogIiAkMCB9CiBzdGF0ZT09MSAmJiAvJ2BlY2hvICR0bXAu cG1pZSB8IHNlZCAtZSBzQC9AXFxcXFxcXFwvQGdgJyBcKDIgcnVsZVwpLwl7IHByaW50OyB3YW50 ID0gMTsgbmV4dCB9CiBzdGF0ZT09MSAmJiAvIFwoYWN0aW9ucz0vCXsgaWYgKCQzID09ICQ1ICYm ICQ1ID09ICQ5KSB7Ci0JCQkJICAgICAgaWYgKCQzID49IDQgJiYgJDMgPD0gNikgJDMgPSAiT0si Ci0JCQkJICAgICAgaWYgKCQ1ID49IDQgJiYgJDUgPD0gNikgJDUgPSAiT0siCi0JCQkJICAgICAg aWYgKCQ5ID49IDQgJiYgJDkgPD0gNikgJDkgPSAiT0siCisJCQkJICAgICAgaWYgKCQzID49IDQg JiYgJDMgPD0gOSkgJDMgPSAiT0siCisJCQkJICAgICAgaWYgKCQ1ID49IDQgJiYgJDUgPD0gOSkg JDUgPSAiT0siCisJCQkJICAgICAgaWYgKCQ5ID49IDQgJiYgJDkgPD0gOSkgJDkgPSAiT0siCiAJ CQkJICB9CiAJCQkJfQogc3RhdGU9PTEgJiYgLyBydWxlXCkvCQl7IHdhbnQgPSAwIH0KZGlmZiAt LWdpdCBhL3NyYy9wbWllL3NyYy9wbWllLmMgYi9zcmMvcG1pZS9zcmMvcG1pZS5jCmluZGV4IDRi MWQwZGYuLjY1NjA3ODggMTAwNjQ0Ci0tLSBhL3NyYy9wbWllL3NyYy9wbWllLmMKKysrIGIvc3Jj L3BtaWUvc3JjL3BtaWUuYwpAQCAtNzA3LDcgKzcwNyw3IEBAIGdldGFyZ3MoaW50IGFyZ2MsIGNo YXIgKmFyZ3ZbXSkKICAgICB9CiAKICAgICAvKiBpbml0aWFsaXplIHRpbWUgKi8KLSAgICBub3cg PSBhcmNoaXZlcyA/IGZpcnN0IDogZ2V0UmVhbCgpICsgMS4wOworICAgIG5vdyA9IGFyY2hpdmVz ID8gZmlyc3QgOiBnZXRSZWFsKCkgKyAwLjAwMDAwMDAwMTsKICAgICB6b25lSW5pdCgpOwogICAg IHJlZmxlY3RUaW1lKGRmbHREZWx0YSk7CiAKQEAgLTc3NSw3ICs3NzUsNyBAQCBnZXRhcmdzKGlu dCBhcmdjLCBjaGFyICphcmd2W10pCiAKICAgICAvKiByZWFsbHkgcGFyc2UgdGltZSB3aW5kb3cg Ki8KICAgICBpZiAoIWFyY2hpdmVzKSB7Ci0Jbm93ID0gZ2V0UmVhbCgpICsgMS4wOworCW5vdyA9 IGdldFJlYWwoKSArIDAuMDAwMDAwMDAxOwogCXJlZmxlY3RUaW1lKGRmbHREZWx0YSk7CiAgICAg fQogICAgIF9fcG10aW1ldmFsRnJvbVJlYWwobm93LCAmdHYxKTsK ------=_Part_3748567_726811235.1429589380942-- From nscott@redhat.com Tue Apr 21 01:29:22 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id CCCFE7F51 for ; Tue, 21 Apr 2015 01:29:22 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id AC9898F804C for ; Mon, 20 Apr 2015 23:29:19 -0700 (PDT) X-ASG-Debug-ID: 1429597756-04cbb056b2356170001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id vvWJSwNIyDKFXRmH (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 20 Apr 2015 23:29:17 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3L6TC3b041636; Tue, 21 Apr 2015 02:29:12 -0400 Date: Tue, 21 Apr 2015 02:29:12 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Mark Goodwin , Ken McDonell , Lukas Berk Cc: pcp developers Message-ID: <1961915504.3837841.1429597752375.JavaMail.zimbra@redhat.com> In-Reply-To: <974112168.3837557.1429597638955.JavaMail.zimbra@redhat.com> Subject: pcp updates: qa, pmie, pmiostat MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: qa, pmie, pmiostat Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.116] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: qa, pmie, pmiostat Thread-Index: 721TJuFlBDEBBMn9kF4bN3yaVPGSMQ== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1429597756 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18190 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi guys, Just pushing that pmie change to my private tree for now - if you need it Lukas, its just a git-pull away. Mark, could you also take a look at the pmiostat change there & pull if all good? thanks! Changes committed to git://git.pcp.io/nathans/pcp.git master qa/312 | 2 +- qa/518 | 8 ++++---- src/pmdas/linux_proc/help_text.h | 2 +- src/pmie/src/pmie.c | 4 ++-- src/pmiostat/pmiostat.py | 15 ++++++++------- 5 files changed, 16 insertions(+), 15 deletions(-) commit d21bb6c017696233d736d0c518eeeb742eb4d36f Author: Nathan Scott Date: Tue Apr 21 16:24:40 2015 +1000 pmie: remove unnecessary 2 second delay at live startup Noticed that pmie was taking a while to start up and dump out the result from initial sample for qa312. ltrace pointed toward some 1 second calls to nanosleep, and following that led to unexpected time deltas for scheduled tasks vs the initial notion of "now". Turned out those delays were due to some places where we calcualte 'sched_time = now + 1sec' (or similar) - seems to be unnecessary, from QA testing so far. commit 8048bf8cb660583cf5e9f95682b214930f0ababa Author: Nathan Scott Date: Tue Apr 21 16:21:57 2015 +1000 pmiostat: usage message cleanup Noticed pmiostat --help was printing "None" right at the end, which seemed odd. Turned out to be a not-quite-right API call in the usage exception handler. While there, found the 'x' option not being presented via the getopt API call (harmless in practice), a double-colon on "General Options::", and some whitespace/alignment not quite in the right spot - so, all trivial cleanups here. commit e0e0a7a879fff29414867e65c9a18096b3811cf2 Author: Nathan Scott Date: Tue Apr 21 16:21:15 2015 +1000 qa: fix short-help-text length test on proc.psinfo.environ From mgoodwin@redhat.com Tue Apr 21 03:27:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id A27C27F54 for ; Tue, 21 Apr 2015 03:27:18 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 91497304032 for ; Tue, 21 Apr 2015 01:27:15 -0700 (PDT) X-ASG-Debug-ID: 1429604834-04cb6c1cc9316770001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id pAQSvwAG8RuJRwPr (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 21 Apr 2015 01:27:14 -0700 (PDT) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (Postfix) with ESMTPS id F347E5A for ; Tue, 21 Apr 2015 08:27:13 +0000 (UTC) Received: from [10.64.50.174] (vpn1-50-174.bne.redhat.com [10.64.50.174]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3L8RCwM013086; Tue, 21 Apr 2015 04:27:12 -0400 Message-ID: <553609DF.7050908@redhat.com> Date: Tue, 21 Apr 2015 18:27:11 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp developers Subject: Re: pcp updates: qa, pmie, pmiostat References: <1961915504.3837841.1429597752375.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: pcp updates: qa, pmie, pmiostat In-Reply-To: <1961915504.3837841.1429597752375.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429604834 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 04/21/2015 04:29 PM, Nathan Scott wrote: > ... Mark, could you also take > a look at the pmiostat change there & pull if all good? > looks good (and already in master). An additional improvement might be if pmiostat -x dm -x t and pmiostat -x dm,t were equivalent, but that's just a nit really. -- Mark From myllynen@redhat.com Tue Apr 21 06:16:26 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 8C7847F51 for ; Tue, 21 Apr 2015 06:16:26 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 6D84B304032 for ; Tue, 21 Apr 2015 04:16:23 -0700 (PDT) X-ASG-Debug-ID: 1429614982-04cb6c1cc831be00001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id BQ9wN9AgPFsPjZBp (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 21 Apr 2015 04:16:22 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3LBGLlI005794 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 21 Apr 2015 07:16:21 -0400 Received: from mmyllyne.csb (vpn1-4-147.ams2.redhat.com [10.36.4.147]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3LBGC73012298 for ; Tue, 21 Apr 2015 07:16:21 -0400 Message-ID: <5536317C.5000600@redhat.com> Date: Tue, 21 Apr 2015 14:16:12 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Accessing instance specific metrics References: <5534C680.2020709@redhat.com> X-ASG-Orig-Subj: Accessing instance specific metrics In-Reply-To: <5534C680.2020709@redhat.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429614982 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, On 2015-04-20 12:27, Marko Myllynen wrote: > > One mostly cosmetic thing I noticed with Perl PCP::PMDA is that while > proc.psinfo maps instance numbers to PIDs (e.g. a process with PID > 21641 is listed as 'inst [21641 or "021641 zsh"]'), with PCP::PMDA > instance domain numbers are starting from 0 and can't be affected. > Not sure does that actually matter in practice at all but if > there's a trick to follow the proc.psinfo convention I could use it. actually this might not be entirely cosmetic after all. I'm using pidstat.threads as an example below but this looks to be generally applicable usability issue as well. When listing a metric from an archive with something like "pmval -t 1m -f 3 -S @13:20 -T @13:30 -a 20150421.11.06 pidstat.threads" I see all the instances reported, for example there could be "11173 java", "11188 java", and "13211 java" in the archive. But to list only one of them seems tricky, one first needs to guess or loop over the archive to find the instance ID (an integer) for the instance as it is not the PID and -i "11173 java" won't work. In an archive I tested with, the instance IDs were 974, 1021, and 1153 (as I've had pidstat PMDA running here for several days already) so it's something that one needs to script around. So it's a usability issue that can be dealt with on the command line but if there would be a Web UI front-end in play I'm not sure how to guess the instance IDs in that case. Perhaps ideally with PCP::PMDA the instance ID could be set or -i would accept the form "11173 java" (if unique). Do you see other alternatives or should I perhaps file an RFE? Thanks, -- Marko Myllynen From myllynen@redhat.com Tue Apr 21 07:44:02 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 25DD97F54 for ; Tue, 21 Apr 2015 07:44:02 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 9ABB3AC003 for ; Tue, 21 Apr 2015 05:43:58 -0700 (PDT) X-ASG-Debug-ID: 1429620233-04cbb056b13607b0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id jFRUBBgJFGkEGAcG (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 21 Apr 2015 05:43:54 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (Postfix) with ESMTPS id 826C38E6E8; Tue, 21 Apr 2015 12:43:53 +0000 (UTC) Received: from mmyllyne.csb (vpn1-4-226.ams2.redhat.com [10.36.4.226]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3LChpYt027188; Tue, 21 Apr 2015 08:43:52 -0400 Message-ID: <55364606.1000503@redhat.com> Date: Tue, 21 Apr 2015 15:43:50 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Nathan Scott CC: Martins Innus , pcp developers Subject: Re: [pcp] [PATCH] PCP pidstat PMDA References: <5534C680.2020709@redhat.com> <493537984.3276058.1429528962326.JavaMail.zimbra@redhat.com> <5534EBA8.4030509@redhat.com> <1644393599.3651017.1429563442835.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] [PATCH] PCP pidstat PMDA In-Reply-To: <1644393599.3651017.1429563442835.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429620234 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, On 2015-04-20 23:57, Nathan Scott wrote: >> On 2015-04-20 14:22, Nathan Scott wrote: >> >> Btw, a general question, is there a way to access other metrics from >> PMDA? (Think of writing a PMDA which would provide custom metrics under >> "foo." but some special metrics would be calculated with help of some >> external metric like hinv or so.) > > Yep, have a look at sample.secret.foo.bar.max.redirect in pmdas/sample. hmm, so it is possible to provide a redirected metric from another domain in C but is there a way to do that in Perl or Python? And is it possible to read a metric from another domain to be used to calculate or construct a new metrics in the current domain, not just redirect? >>> Is there something missing from the hotproc.* metrics that this new >>> PMDA would provide Marko? I don't really follow the IO-stats comment >>> - there's no magic that pidstat can do that pmdaproc cannot AFAIK in >>> terms of querying the kernel for stats. >> >> The reason for using pidstat was mainly that it was quick to write the >> PMDA. As a bonus it also provided those read/s and write/s metrics which >> I didn't see readily available elsewhere. > > I think those will be the values behind the proc.io.* metrics, FWIW, but > have not checked closely (see e.g. /proc/self/io). Yes, the values are basically proc.io.{read,write}_bytes / process lifetime-in-seconds. So it's a calculated / pre-processed value which quickly gives an idea of a process IO activity at a time. (See below for more on this.) FWIW, the upstream man page for everything under proc is nowadays well-maintained: http://man7.org/linux/man-pages/man5/proc.5.html. >> Yes, that would be great. The use case I was thinking for the pidstat >> PMDA was that it would be suitable almost anyone to add certain >> processes to be monitored without necessarily knowing anything about >> PCP. For pidstat the required documentation to achieve this was more or >> less those two lines in the configuration file. > > +1 ... pmdaproc is on-by-default already, and its hotproc metrics share > those goals - I think we should focus on adding anything that's missing > that you need into that PMDA. Agreed, and wrt documentation it should not be the case that it's easier to write a new PMDA then to decrypt an existing one :-) Wrt usability in general, the above mentioned metrics read/s and write/s can of course be calculated based on the process lifetime and read/write totals so far. But if using something like pmval to quickly check what the process is up to at the moment, you don't get that sort of idea instantly. This is of course not specific to monitoring processes but applies in general, what's the best practice to follow a metric which actually is a combination or calculation of two or more metrics being collected? > Also, writing a pcp-pidstat I don't think this is really needed as long as something similar is easily available either from hotproc or pidstat PMDA. Thanks, -- Marko Myllynen From minnus@buffalo.edu Tue Apr 21 08:10:19 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id D1F8B7F54 for ; Tue, 21 Apr 2015 08:10:19 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id C18D48F8068 for ; Tue, 21 Apr 2015 06:10:16 -0700 (PDT) X-ASG-Debug-ID: 1429621814-04cb6c1cc831efe0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id Dr2J1Itdok0ijb8f for ; Tue, 21 Apr 2015 06:10:14 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmailD.acsu.buffalo.edu (localmaild.acsu.buffalo.edu [128.205.5.208]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 850EE193 for ; Tue, 21 Apr 2015 09:10:14 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 7D26E130B4 for ; Tue, 21 Apr 2015 09:10:14 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailD.acsu.buffalo.edu (Postfix) with ESMTP id 8496913DA3 for ; Tue, 21 Apr 2015 09:10:13 -0400 (EDT) Received: from smtp.buffalo.edu (smtp4.acsu.buffalo.edu [128.205.5.229]) by localmailD.acsu.buffalo.edu (Prefixe) with ESMTP id 6671913D4C for ; Tue, 21 Apr 2015 09:10:13 -0400 (EDT) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 5D8D2506C4 for ; Tue, 21 Apr 2015 09:10:13 -0400 (EDT) Message-ID: <55364C35.50007@buffalo.edu> Date: Tue, 21 Apr 2015 09:10:13 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: pcp developers Subject: .NeedInstall patch Content-Type: multipart/alternative; boundary="------------090401040106030303080403" X-ASG-Orig-Subj: .NeedInstall patch X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1429621814 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18199 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 HTML_MESSAGE BODY: HTML included in message This is a multi-part message in MIME format. --------------090401040106030303080403 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Hi, I've been trying to debug a strange issue that the following patch seems to fix: https://github.com/ubccr/pcp/tree/martins_working The pmda setup process doesn't cd back to PCP_PMDA_DIR after processing a .NeedInstall file. This might not be the right solution though, because currently, at least with my testing (Centos 6.5), if you put a .NeedInstall file into multiple pmda directories, the first 2 get installed and not the rest. I would have thought only one would get installed with the current script. So not sure if there is something else going on here. With this patch, all get installed. Martins commit 4588745c412196c1bd1b80e36afcee8276d6a658 Author: Martins Innus Date: Tue Apr 21 12:59:24 2015 +0000 Allow more than one .NeedInstall to occur at a time Chnage back to PCP_PMDAS_DIR after installing a pmda src/pmcd/rc_pmcd | 1 + 1 files changed, 1 insertions(+), 0 deletions(-) diff --git a/src/pmcd/rc_pmcd b/src/pmcd/rc_pmcd index 6037534..edfdd2e 100644 --- a/src/pmcd/rc_pmcd +++ b/src/pmcd/rc_pmcd @@ -210,6 +210,7 @@ _pmda_enact() $PCP_BINADM_DIR/pmpost "PMDA setup: automated $action FAILED (exit=$?): $pmda" mv .Need$action.sav .Need$action fi + cd "$PCP_PMDAS_DIR" fi done # move back into PMDA dir as expected by _pmda_setup() --------------090401040106030303080403 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit Hi,
    I've been trying to debug a strange issue that the following patch seems to fix:

https://github.com/ubccr/pcp/tree/martins_working


The pmda setup process doesn't cd back to PCP_PMDA_DIR after processing a .NeedInstall file.  This might not be the right solution though, because currently, at least with my testing (Centos 6.5), if you put a .NeedInstall file into multiple pmda directories, the first 2 get installed and not the rest.  I would have thought only one would get installed with the current script. So not sure if there is something else going on here.

With this patch, all get installed.

Martins

commit 4588745c412196c1bd1b80e36afcee8276d6a658
Author: Martins Innus <minnus@buffalo.edu>
Date:   Tue Apr 21 12:59:24 2015 +0000

    Allow more than one .NeedInstall to occur at a time
   
    Chnage back to PCP_PMDAS_DIR after installing a pmda

 src/pmcd/rc_pmcd |    1 +
 1 files changed, 1 insertions(+), 0 deletions(-)



diff --git a/src/pmcd/rc_pmcd b/src/pmcd/rc_pmcd
index 6037534..edfdd2e 100644
--- a/src/pmcd/rc_pmcd
+++ b/src/pmcd/rc_pmcd
@@ -210,6 +210,7 @@ _pmda_enact()
 		$PCP_BINADM_DIR/pmpost "PMDA setup: automated $action FAILED (exit=$?): $pmda"
 		mv .Need$action.sav .Need$action
 	    fi
+	    cd "$PCP_PMDAS_DIR"
 	fi
     done
     # move back into PMDA dir as expected by _pmda_setup()

--------------090401040106030303080403-- From fche@redhat.com Tue Apr 21 09:14:48 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id E9F177F5F for ; Tue, 21 Apr 2015 09:14:48 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id D9DAE8F8054 for ; Tue, 21 Apr 2015 07:14:45 -0700 (PDT) X-ASG-Debug-ID: 1429625684-04cbb056b1363230001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id TQ8JHR6Ir7Xmvg53 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 21 Apr 2015 07:14:44 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3LEEdQp023466 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Tue, 21 Apr 2015 10:14:39 -0400 Received: from fche.csb (vpn-225-93.phx2.redhat.com [10.3.225.93]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3LEEdra008929; Tue, 21 Apr 2015 10:14:39 -0400 Received: by fche.csb (Postfix, from userid 2569) id B11725853E; Tue, 21 Apr 2015 10:14:35 -0400 (EDT) To: Nathan Scott Cc: Michele Baldessari , pcp@oss.sgi.com Subject: Re: Bug/Issue tracker References: <20150420174712.GH18943@marquez.int.rhx> <880380200.3717668.1429580218242.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: Bug/Issue tracker From: fche@redhat.com (Frank Ch. Eigler) Date: Tue, 21 Apr 2015 10:14:35 -0400 In-Reply-To: <880380200.3717668.1429580218242.JavaMail.zimbra@redhat.com> (Nathan Scott's message of "Mon, 20 Apr 2015 21:36:58 -0400 (EDT)") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429625684 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 nathans wrote: > [...] We also have a series of pcp sub-projects on github now for > which there is no way to open bugs in bugzilla. Bugzilla's capabilities for categorizing bugs into subcomponents is far beyond github's. http://oss.sgi.com/bugzilla/editcomponents.cgi?product=pcp > [...] > My vote is for a switch to github & retiring the bugzilla use. What is your intention with respect to all the bugs already filed in the latter? - FChE From michele@acksyn.org Tue Apr 21 09:28:51 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=T_DKIM_INVALID autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 7C13E7F5F for ; Tue, 21 Apr 2015 09:28:51 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 1A3D2AC002 for ; Tue, 21 Apr 2015 07:28:47 -0700 (PDT) X-ASG-Debug-ID: 1429626525-04cb6c1cc9321a20001-S8gJnT Received: from palahniuk.acksyn.org (palahniuk.acksyn.org [5.9.7.26]) by cuda.sgi.com with ESMTP id kFE4IDFODu5qRDDe for ; Tue, 21 Apr 2015 07:28:46 -0700 (PDT) X-Barracuda-Envelope-From: michele@acksyn.org X-Barracuda-Apparent-Source-IP: 5.9.7.26 Received: from localhost (localhost [127.0.0.1]) by palahniuk.acksyn.org (Postfix) with ESMTP id 81D2529D10; Tue, 21 Apr 2015 10:28:45 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=acksyn.org; h= user-agent:in-reply-to:content-disposition:content-type :content-type:mime-version:references:message-id:subject:subject :from:from:date:date:received:received; s=2010; t=1429626525; bh=EI2mFovIM3Q8lKrsP71LErPqJWj2lkN4/Ods89WgXFE=; b=AnRC9LYWoyXZ hJtAjNq7ttGH+G38gkG29VHuBVYabh+EG91TIUZaTtBYP3SRZlOn+hlQiYeSVwL7 tYHX/N95tTINOJRZvyTESbOey9JHkMPdSEW+wZCsYQPaDqpNsqkzwcbump72vDE9 0QsQtsoqMjuCF052b+VkrO+7aNSh/WI= Received: from palahniuk.acksyn.org ([127.0.0.1]) by localhost (mail.acksyn.org [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id STn7uJJndSCc; Tue, 21 Apr 2015 10:28:45 -0400 (EDT) Received: from localhost (host89-178-dynamic.6-79-r.retail.telecomitalia.it [79.6.178.89]) by palahniuk.acksyn.org (Postfix) with ESMTPSA id 8244920095; Tue, 21 Apr 2015 10:28:44 -0400 (EDT) Date: Tue, 21 Apr 2015 16:28:43 +0200 From: Michele Baldessari To: "Frank Ch. Eigler" Cc: Nathan Scott , pcp@oss.sgi.com Subject: Re: Bug/Issue tracker Message-ID: <20150421142843.GK18943@marquez.int.rhx> X-ASG-Orig-Subj: Re: Bug/Issue tracker References: <20150420174712.GH18943@marquez.int.rhx> <880380200.3717668.1429580218242.JavaMail.zimbra@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23.1-rc1 (2014-03-12) X-Barracuda-Connect: palahniuk.acksyn.org[5.9.7.26] X-Barracuda-Start-Time: 1429626525 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, DKIM_SIGNED, DKIM_VERIFIED X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18201 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature Heya Frank, On Tue, Apr 21, 2015 at 10:14:35AM -0400, Frank Ch. Eigler wrote: > > [...] > > My vote is for a switch to github & retiring the bugzilla use. > > What is your intention with respect to all the bugs already filed in > the latter? I would say that without a full migration of the data from BZ -> github this would be a non-starter. cheers, Michele -- Michele Baldessari C2A5 9DA3 9961 4FFB E01B D0BC DDD4 DCCB 7515 5C6D From minnus@buffalo.edu Tue Apr 21 12:01:57 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 4A4E77F5A for ; Tue, 21 Apr 2015 12:01:57 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 399D9304066 for ; Tue, 21 Apr 2015 10:01:54 -0700 (PDT) X-ASG-Debug-ID: 1429635712-04cbb056b3368030001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id assOkCWmcKcXnbsE for ; Tue, 21 Apr 2015 10:01:52 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmailD.acsu.buffalo.edu (localmaild.acsu.buffalo.edu [128.205.5.208]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 1FC701AD; Tue, 21 Apr 2015 13:01:52 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 16ECCFA89; Tue, 21 Apr 2015 13:01:52 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailD.acsu.buffalo.edu (Postfix) with ESMTP id 487AAFA7F; Tue, 21 Apr 2015 13:01:51 -0400 (EDT) Received: from smtp.buffalo.edu (smtp1.acsu.buffalo.edu [128.205.5.253]) by localmailD.acsu.buffalo.edu (Prefixe) with ESMTP id 36656FA7E; Tue, 21 Apr 2015 13:01:51 -0400 (EDT) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 2BECF2867; Tue, 21 Apr 2015 13:01:51 -0400 (EDT) Message-ID: <5536827C.20607@buffalo.edu> Date: Tue, 21 Apr 2015 13:01:48 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: myllynen@redhat.com, Nathan Scott CC: pcp developers Subject: Re: [pcp] [PATCH] PCP pidstat PMDA References: <5534C680.2020709@redhat.com> <493537984.3276058.1429528962326.JavaMail.zimbra@redhat.com> <5534EBA8.4030509@redhat.com> X-ASG-Orig-Subj: Re: [pcp] [PATCH] PCP pidstat PMDA In-Reply-To: <5534EBA8.4030509@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1429635712 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18207 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Marko, On 4/20/15 8:06 AM, Marko Myllynen wrote: > >> Those new hotproc.* metrics do allow both a configuration file-based >> mechanism (like this new PMDA) & also support a very dynamic pmstore >> update model too, like: >> >> # pmstore hotproc.control.config 'fname = "java"' >> >> to set the process filtering on-the-fly (the above syntax may not be >> 100% correct, thats just from memory - it'll be close though). > Ok, I wasn't aware of this, would be great to know how to do that, the > above example doesn't seem to work and the pmdahotproc.1 man isn't > really that helpful. > I had an off by one error for the fname parameter in the pmda which should be fixed by: diff --git a/src/pmdas/linux_proc/proc_pid.c b/src/pmdas/linux_proc/proc_pid.c index 3cbeb17..6ea6c79 100644 --- a/src/pmdas/linux_proc/proc_pid.c +++ b/src/pmdas/linux_proc/proc_pid.c @@ -642,7 +642,7 @@ hotproc_eval_procs(void) strncpy(vars.fname, cmd, sizeof(vars.fname)); if (len < sizeof(vars.fname)) - vars.fname[len] = '\0'; + vars.fname[len-1] = '\0'; vars.fname[sizeof(vars.fname) - 1] = '\0'; } So you could do something similar to this: [vagrant@centos65 linux_proc]$ sudo pmstore hotproc.control.config 'fname == "mingetty"' ...update info displayed..... [vagrant@centos65 linux_proc]$ pminfo -f hotproc.id.uid hotproc.id.uid inst [1134 or "001134 /sbin/mingetty /dev/tty1"] value 0 inst [1136 or "001136 /sbin/mingetty /dev/tty2"] value 0 inst [1138 or "001138 /sbin/mingetty /dev/tty3"] value 0 inst [1141 or "001141 /sbin/mingetty /dev/tty4"] value 0 inst [1147 or "001147 /sbin/mingetty /dev/tty5"] value 0 inst [1149 or "001149 /sbin/mingetty /dev/tty6"] value 0 As with proc in general, the amount of information returned will depend on your privilege. All metrics that are available for proc should be there for hotproc. I will work on beefing up the docs. In general, I just took what I could find from the old implementation, but it does need some additions. Martins From myllynen@redhat.com Tue Apr 21 14:17:42 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 515297F37 for ; Tue, 21 Apr 2015 14:17:42 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id EE4BFAC003 for ; Tue, 21 Apr 2015 12:17:38 -0700 (PDT) X-ASG-Debug-ID: 1429643854-04bdf06323365480001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id UVOnZrbb9KFZLpNr (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 21 Apr 2015 12:17:34 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3LJHVFI019923 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Tue, 21 Apr 2015 15:17:32 -0400 Received: from localhost.localdomain (vpn1-4-187.ams2.redhat.com [10.36.4.187]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3LJHRoH012793; Tue, 21 Apr 2015 15:17:30 -0400 Message-ID: <5536A247.4080602@redhat.com> Date: Tue, 21 Apr 2015 22:17:27 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Martins Innus , Nathan Scott CC: pcp developers Subject: Re: [pcp] [PATCH] PCP pidstat PMDA References: <5534C680.2020709@redhat.com> <493537984.3276058.1429528962326.JavaMail.zimbra@redhat.com> <5534EBA8.4030509@redhat.com> <5536827C.20607@buffalo.edu> X-ASG-Orig-Subj: Re: [pcp] [PATCH] PCP pidstat PMDA In-Reply-To: <5536827C.20607@buffalo.edu> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429643854 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi Martins, On 2015-04-21 20:01, Martins Innus wrote: > On 4/20/15 8:06 AM, Marko Myllynen wrote: >> >>> Those new hotproc.* metrics do allow both a configuration file-based >>> mechanism (like this new PMDA) & also support a very dynamic pmstore >>> update model too, like: >>> >>> # pmstore hotproc.control.config 'fname = "java"' >>> >>> to set the process filtering on-the-fly (the above syntax may not be >>> 100% correct, thats just from memory - it'll be close though). >> Ok, I wasn't aware of this, would be great to know how to do that, the >> above example doesn't seem to work and the pmdahotproc.1 man isn't >> really that helpful. >> > I had an off by one error for the fname parameter in the pmda which > should be fixed by: > > - vars.fname[len] = '\0'; > + vars.fname[len-1] = '\0'; > > So you could do something similar to this: > > [vagrant@centos65 linux_proc]$ sudo pmstore hotproc.control.config > 'fname == "mingetty"' thanks for checking, with the fix in place this works perfectly! > As with proc in general, the amount of information returned will depend > on your privilege. All metrics that are available for proc should be > there for hotproc. I will work on beefing up the docs. In general, I > just took what I could find from the old implementation, but it does > need some additions. Sure, thanks again. Cheers, -- Marko Myllynen From minnus@buffalo.edu Tue Apr 21 14:47:03 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 358157F37 for ; Tue, 21 Apr 2015 14:47:03 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 1501D8F8054 for ; Tue, 21 Apr 2015 12:47:02 -0700 (PDT) X-ASG-Debug-ID: 1429645621-04bdf06321366560001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id 3wBTcNwZzouONcOQ for ; Tue, 21 Apr 2015 12:47:01 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmaile.acsu.buffalo.edu (localmaile.acsu.buffalo.edu [128.205.4.3]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id EE4EF460 for ; Tue, 21 Apr 2015 15:47:00 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id DF9B2160070 for ; Tue, 21 Apr 2015 15:47:00 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localmaile.acsu.buffalo.edu (Postfix) with ESMTP id CC762160094 for ; Tue, 21 Apr 2015 15:47:00 -0400 (EDT) Received: from smtp.buffalo.edu (smtp2.acsu.buffalo.edu [128.205.5.254]) by localmaile.acsu.buffalo.edu (Prefixe) with ESMTP id CB36F160070 for ; Tue, 21 Apr 2015 15:47:00 -0400 (EDT) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id C32462959 for ; Tue, 21 Apr 2015 15:47:00 -0400 (EDT) Message-ID: <5536A934.8040002@buffalo.edu> Date: Tue, 21 Apr 2015 15:47:00 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: pcp developers Subject: Hotproc fixes Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: Hotproc fixes Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1429645621 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18213 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi, Here are a few cleanups to hotproc. Fixes an off by one error where the fname configuration wasn't working. Also started a cleanup of the manpage to try to make clear that this is part of the standard proc pmda and also give some more configuration information. More work to do here still. https://github.com/ubccr/pcp/tree/hotproc_cleanups Probably should archive the old hotproc directory somewhere and leave a pointer to the new stuff. If you let me know how to handle that, just a wholesale "git rm", or something else, I can do that as well. Thanks Martins commit 2093535ac6dc866b4e5d99e1f11b39cf6c5f74a9 Author: Martins Innus Date: Tue Apr 21 19:36:56 2015 +0000 hotproc - Add some more detail to the man page src/pmdas/linux_proc/pmdahotproc.1 | 214 +++++++----------------------------- 1 files changed, 40 insertions(+), 174 deletions(-) commit 34db01726b6b91ed7e5a37e3af75a61487924eab Author: Martins Innus Date: Tue Apr 21 17:38:54 2015 +0000 hotproc : fix an off by one error for fname configs src/pmdas/linux_proc/proc_pid.c | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) From kenj@internode.on.net Tue Apr 21 15:29:14 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 08AB67CBE for ; Tue, 21 Apr 2015 15:29:14 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id DD7F2304039 for ; Tue, 21 Apr 2015 13:29:10 -0700 (PDT) X-ASG-Debug-ID: 1429648148-04bdf06321367080001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id 3kUHohOmjbVnoTxv for ; Tue, 21 Apr 2015 13:29:08 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2D+AQD5sTZVPKEh0XYNSAaKf8RTgl0CghIBAQEBAQEHAQEBATiEXAEBBDhAEQsYCRYPCQMCAQIBMRQTCAEBvlSVdwEBCAIBH4s3hBcqShaEFwEEsQmEJ4FogTkBAQE Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 22 Apr 2015 05:59:07 +0930 Message-ID: <5536B319.1090805@internode.on.net> Date: Wed, 22 Apr 2015 06:29:13 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] Accessing instance specific metrics References: <5534C680.2020709@redhat.com> <5536317C.5000600@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Accessing instance specific metrics In-Reply-To: <5536317C.5000600@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1429648148 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18214 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 21/04/15 21:16, Marko Myllynen wrote: > ... and > -i "11173 java" won't work. But I would expect -i "'11173 java'" or -i '"11173 java"' to work. The nested quoting is unusual (but documented in the pmval(1) man page) as a result of the "special" significance of white space in an external instance name, i.e. an instance name must be unique across an instance domain up to the first white space in the name. There are only a few examples of instance names than contain spaces ... but this does include all of the process-based ones and the load average. From kenj@internode.on.net Tue Apr 21 15:35:31 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 8E47D7CBE for ; Tue, 21 Apr 2015 15:35:31 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 5F49B8F8059 for ; Tue, 21 Apr 2015 13:35:28 -0700 (PDT) X-ASG-Debug-ID: 1429648526-04bdf06321367240001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id 6qIXtiDtp8FX6RAJ for ; Tue, 21 Apr 2015 13:35:26 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2D+AQAbszZVPKEh0XYNTop/xFOCXQKCEgEBAQEBAQcBAQEBOIRcAQEEOEARCxgJFg8JAwIBAgExFBMIAQG+TpV4AQEIAgEfizeFCxaEFwEEsQmEJ4MhAQEB Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 22 Apr 2015 06:05:25 +0930 Message-ID: <5536B493.5070208@internode.on.net> Date: Wed, 22 Apr 2015 06:35:31 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] Bug/Issue tracker References: <20150420174712.GH18943@marquez.int.rhx> X-ASG-Orig-Subj: Re: [pcp] Bug/Issue tracker In-Reply-To: <20150420174712.GH18943@marquez.int.rhx> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1429648526 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18214 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 21/04/15 03:47, Michele Baldessari wrote: > Hi all, > > we currently have issues/enhancements filed in three different places: > 1. SGI Bugzilla (92 bugs open atm) > 2. Github Issue Tracker (9 issues open atm) > 3. Red Hat Bugzilla (mainly for issues with packaging in RHEL/Fedora or > any Red Hat specific process - I am excluding this one from the > proposal below) > > ... My thoughts on this are ... - I don't like multiple issue tracking repositories - the current github spate seems to have been triggered by the Netflix Vector announcement, and I wonder if it will continue - since many of the github "issues" seem to be really, in the "this does not work for me" or "this does not seem right" categories, I would suggest we actively engage with the github posters to answer their questions and (a) close the issue, or (b) when it raises a real problem move the issue to one of the bugzilla repositories and then close the issue on github This would turn the github "issues" into more of a forum, and leave the hard core issue tracking as it is today ... split in TWO places, sigh. From wwwrun@oss.sgi.com Tue Apr 21 15:40:35 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id ADD4B7F54; Tue, 21 Apr 2015 15:40:35 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1067] linux pmda does too much work for network.interface queries Date: Tue, 21 Apr 2015 20:40:33 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: cltorrespr@gmail.com X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1429648835.A7b185.11023"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1429648835.A7b185.11023 Date: Tue, 21 Apr 2015 15:40:35 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1067 --- Comment #8 from Carlos L. Torres --- I tried the patch above but I'm getting a segfault whenever I request network data, other data works fine. dmesg shows this: [ 953.058160] pmdalinux[10280]: segfault at 0 ip 0000000000409c76 sp 00007fff88aff3e0 error 4 in pmdalinux[400000+17000] -- You are receiving this mail because: You are on the CC list for the bug. --1429648835.A7b185.11023 Date: Tue, 21 Apr 2015 15:40:35 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8"

Comment # 8 on bug 1067 from 
I tried the patch above but I'm getting a segfault whenever I request network
data, other data works fine.

dmesg shows this:

[  953.058160] pmdalinux[10280]: segfault at 0 ip 0000000000409c76 sp
00007fff88aff3e0 error 4 in pmdalinux[400000+17000]

You are receiving this mail because:
  • You are on the CC list for the bug.
--1429648835.A7b185.11023-- From dsmith@redhat.com Tue Apr 21 16:33:34 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 97B177CBE for ; Tue, 21 Apr 2015 16:33:34 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 8EDAA304032 for ; Tue, 21 Apr 2015 14:33:34 -0700 (PDT) X-ASG-Debug-ID: 1429652009-04cb6c1cca32d7b0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id CDrCK3gIf870POq4 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 21 Apr 2015 14:33:30 -0700 (PDT) X-Barracuda-Envelope-From: dsmith@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (Postfix) with ESMTPS id AF5AA8F02E for ; Tue, 21 Apr 2015 21:33:29 +0000 (UTC) Received: from t540p.usersys.redhat.com (dhcp-10-15-1-2.hsv.redhat.com [10.15.1.2]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3LLXSod002795 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 21 Apr 2015 17:33:29 -0400 Message-ID: <5536C228.8010001@redhat.com> Date: Tue, 21 Apr 2015 16:33:28 -0500 From: David Smith User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp Subject: Re: [pcp] JSON PMDA References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <1237712965.18667183.1429054767135.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] JSON PMDA In-Reply-To: <1237712965.18667183.1429054767135.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429652010 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 04/14/2015 06:39 PM, Nathan Scott wrote: > Hi David, > > ----- Original Message ----- >>> [...] >>> Yeah - something like that - have a look at src/libpcp_pmda/src/cache.c as >>> thats how the instance cache number stability is achieved. Perhaps we can >>> extend that with additional APIs to help us out here. >>> >> > Its OK to extend the API/ABI, but not to break it. Which should be all we > need to do here, I think. Maybe see if we can reduce the range that those > cache.c interfaces accept - the two lines with "if (inst == 0x7fffffff) {" > there look promising. If we had a h->maxinst there perhaps, instead of the > hard-coded 2^32-1 limit (may need to change the test to '>=' too) we might > be done and dusted here. That'll turn out to be a gross oversimplification > I'm sure ... but maybe, just maybe it will work. OK, I've been staring at cache.c today, and I've figured out a couple of things. - Most of the existing code is for an instance cache, there doesn't appear to be any existing code for a cluster/metric cache. - I'm failing to see how changing that 0x07ffffff as you outlined above helps. Can you explain that a bit more? If you'd like me to add a cluster/metric cache, I'm going to need a bit more explanation about what that will entail. >From a PMDA writer's point of view, I'd think the new APIs would look something like (in pseudo code): - lookup_cluster(domain_id, name) - find_next_available_cluster(domain_id) - lookup_metric(domain_id, cluster_id, name) - find_next_available_metric(domain_id, cluster_id) -- David Smith dsmith@redhat.com Red Hat http://www.redhat.com 256.217.0141 (direct) 256.837.0057 (fax) From kenj@internode.on.net Tue Apr 21 17:22:08 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 97DA67CBE for ; Tue, 21 Apr 2015 17:22:08 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 200D8AC001 for ; Tue, 21 Apr 2015 15:22:05 -0700 (PDT) X-ASG-Debug-ID: 1429654919-04cbb056b33705f0001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id 70FXrBvzkA9yOHsS for ; Tue, 21 Apr 2015 15:21:59 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2D/AQAczTZVPKEh0XYNTodSgy3EWIJdAoIMAQEBAQEBBwEBAQE4hFwBAQQjFUABEAsYAgIFFgsCAgkDAgECATEUBgEMAQcBAb47cJUVAQEBAQEBAQEBAQEBAQEBAQEBGoEhihaFBAeCaIFFAQSxCYQngyEBAQE Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 22 Apr 2015 07:51:47 +0930 Message-ID: <5536CD81.1070008@internode.on.net> Date: Wed, 22 Apr 2015 08:21:53 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Nathan Scott , Lukas Berk CC: pcp developers Subject: Re: [patch] speed pmie startup References: <852862416.3748569.1429589380945.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [patch] speed pmie startup In-Reply-To: <852862416.3748569.1429589380945.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1429654919 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18219 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 21/04/15 14:09, Nathan Scott wrote: > ...It turned out > those delays were due to some places where we do 'now = now + 1sec' > - see attached patch. Do you know the reason behind adding in that > one second difference there? (and is it safe to remove, or reduce, > as the patch does?) I do not know why they are there. Seppo would be the only hope of answering that. But I can guess ... there was some initial concerns about pmie's fetch scheduling getting behind, so fetchs are scheduled to happen at some time that has already passed, and adding some arbitrary slop in the start up gave a chance to parse the config file and get set up before the first fetch. But we've done considerable work in the interim to improve the general handling of the "scheduling getting behind" situation, so I don't think the +1sec is needed at all ... so I'd suggest dropping the first + 0.000000001 and the while second block if (!archives) { ... } can also go. I just tried this, but there are other QA failures (from -g pmie), namely 260 and 518 ... 260 looks like it would be OK with some tweaking, but I'm not sure about 518. Probably needs some more investigation. From kenj@internode.on.net Tue Apr 21 17:29:45 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id C82BE7CBE for ; Tue, 21 Apr 2015 17:29:45 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id B19DB304039 for ; Tue, 21 Apr 2015 15:29:42 -0700 (PDT) X-ASG-Debug-ID: 1429655379-04cb6c1cca32e4f0001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id MsmsalgdVk4kS9mt for ; Tue, 21 Apr 2015 15:29:40 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2D+AQBNzjZVPKEh0XYNTop/xFiCXQKCDQEBAQEBAQcBAQEBOIRcAQEEJxFAEQsYCRYPCQMCAQIBMRQTCAEBvjaWBgEBCAIBH4s3hQsWhBcBBJx+hiqNYYQngyEBAQE Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 22 Apr 2015 07:59:39 +0930 Message-ID: <5536CF59.6050108@internode.on.net> Date: Wed, 22 Apr 2015 08:29:45 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] [PATCH] PCP pidstat PMDA References: <5534C680.2020709@redhat.com> <493537984.3276058.1429528962326.JavaMail.zimbra@redhat.com> <5534EBA8.4030509@redhat.com> <1644393599.3651017.1429563442835.JavaMail.zimbra@redhat.com> <55364606.1000503@redhat.com> X-ASG-Orig-Subj: Re: [pcp] [PATCH] PCP pidstat PMDA In-Reply-To: <55364606.1000503@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1429655380 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18218 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 21/04/15 22:43, Marko Myllynen wrote: > ... > hmm, so it is possible to provide a redirected metric from another > domain in C but is there a way to do that in Perl or Python? And is it > possible to read a metric from another domain to be used to calculate or > construct a new metrics in the current domain, not just redirect? In general this is not possible. Think about the flow of a request (you're building pmda A and pmda B has the metrics you're interested in): client -> pmcd -> pmda A -> ??? If pmda A tries to use pmcd to get to pmcd B we have a callback into pmcd and all sorts of timeout headaches ... pmie in "secret agent mode" for the summary PMDA does this, but I would not recommend that as a precedent to be copied! If pmda B has some non-pcp export channel (as well) that could be used. Otherwise, source code replication from pmda B into pmda A is likely to be the simplest (and most efficient) strategy. From fche@redhat.com Tue Apr 21 17:44:11 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id BE99B7CBE for ; Tue, 21 Apr 2015 17:44:11 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id B1A858F8054 for ; Tue, 21 Apr 2015 15:44:11 -0700 (PDT) X-ASG-Debug-ID: 1429656250-04cb6c1cca32e800001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id DhitFs1yGfJeNDfL (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 21 Apr 2015 15:44:10 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3LMi9kI024146 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 21 Apr 2015 18:44:09 -0400 Received: from fche.csb (vpn-225-93.phx2.redhat.com [10.3.225.93]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3LMi9aK018657 for ; Tue, 21 Apr 2015 18:44:09 -0400 Received: by fche.csb (Postfix, from userid 2569) id 985B85853E; Tue, 21 Apr 2015 18:44:05 -0400 (EDT) Date: Tue, 21 Apr 2015 18:44:05 -0400 From: "Frank Ch. Eigler" To: pcp developers Subject: pcp updates: pmmgr, pmwebd Message-ID: <20150421224405.GN6822@redhat.com> X-ASG-Orig-Subj: pcp updates: pmmgr, pmwebd Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429656250 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - 3-week ping re. pcpfans.git fche/pmmgr: commit 583b350d98246f9082253f04b76b682985c0de55 Author: Frank Ch. Eigler Date: Sun Apr 5 17:17:34 2015 -0400 pmmgr subtarget-containers: disable by default Investigation of PR1106 indicates that pmcd is too fragile to use with containers safely, e.g., a pmda can get stuck within a container namespace, rendering further normal use of that pmda useless. Until this is fixed, let's not supply /etc/pcp/pmmgr/subtarget-containers. commit 35c490f3f6ca7c800a09d1903bfc2a9e03a83352 Author: Frank Ch. Eigler Date: Wed Apr 1 21:05:21 2015 -0400 pmmgr: lengthen subtarget-containers qa/668 Further testing on a slower virtual machine shows situations where pmlogconf & docker run dramatically slower than on full workstations, whether due to bare-metalness, number of processors, presence of selinux bugs & troubleshooting thereof, etc. This test case is made more conservative in terms of timing (3ish minutes) and more defensive of iffy docker situations. commit d42afe606b02e2fa570b34a0313add8aa555619a Author: Frank Ch. Eigler Date: Tue Mar 31 21:15:23 2015 -0400 pmmgr: subtarget-containers qa/668 A relatively short (60-second) test that fires up a pmmgr only in order to attach pmloggers to a few *real live* docker containers. (That means the qa-invoking user probably needs to be in group 'docker'; something checked by the qa script.) The docker container being used is a tiny "busybox sleep XX" kind, so there should be only minimal disk/network consumption. The tests do not assert anything about the contents of the pcp archives resulting from the per-container attachment. In my tests, they got apprx. zero actual content, other than proper pmcd.hostname. There ought to be a pmlogconf ditty for the container's own cgroup stats, and disk/network stuff should eventually be correct. commit 8864f4e2d9824933d8d598e8361869d58815a2b8 Author: Frank Ch. Eigler Date: Tue Mar 31 18:35:23 2015 -0400 pmmgr: subtarget-containers support Add support for a config option "subtarget-containers", which implicitly forks further pmlogger (but not pmie: PR1105) instances for all running containers on an identified target host. The host's host-id string gets a "--CONTAINER" code attached, and the connection hostspec gets a "container=XXXXX" appended with a ? or & suffix-prefix. and some work on pcpfans.git fche/pmwebd: commit 40a606d419ec8d8cfcaeb2551ded9d0cf424c690 Author: Frank Ch. Eigler Date: Tue Apr 21 18:12:59 2015 -0400 PR1099 (compressed archive) mitigation in pmwebd: skip them in graphite mode As per PR1099, pmwebd graphite mode searches deeply conflict with compressed mode archives, because these cost a lot of time to individually decompress (and perhaps many times repeatedly). A new heuristic in pmgraphite_enumerate_metrics() rejects them. QA included (+ regenerated qa/661.out). commit c9597c675773fc37b93f428be24e9e55f2dd3994 Author: Frank Ch. Eigler Date: Tue Apr 21 10:35:21 2015 -0400 pmwebd crasher fix: png-rendered multiple graphs with corrupt archives It was discovered that if pmwebd (in graphite, render-to-png mode) was told to draw a mixture of archives, some of which were corrupt enough to fail pmGetArchiveEnd(), it could crash during the time-series importance-analysis stage. We now protect against that particular case, and improve diagnostics for that and others. QA included using two new pcpqa archives, one featuring 100% Genuine Corruption. commit 96581262dfedee20c080218bc106d1f762ca3a9c Author: Frank Ch. Eigler Date: Sun Mar 8 16:43:37 2015 -0400 pmwebd: handle exit_p requested during graphite data-mass gathering If we receive a SIGINT during pmgraphite_fetch_all_series, it will return early, but perhaps without all the correct geometry in the vector it returns. The caller pmgraphite_respond_render_gfx now checks for exit_p right after that call, so a badly-timed SIGINT doesn't trigger later geometry-assertions. commit 7305d8ea49331f45767724a83e58ca4d1a49babd Author: Frank Ch. Eigler Date: Mon Mar 2 13:35:02 2015 -0500 pmwebd: fix little memory leak for fts() during interrupted rendering The metric-enumeration loop using fts(3) could formerly exit without a fts_close() in case of a top-level ^C (exit_p shutdown). It's an insignificant leak, but what the heck. commit fed7789015f35586eac6dd33da088e19c2c58d41 Author: Frank Ch. Eigler Date: Sat Feb 28 09:35:09 2015 -0500 pmwebd: add a "-i MIN-INTERVAL" option for graphite time-precision control When pmlogger data is sampled more frequently than /60s, it is desirable to let graphite render data at a higher time resolution. Oversampling leads to wiggles due to interpolation FP artifacts, so is undesirable. The pmwebd invoker is best placed to judge the right tradeoff, so is given an option to set the minimum time-step size. From nscott@redhat.com Tue Apr 21 18:27:49 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 0F98A7CBE for ; Tue, 21 Apr 2015 18:27:49 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id CF6AD8F8065 for ; Tue, 21 Apr 2015 16:27:48 -0700 (PDT) X-ASG-Debug-ID: 1429658863-04bdf06320369eb0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id eQkTn0ClvDLFUuPr (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 21 Apr 2015 16:27:43 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3LNRhbY011445; Tue, 21 Apr 2015 19:27:43 -0400 Date: Tue, 21 Apr 2015 19:27:43 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: David Smith Cc: pcp Message-ID: <1344441557.4430503.1429658863072.JavaMail.zimbra@redhat.com> In-Reply-To: <5536C228.8010001@redhat.com> References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <1237712965.18667183.1429054767135.JavaMail.zimbra@redhat.com> <5536C228.8010001@redhat.com> Subject: Re: [pcp] JSON PMDA MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] JSON PMDA Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.129] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: JSON PMDA Thread-Index: FlAA9MmycRh4a/6rJpRp3j/XYswapg== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1429658863 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18221 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi David, ----- Original Message ----- > > ----- Original Message ----- > >>> [...] > >>> Yeah - something like that - have a look at src/libpcp_pmda/src/cache.c > >>> as > >>> thats how the instance cache number stability is achieved. Perhaps we > >>> can > >>> extend that with additional APIs to help us out here. > >>> > >> > > Its OK to extend the API/ABI, but not to break it. Which should be all we > > need to do here, I think. Maybe see if we can reduce the range that those > > cache.c interfaces accept - the two lines with "if (inst == 0x7fffffff) {" > > there look promising. If we had a h->maxinst there perhaps, instead of the > > hard-coded 2^32-1 limit (may need to change the test to '>=' too) we might > > be done and dusted here. That'll turn out to be a gross oversimplification > > I'm sure ... but maybe, just maybe it will work. > > OK, I've been staring at cache.c today, and I've figured out a couple of > things. > > - Most of the existing code is for an instance cache, there doesn't > appear to be any existing code for a cluster/metric cache. A more abstract way to think about it would be 'its a cache for signed 32 bit identifiers allocated in a monotonically increasing way, allowing for holes and with support for optional persistence' ... which we use only for instances today. > - I'm failing to see how changing that 0x07ffffff as you outlined above > helps. Can you explain that a bit more? So, if we can generalise the above a little, we may be able to make it a 'cache for identifiers in a range from 0 to some specified maximum, with identifiers allocated in a monotonically increasing way, allowing holes and optional persistence'. The pmInDom is a domain number (JSON 137) and a "serial" number. So in our situation here, we could reserve serial #0 for a metric-identifier cache, #1 for an indom-identifier cache, and then use the rest of the space for indom-instance caches. > If you'd like me to add a cluster/metric cache, I'm going to need a bit > more explanation about what that will entail. I don't think that is necessary. I think we may even get away with just the one metric identifier cache? (combine cluster and index - using the full metric name as the cache key. Maybe? Not sure, but that would help with the 1024-metrics-per-source-only problem). > From a PMDA writer's point of view, I'd think the new APIs would look > something like (in pseudo code): > > - lookup_cluster(domain_id, name) > - find_next_available_cluster(domain_id) > - lookup_metric(domain_id, cluster_id, name) > - find_next_available_metric(domain_id, cluster_id) As per the earlier mail with kenj (re ioctl), I think the only new API we will need for this aspect would be something like: int pmdaCacheResize(pmInDom indom, int maximum); the rest of the pmdaCacheOp(3) interfaces should give us the rest of the cache manipulation functionality you need (like persisting, restoring, & so on). cheers. -- Nathan From nscott@redhat.com Tue Apr 21 18:53:39 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 0B4067CBE for ; Tue, 21 Apr 2015 18:53:39 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id E69928F8065 for ; Tue, 21 Apr 2015 16:53:38 -0700 (PDT) X-ASG-Debug-ID: 1429660411-04bdf0632136a610001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id bu8bB3fkfEpc9aaN (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 21 Apr 2015 16:53:31 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3LNrUBi051650; Tue, 21 Apr 2015 19:53:30 -0400 Date: Tue, 21 Apr 2015 19:53:30 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: pcp developers Message-ID: <1770973441.4434135.1429660410730.JavaMail.zimbra@redhat.com> In-Reply-To: <20150421224405.GN6822@redhat.com> References: <20150421224405.GN6822@redhat.com> Subject: Re: [pcp] pcp updates: pmmgr, pmwebd MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pcp updates: pmmgr, pmwebd Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.129] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: pmmgr, pmwebd Thread-Index: FjgyKW2chLSDuIgK2mcwwXxWgB4gKA== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1429660411 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18222 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > Hi - > > 3-week ping re. pcpfans.git fche/pmmgr: > [...] (Please provide git urls in pull requests, it makes life much easier for various maintainers to pull in changes) I may have misunderstood your earlier mail - its this one right? http://www.pcp.io/pipermail/pcp/2015-March/006883.html ... the "for your entertainment" one. There were lots of references to bugs & things not working there - and this latest pull request seems to turn the earlier feature off? Have I got that right? If so, do you have any idea about the root cause of the underlying problems? We should fix those, not ignore them and continue on with feature work (I had optimistically assumed the fixes would arrive shortly after your new-feature mail, sorry). Do you need a hand with those? cheers. -- Nathan From nscott@redhat.com Tue Apr 21 19:00:59 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id F23987CBE for ; Tue, 21 Apr 2015 19:00:59 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id D88D58F8074 for ; Tue, 21 Apr 2015 17:00:59 -0700 (PDT) X-ASG-Debug-ID: 1429660857-04cbb056b4371e40001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id Gcf4rOvDBIGKYFSf (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 21 Apr 2015 17:00:58 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3M00tfl023697; Tue, 21 Apr 2015 20:00:55 -0400 Date: Tue, 21 Apr 2015 20:00:55 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: Michele Baldessari , pcp@oss.sgi.com Message-ID: <1261130981.4436043.1429660855080.JavaMail.zimbra@redhat.com> In-Reply-To: References: <20150420174712.GH18943@marquez.int.rhx> <880380200.3717668.1429580218242.JavaMail.zimbra@redhat.com> Subject: Re: Bug/Issue tracker MIME-Version: 1.0 X-ASG-Orig-Subj: Re: Bug/Issue tracker Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.129] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Bug/Issue tracker Thread-Index: DZ5G1Ae1sSfnf79hfOGTl/4Z1Jbb6w== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1429660858 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18222 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > > Bugzilla's capabilities [...] This is not a technical problem, its a people problem. It doesn't matter what features bugzilla has, actual pcp users are simply not using it. cheers. -- Nathan From fche@redhat.com Tue Apr 21 19:07:30 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 187E57F3F for ; Tue, 21 Apr 2015 19:07:30 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 0EE388F8068 for ; Tue, 21 Apr 2015 17:07:26 -0700 (PDT) X-ASG-Debug-ID: 1429661245-04cbb056b3372020001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 6ME0lNKNaFUx9WrU (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 21 Apr 2015 17:07:26 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3M07POY005613 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 21 Apr 2015 20:07:25 -0400 Received: from fche.csb (vpn-225-93.phx2.redhat.com [10.3.225.93]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3M07ONq030812; Tue, 21 Apr 2015 20:07:24 -0400 Received: by fche.csb (Postfix, from userid 2569) id DEC775853E; Tue, 21 Apr 2015 20:07:20 -0400 (EDT) Date: Tue, 21 Apr 2015 20:07:20 -0400 From: "Frank Ch. Eigler" To: Nathan Scott Cc: pcp developers Subject: Re: [pcp] pcp updates: pmmgr, pmwebd Message-ID: <20150422000720.GO6822@redhat.com> X-ASG-Orig-Subj: Re: [pcp] pcp updates: pmmgr, pmwebd References: <20150421224405.GN6822@redhat.com> <1770973441.4434135.1429660410730.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1770973441.4434135.1429660410730.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429661245 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - > [...] > There were lots of references to bugs & things not working there - and this > latest pull request seems to turn the earlier feature off? Have I got that > right? Not exactly. The new pmmgr code is fine, which is why it was tested, documented, and submitted for review (and entertainment). However, as made clear during testing, pcp containers code has problems that prevent this new code from being turned on -by default-. > If so, do you have any idea about the root cause of the underlying > problems? [...] http://oss.sgi.com/pipermail/pcp/2015-April/006892.html > Do you need a hand with those? I'll defer to the author of the affected code. - FChE From kenj@internode.on.net Tue Apr 21 19:23:19 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id F1EBC7CBE for ; Tue, 21 Apr 2015 19:23:19 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id D332F8F8054 for ; Tue, 21 Apr 2015 17:23:19 -0700 (PDT) X-ASG-Debug-ID: 1429662193-04cb6c1cc832fef0001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id EPcy8sVzRniUkhaL for ; Tue, 21 Apr 2015 17:23:14 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2D+AQCD6TZVPKEh0XYNToNeXIMYgy3BKYgdAQEBAQEBBwEBAQE4hQVVMAYCBRYLAgsDAgECATEnBgIBAb4ccJVAgSGBLI4LglKBRQWGMo8Cm1WEJ12CRAEBAQ Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 22 Apr 2015 09:53:05 +0930 Message-ID: <5536E9EE.1060108@internode.on.net> Date: Wed, 22 Apr 2015 10:23:10 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - pmLookupName() Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - pmLookupName() Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1429662193 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18223 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp master Ken McDonell (1): libpcp/pmns.c: pmLookupName() fix up man/man3/pmlookupname.3 | 94 ++++++++++++++++- qa/404.out | 12 +- qa/901.out | 12 +- qa/909 | 122 +++++++++++++++++++++++ qa/909.out | 131 ++++++++++++++++++++++++ qa/group | 1 qa/src/interp_bug.c | 10 + qa/src/interp_bug2.c | 22 +++- qa/src/lookupnametest.c | 53 +++++++++- qa/src/multifetch.c | 3 qa/src/multithread5.c | 5 qa/src/multithread6.c | 5 qa/src/multithread7.c | 5 qa/src/multithread8.c | 5 qa/src/multithread9.c | 5 qa/src/permfetch.c | 2 qa/src/torture_api.c | 6 - src/libpcp/src/pmns.c | 252 +++++++++++++++++++++++++++++++++++------------- src/pmcd/src/dopdus.c | 83 +++++++++------ 19 files changed, 694 insertions(+), 134 deletions(-) Details ... commit d26ac520e34c42a07825864dc7db84b4bee300bf Author: Ken McDonell Date: Wed Apr 22 10:17:33 2015 +1000 libpcp/pmns.c: pmLookupName() fix up Complete audit of pmLookupName() error handling, to ensure we are consistent across all of - local PMNS (with and without a current context) - remote host context - local context - archive context for all types of metrics, but especially DYNAMIC metrics. Mostly in libpcp, but also a small pmcd change. pmLookupName() man page updated to reflect the real error handling protocol and verified example code added. As a by-product, discovered that pmNameID() and pmNameAll() were broken for DYNAMIC metrics, so drive-by fix for these as well. And finally a bunch of QA consequential cleanup. From minnus@buffalo.edu Tue Apr 21 19:39:13 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=MIME_QP_LONG_LINE autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 0E0197CBE for ; Tue, 21 Apr 2015 19:39:13 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 7B5A9AC001 for ; Tue, 21 Apr 2015 17:39:09 -0700 (PDT) X-ASG-Debug-ID: 1429663146-04cbb056b1372840001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id a9QJiS1EdYfaqUQ4 for ; Tue, 21 Apr 2015 17:39:07 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmaile.acsu.buffalo.edu (localmaile.acsu.buffalo.edu [128.205.4.3]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 92E0378F; Tue, 21 Apr 2015 20:39:06 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 842DB160070; Tue, 21 Apr 2015 20:39:06 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localmaile.acsu.buffalo.edu (Postfix) with ESMTP id AD976160094; Tue, 21 Apr 2015 20:39:05 -0400 (EDT) Received: from smtp.buffalo.edu (smtp1.acsu.buffalo.edu [128.205.5.253]) by localmaile.acsu.buffalo.edu (Prefixe) with ESMTP id AC273160070; Tue, 21 Apr 2015 20:39:05 -0400 (EDT) Received: from [10.0.1.12] (cpe-69-204-8-250.buffalo.res.rr.com [69.204.8.250]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 923B7219B; Tue, 21 Apr 2015 20:39:05 -0400 (EDT) References: <5536E9EE.1060108@internode.on.net> Mime-Version: 1.0 (1.0) In-Reply-To: <5536E9EE.1060108@internode.on.net> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Message-Id: Cc: "pcp@oss.sgi.com" X-Mailer: iPhone Mail (11D257) From: Martins Innus Subject: Re: [pcp] pcp updates - pmLookupName() Date: Tue, 21 Apr 2015 20:39:02 -0400 X-ASG-Orig-Subj: Re: [pcp] pcp updates - pmLookupName() To: Ken McDonell X-PM-EL-Spam-Prob: XX: 28% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1429663147 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.82 X-Barracuda-Spam-Status: No, SCORE=0.82 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=MIME_QP_LONG_LINE, MIME_QP_LONG_LINE_2 X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18224 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 MIME_QP_LONG_LINE RAW: Quoted-printable line longer than 76 chars 0.82 MIME_QP_LONG_LINE_2 RAW: Quoted-printable line longer than 76 chars Thanks Ken! I will test my previously failing cases Tommorrow. Martins > On Apr 21, 2015, at 8:23 PM, Ken McDonell wrote: >=20 > Changes committed to git://git.pcp.io/kenj/pcp master >=20 > Ken McDonell (1): > libpcp/pmns.c: pmLookupName() fix up >=20 > man/man3/pmlookupname.3 | 94 ++++++++++++++++- > qa/404.out | 12 +- > qa/901.out | 12 +- > qa/909 | 122 +++++++++++++++++++++++ > qa/909.out | 131 ++++++++++++++++++++++++ > qa/group | 1=20 > qa/src/interp_bug.c | 10 + > qa/src/interp_bug2.c | 22 +++- > qa/src/lookupnametest.c | 53 +++++++++- > qa/src/multifetch.c | 3=20 > qa/src/multithread5.c | 5=20 > qa/src/multithread6.c | 5=20 > qa/src/multithread7.c | 5=20 > qa/src/multithread8.c | 5=20 > qa/src/multithread9.c | 5=20 > qa/src/permfetch.c | 2=20 > qa/src/torture_api.c | 6 - > src/libpcp/src/pmns.c | 252 +++++++++++++++++++++++++++++++++++--------= ----- > src/pmcd/src/dopdus.c | 83 +++++++++------ > 19 files changed, 694 insertions(+), 134 deletions(-) >=20 > Details ... >=20 > commit d26ac520e34c42a07825864dc7db84b4bee300bf > Author: Ken McDonell > Date: Wed Apr 22 10:17:33 2015 +1000 >=20 > libpcp/pmns.c: pmLookupName() fix up >=20 > Complete audit of pmLookupName() error handling, to ensure we are > consistent across all of > - local PMNS (with and without a current context) > - remote host context > - local context > - archive context > for all types of metrics, but especially DYNAMIC metrics. >=20 > Mostly in libpcp, but also a small pmcd change. >=20 > pmLookupName() man page updated to reflect the real error handling > protocol and verified example code added. >=20 > As a by-product, discovered that pmNameID() and pmNameAll() were > broken for DYNAMIC metrics, so drive-by fix for these as well. >=20 > And finally a bunch of QA consequential cleanup. >=20 > _______________________________________________ > pcp mailing list > pcp@oss.sgi.com > http://oss.sgi.com/mailman/listinfo/pcp >=20 >=20 From lberk@redhat.com Tue Apr 21 20:05:11 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 165657CBE for ; Tue, 21 Apr 2015 20:05:11 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id B076EAC003 for ; Tue, 21 Apr 2015 18:05:07 -0700 (PDT) X-ASG-Debug-ID: 1429664706-04bdf0632136b990001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id Tsuqd7xRZRDxGrJN (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 21 Apr 2015 18:05:06 -0700 (PDT) X-Barracuda-Envelope-From: lberk@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (Postfix) with ESMTPS id 23E18AC7D4 for ; Wed, 22 Apr 2015 01:05:06 +0000 (UTC) Received: from toium (unused [10.10.50.154] (may be forged)) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3M153bK028644 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Tue, 21 Apr 2015 21:05:05 -0400 From: Lukas Berk To: pcp@oss.sgi.com Subject: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint References: <87bnk0wzn5.fsf@redhat.com> X-ASG-Orig-Subj: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint Date: Tue, 21 Apr 2015 21:05:03 -0400 In-Reply-To: <87bnk0wzn5.fsf@redhat.com> (Lukas Berk's message of "Tue, 10 Mar 2015 13:06:22 -0400") Message-ID: <877ft59dmo.fsf@redhat.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429664706 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hey All, I've pushed my work on this so far to lberk/dev on sourceware.org/git/pcpfans.git I've focused the changes within pcp.spec.in to start, so to try out the changes, simply ./Makepkgs on a fedora or centos box. Just about every pmda except core ones have been split into their own pcp-pmda- package, and on systems that already have a stable pcp release (fedora 22 and older or centos 7 and older) there is a pcp-compat package. This pcp-compat will ensure all the new subpackages will be installed by default. This way there is no broken/missing elements after an upgrade. I've been careful to test qa after splitting off pmdas of each language (python, perl, and C, respectively), and there is various updated qa bits to match that. As it currently stands, I have no regressions on my local runs. I've also moved the python user tools under src/pcp, and created their own sub package: pcp-system-tools. This was required, as now both python and perl bindings are no longer installed by default (in an attempt to lower the default footprint). As with the pmdas, this package will be dragged in on existing releases. I've also added symlinks to their previous commands, so no change is required when invoking the tools. I've also added a %post hook to build the pmns (and removes the .NeedRebuild file if successful). I explicitly tested this by making sure to nuke /var/lib/pcp* and running the full testsuite (also manually checked the pmns before and after adding that hook, no difference). Overall these changes have reduced the default footprint from 51mb to 7mb. Any comments are appreciated. Frank has already pointed out on IRC, a pcp-full-collection style package, which requires and installs the full pcp set of packages would be nice to have. Especially as a convienience to the user. I think this is a great idea, and unless there is strong opposition to it, will be adding that asap. Cheers, Lukas From nscott@redhat.com Tue Apr 21 22:56:28 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id E00D97CBE for ; Tue, 21 Apr 2015 22:56:28 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 68A3FAC004 for ; Tue, 21 Apr 2015 20:56:25 -0700 (PDT) X-ASG-Debug-ID: 1429674979-04cb6c1cc7333550001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id XqfyTSXxpoLE6ddc (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 21 Apr 2015 20:56:20 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3M3uJEr030519; Tue, 21 Apr 2015 23:56:19 -0400 Date: Tue, 21 Apr 2015 23:56:19 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: pcp developers Message-ID: <1086935455.4499240.1429674979133.JavaMail.zimbra@redhat.com> In-Reply-To: <20150422000720.GO6822@redhat.com> References: <20150421224405.GN6822@redhat.com> <1770973441.4434135.1429660410730.JavaMail.zimbra@redhat.com> <20150422000720.GO6822@redhat.com> Subject: Re: [pcp] pcp updates: pmmgr, pmwebd MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pcp updates: pmmgr, pmwebd Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.176.220] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: pmmgr, pmwebd Thread-Index: MjZ4hdoEhn686noi8B2+SFjKaMXoPA== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1429674980 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18227 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > > [...] > > Do you need a hand with those? > > I'll defer to the author of the affected code. > I see. I'll look into those issues when I can; until then, I guess there's no point merging any new code that relies on those fixes. cheers. -- Nathan From nscott@redhat.com Tue Apr 21 23:02:45 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 0F2A07CBE for ; Tue, 21 Apr 2015 23:02:45 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id EB91F8F8064 for ; Tue, 21 Apr 2015 21:02:44 -0700 (PDT) X-ASG-Debug-ID: 1429675359-04bdf0632236f080001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id 5hPtFKNzPNeaftck (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 21 Apr 2015 21:02:39 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3M42dfo031233; Wed, 22 Apr 2015 00:02:39 -0400 Date: Wed, 22 Apr 2015 00:02:39 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Lukas Berk Cc: pcp@oss.sgi.com Message-ID: <1344838118.4507317.1429675359315.JavaMail.zimbra@redhat.com> In-Reply-To: <877ft59dmo.fsf@redhat.com> References: <87bnk0wzn5.fsf@redhat.com> <877ft59dmo.fsf@redhat.com> Subject: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.176.220] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Minimizing Installation Size for Reduced PCP Footprint Thread-Index: v6HO/R3BHNNMC7HAHXG/onUjb/lYjw== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1429675359 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18227 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi Lukas, ----- Original Message ----- > [...] > I've also moved the python user tools under src/pcp, and created their > own sub package: pcp-system-tools. This was required, as now both > python and perl bindings are no longer installed by default (in an > attempt to lower the default footprint). As with the pmdas, this > package will be dragged in on existing releases. I've also added > symlinks to their previous commands, so no change is required when > invoking the tools. Nice. > Overall these changes have reduced the default footprint from 51mb to > 7mb. Good stuff, Mark will be happy. :) > Any comments are appreciated. Frank has already pointed out on IRC, a > pcp-full-collection style package, which requires and installs the full > pcp set of packages would be nice to have. Especially as a convienience > to the user. I think this is a great idea, and unless there is strong > opposition to it, will be adding that asap. The documentation refers to concepts of 'pcp collector' and 'pcp monitor' installations (which also reflects the common deployment model) - it would make alot of sense to have two packages reflect that, if possible, rather than one mega package. cheers. -- Nathan From nscott@redhat.com Tue Apr 21 23:23:41 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id E4F7E7CBE for ; Tue, 21 Apr 2015 23:23:40 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 6E95CAC003 for ; Tue, 21 Apr 2015 21:23:37 -0700 (PDT) X-ASG-Debug-ID: 1429676614-04cbb056b2376280001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id vHQsgPQKqAEyEijf (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 21 Apr 2015 21:23:35 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3M4NFcI002785; Wed, 22 Apr 2015 00:23:15 -0400 Date: Wed, 22 Apr 2015 00:23:15 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <681874759.4524910.1429676595258.JavaMail.zimbra@redhat.com> In-Reply-To: <5536B493.5070208@internode.on.net> References: <20150420174712.GH18943@marquez.int.rhx> <5536B493.5070208@internode.on.net> Subject: Re: [pcp] Bug/Issue tracker MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Bug/Issue tracker Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.176.220] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Bug/Issue tracker Thread-Index: I38+9z+Ok/cq7gWG/A0niNxI+Wg0iQ== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1429676615 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18227 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Ken, ----- Original Message ----- > [...] > My thoughts on this are ... > > - I don't like multiple issue tracking repositories +1 > - the current github spate seems to have been triggered by the Netflix > Vector announcement, and I wonder if it will continue No doubt that's the trigger, but the point is people have (100%) chosen to report their pcp problems via either github or email, noone has used bugzilla at all so far (aaaand... no doubt someone now will). > - since many of the github "issues" seem to be really, in the "this does > not work for me" or "this does not seem right" categories, I would > suggest we actively engage with the github posters to answer their > questions and (a) close the issue, or (b) when it raises a real problem > move the issue to one of the bugzilla repositories and then close the > issue on github Hmm, I agree with (a) but the (b) above seems like double handling to me with no added value. > This would turn the github "issues" into more of a forum, and leave the > hard core issue tracking as it is today ... split in TWO places, sigh. Well the opportunity if before us right now to resolve this since Michele is offering to do the work of consolidating the two - is there any reason why "hard core" issues couldn't be tracked in github instead? cheers. -- Nathan From nscott@redhat.com Wed Apr 22 02:37:48 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id B14057F37 for ; Wed, 22 Apr 2015 02:37:48 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id A398E8F8065 for ; Wed, 22 Apr 2015 00:37:48 -0700 (PDT) X-ASG-Debug-ID: 1429688261-04cb6c1cc8336400001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id 4cdMd8KrhOir5ywq (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 00:37:42 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3M7bfbQ017279 for ; Wed, 22 Apr 2015 03:37:41 -0400 Date: Wed, 22 Apr 2015 03:37:40 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp developers Message-ID: <343985277.4632156.1429688260984.JavaMail.zimbra@redhat.com> Subject: pcp updates: fixes, hotproc MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: fixes, hotproc Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.221] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: fixes, hotproc Thread-Index: 0FK494qRQakG1a8u4HdioZnuwytVIg== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1429688262 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18230 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/nathans/pcp.git master src/include/pcp/config.h.in | 6 src/include/pcp/fault.h | 6 src/include/pcp/impl.h | 6 src/include/pcp/import.h | 6 src/include/pcp/mmv_dev.h | 6 src/include/pcp/mmv_stats.h | 6 src/include/pcp/platform_defs.h.in | 6 src/include/pcp/pmafm.h | 6 src/include/pcp/pmapi.h | 6 src/include/pcp/pmda.h | 6 src/include/pcp/pmtime.h | 6 src/include/pcp/trace.h | 6 src/include/pcp/trace_dev.h | 6 src/pmcd/rc_pmcd | 3 src/pmdas/GNUmakefile | 2 src/pmdas/hotproc/GNUakefile | 52 - src/pmdas/hotproc/GNUmakefile | 157 --- src/pmdas/hotproc/Install | 150 --- src/pmdas/hotproc/README | 141 --- src/pmdas/hotproc/Remove | 38 src/pmdas/hotproc/fixpmns.awk | 35 src/pmdas/hotproc/general.conf | 27 src/pmdas/hotproc/general.pmie | 29 src/pmdas/hotproc/help.fmt | 36 src/pmdas/hotproc/help.hotproc | 141 --- src/pmdas/hotproc/pmns.hotproc | 34 src/pmdas/hotproc/root | 10 src/pmdas/hotproc/sample.conf | 15 src/pmdas/hotproc/src/GNUmakefile | 34 src/pmdas/hotproc/src/config.c | 569 ------------ src/pmdas/hotproc/src/config.h | 79 - src/pmdas/hotproc/src/ctltab.c | 66 - src/pmdas/hotproc/src/error.c | 40 src/pmdas/hotproc/src/gram.y | 163 --- src/pmdas/hotproc/src/gram_node.c | 199 ---- src/pmdas/hotproc/src/gram_node.h | 69 - src/pmdas/hotproc/src/hotproc.c | 1555 ----------------------------------- src/pmdas/hotproc/src/hotproc.h | 52 - src/pmdas/hotproc/src/lex.l | 115 -- src/pmdas/hotproc/src/pcpu.c | 100 -- src/pmdas/hotproc/src/pcpu.h | 31 src/pmdas/hotproc/src/pglobal.c | 93 -- src/pmdas/hotproc/src/pglobal.h | 41 src/pmdas/hotproc/src/ppred_values.c | 163 --- src/pmdas/hotproc/src/ppred_values.h | 39 src/pmdas/linux_proc/pmdahotproc.1 | 214 ---- src/pmdas/linux_proc/proc_pid.c | 2 src/pmdas/systemtap/.gitignore | 4 src/pmdas/systemtap/GNUmakefile | 45 - src/pmdas/systemtap/Install | 32 src/pmdas/systemtap/README | 59 - src/pmdas/systemtap/Remove | 29 src/pmdas/systemtap/pmdasystemtap.1 | 87 - src/pmdas/systemtap/pmdasystemtap.pl | 86 - src/pmdas/systemtap/probes.stp | 6 55 files changed, 82 insertions(+), 4838 deletions(-) commit 3466b57582dbe444b85e09af8aa338f221cf949c Author: Nathan Scott Date: Wed Apr 22 17:25:02 2015 +1000 rc_pmcd: remove a now-redundant chdir after martins fix commit e14233eb81a9b777220921690768bc06a245796a Author: Nathan Scott Date: Wed Apr 22 16:33:56 2015 +1000 headers: make cpp #include macro guards more conventional As discussed in https://github.com/performancecopilot/pcp/issues/7 commit 561c7900516e9f251c039b02d6f4adf4ae21aca8 Author: Nathan Scott Date: Wed Apr 22 11:35:00 2015 +1000 build: removed old-variants of freshly renovated code commit 2093535ac6dc866b4e5d99e1f11b39cf6c5f74a9 Author: Martins Innus Date: Tue Apr 21 19:36:56 2015 +0000 hotproc - Add some more detail to the man page commit 34db01726b6b91ed7e5a37e3af75a61487924eab Author: Martins Innus Date: Tue Apr 21 17:38:54 2015 +0000 hotproc : fix an off by one error for fname configs commit 4588745c412196c1bd1b80e36afcee8276d6a658 Author: Martins Innus Date: Tue Apr 21 12:59:24 2015 +0000 Allow more than one .NeedInstall to occur at a time Chnage back to PCP_PMDAS_DIR after installing a pmda From nscott@redhat.com Wed Apr 22 02:43:37 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 03BB87F37 for ; Wed, 22 Apr 2015 02:43:37 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 90381AC004 for ; Wed, 22 Apr 2015 00:43:36 -0700 (PDT) X-ASG-Debug-ID: 1429688605-04bdf06322372820001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id tHEvAcOan1EaACfm (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 00:43:26 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3M7hOfi007539; Wed, 22 Apr 2015 03:43:24 -0400 Date: Wed, 22 Apr 2015 03:43:24 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus Cc: pcp developers Message-ID: <1566206962.4633612.1429688604112.JavaMail.zimbra@redhat.com> In-Reply-To: <5536A934.8040002@buffalo.edu> References: <5536A934.8040002@buffalo.edu> Subject: Re: [pcp] Hotproc fixes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.221] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Hotproc fixes Thread-Index: g58RhwZBwSHkrU1JQYXBxoTP+QX6TQ== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1429688606 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18231 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > Hi, > Here are a few cleanups to hotproc. Fixes an off by one error > where the fname configuration wasn't working. Also started a cleanup of > the manpage to try to make clear that this is part of the standard proc > pmda and also give some more configuration information. More work to do > here still. > > https://github.com/ubccr/pcp/tree/hotproc_cleanups > > Probably should archive the old hotproc directory somewhere and leave a > pointer to the new stuff. If you let me know how to handle that, just a > wholesale "git rm", or something else, I can do that as well. I've pushed that and some others to git://git.pcp.io/nathans/pcp.git - it looks like the pmdahotproc.1 man page is not installed BTW. That should probably be condensed down into a new section in pmdaproc.1 about hotproc and git-rm the old man page. We should add a simple hotproc fname QA test I think (pmstore a hotproc config like 'fname == pmdaproc' then "pminfo --fetch hotproc.nproc" will be deterministically "1", exercising this fix) - I'll put that together tomorrow. cheers. -- Nathan From wwwrun@oss.sgi.com Wed Apr 22 04:29:21 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 02DF87F51; Wed, 22 Apr 2015 04:29:21 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1067] linux pmda does too much work for network.interface queries Date: Wed, 22 Apr 2015 09:29:20 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: michele@acksyn.org X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1429694961.fe3Fd5.26612"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1429694961.fe3Fd5.26612 Date: Wed, 22 Apr 2015 04:29:20 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1067 --- Comment #9 from Michele Baldessari --- Hi Carlos, I saw something similar when I did an upgrade from stock fedora rpm to patched rpms built with makekpg. After a reboot it all worked correctly but I did not manage to investigate into detail why that happened. Can you make sure that is not the case? Also can you paste an "ip a" output so I can try and mimic your setup in case the above is not relevant? cheers, Michele -- You are receiving this mail because: You are on the CC list for the bug. --1429694961.fe3Fd5.26612 Date: Wed, 22 Apr 2015 04:29:20 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8"

Comment # 9 on bug 1067 from 
Hi Carlos,

I saw something similar when I did an upgrade from stock fedora rpm to
patched rpms built with makekpg. After a reboot it all worked correctly but
I did not manage to investigate into detail why that happened. Can you make
sure that is not the case?

Also can you paste an "ip a" output so I can try and mimic your setup in case
the above is not relevant?

cheers,
Michele

You are receiving this mail because:
  • You are on the CC list for the bug.
--1429694961.fe3Fd5.26612-- From fche@redhat.com Wed Apr 22 06:59:14 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 176407F37 for ; Wed, 22 Apr 2015 06:59:14 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 92976AC002 for ; Wed, 22 Apr 2015 04:59:10 -0700 (PDT) X-ASG-Debug-ID: 1429703948-04cb6c1cc733d190001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id fg8QIgfB7BNi66so (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 04:59:09 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3MBx7WP025267 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 22 Apr 2015 07:59:08 -0400 Received: from fche.csb (vpn-225-93.phx2.redhat.com [10.3.225.93]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3MBx7jN023042; Wed, 22 Apr 2015 07:59:07 -0400 Received: by fche.csb (Postfix, from userid 2569) id 4918A5853E; Wed, 22 Apr 2015 07:59:03 -0400 (EDT) Date: Wed, 22 Apr 2015 07:59:03 -0400 From: "Frank Ch. Eigler" To: Nathan Scott Cc: pcp developers Subject: Re: [pcp] pcp updates: pmmgr, pmwebd Message-ID: <20150422115903.GQ6822@redhat.com> X-ASG-Orig-Subj: Re: [pcp] pcp updates: pmmgr, pmwebd References: <20150421224405.GN6822@redhat.com> <1770973441.4434135.1429660410730.JavaMail.zimbra@redhat.com> <20150422000720.GO6822@redhat.com> <1086935455.4499240.1429674979133.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1086935455.4499240.1429674979133.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429703949 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - > [...] until then, I guess there's no point merging any new code that > relies on those fixes. There is no need for a chicken-and-egg paradox. The code can go in harmlessly, and be ready for use in testing the fixes, or for use for those unaffected by the pcp core bugs. Similarly, I'm planning to add some pmwebd code to help brolley get some early use out of the archive-directory machinery, which should also be harmless to current users. - FChE From kenj@internode.on.net Wed Apr 22 07:36:30 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 8C05D7F37 for ; Wed, 22 Apr 2015 07:36:30 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 6F45A304039 for ; Wed, 22 Apr 2015 05:36:27 -0700 (PDT) X-ASG-Debug-ID: 1429706184-04bdf0632037a870001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id S8whJCX3clCPReJs for ; Wed, 22 Apr 2015 05:36:25 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2CzAQAJlTdVPKEh0XYNTodSgy2/QAmEdoJdAoFuFAEBAQEBAQEGAQEBATiEXAEBBCMVQAEQCxgCAgUWCwICCQMCAQIBMRQGDQEHAQG+PHCVGQEBAQEBAQEBAgEBAQEBAQEbgSGKFoUEB4JogUUBBLEJhCeDIQEBAQ Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail05.adl6.internode.on.net with ESMTP; 22 Apr 2015 22:06:24 +0930 Message-ID: <553795CE.8010105@internode.on.net> Date: Wed, 22 Apr 2015 22:36:30 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp@oss.sgi.com Subject: Re: [pcp] Bug/Issue tracker References: <20150420174712.GH18943@marquez.int.rhx> <5536B493.5070208@internode.on.net> <681874759.4524910.1429676595258.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Bug/Issue tracker In-Reply-To: <681874759.4524910.1429676595258.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1429706184 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18236 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 22/04/15 14:23, Nathan Scott wrote: > ... > Well the opportunity if before us right now to resolve this since Michele > is offering to do the work of consolidating the two - is there any reason > why "hard core" issues couldn't be tracked in github instead? No objection from me ... I don't particularly like bugzilla and a quick tyre kick of github's issues service seems pretty basic but probably OK, except for the lack of any file upload and attach to an issue ... which could be a real pain for us with log files. Also we are already seeing pull requests on github so we need to think about encouraging this and how we'll manage these with the oss trees and the local repos of the hard core PCP developers. From myllynen@redhat.com Wed Apr 22 08:25:47 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id B0F4F7F37 for ; Wed, 22 Apr 2015 08:25:47 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id A06F28F8049 for ; Wed, 22 Apr 2015 06:25:44 -0700 (PDT) X-ASG-Debug-ID: 1429709143-04cb6c1cc933f730001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 1zwHjTEQoyIEKuBG (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 06:25:43 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3MDPf0h007981 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 22 Apr 2015 09:25:42 -0400 Received: from localhost.localdomain (vpn1-5-76.ams2.redhat.com [10.36.5.76]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3MDPeWR003256 for ; Wed, 22 Apr 2015 09:25:41 -0400 Message-ID: <5537A154.2090803@redhat.com> Date: Wed, 22 Apr 2015 16:25:40 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] Hotproc fixes References: <5536A934.8040002@buffalo.edu> X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes In-Reply-To: <5536A934.8040002@buffalo.edu> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429709143 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, On 2015-04-21 22:47, Martins Innus wrote: > Hi, > Here are a few cleanups to hotproc. Fixes an off by one error where > the fname configuration wasn't working. Also started a cleanup of the > manpage to try to make clear that this is part of the standard proc pmda > and also give some more configuration information. thanks, looking good already. I tried using the configuration file, not sure is it behaving as intended? # cat hotproc.conf #pmdahotproc Version 1.0 fname == "firefox" # pmstore hotproc.control.config 'fname == "firefox"' hotproc.control.config old value="#pmdahotproc Version 1.0 fname == "firefox" " new value="fname == "firefox"" # Thanks, -- Marko Myllynen From myllynen@redhat.com Wed Apr 22 08:26:15 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 3F9507F37 for ; Wed, 22 Apr 2015 08:26:15 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 2F2AF8F8035 for ; Wed, 22 Apr 2015 06:26:15 -0700 (PDT) X-ASG-Debug-ID: 1429709174-04cb6c1cc933f770001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id HQlEeGkHXVUFv3aq (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 06:26:14 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3MDQDJB027397 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 22 Apr 2015 09:26:13 -0400 Received: from localhost.localdomain (vpn1-5-76.ams2.redhat.com [10.36.5.76]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3MDQCTW018825 for ; Wed, 22 Apr 2015 09:26:13 -0400 Message-ID: <5537A174.9070403@redhat.com> Date: Wed, 22 Apr 2015 16:26:12 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] Accessing instance specific metrics References: <5534C680.2020709@redhat.com> <5536317C.5000600@redhat.com> <5536B319.1090805@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] Accessing instance specific metrics In-Reply-To: <5536B319.1090805@internode.on.net> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429709174 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, On 2015-04-21 23:29, Ken McDonell wrote: > On 21/04/15 21:16, Marko Myllynen wrote: >> ... and >> -i "11173 java" won't work. > > But I would expect -i "'11173 java'" or -i '"11173 java"' to work. > > The nested quoting is unusual (but documented in the pmval(1) man page) > as a result of the "special" significance of white space in an external > instance name, i.e. an instance name must be unique across an instance > domain up to the first white space in the name. thanks, I'm happy to confirm it works as you suggested. I think I missed or misread the man page where it says that, there are indeed example a bit below but the "or" in the description didn't hint that strongly toward nested quoting. " The instance name may be quoted with single (’) or double (") quotes for those cases where the instance name contains white space or commas. " Cheers, -- Marko Myllynen From minnus@buffalo.edu Wed Apr 22 08:36:54 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id C44A27F37 for ; Wed, 22 Apr 2015 08:36:54 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id B308D8F8035 for ; Wed, 22 Apr 2015 06:36:54 -0700 (PDT) X-ASG-Debug-ID: 1429709812-04cbb056b2383680001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id qOALmZ5oH3uJFtkg for ; Wed, 22 Apr 2015 06:36:53 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmailA.acsu.buffalo.edu (localmaila.acsu.buffalo.edu [128.205.5.196]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 91D1E8E6; Wed, 22 Apr 2015 09:36:52 -0400 (EDT) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 8C834109E1; Wed, 22 Apr 2015 09:36:52 -0400 (EDT) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailA.acsu.buffalo.edu (Postfix) with ESMTP id 11941109DE; Wed, 22 Apr 2015 09:36:52 -0400 (EDT) Received: from smtp.buffalo.edu (smtp4.acsu.buffalo.edu [128.205.5.229]) by localmailA.acsu.buffalo.edu (Prefixe) with ESMTP id F21E0109DD; Wed, 22 Apr 2015 09:36:51 -0400 (EDT) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id EC0F65F94E; Wed, 22 Apr 2015 09:36:51 -0400 (EDT) Message-ID: <5537A3F3.5060204@buffalo.edu> Date: Wed, 22 Apr 2015 09:36:51 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: myllynen@redhat.com, pcp@oss.sgi.com Subject: Re: [pcp] Hotproc fixes References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes In-Reply-To: <5537A154.2090803@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: X: 10% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1429709812 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18237 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Marko, On 4/22/15 9:25 AM, Marko Myllynen wrote: > Hi, > > On 2015-04-21 22:47, Martins Innus wrote: >> Hi, >> Here are a few cleanups to hotproc. Fixes an off by one error where >> the fname configuration wasn't working. Also started a cleanup of the >> manpage to try to make clear that this is part of the standard proc pmda >> and also give some more configuration information. > thanks, looking good already. I tried using the configuration file, not > sure is it behaving as intended? > > # cat hotproc.conf > #pmdahotproc > Version 1.0 > > fname == "firefox" > # pmstore hotproc.control.config 'fname == "firefox"' > hotproc.control.config old value="#pmdahotproc > Version 1.0 > > fname == "firefox" > " new value="fname == "firefox"" > # > It should be working though, right? It shouldn't affect operation, but I can look into dumping the extra info at file parse time. Martins From myllynen@redhat.com Wed Apr 22 08:42:39 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 650577F37 for ; Wed, 22 Apr 2015 08:42:39 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 0B7C8AC005 for ; Wed, 22 Apr 2015 06:42:35 -0700 (PDT) X-ASG-Debug-ID: 1429710151-04bdf0632237ccf0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id eXKZ8Lj5q3Z1ddQv (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 06:42:32 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3MDgTE7014227 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Wed, 22 Apr 2015 09:42:30 -0400 Received: from localhost.localdomain (vpn1-5-76.ams2.redhat.com [10.36.5.76]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3MDgQit014738; Wed, 22 Apr 2015 09:42:28 -0400 Message-ID: <5537A542.6080905@redhat.com> Date: Wed, 22 Apr 2015 16:42:26 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Martins Innus , pcp@oss.sgi.com Subject: Re: [pcp] Hotproc fixes References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes In-Reply-To: <5537A3F3.5060204@buffalo.edu> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429710152 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, On 2015-04-22 16:36, Martins Innus wrote: > On 4/22/15 9:25 AM, Marko Myllynen wrote: >> On 2015-04-21 22:47, Martins Innus wrote: >> thanks, looking good already. I tried using the configuration file, not >> sure is it behaving as intended? >> >> # cat hotproc.conf >> #pmdahotproc >> Version 1.0 >> >> fname == "firefox" >> # pmstore hotproc.control.config 'fname == "firefox"' >> hotproc.control.config old value="#pmdahotproc >> Version 1.0 >> >> fname == "firefox" >> " new value="fname == "firefox"" >> # >> > It should be working though, right? It shouldn't affect operation, but > I can look into dumping the extra info at file parse time. yeah, it works ok but it's perhaps slightly confusing. Thanks, -- Marko Myllynen From fche@redhat.com Wed Apr 22 09:37:51 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 3F6CB7F37 for ; Wed, 22 Apr 2015 09:37:51 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 20FBC8F8040 for ; Wed, 22 Apr 2015 07:37:48 -0700 (PDT) X-ASG-Debug-ID: 1429713466-04bdf0632337ed50001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id biHtkui3lsDTpBik (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 07:37:47 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3MEbiwM032671 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Wed, 22 Apr 2015 10:37:44 -0400 Received: from fche.csb (vpn-225-93.phx2.redhat.com [10.3.225.93]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3MEbhNI024305; Wed, 22 Apr 2015 10:37:43 -0400 Received: by fche.csb (Postfix, from userid 2569) id D325E5853E; Wed, 22 Apr 2015 10:37:39 -0400 (EDT) To: Nathan Scott Cc: Ken McDonell , pcp@oss.sgi.com Subject: Re: Bug/Issue tracker References: <20150420174712.GH18943@marquez.int.rhx> <5536B493.5070208@internode.on.net> <681874759.4524910.1429676595258.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: Bug/Issue tracker From: fche@redhat.com (Frank Ch. Eigler) Date: Wed, 22 Apr 2015 10:37:39 -0400 In-Reply-To: <681874759.4524910.1429676595258.JavaMail.zimbra@redhat.com> (Nathan Scott's message of "Wed, 22 Apr 2015 00:23:15 -0400 (EDT)") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429713467 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 nathans wrote: > [...] Well the opportunity if before us right now to resolve this > since Michele is offering to do the work of consolidating the two > [...] I missed where anyone volunteered to consolidate. Last I read, he acknowleged it as essential, but that's not the same thing. Considering though that you've already granted that the various per-distro bug trackers are going to stick around, ergo we developers must already put up with a handful of them, perhaps the worry of a single additional little one from github is overwrought. - FChE From fche@redhat.com Wed Apr 22 09:47:13 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 19AF17F37 for ; Wed, 22 Apr 2015 09:47:13 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 06D3D8F8035 for ; Wed, 22 Apr 2015 07:47:12 -0700 (PDT) X-ASG-Debug-ID: 1429714028-04cbb056b1385920001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id qVgMFO0TgnXJg6xc (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 07:47:08 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3MEl7Hb025673 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 22 Apr 2015 10:47:08 -0400 Received: from fche.csb (vpn-225-93.phx2.redhat.com [10.3.225.93]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3MEl7S9014074; Wed, 22 Apr 2015 10:47:07 -0400 Received: by fche.csb (Postfix, from userid 2569) id C33685853E; Wed, 22 Apr 2015 10:47:03 -0400 (EDT) To: Lukas Berk Cc: pcp@oss.sgi.com Subject: Re: [RFC] Minimizing Installation Size for Reduced PCP Footprint References: <87bnk0wzn5.fsf@redhat.com> <877ft59dmo.fsf@redhat.com> X-ASG-Orig-Subj: Re: [RFC] Minimizing Installation Size for Reduced PCP Footprint From: fche@redhat.com (Frank Ch. Eigler) Date: Wed, 22 Apr 2015 10:47:03 -0400 In-Reply-To: <877ft59dmo.fsf@redhat.com> (Lukas Berk's message of "Tue, 21 Apr 2015 21:05:03 -0400") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429714028 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 lberk wrote: > [...] Just about every pmda except core ones have been split into > their own pcp-pmda- package [...] FWIW, I haven't been fond of the flock of numerous tiny subrpms for tools like nagios-plugins-*, or texlive-*. There is a real mental overhead in juggling so many little things. If the -purpose- of subdivision is to minimize undesired dependencies, then one could lump together pmdas with the same prereqs (say, all python ones). Anyway, such detailed subdivision is to stay, perhaps the case could be made that by the act of installing these rpms, a sysadmin must really want them ... so include a pmda .NeedInstall file for each? - FChE From wwwrun@oss.sgi.com Wed Apr 22 12:21:21 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id EE1AD7F55; Wed, 22 Apr 2015 12:21:21 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1067] linux pmda does too much work for network.interface queries Date: Wed, 22 Apr 2015 17:21:21 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: cltorrespr@gmail.com X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1429723281.cabbDeD5.28011"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1429723281.cabbDeD5.28011 Date: Wed, 22 Apr 2015 12:21:21 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1067 --- Comment #10 from Carlos L. Torres --- Created attachment 329 --> http://oss.sgi.com/bugzilla/attachment.cgi?id=329&action=edit ip_address_output.txt Michele, I pulled the latest changes from the git repo, then applied the patch, and re-compiled and re-installed everything, and got the segfault when requesting network data. Then, I tried a reboot, but still I have the same problem. Attached you find the output of ip a (there are about 23 interfaces) These are distro and kernel version I'm running on in case you need it: Ubuntu 14.04.2 LTS Linux 3.13.0-34-generic #60-Ubuntu SMP Wed Aug 13 15:45:27 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux and the PCP versions, and PMDAs I'm running: services: pmcd pmwebd pmcd: Version 3.10.5-1, 6 agents, 1 client pmda: root pmcd proc xfs linux[720904] mmv jbd2 -- You are receiving this mail because: You are on the CC list for the bug. --1429723281.cabbDeD5.28011 Date: Wed, 22 Apr 2015 12:21:21 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8"

Comment # 10 on bug 1067 from 
Created attachment 329 [details]
ip_address_output.txt

Michele,

I pulled the latest changes from the git repo, then applied the patch, and
re-compiled and re-installed everything, and got the segfault when requesting
network data. Then, I tried a reboot, but still I have the same problem.

Attached you find the output of  ip a (there are about 23 interfaces)

These are distro and kernel version I'm running on in case you need it:

Ubuntu 14.04.2 LTS
Linux 3.13.0-34-generic #60-Ubuntu SMP Wed Aug 13 15:45:27 UTC 2014 x86_64
x86_64 x86_64 GNU/Linux

and the PCP versions, and PMDAs I'm running:

services: pmcd pmwebd
     pmcd: Version 3.10.5-1, 6 agents, 1 client
     pmda: root pmcd proc xfs linux[720904] mmv jbd2

You are receiving this mail because:
  • You are on the CC list for the bug.
--1429723281.cabbDeD5.28011-- From minnus@buffalo.edu Wed Apr 22 15:01:49 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 398817F37 for ; Wed, 22 Apr 2015 15:01:49 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id BB1ECAC002 for ; Wed, 22 Apr 2015 13:01:45 -0700 (PDT) X-ASG-Debug-ID: 1429732900-04cbb056b438fdd0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve2.acsu.buffalo.edu [128.205.7.162]) by cuda.sgi.com with ESMTP id 5uTtC52e4r88wce3 for ; Wed, 22 Apr 2015 13:01:40 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.162 Received: from localmailA.acsu.buffalo.edu (localmaila.acsu.buffalo.edu [128.205.5.196]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 491E93101; Wed, 22 Apr 2015 16:01:40 -0400 (EDT) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 424F1C313; Wed, 22 Apr 2015 16:01:40 -0400 (EDT) Received: from localmailA.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailA.acsu.buffalo.edu (Postfix) with ESMTP id B26B1C310; Wed, 22 Apr 2015 16:01:39 -0400 (EDT) Received: from smtp.buffalo.edu (smtp4.acsu.buffalo.edu [128.205.5.229]) by localmailA.acsu.buffalo.edu (Prefixe) with ESMTP id A6136C30F; Wed, 22 Apr 2015 16:01:39 -0400 (EDT) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id A147666F8F; Wed, 22 Apr 2015 16:01:39 -0400 (EDT) Message-ID: <5537FE23.4040006@buffalo.edu> Date: Wed, 22 Apr 2015 16:01:39 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: myllynen@redhat.com, pcp@oss.sgi.com Subject: Re: [pcp] Hotproc fixes References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> <5537A542.6080905@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes In-Reply-To: <5537A542.6080905@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: X: 10% X-Barracuda-Connect: mtareserve2.acsu.buffalo.edu[128.205.7.162] X-Barracuda-Start-Time: 1429732900 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18247 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Marko, On 4/22/15 9:42 AM, Marko Myllynen wrote: > Hi, > > On 2015-04-22 16:36, Martins Innus wrote: >> On 4/22/15 9:25 AM, Marko Myllynen wrote: >>> On 2015-04-21 22:47, Martins Innus wrote: >>> thanks, looking good already. I tried using the configuration file, not >>> sure is it behaving as intended? >>> >>> # cat hotproc.conf >>> #pmdahotproc >>> Version 1.0 >>> >>> fname == "firefox" >>> # pmstore hotproc.control.config 'fname == "firefox"' >>> hotproc.control.config old value="#pmdahotproc >>> Version 1.0 >>> >>> fname == "firefox" >>> " new value="fname == "firefox"" >>> # >>> >> It should be working though, right? It shouldn't affect operation, but >> I can look into dumping the extra info at file parse time. > yeah, it works ok but it's perhaps slightly confusing. > Sure. Ok, was an easy change. Ill send once I finish up the documentation changes. Martins From nscott@redhat.com Wed Apr 22 17:36:57 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 32C817F37 for ; Wed, 22 Apr 2015 17:36:57 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id B3D8AAC004 for ; Wed, 22 Apr 2015 15:36:56 -0700 (PDT) X-ASG-Debug-ID: 1429742210-04cb6c1cc934fb90001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id VzR11lPu0FEhEh4M (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 15:36:51 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3MMam0W005800; Wed, 22 Apr 2015 18:36:48 -0400 Date: Wed, 22 Apr 2015 18:36:47 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Michele Baldessari Cc: pcp@oss.sgi.com Message-ID: <1639923927.5201948.1429742207940.JavaMail.zimbra@redhat.com> In-Reply-To: References: <20150420174712.GH18943@marquez.int.rhx> <5536B493.5070208@internode.on.net> <681874759.4524910.1429676595258.JavaMail.zimbra@redhat.com> Subject: Re: Bug/Issue tracker MIME-Version: 1.0 X-ASG-Orig-Subj: Re: Bug/Issue tracker Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.221] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Bug/Issue tracker Thread-Index: KDzFRcu0MhM/kwLcTRGNGHbT/OGRLQ== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1429742211 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18249 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > > [...] Well the opportunity if before us right now to resolve this > > since Michele is offering to do the work of consolidating the two > > [...] > > I missed where anyone volunteered to consolidate. Last I read, he > acknowleged it as essential, but that's not the same thing. Assuming this, from your original mail Michele, is still the case... | I think that to make things easier for users it makes more sense to | switch to github fully for issue tracking purposes. If there is rough | consensus on this, I'll work on some test scripts to migrate all bugs | w/comments and attachments. ... it sounds like it'd be worth investigating the attachment side of things further (as per Kens last mail). If that's solvable, I guess we have as "rough consensus" as we ever tend to get, so lets move forward. Thanks for working on this. cheers. -- Nathan From nscott@redhat.com Wed Apr 22 17:49:52 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 891737F37 for ; Wed, 22 Apr 2015 17:49:52 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 03346AC004 for ; Wed, 22 Apr 2015 15:49:51 -0700 (PDT) X-ASG-Debug-ID: 1429742985-04cbb056b1393990001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id Lwp6dQ4ywTfSaZct (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 15:49:46 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3MMnj2O018504 for ; Wed, 22 Apr 2015 18:49:45 -0400 Date: Wed, 22 Apr 2015 18:49:45 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp developers Message-ID: <1670962342.5203133.1429742985256.JavaMail.zimbra@redhat.com> In-Reply-To: References: Subject: Fwd: [lca-announce] linux.conf.au 2016 dates and venue confirmed 1st-5th Feb 2016 MIME-Version: 1.0 X-ASG-Orig-Subj: Fwd: [lca-announce] linux.conf.au 2016 dates and venue confirmed 1st-5th Feb 2016 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Originating-IP: [10.64.50.221] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: linux.conf.au 2016 dates and venue confirmed 1st-5th Feb 2016 Thread-Index: KzryFlhUyKSIlKoC/Gzzz7DaXUimgg== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1429742985 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18250 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi all, Please see announcement below regarding linux.conf.au. Next year it is being held in Geelong, just outside Melbourne, where we have a strong contingent of PCP developers, users and deployments. It will be a great opportunity to meet up with like-minded people from the list &| IRC. It will also be prime summertime down under, so a great time for a holiday and to escape the northern hemisphere winter! Geelong is also very close to my home town, so for any international or interstate folks attending, feel free to contact me as I may be able to help out with finding good local accommodation, airport transfers, etc. See you all there! :) cheers. ----- Forwarded Message ----- From: "linux.conf.au Announcements" To: lca-announce@lists.linux.org.au, "Linux Australia List" Sent: Wednesday, April 22, 2015 8:42:13 PM Subject: [lca-announce] linux.conf.au 2016 dates and venue confirmed 1st-5t= h Feb 2016 The linux.conf.au 2016 Geelong - LCA By the Bay team is thrilled to confirm= dates and venue for LCA 2016. The conference will happen between 1st-5th F= ebruary at Deakin University=E2=80=99s architecturally spectacular Waterfro= nt campus, situated just a block from the cafe and foodie precinct of Easte= rn Beach, and two blocks from Geelong=E2=80=99s vibrant CBD.=20 The Call for Presentations (CfP) for linux.conf.au are expected to open in = June.=20 Potential Delegates and Speakers are encouraged to remain up to date with c= onference news through one of the following channels;=20 Website: http://lcabythebay.org ,au=20 Twitter: @linuxconfau, hashtag #lca2016=20 Facebook: https://www.facebook.com/lcabythebay=20 Google+: https://www.google.com/+LcabythebayOrgAu=20 Lanyrd: http://lanyrd.com/2016/linuxconfau/=20 IRC: # linux.conf.au on freenode.net=20 Email: info@lcabythebay.org.au=20 Announce mailing list: http://lists.linux.org.au/mailman/listinfo/lca-annou= nce=20 We warmly encourage you to forward this announcement to technical communiti= es you may be involved in.=20 Kind regards,=20 David=20 --=20 David Bell=20 Conference Director linux.conf.au 2016=20 @linuxconfau=20 info@lcabythebay.org.au=20 http://lcabythebay.org.au=20 _______________________________________________ lca-announce mailing list lca-announce@lists.linux.org.au http://lists.linux.org.au/mailman/listinfo/lca-announce From kenj@internode.on.net Wed Apr 22 18:30:42 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 2958B7F37 for ; Wed, 22 Apr 2015 18:30:42 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id B788BAC002 for ; Wed, 22 Apr 2015 16:30:38 -0700 (PDT) X-ASG-Debug-ID: 1429745432-04bdf0632338ed80001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id fbuHaE8OFqSTkKeI for ; Wed, 22 Apr 2015 16:30:32 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2CWAQAiLjhV/6Eh0XYNToNeXIMYxEaGDIICAQEBAQEBhS4nBFEBLwYCBRYLAgsDAgECAVgBBQIBARW/EXCVAQEBAQEGAiCBIY8agm+BRQWGNI8Ih0uQQYNOgicZBIFjXYJEAQEB Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail07.adl2.internode.on.net with ESMTP; 23 Apr 2015 09:00:31 +0930 Message-ID: <55382F13.8080906@internode.on.net> Date: Thu, 23 Apr 2015 09:30:27 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com CC: "Smith, Paul" , "Frank Ch. Eigler" Subject: pcp updates - interp.c is the biggie Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - interp.c is the biggie Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1429745432 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18251 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Paul and Frank ... I think this finally (sigh) nails your PCP archive poor performance problems. Changes committed to git://git.pcp.io/kenj/pcp master Ken McDonell (4): libpcp/derive.c: fix typo in diagnostic message qa/admin/check-vm: Add note to ignore networking warnings if not running QA libpcp/interp.c: another performance improvement libpcp/interp.c: major breakthrough! qa/180.out.3 | 2 +- qa/787.out | 8 ++++---- qa/admin/check-vm | 11 +++++++---- src/libpcp/src/derive.c | 2 +- src/libpcp/src/interp.c | 48 +++++++++++++++++++++++++++--------------------- 5 files changed, 40 insertions(+), 31 deletions(-) Details ... commit 2a3b5ff6668c13791e9c9df64673419dd7903281 Author: Ken McDonell Date: Thu Apr 23 09:10:07 2015 +1000 libpcp/interp.c: major breakthrough! One and off for more than 15 months(!), I've been trying to understand two guards that control the backwards and forwards searching when trying to "bound" a metric-instance for a point in time value interpolation from a PCP archive. This is in the dark heart of some of the most complex code in libpcp, and sometimes was observed to trigger obscene amounts of archive record reading, and re-reading, and re-reading ... In the guards one clause in particular made no sense to me ... but each time I tried to remove these clauses or refine them so they made less nonsense, there were a spate of hard to understand and harder to diagnose QA failures. After many other changes to improve the logic in the code to deal with unrelated corner cases, I finally was down to a single QA anomaly. In desperation, I removed the "makes no sense to me guards" and bingo! All tests pass, and the performance problems reported by Frank (in a pmmgr context) and Paul Smith (in a pmchart context with big production archives) have both gone away _and_ interp mode seems to produce the correct metric values across all of the QA tests. With hindsight, it appears the guards were an incorrect attempt to address logic errors elsewhere, and when these other errors were finally all fixed properly, the guards were no longer needed for correctness, but they did sometimes trigger lots of archive reading that was not required. For the historical record the guard that has been dropped is this one (for forward search and the similar one for backwards search): /* ... * t_next is a mark and t_next > t_req => need to search * back also (unless we've already scanned to this mark) ... */ ... (IS_MARK(icp->s_next) && !IS_SCANNED(icp->s_next) && icp->t_next > t_req) || Now back to the rest of my life! commit 8a28abe2c3ecd75daef3e01424a64523d8601738 Author: Ken McDonell Date: Thu Apr 23 08:31:12 2015 +1000 libpcp/interp.c: another performance improvement Small one this time, we're down to the obscure corner cases now. commit b113884be5060a1a99ddbef94baaab416638bbca Author: Ken McDonell Date: Thu Apr 23 08:29:17 2015 +1000 qa/admin/check-vm: Add note to ignore networking warnings if not running QA commit 81d987bf77a8f74d29847fd136fb903bee09c8d4 Author: Ken McDonell Date: Thu Apr 23 08:28:40 2015 +1000 libpcp/derive.c: fix typo in diagnostic message From mgoodwin@redhat.com Wed Apr 22 20:24:13 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id D60A57F37 for ; Wed, 22 Apr 2015 20:24:12 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 55373AC004 for ; Wed, 22 Apr 2015 18:24:11 -0700 (PDT) X-ASG-Debug-ID: 1429752246-04cb6c1cc7352860001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id DNq3fClc52XbnMFY (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 18:24:07 -0700 (PDT) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3N1NpBA028546 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Wed, 22 Apr 2015 21:23:51 -0400 Received: from [10.64.50.250] (vpn1-50-250.bne.redhat.com [10.64.50.250]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3N1Nlc8002756; Wed, 22 Apr 2015 21:23:48 -0400 Message-ID: <553849A3.9060002@redhat.com> Date: Thu, 23 Apr 2015 11:23:47 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: Ken McDonell , pcp@oss.sgi.com CC: "Frank Ch. Eigler" Subject: Re: [pcp] pcp updates - interp.c is the biggie References: <55382F13.8080906@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] pcp updates - interp.c is the biggie In-Reply-To: <55382F13.8080906@internode.on.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429752247 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi Ken, just trying to review these changes - I guess the crux of the issue falls on the "fixed logic errors elsewhere", as mentioned : 'With hindsight, it appears the guards were an incorrect attempt to address logic errors elsewhere, and when these other errors were finally all fixed properly, the guards were no longer needed for correctness, but they did sometimes trigger lots of archive reading that was not required.' So whilst I can review the code change involving the removal of the guard (which looks good at the surface), no idea what other fixes were made to remove the need for that guard. I think we can just take your word for it! I built and installed with these changes and checked qa/787 passes. But I've lost Frank and Paul's recipe for reproducing the archive replay performance issue - anyone have a reference to that handy? Regards -- Mark On 04/23/2015 09:30 AM, Ken McDonell wrote: > Paul and Frank ... I think this finally (sigh) nails your PCP archive poor performance problems. > > Changes committed to git://git.pcp.io/kenj/pcp master > > Ken McDonell (4): > libpcp/derive.c: fix typo in diagnostic message > qa/admin/check-vm: Add note to ignore networking warnings if not running QA > libpcp/interp.c: another performance improvement > libpcp/interp.c: major breakthrough! > > qa/180.out.3 | 2 +- > qa/787.out | 8 ++++---- > qa/admin/check-vm | 11 +++++++---- > src/libpcp/src/derive.c | 2 +- > src/libpcp/src/interp.c | 48 +++++++++++++++++++++++++++--------------------- > 5 files changed, 40 insertions(+), 31 deletions(-) > > Details ... > > commit 2a3b5ff6668c13791e9c9df64673419dd7903281 > Author: Ken McDonell > Date: Thu Apr 23 09:10:07 2015 +1000 > > libpcp/interp.c: major breakthrough! > > One and off for more than 15 months(!), I've been trying to > understand two guards that control the backwards and forwards > searching when trying to "bound" a metric-instance for a point in > time value interpolation from a PCP archive. This is in the dark > heart of some of the most complex code in libpcp, and sometimes > was observed to trigger obscene amounts of archive record reading, > and re-reading, and re-reading ... > > In the guards one clause in particular made no sense to me ... but > each time I tried to remove these clauses or refine them so they > made less nonsense, there were a spate of hard to understand and > harder to diagnose QA failures. > > After many other changes to improve the logic in the code to > deal with unrelated corner cases, I finally was down to a single > QA anomaly. In desperation, I removed the "makes no sense to me > guards" and bingo! > > All tests pass, and the performance problems reported by Frank > (in a pmmgr context) and Paul Smith (in a pmchart context with big > production archives) have both gone away _and_ interp mode seems > to produce the correct metric values across all of the QA tests. > > With hindsight, it appears the guards were an incorrect attempt > to address logic errors elsewhere, and when these other errors > were finally all fixed properly, the guards were no longer needed > for correctness, but they did sometimes trigger lots of archive > reading that was not required. > > For the historical record the guard that has been dropped is this one > (for forward search and the similar one for backwards search): > /* ... > * t_next is a mark and t_next > t_req => need to search > * back also (unless we've already scanned to this mark) > ... > */ > ... > (IS_MARK(icp->s_next) && !IS_SCANNED(icp->s_next) && icp->t_next > t_req) || > > Now back to the rest of my life! > > commit 8a28abe2c3ecd75daef3e01424a64523d8601738 > Author: Ken McDonell > Date: Thu Apr 23 08:31:12 2015 +1000 > > libpcp/interp.c: another performance improvement > > Small one this time, we're down to the obscure corner cases now. > > commit b113884be5060a1a99ddbef94baaab416638bbca > Author: Ken McDonell > Date: Thu Apr 23 08:29:17 2015 +1000 > > qa/admin/check-vm: Add note to ignore networking warnings if not running QA > > commit 81d987bf77a8f74d29847fd136fb903bee09c8d4 > Author: Ken McDonell > Date: Thu Apr 23 08:28:40 2015 +1000 > > libpcp/derive.c: fix typo in diagnostic message > > _______________________________________________ > pcp mailing list > pcp@oss.sgi.com > http://oss.sgi.com/mailman/listinfo/pcp > From goodwinos@gmail.com Wed Apr 22 20:36:37 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=FREEMAIL_FROM autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 475917F37 for ; Wed, 22 Apr 2015 20:36:37 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 36BBC8F8050 for ; Wed, 22 Apr 2015 18:36:37 -0700 (PDT) X-ASG-Debug-ID: 1429752992-04cbb056b3396790001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id Wm9cnNBKGuPlB4i1 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 18:36:33 -0700 (PDT) X-Barracuda-Envelope-From: goodwinos@gmail.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (Postfix) with ESMTPS id 6F8D68E905 for ; Thu, 23 Apr 2015 01:36:32 +0000 (UTC) Received: from [10.64.50.250] (vpn1-50-250.bne.redhat.com [10.64.50.250]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3N1aTln002268 for ; Wed, 22 Apr 2015 21:36:30 -0400 Message-ID: <55384C9B.2070400@gmail.com> Date: Thu, 23 Apr 2015 11:36:27 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint References: <87bnk0wzn5.fsf@redhat.com> <877ft59dmo.fsf@redhat.com> X-ASG-Orig-Subj: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429752993 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 04/23/2015 12:47 AM, Frank Ch. Eigler wrote: > > lberk wrote: > >> [...] Just about every pmda except core ones have been split into >> their own pcp-pmda- package [...] > > FWIW, I haven't been fond of the flock of numerous tiny subrpms for > tools like nagios-plugins-*, or texlive-*. There is a real mental > overhead in juggling so many little things. If the -purpose- of > subdivision is to minimize undesired dependencies, then one could lump > together pmdas with the same prereqs (say, all python ones). > > Anyway, such detailed subdivision is to stay, perhaps the case could > be made that by the act of installing these rpms, a sysadmin must > really want them ... so include a pmda .NeedInstall file for each? that's not going to be very practical if we ship the proposed uber 'install-everything' package. not unless we also implement deferred initialization, i.e. all installed PMDAs are ./Installed by default, but foo_init() would not be called until first fetch or other PMAPI function involving the domain. Regards -- Mark From wwwrun@oss.sgi.com Wed Apr 22 20:52:19 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 0D8CC7F4E; Wed, 22 Apr 2015 20:52:19 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1044] pmchart very slow when Overview-panning archive file with lots of records Date: Thu, 23 Apr 2015 01:52:18 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: mgoodwin@redhat.com X-Bugzilla-Status: RESOLVED X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: fche@redhat.com X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1429753939.AE1CB2.22014"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1429753939.AE1CB2.22014 Date: Wed, 22 Apr 2015 20:52:19 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1044 Mark Goodwin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mgoodwin@redhat.com --- Comment #8 from Mark Goodwin --- perhaps if someone could attach a tgz of super-SLOW-merged-archive-20140124.225919.{index,meta,[0-9]} we could manually check Ken's latest fix for this issue. That tarball would be too big to commit to qa/archives I presume. Thanks -- You are receiving this mail because: You are on the CC list for the bug. --1429753939.AE1CB2.22014 Date: Wed, 22 Apr 2015 20:52:19 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" changed bug 1044
What Removed Added
CC   mgoodwin@redhat.com

Comment # 8 on bug 1044 from 
perhaps if someone could attach a tgz of
super-SLOW-merged-archive-20140124.225919.{index,meta,[0-9]}  we could manually
check Ken's latest fix for this issue. That tarball would be too big to commit
to qa/archives I presume.

Thanks

You are receiving this mail because:
  • You are on the CC list for the bug.
--1429753939.AE1CB2.22014-- From nscott@redhat.com Wed Apr 22 21:17:39 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id C92DC7F37 for ; Wed, 22 Apr 2015 21:17:39 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id AA7D330404E for ; Wed, 22 Apr 2015 19:17:36 -0700 (PDT) X-ASG-Debug-ID: 1429755452-04bdf06322391b20001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id C4t61d9yFEHe6Imc (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 19:17:32 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3N2HSa6019111; Wed, 22 Apr 2015 22:17:28 -0400 Date: Wed, 22 Apr 2015 22:17:28 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: Lukas Berk , pcp developers Message-ID: <670202791.5237429.1429755448032.JavaMail.zimbra@redhat.com> In-Reply-To: <5536CD81.1070008@internode.on.net> References: <852862416.3748569.1429589380945.JavaMail.zimbra@redhat.com> <5536CD81.1070008@internode.on.net> Subject: Re: [patch] speed pmie startup MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [patch] speed pmie startup Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.221] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: speed pmie startup Thread-Index: hgvpirBU1bYBkw5CNCvbomL2gprdAg== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1429755452 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18254 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Ken, ----- Original Message ----- > [...] > But I can guess ... there was some initial concerns about pmie's fetch > scheduling getting behind, so fetchs are scheduled to happen at some > time that has already passed, and adding some arbitrary slop in the > start up gave a chance to parse the config file and get set up before > the first fetch. > > But we've done considerable work in the interim to improve the general > handling of the "scheduling getting behind" situation, so I don't think > the +1sec is needed at all ... so I'd suggest dropping the first + > 0.000000001 and the while second block if (!archives) { ... } can also go. OK, will verify that & update. > I just tried this, but there are other QA failures (from -g pmie), > namely 260 and 518 ... 260 looks like it would be OK with some tweaking, > but I'm not sure about 518. The 518 fix was in the original patch, but 260 hasn't been failing here at all so far - can you send me the .bad file? cheers. -- Nathan From kenj@internode.on.net Wed Apr 22 21:44:35 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 62E217F37 for ; Wed, 22 Apr 2015 21:44:35 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id E1CA0AC004 for ; Wed, 22 Apr 2015 19:44:34 -0700 (PDT) X-ASG-Debug-ID: 1429757071-04cb6c1cc7353b60001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id opA3DAN6gRSPBRvr for ; Wed, 22 Apr 2015 19:44:32 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2CWAQD3WzhV/6Eh0XYNTodSyBKCXQKCBAEBAQEBAYUsAQEEIxVBEAsYAgIFIQICDwJGBg0BBwEBvnhwlQUBAQEBAQEBAwEBAQEBAQEbgSGKFoUEB4JogUUBBLEWhCeDIQEBAQ Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail07.adl2.internode.on.net with ESMTP; 23 Apr 2015 12:14:31 +0930 Message-ID: <55385C8A.40403@internode.on.net> Date: Thu, 23 Apr 2015 12:44:26 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Nathan Scott CC: Lukas Berk , pcp developers Subject: Re: [patch] speed pmie startup References: <852862416.3748569.1429589380945.JavaMail.zimbra@redhat.com> <5536CD81.1070008@internode.on.net> <670202791.5237429.1429755448032.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [patch] speed pmie startup In-Reply-To: <670202791.5237429.1429755448032.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1429757071 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18254 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 23/04/15 12:17, Nathan Scott wrote: > ... > The 518 fix was in the original patch, but 260 hasn't been failing here at > all so far - can you send me the .bad file? Grrr ... 260 is not failing here now! From nscott@redhat.com Wed Apr 22 23:27:07 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 3111E7F37 for ; Wed, 22 Apr 2015 23:27:07 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id D07EAAC004 for ; Wed, 22 Apr 2015 21:27:06 -0700 (PDT) X-ASG-Debug-ID: 1429763221-04bdf06323394140001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id vddglToVWEaYpq1n (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 21:27:02 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3N4QwLx001997; Thu, 23 Apr 2015 00:26:58 -0400 Date: Thu, 23 Apr 2015 00:26:58 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: Lukas Berk , pcp developers Message-ID: <614087554.5255330.1429763218272.JavaMail.zimbra@redhat.com> In-Reply-To: <55385C8A.40403@internode.on.net> References: <852862416.3748569.1429589380945.JavaMail.zimbra@redhat.com> <5536CD81.1070008@internode.on.net> <670202791.5237429.1429755448032.JavaMail.zimbra@redhat.com> <55385C8A.40403@internode.on.net> Subject: Re: [patch] speed pmie startup MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [patch] speed pmie startup Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.221] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: speed pmie startup Thread-Index: Kkqyy4VSASavHyxscfOZaGv93Zwjvg== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1429763222 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18257 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > On 23/04/15 12:17, Nathan Scott wrote: > > ... > > The 518 fix was in the original patch, but 260 hasn't been failing here at > > all so far - can you send me the .bad file? > > Grrr ... 260 is not failing here now! > I've run it in a loop & managed to hit it - looks like its as you suggested, the values from pmie look very close, just the acceptable range needs to be widened on one side of the equation to accommodate the quicker startup. Will fix shortly, thanks. cheers. -- Nathan From nscott@redhat.com Wed Apr 22 23:31:20 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 1D8AD7F37 for ; Wed, 22 Apr 2015 23:31:20 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id F05E5304062 for ; Wed, 22 Apr 2015 21:31:19 -0700 (PDT) X-ASG-Debug-ID: 1429763473-04cb6c1cc83556d0001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id mNdo9RW3UgEl8EQl (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 21:31:14 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3N4VDH5041365; Thu, 23 Apr 2015 00:31:13 -0400 Date: Thu, 23 Apr 2015 00:31:13 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Mark Goodwin Cc: pcp developers Message-ID: <870197135.5255911.1429763473191.JavaMail.zimbra@redhat.com> In-Reply-To: <553609DF.7050908@redhat.com> References: <1961915504.3837841.1429597752375.JavaMail.zimbra@redhat.com> <553609DF.7050908@redhat.com> Subject: Re: pcp updates: qa, pmie, pmiostat MIME-Version: 1.0 X-ASG-Orig-Subj: Re: pcp updates: qa, pmie, pmiostat Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.221] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: qa, pmie, pmiostat Thread-Index: CZIx+DXR0wlQmw5JJE+RVZhXHTaakQ== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1429763473 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18256 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi Mark, ----- Original Message ----- > [...] > might be if pmiostat -x dm -x t and pmiostat -x dm,t were > equivalent, but that's just a nit really. Heh, that's a one-character change - done. Actually, there's some redundant error handling in there that can be removed. Those two, some QA and reviewed+QA'd updates from other folks are ready to go ... Changes committed to git://git.pcp.io/nathans/pcp.git master qa/260 | 8 - qa/981 | 1 qa/982 | 44 ++++++ qa/982.out | 14 ++ qa/group | 1 src/pmdas/ds389/pmdads389.pl | 31 ++-- src/pmdas/ds389log/pmdads389log.pl | 248 ++++++++++++++++++------------------- src/pmie/src/pmie.c | 9 - src/pmiostat/pmiostat.py | 4 9 files changed, 210 insertions(+), 150 deletions(-) commit eab6c963ca8cee03cce6da285f598e2042cbb003 Author: Nathan Scott Date: Thu Apr 23 14:14:36 2015 +1000 pmie: simplify time setup as suggested by kenj, update qa bounds commit e983c1758d29dbf55125bdc9c5ae0adf8c83dde1 Author: Nathan Scott Date: Thu Apr 23 14:12:23 2015 +1000 pmiostat: accumulate -x arguments, remove duplicate error handling commit 2615c179d9fe2af6153102ec49eace5705cf305c Author: Marko Myllynen Date: Thu Apr 23 11:21:40 2015 +1000 ds389log: init metrics with PM_ERR_AGAIN not zero commit 1c48481681b7a849809871469e0c6d29d0f4774a Author: Marko Myllynen Date: Thu Apr 23 11:19:18 2015 +1000 pmdads389[log]: make configuration variables actually configurable commit fdbe9cc9f79a76d8cf4807dab026d926c100cc44 Author: Marko Myllynen Date: Thu Apr 23 11:18:10 2015 +1000 pmdads389: make more resilient to server failures Retry connecting to the server if a connection fails, for example during server restart. Add a bit of logging. commit f99cec6318841d96c83d54b890e84320e1b49156 Author: Marko Myllynen Date: Thu Apr 23 11:07:01 2015 +1000 pmdads389log: use tabs with ds389log as we're using with ds389 commit aa791de4242ecacc00296248ec09aaf70575f840 Author: Nathan Scott Date: Thu Apr 23 10:56:16 2015 +1000 qa: add hotproc fname exerciser test using pmstore commit f0160cefea0f4aa24976fd63f389b8ace69b774a Author: Nathan Scott Date: Thu Apr 23 10:54:35 2015 +1000 qa: ensure test 981 calls exit for trap handler execution From nscott@redhat.com Wed Apr 22 23:50:58 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 62C1D7F37 for ; Wed, 22 Apr 2015 23:50:58 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 3401E304053 for ; Wed, 22 Apr 2015 21:50:58 -0700 (PDT) X-ASG-Debug-ID: 1429764656-04bdf063223947d0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id 3DRVyxdL8mt9buMu (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 21:50:56 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3N4os4R026700; Thu, 23 Apr 2015 00:50:54 -0400 Date: Thu, 23 Apr 2015 00:50:54 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus , myllynen@redhat.com Cc: pcp@oss.sgi.com Message-ID: <233739221.5258413.1429764654377.JavaMail.zimbra@redhat.com> In-Reply-To: <5537A3F3.5060204@buffalo.edu> References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> Subject: Re: [pcp] Hotproc fixes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.221] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Hotproc fixes Thread-Index: VvEiUoo1kDvi3w2VBbn6h8vNUstHKA== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1429764656 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18257 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi guys, ----- Original Message ----- > > [...] > > # pmstore hotproc.control.config 'fname == "firefox"' > > > It should be working though, right? It shouldn't affect operation, but > I can look into dumping the extra info at file parse time. I've added qa/982 which does basically the above, but its failing currently (nprocs == 0). I think I've got all your fixes though, Martins - could you take a look if you get a minute? Thanks! -- Nathan From kenj@internode.on.net Thu Apr 23 00:27:30 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 49E6B7F37 for ; Thu, 23 Apr 2015 00:27:30 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id DB7D2AC004 for ; Wed, 22 Apr 2015 22:27:26 -0700 (PDT) X-ASG-Debug-ID: 1429766839-04cbb056b239a210001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id xxz2BNNxz9ps3Gue for ; Wed, 22 Apr 2015 22:27:20 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2CWAQCQgThV/6Eh0XYNTs96gl0CggQBAQEBAQGFKwEBAQMBOEABBQsLDgoJFg8JAwIBAgFFBgEMAQcBAYgftk+WCgEBAQEBAQEBAQEBAQEBAQEBARqLN4UEB4QtAQSPIaINhCiDIQEBAQ Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail07.adl2.internode.on.net with ESMTP; 23 Apr 2015 14:57:18 +0930 Message-ID: <553882B3.7080101@internode.on.net> Date: Thu, 23 Apr 2015 15:27:15 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Mark Goodwin , pcp@oss.sgi.com CC: "Frank Ch. Eigler" Subject: Re: [pcp] pcp updates - interp.c is the biggie References: <55382F13.8080906@internode.on.net> <553849A3.9060002@redhat.com> X-ASG-Orig-Subj: Re: [pcp] pcp updates - interp.c is the biggie In-Reply-To: <553849A3.9060002@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1429766839 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18258 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 23/04/15 11:23, Mark Goodwin wrote: > Hi Ken, just trying to review these changes ... Thanks. > ... - I guess the crux > of the issue falls on the "fixed logic errors elsewhere", as mentioned : > ... These changes are in the previous half dozen or so commits involve interp.c > I built and installed with these changes and checked qa/787 passes. > But I've lost Frank and Paul's recipe for reproducing the archive replay > performance issue - anyone have a reference to that handy? qa/787 uses qa/archives/bug-1044 which is a pmlogextract'd version of Frank's original super-SLOW-merged-archive-20140124.225919 archive. A tarball of the original archive is on oss.sgi.com:~kenj if you need/want it (~kenj/super-slow-archive.tar.xz). With this archive unpacked: $ time pmval -t 60 -a super-SLOW-merged-archive-20140124.225919 pmcd.numagents should finish in seconds, not minutes! Paul's one is trickier ... I don't have an automated test for that and I've been testing interactively also with pmlogextract'd subset of the metrics ... gimme a while to snoop the details out. From myllynen@redhat.com Thu Apr 23 01:08:45 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 2EA987F37 for ; Thu, 23 Apr 2015 01:08:45 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id BB711AC002 for ; Wed, 22 Apr 2015 23:08:41 -0700 (PDT) X-ASG-Debug-ID: 1429769320-04bdf06322395d20001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id LVaIpPmHA9AMaAYB (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 23:08:41 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (Postfix) with ESMTPS id 99BD8A10AE; Thu, 23 Apr 2015 06:08:40 +0000 (UTC) Received: from mmyllyne.csb (vpn1-6-59.ams2.redhat.com [10.36.6.59]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3N68cIA010225; Thu, 23 Apr 2015 02:08:39 -0400 Message-ID: <55388C61.9080506@redhat.com> Date: Thu, 23 Apr 2015 09:08:33 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Martins Innus , pcp@oss.sgi.com Subject: Re: [pcp] Hotproc fixes References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> <5537A542.6080905@redhat.com> <5537FE23.4040006@buffalo.edu> X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes In-Reply-To: <5537FE23.4040006@buffalo.edu> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429769321 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, On 2015-04-22 23:01, Martins Innus wrote: > On 4/22/15 9:42 AM, Marko Myllynen wrote: >> On 2015-04-22 16:36, Martins Innus wrote: >>> On 4/22/15 9:25 AM, Marko Myllynen wrote: >>>> On 2015-04-21 22:47, Martins Innus wrote: >>>> thanks, looking good already. I tried using the configuration file, not >>>> sure is it behaving as intended? >>>> >>> It should be working though, right? It shouldn't affect operation, but >>> I can look into dumping the extra info at file parse time. >> yeah, it works ok but it's perhaps slightly confusing. >> > Sure. Ok, was an easy change. Ill send once I finish up the > documentation changes. I came to think one new feature which might be helpful: it'd be nice if it would be possible to trigger re-reading of the configuration file. This way one could do all the changes needed in the configuration file (it's probably also easier to write more complex rules in a file than on the command line) and be sure they persist across pmcd restarts or even system reboots. Ok, it's possible to have the configuration file read by restarting pmcd but then clients are affected so I don't think that's ideal. Remotely related to this, it seems that the configuration file is read even if it's world-writeable, not sure would it be worth to disallow that. Thanks, -- Marko Myllynen From mgoodwin@redhat.com Thu Apr 23 01:10:55 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id BAF3E7F37 for ; Thu, 23 Apr 2015 01:10:55 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 8DAF38F804B for ; Wed, 22 Apr 2015 23:10:52 -0700 (PDT) X-ASG-Debug-ID: 1429769451-04bdf06322395dc0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id P0IZjXk8YV7dJdGw (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 23:10:51 -0700 (PDT) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3N6Am1D004259 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Thu, 23 Apr 2015 02:10:48 -0400 Received: from [10.64.50.250] (vpn1-50-250.bne.redhat.com [10.64.50.250]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3N6Akf3022991; Thu, 23 Apr 2015 02:10:46 -0400 Message-ID: <55388CE5.5050801@redhat.com> Date: Thu, 23 Apr 2015 16:10:45 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: Ken McDonell , pcp@oss.sgi.com CC: "Frank Ch. Eigler" Subject: Re: [pcp] pcp updates - interp.c is the biggie References: <55382F13.8080906@internode.on.net> <553849A3.9060002@redhat.com> <553882B3.7080101@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] pcp updates - interp.c is the biggie In-Reply-To: <553882B3.7080101@internode.on.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429769451 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 04/23/2015 03:27 PM, Ken McDonell wrote: > ...A tarball of the > original archive is on oss.sgi.com:~kenj if you need/want it > (~kenj/super-slow-archive.tar.xz). With this archive unpacked: > > $ time pmval -t 60 -a super-SLOW-merged-archive-20140124.225919 pmcd.numagents > > should finish in seconds, not minutes! indeed it does - Before the fix : real 16m0.272s user 12m39.956s sys 3m18.792s After the fix : real 0m1.760s user 0m1.163s sys 0m0.194s more than 500x faster on the same archive with identical output :) From mgoodwin@redhat.com Thu Apr 23 01:19:33 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 4B2177F47 for ; Thu, 23 Apr 2015 01:19:33 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 0C3AA8F804B for ; Wed, 22 Apr 2015 23:19:32 -0700 (PDT) X-ASG-Debug-ID: 1429769971-04bdf06321396030001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id NbtZ35ePKQQOHwr1 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 22 Apr 2015 23:19:31 -0700 (PDT) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (Postfix) with ESMTPS id 2C423AC7B6 for ; Thu, 23 Apr 2015 06:19:31 +0000 (UTC) Received: from [10.64.50.250] (vpn1-50-250.bne.redhat.com [10.64.50.250]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3N6JTO7030177 for ; Thu, 23 Apr 2015 02:19:30 -0400 Message-ID: <55388EF0.3030905@redhat.com> Date: Thu, 23 Apr 2015 16:19:28 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp Subject: pcp updates: kenj merge Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: kenj merge Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429769971 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Changes committed to git://git.pcp.io/pcp.git master Ken McDonell (5): libpcp/pmns.c: pmLookupName() fix up libpcp/derive.c: fix typo in diagnostic message qa/admin/check-vm: Add note to ignore networking warnings if not running QA libpcp/interp.c: another performance improvement libpcp/interp.c: major breakthrough! man/man3/pmlookupname.3 | 94 ++++++++++++++++- qa/180.out.3 | 2 qa/404.out | 12 +- qa/787.out | 8 - qa/901.out | 12 +- qa/909 | 122 +++++++++++++++++++++++ qa/909.out | 131 ++++++++++++++++++++++++ qa/admin/check-vm | 11 +- qa/group | 1 qa/src/interp_bug.c | 10 + qa/src/interp_bug2.c | 22 +++- qa/src/lookupnametest.c | 53 +++++++++- qa/src/multifetch.c | 3 qa/src/multithread5.c | 5 qa/src/multithread6.c | 5 qa/src/multithread7.c | 5 qa/src/multithread8.c | 5 qa/src/multithread9.c | 5 qa/src/permfetch.c | 2 qa/src/torture_api.c | 6 - src/libpcp/src/derive.c | 2 src/libpcp/src/interp.c | 48 +++++---- src/libpcp/src/pmns.c | 252 +++++++++++++++++++++++++++++++++++------------- src/pmcd/src/dopdus.c | 83 +++++++++------ 24 files changed, 734 insertions(+), 165 deletions(-) Details ... commit 2a3b5ff6668c13791e9c9df64673419dd7903281 Author: Ken McDonell Date: Thu Apr 23 09:10:07 2015 +1000 libpcp/interp.c: major breakthrough! One and off for more than 15 months(!), I've been trying to understand two guards that control the backwards and forwards searching when trying to "bound" a metric-instance for a point in time value interpolation from a PCP archive. This is in the dark heart of some of the most complex code in libpcp, and sometimes was observed to trigger obscene amounts of archive record reading, and re-reading, and re-reading ... In the guards one clause in particular made no sense to me ... but each time I tried to remove these clauses or refine them so they made less nonsense, there were a spate of hard to understand and harder to diagnose QA failures. After many other changes to improve the logic in the code to deal with unrelated corner cases, I finally was down to a single QA anomaly. In desperation, I removed the "makes no sense to me guards" and bingo! All tests pass, and the performance problems reported by Frank (in a pmmgr context) and Paul Smith (in a pmchart context with big production archives) have both gone away _and_ interp mode seems to produce the correct metric values across all of the QA tests. With hindsight, it appears the guards were an incorrect attempt to address logic errors elsewhere, and when these other errors were finally all fixed properly, the guards were no longer needed for correctness, but they did sometimes trigger lots of archive reading that was not required. For the historical record the guard that has been dropped is this one (for forward search and the similar one for backwards search): /* ... * t_next is a mark and t_next > t_req => need to search * back also (unless we've already scanned to this mark) ... */ ... (IS_MARK(icp->s_next) && !IS_SCANNED(icp->s_next) && icp->t_next > t_req) || Now back to the rest of my life! commit 8a28abe2c3ecd75daef3e01424a64523d8601738 Author: Ken McDonell Date: Thu Apr 23 08:31:12 2015 +1000 libpcp/interp.c: another performance improvement Small one this time, we're down to the obscure corner cases now. commit b113884be5060a1a99ddbef94baaab416638bbca Author: Ken McDonell Date: Thu Apr 23 08:29:17 2015 +1000 qa/admin/check-vm: Add note to ignore networking warnings if not running QA commit 81d987bf77a8f74d29847fd136fb903bee09c8d4 Author: Ken McDonell Date: Thu Apr 23 08:28:40 2015 +1000 libpcp/derive.c: fix typo in diagnostic message commit d26ac520e34c42a07825864dc7db84b4bee300bf Author: Ken McDonell Date: Wed Apr 22 10:17:33 2015 +1000 libpcp/pmns.c: pmLookupName() fix up Complete audit of pmLookupName() error handling, to ensure we are consistent across all of - local PMNS (with and without a current context) - remote host context - local context - archive context for all types of metrics, but especially DYNAMIC metrics. Mostly in libpcp, but also a small pmcd change. pmLookupName() man page updated to reflect the real error handling protocol and verified example code added. As a by-product, discovered that pmNameID() and pmNameAll() were broken for DYNAMIC metrics, so drive-by fix for these as well. And finally a bunch of QA consequential cleanup. From michele@acksyn.org Thu Apr 23 01:36:37 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=T_DKIM_INVALID autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 373777F37 for ; Thu, 23 Apr 2015 01:36:37 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 0881930404E for ; Wed, 22 Apr 2015 23:36:36 -0700 (PDT) X-ASG-Debug-ID: 1429770990-04bdf063223965c0001-S8gJnT Received: from palahniuk.acksyn.org (palahniuk.acksyn.org [5.9.7.26]) by cuda.sgi.com with ESMTP id 5onewAtNd80hVAuP for ; Wed, 22 Apr 2015 23:36:31 -0700 (PDT) X-Barracuda-Envelope-From: michele@acksyn.org X-Barracuda-Apparent-Source-IP: 5.9.7.26 Received: from localhost (localhost [127.0.0.1]) by palahniuk.acksyn.org (Postfix) with ESMTP id 8168729D23; Thu, 23 Apr 2015 02:36:30 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=acksyn.org; h= user-agent:in-reply-to:content-disposition:content-type :content-type:mime-version:references:message-id:subject:subject :from:from:date:date:received:received; s=2010; t=1429770990; bh=PYSF+MHj3/r08NT758UTtdPZgkpi7gGzkaOgclwCD/M=; b=Es0j6iEjM+gv +x+UmShZS2FtUwSmH+CQbj+t5VpXiFPmGceGQWupr9alfcKB8wkE41yPQxNjgC+0 wuUejVEcvlq2S/PWYSiOSKkNwBzqWjljU4DtKe9zcUvGvSivu6eKD5PitHrg/ka+ t+VJho/+rqzLLQIGbWl2TdeOtOt5BOM= Received: from palahniuk.acksyn.org ([127.0.0.1]) by localhost (mail.acksyn.org [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id KEGJN5njUbk8; Thu, 23 Apr 2015 02:36:30 -0400 (EDT) Received: from localhost (host89-178-dynamic.6-79-r.retail.telecomitalia.it [79.6.178.89]) by palahniuk.acksyn.org (Postfix) with ESMTPSA id 94584263F5; Thu, 23 Apr 2015 02:36:29 -0400 (EDT) Date: Thu, 23 Apr 2015 08:36:28 +0200 From: Michele Baldessari To: Nathan Scott Cc: pcp@oss.sgi.com Subject: Re: Bug/Issue tracker Message-ID: <20150423063628.GM18943@marquez.int.rhx> X-ASG-Orig-Subj: Re: Bug/Issue tracker References: <20150420174712.GH18943@marquez.int.rhx> <5536B493.5070208@internode.on.net> <681874759.4524910.1429676595258.JavaMail.zimbra@redhat.com> <1639923927.5201948.1429742207940.JavaMail.zimbra@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1639923927.5201948.1429742207940.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.5.23.1-rc1 (2014-03-12) X-Barracuda-Connect: palahniuk.acksyn.org[5.9.7.26] X-Barracuda-Start-Time: 1429770991 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18259 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature On Wed, Apr 22, 2015 at 06:36:47PM -0400, Nathan Scott wrote: > ----- Original Message ----- > > > [...] Well the opportunity if before us right now to resolve this > > > since Michele is offering to do the work of consolidating the two > > > [...] > > > > I missed where anyone volunteered to consolidate. Last I read, he > > acknowleged it as essential, but that's not the same thing. > > Assuming this, from your original mail Michele, is still the case... yes, of course ;) > | I think that to make things easier for users it makes more sense to > | switch to github fully for issue tracking purposes. If there is rough > | consensus on this, I'll work on some test scripts to migrate all bugs > | w/comments and attachments. > > ... it sounds like it'd be worth investigating the attachment side of > things further (as per Kens last mail). If that's solvable, I guess we > have as "rough consensus" as we ever tend to get, so lets move forward. Aye, let me invest some time to see if we do not lose any data/info in a potential migration. If the test end-result is satisfactory, great. If it is not we'll just keep the status quo. cheers, Michele -- Michele Baldessari C2A5 9DA3 9961 4FFB E01B D0BC DDD4 DCCB 7515 5C6D From mgoodwin@redhat.com Thu Apr 23 02:17:07 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 99AA87F37 for ; Thu, 23 Apr 2015 02:17:07 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 2930CAC001 for ; Thu, 23 Apr 2015 00:17:03 -0700 (PDT) X-ASG-Debug-ID: 1429773421-04cbb056b339c460001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id YWq0IZoGn0OXCxt7 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 23 Apr 2015 00:17:02 -0700 (PDT) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (Postfix) with ESMTPS id C968791C02 for ; Thu, 23 Apr 2015 07:17:01 +0000 (UTC) Received: from [10.64.50.250] (vpn1-50-250.bne.redhat.com [10.64.50.250]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3N7H0uN026012 for ; Thu, 23 Apr 2015 03:17:00 -0400 Message-ID: <55389C6B.70407@redhat.com> Date: Thu, 23 Apr 2015 17:16:59 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp Subject: pcp updates: Nathan+Marko+Martins merge Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: Nathan+Marko+Martins merge Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429773422 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 These were reviewed by Nathan (except for the pmiostat changes, which I reviewed). Changes committed to git://git.pcp.io/pcp.git master Nathan Scott (7): build: removed old-variants of freshly renovated code headers: make cpp #include macro guards more conventional rc_pmcd: remove a now-redundant chdir after martins fix qa: ensure test 981 calls exit for trap handler execution qa: add hotproc fname exerciser test using pmstore pmiostat: accumulate -x arguments, remove duplicate error handling pmie: simplify time setup as suggested by kenj, update qa bounds Marko Myllynen (4): pmdads389log: use tabs with ds389log as we're using with ds389 pmdads389: make more resilient to server failures pmdads389[log]: make configuration variables actually configurable ds389log: init metrics with PM_ERR_AGAIN not zero Martins Innus (3): Allow more than one .NeedInstall to occur at a time hotproc : fix an off by one error for fname configs hotproc - Add some more detail to the man page qa/260 | 8 qa/981 | 1 qa/982 | 44 qa/982.out | 14 qa/group | 1 src/include/pcp/config.h.in | 6 src/include/pcp/fault.h | 6 src/include/pcp/impl.h | 6 src/include/pcp/import.h | 6 src/include/pcp/mmv_dev.h | 6 src/include/pcp/mmv_stats.h | 6 src/include/pcp/platform_defs.h.in | 6 src/include/pcp/pmafm.h | 6 src/include/pcp/pmapi.h | 6 src/include/pcp/pmda.h | 6 src/include/pcp/pmtime.h | 6 src/include/pcp/trace.h | 6 src/include/pcp/trace_dev.h | 6 src/pmcd/rc_pmcd | 3 src/pmdas/GNUmakefile | 2 src/pmdas/ds389/pmdads389.pl | 31 src/pmdas/ds389log/pmdads389log.pl | 248 ++--- src/pmdas/hotproc/GNUakefile | 52 - src/pmdas/hotproc/GNUmakefile | 157 --- src/pmdas/hotproc/Install | 150 --- src/pmdas/hotproc/README | 141 --- src/pmdas/hotproc/Remove | 38 src/pmdas/hotproc/fixpmns.awk | 35 src/pmdas/hotproc/general.conf | 27 src/pmdas/hotproc/general.pmie | 29 src/pmdas/hotproc/help.fmt | 36 src/pmdas/hotproc/help.hotproc | 141 --- src/pmdas/hotproc/pmns.hotproc | 34 src/pmdas/hotproc/root | 10 src/pmdas/hotproc/sample.conf | 15 src/pmdas/hotproc/src/GNUmakefile | 34 src/pmdas/hotproc/src/config.c | 569 ------------ src/pmdas/hotproc/src/config.h | 79 - src/pmdas/hotproc/src/ctltab.c | 66 - src/pmdas/hotproc/src/error.c | 40 src/pmdas/hotproc/src/gram.y | 163 --- src/pmdas/hotproc/src/gram_node.c | 199 ---- src/pmdas/hotproc/src/gram_node.h | 69 - src/pmdas/hotproc/src/hotproc.c | 1555 ----------------------------------- src/pmdas/hotproc/src/hotproc.h | 52 - src/pmdas/hotproc/src/lex.l | 115 -- src/pmdas/hotproc/src/pcpu.c | 100 -- src/pmdas/hotproc/src/pcpu.h | 31 src/pmdas/hotproc/src/pglobal.c | 93 -- src/pmdas/hotproc/src/pglobal.h | 41 src/pmdas/hotproc/src/ppred_values.c | 163 --- src/pmdas/hotproc/src/ppred_values.h | 39 src/pmdas/linux_proc/pmdahotproc.1 | 214 ---- src/pmdas/linux_proc/proc_pid.c | 2 src/pmdas/systemtap/.gitignore | 4 src/pmdas/systemtap/GNUmakefile | 45 - src/pmdas/systemtap/Install | 32 src/pmdas/systemtap/README | 59 - src/pmdas/systemtap/Remove | 29 src/pmdas/systemtap/pmdasystemtap.1 | 87 - src/pmdas/systemtap/pmdasystemtap.pl | 86 - src/pmdas/systemtap/probes.stp | 6 src/pmie/src/pmie.c | 9 src/pmiostat/pmiostat.py | 4 64 files changed, 292 insertions(+), 4988 deletions(-) Details ... commit eab6c963ca8cee03cce6da285f598e2042cbb003 Author: Nathan Scott Date: Thu Apr 23 14:14:36 2015 +1000 pmie: simplify time setup as suggested by kenj, update qa bounds commit e983c1758d29dbf55125bdc9c5ae0adf8c83dde1 Author: Nathan Scott Date: Thu Apr 23 14:12:23 2015 +1000 pmiostat: accumulate -x arguments, remove duplicate error handling commit 2615c179d9fe2af6153102ec49eace5705cf305c Author: Marko Myllynen Date: Thu Apr 23 11:21:40 2015 +1000 ds389log: init metrics with PM_ERR_AGAIN not zero commit 1c48481681b7a849809871469e0c6d29d0f4774a Author: Marko Myllynen Date: Thu Apr 23 11:19:18 2015 +1000 pmdads389[log]: make configuration variables actually configurable commit fdbe9cc9f79a76d8cf4807dab026d926c100cc44 Author: Marko Myllynen Date: Thu Apr 23 11:18:10 2015 +1000 pmdads389: make more resilient to server failures Retry connecting to the server if a connection fails, for example during server restart. Add a bit of logging. commit f99cec6318841d96c83d54b890e84320e1b49156 Author: Marko Myllynen Date: Thu Apr 23 11:07:01 2015 +1000 pmdads389log: use tabs with ds389log as we're using with ds389 commit aa791de4242ecacc00296248ec09aaf70575f840 Author: Nathan Scott Date: Thu Apr 23 10:56:16 2015 +1000 qa: add hotproc fname exerciser test using pmstore commit f0160cefea0f4aa24976fd63f389b8ace69b774a Author: Nathan Scott Date: Thu Apr 23 10:54:35 2015 +1000 qa: ensure test 981 calls exit for trap handler execution commit 3466b57582dbe444b85e09af8aa338f221cf949c Author: Nathan Scott Date: Wed Apr 22 17:25:02 2015 +1000 rc_pmcd: remove a now-redundant chdir after martins fix commit e14233eb81a9b777220921690768bc06a245796a Author: Nathan Scott Date: Wed Apr 22 16:33:56 2015 +1000 headers: make cpp #include macro guards more conventional As discussed in https://github.com/performancecopilot/pcp/issues/7 commit 561c7900516e9f251c039b02d6f4adf4ae21aca8 Author: Nathan Scott Date: Wed Apr 22 11:35:00 2015 +1000 build: removed old-variants of freshly renovated code commit 2093535ac6dc866b4e5d99e1f11b39cf6c5f74a9 Author: Martins Innus Date: Tue Apr 21 19:36:56 2015 +0000 hotproc - Add some more detail to the man page commit 34db01726b6b91ed7e5a37e3af75a61487924eab Author: Martins Innus Date: Tue Apr 21 17:38:54 2015 +0000 hotproc : fix an off by one error for fname configs commit 4588745c412196c1bd1b80e36afcee8276d6a658 Author: Martins Innus Date: Tue Apr 21 12:59:24 2015 +0000 Allow more than one .NeedInstall to occur at a time Chnage back to PCP_PMDAS_DIR after installing a pmda From nscott@redhat.com Thu Apr 23 02:24:41 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 2D8C77F37 for ; Thu, 23 Apr 2015 02:24:41 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 1E36E304039 for ; Thu, 23 Apr 2015 00:24:37 -0700 (PDT) X-ASG-Debug-ID: 1429773875-04cbb056b339c6e0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id BUqSjCa2PVKIhC24 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 23 Apr 2015 00:24:36 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3N7OWGi017909; Thu, 23 Apr 2015 03:24:32 -0400 Date: Thu, 23 Apr 2015 03:24:32 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Michele Baldessari Cc: pcp@oss.sgi.com Message-ID: <1170756043.5356082.1429773872370.JavaMail.zimbra@redhat.com> In-Reply-To: <20150423063628.GM18943@marquez.int.rhx> References: <20150420174712.GH18943@marquez.int.rhx> <5536B493.5070208@internode.on.net> <681874759.4524910.1429676595258.JavaMail.zimbra@redhat.com> <1639923927.5201948.1429742207940.JavaMail.zimbra@redhat.com> <20150423063628.GM18943@marquez.int.rhx> Subject: Re: Bug/Issue tracker MIME-Version: 1.0 X-ASG-Orig-Subj: Re: Bug/Issue tracker Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.221] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Bug/Issue tracker Thread-Index: 4+NPsM1EN55EykC+rlQN0LTJ6/7Fxw== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1429773876 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18260 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > [...] > Aye, let me invest some time to see if we do not lose any data/info in a > potential migration. If the test end-result is satisfactory, great. If > it is not we'll just keep the status quo. Sounds good to me, thanks Michele. cheers. -- Nathan From minnus@buffalo.edu Thu Apr 23 12:28:23 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id E82577F47 for ; Thu, 23 Apr 2015 12:28:23 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id D7AD38F8050 for ; Thu, 23 Apr 2015 10:28:20 -0700 (PDT) X-ASG-Debug-ID: 1429810098-04cbb056b43af4c0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve3.acsu.buffalo.edu [128.205.7.163]) by cuda.sgi.com with ESMTP id vJMBB2l13GD2qiBl for ; Thu, 23 Apr 2015 10:28:18 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.163 Received: from localmaile.acsu.buffalo.edu (localmaile.acsu.buffalo.edu [128.205.4.3]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id B67CC3C7F; Thu, 23 Apr 2015 13:28:18 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id A8D5F1600A0; Thu, 23 Apr 2015 13:28:18 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localmaile.acsu.buffalo.edu (Postfix) with ESMTP id 9522E16009E; Thu, 23 Apr 2015 13:28:18 -0400 (EDT) Received: from smtp.buffalo.edu (smtp4.acsu.buffalo.edu [128.205.5.229]) by localmaile.acsu.buffalo.edu (Prefixe) with ESMTP id 94016160070; Thu, 23 Apr 2015 13:28:18 -0400 (EDT) Received: from [10.0.1.191] (cpe-69-204-8-250.buffalo.res.rr.com [69.204.8.250]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 559627760A; Thu, 23 Apr 2015 13:28:18 -0400 (EDT) Message-ID: <55392BAB.3060101@buffalo.edu> Date: Thu, 23 Apr 2015 13:28:11 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Nathan Scott , myllynen@redhat.com CC: pcp@oss.sgi.com Subject: Re: [pcp] Hotproc fixes References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> <233739221.5258413.1429764654377.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes In-Reply-To: <233739221.5258413.1429764654377.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: XX: 28% X-Barracuda-Connect: mtareserve3.acsu.buffalo.edu[128.205.7.163] X-Barracuda-Start-Time: 1429810098 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18271 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Nathan, > Hi guys, > > ----- Original Message ----- >>> [...] >>> # pmstore hotproc.control.config 'fname == "firefox"' >>> >> It should be working though, right? It shouldn't affect operation, but >> I can look into dumping the extra info at file parse time. > I've added qa/982 which does basically the above, but its failing currently > (nprocs == 0). I think I've got all your fixes though, Martins - could you > take a look if you get a minute? > > OK, tracked this down. Only happens on some OSs. I had assumed that all of /proc//* should be available and files would only be missing if some badness happened or a pid was in the process of exiting. Turns out that schedstat is not enabled in some kernels by default. Will need a bit of rework to deal with this. qa/800 should have caught this, so I will rework that as well. Thanks Martins From minnus@buffalo.edu Thu Apr 23 14:39:54 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 27BB87F47 for ; Thu, 23 Apr 2015 14:39:54 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 05EF1304053 for ; Thu, 23 Apr 2015 12:39:53 -0700 (PDT) X-ASG-Debug-ID: 1429817992-04cbb056b33b2960001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve3.acsu.buffalo.edu [128.205.7.163]) by cuda.sgi.com with ESMTP id oon2wgJWbUJHyuSM for ; Thu, 23 Apr 2015 12:39:52 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.163 Received: from localmailB.acsu.buffalo.edu (localmailb.acsu.buffalo.edu [128.205.5.200]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id EB8A81B67 for ; Thu, 23 Apr 2015 15:39:51 -0400 (EDT) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id E77CDC834 for ; Thu, 23 Apr 2015 15:39:51 -0400 (EDT) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailB.acsu.buffalo.edu (Postfix) with ESMTP id D265EC831 for ; Thu, 23 Apr 2015 15:39:49 -0400 (EDT) Received: from smtp.buffalo.edu (smtp4.acsu.buffalo.edu [128.205.5.229]) by localmailB.acsu.buffalo.edu (Prefixe) with ESMTP id CB1C9C830 for ; Thu, 23 Apr 2015 15:39:49 -0400 (EDT) Received: from [10.0.1.191] (cpe-69-204-8-250.buffalo.res.rr.com [69.204.8.250]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id A520E79F52 for ; Thu, 23 Apr 2015 15:39:49 -0400 (EDT) Message-ID: <55394A83.2000103@buffalo.edu> Date: Thu, 23 Apr 2015 15:39:47 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: More hotproc cleanups Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: More hotproc cleanups Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: XX: 28% X-Barracuda-Connect: mtareserve3.acsu.buffalo.edu[128.205.7.163] X-Barracuda-Start-Time: 1429817992 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18275 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi, Here are some more fixes to recently discovered bugs. https://github.com/ubccr/pcp/tree/hotproc_cleanups Thanks Martins commit a6965ef0a68969e3e877884918491a30e1f6c45c Author: Martins Innus Date: Thu Apr 23 19:35:29 2015 +0000 hotproc - more cleanups Fix hotproc failing on linux kernel with no schedstat Fix qa/800 to detect nprocs==0 Cleanup hotproc.control.config output qa/800 | 8 +++++--- qa/800.out | 18 +++++++++++++++--- src/pmdas/linux_proc/config.c | 2 +- src/pmdas/linux_proc/proc_pid.c | 6 ++++-- 4 files changed, 25 insertions(+), 9 deletions(-) From fche@redhat.com Thu Apr 23 17:54:29 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id A53D87F47 for ; Thu, 23 Apr 2015 17:54:29 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 9B4DE304062 for ; Thu, 23 Apr 2015 15:54:29 -0700 (PDT) X-ASG-Debug-ID: 1429829665-04cb6c1cca371be0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id ksKSHiu4bdEnQvjp (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 23 Apr 2015 15:54:25 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3NMsOs2002369 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 23 Apr 2015 18:54:24 -0400 Received: from fche.csb (vpn-224-175.phx2.redhat.com [10.3.224.175]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3NMsOHc010126; Thu, 23 Apr 2015 18:54:24 -0400 Received: by fche.csb (Postfix, from userid 2569) id EE3AB5853F; Thu, 23 Apr 2015 18:54:19 -0400 (EDT) Date: Thu, 23 Apr 2015 18:54:19 -0400 From: "Frank Ch. Eigler" To: brolley@redhat.com Cc: pcp developers Subject: pcp update (for archives-as-directories) Message-ID: <20150423225419.GD10477@redhat.com> X-ASG-Orig-Subj: pcp update (for archives-as-directories) Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429829665 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, Dave - Below is the pmwebd patch we were talking about the other day, which provides another way to enjoy the benefits of your work-in-progress. (It's harmless to current pcp, so it could be merged even before your new stuff is ready.) commit 53d34c3d7102043b66dd337a8a8fe89cd55b3518 (pcpfans.git) Author: Frank Ch. Eigler Date: Thu Apr 23 18:34:00 2015 -0400 pmwebd: add -I option for opening directories-as-archives for graphite This facility allows pmwebd to present to graphite-api clients such as the graphite and grafana webapps a more compact metric-name for the canonical sort of pmlogger directory layout, wherein each directory that contains archives are all from the same host. The moment pmNewContext (PM_CONTEXT_ARCHIVE, "/path/to/directory") facility comes online, this option will let pmwebd exploit it. The effect will be to go from having a gajillion: [...] pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150131-2E-110904-2E-meta.kernel.all.nprocs pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150131-2E-110904-2E-meta.kernel.all.nprocs pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150131-2E-110904-2E-meta.kernel.all.nprocs pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150201-2E-110705-2E-meta.kernel.all.nprocs [...] items to a single: pmmgr-2F-easy-2E-elastic-2E-org.kernel.all.nprocs Documentation is included. Hand-QA'd via gdb (to check that pmNewContext was being properly called on directories too). The code is harmless to current libpcp users, even if the non-default -I flag were turned on; updated QA asserts this. (qa/661.out may vary once the new pmNewContext facility comes online.) From kenj@internode.on.net Thu Apr 23 18:33:26 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id D33C87F47 for ; Thu, 23 Apr 2015 18:33:26 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id AD4DB8F8064 for ; Thu, 23 Apr 2015 16:33:26 -0700 (PDT) X-ASG-Debug-ID: 1429832000-04bdf063233b3d80001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id KNf7NyLnHk6Gfh4d for ; Thu, 23 Apr 2015 16:33:20 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DZAQDDgDlVPKEh0XYNTodUgy3EX4JdAoF9AQEBAQEBBwEBAQFBhF8BAQEEIxVAAQwECxgCAgUWCwICCQMCAQIBMRQGDQEHAQG/CHCVEAEBAQEBAQEDAQEBAQEBARuBIYoWhQQHgmiBRQEEsUqEKYMhAQEB Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail06.adl6.internode.on.net with ESMTP; 24 Apr 2015 09:02:40 +0930 Message-ID: <55398121.8020608@internode.on.net> Date: Fri, 24 Apr 2015 09:32:49 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Nathan Scott CC: Lukas Berk , pcp developers Subject: Re: [patch] speed pmie startup References: <852862416.3748569.1429589380945.JavaMail.zimbra@redhat.com> <5536CD81.1070008@internode.on.net> <670202791.5237429.1429755448032.JavaMail.zimbra@redhat.com> <55385C8A.40403@internode.on.net> <614087554.5255330.1429763218272.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [patch] speed pmie startup In-Reply-To: <614087554.5255330.1429763218272.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1429832000 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18282 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 23/04/15 14:26, Nathan Scott wrote: > > > ----- Original Message ----- >> On 23/04/15 12:17, Nathan Scott wrote: >>> ... >>> The 518 fix was in the original patch, but 260 hasn't been failing here at >>> all so far - can you send me the .bad file? >> >> Grrr ... 260 is not failing here now! >> > > I've run it in a loop & managed to hit it - looks like its as you suggested, the > values from pmie look very close, just the acceptable range needs to be widened > on one side of the equation to accommodate the quicker startup. > > Will fix shortly, thanks. Not sure we're on the right path here. 1. if pmie starts sooner, the number of samples should be larger, not smaller ... so in qa/260 expecting a value of 180, finding a value of 172 or 175 does not sound like a filter change is the right fix 2. qa/312 is failing for me now and the pmie rule is never being evaluated I suspect (but have not found yet) some early rule firing that is no longer working with the 1 sec delays at start removed ... more investigation needed, me thinks. From mgoodwin@redhat.com Thu Apr 23 19:01:35 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 19E917F47 for ; Thu, 23 Apr 2015 19:01:35 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id B5231AC002 for ; Thu, 23 Apr 2015 17:01:25 -0700 (PDT) X-ASG-Debug-ID: 1429833684-04bdf063233b4360001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id HU0Wqxu6Xnm1Qwqr (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 23 Apr 2015 17:01:24 -0700 (PDT) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3O01OgW013473 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 23 Apr 2015 20:01:24 -0400 Received: from [10.64.50.196] (vpn1-50-196.bne.redhat.com [10.64.50.196]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3O01MQb018840; Thu, 23 Apr 2015 20:01:23 -0400 Message-ID: <553987D1.9080402@redhat.com> Date: Fri, 24 Apr 2015 10:01:21 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: "Frank Ch. Eigler" , pcp developers Subject: Re: [pcp] possible collectd interoperation options References: <20150318182507.GB29537@redhat.com> X-ASG-Orig-Subj: Re: [pcp] possible collectd interoperation options In-Reply-To: <20150318182507.GB29537@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429833684 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 03/19/2015 05:25 AM, Frank Ch. Eigler wrote: > Hi - > > A potential pcp user recently asked whether pcp can match the data > gathering capabilities of collectd [1], listing a smorgasbord of > their-equivalent-of-pmda's. The simple answer is "no", but maybe we > can get to "not yet" and maybe even "soon", while not reinventing the > wheel. > > A brief review: collectd is kind of like pmlogger+pmcd in one, where > their pmdas as well as logging-output backends [2] are packaged in > shared libraries that use a fixedish abi/api [3]. The main loop of > collectd periodically polls the configured data sources and relays to > data sinks. > > So, how do we play in the same sandbox? A few options: just revisiting this since I initially confused collectd with collectl (and we already have a collectl2pcp importer). Additionally to the options listed below - the collectd daemon supports a unix domain socket interface, see: https://collectd.org/documentation/manpages/collectd-unixsock.5.shtml There is a perl binding too. A bridging PMDA using this socket interface could import collectd metrics - we'd need some sort of descriptor table for the PCP metadata since this seems to be implicit in collectd. Regards -- Mark > > - write a pcp data source plugin for collectd > > This would leave collectd as the driver, but we would get to > provide our wealth of data to supplement theirs, kind of like > pcp2graphite. > > > - write a pcp data sink plugin for collectd > > This would leave collectd as the driver, but we could get an > incrementally written pcp log-archive as output. > > > - write a collectd plugin-host/impersonator pmda for pcp > > This would consist of a new pmda that implements the collectd plugin > abi (server side), loads unmodified collectd plugin .so's, invokes > their 'read' callbacks on demand and saves their output for relaying > into pmcd/pcp. > > This would let pcp "drive", exploit the library of collectd plugins, > and ease some of the adverse performance implications of collectd's > design (by for example refreshing only those agents & metrics that > were solicited). > > > Are any of these (or other possibilities) of interest to the group? > > > [1] https://collectd.org/ > [2] https://collectd.org/wiki/index.php/Table_of_Plugins > [3] https://collectd.org/wiki/index.php/Plugin_architecture > > _______________________________________________ > pcp mailing list > pcp@oss.sgi.com > http://oss.sgi.com/mailman/listinfo/pcp > From kenj@internode.on.net Thu Apr 23 19:29:57 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 944067F47 for ; Thu, 23 Apr 2015 19:29:57 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 3B2DCAC004 for ; Thu, 23 Apr 2015 17:29:54 -0700 (PDT) X-ASG-Debug-ID: 1429834467-04bdf063233b46a0001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id klZJbXDtC2no4pJC for ; Thu, 23 Apr 2015 17:14:27 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DZAQBgijlVPKEh0XYNToNeXIMagy3BMIgLAQEBAQEBBwEBAQFBhQkEUTAGAgUWCwILAwIBAgExJwYCAQG+enCVPoEhjzeCUoFFBYY8jw+bf4QpXYJEAQEB Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail06.adl6.internode.on.net with ESMTP; 24 Apr 2015 09:36:29 +0930 Message-ID: <5539890E.5040802@internode.on.net> Date: Fri, 24 Apr 2015 10:06:38 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - small libpcp fixup and qa Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - small libpcp fixup and qa Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1429834467 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18283 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp master Ken McDonell (3): qa/475: fallout from pmLookupName() rework qa/444: pmLookupName() fallout libpcp/pmns.c: pmNameID and pmNameAll change qa/444 | 2 +- qa/444.out.1 | 14 ++++++++++---- qa/444.out.2 | 14 ++++++++++---- qa/444.out.3 | 14 ++++++++++---- qa/475.out | 30 +++++++++++++++--------------- qa/src/multithread9.c | 9 +++++++-- src/libpcp/src/pmns.c | 5 +++++ 7 files changed, 58 insertions(+), 30 deletions(-) Details ... commit 6dc6f0a8d879882caa99648211f8b45196af4ecb Author: Ken McDonell Date: Fri Apr 24 09:28:18 2015 +1000 libpcp/pmns.c: pmNameID and pmNameAll change Small error path logic change needed as a result of the last round of changes for looking up the names of dynamic metrics ... found by some QA failures. commit b178b2ce679fa9da644ba280dc695fb0b7721be5 Author: Ken McDonell Date: Fri Apr 24 09:25:04 2015 +1000 qa/444: pmLookupName() fallout This time the client <--> pmcd protocol changed slightly but the same output is generated thanks to compensating changes in libpcp. Add a bit more PCP -Dderive diagnostic output to confirm that the change is correct. commit dbcd0970569018285b8deb7bc1714bd1dc0d9225 Author: Ken McDonell Date: Fri Apr 24 08:40:39 2015 +1000 qa/475: fallout from pmLookupName() rework Tweak error handling in qa/src/multithread9.c, and a new 475.out to match. From nscott@redhat.com Thu Apr 23 20:36:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 6C4137F47 for ; Thu, 23 Apr 2015 20:36:18 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id C9478AC002 for ; Thu, 23 Apr 2015 18:36:02 -0700 (PDT) X-ASG-Debug-ID: 1429839354-04cbb056b23b8030001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id J043IrG85d4lyFjv (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 23 Apr 2015 18:35:55 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3O1ZsaG001836 for ; Thu, 23 Apr 2015 21:35:54 -0400 Date: Thu, 23 Apr 2015 21:35:54 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp developers Message-ID: <57134578.5885693.1429839354561.JavaMail.zimbra@redhat.com> In-Reply-To: <439097062.5884622.1429838699666.JavaMail.zimbra@redhat.com> Subject: pcp updates: hotproc, mounts, qa MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: hotproc, mounts, qa Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Originating-IP: [10.64.50.221] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: hotproc, mounts, qa Thread-Index: Z7isKVlQove9msa0tiJzzcCtMks+0g== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1429839355 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18286 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/nathans/pcp.git master qa/800 | 8 +- qa/800.out | 20 ++++- qa/845 | 84 +++++++++++++++++++++++ qa/845.out | 45 ++++++++++++ qa/982.out | 2=20 qa/group | 2=20 qa/src/.gitignore | 1=20 src/pmdas/linux_proc/config.c | 2=20 src/pmdas/linux_proc/gram_node.c | 9 ++ src/pmdas/linux_proc/proc_pid.c | 6 + src/pmdas/mounts/Install | 4 - src/pmdas/mounts/Remove | 20 ----- src/pmdas/mounts/help | 27 ++----- src/pmdas/mounts/mounts.c | 137 +++++++++++++++++++---------------= ----- src/pmdas/mounts/mounts.conf | 7 - src/pmdas/mounts/pmns | 6 - 16 files changed, 251 insertions(+), 129 deletions(-) commit 6b5394e99ffbe755babc8ee8342a8b1ff240036f Author: Nathan Scott Date: Fri Apr 24 11:13:33 2015 +1000 qa: update hotproc tests after martins latest set of fixes =20 Values for the hotproc config metric now have braces, so a couple of tests needed updating. Also tweaked the pmdaproc config generation code so that this =20 > value "(uid =3D=3D 0.000000)" =20 is once again reported as =20 > value "(uid =3D=3D 0)" commit 8bcc3e21eb8851c4c3e29c004be7ac3d1179106e Author: Nathan Scott Date: Fri Apr 24 10:24:32 2015 +1000 pmdamounts: fix stack corruption for large mount options =20 Milo=C5=A1 found some scenarios where the mounts PMDA could crash and burn when a machine has mounts with option strings larger than the allocated space for them. This commit improves the bounds checking for all arrays in this PMDA, and also does a bit of general housecleaning for pmdamount readability. Test qa/845 is added to exercise the mount PMDA. =20 Resolves RHBZ #1213833. commit 2d3c11e3cb6611bca732742102596ed1e6eafd63 Author: Nathan Scott Date: Fri Apr 24 10:09:30 2015 +1000 qa: add to gitignore for lookupnametest binary commit a6965ef0a68969e3e877884918491a30e1f6c45c Author: Martins Innus Date: Thu Apr 23 19:35:29 2015 +0000 hotproc - more cleanups =20 Fix hotproc failing on linux kernel with no schedstat Fix qa/800 to detect nprocs=3D=3D0 Cleanup hotproc.control.config output From nscott@redhat.com Thu Apr 23 20:37:22 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 9B2FB7F47 for ; Thu, 23 Apr 2015 20:37:22 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id A6F3A8F8050 for ; Thu, 23 Apr 2015 18:37:22 -0700 (PDT) X-ASG-Debug-ID: 1429839440-04cb6c1cca373d30001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id WErkYcatVJTf8kHO (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 23 Apr 2015 18:37:20 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3O1bI1I026424; Thu, 23 Apr 2015 21:37:18 -0400 Date: Thu, 23 Apr 2015 21:37:18 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus Cc: myllynen@redhat.com, pcp@oss.sgi.com Message-ID: <806884984.5885784.1429839438565.JavaMail.zimbra@redhat.com> In-Reply-To: <55392BAB.3060101@buffalo.edu> References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> <233739221.5258413.1429764654377.JavaMail.zimbra@redhat.com> <55392BAB.3060101@buffalo.edu> Subject: Re: [pcp] Hotproc fixes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.221] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Hotproc fixes Thread-Index: tKjKL2yLUoUsdldJAL2muU2OZR6pAQ== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1429839440 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18285 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Martins, ----- Original Message ----- > > ----- Original Message ----- > >>> [...] > >>> # pmstore hotproc.control.config 'fname == "firefox"' > >>> > >> It should be working though, right? It shouldn't affect operation, but > >> I can look into dumping the extra info at file parse time. > > I've added qa/982 which does basically the above, but its failing currently > > (nprocs == 0). I think I've got all your fixes though, Martins - could you > > take a look if you get a minute? > > > > > OK, tracked this down. Only happens on some OSs. I had assumed that > all of /proc//* should be available and files would only be missing > if some badness happened or a pid was in the process of exiting. Turns > out that schedstat is not enabled in some kernels by default. Will need > a bit of rework to deal with this. Aha, makes sense - good catch - and yep, can confirm its working here now. > qa/800 should have caught this, so I will rework that as well. Looks good. I've updated the QA a little in my tree (please review), then found another small issue I think, in the store handler, where it ignores an empty string. I had expected to be able to use that to switch off the monitoring - is that not right? $ sudo pmstore hotproc.control.config "" hotproc.control.config old value="(fname == "pmdaproc")" new value="" $ sudo pmstore hotproc.control.config "" hotproc.control.config old value="(fname == "pmdaproc")" new value="" $ sudo pmstore hotproc.control.config "" hotproc.control.config old value="(fname == "pmdaproc")" new value="" If this is not a valid way to end hotproc-ing the store handler should probably return an error instead of accepting the empty string and ignoring it. But, it would be nice if it could be both dynamically enabled and disabled. An update like the following could be used to test that, if thats the behaviour you think we should go with...? --- 982.orig 2015-04-24 11:20:30.556960974 +1000 +++ 982 2015-04-24 11:20:36.858964662 +1000 @@ -39,6 +39,7 @@ # restore defaults $sudo pmstore hotproc.control.refresh 10 | _filter_store $sudo pmstore hotproc.control.config "" | _filter_store +$sudo pmstore hotproc.control.config "" | _filter_store status=0 exit cheers. -- Nathan From nscott@redhat.com Thu Apr 23 20:51:45 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 59E507F4E for ; Thu, 23 Apr 2015 20:51:45 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 614868F8050 for ; Thu, 23 Apr 2015 18:51:45 -0700 (PDT) X-ASG-Debug-ID: 1429840302-04cbb056b43b8430001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id UXTDTtHJPJnagmfI (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 23 Apr 2015 18:51:43 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3O1pdFS029257; Thu, 23 Apr 2015 21:51:39 -0400 Date: Thu, 23 Apr 2015 21:51:38 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: Lukas Berk , pcp developers Message-ID: <1623245265.5889251.1429840298981.JavaMail.zimbra@redhat.com> In-Reply-To: <55398121.8020608@internode.on.net> References: <852862416.3748569.1429589380945.JavaMail.zimbra@redhat.com> <5536CD81.1070008@internode.on.net> <670202791.5237429.1429755448032.JavaMail.zimbra@redhat.com> <55385C8A.40403@internode.on.net> <614087554.5255330.1429763218272.JavaMail.zimbra@redhat.com> <55398121.8020608@internode.on.net> Subject: Re: [patch] speed pmie startup MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [patch] speed pmie startup Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.221] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: speed pmie startup Thread-Index: RFsrgVQ/SjpAAQbTW21d9e/fPgjjkw== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1429840303 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18286 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Ken, ----- Original Message ----- > > 1. if pmie starts sooner, the number of samples should be larger, not > smaller ... so in qa/260 expecting a value of 180, finding a value of > 172 or 175 does not sound like a filter change is the right fix The sample time is increased by up to 2sec over earlier due to removal of the delays. For rate conversions like in 260 we'll end up with a larger denominator in the delta-v-over-delta-t calculation. So, if the numerator doesn't increase accordingly (depends on the sampled values), we can expect to see a smaller rate converted value. In all my tests, the values were only ever going down (slightly), so I only went with only decreasing the filter range. > 2. qa/312 is failing for me now and the pmie rule is never being evaluated > > I suspect (but have not found yet) some early rule firing that is no > longer working with the 1 sec delays at start removed ... more > investigation needed, me thinks. That may be because I aggressively reduced the timeout in test qa/312 - too much so perhaps. Does this change things...? diff --git a/qa/312 b/qa/312 index f3e0d75..c18ac3c 100755 --- a/qa/312 +++ b/qa/312 @@ -25,7 +25,7 @@ trap "rm -f $tmp.*; exit \$status" 0 1 2 3 15 echo 'load = sample.load;' | pmie -v -t 1hour >$tmp.out 2>$tmp.err & pmie_pid=$! -pmsleep 0.5 +pmsleep 1.5 $signal -s TERM $pmie_pid wait If not, can you run that sample.load pmie invocation in a shell and see if it really produces no output at all? (anything on stderr?) cheers. -- Nathan From wwwrun@oss.sgi.com Thu Apr 23 21:02:56 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 5B9E67F51; Thu, 23 Apr 2015 21:02:56 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 962] Missing QA for mounts PMDA Date: Fri, 24 Apr 2015 02:02:56 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: nathans@debian.org X-Bugzilla-Status: RESOLVED X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: nathans@debian.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: bug_status resolution short_desc Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1429840976.8ac8ddC61.25867"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1429840976.8ac8ddC61.25867 Date: Thu, 23 Apr 2015 21:02:56 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=962 Nathan Scott changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution|--- |FIXED Summary|Mising QA for mounts PMDA |Missing QA for mounts PMDA --- Comment #1 from Nathan Scott --- Test qa/845 has now been added to exercise the mounts PMDA. -- You are receiving this mail because: You are on the CC list for the bug. --1429840976.8ac8ddC61.25867 Date: Thu, 23 Apr 2015 21:02:56 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" changed bug 962
What Removed Added
Status NEW RESOLVED
Resolution --- FIXED
Summary Mising QA for mounts PMDA Missing QA for mounts PMDA

Comment # 1 on bug 962 from 
Test qa/845 has now been added to exercise the mounts PMDA.

You are receiving this mail because:
  • You are on the CC list for the bug.
--1429840976.8ac8ddC61.25867-- From wwwrun@oss.sgi.com Thu Apr 23 21:02:56 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 76F7D7F56; Thu, 23 Apr 2015 21:02:56 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 948] PMDAs should not be shipped without some QA coverage Date: Fri, 24 Apr 2015 02:02:56 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: nathans@debian.org X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: kenj@internode.on.net X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1429840976.7c6bEb3.25867"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1429840976.7c6bEb3.25867 Date: Thu, 23 Apr 2015 21:02:56 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=948 Bug 948 depends on bug 962, which changed state. Bug 962 Summary: Missing QA for mounts PMDA http://oss.sgi.com/bugzilla/show_bug.cgi?id=962 What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution|--- |FIXED -- You are receiving this mail because: You are on the CC list for the bug. --1429840976.7c6bEb3.25867 Date: Thu, 23 Apr 2015 21:02:56 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" Bug 948 depends on bug 962, which changed state.
What Removed Added
Status NEW RESOLVED
Resolution --- FIXED

You are receiving this mail because:
  • You are on the CC list for the bug.
--1429840976.7c6bEb3.25867-- From nscott@redhat.com Thu Apr 23 22:41:30 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id F33797F4E for ; Thu, 23 Apr 2015 22:41:29 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 06A9A304059 for ; Thu, 23 Apr 2015 20:41:26 -0700 (PDT) X-ASG-Debug-ID: 1429846877-04cb6c1cc8376370001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id DWmhcemo8yFLwEmd (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 23 Apr 2015 20:41:18 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3O3fGjA022390; Thu, 23 Apr 2015 23:41:16 -0400 Date: Thu, 23 Apr 2015 23:41:16 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus Cc: myllynen@redhat.com, pcp@oss.sgi.com Message-ID: <206370475.5905649.1429846876286.JavaMail.zimbra@redhat.com> In-Reply-To: <55392BAB.3060101@buffalo.edu> References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> <233739221.5258413.1429764654377.JavaMail.zimbra@redhat.com> <55392BAB.3060101@buffalo.edu> Subject: Re: [pcp] Hotproc fixes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.221] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: Hotproc fixes Thread-Index: X/bnlyTevGGYePUgB/0QaF4BWLgxKg== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1429846878 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18287 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > [...] > OK, tracked this down. Only happens on some OSs. I had assumed that > all of /proc//* should be available and files would only be missing > if some badness happened or a pid was in the process of exiting. Turns > out that schedstat is not enabled in some kernels by default. Will need > a bit of rework to deal with this. Now that I think about it, the /proc/pid/io entry is in the same boat... the kernel fs/proc/base.c code has - #ifdef CONFIG_TASK_IO_ACCOUNTING ONE("io", S_IRUSR, proc_tgid_io_accounting), #endif and it was only added part way through 2.6 lifetime IIRC, so older kernels will not have it at all. status and stat should be pretty safe though, so this should probably change too...? diff --git a/src/pmdas/linux_proc/proc_pid.c b/src/pmdas/linux_proc/proc_pid.c index 2dff249..5232367 100644 --- a/src/pmdas/linux_proc/proc_pid.c +++ b/src/pmdas/linux_proc/proc_pid.c @@ -487,7 +487,8 @@ hotproc_eval_procs(void) ioentry = fetch_proc_pid_io(pid, hotproc_poss_pid, &sts); schedstatentry = fetch_proc_pid_schedstat(pid, hotproc_poss_pid, &sts); - if (!statentry || !statusentry || !ioentry /*|| !schedstatentry */ ) { /* schedstat not available everywhere */ + /* Note: /proc/pid/schedstat and /proc/pid/io not on all platforms */ + if (!statentry || !statusentry /*|| !ioentry || !schedstatentry */) { /* Can happen if the process was exiting during * refresh_proc_pidlist then the above fetch's will fail. cheers. -- Nathan From kenj@internode.on.net Thu Apr 23 23:24:11 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 810357F4E for ; Thu, 23 Apr 2015 23:24:11 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 0CD56AC00B for ; Thu, 23 Apr 2015 21:23:55 -0700 (PDT) X-ASG-Debug-ID: 1429849430-04cb6c1cc83770b0001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id 8wG4EA6GKsSIiIew for ; Thu, 23 Apr 2015 21:23:53 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2CACAA6xDlVPL4Q0XZbgwyBLoJMToMuv2EJh08EAgKBNTkUAQEBAQEBAQYBAQEBQT+EIAEBAQMBCAIZBS4jBQcBAwIGAxUBBAIjAwICGSAKAxECBBMLBYgTB7cDlHgBAQgCAR+BIYoWhQQHgmiBRQWRSmOKdJBbg06EKSwxgkQBAQE Received: from ppp118-209-16-190.lns20.mel4.internode.on.net (HELO bozohorize) ([118.209.16.190]) by ipmail05.adl6.internode.on.net with ESMTP; 24 Apr 2015 13:53:49 +0930 From: "Ken McDonell" To: "'Nathan Scott'" Cc: "'Lukas Berk'" , "'pcp developers'" References: <852862416.3748569.1429589380945.JavaMail.zimbra@redhat.com> <5536CD81.1070008@internode.on.net> <670202791.5237429.1429755448032.JavaMail.zimbra@redhat.com> <55385C8A.40403@internode.on.net> <614087554.5255330.1429763218272.JavaMail.zimbra@redhat.com> <55398121.8020608@internode.on.net> <1623245265.5889251.1429840298981.JavaMail.zimbra@redhat.com> In-Reply-To: <1623245265.5889251.1429840298981.JavaMail.zimbra@redhat.com> Subject: RE: [patch] speed pmie startup Date: Fri, 24 Apr 2015 14:23:49 +1000 X-ASG-Orig-Subj: RE: [patch] speed pmie startup Message-ID: <00ce01d07e46$77350bc0$659f2340$@internode.on.net> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQJFVXwLsV3iCBx4hVXCmAZtyeSboQGG411QAZnZ8xoB0/RJkALXzhx2AbByVVwBmJEcUZwZNUnQ Content-Language: en-au X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1429849433 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18288 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header > -----Original Message----- > From: Nathan Scott [mailto:nathans@redhat.com] > Sent: Friday, 24 April 2015 11:52 AM > ... > In all my tests, the values were only ever going down (slightly), so I = only went > with only decreasing the filter range. OK ... your analysis trumps my wild arse guess. > That may be because I aggressively reduced the timeout in test qa/312 = - too > much so perhaps. Does this change things...? split the difference (sort of) ... pmsleep 1 seems to work for me ... do = you wanna commit that, or should I? From nscott@redhat.com Thu Apr 23 23:30:54 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id E94D47F4E for ; Thu, 23 Apr 2015 23:30:53 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 73B15AC004 for ; Thu, 23 Apr 2015 21:30:44 -0700 (PDT) X-ASG-Debug-ID: 1429849839-04cbb056b13bb420001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id pnzKAJrFNBCN48Mg (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 23 Apr 2015 21:30:40 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3O4UaSX006865; Fri, 24 Apr 2015 00:30:36 -0400 Date: Fri, 24 Apr 2015 00:30:36 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: Lukas Berk , pcp developers Message-ID: <1508762032.5913293.1429849836722.JavaMail.zimbra@redhat.com> In-Reply-To: <00ce01d07e46$77350bc0$659f2340$@internode.on.net> References: <852862416.3748569.1429589380945.JavaMail.zimbra@redhat.com> <5536CD81.1070008@internode.on.net> <670202791.5237429.1429755448032.JavaMail.zimbra@redhat.com> <55385C8A.40403@internode.on.net> <614087554.5255330.1429763218272.JavaMail.zimbra@redhat.com> <55398121.8020608@internode.on.net> <1623245265.5889251.1429840298981.JavaMail.zimbra@redhat.com> <00ce01d07e46$77350bc0$659f2340$@internode.on.net> Subject: Re: [patch] speed pmie startup MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [patch] speed pmie startup Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.221] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: speed pmie startup Thread-Index: AQJFVXwLsV3iCBx4hVXCmAZtyeSboQGG411QAZnZ8xoB0/RJkALXzhx2AbByVVwBmJEcUZwZNUnQ2YL0lGU= X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1429849840 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18289 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > > -----Original Message----- > > From: Nathan Scott [mailto:nathans@redhat.com] > > Sent: Friday, 24 April 2015 11:52 AM > > ... > > In all my tests, the values were only ever going down (slightly), so I only > > went with only decreasing the filter range. > > OK ... your analysis trumps my wild arse guess. Heh. > > That may be because I aggressively reduced the timeout in test qa/312 - too > > much so perhaps. Does this change things...? > > split the difference (sort of) ... pmsleep 1 seems to work for me ... do you > wanna commit that, or should I? I've got another couple of commits pending here, I'll roll this in with them. cheers. -- Nathan From mgoodwin@redhat.com Fri Apr 24 02:00:24 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id B3ADC29DFB for ; Fri, 24 Apr 2015 02:00:24 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 9B164304064 for ; Fri, 24 Apr 2015 00:00:21 -0700 (PDT) X-ASG-Debug-ID: 1429858805-04bdf063203bb750001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id GZkykPKg0MnafJf1 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 24 Apr 2015 00:00:08 -0700 (PDT) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3O705bT023228 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Fri, 24 Apr 2015 03:00:05 -0400 Received: from [10.64.50.196] (vpn1-50-196.bne.redhat.com [10.64.50.196]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3O703DB019357 for ; Fri, 24 Apr 2015 03:00:04 -0400 Message-ID: <5539E9F2.1050102@redhat.com> Date: Fri, 24 Apr 2015 17:00:02 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp Subject: pcp updates: nathans+kenj+martins merge Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: pcp updates: nathans+kenj+martins merge Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1429858808 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 merged via Nathan. Changes committed to git://git.pcp.io/pcp.git master Nathan Scott (6): qa: add to gitignore for lookupnametest binary pmdamounts: fix stack corruption for large mount options qa: update hotproc tests after martins latest set of fixes python: exception handling improvements qa: increase nap time in test 312 for slower QA boxen qa: flush output streams in qa/995 for deterministic output Ken McDonell (3): qa/475: fallout from pmLookupName() rework qa/444: pmLookupName() fallout libpcp/pmns.c: pmNameID and pmNameAll change Martins Innus (1): hotproc - more cleanups qa/312 | 2 qa/444 | 2 qa/444.out.1 | 14 ++- qa/444.out.2 | 14 ++- qa/444.out.3 | 14 ++- qa/475.out | 30 ++++---- qa/800 | 8 +- qa/800.out | 20 ++++- qa/845 | 84 +++++++++++++++++++++++ qa/845.out | 45 ++++++++++++ qa/982.out | 2 qa/995 | 18 +++++ qa/995.out | 12 +++ qa/group | 3 qa/src/.gitignore | 1 qa/src/GNUlocaldefs | 3 qa/src/multithread9.c | 9 +- qa/src/pmapi_exceptions.python | 57 ++++++++++++++++ src/libpcp/src/pmns.c | 5 + src/pmdas/linux_proc/config.c | 2 src/pmdas/linux_proc/gram_node.c | 9 ++ src/pmdas/linux_proc/proc_pid.c | 6 + src/pmdas/mounts/Install | 4 - src/pmdas/mounts/Remove | 20 ----- src/pmdas/mounts/help | 27 ++----- src/pmdas/mounts/mounts.c | 137 +++++++++++++++++++-------------------- src/pmdas/mounts/mounts.conf | 7 - src/pmdas/mounts/pmns | 6 - src/python/pcp/pmapi.py | 4 - 29 files changed, 402 insertions(+), 163 deletions(-) Details ... commit 0cb359346b445461202dfdbb5bbef3b937e152b5 Author: Nathan Scott Date: Fri Apr 24 16:05:37 2015 +1000 qa: flush output streams in qa/995 for deterministic output commit 707f2de72c2886e968a7d91236e7e638473e1b6f Author: Nathan Scott Date: Fri Apr 24 14:49:41 2015 +1000 qa: increase nap time in test 312 for slower QA boxen commit 4ade898f26a9aa75ac10b1976673b0f0bb524786 Author: Nathan Scott Date: Fri Apr 24 13:06:16 2015 +1000 python: exception handling improvements Ensure that the program name passed back from pmErr exception class is a native string (not always bytes); add a pmUsageErr extension allowing initial diagnostic message before Usage: Adds qa/995 and a helper python script to exercise both of the exception classes, using each mode of invocation. commit 6b5394e99ffbe755babc8ee8342a8b1ff240036f Author: Nathan Scott Date: Fri Apr 24 11:13:33 2015 +1000 qa: update hotproc tests after martins latest set of fixes Values for the hotproc config metric now have braces, so a couple of tests needed updating. Also tweaked the pmdaproc config generation code so that this > value "(uid == 0.000000)" is once again reported as > value "(uid == 0)" commit 8bcc3e21eb8851c4c3e29c004be7ac3d1179106e Author: Nathan Scott Date: Fri Apr 24 10:24:32 2015 +1000 pmdamounts: fix stack corruption for large mount options Miloš found some scenarios where the mounts PMDA could crash and burn when a machine has mounts with option strings larger than the allocated space for them. This commit improves the bounds checking for all arrays in this PMDA, and also does a bit of general housecleaning for pmdamount readability. Test qa/845 is added to exercise the mount PMDA. Resolves RHBZ #1213833. commit 2d3c11e3cb6611bca732742102596ed1e6eafd63 Author: Nathan Scott Date: Fri Apr 24 10:09:30 2015 +1000 qa: add to gitignore for lookupnametest binary commit 6dc6f0a8d879882caa99648211f8b45196af4ecb Author: Ken McDonell Date: Fri Apr 24 09:28:18 2015 +1000 libpcp/pmns.c: pmNameID and pmNameAll change Small error path logic change needed as a result of the last round of changes for looking up the names of dynamic metrics ... found by some QA failures. commit b178b2ce679fa9da644ba280dc695fb0b7721be5 Author: Ken McDonell Date: Fri Apr 24 09:25:04 2015 +1000 qa/444: pmLookupName() fallout This time the client <--> pmcd protocol changed slightly but the same output is generated thanks to compensating changes in libpcp. Add a bit more PCP -Dderive diagnostic output to confirm that the change is correct. commit dbcd0970569018285b8deb7bc1714bd1dc0d9225 Author: Ken McDonell Date: Fri Apr 24 08:40:39 2015 +1000 qa/475: fallout from pmLookupName() rework Tweak error handling in qa/src/multithread9.c, and a new 475.out to match. commit a6965ef0a68969e3e877884918491a30e1f6c45c Author: Martins Innus Date: Thu Apr 23 19:35:29 2015 +0000 hotproc - more cleanups Fix hotproc failing on linux kernel with no schedstat Fix qa/800 to detect nprocs==0 Cleanup hotproc.control.config output From nscott@redhat.com Fri Apr 24 02:14:48 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id D06A77F50 for ; Fri, 24 Apr 2015 02:14:48 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 6C9E9AC001 for ; Fri, 24 Apr 2015 00:14:36 -0700 (PDT) X-ASG-Debug-ID: 1429859670-04bdf063203bbc70001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id 8pLgmRJz6lKfGFTn (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 24 Apr 2015 00:14:31 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3O7EUbE016592 for ; Fri, 24 Apr 2015 03:14:30 -0400 Date: Fri, 24 Apr 2015 03:14:30 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp developers Message-ID: <2028241492.5949582.1429859670655.JavaMail.zimbra@redhat.com> In-Reply-To: <1011367005.5949123.1429859571715.JavaMail.zimbra@redhat.com> Subject: pcp updates: pmdaproc MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: pmdaproc Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.221] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF36 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: pmdaproc Thread-Index: WSy0aH577GPg42gmaRO8zltGaU6u9g== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1429859671 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18291 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... (This is not yet ready to be pulled Mark - its stable but needs some new QA tests. Pushing it in now so that Martins can build on it, if he has overlapping hotproc changes -- cheers.) Changes committed to git://git.pcp.io/nathans/pcp.git master qa/022.out.linux | 9 + qa/359 | 1 src/pmdas/linux_proc/cgroups.c | 6 src/pmdas/linux_proc/cgroups.h | 7 + src/pmdas/linux_proc/help_text.h | 9 + src/pmdas/linux_proc/pmda.c | 238 ++++++++++++++++++++++++++++++------ src/pmdas/linux_proc/proc_dynamic.c | 31 +++- src/pmdas/linux_proc/proc_pid.c | 55 +++++++- src/pmdas/linux_proc/proc_pid.h | 99 +++++++++----- src/pmdas/linux_proc/root_proc | 5 10 files changed, 375 insertions(+), 85 deletions(-) commit 80bd02cddf66e1d43832d30fe9344b408b6311ca Author: Nathan Scott Date: Fri Apr 24 17:10:00 2015 +1000 pmdaproc: additional proc memory, namespace and memory cgroup metrics From kenj@kenj.com.au Fri Apr 24 05:28:22 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id EC6AE7F50 for ; Fri, 24 Apr 2015 05:28:22 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id EF1938F8035 for ; Fri, 24 Apr 2015 03:28:19 -0700 (PDT) X-ASG-Debug-ID: 1429871295-04cb6c1cc837d6f0001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id JMF5s4eN3TbtyUhT for ; Fri, 24 Apr 2015 03:28:16 -0700 (PDT) X-Barracuda-Envelope-From: kenj@kenj.com.au X-Barracuda-Apparent-Source-IP: 150.101.137.143 Received: from ppp118-209-16-190.lns20.mel4.internode.on.net (HELO bozo-vm.localdomain) ([118.209.16.190]) by ipmail05.adl6.internode.on.net with ESMTP; 24 Apr 2015 19:58:09 +0930 Received: by bozo-vm.localdomain (Postfix, from userid 1000) id 8FA42A3CDB; Fri, 24 Apr 2015 20:27:51 +1000 (AEST) To: pcp@oss.sgi.com Subject: pcp updates Message-Id: <20150424102751.8FA42A3CDB@bozo-vm.localdomain> X-ASG-Orig-Subj: pcp updates Date: Fri, 24 Apr 2015 20:27:51 +1000 (AEST) From: kenj@kenj.com.au (Ken McDonell) X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1429871295 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18294 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp master Ken McDonell (3): qa/787: oops ... remove debugging crutch qa/archives: add missing dynmetric archive pmdumplog: scratch an itch cmdline arg foo != foo.0 etc qa/787 | 2 qa/995 | 51 +++++++++ qa/995.out | 239 ++++++++++++++++++++++++++++++++++++++++++++ qa/archives/dynmetric.0 |binary qa/archives/dynmetric.index |binary qa/archives/dynmetric.meta |binary qa/group | 1 src/pmdumplog/pmdumplog.c | 7 - 8 files changed, 296 insertions(+), 4 deletions(-) Details ... commit 6603f7663091253b70acc719cb7a21f6ebaf2cec Author: Ken McDonell Date: Fri Apr 24 20:14:21 2015 +1000 pmdumplog: scratch an itch cmdline arg foo != foo.0 etc Fix botch in filename handling ... -t produced bogus Warning: file missing or compressed for log volume 0 when command line arg was an archive filename (.0, .index, .meta, etc) rather than a basename for the archive. qa/995 proves the point. commit 693402b4f0715ed81e35f312f829bd8adfbed765 Author: Ken McDonell Date: Fri Apr 24 20:12:15 2015 +1000 qa/archives: add missing dynmetric archive commit a735f6ee7b41f49984b06572eaf082819f2f056b Author: Ken McDonell Date: Fri Apr 24 19:59:21 2015 +1000 qa/787: oops ... remove debugging crutch From kenj@internode.on.net Sat Apr 25 16:55:39 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=MIME_QP_LONG_LINE autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 0B3627F37 for ; Sat, 25 Apr 2015 16:55:39 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id DD3EA304043 for ; Sat, 25 Apr 2015 14:55:38 -0700 (PDT) X-ASG-Debug-ID: 1429998931-04cbb056b34242d0001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id U2id9KOgQGzV7r9r for ; Sat, 25 Apr 2015 14:55:32 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2CLBwAeDDxVPIx2LHlcgwyHd8UOglcEgTU9EAEBAQEBAQEGAQEBAUE/hCcIAkwwBQZiIAoVAQQeBYgaom6kDos4iTkFkVVjgQ+BN4gyg0iQd4QpLIJ1AQEB Received: from ppp121-44-118-140.lns20.syd4.internode.on.net (HELO bozohorize) ([121.44.118.140]) by ipmail05.adl6.internode.on.net with ESMTP; 26 Apr 2015 07:25:30 +0930 From: "Ken McDonell" To: "'pcp developers'" Subject: Recent QA failures Date: Sun, 26 Apr 2015 07:55:20 +1000 X-ASG-Orig-Subj: Recent QA failures Message-ID: <026e01d07fa2$874e9cd0$95ebd670$@internode.on.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_NextPart_000_026F_01D07FF6.58FB2200" X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdB/ogYiRwN31L4ERXGHXcMcTPGWrA== Content-Language: en-au X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1429998932 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.83 X-Barracuda-Spam-Status: No, SCORE=0.83 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=MIME_QP_LONG_LINE, MIME_QP_LONG_LINE_2, THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18338 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.00 MIME_QP_LONG_LINE RAW: Quoted-printable line longer than 76 chars 0.82 MIME_QP_LONG_LINE_2 RAW: Quoted-printable line longer than 76 chars This is a multipart message in MIME format. ------=_NextPart_000_026F_01D07FF6.58FB2200 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit I'm seeing failures on these tests: 458 800 982 995 These appear to be new and recent regressions. The spread is pretty broad, so not likely to be a single cause ... kenj@bozo-vm:~/src/pcp/qa$ egrep '^(458|800|982|995)' group 458 pmda.logger pmda.install event local 800 pmda.proc local 982 pmda.proc pmda.hotproc local 995 python local .bad files attached Could their respective owners please investigate? ------=_NextPart_000_026F_01D07FF6.58FB2200 Content-Type: application/octet-stream; name="995.out.bad" Content-Transfer-Encoding: quoted-printable Content-Disposition: attachment; filename="995.out.bad" QA output created by 995=0A= Usage: pcp [options]=0A= ++ pmapi.pmUsageErr exception handler=0A= Usage: pcp [options]=0A= ++ pmapi.pmUsageErr exception handler=0A= ++ pmapi.pmErr exception handler=0A= pcp: Generic error, already reported above=0A= ++ pmapi.pmErr exception handler=0A= pcp: Generic error, already reported above [extra information]=0A= ------=_NextPart_000_026F_01D07FF6.58FB2200 Content-Type: application/octet-stream; name="982.out.bad" Content-Transfer-Encoding: quoted-printable Content-Disposition: attachment; filename="982.out.bad" QA output created by 982=0A= hotproc.control.refresh new value=3D1=0A= hotproc.control.config new value=3D"fname =3D=3D "pmdaproc""=0A= =0A= hotproc.nprocs=0A= value 0=0A= =0A= hotproc.control.refresh=0A= value 1=0A= =0A= hotproc.control.config=0A= value "fname =3D=3D "pmdaproc""=0A= hotproc.control.refresh new value=3D10=0A= hotproc.control.config new value=3D""=0A= ------=_NextPart_000_026F_01D07FF6.58FB2200 Content-Type: application/octet-stream; name="800.out.bad" Content-Transfer-Encoding: quoted-printable Content-Disposition: attachment; filename="800.out.bad" QA output created by 800=0A= =3D=3D=3D Hotproc disabled by default test =3D=3D=3D=0A= dbpmda> open pipe PCP_PMDAS_DIR/proc/pmdaproc -d 3=0A= Start pmdaproc PMDA: PCP_PMDAS_DIR/proc/pmdaproc -d 3=0A= dbpmda> getdesc on=0A= dbpmda> fetch hotproc.control.config_gen=0A= PMID(s): 3.NUMBER.NUMBER=0A= pmResult dump from ADDR timestamp: 0.000000 TIME numpmid: 1=0A= 3.NUMBER.NUMBER (hotproc.control.config_gen): numval: 1 valfmt: 0 = vlist[]:=0A= value 0=0A= dbpmda> fetch hotproc.control.config=0A= PMID(s): 3.NUMBER.NUMBER=0A= pmResult dump from ADDR timestamp: 0.000000 TIME numpmid: 1=0A= 3.NUMBER.NUMBER (hotproc.control.config): numval: 1 valfmt: 1 vlist[]:=0A= value ""=0A= dbpmda> =0A= =3D=3D=3D Check that hotproc can be configured with UID=3D=3D=3D=0A= dbpmda> open pipe PCP_PMDAS_DIR/proc/pmdaproc -d 3=0A= Start pmdaproc PMDA: PCP_PMDAS_DIR/proc/pmdaproc -d 3=0A= dbpmda> getdesc on=0A= dbpmda> attr "username" "root"=0A= Attribute: username=3Droot=0A= Success=0A= dbpmda> attr 11 "0"=0A= Attribute: userid=3D0=0A= Success=0A= dbpmda> store hotproc.control.config "uid=3D=3D0"=0A= PMID: 3.NUMBER.NUMBER=0A= Getting description...=0A= Sending Profile...=0A= Getting Result Structure...=0A= 3.NUMBER.NUMBER: "" -> "uid=3D=3D0"=0A= Sending Result...=0A= dbpmda> store hotproc.control.refresh "1"=0A= PMID: 3.NUMBER.NUMBER=0A= Getting description...=0A= Getting Result Structure...=0A= 3.NUMBER.NUMBER: 10 -> 1=0A= Sending Result...=0A= dbpmda> fetch hotproc.control.config=0A= PMID(s): 3.NUMBER.NUMBER=0A= pmResult dump from ADDR timestamp: 0.000000 TIME numpmid: 1=0A= 3.NUMBER.NUMBER (hotproc.control.config): numval: 1 valfmt: 1 vlist[]:=0A= value "uid=3D=3D0"=0A= dbpmda> wait 3=0A= dbpmda> fetch hotproc.nprocs=0A= PMID(s): 3.NUMBER.NUMBER=0A= pmResult dump from ADDR timestamp: 0.000000 TIME numpmid: 1=0A= 3.NUMBER.NUMBER (hotproc.nprocs): numval: 1 valfmt: 0 vlist[]:=0A= value 0=0A= dbpmda> =0A= =3D=3D=3D Check that hotproc can be configured with process name=3D=3D=3D=0A= dbpmda> open pipe PCP_PMDAS_DIR/proc/pmdaproc -d 3=0A= Start pmdaproc PMDA: PCP_PMDAS_DIR/proc/pmdaproc -d 3=0A= dbpmda> getdesc on=0A= dbpmda> attr "username" "root"=0A= Attribute: username=3Droot=0A= Success=0A= dbpmda> attr 11 "0"=0A= Attribute: userid=3D0=0A= Success=0A= dbpmda> store hotproc.control.config 'fname=3D=3D"pmdaproc"'=0A= PMID: 3.NUMBER.NUMBER=0A= Getting description...=0A= Sending Profile...=0A= Getting Result Structure...=0A= 3.NUMBER.NUMBER: "" -> "fname=3D=3D"pmdaproc""=0A= Sending Result...=0A= dbpmda> store hotproc.control.refresh "1"=0A= PMID: 3.NUMBER.NUMBER=0A= Getting description...=0A= Getting Result Structure...=0A= 3.NUMBER.NUMBER: 10 -> 1=0A= Sending Result...=0A= dbpmda> wait 3=0A= dbpmda> fetch hotproc.nprocs=0A= PMID(s): 3.NUMBER.NUMBER=0A= pmResult dump from ADDR timestamp: 0.000000 TIME numpmid: 1=0A= 3.NUMBER.NUMBER (hotproc.nprocs): numval: 1 valfmt: 0 vlist[]:=0A= value 0=0A= dbpmda> =0A= ------=_NextPart_000_026F_01D07FF6.58FB2200 Content-Type: application/octet-stream; name="458.out.bad" Content-Transfer-Encoding: quoted-printable Content-Disposition: attachment; filename="458.out.bad" QA output created by 458=0A= You will need to choose an appropriate configuration for installation of=0A= the "logger" Performance Metrics Domain Agent (PMDA).=0A= =0A= collector collect performance statistics on this system=0A= monitor allow this system to monitor local and/or remote systems=0A= both collector and monitor configuration for this system=0A= =0A= Please enter c(ollector) or m(onitor) or b(oth) [b] Possible = configuration files to choose from:=0A= [1] PCP_VAR_DIR/config/logger/logger.conf=0A= [2] Specify your own configuration file.=0A= [3] None of the above (abandon configuration file selection).=0A= Which configuration file do you want to use ? [1] =0A= Contents of the selected configuration file:=0A= --------------- start PCP_VAR_DIR/config/logger/logger.conf = ---------------=0A= =0A= reg n TMPFILE.reg=0A= fifo n TMPFILE.fifo=0A= =0A= --------------- end PCP_VAR_DIR/config/logger/logger.conf ---------------=0A= =0A= Use this configuration file? [y] Updating the Performance Metrics Name = Space (PMNS) ...=0A= Terminate PMDA if already installed ...=0A= [...install files, make output...]=0A= Updating the PMCD control file, and notifying PMCD ...=0A= Check logger metrics have appeared ... 18 metrics and 15 values=0A= =3D=3D=3D 1. regular file case =3D=3D=3D=0A= Starting initial event watcher:=0A= done.=0A= Captured event trace was:=0A= host: localhost=0A= samples: 5=0A= interval: 1.00 sec=0A= logger.perfile.reg.records: 3 event records=0A= TIMESTAMP --- event record [0] flags 0x1 (point) ---=0A= logger.param_string "TeSt DaTa ... TeSt DaTa ..."=0A= TIMESTAMP --- event record [1] flags 0x1 (point) ---=0A= logger.param_string "TeSt2 DaTa2 ... TeSt2 DaTa2"=0A= TIMESTAMP --- event record [2] flags 0x1 (point) ---=0A= logger.param_string ""=0A= =3D=3D=3D 2. fifo queue case =3D=3D=3D=0A= Starting initial event watcher:=0A= done.=0A= Captured event trace was:=0A= host: localhost=0A= samples: 5=0A= interval: 1.00 sec=0A= logger.perfile.fifo.records: 2 event records=0A= TIMESTAMP --- event record [0] flags 0x1 (point) ---=0A= logger.param_string "TeSt DaTa ... TeSt DaTa ..."=0A= TIMESTAMP --- event record [1] flags 0x1 (point) ---=0A= logger.param_string "TeSt2 DaTa2 ... TeSt2 DaTa2"=0A= ------=_NextPart_000_026F_01D07FF6.58FB2200-- From minnus@buffalo.edu Sun Apr 26 12:22:14 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id D3E917F47 for ; Sun, 26 Apr 2015 12:22:14 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id C76F78F8035 for ; Sun, 26 Apr 2015 10:22:14 -0700 (PDT) X-ASG-Debug-ID: 1430068929-04cbb056b24365c0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve3.acsu.buffalo.edu [128.205.7.163]) by cuda.sgi.com with ESMTP id AWlsVgcGqDFZFlgj for ; Sun, 26 Apr 2015 10:22:10 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.163 Received: from localmaile.acsu.buffalo.edu (localmaile.acsu.buffalo.edu [128.205.4.3]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 7C31510A4; Sun, 26 Apr 2015 13:22:09 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 700CD160070; Sun, 26 Apr 2015 13:22:09 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localmaile.acsu.buffalo.edu (Postfix) with ESMTP id 59EB1160076; Sun, 26 Apr 2015 13:22:09 -0400 (EDT) Received: from smtp.buffalo.edu (smtp1.acsu.buffalo.edu [128.205.5.253]) by localmaile.acsu.buffalo.edu (Prefixe) with ESMTP id 5875B160070; Sun, 26 Apr 2015 13:22:09 -0400 (EDT) Received: from [10.0.1.191] (cpe-69-204-8-250.buffalo.res.rr.com [69.204.8.250]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 1F81B3644E; Sun, 26 Apr 2015 13:22:09 -0400 (EDT) Message-ID: <553D1EBD.9030603@buffalo.edu> Date: Sun, 26 Apr 2015 13:22:05 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Nathan Scott CC: myllynen@redhat.com, pcp@oss.sgi.com Subject: Re: [pcp] Hotproc fixes References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> <233739221.5258413.1429764654377.JavaMail.zimbra@redhat.com> <55392BAB.3060101@buffalo.edu> <206370475.5905649.1429846876286.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes In-Reply-To: <206370475.5905649.1429846876286.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: XX: 28% X-Barracuda-Connect: mtareserve3.acsu.buffalo.edu[128.205.7.163] X-Barracuda-Start-Time: 1430068929 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18359 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Nathan, On 4/23/2015 11:41 PM, Nathan Scott wrote: > > ----- Original Message ----- >> [...] >> OK, tracked this down. Only happens on some OSs. I had assumed that >> all of /proc//* should be available and files would only be missing >> if some badness happened or a pid was in the process of exiting. Turns >> out that schedstat is not enabled in some kernels by default. Will need >> a bit of rework to deal with this. > Now that I think about it, the /proc/pid/io entry is in the same boat... > the kernel fs/proc/base.c code has - > > #ifdef CONFIG_TASK_IO_ACCOUNTING > ONE("io", S_IRUSR, proc_tgid_io_accounting), > #endif > > Yup, probably also need the following guards, but I don't have a system without these entries to test for sure. https://github.com/ubccr/pcp/tree/hotproc_cleanups Martins diff --git a/src/pmdas/linux_proc/proc_pid.c b/src/pmdas/linux_proc/proc_pid.c index 442c5b4..10077d7 100644 --- a/src/pmdas/linux_proc/proc_pid.c +++ b/src/pmdas/linux_proc/proc_pid.c @@ -545,7 +545,9 @@ hotproc_eval_procs(void) /* IO demand */ /* Read */ - if ((f = _pm_getfield(ioentry->io_lines.readb, 1)) == NULL) + if( !ioentry ) /* ioentry is not enabled on all kernels */ + ull = 0; + else if ((f = _pm_getfield(ioentry->io_lines.readb, 1)) == NULL) ull = 0; else ull = (__uint64_t)strtoull(f, &tail, 0); @@ -554,7 +556,9 @@ hotproc_eval_procs(void) /* Write */ - if ((f = _pm_getfield(ioentry->io_lines.writeb, 1)) == NULL) + if( !ioentry ) /* ioentry is not enabled on all kernels */ + ull = 0; + else if ((f = _pm_getfield(ioentry->io_lines.writeb, 1)) == NULL) ull = 0; else ull = (__uint64_t)strtoull(f, &tail, 0); From minnus@buffalo.edu Sun Apr 26 15:55:44 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id E18A37F47 for ; Sun, 26 Apr 2015 15:55:44 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id 7AC35AC001 for ; Sun, 26 Apr 2015 13:55:41 -0700 (PDT) X-ASG-Debug-ID: 1430081736-04bdf0632243b0f0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve3.acsu.buffalo.edu [128.205.7.163]) by cuda.sgi.com with ESMTP id jLKuAjCeHAC0kw5C for ; Sun, 26 Apr 2015 13:55:36 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.163 Received: from localmaile.acsu.buffalo.edu (localmaile.acsu.buffalo.edu [128.205.4.3]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 24EF61255; Sun, 26 Apr 2015 16:55:36 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 189FF160070; Sun, 26 Apr 2015 16:55:36 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localmaile.acsu.buffalo.edu (Postfix) with ESMTP id 08785160076; Sun, 26 Apr 2015 16:55:36 -0400 (EDT) Received: from smtp.buffalo.edu (smtp4.acsu.buffalo.edu [128.205.5.229]) by localmaile.acsu.buffalo.edu (Prefixe) with ESMTP id 075EF160070; Sun, 26 Apr 2015 16:55:36 -0400 (EDT) Received: from [10.0.1.191] (cpe-69-204-8-250.buffalo.res.rr.com [69.204.8.250]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id CD330992FE; Sun, 26 Apr 2015 16:55:35 -0400 (EDT) Message-ID: <553D50C3.8090703@buffalo.edu> Date: Sun, 26 Apr 2015 16:55:31 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Ken McDonell , 'pcp developers' Subject: Re: [pcp] Recent QA failures References: <026e01d07fa2$874e9cd0$95ebd670$@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] Recent QA failures In-Reply-To: <026e01d07fa2$874e9cd0$95ebd670$@internode.on.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: XX: 28% X-Barracuda-Connect: mtareserve3.acsu.buffalo.edu[128.205.7.163] X-Barracuda-Start-Time: 1430081736 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18364 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Ken, On 4/25/2015 5:55 PM, Ken McDonell wrote: > I'm seeing failures on these tests: 458 800 982 995 > > These appear to be new and recent regressions. > > The spread is pretty broad, so not likely to be a single cause ... > > kenj@bozo-vm:~/src/pcp/qa$ egrep '^(458|800|982|995)' group > 458 pmda.logger pmda.install event local > 800 pmda.proc local > 982 pmda.proc pmda.hotproc local > 995 python local > 982 and 800 are likely mine from trying to fix previous false positives. Can you send me an OS where those are failing? Thanks Martins From kenj@internode.on.net Sun Apr 26 16:07:46 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 76D8A7F47 for ; Sun, 26 Apr 2015 16:07:46 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 5BDAD8F8033 for ; Sun, 26 Apr 2015 14:07:43 -0700 (PDT) X-ASG-Debug-ID: 1430082460-04bdf0632243b450001-S8gJnT Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by cuda.sgi.com with ESMTP id QQmDoyurt48nyFVG for ; Sun, 26 Apr 2015 14:07:41 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.145 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2AlBwBIUz1VPBJ50XZcDoJ+gS+CTIN8xzEEAgKBHU0BAQEBAQEHAQEBAUE/hCABAQEECAIwHC8BAwIGAw4HASkHGSAKAwMBDQIEARILBYgaxGwBCwEfiziFDIQtBZFVY583g1pPLDGCRAEBAQ Received: from ppp118-209-121-18.lns20.mel4.internode.on.net (HELO bozohorize) ([118.209.121.18]) by ipmail06.adl6.internode.on.net with ESMTP; 27 Apr 2015 06:37:37 +0930 From: "Ken McDonell" To: "'Martins Innus'" , "'pcp developers'" References: <026e01d07fa2$874e9cd0$95ebd670$@internode.on.net> <553D50C3.8090703@buffalo.edu> In-Reply-To: <553D50C3.8090703@buffalo.edu> Subject: RE: [pcp] Recent QA failures Date: Mon, 27 Apr 2015 07:07:23 +1000 X-ASG-Orig-Subj: RE: [pcp] Recent QA failures Message-ID: <02d701d08064$fe50d6a0$faf283e0$@internode.on.net> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQFQrypyEwzA5vM7WhRPWDWLAh5YWAD0/BhTnlfC5bA= Content-Language: en-au X-Barracuda-Connect: ipmail06.adl6.internode.on.net[150.101.137.145] X-Barracuda-Start-Time: 1430082461 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18364 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== > -----Original Message----- > From: Martins Innus [mailto:minnus@buffalo.edu] > Sent: Monday, 27 April 2015 6:56 AM > ... > 982 and 800 are likely mine from trying to fix previous false positives. Can you > send me an OS where those are failing? G'day Martins. The failures so far have only been on bozo-vm (PCP 3.10.5) x86_64 Debian 7.6 which is running on a VirtualBox VM on a Windows 7 host (my laptop). From minnus@buffalo.edu Mon Apr 27 12:11:03 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id C22AD7F56 for ; Mon, 27 Apr 2015 12:11:03 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 944EF304043 for ; Mon, 27 Apr 2015 10:11:00 -0700 (PDT) X-ASG-Debug-ID: 1430154658-04bdf0632145d940001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve3.acsu.buffalo.edu [128.205.7.163]) by cuda.sgi.com with ESMTP id BHoVVPjGU2IziyKI for ; Mon, 27 Apr 2015 10:10:58 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.163 Received: from localmaile.acsu.buffalo.edu (localmaile.acsu.buffalo.edu [128.205.4.3]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 482347B9; Mon, 27 Apr 2015 13:10:58 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 3C09C160070; Mon, 27 Apr 2015 13:10:58 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localmaile.acsu.buffalo.edu (Postfix) with ESMTP id 2968C160076; Mon, 27 Apr 2015 13:10:58 -0400 (EDT) Received: from smtp.buffalo.edu (smtp1.acsu.buffalo.edu [128.205.5.253]) by localmaile.acsu.buffalo.edu (Prefixe) with ESMTP id 285B1160070; Mon, 27 Apr 2015 13:10:58 -0400 (EDT) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 244B142135; Mon, 27 Apr 2015 13:10:58 -0400 (EDT) Message-ID: <553E6DA1.7030700@buffalo.edu> Date: Mon, 27 Apr 2015 13:10:57 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Ken McDonell , 'pcp developers' Subject: Re: [pcp] Recent QA failures References: <026e01d07fa2$874e9cd0$95ebd670$@internode.on.net> <553D50C3.8090703@buffalo.edu> <02d701d08064$fe50d6a0$faf283e0$@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] Recent QA failures In-Reply-To: <02d701d08064$fe50d6a0$faf283e0$@internode.on.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve3.acsu.buffalo.edu[128.205.7.163] X-Barracuda-Start-Time: 1430154658 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18389 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Ken, On 4/26/15 5:07 PM, Ken McDonell wrote: >> -----Original Message----- >> From: Martins Innus [mailto:minnus@buffalo.edu] >> Sent: Monday, 27 April 2015 6:56 AM >> ... >> 982 and 800 are likely mine from trying to fix previous false positives. > Can you >> send me an OS where those are failing? > G'day Martins. > > The failures so far have only been on bozo-vm (PCP 3.10.5) x86_64 Debian > 7.6 which is running on a VirtualBox VM on a Windows 7 host (my laptop). > > OK, I am not able to reproduce on a similar system: Deb 7.6 x86_64 on a VirtualBox VM on a Mac host. Could I ask you to try a couple things? 1. For 800 and 982 increase the wait/pmsleep, maybe double the values. If that doesn't work, increase them significantly, maybe 20 seconds. 2. Send a directory listing of some /proc/ 3. Try : sudo pmstore hotproc.control.config "uid==0" pminfo -f hotproc.control.config pminfo -f hotproc.nprocs pminfo -f hotproc.id.uid And send me the output? Thanks Martins From noreply@release.debian.org Mon Apr 27 12:13:34 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id B1EC87F58 for ; Mon, 27 Apr 2015 12:13:34 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 502DEAC002 for ; Mon, 27 Apr 2015 10:13:31 -0700 (PDT) X-ASG-Debug-ID: 1430154808-04cb6c1cc840c770001-S8gJnT Received: from picconi.debian.org (picconi.debian.org [5.153.231.3]) by cuda.sgi.com with ESMTP id cnleMSK9kFaR4J04 (version=TLSv1 cipher=AES128-SHA bits=128 verify=NO) for ; Mon, 27 Apr 2015 10:13:29 -0700 (PDT) X-Barracuda-Envelope-From: noreply@release.debian.org X-Barracuda-Apparent-Source-IP: 5.153.231.3 Received: from mailly.debian.org ([2001:41b8:202:deb:6564:a62:52c3:4b72]) from C=NA,ST=NA,L=Ankh Morpork,O=Debian SMTP,OU=Debian SMTP CA,CN=mailly.debian.org,EMAIL=hostmaster@mailly.debian.org (verified) by picconi.debian.org with esmtps (TLS1.2:DHE_RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from ) id 1Ymmb1-0007Nn-GA for pcp@packages.debian.org; Mon, 27 Apr 2015 17:13:27 +0000 Received: from franck.debian.org ([138.16.160.12]) from C=NA,ST=NA,L=Ankh Morpork,O=Debian SMTP,OU=Debian SMTP CA,CN=franck.debian.org,EMAIL=hostmaster@franck.debian.org (verified) by mailly.debian.org with esmtps (TLS1.2:DHE_RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from ) id 1Ymm4d-0007pw-CS; Mon, 27 Apr 2015 16:39:59 +0000 Received: from release by franck.debian.org with local (Exim 4.80) (envelope-from ) id 1Ymm4I-0005ft-MT; Mon, 27 Apr 2015 16:39:38 +0000 From: Debian testing watch Precedence: bulk X-Trille: 0.120315.1711 Subject: pcp 3.10.1 MIGRATED to testing X-Testing-Watch-Package: pcp X-ASG-Orig-Subj: pcp 3.10.1 MIGRATED to testing X-Testing-Watch-Version: 3.10.1 To: pcp@packages.debian.org Message-Id: Date: Mon, 27 Apr 2015 16:39:38 +0000 Delivered-To: pcp@packages.debian.org X-Barracuda-Connect: picconi.debian.org[5.153.231.3] X-Barracuda-Start-Time: 1430154809 X-Barracuda-Encrypted: AES128-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18389 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header FYI: The status of the pcp source package in Debian's testing distribution has changed. Previous version: 3.9.10 Current version: 3.10.1 -- This email is automatically generated once a day. As the installation of new packages into testing happens multiple times a day you will receive later changes on the next day. See https://release.debian.org/testing-watch/ for more information. From wwwrun@oss.sgi.com Mon Apr 27 17:11:53 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id E36857F5E; Mon, 27 Apr 2015 17:11:53 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 871] poor error checking in __pmDecodeProfile Date: Mon, 27 Apr 2015 22:11:53 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: kenj@internode.on.net X-Bugzilla-Status: RESOLVED X-Bugzilla-Priority: P2 X-Bugzilla-Assigned-To: mort@sgi.com X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1430172713.b4Ecf3.21603"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1430172713.b4Ecf3.21603 Date: Mon, 27 Apr 2015 17:11:53 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=871 Ken McDonell changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED CC| |kenj@internode.on.net Resolution|--- |FIXED --- Comment #1 from Ken McDonell --- At some point in the last 5 years this has been fixed. Added fault injection points in __pmDecodeProfile and a new qa/770 to verify that there are no mem leaks on the error paths in this routine. -- You are receiving this mail because: You are on the CC list for the bug. --1430172713.b4Ecf3.21603 Date: Mon, 27 Apr 2015 17:11:53 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" changed bug 871
What Removed Added
Status NEW RESOLVED
CC   kenj@internode.on.net
Resolution --- FIXED

Comment # 1 on bug 871 from 
At some point in the last 5 years this has been fixed.

Added fault injection points in __pmDecodeProfile and a new qa/770 to verify
that there are no mem leaks on the error paths in this routine.

You are receiving this mail because:
  • You are on the CC list for the bug.
--1430172713.b4Ecf3.21603-- From wwwrun@oss.sgi.com Mon Apr 27 17:17:17 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 4858D7F58; Mon, 27 Apr 2015 17:17:17 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 958] Mising QA for roomtemp PMDA Date: Mon, 27 Apr 2015 22:17:17 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: kenj@internode.on.net X-Bugzilla-Status: RESOLVED X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: kenj@internode.on.net X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1430173037.6DCcD3841.22549"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1430173037.6DCcD3841.22549 Date: Mon, 27 Apr 2015 17:17:17 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=958 Ken McDonell changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution|--- |WONTFIX --- Comment #1 from Ken McDonell --- I don't care. And everyone cares even less. The roomtemp PMDA is not really useful beyond a toy demonstration, and I no longer have the specific model of the Dallas thermister that it depends on. -- You are receiving this mail because: You are on the CC list for the bug. --1430173037.6DCcD3841.22549 Date: Mon, 27 Apr 2015 17:17:17 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" changed bug 958
What Removed Added
Status NEW RESOLVED
Resolution --- WONTFIX

Comment # 1 on bug 958 from 
I don't care.
And everyone cares even less.
The roomtemp PMDA is not really useful beyond a toy demonstration, and I no
longer have the specific model of the Dallas thermister that it depends on.

You are receiving this mail because:
  • You are on the CC list for the bug.
--1430173037.6DCcD3841.22549-- From wwwrun@oss.sgi.com Mon Apr 27 17:17:17 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 5E58B7F5D; Mon, 27 Apr 2015 17:17:17 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 948] PMDAs should not be shipped without some QA coverage Date: Mon, 27 Apr 2015 22:17:17 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: kenj@internode.on.net X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: kenj@internode.on.net X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1430173037.4bA8c3.22549"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1430173037.4bA8c3.22549 Date: Mon, 27 Apr 2015 17:17:17 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=948 Bug 948 depends on bug 958, which changed state. Bug 958 Summary: Mising QA for roomtemp PMDA http://oss.sgi.com/bugzilla/show_bug.cgi?id=958 What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution|--- |WONTFIX -- You are receiving this mail because: You are on the CC list for the bug. --1430173037.4bA8c3.22549 Date: Mon, 27 Apr 2015 17:17:17 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" Bug 948 depends on bug 958, which changed state.
What Removed Added
Status NEW RESOLVED
Resolution --- WONTFIX

You are receiving this mail because:
  • You are on the CC list for the bug.
--1430173037.4bA8c3.22549-- From wwwrun@oss.sgi.com Mon Apr 27 18:03:46 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 4C7C77F59; Mon, 27 Apr 2015 18:03:46 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 958] Mising QA for roomtemp PMDA Date: Mon, 27 Apr 2015 23:03:46 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: nathans@debian.org X-Bugzilla-Status: RESOLVED X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: kenj@internode.on.net X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1430175826.D7cD4B1.25609"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1430175826.D7cD4B1.25609 Date: Mon, 27 Apr 2015 18:03:46 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=958 Nathan Scott changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |nathans@debian.org --- Comment #2 from Nathan Scott --- Should we drop the PMDA code from the tree? -- You are receiving this mail because: You are on the CC list for the bug. --1430175826.D7cD4B1.25609 Date: Mon, 27 Apr 2015 18:03:46 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" changed bug 958
What Removed Added
CC   nathans@debian.org

Comment # 2 on bug 958 from 
Should we drop the PMDA code from the tree?

You are receiving this mail because:
  • You are on the CC list for the bug.
--1430175826.D7cD4B1.25609-- From wwwrun@oss.sgi.com Mon Apr 27 18:07:10 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 0EFD77F5A; Mon, 27 Apr 2015 18:07:10 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 958] Mising QA for roomtemp PMDA Date: Mon, 27 Apr 2015 23:07:09 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: kenj@internode.on.net X-Bugzilla-Status: RESOLVED X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: kenj@internode.on.net X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1430176030.7cFBc2.25840"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1430176030.7cFBc2.25840 Date: Mon, 27 Apr 2015 18:07:10 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=958 --- Comment #3 from Ken McDonell --- We could start by dropping it from the build, and see if anyone notices. -- You are receiving this mail because: You are on the CC list for the bug. --1430176030.7cFBc2.25840 Date: Mon, 27 Apr 2015 18:07:10 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8"

Comment # 3 on bug 958 from 
We could start by dropping it from the build, and see if anyone notices.

You are receiving this mail because:
  • You are on the CC list for the bug.
--1430176030.7cFBc2.25840-- From nscott@redhat.com Mon Apr 27 18:54:52 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 59F567F59 for ; Mon, 27 Apr 2015 18:54:52 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id DA487AC003 for ; Mon, 27 Apr 2015 16:54:51 -0700 (PDT) X-ASG-Debug-ID: 1430178886-04cb6c1cc84175f0001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id Bk3cITO6w77ta0Q7 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 27 Apr 2015 16:54:46 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3RNshvx006864; Mon, 27 Apr 2015 19:54:43 -0400 Date: Mon, 27 Apr 2015 19:54:43 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus Cc: myllynen@redhat.com, pcp@oss.sgi.com Message-ID: <447577300.7686379.1430178883275.JavaMail.zimbra@redhat.com> In-Reply-To: <553D1EBD.9030603@buffalo.edu> References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> <233739221.5258413.1429764654377.JavaMail.zimbra@redhat.com> <55392BAB.3060101@buffalo.edu> <206370475.5905649.1429846876286.JavaMail.zimbra@redhat.com> <553D1EBD.9030603@buffalo.edu> Subject: Re: [pcp] Hotproc fixes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.189] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: Hotproc fixes Thread-Index: i3730OBO40feQJpUP7bO1J0t5fy5MA== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1430178886 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18407 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Martins, ----- Original Message ----- > Nathan, > > On 4/23/2015 11:41 PM, Nathan Scott wrote: > > > > ----- Original Message ----- > >> [...] > >> OK, tracked this down. Only happens on some OSs. I had assumed that > >> all of /proc//* should be available and files would only be missing > >> if some badness happened or a pid was in the process of exiting. Turns > >> out that schedstat is not enabled in some kernels by default. Will need > >> a bit of rework to deal with this. > > Now that I think about it, the /proc/pid/io entry is in the same boat... > > the kernel fs/proc/base.c code has - > > > > #ifdef CONFIG_TASK_IO_ACCOUNTING > > ONE("io", S_IRUSR, proc_tgid_io_accounting), > > #endif > > > > > Yup, probably also need the following guards, but I don't have a system > without these entries to test for sure. > > https://github.com/ubccr/pcp/tree/hotproc_cleanups Good call, yes. I also don't have such a system, but we can fake it via $PROC_STATSPATH env var - I'm writing some other pmdaproc QA tests today, will add this in at the same time. cheers. -- Nathan From nscott@redhat.com Mon Apr 27 19:12:33 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id BBEC97F5D for ; Mon, 27 Apr 2015 19:12:33 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id AD3D08F8065 for ; Mon, 27 Apr 2015 17:12:30 -0700 (PDT) X-ASG-Debug-ID: 1430179948-04cb6c1cc8417cd0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id XT1OJXaXPh6fVwRa (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 27 Apr 2015 17:12:29 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3S0CBmn010815; Mon, 27 Apr 2015 20:12:11 -0400 Date: Mon, 27 Apr 2015 20:12:11 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp developers Message-ID: <1699060067.7689027.1430179931519.JavaMail.zimbra@redhat.com> In-Reply-To: <026e01d07fa2$874e9cd0$95ebd670$@internode.on.net> References: <026e01d07fa2$874e9cd0$95ebd670$@internode.on.net> Subject: Re: [pcp] Recent QA failures MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Recent QA failures Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.189] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: Recent QA failures Thread-Index: AdB/ogYiRwN31L4ERXGHXcMcTPGWrOg8ExFL X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1430179949 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18407 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > I'm seeing failures on these tests: 458 800 982 995 > > These appear to be new and recent regressions. > > The spread is pretty broad, so not likely to be a single cause ... > > kenj@bozo-vm:~/src/pcp/qa$ egrep '^(458|800|982|995)' group > 458 pmda.logger pmda.install event local > 800 pmda.proc local > 982 pmda.proc pmda.hotproc local > 995 python local > > .bad files attached 995 looks like either the "python-pcp" or "python3-pcp" package has not been updated? Its passing here for both python2 & 3 and I'd expect the failure you're seeing there if the pmapi.py was out-of-date. 458 looks like either a pmdalogger issue or a race condition - nothing I can think of that has changed there recently, so odd that its started failing. cheers. -- Nathan From kenj@internode.on.net Mon Apr 27 20:28:21 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 3DE117F5F for ; Mon, 27 Apr 2015 20:28:21 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 13365304039 for ; Mon, 27 Apr 2015 18:28:21 -0700 (PDT) X-ASG-Debug-ID: 1430184495-04bdf0632346b9e0001-S8gJnT Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id DwVCI1JYmfUtzJzK for ; Mon, 27 Apr 2015 18:28:15 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.131 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2CjBgB54T5V/0Bx0XZcDoJ+z1cEAgKBME0BAQEBAQGBC4QhAQEECAIeEhwwAwIGAw44GSAeAgQBHQWIGsdFiziEMwEBV4QtBY8zgiJjiniQb4NQI4FlgVJPLIE8gTkBAQE Received: from ppp118-209-113-64.lns20.mel4.internode.on.net (HELO bozohorize) ([118.209.113.64]) by ipmail07.adl2.internode.on.net with ESMTP; 28 Apr 2015 10:57:58 +0930 From: "Ken McDonell" To: "'Martins Innus'" , "'pcp developers'" References: <026e01d07fa2$874e9cd0$95ebd670$@internode.on.net> <553D50C3.8090703@buffalo.edu> <02d701d08064$fe50d6a0$faf283e0$@internode.on.net> <553E6DA1.7030700@buffalo.edu> In-Reply-To: <553E6DA1.7030700@buffalo.edu> Subject: RE: [pcp] Recent QA failures Date: Tue, 28 Apr 2015 11:27:44 +1000 X-ASG-Orig-Subj: RE: [pcp] Recent QA failures Message-ID: <005d01d08152$8e951260$abbf3720$@internode.on.net> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQFQrypyEwzA5vM7WhRPWDWLAh5YWAD0/BhTAaEn+ogDCq4taZ40PzMQ Content-Language: en-au X-Barracuda-Connect: ipmail07.adl2.internode.on.net[150.101.137.131] X-Barracuda-Start-Time: 1430184495 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18411 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== Sorry Martins, but the issue seems to have moved on, or rather gone away. Not sure what happened between Sunday and now, but both 800 and 982 are passing repeatedly now. Apologies for the distraction. I'll keep your triage mail hints in case the issue resurfaces in the near future. From minnus@buffalo.edu Mon Apr 27 20:41:49 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=MIME_QP_LONG_LINE autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 97EB97F61 for ; Mon, 27 Apr 2015 20:41:49 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 8A6D98F8078 for ; Mon, 27 Apr 2015 18:41:46 -0700 (PDT) X-ASG-Debug-ID: 1430185304-04cb6c1cc7419860001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve3.acsu.buffalo.edu [128.205.7.163]) by cuda.sgi.com with ESMTP id oy53GBxNYz5RUJaY for ; Mon, 27 Apr 2015 18:41:45 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.163 Received: from localmailf.acsu.buffalo.edu (localmailf.acsu.buffalo.edu [128.205.4.17]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 9267CB23; Mon, 27 Apr 2015 21:41:44 -0400 (EDT) Received: from localmailf.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 800BC8007A; Mon, 27 Apr 2015 21:41:45 -0400 (EDT) Received: from localmailf.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailf.acsu.buffalo.edu (Postfix) with ESMTP id 6E80B8007D; Mon, 27 Apr 2015 21:41:45 -0400 (EDT) Received: from smtp.buffalo.edu (smtp3.acsu.buffalo.edu [128.205.5.226]) by localmailf.acsu.buffalo.edu (Prefixe) with ESMTP id 6CD898007A; Mon, 27 Apr 2015 21:41:45 -0400 (EDT) Received: from [10.0.1.12] (cpe-69-204-8-250.buffalo.res.rr.com [69.204.8.250]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id F36F42AC1; Mon, 27 Apr 2015 21:41:38 -0400 (EDT) References: <026e01d07fa2$874e9cd0$95ebd670$@internode.on.net> <553D50C3.8090703@buffalo.edu> <02d701d08064$fe50d6a0$faf283e0$@internode.on.net> <553E6DA1.7030700@buffalo.edu> <005d01d08152$8e951260$abbf3720$@internode.on.net> Mime-Version: 1.0 (1.0) In-Reply-To: <005d01d08152$8e951260$abbf3720$@internode.on.net> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Message-Id: <2C4E739D-4BA8-44EC-9FB6-C2B2A74347C3@buffalo.edu> Cc: pcp developers X-Mailer: iPhone Mail (11D257) From: Martins Innus Subject: Re: [pcp] Recent QA failures Date: Mon, 27 Apr 2015 21:41:33 -0400 X-ASG-Orig-Subj: Re: [pcp] Recent QA failures To: Ken McDonell X-PM-EL-Spam-Prob: XX: 28% X-Barracuda-Connect: mtareserve3.acsu.buffalo.edu[128.205.7.163] X-Barracuda-Start-Time: 1430185304 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.82 X-Barracuda-Spam-Status: No, SCORE=0.82 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=MIME_QP_LONG_LINE, MIME_QP_LONG_LINE_2 X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18411 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 MIME_QP_LONG_LINE RAW: Quoted-printable line longer than 76 chars 0.82 MIME_QP_LONG_LINE_2 RAW: Quoted-printable line longer than 76 chars Ken, > On Apr 27, 2015, at 9:27 PM, "Ken McDonell" wrote:= >=20 > Sorry Martins, but the issue seems to have moved on, or rather gone away. >=20 > Not sure what happened between Sunday and now, but both 800 and 982 are > passing repeatedly now. >=20 > Apologies for the distraction. No problem, there might still be problems there. I'll keep it in mind as I w= ork on hotproc. Martins= From nscott@redhat.com Mon Apr 27 20:47:09 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 057787F63 for ; Mon, 27 Apr 2015 20:47:09 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id DB9668F8078 for ; Mon, 27 Apr 2015 18:47:08 -0700 (PDT) X-ASG-Debug-ID: 1430185626-04cb6c1cc9419a00001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id vx7tda8owicDUZaj (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Mon, 27 Apr 2015 18:47:07 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3S1koQP025262; Mon, 27 Apr 2015 21:46:50 -0400 Date: Mon, 27 Apr 2015 21:46:50 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus , Ken McDonell Cc: pcp developers Message-ID: <171933047.7706877.1430185610595.JavaMail.zimbra@redhat.com> In-Reply-To: <2C4E739D-4BA8-44EC-9FB6-C2B2A74347C3@buffalo.edu> References: <026e01d07fa2$874e9cd0$95ebd670$@internode.on.net> <553D50C3.8090703@buffalo.edu> <02d701d08064$fe50d6a0$faf283e0$@internode.on.net> <553E6DA1.7030700@buffalo.edu> <005d01d08152$8e951260$abbf3720$@internode.on.net> <2C4E739D-4BA8-44EC-9FB6-C2B2A74347C3@buffalo.edu> Subject: Re: [pcp] Recent QA failures MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Recent QA failures Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.189] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: Recent QA failures Thread-Index: qTxNe0/yb1fk8GmkG0+Yd4goPq2kmw== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1430185627 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18411 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > Ken, > > > On Apr 27, 2015, at 9:27 PM, "Ken McDonell" wrote: > > > > Sorry Martins, but the issue seems to have moved on, or rather gone away. > > > > Not sure what happened between Sunday and now, but both 800 and 982 are > > passing repeatedly now. > > > > Apologies for the distraction. > > No problem, there might still be problems there. I'll keep it in mind as I > work on hotproc. I did see some issues earlier last week (well before Sunday though Ken) and some small, possibly-related fixes went in via ... commit 6b5394e99ffbe755babc8ee8342a8b1ff240036f Author: Nathan Scott Date: Fri Apr 24 11:13:33 2015 +1000 qa: update hotproc tests after martins latest set of fixes Values for the hotproc config metric now have braces, so a couple of tests needed updating. Also tweaked the pmdaproc config generation code so that this > value "(uid == 0.000000)" is once again reported as > value "(uid == 0)" From kenj@internode.on.net Mon Apr 27 22:19:07 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 7A5ED7F6C for ; Mon, 27 Apr 2015 22:19:07 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 502B58F8035 for ; Mon, 27 Apr 2015 20:19:04 -0700 (PDT) X-ASG-Debug-ID: 1430191141-04bdf0632046dc30001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id DzlKiH89RUFUK3YG for ; Mon, 27 Apr 2015 20:19:01 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2CMBwA5+z5VPI8PLHlcgwxTXIMagy7BcIYGBAICgTNNAQEBAQEBBwEBAQFBP4QgAQEBAwEIAhkFLiMFBwEDAgYDFQEEAiMDAgIZIAoDEQIEEwsFiBMHsnmUEQEBAQcBAQEBHoEhiheFBQeCaIFFBY8zgiJjgx6IF5QCggiCISwxgkQBAQE Received: from ppp121-44-15-143.lns20.syd4.internode.on.net (HELO bozohorize) ([121.44.15.143]) by ipmail06.adl2.internode.on.net with ESMTP; 28 Apr 2015 12:49:00 +0930 From: "Ken McDonell" To: "'Nathan Scott'" Cc: "'pcp developers'" References: <026e01d07fa2$874e9cd0$95ebd670$@internode.on.net> <1699060067.7689027.1430179931519.JavaMail.zimbra@redhat.com> In-Reply-To: <1699060067.7689027.1430179931519.JavaMail.zimbra@redhat.com> Subject: RE: [pcp] Recent QA failures Date: Tue, 28 Apr 2015 13:18:57 +1000 X-ASG-Orig-Subj: RE: [pcp] Recent QA failures Message-ID: <006401d08162$113a35b0$33aea110$@internode.on.net> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQFQrypyEwzA5vM7WhRPWDWLAh5YWAGlGsM2nlQ6BDA= Content-Language: en-au X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1430191141 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.01 X-Barracuda-Spam-Status: No, SCORE=0.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18412 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header > -----Original Message----- > From: Nathan Scott [mailto:nathans@redhat.com] > Sent: Tuesday, 28 April 2015 10:12 AM > ... > 995 looks like either the "python-pcp" or "python3-pcp" package has = not been > updated? Its passing here for both python2 & 3 and I'd expect the = failure > you're seeing there if the pmapi.py was out-of-date. This one (like Martins' ones) seems to have mysteriously gone away. > 458 looks like either a pmdalogger issue or a race condition - nothing = I can think > of that has changed there recently, so odd that its started failing. This one is very strange. For the regular file case there are 2 records in the file, there are 2 = records Appended, Added and Removed via the libpcp_pmda Queue services = (as reported by -Dlibpmda for the PMDA). But pmevent in the qa test sees 3 (!) records, and the last one (after = the 2 expected records) is the empty string "" ... this smells more like = an EOF problem, rather than a race at start up. But, wait, there is more ... with diags enabled (-Dlibpmda) for the PMDA = the test passes ... disable the diags and it fails (I've repeated both = experiments several times). Not sure where to look now .... suggestions would be most welcome. From kenj@internode.on.net Tue Apr 28 00:26:16 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id E4AD47F58 for ; Tue, 28 Apr 2015 00:26:16 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id C625F8F8078 for ; Mon, 27 Apr 2015 22:26:13 -0700 (PDT) X-ASG-Debug-ID: 1430198770-04bdf06321470830001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id pIXjXv7A83QffgnD for ; Mon, 27 Apr 2015 22:26:10 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DHAQAaGT9VPKEh0XYNT4NfXIMaw1mBUod1EwEBAQEBAQEGAQEBAUGFCYEFBgIFIQIRAjInBgIBAYg0sVJwlDOBIYEsjg2CUoFFBYZCjxSHWop9ghyHJoQpXQGCQwEBAQ Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail05.adl6.internode.on.net with ESMTP; 28 Apr 2015 14:56:09 +0930 Message-ID: <553F1A04.70809@internode.on.net> Date: Tue, 28 Apr 2015 15:26:28 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - libpcp __pmDecodeProfile QA workout Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - libpcp __pmDecodeProfile QA workout Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1430198770 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18415 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp master Ken McDonell (3): libpcp/p_profile.c: add fault injection points qa/770: (new) use libpcp_fault to check __pmDecodeProfile mem leaks libpcp_fault/src/GNUmakefile: update to match libpcp makefile changes qa/770 | 53 ++++ qa/770.out | 51 ++++ qa/group | 1 qa/src/pducheck.c | 479 ++++++++++++++++++++++++--------------- src/libpcp/src/p_profile.c | 16 + src/libpcp_fault/src/GNUmakefile | 28 +- 6 files changed, 434 insertions(+), 194 deletions(-) Details ... commit 1d3c29e726e35bc2543e2b0721dcfca378f36703 Author: Ken McDonell Date: Tue Apr 28 10:59:07 2015 +1000 libpcp_fault/src/GNUmakefile: update to match libpcp makefile changes commit 3d8e6a61de2771d457734337338d4c3c558d6903 Author: Ken McDonell Date: Tue Apr 28 08:08:13 2015 +1000 qa/770: (new) use libpcp_fault to check __pmDecodeProfile mem leaks Shows http://oss.sgi.com/bugzilla/show_bug.cgi?id=871 is indeed fixed. Needed to rework the error handling in qa/src/pducheck.c so it does not generate valgrind errors in the presence of unexpected failures. commit cc3cec55a57094e152edb927aceae9357e4ce47a Author: Ken McDonell Date: Tue Apr 28 08:06:45 2015 +1000 libpcp/p_profile.c: add fault injection points Part of verification (with qa/770) that the issues raised in http://oss.sgi.com/bugzilla/show_bug.cgi?id=871 have been fixed. From nscott@redhat.com Tue Apr 28 02:50:24 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 578637F55 for ; Tue, 28 Apr 2015 02:50:24 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id E9362AC001 for ; Tue, 28 Apr 2015 00:50:20 -0700 (PDT) X-ASG-Debug-ID: 1430207415-04bdf06323473a90001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id ANvaS007ZnZRY5XA (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 00:50:16 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3S7o0Jc004352; Tue, 28 Apr 2015 03:50:00 -0400 Date: Tue, 28 Apr 2015 03:50:00 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Ken McDonell Cc: pcp developers Message-ID: <144565483.7808677.1430207400112.JavaMail.zimbra@redhat.com> In-Reply-To: <006401d08162$113a35b0$33aea110$@internode.on.net> References: <026e01d07fa2$874e9cd0$95ebd670$@internode.on.net> <1699060067.7689027.1430179931519.JavaMail.zimbra@redhat.com> <006401d08162$113a35b0$33aea110$@internode.on.net> Subject: Re: [pcp] Recent QA failures MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Recent QA failures Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.140] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: Recent QA failures Thread-Index: AQFQrypyEwzA5vM7WhRPWDWLAh5YWAGlGsM2nlQ6BDBHpCaPGw== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1430207415 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18417 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > [...] > This one is very strange. > > For the regular file case there are 2 records in the file, there are 2 > records Appended, Added and Removed via the libpcp_pmda Queue services (as > reported by -Dlibpmda for the PMDA). > > But pmevent in the qa test sees 3 (!) records, and the last one (after the 2 > expected records) is the empty string "" ... this smells more like an EOF > problem, rather than a race at start up. *nod* > But, wait, there is more ... with diags enabled (-Dlibpmda) for the PMDA the > test passes ... disable the diags and it fails (I've repeated both > experiments several times). > > Not sure where to look now .... suggestions would be most welcome. Nothing concrete other than its gotta be one of pmdalogger or libpcp_pmda (the -D observation above rules out libpcp and pmevent, I think). Guess that doesn't help hugely in narrowing it down though. :| cheers. -- Nathan From mgoodwin@redhat.com Tue Apr 28 03:25:52 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 783197F55 for ; Tue, 28 Apr 2015 03:25:52 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 6793A8F8073 for ; Tue, 28 Apr 2015 01:25:49 -0700 (PDT) X-ASG-Debug-ID: 1430209544-04cbb056b146e6c0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id OZsWhRJ6eaxyuCVb (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 01:25:45 -0700 (PDT) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (Postfix) with ESMTPS id E8EB42BB3A9 for ; Tue, 28 Apr 2015 08:25:43 +0000 (UTC) Received: from [10.64.51.53] (vpn1-51-53.bne.redhat.com [10.64.51.53]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3S8Pfgr028530 for ; Tue, 28 Apr 2015 04:25:42 -0400 Message-ID: <553F4404.9010207@redhat.com> Date: Tue, 28 Apr 2015 18:25:40 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp Subject: pcp updates: kenj merge Content-Type: text/plain; charset=windows-1252; format=flowed X-ASG-Orig-Subj: pcp updates: kenj merge Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430209544 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Merged Ken's recent changes - quite a haul! My only review comment would be that perhaps libpcp_fault could be shipped in the pcp-testsuite package (I had to jump through some hoops to check qa/770 was being run and passing - most qa environments would probably just _notrun it?). Changes committed to git://git.pcp.io/pcp.git master Ken McDonell (17): qa/787: oops ... remove debugging crutch qa/archives: add missing dynmetric archive pmdumplog: scratch an itch cmdline arg foo != foo.0 etc qa/995: renumber to 774 to avoid collision rpm pmda: check return status from pthread_create() qa/new: extend range of QA test numbers qa/1091: (new) test changes to avoid pmcpp where possible qa/464&509: remake .out after libpcp pmLoadNameSpace change libpcp: avoid pmcpp when loading PMNS if possible man pages: pmLookupNameSpace(3), pmLookupASCIINameSpace(3) and PMNS(5) pmnscomp: remove code ... no longer used qa: fallout from pmLoadNameSpace() changes libpcp/pmns.c: final version of the pmLoadNameSpace() changes assorted: knock-on changes from pmLoadNameSpace() changes libpcp/p_profile.c: add fault injection points qa/770: (new) use libpcp_fault to check __pmDecodeProfile mem leaks libpcp_fault/src/GNUmakefile: update to match libpcp makefile changes man/man3/pmloadasciinamespace.3 | 44 ++ man/man3/pmloadnamespace.3 | 21 + man/man5/pmns.5 | 12 qa/1091 | 73 ++++ qa/1091.out | 61 +++ qa/235.out | 2 qa/245.out | 4 qa/273.out | 1 qa/464.out | 4 qa/509.out | 4 qa/770 | 53 +++ qa/770.out | 51 +++ qa/774 | 51 +++ qa/774.out | 239 +++++++++++++++ qa/787 | 2 qa/995 | 102 +++--- qa/995.out | 478 +++++++++++++++--------------- qa/archives/dynmetric.0 |binary qa/archives/dynmetric.index |binary qa/archives/dynmetric.meta |binary qa/group | 5 qa/new | 2 qa/src/779246.c | 2 qa/src/archinst.c | 2 qa/src/chk_memleak.c | 2 qa/src/chk_metric_types.c | 2 qa/src/chkconnect.c | 4 qa/src/chkctx2.c | 2 qa/src/chknumval.c | 4 qa/src/chktrim.c | 2 qa/src/churnctx.c | 2 qa/src/context_test.c | 2 qa/src/defctx.c | 2 qa/src/eofarch.c | 2 qa/src/eol.c | 2 qa/src/exercise.c | 6 qa/src/exertz.c | 2 qa/src/fetchpdu.c | 2 qa/src/fetchrate.c | 2 qa/src/grind_ctx.c | 2 qa/src/hp-mib.c | 2 qa/src/indom.c | 2 qa/src/interp0.c | 2 qa/src/interp1.c | 2 qa/src/interp2.c | 2 qa/src/interp3.c | 2 qa/src/interp4.c | 2 qa/src/interp_bug.c | 2 qa/src/interp_bug2.c | 2 qa/src/ipc.c | 2 qa/src/logcontrol.c | 4 qa/src/lookupnametest.c | 2 qa/src/multifetch.c | 2 qa/src/multithread3.c | 12 qa/src/nullinst.c | 2 qa/src/pcp_lite_crash.c | 2 qa/src/pducheck.c | 479 ++++++++++++++++++------------ qa/src/permfetch.c | 2 qa/src/pmnsunload.c | 2 qa/src/pmsocks_objstyle.c | 2 qa/src/proc_test.c | 2 qa/src/store.c | 2 qa/src/storepast.c | 2 qa/src/storepdu.c | 2 qa/src/template.c | 2 qa/src/torture_api.c | 2 qa/src/torture_indom.c | 2 qa/src/torture_pmns.c | 2 qa/src/xarch.c | 2 qa/src/xlog.c | 2 src/dbpmda/src/dbpmda.c | 31 + src/libpcp/src/check-statics | 1 src/libpcp/src/p_profile.c | 16 - src/libpcp/src/pmns.c | 157 ++++++--- src/libpcp_fault/src/GNUmakefile | 28 - src/newhelp/chkhelp.c | 4 src/newhelp/newhelp.c | 4 src/pmdas/rpm/rpm.c | 10 src/pmdas/solaris/solaris.c | 9 src/pmdumplog/pmdumplog.c | 7 src/pmlogger/src/pmlogger.c | 2 src/pmns/pmnsdel.c | 4 src/pmns/pmnsmerge.c | 8 src/pmnscomp/.gitignore | 1 src/pmnscomp/GNUmakefile | 31 - src/pmnscomp/pmnscomp.c | 621 --------------------------------------- 86 files changed, 1436 insertions(+), 1300 deletions(-) Details ... commit 1d3c29e726e35bc2543e2b0721dcfca378f36703 Author: Ken McDonell Date: Tue Apr 28 10:59:07 2015 +1000 libpcp_fault/src/GNUmakefile: update to match libpcp makefile changes commit 3d8e6a61de2771d457734337338d4c3c558d6903 Author: Ken McDonell Date: Tue Apr 28 08:08:13 2015 +1000 qa/770: (new) use libpcp_fault to check __pmDecodeProfile mem leaks Shows http://oss.sgi.com/bugzilla/show_bug.cgi?id=871 is indeed fixed. Needed to rework the error handling in qa/src/pducheck.c so it does not generate valgrind errors in the presence of unexpected failures. commit cc3cec55a57094e152edb927aceae9357e4ce47a Author: Ken McDonell Date: Tue Apr 28 08:06:45 2015 +1000 libpcp/p_profile.c: add fault injection points Part of verification (with qa/770) that the issues raised in http://oss.sgi.com/bugzilla/show_bug.cgi?id=871 have been fixed. commit e3c0fc53d187cba6a41b95a8f20d8e425e129a60 Author: Ken McDonell Date: Sun Apr 26 17:09:30 2015 +1000 assorted: knock-on changes from pmLoadNameSpace() changes There are a few PCP apps that need to process PMNS files that may have embedded C-style comments, preprocessor directives or macros. Specifically: - pmnsdel and pmnsmerge (always needed) - newhelp and chkhelp (always needed) - dbpmda (rarely used) - pmlogger (rarely used) - solaris PMDA (go figure!) commit 3c772a074ae54685bb6e544184d5528e7d8ab9bd Author: Ken McDonell Date: Sun Apr 26 17:05:08 2015 +1000 libpcp/pmns.c: final version of the pmLoadNameSpace() changes Removed some bogus code from the preliminary version to expose the real logic which is: - pmLoadNameSpace() - never use pmcpp - pmLoadASCIINameSpace() - if filename is PM_NS_DEFAULT don't use pmcpp, otherwise use pmcpp This avoids pmcpp for most common uses where the default PMNS is, loaded, and this includes all PM_CONTEXT_LOCAL contexts. commit 21fae5e48b7a074e91a768148872f26ac4b0cd42 Author: Ken McDonell Date: Sun Apr 26 17:01:27 2015 +1000 qa: fallout from pmLoadNameSpace() changes Lots of source code changes here as many QA test applications load a customized PMNS as part of their testing. Basically need to replace pmLoadNameSpace(...) calls with pmLoadASCIINameSpace(..., 1) calls. Also a few .out changes as a consequence of not calling any of the PMNS load namespace routines when we don't need to. commit 486035548e27048997c08cfbf4846fc044860181 Author: Ken McDonell Date: Sun Apr 26 14:47:43 2015 +1000 pmnscomp: remove code ... no longer used commit 988557e23e12bb0ba6e371c58923672535d38e94 Author: Ken McDonell Date: Sun Apr 26 14:09:53 2015 +1000 man pages: pmLookupNameSpace(3), pmLookupASCIINameSpace(3) and PMNS(5) Updates to reflect new logic that avoids the use of pmcpp(1) in all cases except for pmLookupASCIINameSpace() when the filename argument is something other than PM_NS_DEFAULT (NULL). commit a8e97900414e26bd729c2677893976fea38ee9c0 Author: Ken McDonell Date: Sun Apr 26 08:01:29 2015 +1000 libpcp: avoid pmcpp when loading PMNS if possible When using pmLoadNameSpace() or pmLoadASCIINameSpace(PM_NS_DEFAULT) or PM_CONTEXT_LOCAL we don't need pmcpp ... the PMMS contains no cpp-style #if or #include directives and no cpp macros. In these cases we use fopen() instead of the fork/exec/pipe arrangment to pre-process the PMNS file with pmcpp. The preprocessor is still used with pmLoadASCIINameSpace() and any PMNS other than PM_NS_DEFAULT, so all of the PMNS updates via the PMDA Install and Remove scripts still work. commit 00d29e91b2c7ffe56134d546118919893e5f00a7 Author: Ken McDonell Date: Sun Apr 26 07:59:30 2015 +1000 qa/464&509: remake .out after libpcp pmLoadNameSpace change commit 52a6807e045ad5d8c923392cae3bfecb9572b4c4 Author: Ken McDonell Date: Sun Apr 26 07:58:22 2015 +1000 qa/1091: (new) test changes to avoid pmcpp where possible libpcp changes for pmLoadNameSpace (et al) coming. commit bcf854ff9e7c46f940cec5fa8371ec4e1a0fd146 Author: Ken McDonell Date: Sun Apr 26 07:57:05 2015 +1000 qa/new: extend range of QA test numbers We're starting to get collisions, so up the max from 999 to 1099. commit f2cee38477f3f77be9d5e9e9b3da6540a62a67cc Author: Ken McDonell Date: Sat Apr 25 07:35:45 2015 +1000 rpm pmda: check return status from pthread_create() Closes https://github.com/performancecopilot/pcp/issues/10 commit c427aafdd5ab1439ae622fb002f03087edd94da0 Author: Ken McDonell Date: Sat Apr 25 07:14:05 2015 +1000 qa/995: renumber to 774 to avoid collision commit 6603f7663091253b70acc719cb7a21f6ebaf2cec Author: Ken McDonell Date: Fri Apr 24 20:14:21 2015 +1000 pmdumplog: scratch an itch cmdline arg foo != foo.0 etc Fix botch in filename handling ... -t produced bogus Warning: file missing or compressed for log volume 0 when command line arg was an archive filename (.0, .index, .meta, etc) rather than a basename for the archive. qa/995 proves the point. commit 693402b4f0715ed81e35f312f829bd8adfbed765 Author: Ken McDonell Date: Fri Apr 24 20:12:15 2015 +1000 qa/archives: add missing dynmetric archive commit a735f6ee7b41f49984b06572eaf082819f2f056b Author: Ken McDonell Date: Fri Apr 24 19:59:21 2015 +1000 qa/787: oops ... remove debugging crutch From mgoodwin@redhat.com Tue Apr 28 03:58:23 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 652527F55 for ; Tue, 28 Apr 2015 03:58:23 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id F22F9AC001 for ; Tue, 28 Apr 2015 01:58:22 -0700 (PDT) X-ASG-Debug-ID: 1430211499-04cbb056b146f940001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id aXpcK6zbYjPrFX1o (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 01:58:20 -0700 (PDT) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (Postfix) with ESMTPS id 2EE448E7B2 for ; Tue, 28 Apr 2015 08:58:19 +0000 (UTC) Received: from [10.64.51.53] (vpn1-51-53.bne.redhat.com [10.64.51.53]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3S8wHEX032413; Tue, 28 Apr 2015 04:58:18 -0400 Message-ID: <553F4BA8.5000001@redhat.com> Date: Tue, 28 Apr 2015 18:58:16 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: "Frank Ch. Eigler" CC: pcp Subject: Re: [pcp] pcp updates: pmmgr, pmwebd References: <20150421224405.GN6822@redhat.com> <5536E65F.50600@redhat.com> <20150422000949.GP6822@redhat.com> X-ASG-Orig-Subj: Re: [pcp] pcp updates: pmmgr, pmwebd In-Reply-To: <20150422000949.GP6822@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430211499 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 04/22/2015 10:09 AM, Frank Ch. Eigler wrote: > Hi, Mark - > >> Hey Frank can you post the full git url for your work below. >> I'll pull it into a branch for review. > > pcpfans.git is git://sourceware.org/git/pcpfans.git > The two subject branches are fche/pmmgr and fche/pmwebd. > Thanks a lot. > > - FChE > Howdy Frank, will I just pull in all your changes? Or cherry-pick only the pmwebd changes? Your tree of unmerged stuff seems to go back to the commit listed below I think. The pmmgr changes are marked as 'blocked' on https://trello.com/b/5t9Ml341/release-task-tracking. Cheers -- Mark commit 6b2eb46b3eba9dacba86009bfc4ccebd198e7b79 Author: Frank Ch. Eigler Date: Sat Feb 28 09:35:09 2015 -0500 pmwebd: add a "-i MIN-INTERVAL" option for graphite time-precision control When pmlogger data is sampled more frequently than /60s, it is desirable to let graphite render data at a higher time resolution. Oversampling leads to wiggles due to interpolation FP artifacts, so is undesirable. The pmwebd invoker is best placed to judge the right tradeoff, so is given an option to set the minimum time-step size. From myllynen@redhat.com Tue Apr 28 04:31:30 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 020327F55 for ; Tue, 28 Apr 2015 04:31:30 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id E358E304032 for ; Tue, 28 Apr 2015 02:31:26 -0700 (PDT) X-ASG-Debug-ID: 1430213484-04cbb056b4470a80001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id G0SWOlCn62lmsm5w (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 02:31:25 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3S9VNcD032238 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 28 Apr 2015 05:31:24 -0400 Received: from mmyllyne.csb (vpn1-6-48.ams2.redhat.com [10.36.6.48]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3S9VMrr012854 for ; Tue, 28 Apr 2015 05:31:23 -0400 Message-ID: <553F5369.1030300@redhat.com> Date: Tue, 28 Apr 2015 12:31:21 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: pcp developers Subject: Add PCP Hotproc Mechanism to Quick Guide Content-Type: multipart/mixed; boundary="------------030702030902060402090804" X-ASG-Orig-Subj: Add PCP Hotproc Mechanism to Quick Guide X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430213485 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 This is a multi-part message in MIME format. --------------030702030902060402090804 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Hi, after the latest fixes from Martins it looks like hotproc is ready for general consumption, please find attached a patch to add a section about hotproc to the Quick Guide. I added some HTML elements here and there while at it. I had to point to pcp.io for pmdahotproc(1) instead of man7.org since it wasn't available there. And as usual, any enhancements or grammar fixes from native speakers are warmly welcome. I'll leave it up to you should we apply the patch today already or after the next release with the recent fixes is out. Thanks, -- Marko Myllynen --------------030702030902060402090804 Content-Type: text/x-patch; name="0001-Describe-Hotproc-in-the-Quick-Guide.patch" Content-Transfer-Encoding: 8bit Content-Disposition: attachment; filename="0001-Describe-Hotproc-in-the-Quick-Guide.patch" >From a28923ac5d45810a4f7f915e5b4f6125414f1567 Mon Sep 17 00:00:00 2001 From: Marko Myllynen Date: Tue, 28 Apr 2015 12:24:00 +0300 Subject: [PATCH] Describe Hotproc in the Quick Guide --- man/html/guide.html | 50 +++++++++++++++++++++++++++++++++----------------- 1 files changed, 33 insertions(+), 17 deletions(-) diff --git a/man/html/guide.html b/man/html/guide.html index a143655..2512069 100644 --- a/man/html/guide.html +++ b/man/html/guide.html @@ -33,6 +33,7 @@
  • Process Level Performance Monitoring
  • Performance Metrics Inference @@ -103,7 +104,7 @@ -

    To enable centralized archive log collection on the monitoring host, its pmlogger is configured to fetch performance metrics from collector hosts. Add each collector host to the pmlogger configuration file /etc/pcp/pmlogger/control and then restart the pmlogger service on the monitoring host. +

    To enable centralized archive log collection on the monitoring host, its pmlogger is configured to fetch performance metrics from collector hosts. Add each collector host to the pmlogger configuration file /etc/pcp/pmlogger/control and then restart the pmlogger service on the monitoring host.

       Enable recording of metrics from remote host acme.com:
    @@ -113,7 +114,7 @@
    -

    Checks for remote log collection will be done every half an hour. You may also wish to run /usr/libexec/pcp/bin/pmlogger_check -V -C (on Fedora/RHEL) or /usr/lib/pcp/bin/pmlogger_check -V -C (on Debian/Ubuntu) manually (service restart above issues this command internally). +

    Checks for remote log collection will be done every half an hour. You may also wish to run /usr/libexec/pcp/bin/pmlogger_check -V -C (on Fedora/RHEL) or /usr/lib/pcp/bin/pmlogger_check -V -C (on Debian/Ubuntu) manually (service restart above issues this command internally).

    Note that a default configuration file (config.acme.com above) will be generated if it does not exist already. This process is optional (a custom configuration for each host can be provided instead), see the pmlogconf(1) manual page for details on this. @@ -200,7 +201,7 @@ Display detailed information about a performance metric and its current values:<

        -Monitor live disk write operations per partition with two second interval using fixed point notation (use -i instance to list only certain metrics and -r for raw values):
    +Monitor live disk write operations per partition with two second interval using fixed point notation (use -i instance to list only certain metrics and -r for raw values):

    $ pmval -t 2sec -f 3 disk.partitions.write -h acme.com
    @@ -235,7 +236,7 @@ Monitor system metrics in an iostat like fashion with two second interval:

        -Monitor performance metrics with a GUI application with two second default interval from two different hosts. Use File->New Chart to select metrics to be included in a new view and use File->Open View to use a predefined view:
    +Monitor performance metrics with a GUI application with two second default interval from two different hosts. Use File->New Chart to select metrics to be included in a new view and use File->Open View to use a predefined view:

    $ pmchart -t 2sec -h acme1.com -h acme2.com     @@ -243,7 +244,7 @@ Monitor performance metrics with a GUI application with two second default inter

    Retrospective Performance Analysis

    -

    PCP archive logs are located under /var/log/pcp/pmlogger/hostname, and the archive names indicate the date they cover. Archives are self-contained, and machine-independent so can be transfered to any machine for offline analysis. +

    PCP archive logs are located under /var/log/pcp/pmlogger/hostname, and the archive names indicate the date they cover. Archives are self-contained, and machine-independent so can be transfered to any machine for offline analysis.

        @@ -275,14 +276,14 @@ Display detailed information about a performance metric at the time when an arch

        -Dump past disk write operations per partition in an archive using fixed point notation (use -i instance to list only certain metrics and -r for raw values):
    +Dump past disk write operations per partition in an archive using fixed point notation (use -i instance to list only certain metrics and -r for raw values):

    $ pmval -f 3 disk.partitions.write -a acme.com/20140902

        -Replay past disk write operations per partition in an archive with two second interval using fixed point notation between 9 AM and 10 AM (use full dates with syntax like @"2014-08-20 14:00:00"):
    +Replay past disk write operations per partition in an archive with two second interval using fixed point notation between 9 AM and 10 AM (use full dates with syntax like @"2014-08-20 14:00:00"):

    $ pmval -d -t 2sec -f 3 disk.partitions.write -S @09:00 -T @10:00 -a acme.com/20140902
    @@ -303,7 +304,7 @@ Dump past CPU load, memory usage, and disk write operations per partition in an

        -Summarize differences in past performance metrics between two archives, comparing 2 AM / 3 AM in the first archive to 9 AM / 10 AM in the second archive (grep for '+' to quickly see values which were zero during the first period):
    +Summarize differences in past performance metrics between two archives, comparing 2 AM / 3 AM in the first archive to 9 AM / 10 AM in the second archive (grep for '+' to quickly see values which were zero during the first period):

    $ pmdiff -S @02:00 -T @03:00 -B @09:00 -E @10:00 acme.com/20140902 acme.com/20140901
    @@ -338,7 +339,7 @@ Dump past system metrics in a

        -Replay performance metrics with a GUI application with two second default interval in an archive between 9 AM and 10 AM. Use File->New Chart to select metrics to be included in a new view and use File->Open View to use a predefined view:
    +Replay performance metrics with a GUI application with two second default interval in an archive between 9 AM and 10 AM. Use File->New Chart to select metrics to be included in a new view and use File->Open View to use a predefined view:

    $ pmchart -t 2sec -S @09:00 -T @10:00 -a acme.com/20140902
    @@ -353,7 +354,7 @@ Merge several archives as a new combined archive (see the manual page how to wri

    Visualizing iostat and sar Data

    -

    iostat and sar data can be imported as PCP archives which then allows inspecting and visualizing the data with PCP tools. The iostat2pcp(1) importer is in the pcp-import-iostat2pcp package and the sar2pcp(1) importer is in the pcp-import-sar2pcp package. +

    iostat and sar data can be imported as PCP archives which then allows inspecting and visualizing the data with PCP tools. The iostat2pcp(1) importer is in the pcp-import-iostat2pcp package and the sar2pcp(1) importer is in the pcp-import-sar2pcp package.

        @@ -366,7 +367,7 @@ Import iostat data to a new PCP archive and visualize it:
    @@ -375,7 +376,7 @@ Import sar data from an existing sar archive to a new PCP archive and visualize

    Process Level Performance Monitoring

    -

    PCP provides details of each running process via the standard PCP interfaces and tools on the localhost but due to security and performance considerations, most of the process related information is not stored in archive logs by default. +

    PCP provides details of each running process via the standard PCP interfaces and tools on the localhost but due to security and performance considerations, most of the process related information is not stored in archive logs by default. Also for security reasons, only root can access some details of running processes of other users.

    Custom application instrumentation is possible with the Memory Mapped Value (MMV) PMDA. @@ -397,7 +398,7 @@ Monitor the number of open file descriptors of the process 1234:


        -Import sar data from an existing sar archive to a new PCP archive and visualize it (sar logs are under /var/log/sysstat on Debian/Ubuntu):
    +Import sar data from an existing sar archive to a new PCP archive and visualize it (sar logs are under /var/log/sysstat on Debian/Ubuntu):

    $ sar2pcp /var/log/sa/sa15 sar.pcp
    $ pmchart -t 2sec -a sar.pcp

        -Monitor the CPU time, memory usage (RSS), and the number of threads of the process 1234 (-h local: is a workaround needed for the time being):
    +Monitor the CPU time, memory usage (RSS), and the number of threads of the process 1234 (-h local: is a workaround needed for the time being):

    $ pmdumptext -h local: -t 2sec 'proc.psinfo.utime[1234]' 'proc.memory.rss[1234]' 'proc.psinfo.threads[1234]'
    @@ -416,6 +417,21 @@ Display the number of running processes on 2014-08-20 14:00:
    + +

    Monitoring “Hot†Processes with Hotproc

    + +

    It is also possible to monitor “hot†or “interesting†processes by name, for example all processes of which command name is java or python. This monitoring of “hot†processes can also be enabled or disabled based on certain criterias or from the command line on the fly. The metrics will be available under the namespace hotproc. +

    Configuring processes to be monitored contantly using the hotproc namespace can be done using the configuration file /var/lib/pcp/pmdas/proc/hotproc.conf - see the pmdahotproc(1) manual page for details. This allows monitoring these processes regardless of their PIDs and also logging the metrics easily. + + + +

        +Enable monitoring of all Java instances on the fly and display all the collected metrics:
    +
    # pmstore hotproc.control.config 'fname == "java"' +
    # pminfo -f hotproc +
    + +

    Application Instrumentation

    @@ -443,7 +459,7 @@ Display the number of running processes on 2014-08-20 14:00:
    -

    To enable the monitoring host to run PMIE for collector hosts, add each host to the /etc/pcp/pmie/control configuration file. +

    To enable the monitoring host to run PMIE for collector hosts, add each host to the /etc/pcp/pmie/control configuration file.

       Enable monitoring of metrics from remote host acme.com: @@ -506,12 +522,12 @@ This example shows a PMIE script, checks its syntax, runs it against an archive,

    PCP PMDAs offer a way for administrators and developers to customize and extend the default PCP installation. The pcp-libs-devel package contains all the needed development related examples, headers, and libraries. New PMDAs can easily be added, below is a quick list of references for starting development:

      -
    • Some examples exist below /var/lib/pcp/pmdas/ - the simple, sample, and txmon PMDAs are easy to read PMDAs. +
    • Some examples exist below /var/lib/pcp/pmdas/ - the simple, sample, and txmon PMDAs are easy to read PMDAs.
      • The simple PMDA provides implementations in C, Perl and Python.
      • -
    • A simple command line monitor tool is /usr/share/pcp/demos/pmclient (C language).
      • -
    • Good initial Python monitor examples are /usr/libexec/pcp/bin/pcp/pcp-* (Fedora/RHEL) or /usr/lib/pcp/bin/pcp-* (Debian/Ubuntu). +
    • A simple command line monitor tool is /usr/share/pcp/demos/pmclient (C language).
      • +
    • Good initial Python monitor examples are /usr/libexec/pcp/bin/pcp/pcp-* (Fedora/RHEL) or /usr/lib/pcp/bin/pcp-* (Debian/Ubuntu).
      • Slightly more complex examples are the pmiostat, pmatop, pmcollectl commands.
      • -- 1.7.1 --------------030702030902060402090804-- From fche@redhat.com Tue Apr 28 06:06:35 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 155CE7F50 for ; Tue, 28 Apr 2015 06:06:35 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id A678DAC004 for ; Tue, 28 Apr 2015 04:06:31 -0700 (PDT) X-ASG-Debug-ID: 1430219186-04cb6c1cca425ed0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id Yp0tYZjwLTXGPtOa (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 04:06:27 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3SB6Qdi014382 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 28 Apr 2015 07:06:26 -0400 Received: from fche.csb (vpn-224-222.phx2.redhat.com [10.3.224.222]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3SB6QxB017250; Tue, 28 Apr 2015 07:06:26 -0400 Received: by fche.csb (Postfix, from userid 2569) id 1274A584E3; Tue, 28 Apr 2015 07:06:24 -0400 (EDT) Date: Tue, 28 Apr 2015 07:06:24 -0400 From: "Frank Ch. Eigler" To: Mark Goodwin Cc: pcp Subject: Re: [pcp] pcp updates: pmmgr, pmwebd Message-ID: <20150428110624.GB1295@redhat.com> X-ASG-Orig-Subj: Re: [pcp] pcp updates: pmmgr, pmwebd References: <20150421224405.GN6822@redhat.com> <5536E65F.50600@redhat.com> <20150422000949.GP6822@redhat.com> <553F4BA8.5000001@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <553F4BA8.5000001@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430219187 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - > Howdy Frank, will I just pull in all your changes? Or cherry-pick > only the pmwebd changes? Your tree of unmerged stuff seems to go > back to the commit listed below I think. I'd love for both braches to be reviewed & merged. > The pmmgr changes are marked as 'blocked' on > https://trello.com/b/5t9Ml341/release-task-tracking. That one is private (why?). Also, I thought y'all had switched to a Libreboard setup. Anyway, the pmmgr changes shouldn't be so marked. That code works, includes docs & qa. It is not on by default, so is harmless despite the infrastructure bugs. Yet it is possible to use the code, for example to simply track container lifetimes, if there exists even one pcp metric (pmcd.hostname?) that is reliably fetchable from within a &container=FOO connection. And surely there exists at least one such metric. - FChE From dsmith@redhat.com Tue Apr 28 09:30:07 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 1C5657F47 for ; Tue, 28 Apr 2015 09:30:07 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id EBD868F8065 for ; Tue, 28 Apr 2015 07:30:03 -0700 (PDT) X-ASG-Debug-ID: 1430231402-04cb6c1cc742bd40001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id g569DvBvK48oBzQq (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 07:30:02 -0700 (PDT) X-Barracuda-Envelope-From: dsmith@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3SEU16u032503 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 28 Apr 2015 10:30:02 -0400 Received: from t540p.usersys.redhat.com (dhcp-10-15-1-2.hsv.redhat.com [10.15.1.2]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3SEU1dL021657 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 28 Apr 2015 10:30:01 -0400 Message-ID: <553F9968.4070509@redhat.com> Date: Tue, 28 Apr 2015 09:30:00 -0500 From: David Smith User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp Subject: Re: [pcp] JSON PMDA References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <1237712965.18667183.1429054767135.JavaMail.zimbra@redhat.com> <5536C228.8010001@redhat.com> <1344441557.4430503.1429658863072.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] JSON PMDA In-Reply-To: <1344441557.4430503.1429658863072.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430231402 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 On 04/21/2015 06:27 PM, Nathan Scott wrote: > Hi David, > > ----- Original Message ----- >>> ----- Original Message ----- >>>>> [...] >>>>> Yeah - something like that - have a look at src/libpcp_pmda/src/cache.c >>>>> as >>>>> thats how the instance cache number stability is achieved. Perhaps we >>>>> can >>>>> extend that with additional APIs to help us out here. >>>>> >>>> >>> Its OK to extend the API/ABI, but not to break it. Which should be all we >>> need to do here, I think. Maybe see if we can reduce the range that those >>> cache.c interfaces accept - the two lines with "if (inst == 0x7fffffff) {" >>> there look promising. If we had a h->maxinst there perhaps, instead of the >>> hard-coded 2^32-1 limit (may need to change the test to '>=' too) we might >>> be done and dusted here. That'll turn out to be a gross oversimplification >>> I'm sure ... but maybe, just maybe it will work. >> >> OK, I've been staring at cache.c today, and I've figured out a couple of >> things. >> >> - Most of the existing code is for an instance cache, there doesn't >> appear to be any existing code for a cluster/metric cache. > > A more abstract way to think about it would be 'its a cache for signed 32 > bit identifiers allocated in a monotonically increasing way, allowing for > holes and with support for optional persistence' ... which we use only for > instances today. > >> - I'm failing to see how changing that 0x07ffffff as you outlined above >> helps. Can you explain that a bit more? > > So, if we can generalise the above a little, we may be able to make it a > 'cache for identifiers in a range from 0 to some specified maximum, with > identifiers allocated in a monotonically increasing way, allowing holes > and optional persistence'. > > The pmInDom is a domain number (JSON 137) and a "serial" number. So in > our situation here, we could reserve serial #0 for a metric-identifier > cache, #1 for an indom-identifier cache, and then use the rest of the > space for indom-instance caches. Wouldn't it make more sense to reserve serial #0 for the indom-instance cache, since that is what serial #0 is current used for (in effect)? How much is the current indom-instance cache used today? >> If you'd like me to add a cluster/metric cache, I'm going to need a bit >> more explanation about what that will entail. > > I don't think that is necessary. I think we may even get away with just > the one metric identifier cache? (combine cluster and index - using the > full metric name as the cache key. Maybe? Not sure, but that would help > with the 1024-metrics-per-source-only problem). > >> From a PMDA writer's point of view, I'd think the new APIs would look >> something like (in pseudo code): >> >> - lookup_cluster(domain_id, name) >> - find_next_available_cluster(domain_id) >> - lookup_metric(domain_id, cluster_id, name) >> - find_next_available_metric(domain_id, cluster_id) > > As per the earlier mail with kenj (re ioctl), I think the only new API we > will need for this aspect would be something like: > > int pmdaCacheResize(pmInDom indom, int maximum); > > the rest of the pmdaCacheOp(3) interfaces should give us the rest of the > cache manipulation functionality you need (like persisting, restoring, & > so on). I wonder if it wouldn't make sense to define something like the following instead: int pmdaCacheOp2(pmInDom indom, int op, unsigned long val); with an associated op of PMDA_CACHE2_RESIZE. That would give more room for the addition of future operations. -- David Smith dsmith@redhat.com Red Hat http://www.redhat.com 256.217.0141 (direct) 256.837.0057 (fax) From bounces+749839-2c40-pcp=oss.sgi.com@email.pd25.com Tue Apr 28 10:44:20 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,T_DKIM_INVALID autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 3A47A7F37 for ; Tue, 28 Apr 2015 10:44:20 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 294138F807A for ; Tue, 28 Apr 2015 08:44:17 -0700 (PDT) X-ASG-Debug-ID: 1430235853-04cbb056b347c540001-S8gJnT Received: from o443.email.pd25.com ([198.21.0.182]) by cuda.sgi.com with ESMTP id 27blJeoBMW0wkoaP (version=TLSv1 cipher=AES128-SHA bits=128 verify=NO) for ; Tue, 28 Apr 2015 08:44:14 -0700 (PDT) X-Barracuda-Envelope-From: bounces+749839-2c40-pcp=oss.sgi.com@email.pd25.com X-Barracuda-Apparent-Source-IP: 198.21.0.182 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=fieldnation.com; h=subject:from:to:mime-version:content-type; s=smtpapi; bh=JcN9aht34kKW5MV9uLCWzd4NXlo=; b=VOGy9gCIgHOu1NoUpVnKCUnSziFGH qgpq9O0iyrkjEzFhQOTRDRDDDY3RA8UGqo0oBR1UEIBaIeVlhUmjKPz8+QyX8bo0 RDm432GtzJncY0hDxrF90Ko8iWG10imBFNaYBO9uyyeabdE9jzFgW/GEnB+VLgPO +J1n6XybSyaQrE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=fieldnation.com; h=subject:from:to:mime-version:content-type; q=dns; s=smtpapi; b =ZwTg1mMElNNAWE1tBRDOL154x6A/Nl3pfbDTCy0Fc0qdrdb5Z85hG3tFWW/9oZ2 Qs2dSag6yaZyGVr8kaAvEq28PrzgiZbIycE3xGy7WicMfRz/XB4dApVrfgJXWQyp DoYnWHUuod674PtAPIoWbql0WFXGo65wkqGCOoZpZmDI= Received: by filter-304.sjc1.sendgrid.net with SMTP id filter-304.4250.553FAACB19 2015-04-28 15:44:12.00823756 +0000 UTC Received: from [127.0.0.1] (localhost [50.97.131.83]) by ismtpd-057 (SG) with ESMTP id 14d00b32c5b.155c.7af5a for ; Tue, 28 Apr 2015 15:44:11 +0000 (UTC) Message-ID: Date: Tue, 28 Apr 2015 11:44:11 -0400 Subject: Field Tech Dilemmas and Contingent Workforce Trends - Field Nation From: Tim Harper X-ASG-Orig-Subj: Field Tech Dilemmas and Contingent Workforce Trends - Field Nation To: pcp@oss.sgi.com MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="_=_swift_v4_1430235851_74edb9bde46caaf71d16472657ff5288_=_" X-SG-EID: kOfOAcXv1ynhnyjRjI6h+hr7TTJ4x1z/U2AZZR9fslLmxLFpLXM4E7Mr7PgnnjahPZiY3BZLNOUZpd CvlmC7CmdrueZ5O3CnFbLmGAO0y8IKnVxy5JgJcyNVJLjB5X1Mng133hWT5syFFJEKKkUXZn6C6GP1 4YGH4RaGGGzhYEM= X-SG-ID: s78jXjc54Sh5tx9yFLGsWSVgP7deeyi89jjwqux6R/WVaA7giMWLyPmuomjVXdBvPUGrQhfgOZZ3CU zjOcH1lbeu55hIg7E82slbxe+W6M4oEpcwhlFGEjb53fvURPVI X-Barracuda-Connect: UNKNOWN[198.21.0.182] X-Barracuda-Start-Time: 1430235853 X-Barracuda-Encrypted: AES128-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.60 X-Barracuda-Spam-Status: No, SCORE=0.60 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC5_MJ1963, DKIM_SIGNED, DKIM_VERIFIED, HTML_MESSAGE, RDNS_NONE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18427 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 HTML_MESSAGE BODY: HTML included in message 0.10 RDNS_NONE Delivered to trusted network by a host with no rDNS 0.50 BSF_SC5_MJ1963 Custom Rule MJ1963 --_=_swift_v4_1430235851_74edb9bde46caaf71d16472657ff5288_=_ Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hello Dimitri, Does your success depend on trusted field service technicians? The latest workforce trends report discloses how organizations are overcoming the dilemma of finding engaged experts who are committed to the success of the companies they service. Download "The New Face of the American Workforce" research report to see how organizations are taking advantage of these trends. Download now: http://info.fieldnation.com/e/24592/l-24592-2015-03-30-n2rf1/y7xdx/633608459 Or contact us to discover how Field Nation can help you tap into our marketplace of 50,000 technical contractors at no cost to you. Contact us: www.fieldnation.com/contact?utm_source=3DDhaka&utm_medium=3DWeb-FN&utm_cont= ent=3DLead%20Gen%20BSQ%20%26%20FTP%204.1.15%09&utm_campaign=3DDream%20Email= %20Test%204-2-15 Thanks, Tim Harper VP, Business Development Main: 952.223.1157 http://info.fieldnation.com/e/24592/company-field-nation/y7xdz/633608459 http://info.fieldnation.com/e/24592/fieldnation/y7xf2/633608459 http://info.fieldnation.com/e/24592/fieldnation/y7xf4/633608459 http://info.fieldnation.com/e/24592/annel-UC9l-NXYA7Fww8xi3nk6ZVYA/y7xf6/63= 3608459 http://info.fieldnation.com/e/24592/category-blog/y7xf8/633608459 =C2=A9 2014 Field Nation, LLC. All Rights Reserved. 901 S. Marquette Avenue 2300 ATT Tower Minneapolis, MN 55402 http://info.fieldnation.com/unsubscribe/u/24592/58bcd11c96a5c3f0950d946adaa= 2c784/633608459 | http://info.fieldnation.com/webmail/24592/633608459/58bcd11c96a5c3f0950d946= adaa2c784 --_=_swift_v4_1430235851_74edb9bde46caaf71d16472657ff5288_=_ Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable Field Tech Dilemmas and Contingent Workforce Trends - Field Nation <= /title> </head> <body leftmargin=3D"0" marginwidth=3D"0" topmargin=3D"0" marginheight=3D"0"= offset=3D"0" style=3D"-webkit-text-size-adjust: none;margin: 0;padding: 0;= background-color: #FAFAFA;width: 100%;"> <style type=3D"text/css"> #outlook a { padding: 0; } .body{ width: 100% !important; -webkit-text-size-adjust: 100%; -ms-text-size-adjust: 100%; margin: 0; padding: 0; } .ExternalClass { width:100%; } .ExternalClass, .ExternalClass p, .ExternalClass span, .ExternalClass font, .ExternalClass td, .ExternalClass div { line-height: 100%; } img { outline: none; text-decoration: none; -ms-interpolation-mode: bicubic; } a img { border: none; } p { margin: 1em 0; } table td { border-collapse: collapse; } /* hide unsubscribe from forwards*/ blockquote .original-only, .WordSection1 .original-only { display: none !important; } </style> <center> <table id=3D"backgroundTable" style=3D"margin: 0;padding: 0;background-co= lor: #FAFAFA;height: 100%;width: 100%;" height=3D"100%" width=3D"100%" bord= er=3D"0" cellpadding=3D"0" cellspacing=3D"0"> <tbody> <tr> <td style=3D"border-collapse: collapse;" valign=3D"top" align=3D"ce= nter"><table id=3D"templateContainer" style=3D"border: 0px solid #DDDDDD; b= ackground-color: #FFFFFF;" width=3D"600" border=3D"0" cellpadding=3D"0" cel= lspacing=3D"0"> <tbody> <tr> <td style=3D"border-collapse: collapse;" valign=3D"top" ali= gn=3D"center"><!-- // Begin Template Header \ --> <table id=3D"templateHeader" style=3D"background-color: #= FFFFFF;border-bottom: 0;" width=3D"600" border=3D"0" cellpadding=3D"0" cell= spacing=3D"0"> <tbody> <tr> <td pardot-data=3D"" class=3D"headerContent" style= =3D"border-collapse: collapse; color: rgb(32, 32, 32); font-family: Arial; = font-size: 34px; font-weight: bold; line-height: 34px; padding: 25px 0px 0p= x; text-align: center; vertical-align: middle; background: none repeat scro= ll 0% 0% rgb(250, 250, 250);" pardot-region=3D"header_image"><!-- // Begin = Module: Standard Header Image \ --> <img alt=3D"" id=3D"headerImage campaign-icon" sr= c=3D"http://info.fieldnation.com/l/24592/2014-11-13/g3445/24592/60034/Field= Nation_Template_Logo_250.png" style=3D"width: 250px; height: 82px; outline:= medium none; text-decoration: none; border-width: 0px; border-style: solid= ;" height=3D"82" width=3D"250" border=3D"0"></td> </tr> </tbody> </table> <!-- // End Template Header \ --></td> </tr> </tbody> </table> <!-- // End Template Preheader \ --> <table id=3D"templateContainer" style=3D"border: 1px solid #DDDDD= D;background-color: #FFFFFF;" width=3D"600" border=3D"0" cellpadding=3D"0" = cellspacing=3D"0"> <tbody> <tr> <td style=3D"border-collapse: collapse;" valign=3D"top" ali= gn=3D"center"><!-- // Begin Template Body \ --> <table id=3D"templateBody" width=3D"600" border=3D"0" cel= lpadding=3D"50" cellspacing=3D"0"> <tbody> <tr> <td colspan=3D"3" class=3D"bodyContent" style=3D"bo= rder-collapse: collapse;background-color: #FFFFFF;" valign=3D"top"><!-- // = Begin Module: Standard Content \ --> <table width=3D"100%" border=3D"0" cellpadding=3D= "20" cellspacing=3D"0"> <tbody> <tr> <td style=3D"border-collapse: collapse;" va= lign=3D"top"><div pardot-data=3D"link-underline:underline;" class=3D"" pard= ot-region=3D"std_content00" style=3D"color: rgb(51, 51, 51); font-family: A= rial,Helvetica,sans-serif; font-size: 14px; line-height: 21px; text-align: = left;"><p class=3D"h1" style=3D"color: rgb(32, 32, 32); display: block; fon= t-family: Arial; font-weight: bold; line-height: 34px; margin: 0px 0px 10px= ;"><span style=3D"font-family: 'lucida sans unicode', 'lucida grande', sans= -serif; color: rgb(51, 51, 51); line-height: 21px;">Hello Dimitri,</span></= p> <div>Does your success depend on trusted field service technicians? The lat= est workforce trends report discloses how organizations are overcoming the = dilemma of finding engaged experts who are committed to the success of the = companies they service.<br> <br> <a href=3D"http://info.fieldnation.com/e/24592/l-24592-2015-03-30-n2rf1/y7x= dx/633608459"><span style=3D"color:#0000FF;">Download</span></a> <em>"= The New Face of the American Workforce" </em>research report to see ho= w organizations are taking advantage of these trends.<br>  </div> <div style=3D"text-align: center;"><a href=3D"http://info.fieldnation.com/e= /24592/l-24592-2015-03-30-n2rf1/y7xdx/633608459"><img alt=3D"" border=3D"0"= height=3D"37" src=3D"http://info.fieldnation.com/l/24592/2015-03-31/n3q5w/= 24592/74640/download_trends_button.png" style=3D"width: 133px; height: 37px= ; border-width: 0px; border-style: solid;" width=3D"133"></a></div> <div><br> Or <a href=3D"http://info.fieldnation.com/e/24592/ign-Dream20Email20Test204= -2-15/y7xfd/633608459"><span style=3D"color:#0000FF;">contact us</span></a>= to discover how Field Nation can help you tap into our marketplace of 50,0= 00 technical contractors at no cost to you.<br>  </div> <div style=3D"text-align: center;"><a href=3D"http://info.fieldnation.com/e= /24592/ign-Dream20Email20Test204-2-15/y7xfd/633608459"><img alt=3D"" border= =3D"0" height=3D"35" src=3D"http://info.fieldnation.com/l/24592/2015-03-31/= n3q5y/24592/74642/Contact_Us_Button.png" style=3D"width: 88px; height: 35px= ; border-width: 0px; border-style: solid;" width=3D"88"></a></div> <div><br> <em>Thanks,</em><br> <br> Tim Harper<br> VP, Business Development<br> Main: <a href=3D"tel:952.223.1157" target=3D"_blank">952.223.1157</a></div> </div> <div style=3D"margin:50px 0px 50px;"> <hr size=3D"1" color=3D"#dddcc5"> </div> <table style=3D"text-align:center;" width= =3D"100%" border=3D"0" cellpadding=3D"0" cellspacing=3D"0"> <tbody> <tr> <td><a href=3D"http://info.fieldnat= ion.com/e/24592/company-field-nation/y7xdz/633608459" target=3D"_blank"><im= g alt=3D"LinkedIn" src=3D"http://info.fieldnation.com/l/24592/2014-11-13/g3= 571/24592/60064/orange_linkedin.png" style=3D"width: 30px; height: 30px; bo= rder-width: 0px; border-style: solid;" height=3D"30" width=3D"30" border=3D= "0"></a></td> <td><a href=3D"http://info.fieldnat= ion.com/e/24592/fieldnation/y7xf2/633608459" target=3D"_blank"><img alt=3D"= Facebook" src=3D"http://info.fieldnation.com/l/24592/2014-11-13/g356w/24592= /60060/orange_facebook.png" style=3D"width: 30px; height: 30px; border-widt= h: 0px; border-style: solid;" height=3D"30" width=3D"30" border=3D"0"></a><= /td> <td><a href=3D"http://info.fieldnat= ion.com/e/24592/fieldnation/y7xf4/633608459" target=3D"_blank"><img alt=3D"= Twitter" src=3D"http://info.fieldnation.com/l/24592/2014-11-13/g3575/24592/= 60066/orange_twitter.png" style=3D"width: 30px; height: 30px; border-width:= 0px; border-style: solid;" height=3D"30" width=3D"30" border=3D"0"></a></t= d> <td><a href=3D"http://info.fieldnat= ion.com/e/24592/annel-UC9l-NXYA7Fww8xi3nk6ZVYA/y7xf6/633608459" target=3D"_= blank"><img alt=3D"YouTube" src=3D"http://info.fieldnation.com/l/24592/2014= -11-13/g3573/24592/60068/orange_youtube.png" style=3D"width: 30px; height: = 30px; border-width: 0px; border-style: solid;" height=3D"30" width=3D"30" b= order=3D"0"></a></td> <td><a href=3D"http://info.fieldnat= ion.com/e/24592/category-blog/y7xf8/633608459" target=3D"_blank"><img alt= =3D"Blog" src=3D"http://info.fieldnation.com/l/24592/2014-11-13/g356y/24592= /60062/orange_blog.png" style=3D"width: 30px; height: 30px; border-width: 0= px; border-style: solid;" height=3D"30" width=3D"30" border=3D"0"></a></td> </tr> </tbody> </table></td> </tr> </tbody> </table> <!-- // End Module: Standard Content \ --></td> </tr> </tbody> </table> <!-- // End Template Body \ --></td> </tr> <tr> <td style=3D"border-collapse: collapse;" valign=3D"top" ali= gn=3D"center"><!-- // Begin Template Footer \ --> <table id=3D"templateFooter" style=3D"background-color: #= FFFFFF;border-top: 0;" width=3D"600" border=3D"0" cellpadding=3D"10" cellsp= acing=3D"0"> <tbody> <tr> <td class=3D"footerContent" style=3D"border-collaps= e: collapse;" valign=3D"top"><!-- // Begin Module: Standard Footer \ --> <table width=3D"100%" border=3D"0" cellpadding=3D= "10" cellspacing=3D"0"> <tbody> </tbody> </table> <!-- // End Module: Standard Footer \ --></td> </tr> </tbody> </table> <!-- // End Template Footer \ --></td> </tr> </tbody> </table> <!-- // Begin Template Preheader \ --> <table id=3D"templatePreheader" style=3D"background-color: #FAFAF= A;" width=3D"600" border=3D"0" cellpadding=3D"10" cellspacing=3D"0"> <tbody> <tr> <td class=3D"preheaderContent" style=3D"border-collapse: co= llapse;" valign=3D"top"><!-- // Begin Module: Standard Preheader --> <table width=3D"100%" border=3D"0" cellpadding=3D"10" cel= lspacing=3D"0"> <tbody> <tr> <td style=3D"border-collapse: collapse;" valign=3D"= top"><div class=3D"" pardot-region=3D"std_preheader_content" style=3D"color= : #505050;font-family: Arial;font-size: 10px;line-height: 10px;text-align: = left;"><p style=3D"text-align: center;">=C2=A9 2014 Field Nation, LLC. All = Rights Reserved.<br> 901 S. Marquette Avenue 2300 ATT Tower Minneapolis, MN 55402</p> <p style=3D"text-align: center;">http://info.fieldnation.com/unsubscribe/u/= 24592/58bcd11c96a5c3f0950d946adaa2c784/633608459 | http://info.fieldnation.= com/webmail/24592/633608459/58bcd11c96a5c3f0950d946adaa2c784</p> </div></td> </tr> </tbody> </table> <!-- // End Module: Standard Preheader --></td> </tr> </tbody> </table></td> </tr> </tbody> </table> </center> <!-- This email was originally designed by the wonderful folks at Mail= Chimp and remixed by Pardot. It is licensed under CC BY-SA 3.0 --> <img alt=3D"" src=3D"http://info.fieldnation.com/r/24592/1/633608459/open/1= " /></body> </html> --_=_swift_v4_1430235851_74edb9bde46caaf71d16472657ff5288_=_-- From bounces+749839-2c40-pcp=oss.sgi.com@email.pd25.com Tue Apr 28 11:42:25 2015 Return-Path: <bounces+749839-2c40-pcp=oss.sgi.com@email.pd25.com> X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,T_DKIM_INVALID autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id D23D17F37 for <pcp@oss.sgi.com>; Tue, 28 Apr 2015 11:42:25 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id A232D8F8073 for <pcp@oss.sgi.com>; Tue, 28 Apr 2015 09:42:25 -0700 (PDT) X-ASG-Debug-ID: 1430239343-04bdf06322485050001-S8gJnT Received: from o443.email.pd25.com ([198.21.0.182]) by cuda.sgi.com with ESMTP id LGX4ziBqiStivGcc (version=TLSv1 cipher=AES128-SHA bits=128 verify=NO) for <pcp@oss.sgi.com>; Tue, 28 Apr 2015 09:42:23 -0700 (PDT) X-Barracuda-Envelope-From: bounces+749839-2c40-pcp=oss.sgi.com@email.pd25.com X-Barracuda-Apparent-Source-IP: 198.21.0.182 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=fieldnation.com; h=subject:from:to:mime-version:content-type; s=smtpapi; bh=RwCNUjAh0zVDFlQLacYIEia+Tu4=; b=C8d/ogMtJ/d8wbrVPJY8ftFRjnp9b T820kYuHNb8Yflf5FgJz1Wbr4XWxFoZzrZwgt8W57LjNE+Jov/O16jkQNiSVVY2t Z3cSRyoq9hkVZNnVne5WeXrRrflUAF/Za4SmAvcJs0R8tnIRCqJP12SCrWQBVVR4 Lj5cjOpPhmQ4T8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=fieldnation.com; h=subject:from:to:mime-version:content-type; q=dns; s=smtpapi; b =lcdvetdW4nunGefZuR7vGUyOcaeWu8p2jqRysVC4ON+iQk3figFViKDuDqYEAks veC76ZWpL8X12uAkakY2NLy6+MUm7xz6pjKPz1m/oQD4SmEEln+sn+sWc2YO8dnA tqrDapAaO7et4vuC1IOSMRc9sXuNemzdSYVnacsx+nas= Received: by filter-173.sjc1.sendgrid.net with SMTP id filter-173.24973.553FB86F1C 2015-04-28 16:42:23.451875858 +0000 UTC Received: from [127.0.0.1] (localhost [75.126.64.178]) by ismtpd-046 (SG) with ESMTP id 14d00e872a0.2555.8e089 for <pcp@oss.sgi.com>; Tue, 28 Apr 2015 16:42:23 +0000 (UTC) Message-ID: <b59d7a3b56af397bcef144527e79d5fb@swift.generated> Date: Tue, 28 Apr 2015 12:42:23 -0400 Subject: Can We Set Up a Call? From: Tim Harper <tim.harper@fieldnation.com> X-ASG-Orig-Subj: Can We Set Up a Call? To: pcp@oss.sgi.com MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="_=_swift_v4_1430239343_7a1baa4b1f883373e229ef293a9ffff2_=_" X-SG-EID: kOfOAcXv1ynhnyjRjI6h+hr7TTJ4x1z/U2AZZR9fslL1GS/g7dj42T+g9OTJ4/jtOnGIJkFDhSJKGO zEMiNkp2EKl+01wyKj+t3QVa9g9v8CZ8Jdho6m6MP12payKi9W5mqwElAVO5u/tNKZL2rJ/B7eWRSo TYWuhkxXGrK7l1c= X-SG-ID: s78jXjc54Sh5tx9yFLGsWSVgP7deeyi89jjwqux6R/Un9hqS3S1jnErhoQgYpJGxp1ri2AtIBMyQKK IJIPsom1aJzYJAWAyo3F6qL52ULG1edUcX/9SZoCC+/YGXmh2u X-Barracuda-Connect: UNKNOWN[198.21.0.182] X-Barracuda-Start-Time: 1430239343 X-Barracuda-Encrypted: AES128-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Barracuda-BRTS-Status: 1 X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.60 X-Barracuda-Spam-Status: No, SCORE=0.60 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC5_MJ1963, DKIM_SIGNED, DKIM_VERIFIED, HTML_MESSAGE, RDNS_NONE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18429 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 HTML_MESSAGE BODY: HTML included in message 0.10 RDNS_NONE Delivered to trusted network by a host with no rDNS 0.50 BSF_SC5_MJ1963 Custom Rule MJ1963 --_=_swift_v4_1430239343_7a1baa4b1f883373e229ef293a9ffff2_=_ Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hello Dimitri, I was working on a project and found your company on LinkedIn. I work with Field Nation and think there is an opportunity for us to save you time and money. Check out Field Nation: http://info.fieldnation.com/e/24592/2015-04-28/y9sxq/633707931 We connect companies who need work done with technical contractors at no cost to you. These qualified experts show up on-site, complete your work at a pre-agreed upon price, all while representing your company. If you do business with contractors on any level, I would love to talk. Thanks, Tim Harper VP, Business Development Main: (952) 223-1157 http://info.fieldnation.com/e/24592/2015-04-28/y9sxq/633707931 =C2=A9 2014 Field Nation, LLC. All Rights Reserved. 901 S. Marquette Avenue 2300 ATT Tower Minneapolis, MN 55402 http://info.fieldnation.com/unsubscribe/u/24592/58bcd11c96a5c3f0950d946adaa= 2c784/633707931 | http://info.fieldnation.com/webmail/24592/633707931/58bcd11c96a5c3f0950d946= adaa2c784 --_=_swift_v4_1430239343_7a1baa4b1f883373e229ef293a9ffff2_=_ Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.= w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3DUTF-8"> <meta name=3D"viewport" content=3D"width=3Ddevice-width, initial-scale=3D1.= 0"/> <!-- Facebook sharing information tags --> <meta property=3D"og:title" content=3D"Can We Set Up a Call?"> <title>Can We Set Up a Call?
      3D""

      Hello Dimitri,

      I was working on a project and found your company on LinkedIn. I work = with Field Nation and think there is an opportunity for us to save you = time and money.

      We connect companies who need work done with technical contractors at no co= st to you. These qualified experts show up on-site, complete your work at a= pre-agreed upon price, all while representing your company.

      If you do business with contractors on any level, I would love to talk.

      Thanks,

      Tim Harper
      VP, Business Development
      Main: 952.223.1157

      =C2=A9 20= 14 Field Nation, LLC. All Rights Reserved.
      901 S. Marquette Avenue 2300 ATT Tower Minneapolis, MN 55402

      http://info.fieldnation.com/unsubscribe/u/= 24592/58bcd11c96a5c3f0950d946adaa2c784/633707931 | http://info.fieldnation.= com/webmail/24592/633707931/58bcd11c96a5c3f0950d946adaa2c784
      3D"" --_=_swift_v4_1430239343_7a1baa4b1f883373e229ef293a9ffff2_=_-- From minnus@buffalo.edu Tue Apr 28 14:38:56 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id C75947F37 for ; Tue, 28 Apr 2015 14:38:56 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id A7F5630404E for ; Tue, 28 Apr 2015 12:38:56 -0700 (PDT) X-ASG-Debug-ID: 1430249930-04bdf0632148bde0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve3.acsu.buffalo.edu [128.205.7.163]) by cuda.sgi.com with ESMTP id 3uaBNLRlhlNG0HcM for ; Tue, 28 Apr 2015 12:38:51 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.163 Received: from localmaile.acsu.buffalo.edu (localmaile.acsu.buffalo.edu [128.205.4.3]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 03524280; Tue, 28 Apr 2015 15:38:37 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id EB8FB160070; Tue, 28 Apr 2015 15:38:36 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localmaile.acsu.buffalo.edu (Postfix) with ESMTP id D7F32160076; Tue, 28 Apr 2015 15:38:36 -0400 (EDT) Received: from smtp.buffalo.edu (smtp2.acsu.buffalo.edu [128.205.5.254]) by localmaile.acsu.buffalo.edu (Prefixe) with ESMTP id D6923160070; Tue, 28 Apr 2015 15:38:36 -0400 (EDT) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id D1E262BA6E; Tue, 28 Apr 2015 15:38:36 -0400 (EDT) Message-ID: <553FE1BC.4070309@buffalo.edu> Date: Tue, 28 Apr 2015 15:38:36 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Nathan Scott CC: myllynen@redhat.com, pcp@oss.sgi.com Subject: Re: [pcp] Hotproc fixes References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> <233739221.5258413.1429764654377.JavaMail.zimbra@redhat.com> <55392BAB.3060101@buffalo.edu> <806884984.5885784.1429839438565.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes In-Reply-To: <806884984.5885784.1429839438565.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 9% X-Barracuda-Connect: mtareserve3.acsu.buffalo.edu[128.205.7.163] X-Barracuda-Start-Time: 1430249931 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18433 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Nathan, On 4/23/15 9:37 PM, Nathan Scott wrote: > Looks good. > > I've updated the QA a little in my tree (please review), then found another > small issue I think, in the store handler, where it ignores an empty string. > > I had expected to be able to use that to switch off the monitoring - is that > not right? > > Yeah, that functionality is not there, but should be. I will add it. Also adding Marko's request for config re-read. In the course of this, I need an error I can use when someone feeds pmstore a bad config. The best I could find is PM_ERR_CONV which seems to be used elsewhere, is that correct? Thanks Martins From minnus@buffalo.edu Tue Apr 28 14:39:33 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 48C227F37 for ; Tue, 28 Apr 2015 14:39:33 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 28E2F304059 for ; Tue, 28 Apr 2015 12:39:33 -0700 (PDT) X-ASG-Debug-ID: 1430249971-04bdf0632048be30001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve3.acsu.buffalo.edu [128.205.7.163]) by cuda.sgi.com with ESMTP id M6CCKmYaoOvpqjEI for ; Tue, 28 Apr 2015 12:39:31 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.163 Received: from localmaile.acsu.buffalo.edu (localmaile.acsu.buffalo.edu [128.205.4.3]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 0F46B2A7; Tue, 28 Apr 2015 15:39:31 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 03AF8160070; Tue, 28 Apr 2015 15:39:31 -0400 (EDT) Received: from localmaile.acsu.buffalo.edu (localhost [127.0.0.1]) by localmaile.acsu.buffalo.edu (Postfix) with ESMTP id E64CB160076; Tue, 28 Apr 2015 15:39:30 -0400 (EDT) Received: from smtp.buffalo.edu (smtp1.acsu.buffalo.edu [128.205.5.253]) by localmaile.acsu.buffalo.edu (Prefixe) with ESMTP id E5318160070; Tue, 28 Apr 2015 15:39:30 -0400 (EDT) Received: from prince.ccr.buffalo.edu (prince.ccr.buffalo.edu [128.205.40.45]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id E1A625289C; Tue, 28 Apr 2015 15:39:30 -0400 (EDT) Message-ID: <553FE1F2.50302@buffalo.edu> Date: Tue, 28 Apr 2015 15:39:30 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: myllynen@redhat.com, pcp@oss.sgi.com Subject: Re: [pcp] Hotproc fixes References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> <5537A542.6080905@redhat.com> <5537FE23.4040006@buffalo.edu> <55388C61.9080506@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes In-Reply-To: <55388C61.9080506@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: X: 10% X-Barracuda-Connect: mtareserve3.acsu.buffalo.edu[128.205.7.163] X-Barracuda-Start-Time: 1430249971 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18433 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Marko, On 4/23/15 2:08 AM, Marko Myllynen wrote: > I came to think one new feature which might be helpful: it'd be nice if > it would be possible to trigger re-reading of the configuration file. > This way one could do all the changes needed in the configuration file > (it's probably also easier to write more complex rules in a file than on > the command line) and be sure they persist across pmcd restarts or even > system reboots. Ok, it's possible to have the configuration file read by > restarting pmcd but then clients are affected so I don't think that's ideal. > > Remotely related to this, it seems that the configuration file is read > even if it's world-writeable, not sure would it be worth to disallow that. > Both good ideas, thanks. Martins From dsmith@redhat.com Tue Apr 28 14:57:32 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id D84267F37 for ; Tue, 28 Apr 2015 14:57:32 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id C6B608F8087 for ; Tue, 28 Apr 2015 12:57:29 -0700 (PDT) X-ASG-Debug-ID: 1430251045-04cb6c1cc9436140001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id SK14Oa0SpSNAj9B3 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 12:57:26 -0700 (PDT) X-Barracuda-Envelope-From: dsmith@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3SJvPEn020894 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 28 Apr 2015 15:57:25 -0400 Received: from t540p.usersys.redhat.com (vpn-59-2.rdu2.redhat.com [10.10.59.2]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3SJvMw8004498 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 28 Apr 2015 15:57:24 -0400 Message-ID: <553FE622.4030002@redhat.com> Date: Tue, 28 Apr 2015 14:57:22 -0500 From: David Smith User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp Subject: Re: [pcp] JSON PMDA References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <1237712965.18667183.1429054767135.JavaMail.zimbra@redhat.com> <5536C228.8010001@redhat.com> <1344441557.4430503.1429658863072.JavaMail.zimbra@redhat.com> <553F9968.4070509@redhat.com> X-ASG-Orig-Subj: Re: [pcp] JSON PMDA In-Reply-To: <553F9968.4070509@redhat.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430251045 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Barracuda-BRTS-Status: 1 X-Virus-Scanned: by bsmtpd at sgi.com On 04/28/2015 09:30 AM, David Smith wrote: > On 04/21/2015 06:27 PM, Nathan Scott wrote: >> Hi David, >> >> ----- Original Message ----- >>>> ----- Original Message ----- >>>>>> [...] >>>>>> Yeah - something like that - have a look at src/libpcp_pmda/src/cache.c >>>>>> as >>>>>> thats how the instance cache number stability is achieved. Perhaps we >>>>>> can >>>>>> extend that with additional APIs to help us out here. >>>>>> >>>>> >>>> Its OK to extend the API/ABI, but not to break it. Which should be all we >>>> need to do here, I think. Maybe see if we can reduce the range that those >>>> cache.c interfaces accept - the two lines with "if (inst == 0x7fffffff) {" >>>> there look promising. If we had a h->maxinst there perhaps, instead of the >>>> hard-coded 2^32-1 limit (may need to change the test to '>=' too) we might >>>> be done and dusted here. That'll turn out to be a gross oversimplification >>>> I'm sure ... but maybe, just maybe it will work. >>> >>> OK, I've been staring at cache.c today, and I've figured out a couple of >>> things. >>> >>> - Most of the existing code is for an instance cache, there doesn't >>> appear to be any existing code for a cluster/metric cache. >> >> A more abstract way to think about it would be 'its a cache for signed 32 >> bit identifiers allocated in a monotonically increasing way, allowing for >> holes and with support for optional persistence' ... which we use only for >> instances today. >> >>> - I'm failing to see how changing that 0x07ffffff as you outlined above >>> helps. Can you explain that a bit more? >> >> So, if we can generalise the above a little, we may be able to make it a >> 'cache for identifiers in a range from 0 to some specified maximum, with >> identifiers allocated in a monotonically increasing way, allowing holes >> and optional persistence'. >> >> The pmInDom is a domain number (JSON 137) and a "serial" number. So in >> our situation here, we could reserve serial #0 for a metric-identifier >> cache, #1 for an indom-identifier cache, and then use the rest of the >> space for indom-instance caches. > > Wouldn't it make more sense to reserve serial #0 for the indom-instance > cache, since that is what serial #0 is current used for (in effect)? How > much is the current indom-instance cache used today? > >>> If you'd like me to add a cluster/metric cache, I'm going to need a bit >>> more explanation about what that will entail. >> >> I don't think that is necessary. I think we may even get away with just >> the one metric identifier cache? (combine cluster and index - using the >> full metric name as the cache key. Maybe? Not sure, but that would help >> with the 1024-metrics-per-source-only problem). >> >>> From a PMDA writer's point of view, I'd think the new APIs would look >>> something like (in pseudo code): >>> >>> - lookup_cluster(domain_id, name) >>> - find_next_available_cluster(domain_id) >>> - lookup_metric(domain_id, cluster_id, name) >>> - find_next_available_metric(domain_id, cluster_id) >> >> As per the earlier mail with kenj (re ioctl), I think the only new API we >> will need for this aspect would be something like: >> >> int pmdaCacheResize(pmInDom indom, int maximum); >> >> the rest of the pmdaCacheOp(3) interfaces should give us the rest of the >> cache manipulation functionality you need (like persisting, restoring, & >> so on). > > I wonder if it wouldn't make sense to define something like the > following instead: > > int pmdaCacheOp2(pmInDom indom, int op, unsigned long val); > > with an associated op of PMDA_CACHE2_RESIZE. That would give more room > for the addition of future operations. Thinking about this a bit more, are you thinking the serial # to XXXX item cache is just a suggestion or will we be hard-coding those assignments? If we hard-code those assignments, then do we even need pmdaCacheResize()? Based on the serial #, we would then know what the maximum number of the associated items would be. -- David Smith dsmith@redhat.com Red Hat http://www.redhat.com 256.217.0141 (direct) 256.837.0057 (fax) From fche@redhat.com Tue Apr 28 15:00:00 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id C20AE7F37 for ; Tue, 28 Apr 2015 15:00:00 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 9F48A304048 for ; Tue, 28 Apr 2015 13:00:00 -0700 (PDT) X-ASG-Debug-ID: 1430251199-04bdf0632048c550001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id CDR546FfkFgCHMhe (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 12:59:59 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3SJxxJb020727 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 28 Apr 2015 15:59:59 -0400 Received: from fche.csb (vpn-224-222.phx2.redhat.com [10.3.224.222]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3SJxwiu020339; Tue, 28 Apr 2015 15:59:58 -0400 Received: by fche.csb (Postfix, from userid 2569) id 6F1FE5853F; Tue, 28 Apr 2015 15:59:57 -0400 (EDT) To: David Smith Cc: Nathan Scott , pcp@oss.sgi.com Subject: Re: JSON PMDA References: <54F9F92D.4010202@redhat.com> <448002717.7934024.1427683964254.JavaMail.zimbra@redhat.com> <552699FE.7040801@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <1237712965.18667183.1429054767135.JavaMail.zimbra@redhat.com> <5536C228.8010001@redhat.com> <1344441557.4430503.1429658863072.JavaMail.zimbra@redhat.com> <553F9968.4070509@redhat.com> X-ASG-Orig-Subj: Re: JSON PMDA From: fche@redhat.com (Frank Ch. Eigler) Date: Tue, 28 Apr 2015 15:59:57 -0400 In-Reply-To: <553F9968.4070509@redhat.com> (David Smith's message of "Tue, 28 Apr 2015 09:30:00 -0500") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430251199 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 dsmith wrote: > [...] > I wonder if it wouldn't make sense to define something like the > following instead: > > int pmdaCacheOp2(pmInDom indom, int op, unsigned long val); > > with an associated op of PMDA_CACHE2_RESIZE. That would give more room > for the addition of future operations. FWIW, I'm not a fan of ioctl-like functions like this. They provide apparent API/ABI stability but not actual API/ABI stability. (There would be no way to verify op values or appropriateness of val for each op, etc.) Adding new functions as first class functions is easy. - FChE From nscott@redhat.com Tue Apr 28 17:15:14 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id E09817F37 for ; Tue, 28 Apr 2015 17:15:14 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id CE3D6304043 for ; Tue, 28 Apr 2015 15:15:11 -0700 (PDT) X-ASG-Debug-ID: 1430259306-04cb6c1cc9438f80001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id Jg9rJyrxGg804crk (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 15:15:07 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3SMF4vI012673; Tue, 28 Apr 2015 18:15:04 -0400 Date: Tue, 28 Apr 2015 18:15:04 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus Cc: myllynen@redhat.com, pcp@oss.sgi.com Message-ID: <493868439.8753727.1430259304546.JavaMail.zimbra@redhat.com> In-Reply-To: <553FE1BC.4070309@buffalo.edu> References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> <233739221.5258413.1429764654377.JavaMail.zimbra@redhat.com> <55392BAB.3060101@buffalo.edu> <806884984.5885784.1429839438565.JavaMail.zimbra@redhat.com> <553FE1BC.4070309@buffalo.edu> Subject: Re: [pcp] Hotproc fixes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.140] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: Hotproc fixes Thread-Index: uMXQXQTVI0Fzhz4BmeoUzNnlZqoaiA== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1430259307 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18436 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > [...] > Yeah, that functionality is not there, but should be. I will add it. > Also adding Marko's request for config re-read. In the course of this, > I need an error I can use when someone feeds pmstore a bad config. The > best I could find is PM_ERR_CONV which seems to be used elsewhere, is > that correct? Yep. cheers. -- Nathan From lberk@redhat.com Tue Apr 28 17:40:29 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id B640B7F37 for ; Tue, 28 Apr 2015 17:40:29 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 946B28F8092 for ; Tue, 28 Apr 2015 15:40:26 -0700 (PDT) X-ASG-Debug-ID: 1430260822-04cb6c1cca4397b0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id kXxTGhhSfPIfCWPh (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 15:40:25 -0700 (PDT) X-Barracuda-Envelope-From: lberk@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (Postfix) with ESMTPS id C6A1D91740 for ; Tue, 28 Apr 2015 22:40:22 +0000 (UTC) Received: from toium (vpn-58-124.rdu2.redhat.com [10.10.58.124]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3SMeKru026405 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Tue, 28 Apr 2015 18:40:21 -0400 From: Lukas Berk To: Nathan Scott Cc: pcp@oss.sgi.com Subject: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint References: <87bnk0wzn5.fsf@redhat.com> <877ft59dmo.fsf@redhat.com> <1344838118.4507317.1429675359315.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint Date: Tue, 28 Apr 2015 18:40:19 -0400 In-Reply-To: <1344838118.4507317.1429675359315.JavaMail.zimbra@redhat.com> (Nathan Scott's message of "Wed, 22 Apr 2015 00:02:39 -0400 (EDT)") Message-ID: <87pp6n7u7g.fsf@redhat.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430260825 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hey, Nathan Scott writes: [...] >> Any comments are appreciated. Frank has already pointed out on IRC, a >> pcp-full-collection style package, which requires and installs the full >> pcp set of packages would be nice to have. Especially as a convienience >> to the user. I think this is a great idea, and unless there is strong >> opposition to it, will be adding that asap. > The documentation refers to concepts of 'pcp collector' and 'pcp monitor' > installations (which also reflects the common deployment model) - it would > make alot of sense to have two packages reflect that, if possible, rather > than one mega package. I've been toying with this idea a bit, and ended going with the two packages (pcp-collection and pcp-monitor, respectively). If one is interested in installing every pcp package, wildcarding "pcp-*" will work. I've pushed this commit to lberk/dev at sourceware.org/git/pcpfans.git Cheers, Lukas From nscott@redhat.com Tue Apr 28 17:42:41 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 23E217F37 for ; Tue, 28 Apr 2015 17:42:41 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 1447C304032 for ; Tue, 28 Apr 2015 15:42:40 -0700 (PDT) X-ASG-Debug-ID: 1430260958-04cbb056b44897f0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id fyOIlPFBtI64rBJx (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 15:42:38 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3SMgbDI016572; Tue, 28 Apr 2015 18:42:37 -0400 Date: Tue, 28 Apr 2015 18:42:37 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Mark Goodwin Cc: pcp Message-ID: <972777481.8759612.1430260957858.JavaMail.zimbra@redhat.com> In-Reply-To: <553F4BA8.5000001@redhat.com> References: <20150421224405.GN6822@redhat.com> <5536E65F.50600@redhat.com> <20150422000949.GP6822@redhat.com> <553F4BA8.5000001@redhat.com> Subject: Re: [pcp] pcp updates: pmmgr, pmwebd MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] pcp updates: pmmgr, pmwebd Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.140] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: pmmgr, pmwebd Thread-Index: tZQDS+7hx5dltPWInM7gnCQtXdSoGQ== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1430260958 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18438 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > [...] > Howdy Frank, will I just pull in all your changes? Or cherry-pick > only the pmwebd changes? Your tree of unmerged stuff seems to go back > to the commit listed below I think. The pmmgr changes are marked as > 'blocked' on https://trello.com/b/5t9Ml341/release-task-tracking. The pmmgr changes are blocked on fixes for these two bugs: http://git.pcp.io/bugzilla/show_bug.cgi?id=1105 http://git.pcp.io/bugzilla/show_bug.cgi?id=1106 It's inappropriate to merge this before those are fixed (esp. since the feature is apparently useless without 1106) - if we accept this sort of 'Not My Problem' attitude, we cultivate a class of contributor working primarily on features in their pet project(s), and less on fixing core PCP bugs for the greater good. No reason for merging it at this stage has been provided - is there one? The situation was explained and the path to resolving it discussed - so, I'd suggest it can wait. Or are there legitimate reasons for merging before those bugs are fixed? Taa. cheers. -- Nathan From lberk@redhat.com Tue Apr 28 17:48:02 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 0D5D27F37 for ; Tue, 28 Apr 2015 17:48:02 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay3.corp.sgi.com (Postfix) with ESMTP id A9012AC002 for ; Tue, 28 Apr 2015 15:48:01 -0700 (PDT) X-ASG-Debug-ID: 1430261280-04bdf06322490590001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id NCOHWARAcJTMGfJG (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 15:48:00 -0700 (PDT) X-Barracuda-Envelope-From: lberk@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3SMm077023426 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 28 Apr 2015 18:48:00 -0400 Received: from toium (vpn-58-124.rdu2.redhat.com [10.10.58.124]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3SMlwHk000940 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Tue, 28 Apr 2015 18:47:59 -0400 From: Lukas Berk To: pcp@oss.sgi.com Subject: pcp-update pmdapostfix install fix Date: Tue, 28 Apr 2015 18:47:58 -0400 X-ASG-Orig-Subj: pcp-update pmdapostfix install fix Message-ID: <87k2wv7tup.fsf@redhat.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430261280 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi, Please see lberk/dev on sourceware.org/git/pcpfans.git for a quick patch for pmdapostfix. The pmda installation was failing on RHEL6 due to the inability to set the gid properly. commit 17c48454790627e5a9ad2ff4273d94f026e16c20 Author: Lukas Berk Date: Tue Apr 28 09:58:56 2015 -0400 Force restart for postfix pmda installation The postfix pmda requires being installed by root to change the gid to postfix. Switch the required option in the Install script. diff --git a/src/pmdas/postfix/Install b/src/pmdas/postfix/Install index 07fe957..2ab4d19 100644 --- a/src/pmdas/postfix/Install +++ b/src/pmdas/postfix/Install @@ -21,7 +21,7 @@ iam=postfix perl_opt=true daemon_opt=false -forced_restart=false +forced_restart=true which qshape >/dev/null 2>&1 if test $? -ne 0; then From kenj@internode.on.net Tue Apr 28 17:56:01 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 241347F37 for ; Tue, 28 Apr 2015 17:56:01 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 051F88F808F for ; Tue, 28 Apr 2015 15:56:00 -0700 (PDT) X-ASG-Debug-ID: 1430261757-04bdf06323490920001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id Ji6vdWf6S5XE0KQo for ; Tue, 28 Apr 2015 15:55:58 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DaAQCrDkBVPKEh0XYNT4sDxVyCXQKCCQEBAQEBAQcBAQEBQYRgAQEEOEARCyEWDwkDAgECATEUEwgBAbo9lQQBK4s4hQwWhBcBBLIQgiocgWODIgEBAQ Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail06.adl2.internode.on.net with ESMTP; 29 Apr 2015 08:25:57 +0930 Message-ID: <55401011.2090708@internode.on.net> Date: Wed, 29 Apr 2015 08:56:17 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] Hotproc fixes References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> <233739221.5258413.1429764654377.JavaMail.zimbra@redhat.com> <55392BAB.3060101@buffalo.edu> <806884984.5885784.1429839438565.JavaMail.zimbra@redhat.com> <553FE1BC.4070309@buffalo.edu> X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes In-Reply-To: <553FE1BC.4070309@buffalo.edu> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1430261757 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18439 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 29/04/15 05:38, Martins Innus wrote: > ... In the course of this, > I need an error I can use when someone feeds pmstore a bad config. The > best I could find is PM_ERR_CONV which seems to be used elsewhere, is > that correct? PM_ERR_CONV is probably the closest error code, although this is most frequently encountered in bad pmExtractValue() calls. Other alternatives might be PM_ERR_GENERIC (depending on what options you have for reporting the error, e.g. to the PMDA log file), else petition for a new error code by proposing a new macro PM_ERR_FOO and suitable text to be associated with it via pmErrStr(). The latter course of action is OK in cases where none of the existing errors provide a "reasonable" semantic match for the error in question, and is how the error codes have grown over time (about 25% of the current PM_ERR_* macros did not exist in PCP 1.0). From nscott@redhat.com Tue Apr 28 18:02:09 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 261C67F37 for ; Tue, 28 Apr 2015 18:02:09 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id A8B88AC002 for ; Tue, 28 Apr 2015 16:02:05 -0700 (PDT) X-ASG-Debug-ID: 1430262123-04cbb056b3489d50001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id e3KvN0dWWibQfup1 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 16:02:03 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3SN22RI018873; Tue, 28 Apr 2015 19:02:02 -0400 Date: Tue, 28 Apr 2015 19:02:02 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: David Smith Cc: pcp Message-ID: <228384251.8762318.1430262122726.JavaMail.zimbra@redhat.com> In-Reply-To: <553FE622.4030002@redhat.com> References: <54F9F92D.4010202@redhat.com> <2139482617.15593599.1428634701360.JavaMail.zimbra@redhat.com> <552D6524.1030803@redhat.com> <1237712965.18667183.1429054767135.JavaMail.zimbra@redhat.com> <5536C228.8010001@redhat.com> <1344441557.4430503.1429658863072.JavaMail.zimbra@redhat.com> <553F9968.4070509@redhat.com> <553FE622.4030002@redhat.com> Subject: Re: [pcp] JSON PMDA MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] JSON PMDA Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.140] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: JSON PMDA Thread-Index: vP6y+l1YztpFYaRQAg9POyYNEK323A== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1430262123 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18439 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi David, ----- Original Message ----- > On 04/28/2015 09:30 AM, David Smith wrote: > >> The pmInDom is a domain number (JSON 137) and a "serial" number. So in > >> our situation here, we could reserve serial #0 for a metric-identifier > >> cache, #1 for an indom-identifier cache, and then use the rest of the > >> space for indom-instance caches. > > > > Wouldn't it make more sense to reserve serial #0 for the indom-instance > > cache, since that is what serial #0 is current used for (in effect)? How > > much is the current indom-instance cache used today? Sure. By "reserved" we are meaning within pmdajson right? (not libpcp_pmda) The current pmdaCache routines are used extensively by other PMDAs, so care must be taken not to introduce new restrictions there. > >> As per the earlier mail with kenj (re ioctl), I think the only new API we > >> will need for this aspect would be something like: > >> > >> int pmdaCacheResize(pmInDom indom, int maximum); > >> > >> the rest of the pmdaCacheOp(3) interfaces should give us the rest of the > >> cache manipulation functionality you need (like persisting, restoring, & > >> so on). > > > > I wonder if it wouldn't make sense to define something like the > > following instead: > > > > int pmdaCacheOp2(pmInDom indom, int op, unsigned long val); > > > > with an associated op of PMDA_CACHE2_RESIZE. That would give more room > > for the addition of future operations. I prefer the Linux kernel attitude myself - shy away from ioctl whenever possible, and use unambiguous, well-defined APIs. There's a clear path for us to introduce additional APIs later if needed, just as we are now. > Thinking about this a bit more, are you thinking the serial # to XXXX > item cache is just a suggestion or will we be hard-coding those > assignments? If we hard-code those assignments, then do we even need > pmdaCacheResize()? Based on the serial #, we would then know what the > maximum number of the associated items would be. Hard-coded in pmdajson, not libpcp_pmda - so some mechanism to tell the library a limit for an individual cache will be needed. There are other PMDAs that will want to opt-in to using this too, and they'll have their own size limits for specified (new) pmda-local indoms too (and different requirements about the indom# - e.g. they may already be using serial# zero and one). cheers. -- Nathan From kenj@internode.on.net Tue Apr 28 18:03:26 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 6F3097F37 for ; Tue, 28 Apr 2015 18:03:26 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 60DD78F8092 for ; Tue, 28 Apr 2015 16:03:23 -0700 (PDT) X-ASG-Debug-ID: 1430262177-04cb6c1cca439ec0001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id SiXHVicQKh2bhAS9 for ; Tue, 28 Apr 2015 16:02:58 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DZAQDNEEBVPKEh0XYNT4sDxV2CXQKCCQEBAQEBAQcBAQEBQYRgAQEEOFELGAklDwIyFBMIAQG6NJUEASuLOIUMFoQXAQSyEIEDgyaDIgEBAQ Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail06.adl2.internode.on.net with ESMTP; 29 Apr 2015 08:31:56 +0930 Message-ID: <55401179.90601@internode.on.net> Date: Wed, 29 Apr 2015 09:02:17 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint References: <87bnk0wzn5.fsf@redhat.com> <877ft59dmo.fsf@redhat.com> <1344838118.4507317.1429675359315.JavaMail.zimbra@redhat.com> <87pp6n7u7g.fsf@redhat.com> X-ASG-Orig-Subj: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint In-Reply-To: <87pp6n7u7g.fsf@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1430262177 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18439 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 29/04/15 08:40, Lukas Berk wrote: > ... > I've been toying with this idea a bit, and ended going with the two > packages (pcp-collection and pcp-monitor, respectively). If one is > interested in installing every pcp package, wildcarding "pcp-*" will > work. All the best ideas survive ... just checked and PCP 1.0 released in 1995 contained the packages (for IRIX): pcp_server (now apparently pcp-collection), pcp_client (now apparently pcp-monitor) and pcp_share (common stuff like libpcp). 8^)> From nscott@redhat.com Tue Apr 28 18:12:21 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id BBF497F37 for ; Tue, 28 Apr 2015 18:12:21 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 963A1304039 for ; Tue, 28 Apr 2015 16:12:18 -0700 (PDT) X-ASG-Debug-ID: 1430262734-04cb6c1cc943a1d0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id H6i04HKuj37fmAMg (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 16:12:15 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3SNCEU0021113; Tue, 28 Apr 2015 19:12:14 -0400 Date: Tue, 28 Apr 2015 19:12:14 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Lukas Berk Cc: pcp@oss.sgi.com Message-ID: <2089951493.8763144.1430262734221.JavaMail.zimbra@redhat.com> In-Reply-To: <87pp6n7u7g.fsf@redhat.com> References: <87bnk0wzn5.fsf@redhat.com> <877ft59dmo.fsf@redhat.com> <1344838118.4507317.1429675359315.JavaMail.zimbra@redhat.com> <87pp6n7u7g.fsf@redhat.com> Subject: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.140] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: Minimizing Installation Size for Reduced PCP Footprint Thread-Index: 6it3qi5NNfKonZHxnkujN26uTOhwKg== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1430262734 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18439 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi Lukas, ----- Original Message ----- > [...] > I've been toying with this idea a bit, and ended going with the two > packages (pcp-collection and pcp-monitor, respectively). If one is Could we use the term "collector" rather than "collection"? See e.g. PCPIntro(1) - 3rd and 4th paragraphs there - that terminology is used fairly extensively throughout the Users+Admins Guide book as well. > interested in installing every pcp package, wildcarding "pcp-*" will > work. Neat - always the exceptions to the rule though I guess, with python* & perl* module package naming conventions. > I've pushed this commit to lberk/dev at sourceware.org/git/pcpfans.git > Thanks Lukas. cheers. -- Nathan From kenj@internode.on.net Tue Apr 28 18:54:44 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id D33797F37 for ; Tue, 28 Apr 2015 18:54:44 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 5EE0AAC002 for ; Tue, 28 Apr 2015 16:54:44 -0700 (PDT) X-ASG-Debug-ID: 1430265281-04cb6c1cc943ae50001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id dMB44tkwFlCPxF0V for ; Tue, 28 Apr 2015 16:54:42 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DaAQDCHEBVPKEh0XYNT4NfXIMagy7CL4gUAQEBAQEBBwEBAQFBhQlVMAYCBRYLAgsDAgECATEnBgIBAbo+cJREgSGPOYJSgUUFlWmcJ4QpXYJFAQEB Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail06.adl2.internode.on.net with ESMTP; 29 Apr 2015 09:24:40 +0930 Message-ID: <55401DD5.2070509@internode.on.net> Date: Wed, 29 Apr 2015 09:55:01 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - mac os x fixes Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - mac os x fixes Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1430265281 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18440 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp master Ken McDonell (2): libpcp/check-statics: more Mac OS X changes root PMDA: fix for root_root installer problem on Mac OS X src/libpcp/src/check-statics | 8 ++++---- src/pmdas/root/GNUmakefile | 10 +++++++--- 2 files changed, 11 insertions(+), 7 deletions(-) Details ... commit badfc2686da23880e54c940ebda3159b247d3b58 Author: Ken McDonell Date: Wed Apr 29 09:04:11 2015 +1000 root PMDA: fix for root_root installer problem on Mac OS X Issue was installing root_root twice ... this triggered Mac OS X installer failures of the form install-pcp: Error: Unable to find file (src/pmdas/root/root_root) for /var/lib/pcp/pmns/root_root Fix is to clone the link-and-install-the-link trick from the mmv PMDA. commit 36420d68ff51eeb6a4e45e719e21d0a68b8aa9f1 Author: Ken McDonell Date: Wed Apr 29 06:52:11 2015 +1000 libpcp/check-statics: more Mac OS X changes This time on Mac OS X 10.6.8 (and probably other versions), there are a couple of variables in pmns.c that are thread private (curr_pmns and useExtPMNS) and generate no external symbols ... so make 'em optional in the check-statics manifest, like the thread private variables in other source files. From nscott@redhat.com Tue Apr 28 19:48:44 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id AF5377F37 for ; Tue, 28 Apr 2015 19:48:44 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id 9096C304032 for ; Tue, 28 Apr 2015 17:48:41 -0700 (PDT) X-ASG-Debug-ID: 1430268515-04bdf06320494400001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id xYHMaUQiLseu4sAr (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 17:48:36 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3T0mZVv013737; Tue, 28 Apr 2015 20:48:35 -0400 Date: Tue, 28 Apr 2015 20:48:35 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: myllynen@redhat.com Cc: pcp developers Message-ID: <1920313753.8794344.1430268515490.JavaMail.zimbra@redhat.com> In-Reply-To: <553F5369.1030300@redhat.com> References: <553F5369.1030300@redhat.com> Subject: Re: [pcp] Add PCP Hotproc Mechanism to Quick Guide MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Add PCP Hotproc Mechanism to Quick Guide Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.140] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: Add PCP Hotproc Mechanism to Quick Guide Thread-Index: e4LcfM+sLCJhBJJFw8yzsbQPs5/lrw== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1430268516 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18441 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain Hi Marko, ----- Original Message ----- > Hi, > > after the latest fixes from Martins it looks like hotproc is ready for > general consumption, please find attached a patch to add a section about > hotproc to the Quick Guide. > > I added some HTML elements here and there while at it. I had to point to > pcp.io for pmdahotproc(1) instead of man7.org since it wasn't available > there. Ah, we need to merge pmdaproc.1 & pmdahotproc.1 - there is no separate pmdahotproc binary now (that was a detail of the IRIX implementation). Then the man page will be present in both pcp.io and man7.org and you can choose whichever suits best. > And as usual, any enhancements or grammar fixes from native > speakers are warmly welcome. > > I'll leave it up to you should we apply the patch today already or after > the next release with the recent fixes is out. Perhaps a reference to "pcp-3.10.5 or later" would suit here? cheers. -- Nathan From nscott@redhat.com Tue Apr 28 21:10:04 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 76BDB7F37 for ; Tue, 28 Apr 2015 21:10:04 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay1.corp.sgi.com (Postfix) with ESMTP id 644E58F8092 for ; Tue, 28 Apr 2015 19:10:04 -0700 (PDT) X-ASG-Debug-ID: 1430273398-04cbb056b448d410001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id DGcSqoEkNtqzEbpb (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 19:09:59 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3T29waB013596 for ; Tue, 28 Apr 2015 22:09:58 -0400 Date: Tue, 28 Apr 2015 22:09:58 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp developers Message-ID: <453621038.8816473.1430273398563.JavaMail.zimbra@redhat.com> In-Reply-To: <478976845.8816444.1430273371756.JavaMail.zimbra@redhat.com> Subject: pcp updates: qa, pmdaproc MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: qa, pmdaproc Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Originating-IP: [10.64.50.140] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: qa, pmdaproc Thread-Index: o3PbbOtNvwnsuhGnoP8RYDJihhzyFQ== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1430273399 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18442 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/nathans/pcp.git master Nathan Scott (4): qa: tests exercising new pmdaproc metrics (vm, namespace) qa: update dmcache/dmthin/pmdadm in common QA filters qa: remove debug archive extraction from 787 pmdaproc: add help text for new cgroup mem metrics Martins Innus (1): hotproc - add guards for missing ioentry qa/730.out | 66 + qa/731.out | 15=20 qa/787 | 4=20 qa/943.out | 10=20 qa/974 | 68 + qa/974.out | 2149 ++++++++++++++++++++++++++++++= +++++ qa/common.filter | 3=20 qa/group | 1=20 qa/linux/mk.procpid | 22=20 qa/linux/procpid-2.6.32-root-001.tgz |binary qa/linux/procpid-3.19.0-root-002.tgz |binary qa/linux/procpid-3.2.0-root-003.tgz |binary src/pmdas/linux_proc/help | 4=20 src/pmdas/linux_proc/proc_pid.c | 8=20 14 files changed, 2342 insertions(+), 8 deletions(-) commit 4580c4969ac2fd71997c9aeafe665c06f8b5482f Author: Nathan Scott Date: Wed Apr 29 12:04:08 2015 +1000 pmdaproc: add help text for new cgroup mem metrics commit b3f1be5fc33a95dd3c446278ad8d7641ec12531b Author: Nathan Scott Date: Wed Apr 29 11:43:41 2015 +1000 qa: remove debug archive extraction from 787 =20 Failing for me with ... =20 $ diff 787.out* 1027a1028 > rm: cannot remove =E2=80=98/tmp/convert.*=E2=80=99: No such file or d= irectory =20 looks like some leftover debugging there; commented out now. commit 1bdb023615cac803d52606f8d9ca46b7ea58641e Author: Nathan Scott Date: Tue Apr 28 17:58:34 2015 +1000 qa: update dmcache/dmthin/pmdadm in common QA filters commit bbbeab4cb3396a30a667c576ce38fc8928edda66 Author: Nathan Scott Date: Tue Apr 28 17:58:00 2015 +1000 qa: tests exercising new pmdaproc metrics (vm, namespace) commit 5a748f02750e26edba45990384fa5b5f3f940268 Author: Martins Innus Date: Fri Apr 24 14:44:15 2015 +0000 hotproc - add guards for missing ioentry From fche@redhat.com Tue Apr 28 21:39:39 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 9B0C07F37 for ; Tue, 28 Apr 2015 21:39:39 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 8B295304032 for ; Tue, 28 Apr 2015 19:39:36 -0700 (PDT) X-ASG-Debug-ID: 1430275174-04cbb056b248dc90001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 0z4k8ZcSwyXxiBMr (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 19:39:35 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3T2dY3L019073 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 28 Apr 2015 22:39:34 -0400 Received: from fche.csb (vpn-224-222.phx2.redhat.com [10.3.224.222]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3T2dXBD012238; Tue, 28 Apr 2015 22:39:34 -0400 Received: by fche.csb (Postfix, from userid 2569) id CB89658523; Tue, 28 Apr 2015 22:39:32 -0400 (EDT) To: Nathan Scott Cc: Mark Goodwin , pcp@oss.sgi.com Subject: Re: pcp updates: pmmgr, pmwebd References: <20150421224405.GN6822@redhat.com> <5536E65F.50600@redhat.com> <20150422000949.GP6822@redhat.com> <553F4BA8.5000001@redhat.com> <972777481.8759612.1430260957858.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: pcp updates: pmmgr, pmwebd From: fche@redhat.com (Frank Ch. Eigler) Date: Tue, 28 Apr 2015 22:39:32 -0400 In-Reply-To: <972777481.8759612.1430260957858.JavaMail.zimbra@redhat.com> (Nathan Scott's message of "Tue, 28 Apr 2015 18:42:37 -0400 (EDT)") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430275175 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 > [...] It's inappropriate to merge this before those are fixed > (esp. since the feature is apparently useless without 1106) - As explained elsewhere, this is not true. A custom pmlogger configuration for some basic metrics unaffected by the PR1106 bugs is possible and useful. > if we accept this sort of 'Not My Problem' attitude, we cultivate a > class of contributor working primarily on features in their pet > project(s), and less on fixing core PCP bugs for the greater good. Those core PCP bugs have been in areas where others' technical input has been repeatedly and specifically rejected. Holding this code hostage on account of those problems is inappropriate. - FChE From nscott@redhat.com Tue Apr 28 21:58:49 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 6EF397F37 for ; Tue, 28 Apr 2015 21:58:49 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 4E06D8F8081 for ; Tue, 28 Apr 2015 19:58:49 -0700 (PDT) X-ASG-Debug-ID: 1430276327-04bdf063204970f0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id kEGk9ZftAcULgXmh (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 19:58:47 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3T2wlds030161; Tue, 28 Apr 2015 22:58:47 -0400 Date: Tue, 28 Apr 2015 22:58:46 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: "Frank Ch. Eigler" Cc: pcp@oss.sgi.com Message-ID: <1700718526.8836180.1430276326941.JavaMail.zimbra@redhat.com> In-Reply-To: References: <20150421224405.GN6822@redhat.com> <5536E65F.50600@redhat.com> <20150422000949.GP6822@redhat.com> <553F4BA8.5000001@redhat.com> <972777481.8759612.1430260957858.JavaMail.zimbra@redhat.com> Subject: Re: pcp updates: pmmgr, pmwebd MIME-Version: 1.0 X-ASG-Orig-Subj: Re: pcp updates: pmmgr, pmwebd Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.50.140] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: pmmgr, pmwebd Thread-Index: zfEMSRd2ZYlxLBXDup2SN3NrIyXpng== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1430276327 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18443 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > [...] Holding this code hostage [...] Meanwhile back in the real world, Mark and I discussed this & resolved to look into the container issue as soon as possible to see if we can reproduce and resolve it. If you could look into the pmie problem, in parallel, that would be extremely helpful and ensure a quick merge. Thanks. -- Nathan From nscott@redhat.com Tue Apr 28 23:28:09 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 62A767F37 for ; Tue, 28 Apr 2015 23:28:09 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 513FC304032 for ; Tue, 28 Apr 2015 21:28:05 -0700 (PDT) X-ASG-Debug-ID: 1430281680-04cb6c1cca440090001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id 4TfctjV1kN2hARQ1 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 28 Apr 2015 21:28:01 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3T4S02Q010565 for ; Wed, 29 Apr 2015 00:28:00 -0400 Date: Wed, 29 Apr 2015 00:28:00 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp developers Message-ID: <1438819303.8888657.1430281680235.JavaMail.zimbra@redhat.com> In-Reply-To: <508561531.8888452.1430281585673.JavaMail.zimbra@redhat.com> Subject: pcp updates: postfix MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: postfix Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.85] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: postfix Thread-Index: Zn+GTeBCO/kpPeh6fd/ZprDiVqlD5g== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1430281681 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18444 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/nathans/pcp.git master Lukas Berk (1): Force restart for postfix pmda installation Nathan Scott (1): qa: add new qa test 805 for exercising pmdapostfix fixes qa/805 | 81 ++++++++++++++++++++++++++++++++++++ qa/805.out | 101 ++++++++++++++++++++++++++++++++++++++++++++++ qa/common.filter | 1 qa/group | 2 src/pmdas/postfix/Install | 2 5 files changed, 186 insertions(+), 1 deletion(-) commit 611fbcb29eb166f4e059e2e2fd9f0bc169eb147b Author: Lukas Berk Date: Tue Apr 28 09:58:56 2015 -0400 Force restart for postfix pmda installation The postfix pmda requires being installed by root to change the gid to postfix. Switch the required option in the Install script. commit 79947e01f8a50c108731a94b98aab2bccc3d42e4 Author: Nathan Scott Date: Wed Apr 29 14:12:10 2015 +1000 qa: add new qa test 805 for exercising pmdapostfix fixes From wwwrun@oss.sgi.com Tue Apr 28 23:33:46 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id EEC317F4E; Tue, 28 Apr 2015 23:33:46 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 955] Mising QA for postfix PMDA Date: Wed, 29 Apr 2015 04:33:46 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: nathans@debian.org X-Bugzilla-Status: RESOLVED X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: nathans@debian.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: bug_status cc resolution assigned_to Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1430282026.D2062.8397"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1430282026.D2062.8397 Date: Tue, 28 Apr 2015 23:33:46 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=955 Nathan Scott changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED CC| |nathans@debian.org Resolution|--- |FIXED Assignee|mort@sgi.com |nathans@debian.org --- Comment #1 from Nathan Scott --- Added qa/805 to exercise pmdapostfix.pl -- You are receiving this mail because: You are on the CC list for the bug. --1430282026.D2062.8397 Date: Tue, 28 Apr 2015 23:33:46 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" changed bug 955
      What Removed Added
      Status NEW RESOLVED
      CC   nathans@debian.org
      Resolution --- FIXED
      Assignee mort@sgi.com nathans@debian.org

      Comment # 1 on bug 955 from 
      Added qa/805 to exercise pmdapostfix.pl

      You are receiving this mail because:
      • You are on the CC list for the bug.
      --1430282026.D2062.8397-- From wwwrun@oss.sgi.com Tue Apr 28 23:33:47 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 1A6BC7F51; Tue, 28 Apr 2015 23:33:47 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 948] PMDAs should not be shipped without some QA coverage Date: Wed, 29 Apr 2015 04:33:47 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: nathans@debian.org X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: kenj@internode.on.net X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1430282027.5B80514.8397"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1430282027.5B80514.8397 Date: Tue, 28 Apr 2015 23:33:47 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=948 Bug 948 depends on bug 955, which changed state. Bug 955 Summary: Mising QA for postfix PMDA http://oss.sgi.com/bugzilla/show_bug.cgi?id=955 What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution|--- |FIXED -- You are receiving this mail because: You are on the CC list for the bug. --1430282027.5B80514.8397 Date: Tue, 28 Apr 2015 23:33:47 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" Bug 948 depends on bug 955, which changed state.
      What Removed Added
      Status NEW RESOLVED
      Resolution --- FIXED

      You are receiving this mail because:
      • You are on the CC list for the bug.
      --1430282027.5B80514.8397-- From wwwrun@oss.sgi.com Tue Apr 28 23:36:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 900BE7F4E; Tue, 28 Apr 2015 23:36:18 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 969] Mising QA for systemtap PMDA Date: Wed, 29 Apr 2015 04:36:18 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: nathans@debian.org X-Bugzilla-Status: RESOLVED X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1430282178.8DFd2.8652"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1430282178.8DFd2.8652 Date: Tue, 28 Apr 2015 23:36:18 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=969 Nathan Scott changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED CC| |nathans@debian.org Resolution|--- |WONTFIX --- Comment #1 from Nathan Scott --- This PMDA has been dropped in favour of new work, so we wont be needing QA for it. -- You are receiving this mail because: You are on the CC list for the bug. --1430282178.8DFd2.8652 Date: Tue, 28 Apr 2015 23:36:18 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" changed bug 969
      What Removed Added
      Status NEW RESOLVED
      CC   nathans@debian.org
      Resolution --- WONTFIX

      Comment # 1 on bug 969 from 
      This PMDA has been dropped in favour of new work, so we wont be needing QA for
it.

      You are receiving this mail because:
      • You are on the CC list for the bug.
      --1430282178.8DFd2.8652-- From wwwrun@oss.sgi.com Tue Apr 28 23:36:18 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id A6C9D7F51; Tue, 28 Apr 2015 23:36:18 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 948] PMDAs should not be shipped without some QA coverage Date: Wed, 29 Apr 2015 04:36:18 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: nathans@debian.org X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: kenj@internode.on.net X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1430282178.ECfBdEAD4.8652"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1430282178.ECfBdEAD4.8652 Date: Tue, 28 Apr 2015 23:36:18 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=948 Bug 948 depends on bug 969, which changed state. Bug 969 Summary: Mising QA for systemtap PMDA http://oss.sgi.com/bugzilla/show_bug.cgi?id=969 What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution|--- |WONTFIX -- You are receiving this mail because: You are on the CC list for the bug. --1430282178.ECfBdEAD4.8652 Date: Tue, 28 Apr 2015 23:36:18 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" Bug 948 depends on bug 969, which changed state.
      What Removed Added
      Status NEW RESOLVED
      Resolution --- WONTFIX

      You are receiving this mail because:
      • You are on the CC list for the bug.
      --1430282178.ECfBdEAD4.8652-- From jillian.murray@nhs.net Wed Apr 29 02:21:08 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id A26F17F37 for ; Wed, 29 Apr 2015 02:21:08 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 20275AC001 for ; Wed, 29 Apr 2015 00:21:08 -0700 (PDT) X-ASG-Debug-ID: 1430292062-04cbb056b1493620001-S8gJnT Received: from relay.nhs.uk (relay.nhs.uk [62.208.144.128]) by cuda.sgi.com with ESMTP id B7mjCLHe03ceI2j3 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 29 Apr 2015 00:21:03 -0700 (PDT) X-Barracuda-Envelope-From: jillian.murray@nhs.net Received: from nhs-pd1e-esg107.ad1.nhs.net (nhs-pd1e-esg107.ad1.nhs.net [127.0.0.1]) by IMSVA80 (Postfix) with ESMTP id 8384D478062; Wed, 29 Apr 2015 08:21:00 +0100 (BST) Received: from smtp.nhs.net (unknown [192.168.9.68]) by nhs-pd1e-esg107.ad1.nhs.net (Postfix) with ESMTP id CD04A47806E; Wed, 29 Apr 2015 08:20:59 +0100 (BST) Received: from NHS-PD1i-HTS001.AD1.NHS.NET (192.168.17.1) by NHS-PD1e-ETS004.ad1.nhs.net (192.168.8.68) with Microsoft SMTP Server (TLS) id 8.3.389.2; Wed, 29 Apr 2015 08:20:58 +0100 Received: from NHS-PCLI-MBC029.AD1.NHS.NET ([192.168.16.57]) by NHS-PD1i-HTS001.AD1.NHS.NET ([192.168.17.1]) with mapi; Wed, 29 Apr 2015 08:20:56 +0100 From: "Murray Jillian (WIRRAL UNIVERSITY TEACHING HOSPITAL NHS FOUNDATION TRUST)" To: "Murray Jillian (WIRRAL UNIVERSITY TEACHING HOSPITAL NHS FOUNDATION TRUST)" Date: Wed, 29 Apr 2015 08:20:55 +0100 Subject: RE: Thread-Index: AQHQgiNqM3LrKNLWFE6ZpHiwBWXCzJ1jXoZ3 X-ASG-Orig-Subj: RE: OLD-MSG-ID: <66896F75789ECD44A8728F1A709DADAA4C35F440@NHS-PCLI-MBC029.AD1.NHS.NET> References: <66896F75789ECD44A8728F1A709DADAA4C35F38D@NHS-PCLI-MBC029.AD1.NHS.NET> In-Reply-To: <66896F75789ECD44A8728F1A709DADAA4C35F38D@NHS-PCLI-MBC029.AD1.NHS.NET> Accept-Language: en-US, en-GB Content-Language: en-GB X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Message-Id: <20150429072059.CD04A47806E@nhs-pd1e-esg107.ad1.nhs.net> X-TM-AS-Product-Ver: IMSVA-8.0.0.1495-7.5.0.1018-21510.005 X-TM-AS-Result: No--23.885-60-31-10 X-imss-scan-details: No--23.885-60-31-10;No--23.885-3-31-10;No--23.885-4-31-10 X-TMASE-MatchedRID: dpQjoMhw3Y1X4F4069HJVO5i6weAmSDKYqLHQV0bLx+S1zSSx74FMFP5 NJLOlw6obrgUJ4CnqHgRwfdZV4McSuMwGKsCDN02OJTWdcuXC/46En2bnefhoOKgPcChFS1gLLW htsLdTGpsjXoN4wE77LqP0cP7WjHvgR8fXKWkEM4TDJnK4xDjXdZKsq3DGpalkC5RlDa9dg4sht hRaNLvKJsRrWpwHjzD9jEngGsb127zormiJTqUCe4N1cVIgN97P1v5BHlXCxQkYAR5JCuhB/iTH /bdTT2M4vM1YF6AJbbWG62ZFs10YAtuKBGekqUpPjKoPgsq7cA= X-Barracuda-Connect: relay.nhs.uk[62.208.144.128] X-Barracuda-Start-Time: 1430292063 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 1.01 X-Barracuda-Spam-Status: No, SCORE=1.01 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MISMATCH_TO, BSF_SC0_SA620b, BSF_SC0_SA_TO_FROM_ADDR_MATCH, MAILTO_TO_SPAM_ADDR, THREAD_INDEX X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18447 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.00 BSF_SC0_MISMATCH_TO Envelope rcpt doesn't match header 0.00 MAILTO_TO_SPAM_ADDR URI: Includes a link to a likely spammer email 0.50 BSF_SC0_SA_TO_FROM_ADDR_MATCH Sender Address Matches Recipient Address 0.50 BSF_SC0_SA620b Custom Rule SA620b ________________________________________ From: Murray Jillian (WIRRAL UNIVERSITY TEACHING HOSPITAL NHS FOUNDATION TR= UST) Sent: 29 April 2015 03:23 To: Murray Jillian (WIRRAL UNIVERSITY TEACHING HOSPITAL NHS FOUNDATION TRUS= T) Subject: 1.5 cad to you Contact: leonhirtle905@outlook.com for details. ***************************************************************************= ***************************************** This message may contain confidential information. If you are not the inten= ded recipient please inform the sender that you have received the message in error before deleting it. Please do not disclose, copy or distribute information in this e-mail or ta= ke any action in reliance on its contents: to do so is strictly prohibited and may be unlawful. Thank you for your co-operation. NHSmail is the secure email and directory service available for all NHS sta= ff in England and Scotland NHSmail is approved for exchanging patient data and other sensitive informa= tion with NHSmail and GSi recipients NHSmail provides an email address for your career in the NHS and can be acc= essed anywhere ***************************************************************************= ***************************************** From myllynen@redhat.com Wed Apr 29 08:43:54 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id EB1747F37 for ; Wed, 29 Apr 2015 08:43:54 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id AFB558F804B for ; Wed, 29 Apr 2015 06:43:51 -0700 (PDT) X-ASG-Debug-ID: 1430315027-04bdf063204a8e60001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id aTQWBDVL5aX7UU2Z (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 29 Apr 2015 06:43:47 -0700 (PDT) X-Barracuda-Envelope-From: myllynen@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3TDhkrO024042 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 29 Apr 2015 09:43:47 -0400 Received: from mmyllyne.csb (vpn1-6-230.ams2.redhat.com [10.36.6.230]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3TDhc8r003962; Wed, 29 Apr 2015 09:43:42 -0400 Message-ID: <5540E009.8010709@redhat.com> Date: Wed, 29 Apr 2015 16:43:37 +0300 From: Marko Myllynen Reply-To: myllynen@redhat.com Organization: Red Hat User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Nathan Scott CC: pcp developers Subject: Re: [pcp] Add PCP Hotproc Mechanism to Quick Guide References: <553F5369.1030300@redhat.com> <1920313753.8794344.1430268515490.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Add PCP Hotproc Mechanism to Quick Guide In-Reply-To: <1920313753.8794344.1430268515490.JavaMail.zimbra@redhat.com> Content-Type: multipart/mixed; boundary="------------030108040205030302010204" X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430315027 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 This is a multi-part message in MIME format. --------------030108040205030302010204 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Hi, On 2015-04-29 03:48, Nathan Scott wrote: >> >> after the latest fixes from Martins it looks like hotproc is ready for >> general consumption, please find attached a patch to add a section about >> hotproc to the Quick Guide. >> >> I added some HTML elements here and there while at it. I had to point to >> pcp.io for pmdahotproc(1) instead of man7.org since it wasn't available >> there. > > Ah, we need to merge pmdaproc.1 & pmdahotproc.1 - there is no separate > pmdahotproc binary now (that was a detail of the IRIX implementation). > Then the man page will be present in both pcp.io and man7.org and you > can choose whichever suits best. ok, I changed the man page reference to pmdaproc.1. >> I'll leave it up to you should we apply the patch today already or after >> the next release with the recent fixes is out. > > Perhaps a reference to "pcp-3.10.5 or later" would suit here? Indeed, I added this, please find the updated patch attached. Thanks, -- Marko Myllynen --------------030108040205030302010204 Content-Type: text/x-patch; name="0001-Describe-Hotproc-in-the-Quick-Guide.patch" Content-Transfer-Encoding: 8bit Content-Disposition: attachment; filename="0001-Describe-Hotproc-in-the-Quick-Guide.patch" >From 352ae5a5110aa7409f4eab78455b803ca8b264eb Mon Sep 17 00:00:00 2001 From: Marko Myllynen Date: Wed, 29 Apr 2015 16:40:52 +0300 Subject: [PATCH] Describe Hotproc in the Quick Guide --- man/html/guide.html | 50 +++++++++++++++++++++++++++++++++----------------- 1 files changed, 33 insertions(+), 17 deletions(-) diff --git a/man/html/guide.html b/man/html/guide.html index a143655..08a26a2 100644 --- a/man/html/guide.html +++ b/man/html/guide.html @@ -33,6 +33,7 @@
    • Process Level Performance Monitoring
    • Performance Metrics Inference @@ -103,7 +104,7 @@
    -

    To enable centralized archive log collection on the monitoring host, its pmlogger is configured to fetch performance metrics from collector hosts. Add each collector host to the pmlogger configuration file /etc/pcp/pmlogger/control and then restart the pmlogger service on the monitoring host. +

    To enable centralized archive log collection on the monitoring host, its pmlogger is configured to fetch performance metrics from collector hosts. Add each collector host to the pmlogger configuration file /etc/pcp/pmlogger/control and then restart the pmlogger service on the monitoring host.

       Enable recording of metrics from remote host acme.com:
    @@ -113,7 +114,7 @@
    -

    Checks for remote log collection will be done every half an hour. You may also wish to run /usr/libexec/pcp/bin/pmlogger_check -V -C (on Fedora/RHEL) or /usr/lib/pcp/bin/pmlogger_check -V -C (on Debian/Ubuntu) manually (service restart above issues this command internally). +

    Checks for remote log collection will be done every half an hour. You may also wish to run /usr/libexec/pcp/bin/pmlogger_check -V -C (on Fedora/RHEL) or /usr/lib/pcp/bin/pmlogger_check -V -C (on Debian/Ubuntu) manually (service restart above issues this command internally).

    Note that a default configuration file (config.acme.com above) will be generated if it does not exist already. This process is optional (a custom configuration for each host can be provided instead), see the pmlogconf(1) manual page for details on this. @@ -200,7 +201,7 @@ Display detailed information about a performance metric and its current values:<

        -Monitor live disk write operations per partition with two second interval using fixed point notation (use -i instance to list only certain metrics and -r for raw values):
    +Monitor live disk write operations per partition with two second interval using fixed point notation (use -i instance to list only certain metrics and -r for raw values):

    $ pmval -t 2sec -f 3 disk.partitions.write -h acme.com
    @@ -235,7 +236,7 @@ Monitor system metrics in an iostat like fashion with two second interval:

        -Monitor performance metrics with a GUI application with two second default interval from two different hosts. Use File->New Chart to select metrics to be included in a new view and use File->Open View to use a predefined view:
    +Monitor performance metrics with a GUI application with two second default interval from two different hosts. Use File->New Chart to select metrics to be included in a new view and use File->Open View to use a predefined view:

    $ pmchart -t 2sec -h acme1.com -h acme2.com     @@ -243,7 +244,7 @@ Monitor performance metrics with a GUI application with two second default inter

    Retrospective Performance Analysis

    -

    PCP archive logs are located under /var/log/pcp/pmlogger/hostname, and the archive names indicate the date they cover. Archives are self-contained, and machine-independent so can be transfered to any machine for offline analysis. +

    PCP archive logs are located under /var/log/pcp/pmlogger/hostname, and the archive names indicate the date they cover. Archives are self-contained, and machine-independent so can be transfered to any machine for offline analysis.

        @@ -275,14 +276,14 @@ Display detailed information about a performance metric at the time when an arch

        -Dump past disk write operations per partition in an archive using fixed point notation (use -i instance to list only certain metrics and -r for raw values):
    +Dump past disk write operations per partition in an archive using fixed point notation (use -i instance to list only certain metrics and -r for raw values):

    $ pmval -f 3 disk.partitions.write -a acme.com/20140902

        -Replay past disk write operations per partition in an archive with two second interval using fixed point notation between 9 AM and 10 AM (use full dates with syntax like @"2014-08-20 14:00:00"):
    +Replay past disk write operations per partition in an archive with two second interval using fixed point notation between 9 AM and 10 AM (use full dates with syntax like @"2014-08-20 14:00:00"):

    $ pmval -d -t 2sec -f 3 disk.partitions.write -S @09:00 -T @10:00 -a acme.com/20140902
    @@ -303,7 +304,7 @@ Dump past CPU load, memory usage, and disk write operations per partition in an

        -Summarize differences in past performance metrics between two archives, comparing 2 AM / 3 AM in the first archive to 9 AM / 10 AM in the second archive (grep for '+' to quickly see values which were zero during the first period):
    +Summarize differences in past performance metrics between two archives, comparing 2 AM / 3 AM in the first archive to 9 AM / 10 AM in the second archive (grep for '+' to quickly see values which were zero during the first period):

    $ pmdiff -S @02:00 -T @03:00 -B @09:00 -E @10:00 acme.com/20140902 acme.com/20140901
    @@ -338,7 +339,7 @@ Dump past system metrics in a

        -Replay performance metrics with a GUI application with two second default interval in an archive between 9 AM and 10 AM. Use File->New Chart to select metrics to be included in a new view and use File->Open View to use a predefined view:
    +Replay performance metrics with a GUI application with two second default interval in an archive between 9 AM and 10 AM. Use File->New Chart to select metrics to be included in a new view and use File->Open View to use a predefined view:

    $ pmchart -t 2sec -S @09:00 -T @10:00 -a acme.com/20140902
    @@ -353,7 +354,7 @@ Merge several archives as a new combined archive (see the manual page how to wri

    Visualizing iostat and sar Data

    -

    iostat and sar data can be imported as PCP archives which then allows inspecting and visualizing the data with PCP tools. The iostat2pcp(1) importer is in the pcp-import-iostat2pcp package and the sar2pcp(1) importer is in the pcp-import-sar2pcp package. +

    iostat and sar data can be imported as PCP archives which then allows inspecting and visualizing the data with PCP tools. The iostat2pcp(1) importer is in the pcp-import-iostat2pcp package and the sar2pcp(1) importer is in the pcp-import-sar2pcp package.

        @@ -366,7 +367,7 @@ Import iostat data to a new PCP archive and visualize it:
    @@ -375,7 +376,7 @@ Import sar data from an existing sar archive to a new PCP archive and visualize

    Process Level Performance Monitoring

    -

    PCP provides details of each running process via the standard PCP interfaces and tools on the localhost but due to security and performance considerations, most of the process related information is not stored in archive logs by default. +

    PCP provides details of each running process via the standard PCP interfaces and tools on the localhost but due to security and performance considerations, most of the process related information is not stored in archive logs by default. Also for security reasons, only root can access some details of running processes of other users.

    Custom application instrumentation is possible with the Memory Mapped Value (MMV) PMDA. @@ -397,7 +398,7 @@ Monitor the number of open file descriptors of the process 1234:


        -Import sar data from an existing sar archive to a new PCP archive and visualize it (sar logs are under /var/log/sysstat on Debian/Ubuntu):
    +Import sar data from an existing sar archive to a new PCP archive and visualize it (sar logs are under /var/log/sysstat on Debian/Ubuntu):

    $ sar2pcp /var/log/sa/sa15 sar.pcp
    $ pmchart -t 2sec -a sar.pcp

        -Monitor the CPU time, memory usage (RSS), and the number of threads of the process 1234 (-h local: is a workaround needed for the time being):
    +Monitor the CPU time, memory usage (RSS), and the number of threads of the process 1234 (-h local: is a workaround needed for the time being):

    $ pmdumptext -h local: -t 2sec 'proc.psinfo.utime[1234]' 'proc.memory.rss[1234]' 'proc.psinfo.threads[1234]'
    @@ -416,6 +417,21 @@ Display the number of running processes on 2014-08-20 14:00:
    + +

    Monitoring “Hot†Processes with Hotproc

    + +

    It is also possible to monitor “hot†or “interesting†processes by name with PCP 3.10.5 or later, for example all processes of which command name is java or python. This monitoring of “hot†processes can also be enabled or disabled based on certain criterias or from the command line on the fly. The metrics will be available under the namespace hotproc. +

    Configuring processes to be monitored contantly using the hotproc namespace can be done using the configuration file /var/lib/pcp/pmdas/proc/hotproc.conf - see the pmdaproc(1) manual page for details. This allows monitoring these processes regardless of their PIDs and also logging the metrics easily. + + + +

        +Enable monitoring of all Java instances on the fly and display all the collected metrics:
    +
    # pmstore hotproc.control.config 'fname == "java"' +
    # pminfo -f hotproc +
    + +

    Application Instrumentation

    @@ -443,7 +459,7 @@ Display the number of running processes on 2014-08-20 14:00:
    -

    To enable the monitoring host to run PMIE for collector hosts, add each host to the /etc/pcp/pmie/control configuration file. +

    To enable the monitoring host to run PMIE for collector hosts, add each host to the /etc/pcp/pmie/control configuration file.

       Enable monitoring of metrics from remote host acme.com: @@ -506,12 +522,12 @@ This example shows a PMIE script, checks its syntax, runs it against an archive,

    PCP PMDAs offer a way for administrators and developers to customize and extend the default PCP installation. The pcp-libs-devel package contains all the needed development related examples, headers, and libraries. New PMDAs can easily be added, below is a quick list of references for starting development:

      -
    • Some examples exist below /var/lib/pcp/pmdas/ - the simple, sample, and txmon PMDAs are easy to read PMDAs. +
    • Some examples exist below /var/lib/pcp/pmdas/ - the simple, sample, and txmon PMDAs are easy to read PMDAs.
      • The simple PMDA provides implementations in C, Perl and Python.
      • -
    • A simple command line monitor tool is /usr/share/pcp/demos/pmclient (C language).
      • -
    • Good initial Python monitor examples are /usr/libexec/pcp/bin/pcp/pcp-* (Fedora/RHEL) or /usr/lib/pcp/bin/pcp-* (Debian/Ubuntu). +
    • A simple command line monitor tool is /usr/share/pcp/demos/pmclient (C language).
      • +
    • Good initial Python monitor examples are /usr/libexec/pcp/bin/pcp/pcp-* (Fedora/RHEL) or /usr/lib/pcp/bin/pcp-* (Debian/Ubuntu).
      • Slightly more complex examples are the pmiostat, pmatop, pmcollectl commands.
      • -- 1.7.1 --------------030108040205030302010204-- From lberk@redhat.com Wed Apr 29 12:23:09 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 81EF07F37 for ; Wed, 29 Apr 2015 12:23:09 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 751CF8F8050 for ; Wed, 29 Apr 2015 10:23:06 -0700 (PDT) X-ASG-Debug-ID: 1430328184-04cb6c1cc74589d0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id yarkHQHePyPYDdV4 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 29 Apr 2015 10:23:05 -0700 (PDT) X-Barracuda-Envelope-From: lberk@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3THN4XL015166 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 29 Apr 2015 13:23:04 -0400 Received: from toium (unused-10-15-17-202.yyz.redhat.com [10.15.17.202]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3THN3rJ009094 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 29 Apr 2015 13:23:04 -0400 From: Lukas Berk To: Nathan Scott Cc: pcp@oss.sgi.com Subject: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint References: <87bnk0wzn5.fsf@redhat.com> <877ft59dmo.fsf@redhat.com> <1344838118.4507317.1429675359315.JavaMail.zimbra@redhat.com> <87pp6n7u7g.fsf@redhat.com> <2089951493.8763144.1430262734221.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint Date: Wed, 29 Apr 2015 13:23:03 -0400 In-Reply-To: <2089951493.8763144.1430262734221.JavaMail.zimbra@redhat.com> (Nathan Scott's message of "Tue, 28 Apr 2015 19:12:14 -0400 (EDT)") Message-ID: <87wq0uj1c8.fsf@redhat.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430328185 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hey, Nathan Scott writes: >> I've been toying with this idea a bit, and ended going with the two >> packages (pcp-collection and pcp-monitor, respectively). If one is > Could we use the term "collector" rather than "collection"? See e.g. > PCPIntro(1) - 3rd and 4th paragraphs there - that terminology is used > fairly extensively throughout the Users+Admins Guide book as well. Ah, I mistyped that, it is already pcp-collector (not collection). >> interested in installing every pcp package, wildcarding "pcp-*" will >> work. > Neat - always the exceptions to the rule though I guess, with python* & > perl* module package naming conventions. Yes, but those should get pulled in via package dependencies anyways, no? At least with the pcp-pmda* packages I've create, they require the proper perl/python pmda bindings. Cheers, Lukas From fche@redhat.com Wed Apr 29 13:12:07 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 75C4D7F37 for ; Wed, 29 Apr 2015 13:12:07 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 5A35A304043 for ; Wed, 29 Apr 2015 11:12:04 -0700 (PDT) X-ASG-Debug-ID: 1430331123-04cb6c1cc745a360001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id oGwePsfHF8qxOcZc (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 29 Apr 2015 11:12:03 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (Postfix) with ESMTPS id CC77C8F01E for ; Wed, 29 Apr 2015 18:12:02 +0000 (UTC) Received: from fche.csb (vpn-224-222.phx2.redhat.com [10.3.224.222]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3TIC26X013735; Wed, 29 Apr 2015 14:12:02 -0400 Received: by fche.csb (Postfix, from userid 2569) id 352E95852C; Wed, 29 Apr 2015 14:12:01 -0400 (EDT) Date: Wed, 29 Apr 2015 14:12:01 -0400 From: "Frank Ch. Eigler" To: Nathan Scott Cc: pcp@oss.sgi.com Subject: Re: pcp updates: pmmgr, pmwebd Message-ID: <20150429181201.GC9319@redhat.com> X-ASG-Orig-Subj: Re: pcp updates: pmmgr, pmwebd References: <20150421224405.GN6822@redhat.com> <5536E65F.50600@redhat.com> <20150422000949.GP6822@redhat.com> <553F4BA8.5000001@redhat.com> <972777481.8759612.1430260957858.JavaMail.zimbra@redhat.com> <1700718526.8836180.1430276326941.JavaMail.zimbra@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1700718526.8836180.1430276326941.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.4.2.2i X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430331123 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Hi - > [...] If you could look into the pmie problem [...] OK. - FChE From wwwrun@oss.sgi.com Wed Apr 29 13:25:53 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 916F77F54; Wed, 29 Apr 2015 13:25:53 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1067] linux pmda does too much work for network.interface queries Date: Wed, 29 Apr 2015 18:25:52 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: michele@acksyn.org X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: attachments.isobsolete Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1430331953.ADec46d05.21575"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1430331953.ADec46d05.21575 Date: Wed, 29 Apr 2015 13:25:53 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1067 Michele Baldessari changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #328 is|0 |1 obsolete| | --- Comment #11 from Michele Baldessari --- Created attachment 330 --> http://oss.sgi.com/bugzilla/attachment.cgi?id=330&action=edit V2 of the patch Hi Carlos, can you try this patch and report back? I've fixed the segfault and another bug around the 'running' metric (due to the fact that it turns out that /sys/net/class/.../flags != flags returned by SIOCGIFFLAGS) Thanks and regards, Michele -- You are receiving this mail because: You are on the CC list for the bug. --1430331953.ADec46d05.21575 Date: Wed, 29 Apr 2015 13:25:53 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" changed bug 1067
      What Removed Added
      Attachment #328 is obsolete   1

      Comment # 11 on bug 1067 from 
      Created attachment 330 [details]
V2 of the patch

Hi Carlos,

can you try this patch and report back? I've fixed the segfault and 
another bug around the 'running' metric (due to the fact that it turns out that
/sys/net/class/.../flags != flags returned by SIOCGIFFLAGS)

Thanks and regards,
Michele

      You are receiving this mail because:
      • You are on the CC list for the bug.
      --1430331953.ADec46d05.21575-- From minnus@buffalo.edu Wed Apr 29 13:54:33 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 104967F37 for ; Wed, 29 Apr 2015 13:54:33 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 03F02304043 for ; Wed, 29 Apr 2015 11:54:32 -0700 (PDT) X-ASG-Debug-ID: 1430333670-04cbb056b44a9fe0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve3.acsu.buffalo.edu [128.205.7.163]) by cuda.sgi.com with ESMTP id Uo4Sttyq4DWU3EUU for ; Wed, 29 Apr 2015 11:54:30 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.163 Received: from localmailB.acsu.buffalo.edu (localmailb.acsu.buffalo.edu [128.205.5.200]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 458A33F29; Wed, 29 Apr 2015 14:54:05 -0400 (EDT) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 4061DD19D; Wed, 29 Apr 2015 14:54:05 -0400 (EDT) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailB.acsu.buffalo.edu (Postfix) with ESMTP id 1B166D18B; Wed, 29 Apr 2015 14:54:04 -0400 (EDT) Received: from smtp.buffalo.edu (smtp2.acsu.buffalo.edu [128.205.5.254]) by localmailB.acsu.buffalo.edu (Prefixe) with ESMTP id EE1BFD188; Wed, 29 Apr 2015 14:54:03 -0400 (EDT) Received: from [128.205.40.46] (slash.ccr.buffalo.edu [128.205.40.46]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id CC3E638D18; Wed, 29 Apr 2015 14:54:03 -0400 (EDT) Message-ID: <554128C1.8080901@buffalo.edu> Date: Wed, 29 Apr 2015 14:53:53 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Nathan Scott CC: myllynen@redhat.com, pcp@oss.sgi.com Subject: Re: [pcp] Hotproc fixes References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> <233739221.5258413.1429764654377.JavaMail.zimbra@redhat.com> <55392BAB.3060101@buffalo.edu> <806884984.5885784.1429839438565.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes In-Reply-To: <806884984.5885784.1429839438565.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve3.acsu.buffalo.edu[128.205.7.163] X-Barracuda-Start-Time: 1430333670 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18467 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Nathan, On 4/23/2015 9:37 PM, Nathan Scott wrote: > I've updated the QA a little in my tree (please review), then found another > small issue I think, in the store handler, where it ignores an empty string. > > I had expected to be able to use that to switch off the monitoring - is that > not right? > > $ sudo pmstore hotproc.control.config "" > hotproc.control.config old value="(fname == "pmdaproc")" new value="" > $ sudo pmstore hotproc.control.config "" > hotproc.control.config old value="(fname == "pmdaproc")" new value="" > $ sudo pmstore hotproc.control.config "" > hotproc.control.config old value="(fname == "pmdaproc")" new value="" > > This should be all done here: https://github.com/ubccr/pcp/tree/hotproc_cleanups Also included some other cleanup suggestions from Marko, the ability to reload the config file, updated qa hopefully for all the changes, merged the manpage into procpmda, and added a new error code. Feel free to drop that last one if you think its unnecessary. It should be its own commit. Also, my lex/yacc knowledge is pretty basic so let me know if those changes should be done differently. Martins commit 4cef14619b682c91f982b103e4751416e354e3d1 Author: Martins Innus Date: Wed Apr 29 18:46:09 2015 +0000 hotproc - add a new error code for malformed pmstore input qa/006.out | 2 +- qa/982.out | 2 +- src/include/pcp/pmapi.h | 1 + src/libpcp/src/err.c | 2 ++ src/pmdas/linux_proc/pmda.c | 2 +- 5 files changed, 6 insertions(+), 3 deletions(-) commit e20343ea9ae4dc228d3250a9019c08fb60ddbffc Author: Martins Innus Date: Wed Apr 29 17:39:03 2015 +0000 hotproc - update the pmdaproc manpage with hotproc information src/pmdas/linux_proc/pmdaproc.1 | 163 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 163 insertions(+) commit 6dcab33eed485c0f534c7b52700664b82520b250 Author: Martins Innus Date: Wed Apr 29 17:29:30 2015 +0000 hotproc - Allow config file reload By using: pmstore hotproc.control.reload_config "1" the config file can be forced to be reloaded. Also cleaned up some duplicated code. src/pmdas/linux_proc/hotproc.h | 1 + src/pmdas/linux_proc/pmda.c | 13 +++++++++++++ src/pmdas/linux_proc/pmdahotproc.1 | 3 +++ src/pmdas/linux_proc/proc_pid.c | 13 +++++++------ src/pmdas/linux_proc/root_proc | 1 + 5 files changed, 25 insertions(+), 6 deletions(-) commit a00be8d350ab4eac1ce900dcbf2e737a0d79e4a3 Author: Martins Innus Date: Wed Apr 29 16:46:57 2015 +0000 hotproc - disallow hotproc.conf with global write mode src/pmdas/linux_proc/config.c | 10 ++++++++++ 1 file changed, 10 insertions(+) commit c61371d39aec7e4d3df3d4bf03ba5d1879bf3b44 Author: Martins Innus Date: Wed Apr 29 16:32:55 2015 +0000 hotproc - update qa for recent config changes Test hotproc disable and bad input qa/982 | 5 +++++ qa/982.out | 6 ++++++ 2 files changed, 11 insertions(+) commit 288421ef56a8402aab0a2f0e7d033720443ed7dd Author: Martins Innus Date: Wed Apr 29 15:30:04 2015 +0000 hotproc - support disabling via pmstore Support: pmstore hotproc.control.config "" to disable hotproc. Also, some comments and other cleanups src/pmdas/linux_proc/config.c | 20 ++++++++++++++------ src/pmdas/linux_proc/error.c | 6 +++--- src/pmdas/linux_proc/gram.y | 12 ++++++++---- src/pmdas/linux_proc/hotproc.c | 2 +- src/pmdas/linux_proc/lex.l | 8 +++++++- src/pmdas/linux_proc/pmda.c | 10 +++++++++- src/pmdas/linux_proc/proc_pid.c | 10 ++++++++++ src/pmdas/linux_proc/proc_pid.h | 12 ++++++++++-- 8 files changed, 62 insertions(+), 18 deletions(-) From minnus@buffalo.edu Wed Apr 29 13:55:32 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id F00437F37 for ; Wed, 29 Apr 2015 13:55:32 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id D65A58F8050 for ; Wed, 29 Apr 2015 11:55:32 -0700 (PDT) X-ASG-Debug-ID: 1430333726-04bdf063214b42c0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve3.acsu.buffalo.edu [128.205.7.163]) by cuda.sgi.com with ESMTP id iAEBGlYuU3r92ZEn for ; Wed, 29 Apr 2015 11:55:26 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.163 Received: from localmailB.acsu.buffalo.edu (localmailb.acsu.buffalo.edu [128.205.5.200]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 131963FA7 for ; Wed, 29 Apr 2015 14:55:26 -0400 (EDT) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 0F0B5D24E for ; Wed, 29 Apr 2015 14:55:26 -0400 (EDT) Received: from localmailB.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailB.acsu.buffalo.edu (Postfix) with ESMTP id 821E0D249 for ; Wed, 29 Apr 2015 14:55:25 -0400 (EDT) Received: from smtp.buffalo.edu (smtp4.acsu.buffalo.edu [128.205.5.229]) by localmailB.acsu.buffalo.edu (Prefixe) with ESMTP id 57A8DD247 for ; Wed, 29 Apr 2015 14:55:25 -0400 (EDT) Received: from [128.205.40.46] (slash.ccr.buffalo.edu [128.205.40.46]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 52335C273D for ; Wed, 29 Apr 2015 14:55:25 -0400 (EDT) Message-ID: <55412913.4080603@buffalo.edu> Date: Wed, 29 Apr 2015 14:55:15 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp developers Subject: POSIX version Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: POSIX version Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve3.acsu.buffalo.edu[128.205.7.163] X-Barracuda-Start-Time: 1430333726 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18467 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Hi, I looked throughout the source and couldn't find this anywhere. Is there a rough POSIX version that PCP tries to adhere to? I'd love to use open_memstream in my hotproc cleanups: http://linux.die.net/man/3/open_memstream It would simplify the config parsing logic, but it's part of POSIX.1-2008. This would be in linux_proc, so would only affect Linux, but then would make the procpmda depend on this functionality. In the interest of not losing support for older systems that currently work, I assume this would break too many older builds, but figured I'd check anyway. I can't find a reference on where this would not be supported. Alternatively, any thoughts on pulling such functionality into the pcp codebase? If not, no worries, just would be a handy thing to have available. Thanks Martins From fche@redhat.com Wed Apr 29 15:27:43 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 2FBBB7F37 for ; Wed, 29 Apr 2015 15:27:43 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 183D78F8039 for ; Wed, 29 Apr 2015 13:27:39 -0700 (PDT) X-ASG-Debug-ID: 1430339258-04bdf063204b72c0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id 0qsrwo0hQMZZQPHB (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 29 Apr 2015 13:27:39 -0700 (PDT) X-Barracuda-Envelope-From: fche@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (Postfix) with ESMTPS id B16A78EB42; Wed, 29 Apr 2015 20:27:38 +0000 (UTC) Received: from fche.csb (vpn-224-222.phx2.redhat.com [10.3.224.222]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3TKRc8c026549; Wed, 29 Apr 2015 16:27:38 -0400 Received: by fche.csb (Postfix, from userid 2569) id 023BE5852D; Wed, 29 Apr 2015 16:27:36 -0400 (EDT) To: Ken McDonell Cc: pcp@oss.sgi.com Subject: Re: [RFC] Minimizing Installation Size for Reduced PCP Footprint References: <87bnk0wzn5.fsf@redhat.com> <877ft59dmo.fsf@redhat.com> <1344838118.4507317.1429675359315.JavaMail.zimbra@redhat.com> <87pp6n7u7g.fsf@redhat.com> <55401179.90601@internode.on.net> X-ASG-Orig-Subj: Re: [RFC] Minimizing Installation Size for Reduced PCP Footprint From: fche@redhat.com (Frank Ch. Eigler) Date: Wed, 29 Apr 2015 16:27:36 -0400 In-Reply-To: <55401179.90601@internode.on.net> (Ken McDonell's message of "Wed, 29 Apr 2015 09:02:17 +1000") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430339259 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 kenj wrote: > [...] All the best ideas survive ... just checked and PCP 1.0 > released in 1995 contained the packages (for IRIX): pcp_server (now > apparently pcp-collection), pcp_client (now apparently pcp-monitor) > and pcp_share (common stuff like libpcp). FWIW the 'server' and 'client' nomenclature seems clearer to me. How about using 'pcp-collector-server' and 'pcp-monitor-clients' in the rpm names? Redundant but informative. - FChE From kenj@internode.on.net Wed Apr 29 15:38:08 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 099587F37 for ; Wed, 29 Apr 2015 15:38:08 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id C8C22304048 for ; Wed, 29 Apr 2015 13:38:04 -0700 (PDT) X-ASG-Debug-ID: 1430339882-04bdf063224b7740001-S8gJnT Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by cuda.sgi.com with ESMTP id uTWCDQMqdW1uAcVg for ; Wed, 29 Apr 2015 13:38:02 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.129 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2AGAgBhP0FVPKEh0XYNT4NfXcdbhgQCghEBAQEBAQEHAQEBAUGEYAEBBDhAEQsYCRYPCQMCAQIBMRQTCAEBiDSzQZRYAQEIAgEfiziFDBaEFwWVc4gflBiBA4EFgiGDIgEBAQ Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail06.adl2.internode.on.net with ESMTP; 30 Apr 2015 06:08:01 +0930 Message-ID: <55414129.4090000@internode.on.net> Date: Thu, 30 Apr 2015 06:38:01 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] POSIX version References: <55412913.4080603@buffalo.edu> X-ASG-Orig-Subj: Re: [pcp] POSIX version In-Reply-To: <55412913.4080603@buffalo.edu> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail06.adl2.internode.on.net[150.101.137.129] X-Barracuda-Start-Time: 1430339882 X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18470 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- On 30/04/15 04:55, Martins Innus wrote: > Hi, > > I looked throughout the source and couldn't find this anywhere. Is > there a rough POSIX version that PCP tries to adhere to? I'd love to use > open_memstream in my hotproc cleanups: > > http://linux.die.net/man/3/open_memstream > > It would simplify the config parsing logic, but it's part of > POSIX.1-2008. This would be in linux_proc, so would only affect Linux, > but then would make the procpmda depend on this functionality. > > In the interest of not losing support for older systems that > currently work, I assume this would break too many older builds, but > figured I'd check anyway. I can't find a reference on where this would > not be supported. > > Alternatively, any thoughts on pulling such functionality into the > pcp codebase? > > If not, no worries, just would be a handy thing to have available. We don't really have a formal position on a POSIX version that the code is expected to comply with, other than the (old) -D_GNU_SOURCE in the build which sort of means we can never be POSIX compliant (sigh). This is in part because the POSIX story is confusing across all the platforms we're trying to support, or at least was so at points of time over the last 20+ years. Rather we've gone down the path of isolating source code that is not necessarily portable across all the platforms using HAVE_FOO macros ... in this case it would be HAVE_OPEN_MEMSTREAM. This works fine in cases where the feature provides isolated functionality and the #else path can either do nothing or return a relevant error such as PM_ERR_APPVERSION. But in this case I think you'd either have to (a) assert that open_memstream() is available on any Linux platform where PCP is expected to compile and just do it, or (b) keep the existing implementation for the #else part and use open_memstream() for an alternative (new and default) implementation behind the #ifdef HAVE_OPEN_MEMSTREAM (b) does not make much sense in terms of simplifying the code (just the opposite!), so I think it is a value call on (a) ... I've never used open_memstream() so I can't offer any advice I'm afraid. From wwwrun@oss.sgi.com Wed Apr 29 16:14:00 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 3EF557F54; Wed, 29 Apr 2015 16:14:00 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1067] linux pmda does too much work for network.interface queries Date: Wed, 29 Apr 2015 21:14:00 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: cltorrespr@gmail.com X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1430342040.c812D5.28138"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1430342040.c812D5.28138 Date: Wed, 29 Apr 2015 16:14:00 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1067 --- Comment #12 from Carlos L. Torres --- Created attachment 331 --> http://oss.sgi.com/bugzilla/attachment.cgi?id=331&action=edit strace output with patch Now it is working and is not segfaulting any more. But in terms of performance, there was no improvement. Attached you'll find the strace output with the new patch, and the request for these metrics network.interface.in.bytes, network.interface.out.bytes, network.interface.in.packets, network.interface.out.packets. The total request/response took over 4 seconds. There are some instances where ioctl(8, SIOCETHTOOL, 0x...) syscalls are taking a little over 1 second. -- You are receiving this mail because: You are on the CC list for the bug. --1430342040.c812D5.28138 Date: Wed, 29 Apr 2015 16:14:00 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8"

      Comment # 12 on bug 1067 from 
      Created attachment 331 [details]
strace output with patch

Now it is working and is not segfaulting any more. But in terms of performance,
there was no improvement.

Attached you'll find the strace output with the new patch, and the request for
these metrics network.interface.in.bytes, network.interface.out.bytes,
network.interface.in.packets, network.interface.out.packets. 

The total request/response took over 4 seconds. There are some instances where
ioctl(8, SIOCETHTOOL, 0x...) syscalls are taking a little over 1 second.

      You are receiving this mail because:
      • You are on the CC list for the bug.
      --1430342040.c812D5.28138-- From mgoodwin@redhat.com Wed Apr 29 20:04:48 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 2CBC97F37 for ; Wed, 29 Apr 2015 20:04:48 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 91A69AC002 for ; Wed, 29 Apr 2015 18:04:44 -0700 (PDT) X-ASG-Debug-ID: 1430355882-04cbb056b44b21c0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id XGvVueD2qWGSthrm (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 29 Apr 2015 18:04:43 -0700 (PDT) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (Postfix) with ESMTPS id 670C82BB382 for ; Thu, 30 Apr 2015 01:04:42 +0000 (UTC) Received: from [10.64.176.189] (dhcp-176-189.mel.redhat.com [10.64.176.189]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3U14ebH025376 for ; Wed, 29 Apr 2015 21:04:41 -0400 Message-ID: <55417FA8.8020307@redhat.com> Date: Thu, 30 Apr 2015 11:04:40 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp Subject: pcp updates: merge nathans (pmdaproc,qa) + Lukas (postfix) + Martins (hotproc) Content-Type: text/plain; charset=windows-1252; format=flowed X-ASG-Orig-Subj: pcp updates: merge nathans (pmdaproc,qa) + Lukas (postfix) + Martins (hotproc) Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430355883 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Changes committed to git://git.pcp.io/pcp.git master Nathan Scott (7): pmdaproc: additional proc memory, namespace and memory cgroup metrics qa: tests exercising new pmdaproc metrics (vm, namespace) qa: update dmcache/dmthin/pmdadm in common QA filters qa: remove debug archive extraction from 787 pmdaproc: add help text for new cgroup mem metrics qa: add new qa test 805 for exercising pmdapostfix fixes qa: deterministic output for 805 via sorted metrics list Lukas Berk (1): Force restart for postfix pmda installation Martins Innus (1): hotproc - add guards for missing ioentry qa/022.out.linux | 9 qa/359 | 1 qa/730.out | 66 + qa/731.out | 15 qa/787 | 4 qa/805 | 85 + qa/805.out | 125 +- qa/943.out | 10 qa/974 | 68 + qa/974.out | 2149 +++++++++++++++++++++++++++++++++++ qa/common.filter | 4 qa/group | 3 qa/linux/mk.procpid | 22 qa/linux/procpid-2.6.32-root-001.tgz |binary qa/linux/procpid-3.19.0-root-002.tgz |binary qa/linux/procpid-3.2.0-root-003.tgz |binary src/pmdas/linux_proc/cgroups.c | 6 src/pmdas/linux_proc/cgroups.h | 7 src/pmdas/linux_proc/help | 4 src/pmdas/linux_proc/help_text.h | 9 src/pmdas/linux_proc/pmda.c | 238 +++ src/pmdas/linux_proc/proc_dynamic.c | 31 src/pmdas/linux_proc/proc_pid.c | 63 - src/pmdas/linux_proc/proc_pid.h | 99 - src/pmdas/linux_proc/root_proc | 5 src/pmdas/postfix/Install | 2 26 files changed, 2918 insertions(+), 107 deletions(-) Details ... commit d66e77e130ef664523502a01673979010bcc530f Author: Nathan Scott Date: Wed Apr 29 17:07:55 2015 +1000 qa: deterministic output for 805 via sorted metrics list commit 611fbcb29eb166f4e059e2e2fd9f0bc169eb147b Author: Lukas Berk Date: Tue Apr 28 09:58:56 2015 -0400 Force restart for postfix pmda installation The postfix pmda requires being installed by root to change the gid to postfix. Switch the required option in the Install script. commit 79947e01f8a50c108731a94b98aab2bccc3d42e4 Author: Nathan Scott Date: Wed Apr 29 14:12:10 2015 +1000 qa: add new qa test 805 for exercising pmdapostfix fixes commit 4580c4969ac2fd71997c9aeafe665c06f8b5482f Author: Nathan Scott Date: Wed Apr 29 12:04:08 2015 +1000 pmdaproc: add help text for new cgroup mem metrics commit b3f1be5fc33a95dd3c446278ad8d7641ec12531b Author: Nathan Scott Date: Wed Apr 29 11:43:41 2015 +1000 qa: remove debug archive extraction from 787 Failing for me with ... $ diff 787.out* 1027a1028 > rm: cannot remove ‘/tmp/convert.*’: No such file or directory looks like some leftover debugging there; commented out now. commit 1bdb023615cac803d52606f8d9ca46b7ea58641e Author: Nathan Scott Date: Tue Apr 28 17:58:34 2015 +1000 qa: update dmcache/dmthin/pmdadm in common QA filters commit bbbeab4cb3396a30a667c576ce38fc8928edda66 Author: Nathan Scott Date: Tue Apr 28 17:58:00 2015 +1000 qa: tests exercising new pmdaproc metrics (vm, namespace) commit 5a748f02750e26edba45990384fa5b5f3f940268 Author: Martins Innus Date: Fri Apr 24 14:44:15 2015 +0000 hotproc - add guards for missing ioentry commit 80bd02cddf66e1d43832d30fe9344b408b6311ca Author: Nathan Scott Date: Fri Apr 24 17:10:00 2015 +1000 pmdaproc: additional proc memory, namespace and memory cgroup metrics From nscott@redhat.com Wed Apr 29 22:12:05 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 4DE887F37 for ; Wed, 29 Apr 2015 22:12:05 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 2FB468F8054 for ; Wed, 29 Apr 2015 20:12:02 -0700 (PDT) X-ASG-Debug-ID: 1430363520-04bdf063224bedd0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id FbsGdXkpGFhoT72o (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 29 Apr 2015 20:12:00 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3U3BtNr007934; Wed, 29 Apr 2015 23:11:55 -0400 Date: Wed, 29 Apr 2015 23:11:55 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus , Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <102929865.10042134.1430363515688.JavaMail.zimbra@redhat.com> In-Reply-To: <554128C1.8080901@buffalo.edu> References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> <233739221.5258413.1429764654377.JavaMail.zimbra@redhat.com> <55392BAB.3060101@buffalo.edu> <806884984.5885784.1429839438565.JavaMail.zimbra@redhat.com> <554128C1.8080901@buffalo.edu> Subject: Re: [pcp] Hotproc fixes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.85] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: Hotproc fixes Thread-Index: hFpkRc7c8BUXWs0W9qERw/sM+P7DFg== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1430363520 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18479 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > [...] > This should be all done here: > > https://github.com/ubccr/pcp/tree/hotproc_cleanups Looks good to me. > Also included some other cleanup suggestions from Marko, the ability to > reload the config file, updated qa hopefully for all the changes, merged > the manpage into procpmda, and added a new error code. Feel free to > drop that last one if you think its unnecessary. It should be its own > commit. > I've left that last one for now - needs a bit more discussion I guess, as an ABI extension. I like it though. We should probably audit the three/ four other PMDAs that already use PM_ERR_CONV and switch 'em over. Ken - any other thoughts on a specific error code for bad pmStore to a PMDA? (Oh, maybe the name PM_ERR_BADSTORE to match your error message more closely Martins? the "FMT" part I found a little bit cryptic) cheers. -- Nathan From nscott@redhat.com Wed Apr 29 22:12:34 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 38EED7F37 for ; Wed, 29 Apr 2015 22:12:34 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id 079E78F8050 for ; Wed, 29 Apr 2015 20:12:33 -0700 (PDT) X-ASG-Debug-ID: 1430363551-04bdf063234bee00001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id Skl1xQ5aTgU9ouk8 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 29 Apr 2015 20:12:31 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3U3CVx7008242 for ; Wed, 29 Apr 2015 23:12:31 -0400 Date: Wed, 29 Apr 2015 23:12:31 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: pcp developers Message-ID: <1350751880.10042834.1430363551619.JavaMail.zimbra@redhat.com> In-Reply-To: <1606331413.10036123.1430363158324.JavaMail.zimbra@redhat.com> Subject: pcp updates: webd, hotproc, docs MIME-Version: 1.0 X-ASG-Orig-Subj: pcp updates: webd, hotproc, docs Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.85] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: pcp updates: webd, hotproc, docs Thread-Index: 9kKIrpG8jNrHJUY4FDuDNkwtMfm4eA== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1430363551 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18479 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Changes committed to git://git.pcp.io/nathans/pcp.git master Frank Ch. Eigler (7): pmwebd: add a "-i MIN-INTERVAL" option for graphite time-precision control pmwebd: fix little memory leak for fts() during interrupted rendering pmwebd: handle exit_p requested during graphite data-mass gathering pmwebd crasher fix: png-rendered multiple graphs with corrupt archives PR1099 (compressed archive) mitigation in pmwebd: skip them in graphite mode pmwebd graphite-png rendering: tweak graphics pmwebd: add -I option for opening directories-as-archives for graphite Martins Innus (6): hotproc - support disabling via pmstore hotproc - update qa for recent config changes hotproc - disallow hotproc.conf with global write mode hotproc - Allow config file reload hotproc - update the pmdaproc manpage with hotproc information hotproc - add a new error code for malformed pmstore input Nathan Scott (2): Revert "hotproc - add a new error code for malformed pmstore input" for now docs: update pmdaproc.1 man page a little, drop pmdahotproc.1 Marko Myllynen (1): docs: describe hotproc in the quick reference guide man/html/guide.html | 50 - man/man1/pmwebd.1 | 20 man/man3/pmwebapi.3 | 4 qa/006.out | 4 qa/661 | 34 qa/661.out | 1311 ++++++++++++++++++++++++++++- qa/982 | 5 qa/982.out | 10 qa/archives/archive-20150417.131733.0 |binary qa/archives/archive-20150417.131733.index |binary qa/archives/archive-20150417.131733.meta |binary qa/archives/archive-goodred-20150417.0 |binary qa/archives/archive-goodred-20150417.index |binary qa/archives/archive-goodred-20150417.meta |binary src/include/pcp/pmapi.h | 2 src/libpcp/src/err.c | 4 src/pmdas/linux_proc/config.c | 30 src/pmdas/linux_proc/error.c | 6 src/pmdas/linux_proc/gram.y | 12 src/pmdas/linux_proc/hotproc.c | 2 src/pmdas/linux_proc/hotproc.h | 1 src/pmdas/linux_proc/lex.l | 8 src/pmdas/linux_proc/pmda.c | 27 src/pmdas/linux_proc/pmdahotproc.1 | 187 ---- src/pmdas/linux_proc/pmdaproc.1 | 230 ++++- src/pmdas/linux_proc/proc_pid.c | 23 src/pmdas/linux_proc/proc_pid.h | 12 src/pmdas/linux_proc/root_proc | 1 src/pmwebapi/main.cxx | 31 src/pmwebapi/pmgraphite.cxx | 149 ++- src/pmwebapi/pmwebapi.h | 5 src/pmwebapi/pmwebd.options | 5 32 files changed, 1794 insertions(+), 379 deletions(-) commit 613f296cfd915cb119fb57ad287730f2d9967c28 Author: Nathan Scott Date: Thu Apr 30 12:17:02 2015 +1000 docs: update pmdaproc.1 man page a little, drop pmdahotproc.1 commit 4803ede912410cc6bd4e8ddb995e6b74fb392bd1 Author: Marko Myllynen Date: Thu Apr 30 11:47:05 2015 +1000 docs: describe hotproc in the quick reference guide commit 2cb86d5135876ec2eb721c9fb78a60636d472a97 Author: Nathan Scott Date: Thu Apr 30 10:19:13 2015 +1000 Revert "hotproc - add a new error code for malformed pmstore input" for now This reverts commit 4cef14619b682c91f982b103e4751416e354e3d1. commit 4cef14619b682c91f982b103e4751416e354e3d1 Author: Martins Innus Date: Wed Apr 29 18:46:09 2015 +0000 hotproc - add a new error code for malformed pmstore input commit e20343ea9ae4dc228d3250a9019c08fb60ddbffc Author: Martins Innus Date: Wed Apr 29 17:39:03 2015 +0000 hotproc - update the pmdaproc manpage with hotproc information commit 6dcab33eed485c0f534c7b52700664b82520b250 Author: Martins Innus Date: Wed Apr 29 17:29:30 2015 +0000 hotproc - Allow config file reload By using: pmstore hotproc.control.reload_config "1" the config file can be forced to be reloaded. Also cleaned up some duplicated code. commit a00be8d350ab4eac1ce900dcbf2e737a0d79e4a3 Author: Martins Innus Date: Wed Apr 29 16:46:57 2015 +0000 hotproc - disallow hotproc.conf with global write mode commit c61371d39aec7e4d3df3d4bf03ba5d1879bf3b44 Author: Martins Innus Date: Wed Apr 29 16:32:55 2015 +0000 hotproc - update qa for recent config changes Test hotproc disable and bad input commit 288421ef56a8402aab0a2f0e7d033720443ed7dd Author: Martins Innus Date: Wed Apr 29 15:30:04 2015 +0000 hotproc - support disabling via pmstore Support: pmstore hotproc.control.config "" to disable hotproc. Also, some comments and other cleanups commit 53d34c3d7102043b66dd337a8a8fe89cd55b3518 Author: Frank Ch. Eigler Date: Thu Apr 23 18:34:00 2015 -0400 pmwebd: add -I option for opening directories-as-archives for graphite This facility allows pmwebd to present to graphite-api clients such as the graphite and grafana webapps a more compact metric-name for the canonical sort of pmlogger directory layout, wherein each directory that contains archives are all from the same host. The moment pmNewContext (PM_CONTEXT_ARCHIVE, "/path/to/directory") facility comes online, this option will let pmwebd exploit it. The effect will be to go from having a gajillion: [...] pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150131-2E-110904-2E-meta.kernel.all.nprocs pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150131-2E-110904-2E-meta.kernel.all.nprocs pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150131-2E-110904-2E-meta.kernel.all.nprocs pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150201-2E-110705-2E-meta.kernel.all.nprocs [...] items to a single: pmmgr-2F-easy-2E-elastic-2E-org.kernel.all.nprocs Documentation is included. Hand-QA'd via gdb (to check that pmNewContext was being properly called on directories too). The code is harmless to current libpcp users, even if the non-default -I flag were turned on; updated QA asserts this. (qa/661.out may vary once the new pmNewContext facility comes online.) commit a0039e8dbd2f6ed6ba3964c06a270fec05fd084b Author: Frank Ch. Eigler Date: Tue Apr 21 21:16:01 2015 -0400 pmwebd graphite-png rendering: tweak graphics Make the rendered legend-text normal rather than too-wide, and reduce the maximum fraction of the legend (50% to 40% of the vertical space). It looks a little nicer in the grafana default-png.json dashboard. commit 738ccc07e942d295ec516814e7b52f9c910555d8 Author: Frank Ch. Eigler Date: Tue Apr 21 18:12:59 2015 -0400 PR1099 (compressed archive) mitigation in pmwebd: skip them in graphite mode As per PR1099, pmwebd graphite mode searches deeply conflict with compressed mode archives, because these cost a lot of time to individually decompress (and perhaps many times repeatedly). A new heuristic in pmgraphite_enumerate_metrics() rejects them. QA included (+ regenerated qa/661.out). commit d6ce75729a11a445f1a56091c604a5ca4eee7f41 Author: Frank Ch. Eigler Date: Tue Apr 21 10:35:21 2015 -0400 pmwebd crasher fix: png-rendered multiple graphs with corrupt archives It was discovered that if pmwebd (in graphite, render-to-png mode) was told to draw a mixture of archives, some of which were corrupt enough to fail pmGetArchiveEnd(), it could crash during the time-series importance-analysis stage. We now protect against that particular case, and improve diagnostics for that and others. QA included using two new pcpqa archives, one featuring 100% Genuine Corruption. commit fc0ceb354723195f9f0cf0cc970449ad5a189845 Author: Frank Ch. Eigler Date: Sun Mar 8 16:43:37 2015 -0400 pmwebd: handle exit_p requested during graphite data-mass gathering If we receive a SIGINT during pmgraphite_fetch_all_series, it will return early, but perhaps without all the correct geometry in the vector it returns. The caller pmgraphite_respond_render_gfx now checks for exit_p right after that call, so a badly-timed SIGINT doesn't trigger later geometry-assertions. commit d7a4de3009c2958ff2dfb74ad0ce4757d0a8dec2 Author: Frank Ch. Eigler Date: Mon Mar 2 13:35:02 2015 -0500 pmwebd: fix little memory leak for fts() during interrupted rendering The metric-enumeration loop using fts(3) could formerly exit without a fts_close() in case of a top-level ^C (exit_p shutdown). It's an insignificant leak, but what the heck. commit 6b2eb46b3eba9dacba86009bfc4ccebd198e7b79 Author: Frank Ch. Eigler Date: Sat Feb 28 09:35:09 2015 -0500 pmwebd: add a "-i MIN-INTERVAL" option for graphite time-precision control When pmlogger data is sampled more frequently than /60s, it is desirable to let graphite render data at a higher time resolution. Oversampling leads to wiggles due to interpolation FP artifacts, so is undesirable. The pmwebd invoker is best placed to judge the right tradeoff, so is given an option to set the minimum time-step size. From nscott@redhat.com Wed Apr 29 22:15:31 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 02E617F37 for ; Wed, 29 Apr 2015 22:15:31 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id D9004304059 for ; Wed, 29 Apr 2015 20:15:27 -0700 (PDT) X-ASG-Debug-ID: 1430363725-04bdf063224beea0001-S8gJnT Received: from mx3-phx2.redhat.com (mx3-phx2.redhat.com [209.132.183.24]) by cuda.sgi.com with ESMTP id 8fGRlcXh5hcrjfxS (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 29 Apr 2015 20:15:25 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.24 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx3-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3U3FPsa019956; Wed, 29 Apr 2015 23:15:25 -0400 Date: Wed, 29 Apr 2015 23:15:25 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Lukas Berk Cc: pcp@oss.sgi.com Message-ID: <693083759.10046214.1430363725406.JavaMail.zimbra@redhat.com> In-Reply-To: <87wq0uj1c8.fsf@redhat.com> References: <87bnk0wzn5.fsf@redhat.com> <877ft59dmo.fsf@redhat.com> <1344838118.4507317.1429675359315.JavaMail.zimbra@redhat.com> <87pp6n7u7g.fsf@redhat.com> <2089951493.8763144.1430262734221.JavaMail.zimbra@redhat.com> <87wq0uj1c8.fsf@redhat.com> Subject: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] [RFC] Minimizing Installation Size for Reduced PCP Footprint Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.85] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: Minimizing Installation Size for Reduced PCP Footprint Thread-Index: 26ZaPb5oFaygMvaZEhZ8e05f8CwYRw== X-Barracuda-Connect: mx3-phx2.redhat.com[209.132.183.24] X-Barracuda-Start-Time: 1430363725 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.03 X-Barracuda-Spam-Status: No, SCORE=0.03 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_SA_TO_FROM_DOMAIN_MATCH, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18479 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.01 BSF_SC0_SA_TO_FROM_DOMAIN_MATCH Sender Domain Matches Recipient Domain ----- Original Message ----- > >> interested in installing every pcp package, wildcarding "pcp-*" will > >> work. > > Neat - always the exceptions to the rule though I guess, with python* & > > perl* module package naming conventions. > > Yes, but those should get pulled in via package dependencies anyways, no? > At least with the pcp-pmda* packages I've create, they require the > proper perl/python pmda bindings. Yep - the python2/3 split leaves one of those two as an optional install, but that's just splitting hairs. cheers. -- Nathan From mgoodwin@redhat.com Thu Apr 30 00:35:38 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 118627F37 for ; Thu, 30 Apr 2015 00:35:38 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id F40C68F8033 for ; Wed, 29 Apr 2015 22:35:34 -0700 (PDT) X-ASG-Debug-ID: 1430372130-04cb6c1cca468a50001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id O1zggwt3ICw7Yuoe (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 29 Apr 2015 22:35:31 -0700 (PDT) X-Barracuda-Envelope-From: mgoodwin@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (Postfix) with ESMTPS id 27A00A062E for ; Thu, 30 Apr 2015 05:35:30 +0000 (UTC) Received: from [10.64.176.189] (dhcp-176-189.mel.redhat.com [10.64.176.189]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3U5ZSjn014169 for ; Thu, 30 Apr 2015 01:35:29 -0400 Message-ID: <5541BF1F.2050909@redhat.com> Date: Thu, 30 Apr 2015 15:35:27 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp Subject: pcp updates: merge Frank (pmwebd) + Nathan (hotproc docs) + Martins (docs) Content-Type: text/plain; charset=windows-1252; format=flowed X-ASG-Orig-Subj: pcp updates: merge Frank (pmwebd) + Nathan (hotproc docs) + Martins (docs) Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430372130 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Changes committed to git://git.pcp.io/pcp.git master Frank Ch. Eigler (7): pmwebd: add a "-i MIN-INTERVAL" option for graphite time-precision control pmwebd: fix little memory leak for fts() during interrupted rendering pmwebd: handle exit_p requested during graphite data-mass gathering pmwebd crasher fix: png-rendered multiple graphs with corrupt archives PR1099 (compressed archive) mitigation in pmwebd: skip them in graphite mode pmwebd graphite-png rendering: tweak graphics pmwebd: add -I option for opening directories-as-archives for graphite Martins Innus (6): hotproc - support disabling via pmstore hotproc - update qa for recent config changes hotproc - disallow hotproc.conf with global write mode hotproc - Allow config file reload hotproc - update the pmdaproc manpage with hotproc information hotproc - add a new error code for malformed pmstore input Nathan Scott (2): Revert "hotproc - add a new error code for malformed pmstore input" for now docs: update pmdaproc.1 man page a little, drop pmdahotproc.1 Marko Myllynen (1): docs: describe hotproc in the quick reference guide man/html/guide.html | 50 - man/man1/pmwebd.1 | 20 man/man3/pmwebapi.3 | 4 qa/006.out | 4 qa/661 | 34 qa/661.out | 1311 ++++++++++++++++++++++++++++- qa/982 | 5 qa/982.out | 10 qa/archives/archive-20150417.131733.0 |binary qa/archives/archive-20150417.131733.index |binary qa/archives/archive-20150417.131733.meta |binary qa/archives/archive-goodred-20150417.0 |binary qa/archives/archive-goodred-20150417.index |binary qa/archives/archive-goodred-20150417.meta |binary src/include/pcp/pmapi.h | 2 src/libpcp/src/err.c | 4 src/pmdas/linux_proc/config.c | 30 src/pmdas/linux_proc/error.c | 6 src/pmdas/linux_proc/gram.y | 12 src/pmdas/linux_proc/hotproc.c | 2 src/pmdas/linux_proc/hotproc.h | 1 src/pmdas/linux_proc/lex.l | 8 src/pmdas/linux_proc/pmda.c | 27 src/pmdas/linux_proc/pmdahotproc.1 | 187 ---- src/pmdas/linux_proc/pmdaproc.1 | 230 ++++- src/pmdas/linux_proc/proc_pid.c | 23 src/pmdas/linux_proc/proc_pid.h | 12 src/pmdas/linux_proc/root_proc | 1 src/pmwebapi/main.cxx | 31 src/pmwebapi/pmgraphite.cxx | 149 ++- src/pmwebapi/pmwebapi.h | 5 src/pmwebapi/pmwebd.options | 5 32 files changed, 1794 insertions(+), 379 deletions(-) Details ... commit 613f296cfd915cb119fb57ad287730f2d9967c28 Author: Nathan Scott Date: Thu Apr 30 12:17:02 2015 +1000 docs: update pmdaproc.1 man page a little, drop pmdahotproc.1 commit 4803ede912410cc6bd4e8ddb995e6b74fb392bd1 Author: Marko Myllynen Date: Thu Apr 30 11:47:05 2015 +1000 docs: describe hotproc in the quick reference guide commit 2cb86d5135876ec2eb721c9fb78a60636d472a97 Author: Nathan Scott Date: Thu Apr 30 10:19:13 2015 +1000 Revert "hotproc - add a new error code for malformed pmstore input" for now This reverts commit 4cef14619b682c91f982b103e4751416e354e3d1. commit 4cef14619b682c91f982b103e4751416e354e3d1 Author: Martins Innus Date: Wed Apr 29 18:46:09 2015 +0000 hotproc - add a new error code for malformed pmstore input commit e20343ea9ae4dc228d3250a9019c08fb60ddbffc Author: Martins Innus Date: Wed Apr 29 17:39:03 2015 +0000 hotproc - update the pmdaproc manpage with hotproc information commit 6dcab33eed485c0f534c7b52700664b82520b250 Author: Martins Innus Date: Wed Apr 29 17:29:30 2015 +0000 hotproc - Allow config file reload By using: pmstore hotproc.control.reload_config "1" the config file can be forced to be reloaded. Also cleaned up some duplicated code. commit a00be8d350ab4eac1ce900dcbf2e737a0d79e4a3 Author: Martins Innus Date: Wed Apr 29 16:46:57 2015 +0000 hotproc - disallow hotproc.conf with global write mode commit c61371d39aec7e4d3df3d4bf03ba5d1879bf3b44 Author: Martins Innus Date: Wed Apr 29 16:32:55 2015 +0000 hotproc - update qa for recent config changes Test hotproc disable and bad input commit 288421ef56a8402aab0a2f0e7d033720443ed7dd Author: Martins Innus Date: Wed Apr 29 15:30:04 2015 +0000 hotproc - support disabling via pmstore Support: pmstore hotproc.control.config "" to disable hotproc. Also, some comments and other cleanups commit 53d34c3d7102043b66dd337a8a8fe89cd55b3518 Author: Frank Ch. Eigler Date: Thu Apr 23 18:34:00 2015 -0400 pmwebd: add -I option for opening directories-as-archives for graphite This facility allows pmwebd to present to graphite-api clients such as the graphite and grafana webapps a more compact metric-name for the canonical sort of pmlogger directory layout, wherein each directory that contains archives are all from the same host. The moment pmNewContext (PM_CONTEXT_ARCHIVE, "/path/to/directory") facility comes online, this option will let pmwebd exploit it. The effect will be to go from having a gajillion: [...] pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150131-2E-110904-2E-meta.kernel.all.nprocs pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150131-2E-110904-2E-meta.kernel.all.nprocs pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150131-2E-110904-2E-meta.kernel.all.nprocs pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150201-2E-110705-2E-meta.kernel.all.nprocs [...] items to a single: pmmgr-2F-easy-2E-elastic-2E-org.kernel.all.nprocs Documentation is included. Hand-QA'd via gdb (to check that pmNewContext was being properly called on directories too). The code is harmless to current libpcp users, even if the non-default -I flag were turned on; updated QA asserts this. (qa/661.out may vary once the new pmNewContext facility comes online.) commit a0039e8dbd2f6ed6ba3964c06a270fec05fd084b Author: Frank Ch. Eigler Date: Tue Apr 21 21:16:01 2015 -0400 pmwebd graphite-png rendering: tweak graphics Make the rendered legend-text normal rather than too-wide, and reduce the maximum fraction of the legend (50% to 40% of the vertical space). It looks a little nicer in the grafana default-png.json dashboard. commit 738ccc07e942d295ec516814e7b52f9c910555d8 Author: Frank Ch. Eigler Date: Tue Apr 21 18:12:59 2015 -0400 PR1099 (compressed archive) mitigation in pmwebd: skip them in graphite mode As per PR1099, pmwebd graphite mode searches deeply conflict with compressed mode archives, because these cost a lot of time to individually decompress (and perhaps many times repeatedly). A new heuristic in pmgraphite_enumerate_metrics() rejects them. QA included (+ regenerated qa/661.out). commit d6ce75729a11a445f1a56091c604a5ca4eee7f41 Author: Frank Ch. Eigler Date: Tue Apr 21 10:35:21 2015 -0400 pmwebd crasher fix: png-rendered multiple graphs with corrupt archives It was discovered that if pmwebd (in graphite, render-to-png mode) was told to draw a mixture of archives, some of which were corrupt enough to fail pmGetArchiveEnd(), it could crash during the time-series importance-analysis stage. We now protect against that particular case, and improve diagnostics for that and others. QA included using two new pcpqa archives, one featuring 100% Genuine Corruption. commit fc0ceb354723195f9f0cf0cc970449ad5a189845 Author: Frank Ch. Eigler Date: Sun Mar 8 16:43:37 2015 -0400 pmwebd: handle exit_p requested during graphite data-mass gathering If we receive a SIGINT during pmgraphite_fetch_all_series, it will return early, but perhaps without all the correct geometry in the vector it returns. The caller pmgraphite_respond_render_gfx now checks for exit_p right after that call, so a badly-timed SIGINT doesn't trigger later geometry-assertions. commit d7a4de3009c2958ff2dfb74ad0ce4757d0a8dec2 Author: Frank Ch. Eigler Date: Mon Mar 2 13:35:02 2015 -0500 pmwebd: fix little memory leak for fts() during interrupted rendering The metric-enumeration loop using fts(3) could formerly exit without a fts_close() in case of a top-level ^C (exit_p shutdown). It's an insignificant leak, but what the heck. commit 6b2eb46b3eba9dacba86009bfc4ccebd198e7b79 Author: Frank Ch. Eigler Date: Sat Feb 28 09:35:09 2015 -0500 pmwebd: add a "-i MIN-INTERVAL" option for graphite time-precision control When pmlogger data is sampled more frequently than /60s, it is desirable to let graphite render data at a higher time resolution. Oversampling leads to wiggles due to interpolation FP artifacts, so is undesirable. The pmwebd invoker is best placed to judge the right tradeoff, so is given an option to set the minimum time-step size. From goodwinos@gmail.com Thu Apr 30 00:48:09 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=FREEMAIL_FROM autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 4E26E7F37 for ; Thu, 30 Apr 2015 00:48:09 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 314EF8F804C for ; Wed, 29 Apr 2015 22:48:09 -0700 (PDT) X-ASG-Debug-ID: 1430372887-04cb6c1cca468df0001-S8gJnT Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by cuda.sgi.com with ESMTP id ZnoPryAtwWKC2Alf (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Wed, 29 Apr 2015 22:48:08 -0700 (PDT) X-Barracuda-Envelope-From: goodwinos@gmail.com X-Barracuda-Apparent-Source-IP: 209.132.183.28 X-ASG-Whitelist: Client Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id t3U5m71F011334 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 30 Apr 2015 01:48:07 -0400 Received: from [10.64.176.189] (dhcp-176-189.mel.redhat.com [10.64.176.189]) by int-mx14.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3U5m5sk005665 for ; Thu, 30 Apr 2015 01:48:06 -0400 Message-ID: <5541C215.9010307@gmail.com> Date: Thu, 30 Apr 2015 15:48:05 +1000 From: Mark Goodwin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: Re: [pcp] pcp updates: merge Frank (pmwebd) + Nathan (hotproc docs) + Martins (docs) References: <5541BF1F.2050909@redhat.com> X-ASG-Orig-Subj: Re: [pcp] pcp updates: merge Frank (pmwebd) + Nathan (hotproc docs) + Martins (docs) In-Reply-To: <5541BF1F.2050909@redhat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.27 X-Barracuda-Connect: mx1.redhat.com[209.132.183.28] X-Barracuda-Start-Time: 1430372887 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 Sorry, $subject left out Marko. Should have been: merge Frank (pmwebd) + Nathan (hotproc) + Martins (hotproc) + Marko (docs) On 04/30/2015 03:35 PM, Mark Goodwin wrote: > > Changes committed to git://git.pcp.io/pcp.git master > > Frank Ch. Eigler (7): > pmwebd: add a "-i MIN-INTERVAL" option for graphite time-precision control > pmwebd: fix little memory leak for fts() during interrupted rendering > pmwebd: handle exit_p requested during graphite data-mass gathering > pmwebd crasher fix: png-rendered multiple graphs with corrupt archives > PR1099 (compressed archive) mitigation in pmwebd: skip them in graphite mode > pmwebd graphite-png rendering: tweak graphics > pmwebd: add -I option for opening directories-as-archives for graphite > > Martins Innus (6): > hotproc - support disabling via pmstore > hotproc - update qa for recent config changes > hotproc - disallow hotproc.conf with global write mode > hotproc - Allow config file reload > hotproc - update the pmdaproc manpage with hotproc information > hotproc - add a new error code for malformed pmstore input > > Nathan Scott (2): > Revert "hotproc - add a new error code for malformed pmstore input" for now > docs: update pmdaproc.1 man page a little, drop pmdahotproc.1 > > Marko Myllynen (1): > docs: describe hotproc in the quick reference guide > > man/html/guide.html | 50 - > man/man1/pmwebd.1 | 20 > man/man3/pmwebapi.3 | 4 > qa/006.out | 4 > qa/661 | 34 > qa/661.out | 1311 ++++++++++++++++++++++++++++- > qa/982 | 5 > qa/982.out | 10 > qa/archives/archive-20150417.131733.0 |binary > qa/archives/archive-20150417.131733.index |binary > qa/archives/archive-20150417.131733.meta |binary > qa/archives/archive-goodred-20150417.0 |binary > qa/archives/archive-goodred-20150417.index |binary > qa/archives/archive-goodred-20150417.meta |binary > src/include/pcp/pmapi.h | 2 > src/libpcp/src/err.c | 4 > src/pmdas/linux_proc/config.c | 30 > src/pmdas/linux_proc/error.c | 6 > src/pmdas/linux_proc/gram.y | 12 > src/pmdas/linux_proc/hotproc.c | 2 > src/pmdas/linux_proc/hotproc.h | 1 > src/pmdas/linux_proc/lex.l | 8 > src/pmdas/linux_proc/pmda.c | 27 > src/pmdas/linux_proc/pmdahotproc.1 | 187 ---- > src/pmdas/linux_proc/pmdaproc.1 | 230 ++++- > src/pmdas/linux_proc/proc_pid.c | 23 > src/pmdas/linux_proc/proc_pid.h | 12 > src/pmdas/linux_proc/root_proc | 1 > src/pmwebapi/main.cxx | 31 > src/pmwebapi/pmgraphite.cxx | 149 ++- > src/pmwebapi/pmwebapi.h | 5 > src/pmwebapi/pmwebd.options | 5 > 32 files changed, 1794 insertions(+), 379 deletions(-) > > Details ... > > commit 613f296cfd915cb119fb57ad287730f2d9967c28 > Author: Nathan Scott > Date: Thu Apr 30 12:17:02 2015 +1000 > > docs: update pmdaproc.1 man page a little, drop pmdahotproc.1 > > commit 4803ede912410cc6bd4e8ddb995e6b74fb392bd1 > Author: Marko Myllynen > Date: Thu Apr 30 11:47:05 2015 +1000 > > docs: describe hotproc in the quick reference guide > > commit 2cb86d5135876ec2eb721c9fb78a60636d472a97 > Author: Nathan Scott > Date: Thu Apr 30 10:19:13 2015 +1000 > > Revert "hotproc - add a new error code for malformed pmstore input" for now > > This reverts commit 4cef14619b682c91f982b103e4751416e354e3d1. > > commit 4cef14619b682c91f982b103e4751416e354e3d1 > Author: Martins Innus > Date: Wed Apr 29 18:46:09 2015 +0000 > > hotproc - add a new error code for malformed pmstore input > > commit e20343ea9ae4dc228d3250a9019c08fb60ddbffc > Author: Martins Innus > Date: Wed Apr 29 17:39:03 2015 +0000 > > hotproc - update the pmdaproc manpage with hotproc information > > commit 6dcab33eed485c0f534c7b52700664b82520b250 > Author: Martins Innus > Date: Wed Apr 29 17:29:30 2015 +0000 > > hotproc - Allow config file reload > > By using: pmstore hotproc.control.reload_config "1" > the config file can be forced to be reloaded. > > Also cleaned up some duplicated code. > > commit a00be8d350ab4eac1ce900dcbf2e737a0d79e4a3 > Author: Martins Innus > Date: Wed Apr 29 16:46:57 2015 +0000 > > hotproc - disallow hotproc.conf with global write mode > > commit c61371d39aec7e4d3df3d4bf03ba5d1879bf3b44 > Author: Martins Innus > Date: Wed Apr 29 16:32:55 2015 +0000 > > hotproc - update qa for recent config changes > > Test hotproc disable and bad input > > commit 288421ef56a8402aab0a2f0e7d033720443ed7dd > Author: Martins Innus > Date: Wed Apr 29 15:30:04 2015 +0000 > > hotproc - support disabling via pmstore > > Support: pmstore hotproc.control.config "" > to disable hotproc. > > Also, some comments and other cleanups > > commit 53d34c3d7102043b66dd337a8a8fe89cd55b3518 > Author: Frank Ch. Eigler > Date: Thu Apr 23 18:34:00 2015 -0400 > > pmwebd: add -I option for opening directories-as-archives for graphite > > This facility allows pmwebd to present to graphite-api clients such as > the graphite and grafana webapps a more compact metric-name for the > canonical sort of pmlogger directory layout, wherein each directory > that contains archives are all from the same host. The moment > pmNewContext (PM_CONTEXT_ARCHIVE, "/path/to/directory") facility > comes online, this option will let pmwebd exploit it. > > The effect will be to go from having a gajillion: > [...] > > pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150131-2E-110904-2E-meta.kernel.all.nprocs > > > pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150131-2E-110904-2E-meta.kernel.all.nprocs > > > pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150131-2E-110904-2E-meta.kernel.all.nprocs > > > pmmgr-2F-easy-2E-elastic-2E-org-2F-archive-2D-20150201-2E-110705-2E-meta.kernel.all.nprocs > > [...] > items to a single: > pmmgr-2F-easy-2E-elastic-2E-org.kernel.all.nprocs > > Documentation is included. Hand-QA'd via gdb (to check that > pmNewContext was being properly called on directories too). The code > is harmless to current libpcp users, even if the non-default -I flag > were turned on; updated QA asserts this. (qa/661.out may vary once > the new pmNewContext facility comes online.) > > commit a0039e8dbd2f6ed6ba3964c06a270fec05fd084b > Author: Frank Ch. Eigler > Date: Tue Apr 21 21:16:01 2015 -0400 > > pmwebd graphite-png rendering: tweak graphics > > Make the rendered legend-text normal rather than too-wide, > and reduce the maximum fraction of the legend (50% to 40% > of the vertical space). It looks a little nicer in the > grafana default-png.json dashboard. > > commit 738ccc07e942d295ec516814e7b52f9c910555d8 > Author: Frank Ch. Eigler > Date: Tue Apr 21 18:12:59 2015 -0400 > > PR1099 (compressed archive) mitigation in pmwebd: skip them in graphite mode > > As per PR1099, pmwebd graphite mode searches deeply conflict with > compressed mode archives, because these cost a lot of time to > individually decompress (and perhaps many times repeatedly). A new > heuristic in pmgraphite_enumerate_metrics() rejects them. QA > included (+ regenerated qa/661.out). > > commit d6ce75729a11a445f1a56091c604a5ca4eee7f41 > Author: Frank Ch. Eigler > Date: Tue Apr 21 10:35:21 2015 -0400 > > pmwebd crasher fix: png-rendered multiple graphs with corrupt archives > > It was discovered that if pmwebd (in graphite, render-to-png mode) was > told to draw a mixture of archives, some of which were corrupt enough > to fail pmGetArchiveEnd(), it could crash during the time-series > importance-analysis stage. We now protect against that particular > case, and improve diagnostics for that and others. QA included > using two new pcpqa archives, one featuring 100% Genuine Corruption. > > commit fc0ceb354723195f9f0cf0cc970449ad5a189845 > Author: Frank Ch. Eigler > Date: Sun Mar 8 16:43:37 2015 -0400 > > pmwebd: handle exit_p requested during graphite data-mass gathering > > If we receive a SIGINT during pmgraphite_fetch_all_series, it will > return early, but perhaps without all the correct geometry in the > vector it returns. The caller pmgraphite_respond_render_gfx > now checks for exit_p right after that call, so a badly-timed SIGINT > doesn't trigger later geometry-assertions. > > commit d7a4de3009c2958ff2dfb74ad0ce4757d0a8dec2 > Author: Frank Ch. Eigler > Date: Mon Mar 2 13:35:02 2015 -0500 > > pmwebd: fix little memory leak for fts() during interrupted rendering > > The metric-enumeration loop using fts(3) could formerly exit without a > fts_close() in case of a top-level ^C (exit_p shutdown). It's an > insignificant leak, but what the heck. > > commit 6b2eb46b3eba9dacba86009bfc4ccebd198e7b79 > Author: Frank Ch. Eigler > Date: Sat Feb 28 09:35:09 2015 -0500 > > pmwebd: add a "-i MIN-INTERVAL" option for graphite time-precision control > > When pmlogger data is sampled more frequently than /60s, it is > desirable to let graphite render data at a higher time resolution. > Oversampling leads to wiggles due to interpolation FP artifacts, so is > undesirable. The pmwebd invoker is best placed to judge the right > tradeoff, so is given an option to set the minimum time-step size. > > _______________________________________________ > pcp mailing list > pcp@oss.sgi.com > http://oss.sgi.com/mailman/listinfo/pcp From wwwrun@oss.sgi.com Thu Apr 30 01:04:13 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 98A827F54; Thu, 30 Apr 2015 01:04:13 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1067] linux pmda does too much work for network.interface queries Date: Thu, 30 Apr 2015 06:04:13 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: michele@acksyn.org X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@kenj.com.au X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1430373853.8DCfa0245.19960"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1430373853.8DCfa0245.19960 Date: Thu, 30 Apr 2015 01:04:13 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1067 --- Comment #13 from Michele Baldessari --- Hi Carlos, the reason seems to be: 19022 21:06:19.492609 open("/sys/class/net/p4p2/speed", O_RDONLY) = 9 <0.000037> 19022 21:06:19.492680 fstat(9, {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0 <0.000014> 19022 21:06:19.492726 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fa6c1eb1000 <0.000015> 19022 21:06:19.492772 read(9, 0x7fa6c1eb1000, 4096) = -1 EINVAL (Invalid argument) <0.000014> 19022 21:06:19.492817 close(9) = 0 <0.000015> 19022 21:06:19.492860 munmap(0x7fa6c1eb1000, 4096) = 0 <0.000016> 19022 21:06:19.492905 ioctl(8, SIOCETHTOOL, 0x7ffff046c520) = 0 <1.038097> What kind of interface is this? Can you give the output of "ethtool -i p4p2" and "ethtool p4p2". The issue is that this driver does not fill /sys/class/net/p4p2/speed (likely some virtual driver?) and also takes ages to reply to a SIOCETHTOOL ioctl. Is this a physical system ? thanks, Michele -- You are receiving this mail because: You are on the CC list for the bug. --1430373853.8DCfa0245.19960 Date: Thu, 30 Apr 2015 01:04:13 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8"

      Comment # 13 on bug 1067 from 
      Hi Carlos,

the reason seems to be:
19022 21:06:19.492609 open("/sys/class/net/p4p2/speed", O_RDONLY) = 9
<0.000037>
19022 21:06:19.492680 fstat(9, {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0
<0.000014>
19022 21:06:19.492726 mmap(NULL, 4096, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fa6c1eb1000 <0.000015>
19022 21:06:19.492772 read(9, 0x7fa6c1eb1000, 4096) = -1 EINVAL (Invalid
argument) <0.000014>
19022 21:06:19.492817 close(9)          = 0 <0.000015>
19022 21:06:19.492860 munmap(0x7fa6c1eb1000, 4096) = 0 <0.000016>
19022 21:06:19.492905 ioctl(8, SIOCETHTOOL, 0x7ffff046c520) = 0 <1.038097>

What kind of interface is this? Can you give the output of "ethtool -i p4p2"
and
"ethtool p4p2". The issue is that this driver does not fill
/sys/class/net/p4p2/speed (likely some virtual driver?) and also takes ages to
reply to a SIOCETHTOOL
ioctl. Is this a physical system ?

thanks,
Michele

      You are receiving this mail because:
      • You are on the CC list for the bug.
      --1430373853.8DCfa0245.19960-- From wwwrun@oss.sgi.com Thu Apr 30 02:06:22 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 6987D7F47; Thu, 30 Apr 2015 02:06:22 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1106] pmdalinux / pmdaroot container problems Date: Thu, 30 Apr 2015 07:06:22 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: mgoodwin@redhat.com X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@oss.sgi.com X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1430377582.7C67B7111.23344"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1430377582.7C67B7111.23344 Date: Thu, 30 Apr 2015 02:06:22 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1106 Mark Goodwin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mgoodwin@redhat.com --- Comment #1 from Mark Goodwin --- some progress - in a container, the NET_ADDR_INDOM (using ioctl(fd, SIOCGIFCONF, ..) is the same namespace as the host not of the container, but the NET_DEV_INDOM maps to the net namespace in the container (exported as /proc/net/dev). So in a container, network.interface.net_addr (and related metrics) have different instances to the rest of the network.interface metrics. I'm not sure if this matters, unless there is somewhere in the code that expects the two indoms to have the same set of instances. This could just be a kernel bug or anomaly since SIOCGIFCONF doesn't honour the net namespace, but /proc/net/dev does. Haven't seen any EPERM issues - maybe that was a different bug, now fixed (IIRC we fixed a bug sounding a bit similar a while back). -- You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug. --1430377582.7C67B7111.23344 Date: Thu, 30 Apr 2015 02:06:22 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" changed bug 1106
      What Removed Added
      CC   mgoodwin@redhat.com

      Comment # 1 on bug 1106 from 
      some progress - in a container, the NET_ADDR_INDOM (using ioctl(fd,
SIOCGIFCONF, ..) is the same namespace as the host not of the container, but
the NET_DEV_INDOM maps to the net namespace in the container (exported as
/proc/net/dev). So in a container, network.interface.net_addr (and related
metrics) have different instances to the rest of the network.interface metrics.
I'm not sure if this matters, unless there is somewhere in the code that
expects the two indoms to have the same set of instances. This could just be a
kernel bug or anomaly since SIOCGIFCONF doesn't honour the net namespace, but
/proc/net/dev does.

Haven't seen any EPERM issues - maybe that was a different bug, now fixed (IIRC
we fixed a bug sounding a bit similar a while back).

      You are receiving this mail because:
      • You are on the CC list for the bug.
      • You are the assignee for the bug.
      --1430377582.7C67B7111.23344-- From kenj@internode.on.net Thu Apr 30 05:02:41 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 5A5B07F47 for ; Thu, 30 Apr 2015 05:02:41 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id EC508AC003 for ; Thu, 30 Apr 2015 03:02:37 -0700 (PDT) X-ASG-Debug-ID: 1430388154-04cb6c1cc746f150001-S8gJnT Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net [150.101.137.143]) by cuda.sgi.com with ESMTP id 6xfJY2RdCFAoJ2eu for ; Thu, 30 Apr 2015 03:02:35 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.143 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DZAQD7/EFVPKEh0XYNT4NfXIMbgy7AWYYCghMQAQEBAQEBAQYBAQEBQYUJVTAGAgUWCwILAwIBAgExJwYCAQG7DXCTd4EhjjeBAoJSgUUFlXOcPIQpXYECgUMBAQE Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail05.adl6.internode.on.net with ESMTP; 30 Apr 2015 19:32:33 +0930 Message-ID: <5541FDB9.3080902@internode.on.net> Date: Thu, 30 Apr 2015 20:02:33 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - qa fixup Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - qa fixup Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail05.adl6.internode.on.net[150.101.137.143] X-Barracuda-Start-Time: 1430388155 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18486 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Changes committed to git://git.pcp.io/kenj/pcp master Ken McDonell (1): qa/src/chkctx2.c: fix botch in last change qa/src/chkctx2.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) Details ... commit a474fa74571b7a222677605c8f5091c949c657f5 Author: Ken McDonell Date: Wed Apr 29 15:42:54 2015 +1000 qa/src/chkctx2.c: fix botch in last change qa/024 is failing everywhere because I made a mistake in the last round of pmLoadNameSpace() changes ... for chkctx2 we MUST always call pmLoadASCIINameSpace, even if there is no -n argument and namespace == PM_NS_DEFAULT. From michele@acksyn.org Thu Apr 30 05:12:19 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=T_DKIM_INVALID autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 84D167F47 for ; Thu, 30 Apr 2015 05:12:19 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 74001304032 for ; Thu, 30 Apr 2015 03:12:16 -0700 (PDT) X-ASG-Debug-ID: 1430388731-04cb6c1cc746f620001-S8gJnT Received: from palahniuk.acksyn.org (palahniuk.acksyn.org [5.9.7.26]) by cuda.sgi.com with ESMTP id A3zVBwDeJJFuA9ih for ; Thu, 30 Apr 2015 03:12:11 -0700 (PDT) X-Barracuda-Envelope-From: michele@acksyn.org X-Barracuda-Apparent-Source-IP: 5.9.7.26 Received: from localhost (localhost [127.0.0.1]) by palahniuk.acksyn.org (Postfix) with ESMTP id A36D429DA7; Thu, 30 Apr 2015 06:12:10 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=acksyn.org; h= x-mailer:message-id:date:date:subject:subject:from:from:received :received; s=2010; t=1430388729; bh=5QCbMLC8gHSDAIzfTg2skH+CCDwW fa4200ipqHchiq8=; b=LY1E5NlS0F6lrkbUAWc3X6f5788BWnRIm1oyhgYtGs9r nRDrQZrCxZ8zNdCanzM7WBPrjtQlNX/1hGmv8Ms6d5XcAZD14JXemKPmJbMbAY5j as0xcEdlPMdTtJ1cn4scEE/hdi6M0rYoyRgiVkdEIfZpro8H5lahgYYytLnEFIg= Received: from palahniuk.acksyn.org ([127.0.0.1]) by localhost (mail.acksyn.org [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id msP5vEgJ1Alp; Thu, 30 Apr 2015 06:12:09 -0400 (EDT) Received: from localhost (host160-178-dynamic.6-79-r.retail.telecomitalia.it [79.6.178.160]) by palahniuk.acksyn.org (Postfix) with ESMTPSA id 3F7DD270A4; Thu, 30 Apr 2015 06:12:09 -0400 (EDT) From: Michele Baldessari To: pcp@oss.sgi.com Cc: Michele Baldessari Subject: [PATCH] Add a configure switch for publican brand support Date: Thu, 30 Apr 2015 12:12:01 +0200 X-ASG-Orig-Subj: [PATCH] Add a configure switch for publican brand support Message-Id: <1430388721-4620-1-git-send-email-michele@acksyn.org> X-Mailer: git-send-email 2.3.6 X-Barracuda-Connect: palahniuk.acksyn.org[5.9.7.26] X-Barracuda-Start-Time: 1430388731 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18486 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature Add a --with-books-brand=BRAND configure switch in order to choose the publican brand at build time. This is especially useful for the website documentation where we use a custom brand. The default brand used when nothing is specified is the standard 'common' publican brand. --- books/PCP_PG/GNUmakefile | 7 +++++-- books/PCP_PG/publican.cfg | 4 ---- books/PCP_PG/publican.cfg.in | 4 ++++ books/PCP_TCS/GNUmakefile | 7 +++++-- books/PCP_TCS/publican.cfg | 4 ---- books/PCP_TCS/publican.cfg.in | 4 ++++ books/PCP_UAG/GNUmakefile | 7 +++++-- books/PCP_UAG/publican.cfg | 4 ---- books/PCP_UAG/publican.cfg.in | 4 ++++ configure | 21 +++++++++++++++++++++ configure.ac | 13 +++++++++++++ src/include/builddefs.in | 1 + 12 files changed, 62 insertions(+), 18 deletions(-) delete mode 100644 books/PCP_PG/publican.cfg create mode 100644 books/PCP_PG/publican.cfg.in delete mode 100644 books/PCP_TCS/publican.cfg create mode 100644 books/PCP_TCS/publican.cfg.in delete mode 100644 books/PCP_UAG/publican.cfg create mode 100644 books/PCP_UAG/publican.cfg.in diff --git a/books/PCP_PG/GNUmakefile b/books/PCP_PG/GNUmakefile index 1cd3aacedf9b..eca64bd0be2b 100644 --- a/books/PCP_PG/GNUmakefile +++ b/books/PCP_PG/GNUmakefile @@ -13,7 +13,7 @@ CFG = publican.cfg CP = cp -rdp LSRCFILES = $(XML) $(PUB) $(CFG) $(PDF) LDIRDIRT = pdf html en-US tmp -LDIRT = built.* +LDIRT = built.* publican.cfg CWD = $(shell pwd) default: build-me @@ -21,7 +21,7 @@ default: build-me include $(BUILDRULES) ifeq "$(BOOK_TOOLCHAIN)" "publican" -built.$(BOOK_TOOLCHAIN): $(XML) +built.$(BOOK_TOOLCHAIN): $(XML) $(CFG) @rm -fr pdf html en-US tmp @mkdir -p pdf html en-US tmp $(CP) $(CWD)/$(PUB) en-US/ @@ -59,6 +59,9 @@ else build-me: endif +publican.cfg : publican.cfg.in + $(SED) -e 's;@brand@;'$(BOOK_BRAND)';' $< > $@ + install: default $(INSTALL) -m 755 -d $(PCP_BOOKS_DIR) $(INSTALL) -m 644 $(PDF) $(PCP_BOOKS_DIR)/$(PDF) diff --git a/books/PCP_PG/publican.cfg b/books/PCP_PG/publican.cfg deleted file mode 100644 index 0e5049b157cf..000000000000 --- a/books/PCP_PG/publican.cfg +++ /dev/null @@ -1,4 +0,0 @@ -debug: 1 -xml_lang: en-US -brand: common -condition: common diff --git a/books/PCP_PG/publican.cfg.in b/books/PCP_PG/publican.cfg.in new file mode 100644 index 000000000000..eaf4e8d483ff --- /dev/null +++ b/books/PCP_PG/publican.cfg.in @@ -0,0 +1,4 @@ +debug: 1 +xml_lang: en-US +brand: @brand@ +condition: common diff --git a/books/PCP_TCS/GNUmakefile b/books/PCP_TCS/GNUmakefile index 239eee80da9a..c61aeb730e4f 100644 --- a/books/PCP_TCS/GNUmakefile +++ b/books/PCP_TCS/GNUmakefile @@ -13,7 +13,7 @@ CFG = publican.cfg CP = cp -rdp LSRCFILES = $(XML) $(PUB) $(CFG) $(PDF) LDIRDIRT = pdf html en-US tmp -LDIRT = built.* +LDIRT = built.* publican.cfg CWD = $(shell pwd) default: build-me @@ -21,7 +21,7 @@ default: build-me include $(BUILDRULES) ifeq "$(BOOK_TOOLCHAIN)" "publican" -built.$(BOOK_TOOLCHAIN): $(XML) +built.$(BOOK_TOOLCHAIN): $(XML) $(CFG) @rm -fr pdf html en-US tmp @mkdir -p pdf html en-US tmp $(CP) $(CWD)/$(PUB) en-US/ @@ -59,6 +59,9 @@ else build-me: endif +publican.cfg : publican.cfg.in + $(SED) -e 's;@brand@;'$(BOOK_BRAND)';' $< > $@ + install: default # $(INSTALL) -m 755 -d $(PCP_BOOKS_DIR) # $(INSTALL) -m 644 $(PDF) $(PCP_BOOKS_DIR)/$(PDF) diff --git a/books/PCP_TCS/publican.cfg b/books/PCP_TCS/publican.cfg deleted file mode 100644 index 0e5049b157cf..000000000000 --- a/books/PCP_TCS/publican.cfg +++ /dev/null @@ -1,4 +0,0 @@ -debug: 1 -xml_lang: en-US -brand: common -condition: common diff --git a/books/PCP_TCS/publican.cfg.in b/books/PCP_TCS/publican.cfg.in new file mode 100644 index 000000000000..eaf4e8d483ff --- /dev/null +++ b/books/PCP_TCS/publican.cfg.in @@ -0,0 +1,4 @@ +debug: 1 +xml_lang: en-US +brand: @brand@ +condition: common diff --git a/books/PCP_UAG/GNUmakefile b/books/PCP_UAG/GNUmakefile index 6221203d1da0..5242f4e8aac8 100644 --- a/books/PCP_UAG/GNUmakefile +++ b/books/PCP_UAG/GNUmakefile @@ -13,7 +13,7 @@ CFG = publican.cfg CP = cp -rdp LSRCFILES = $(XML) $(PUB) $(CFG) $(PDF) LDIRDIRT = pdf html en-US tmp -LDIRT = built.* +LDIRT = built.* publican.cfg CWD = $(shell pwd) default: build-me @@ -21,7 +21,7 @@ default: build-me include $(BUILDRULES) ifeq "$(BOOK_TOOLCHAIN)" "publican" -built.$(BOOK_TOOLCHAIN): $(XML) +built.$(BOOK_TOOLCHAIN): $(XML) $(CFG) @rm -fr pdf html en-US tmp @mkdir -p pdf html en-US tmp $(CP) $(CWD)/$(PUB) en-US/ @@ -59,6 +59,9 @@ else build-me: endif +publican.cfg : publican.cfg.in + $(SED) -e 's;@brand@;'$(BOOK_BRAND)';' $< > $@ + install: default $(INSTALL) -m 755 -d $(PCP_BOOKS_DIR) $(INSTALL) -m 644 $(PDF) $(PCP_BOOKS_DIR)/$(PDF) diff --git a/books/PCP_UAG/publican.cfg b/books/PCP_UAG/publican.cfg deleted file mode 100644 index 0e5049b157cf..000000000000 --- a/books/PCP_UAG/publican.cfg +++ /dev/null @@ -1,4 +0,0 @@ -debug: 1 -xml_lang: en-US -brand: common -condition: common diff --git a/books/PCP_UAG/publican.cfg.in b/books/PCP_UAG/publican.cfg.in new file mode 100644 index 000000000000..eaf4e8d483ff --- /dev/null +++ b/books/PCP_UAG/publican.cfg.in @@ -0,0 +1,4 @@ +debug: 1 +xml_lang: en-US +brand: @brand@ +condition: common diff --git a/configure b/configure index 4d825cf69fed..201353682fde 100755 --- a/configure +++ b/configure @@ -738,6 +738,7 @@ LEXLIB LEX_OUTPUT_ROOT LEX LN_S +book_brand book_toolchain xmlto XMLTO @@ -911,6 +912,7 @@ with_qt with_python with_python3 with_books +with_books_brand with_papi with_perfevent with_manager @@ -1604,6 +1606,9 @@ Optional Packages: --with-python3 enable support for tools requiring Python3 (default is on) --with-books enable building of the PCP books (default is off) + --with-books-brand=BRAND + choose the docbook brand when building the PCP books + (default is common) --with-papi[=DIR|=MODULE] enable performance api counter pmda (default is on) The optional argument may be a full path of a PAPI @@ -2659,6 +2664,15 @@ fi +# Check whether --with-books-brand was given. +if test "${with_books_brand+set}" = set; then : + withval=$with_books_brand; do_books_brand=$withval; PACKAGE_CONFIGURE="$PACKAGE_CONFIGURE --with-books-brand=$withval" +else + do_books_brand=common +fi + + + # Check whether --with-papi was given. if test "${with_papi+set}" = set; then : withval=$with_papi; do_papi=$withval; PACKAGE_CONFIGURE="$PACKAGE_CONFIGURE --with-papi=$withval" @@ -8346,6 +8360,13 @@ then fi +book_brand="common" +if test "$do_books_brand" != "" +then + book_brand=$do_books_brand +fi + + { $as_echo "$as_me:${as_lineno-$LINENO}: checking whether ln -s works" >&5 $as_echo_n "checking whether ln -s works... " >&6; } LN_S=$as_ln_s diff --git a/configure.ac b/configure.ac index fd2b62f669da..65e6f4969f56 100644 --- a/configure.ac +++ b/configure.ac @@ -107,6 +107,12 @@ AC_ARG_WITH([books], [do_books=$withval; PACKAGE_CONFIGURE="$PACKAGE_CONFIGURE --with-books=$withval"], [do_books=no]) +AC_ARG_WITH([books-brand], + [AC_HELP_STRING([--with-books-brand=BRAND], + [choose the docbook brand when building the PCP books (default is common)])], + [do_books_brand=$withval; PACKAGE_CONFIGURE="$PACKAGE_CONFIGURE --with-books-brand=$withval"], + [do_books_brand=common]) + AC_ARG_WITH([papi], [AC_HELP_STRING([--with-papi@<:@=DIR|=MODULE@:>@], [enable performance api counter pmda (default is on) @@ -955,6 +961,13 @@ then fi AC_SUBST(book_toolchain) +book_brand="common" +if test "$do_books_brand" != "" +then + book_brand=$do_books_brand +fi +AC_SUBST(book_brand) + dnl check if symbolic links are supported AC_PROG_LN_S if test $target_os = mingw; then diff --git a/src/include/builddefs.in b/src/include/builddefs.in index 34d9f4d9269e..2d5d77b4a0de 100644 --- a/src/include/builddefs.in +++ b/src/include/builddefs.in @@ -204,6 +204,7 @@ XMLTO = @xmlto@ DBLATEX = @dblatex@ PUBLICAN = @publican@ BOOK_TOOLCHAIN = @book_toolchain@ +BOOK_BRAND = @book_brand@ HAVE_GZIPPED_MANPAGES = @have_gzipped_manpages@ HAVE_BZIP2ED_MANPAGES = @have_bzip2ed_manpages@ -- 2.3.6 From minnus@buffalo.edu Thu Apr 30 08:20:11 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 300D27F37 for ; Thu, 30 Apr 2015 08:20:11 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 0BEBD304048 for ; Thu, 30 Apr 2015 06:20:10 -0700 (PDT) X-ASG-Debug-ID: 1430400006-04cbb056b24c4d20001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve3.acsu.buffalo.edu [128.205.7.163]) by cuda.sgi.com with ESMTP id AE7TdtNw68OOXFZC for ; Thu, 30 Apr 2015 06:20:06 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.163 Received: from localmailD.acsu.buffalo.edu (localmaild.acsu.buffalo.edu [128.205.5.208]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 74A19F44; Thu, 30 Apr 2015 09:20:06 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 6AC352ABE3; Thu, 30 Apr 2015 09:20:06 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailD.acsu.buffalo.edu (Postfix) with ESMTP id BD7FF2ABDC; Thu, 30 Apr 2015 09:20:05 -0400 (EDT) Received: from smtp.buffalo.edu (smtp4.acsu.buffalo.edu [128.205.5.229]) by localmailD.acsu.buffalo.edu (Prefixe) with ESMTP id AD72C2ABDA; Thu, 30 Apr 2015 09:20:05 -0400 (EDT) Received: from [128.205.28.168] (slash.eng.buffalo.edu [128.205.28.168]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id A3819CBC4D; Thu, 30 Apr 2015 09:20:05 -0400 (EDT) Message-ID: <55422C03.2000708@buffalo.edu> Date: Thu, 30 Apr 2015 09:20:03 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Ken McDonell , pcp@oss.sgi.com Subject: Re: [pcp] POSIX version References: <55412913.4080603@buffalo.edu> <55414129.4090000@internode.on.net> X-ASG-Orig-Subj: Re: [pcp] POSIX version In-Reply-To: <55414129.4090000@internode.on.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve3.acsu.buffalo.edu[128.205.7.163] X-Barracuda-Start-Time: 1430400006 X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18490 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Ken, On 4/29/2015 4:38 PM, Ken McDonell wrote: > > We don't really have a formal position on a POSIX version that the > code is expected to comply with, other than the (old) -D_GNU_SOURCE in > the build which sort of means we can never be POSIX compliant (sigh). > > This is in part because the POSIX story is confusing across all the > platforms we're trying to support, or at least was so at points of > time over the last 20+ years. > > Rather we've gone down the path of isolating source code that is not > necessarily portable across all the platforms using HAVE_FOO macros > ... in this case it would be HAVE_OPEN_MEMSTREAM. This works fine in > cases where the feature provides isolated functionality and the #else > path can either do nothing or return a relevant error such as > PM_ERR_APPVERSION. > Yeah, not the case here, as it would preclude use of the pmda. > But in this case I think you'd either have to > (a) assert that open_memstream() is available on any Linux platform > where PCP is expected to compile and just do it, or > (b) keep the existing implementation for the #else part and use > open_memstream() for an alternative (new and default) implementation > behind the #ifdef HAVE_OPEN_MEMSTREAM > The more I think about it, any change will probably add more complexity, so not worth it. Thanks Martins From minnus@buffalo.edu Thu Apr 30 08:22:21 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id CE7367F37 for ; Thu, 30 Apr 2015 08:22:21 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay3.corp.sgi.com (Postfix) with ESMTP id 5BC35AC003 for ; Thu, 30 Apr 2015 06:22:18 -0700 (PDT) X-ASG-Debug-ID: 1430400136-04cb6c1cc84759a0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve3.acsu.buffalo.edu [128.205.7.163]) by cuda.sgi.com with ESMTP id Nq9jFRdi6DEHjou8 for ; Thu, 30 Apr 2015 06:22:16 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.163 Received: from localmailD.acsu.buffalo.edu (localmaild.acsu.buffalo.edu [128.205.5.208]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 55B79F93; Thu, 30 Apr 2015 09:22:16 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 4D409F824; Thu, 30 Apr 2015 09:22:16 -0400 (EDT) Received: from localmailD.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailD.acsu.buffalo.edu (Postfix) with ESMTP id B0622F81D; Thu, 30 Apr 2015 09:22:15 -0400 (EDT) Received: from smtp.buffalo.edu (smtp4.acsu.buffalo.edu [128.205.5.229]) by localmailD.acsu.buffalo.edu (Prefixe) with ESMTP id 9F1F6F81C; Thu, 30 Apr 2015 09:22:15 -0400 (EDT) Received: from [128.205.28.168] (slash.eng.buffalo.edu [128.205.28.168]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 9407ECBCEA; Thu, 30 Apr 2015 09:22:15 -0400 (EDT) Message-ID: <55422C85.7060307@buffalo.edu> Date: Thu, 30 Apr 2015 09:22:13 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Nathan Scott , Ken McDonell CC: pcp@oss.sgi.com Subject: Re: [pcp] Hotproc fixes References: <5536A934.8040002@buffalo.edu> <5537A154.2090803@redhat.com> <5537A3F3.5060204@buffalo.edu> <233739221.5258413.1429764654377.JavaMail.zimbra@redhat.com> <55392BAB.3060101@buffalo.edu> <806884984.5885784.1429839438565.JavaMail.zimbra@redhat.com> <554128C1.8080901@buffalo.edu> <102929865.10042134.1430363515688.JavaMail.zimbra@redhat.com> X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes In-Reply-To: <102929865.10042134.1430363515688.JavaMail.zimbra@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve3.acsu.buffalo.edu[128.205.7.163] X-Barracuda-Start-Time: 1430400136 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18489 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- Nathan, On 4/29/2015 11:11 PM, Nathan Scott wrote: >> Also included some other cleanup suggestions from Marko, the ability to >> reload the config file, updated qa hopefully for all the changes, merged >> the manpage into procpmda, and added a new error code. Feel free to >> drop that last one if you think its unnecessary. It should be its own >> commit. >> > I've left that last one for now - needs a bit more discussion I guess, as > an ABI extension. I like it though. We should probably audit the three/ > four other PMDAs that already use PM_ERR_CONV and switch 'em over. Sounds good. > > Ken - any other thoughts on a specific error code for bad pmStore to a PMDA? > (Oh, maybe the name PM_ERR_BADSTORE to match your error message more closely > Martins? the "FMT" part I found a little bit cryptic) I like yours better, I was struggling for a good name. Thanks Martins From minnus@buffalo.edu Thu Apr 30 15:06:20 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id 929A77F37 for ; Thu, 30 Apr 2015 15:06:20 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id 780538F8050 for ; Thu, 30 Apr 2015 13:06:20 -0700 (PDT) X-ASG-Debug-ID: 1430424375-04cb6c1cc84830f0001-S8gJnT Received: from mtareserve1.acsu.buffalo.edu (mtareserve3.acsu.buffalo.edu [128.205.7.163]) by cuda.sgi.com with ESMTP id aJQGKqlEOMu07VIX for ; Thu, 30 Apr 2015 13:06:15 -0700 (PDT) X-Barracuda-Envelope-From: minnus@buffalo.edu X-Barracuda-Apparent-Source-IP: 128.205.7.163 Received: from localmailf.acsu.buffalo.edu (localmailf.acsu.buffalo.edu [128.205.4.17]) by mtareserve1.acsu.buffalo.edu (Postfix) with ESMTP id 35CA03FA for ; Thu, 30 Apr 2015 16:06:15 -0400 (EDT) Received: from localmailf.acsu.buffalo.edu (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 0ED598007F for ; Thu, 30 Apr 2015 16:06:17 -0400 (EDT) Received: from localmailf.acsu.buffalo.edu (localhost [127.0.0.1]) by localmailf.acsu.buffalo.edu (Postfix) with ESMTP id 4103980086 for ; Thu, 30 Apr 2015 16:06:16 -0400 (EDT) Received: from smtp.buffalo.edu (smtp4.acsu.buffalo.edu [128.205.5.229]) by localmailf.acsu.buffalo.edu (Prefixe) with ESMTP id 3E2B48007F for ; Thu, 30 Apr 2015 16:06:16 -0400 (EDT) Received: from [128.205.28.168] (slash.eng.buffalo.edu [128.205.28.168]) (Authenticated sender: minnus@buffalo.edu) by smtp.buffalo.edu (Postfix) with ESMTPSA id 532E9D2C09 for ; Thu, 30 Apr 2015 16:06:14 -0400 (EDT) Message-ID: <55428B32.5040301@buffalo.edu> Date: Thu, 30 Apr 2015 16:06:10 -0400 From: Martins Innus User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp developers Subject: build webapp packages Content-Type: text/plain; charset=utf-8; format=flowed X-ASG-Orig-Subj: build webapp packages Content-Transfer-Encoding: 7bit X-PM-EL-Spam-Prob: : 8% X-Barracuda-Connect: mtareserve3.acsu.buffalo.edu[128.205.7.163] X-Barracuda-Start-Time: 1430424375 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 1.00 X-Barracuda-Spam-Status: No, SCORE=1.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC0_MV0613 X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18501 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 1.00 BSF_SC0_MV0613 BSF_SC0_MV0613 Hi, I've been playing with pcp vector and grafana support just by downloaded the files and pointing pmwebd at those directories and the functionality is really impressive! Now I'm probably missing something obvious but I can't figure out how to build any of the pcp-webapp packages for RHEL/CentOS. I see there are packages here for 5: ftp://ftp.pcp.io/projects/pcp/download/rpm/pcp-3.10.4/el5/x86_64/ So there must be a recipe somewhere. I'm trying to build for 6.6 and 7. I cloned the pcp-webjs git repo into my local pcp directory so then I have a pcp-webjs directory, then tried the standard ./Makepkgs with no luck. I don't get any pcp-webapp rpms at the end of that process as I expected. pcp-webapi builds fine. Do I need to copy the appropriate bits from fedora.spec into pcp.spec.in? Thanks Martins From nscott@redhat.com Thu Apr 30 18:09:12 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id C1CE07F47 for ; Thu, 30 Apr 2015 18:09:12 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id 4720AAC003 for ; Thu, 30 Apr 2015 16:09:08 -0700 (PDT) X-ASG-Debug-ID: 1430435346-04cbb056b14d66d0001-S8gJnT Received: from mx6-phx2.redhat.com (mx6-phx2.redhat.com [209.132.183.39]) by cuda.sgi.com with ESMTP id gr9XDuOFfzOx4t9s (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 30 Apr 2015 16:09:07 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.39 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx6-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3UN922t026348; Thu, 30 Apr 2015 19:09:02 -0400 Date: Thu, 30 Apr 2015 19:09:02 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus , Ken McDonell Cc: pcp@oss.sgi.com Message-ID: <811088251.10742489.1430435342244.JavaMail.zimbra@redhat.com> In-Reply-To: <55422C85.7060307@buffalo.edu> References: <5536A934.8040002@buffalo.edu> <5537A3F3.5060204@buffalo.edu> <233739221.5258413.1429764654377.JavaMail.zimbra@redhat.com> <55392BAB.3060101@buffalo.edu> <806884984.5885784.1429839438565.JavaMail.zimbra@redhat.com> <554128C1.8080901@buffalo.edu> <102929865.10042134.1430363515688.JavaMail.zimbra@redhat.com> <55422C85.7060307@buffalo.edu> Subject: Re: [pcp] Hotproc fixes MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] Hotproc fixes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.85] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: Hotproc fixes Thread-Index: pA6RJ/K/zF6l7E+2ZX0Btem8JM4b0A== X-Barracuda-Connect: mx6-phx2.redhat.com[209.132.183.39] X-Barracuda-Start-Time: 1430435347 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18505 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > Nathan, > > On 4/29/2015 11:11 PM, Nathan Scott wrote: > >> Also included some other cleanup suggestions from Marko, the ability to > >> reload the config file, updated qa hopefully for all the changes, merged > >> the manpage into procpmda, and added a new error code. Feel free to > >> drop that last one if you think its unnecessary. It should be its own > >> commit. > >> > > I've left that last one for now - needs a bit more discussion I guess, as > > an ABI extension. I like it though. We should probably audit the three/ > > four other PMDAs that already use PM_ERR_CONV and switch 'em over. > > Sounds good. > > > > > Ken - any other thoughts on a specific error code for bad pmStore to a > > PMDA? > > (Oh, maybe the name PM_ERR_BADSTORE to match your error message more > > closely > > Martins? the "FMT" part I found a little bit cryptic) > I like yours better, I was struggling for a good name. OK - if there's no objections, lets go ahead with it - do you want to do the honours Martins? cheers. -- Nathan From nscott@redhat.com Thu Apr 30 18:09:42 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id E509D7F47 for ; Thu, 30 Apr 2015 18:09:42 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay1.corp.sgi.com (Postfix) with ESMTP id B6D638F8040 for ; Thu, 30 Apr 2015 16:09:42 -0700 (PDT) X-ASG-Debug-ID: 1430435380-04bdf063224e3490001-S8gJnT Received: from mx5-phx2.redhat.com (mx5-phx2.redhat.com [209.132.183.37]) by cuda.sgi.com with ESMTP id O3oFBLEhqVEAVPN5 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 30 Apr 2015 16:09:40 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.37 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx5-phx2.redhat.com (8.14.4/8.14.4) with ESMTP id t3UN9cd6039927; Thu, 30 Apr 2015 19:09:38 -0400 Date: Thu, 30 Apr 2015 19:09:38 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: henry c Cc: pcp developers Message-ID: <1853303344.10742742.1430435378053.JavaMail.zimbra@redhat.com> In-Reply-To: References: <513687800.9959776.1430348643936.JavaMail.zimbra@redhat.com> Subject: Re: PCP 3.10.5 MIME-Version: 1.0 X-ASG-Orig-Subj: Re: PCP 3.10.5 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.85] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: PCP 3.10.5 Thread-Index: 1ILkrSbpioaTjOk/QI4Ecg7d8jJcZA== X-Barracuda-Connect: mx5-phx2.redhat.com[209.132.183.37] X-Barracuda-Start-Time: 1430435380 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18505 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi there Henry, (CC'ing the PCP list in case others come across this phenomenon too) ----- Original Message ----- > Hey Nathan, > > Thanks for the quick response! > > I was able to install the new code, and get data from those 3 new metrics. > > However the cgroup.memory.limit looks weird to me, i dont think this is in > bit or bytes since it would be too large. Thanks for trying it out! These values are sourced from the kernel via the cgroup pseudo-filesystem, and we pass back (unmodified) the contents of the statistics files for each cgroup. You should be able to find these files and check what limits/usage the kernel is applying. For cgroups that are used in Docker containers, you should see things like: $ cat /sys/fs/cgroup/memory/system.slice/docker-c4f1a5c72ee11e819c1560b6a3be752d3dd6486f84df8322647ad96a184f1f4d.scope/memory.max_usage_in_bytes 14336000 $ cat /sys/fs/cgroup/memory/system.slice/docker-c4f1a5c72ee11e819c1560b6a3be752d3dd6486f84df8322647ad96a184f1f4d.scope/memory.usage_in_bytes 528384 $ docker ps | grep c4f1a5c72ee c4f1a5c72ee1 fedora:20 "/bin/bash" 18 hours ago Up 18 hours jovial_galileo $ pminfo --fetch --container=jovial_galileo cgroup.memory.usage cgroup.memory.usage inst [0 or "/system.slice/docker-c4f1a5c72ee11e819c1560b6a3be752d3dd6486f84df8322647ad96a184f1f4d.scope"] value 528384 cheers. -- Nathan From nscott@redhat.com Thu Apr 30 18:12:01 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 9FE0C7F47 for ; Thu, 30 Apr 2015 18:12:01 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay2.corp.sgi.com (Postfix) with ESMTP id 8E577304048 for ; Thu, 30 Apr 2015 16:11:58 -0700 (PDT) X-ASG-Debug-ID: 1430435513-04cbb056b44d6790001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id WHBn7hTYSXyY6otA (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 30 Apr 2015 16:11:54 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t3UNBqev019436; Thu, 30 Apr 2015 19:11:52 -0400 Date: Thu, 30 Apr 2015 19:11:52 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: Martins Innus Cc: pcp developers Message-ID: <399028968.10743381.1430435512674.JavaMail.zimbra@redhat.com> In-Reply-To: <55428B32.5040301@buffalo.edu> References: <55428B32.5040301@buffalo.edu> Subject: Re: [pcp] build webapp packages MIME-Version: 1.0 X-ASG-Orig-Subj: Re: [pcp] build webapp packages Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.85] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: build webapp packages Thread-Index: yXd4gyG2UBHX/JE7T7yu8MW56xllUw== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1430435514 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18505 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... Hi Martins, ----- Original Message ----- > Hi, > > I've been playing with pcp vector and grafana support just by downloaded > the files and pointing pmwebd at those directories and the functionality > is really impressive! > > Now I'm probably missing something obvious but I can't figure out how to > build any of the pcp-webapp packages for RHEL/CentOS. I see there are > packages here for 5: > > ftp://ftp.pcp.io/projects/pcp/download/rpm/pcp-3.10.4/el5/x86_64/ > > So there must be a recipe somewhere. I'm trying to build for 6.6 and 7. > Currently, the only package building we do for external trees like webjs is via fedora.spec - which is fairly limiting, and something I'd like to start to tackle. We are seeing increasing numbers of external trees (eg vector, webjs, parfait, pcp2pdf, pcp-cpp-pmda, ...), and a more general solution to help build packages for those projects too would be great. > expected. pcp-webapi builds fine. Do I need to copy the appropriate bits > from fedora.spec into pcp.spec.in? Hmm, you know, I think we can solve this more easily for Makepkgs builds - how about this: - allow people to optionally drop in certain external source tarballs in a preset location (say, below build/tar/) - configure.ac looks for any external source tarballs below build/tar and, if present, these can flip switches in the build and incorporate those external sources into the build (bit like fedora.spec does). - add to pcp.spec.in (and debian/* builds) conditional code for the new packges, along the lines of the @enable_python3@ guard around "python3-pcp". - hey presto, we'd be able to have optionally built packages for any of the external projects - and a handy generalised solution going forward I think. cheers. -- Nathan From hc3249@gmail.com Thu Apr 30 18:45:24 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.3 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT, FREEMAIL_FROM,HTML_MESSAGE,T_DKIM_INVALID autolearn=no version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id C68B67F47 for ; Thu, 30 Apr 2015 18:45:24 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id B5043304032 for ; Thu, 30 Apr 2015 16:45:24 -0700 (PDT) X-ASG-Debug-ID: 1430437522-04cb6c1cc7487410001-S8gJnT Received: from mail-qk0-f177.google.com (mail-qk0-f177.google.com [209.85.220.177]) by cuda.sgi.com with ESMTP id Yx86Py5KszYzgvxC (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Thu, 30 Apr 2015 16:45:23 -0700 (PDT) X-Barracuda-Envelope-From: hc3249@gmail.com X-Barracuda-Apparent-Source-IP: 209.85.220.177 X-Barracuda-IPDD: Level1 [gmail.com/209.85.220.177] Received: by qkgx75 with SMTP id x75so43371647qkg.1 for ; Thu, 30 Apr 2015 16:45:22 -0700 (PDT) X-Barracuda-IPDD: Level1 [gmail.com/209.85.220.177] X-Barracuda-IPDD: Level1 [gmail.com/209.85.220.177] DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=eMqXtcYg0pvfJtXeZ/o2RYh61CvmwS0cQ9/YAIHcIzY=; b=PFiZwh9fY3BuvIzSOKemfTMzqDNskDr9h+GgY8h8Dxnji7toy8yK8MLiQ76KD83yv8 16iCfso1Y27S3ozz6n9qDoyryGdK63iIYoB4NSHuBTW+UF1T2X2KtLpwnhvuV0RSoZOF s+WyFakxP7UwEuj+ZXU5OWTwEAKiQKBnKP19Bc58pLdwg0F69WVsVrM93rN57f6buods vDsXkqHKbEBxRNkFIocWrRNwgLGDcgbfCpqED9jbSY6RRNVkoqc9mFqRvnuhEY2GbrA7 TIqz4atl0SBxhymg0mWrZlKNhny9f1msbrUtXpLwSJvLJYR1gexv43fbdaggpbx5zErb hZBg== MIME-Version: 1.0 X-Received: by 10.140.145.81 with SMTP id 78mr3610244qhr.45.1430437522519; Thu, 30 Apr 2015 16:45:22 -0700 (PDT) Received: by 10.13.247.5 with HTTP; Thu, 30 Apr 2015 16:45:22 -0700 (PDT) In-Reply-To: <1853303344.10742742.1430435378053.JavaMail.zimbra@redhat.com> References: <513687800.9959776.1430348643936.JavaMail.zimbra@redhat.com> <1853303344.10742742.1430435378053.JavaMail.zimbra@redhat.com> Date: Thu, 30 Apr 2015 16:45:22 -0700 Message-ID: Subject: Re: PCP 3.10.5 From: henry c X-ASG-Orig-Subj: Re: PCP 3.10.5 To: Nathan Scott Cc: pcp developers Content-Type: multipart/alternative; boundary=001a11356386673adf0514f9b0a3 X-Barracuda-Connect: mail-qk0-f177.google.com[209.85.220.177] X-Barracuda-Start-Time: 1430437523 X-Barracuda-Encrypted: RC4-SHA X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=DKIM_SIGNED, DKIM_VERIFIED, HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18505 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- -0.00 DKIM_VERIFIED Domain Keys Identified Mail: signature passes verification 0.00 DKIM_SIGNED Domain Keys Identified Mail: message has a signature 0.00 HTML_MESSAGE BODY: HTML included in message --001a11356386673adf0514f9b0a3 Content-Type: text/plain; charset=UTF-8 Nathan, Thanks for the response. For me at least, the numbers are not matching. CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 5a86bb5685bc fbe679c040d6 "/bin/sh -c '/usr/lo 2 weeks ago Up 2 weeks serene_pike host:/sys/fs/cgroup/memory/docker/5a86bb5685bcfc87159f2578079703efc172c662ac9702757f1829b53d15d8f6# cat memory.max_usage_in_bytes 1822720 and calling the api returns this, with all instance having the same value { "pmid": 12629073, "name": "cgroup.memory.limit", "instances": [ { "instance": 0, "value": 18446744073709552000 }, { Thanks, -Henry On Thu, Apr 30, 2015 at 4:09 PM, Nathan Scott wrote: > Hi there Henry, > > (CC'ing the PCP list in case others come across this phenomenon too) > > ----- Original Message ----- > > Hey Nathan, > > > > Thanks for the quick response! > > > > I was able to install the new code, and get data from those 3 new > metrics. > > > > However the cgroup.memory.limit looks weird to me, i dont think this is > in > > bit or bytes since it would be too large. > > Thanks for trying it out! These values are sourced from the kernel via the > cgroup pseudo-filesystem, and we pass back (unmodified) the contents of the > statistics files for each cgroup. > > You should be able to find these files and check what limits/usage the > kernel > is applying. For cgroups that are used in Docker containers, you should > see > things like: > > $ cat > /sys/fs/cgroup/memory/system.slice/docker-c4f1a5c72ee11e819c1560b6a3be752d3dd6486f84df8322647ad96a184f1f4d.scope/memory.max_usage_in_bytes > 14336000 > $ cat > /sys/fs/cgroup/memory/system.slice/docker-c4f1a5c72ee11e819c1560b6a3be752d3dd6486f84df8322647ad96a184f1f4d.scope/memory.usage_in_bytes > 528384 > > $ docker ps | grep c4f1a5c72ee > c4f1a5c72ee1 fedora:20 "/bin/bash" 18 hours ago > Up 18 hours jovial_galileo > > $ pminfo --fetch --container=jovial_galileo cgroup.memory.usage > > cgroup.memory.usage > inst [0 or > "/system.slice/docker-c4f1a5c72ee11e819c1560b6a3be752d3dd6486f84df8322647ad96a184f1f4d.scope"] > value 528384 > > > cheers. > > -- > Nathan > --001a11356386673adf0514f9b0a3 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
      Nathan,

      Thanks for the response.
      <= div>
      For me at least, the numbers are not matching.


      CONTAINER ID=C2=A0 =C2=A0 =C2=A0 =C2=A0 IMAG= E =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 COMMAND=C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 CREATED =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 STATUS=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 PORTS = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 NAMES

      5a86bb5685bc=C2=A0 =C2=A0 =C2=A0 =C2=A0 fbe6= 79c040d6=C2=A0 =C2=A0 =C2=A0 =C2=A0 "/bin/sh -c '/usr/lo =C2=A0 2 = weeks ago =C2=A0 =C2=A0 =C2=A0 =C2=A0 Up 2 weeks=C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 serene_pike


      host:/sys/fs/cgroup/memory/docker/5a86bb5685= bcfc87159f2578079703efc172c662ac9702757f1829b53d15d8f6#=C2=A0cat mem= ory.max_usage_in_bytes

      1822720


      and calling the api ret= urns this, with all instance having the same value

      =

      =C2=A0 =C2=A0 =C2=A0 =C2=A0 {=

      =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 "pmid"= ;: 12629073,

      =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 &qu= ot;name": "cgroup.memory.limit",

      =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 "instances": [

      = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 {

      = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 "= ;instance": 0,

      =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 "value": 18446744073709552000

      =

      =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 },

      =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 {


      Thanks,

      -Henry


      On Thu, Apr 30, 2015 at 4:09 PM, Nathan= Scott <nathans@redhat.com> wrote:
      Hi there Henry,

      (CC'ing the PCP list in case others come across this phenomenon too)
      ----- Original Message -----
      > Hey Nathan,
      >
      > Thanks for the quick response!
      >
      > I was able to install the new code, and get data from those 3 new metr= ics.
      >
      > However the cgroup.memory.limit looks weird to me, i dont think this i= s in
      > bit or bytes since it would be too large.

      Thanks for trying it out!=C2=A0 These values are sourced from the ke= rnel via the
      cgroup pseudo-filesystem, and we pass back (unmodified) the contents of the=
      statistics files for each cgroup.

      You should be able to find these files and check what limits/usage the kern= el
      is applying.=C2=A0 For cgroups that are used in Docker containers, you shou= ld see
      things like:

      $ cat /sys/fs/cgroup/memory/system.slice/docker-c4f1a5c72ee11e819c1560b6a3b= e752d3dd6486f84df8322647ad96a184f1f4d.scope/memory.max_usage_in_bytes
      14336000
      $ cat /sys/fs/cgroup/memory/system.slice/docker-c4f1a5c72ee11e819c1560b6a3b= e752d3dd6486f84df8322647ad96a184f1f4d.scope/memory.usage_in_bytes
      528384

      $ docker ps | grep c4f1a5c72ee
      c4f1a5c72ee1=C2=A0 =C2=A0 =C2=A0 =C2=A0 fedora:20=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0"/bin/bash"=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A018 = hours ago=C2=A0 =C2=A0 =C2=A0 =C2=A0 Up 18 hours=C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0jovial_galileo

      $ pminfo --fetch --container=3Djovial_galileo cgroup.memory.usage

      cgroup.memory.usage
      =C2=A0 =C2=A0 inst [0 or "/system.slice/docker-c4f1a5c72ee11e819c1560b= 6a3be752d3dd6486f84df8322647ad96a184f1f4d.scope"] value 528384


      cheers.

      --
      Nathan

      --001a11356386673adf0514f9b0a3-- From nscott@redhat.com Thu Apr 30 19:42:24 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id E5F2F7F47 for ; Thu, 30 Apr 2015 19:42:24 -0500 (CDT) Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by relay2.corp.sgi.com (Postfix) with ESMTP id C809630404E for ; Thu, 30 Apr 2015 17:42:21 -0700 (PDT) X-ASG-Debug-ID: 1430440939-04bdf063214e4df0001-S8gJnT Received: from mx4-phx2.redhat.com (mx4-phx2.redhat.com [209.132.183.25]) by cuda.sgi.com with ESMTP id EGBYE3HCXMEvOBRR (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Thu, 30 Apr 2015 17:42:20 -0700 (PDT) X-Barracuda-Envelope-From: nscott@redhat.com X-Barracuda-Apparent-Source-IP: 209.132.183.25 Received: from zmail20.collab.prod.int.phx2.redhat.com (zmail20.collab.prod.int.phx2.redhat.com [10.5.83.23]) by mx4-phx2.redhat.com (8.13.8/8.13.8) with ESMTP id t410gIq8000354; Thu, 30 Apr 2015 20:42:18 -0400 Date: Thu, 30 Apr 2015 20:42:18 -0400 (EDT) From: Nathan Scott Reply-To: Nathan Scott To: henry c Cc: pcp developers Message-ID: <387105783.10772929.1430440938185.JavaMail.zimbra@redhat.com> In-Reply-To: References: <513687800.9959776.1430348643936.JavaMail.zimbra@redhat.com> <1853303344.10742742.1430435378053.JavaMail.zimbra@redhat.com> Subject: Re: PCP 3.10.5 MIME-Version: 1.0 X-ASG-Orig-Subj: Re: PCP 3.10.5 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [10.64.51.85] X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - FF37 (Linux)/8.0.6_GA_5922) Thread-Topic: PCP 3.10.5 Thread-Index: +tQrDgQ6NGSIz1zEca21u1hZU3IiCw== X-Barracuda-Connect: mx4-phx2.redhat.com[209.132.183.25] X-Barracuda-Start-Time: 1430440939 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.157.11:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18508 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... ----- Original Message ----- > Nathan, > > Thanks for the response. > > For me at least, the numbers are not matching. > Oh, thats interesting - sounds a little like another issue I'm chasing at the moment. Does pminfo(1) give you the correct answer? cheers. -- Nathan From wwwrun@oss.sgi.com Thu Apr 30 21:08:03 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 8E5EF7F51; Thu, 30 Apr 2015 21:08:03 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1106] pmdalinux / pmdaroot container problems Date: Fri, 01 May 2015 02:08:02 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: nathans@debian.org X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@oss.sgi.com X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1430446083.6A77dCc22.22709"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1430446083.6A77dCc22.22709 Date: Thu, 30 Apr 2015 21:08:03 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1106 Nathan Scott changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |nathans@debian.org --- Comment #2 from Nathan Scott --- (In reply to comment #1) > some progress - in a container, the NET_ADDR_INDOM (using ioctl(fd, > SIOCGIFCONF, ..) is the same namespace as the host not of the container, but > the NET_DEV_INDOM maps to the net namespace in the container (exported as > /proc/net/dev). I think I have a handle on the underlying problem for this aspect at least now - fix should follow later today. -- You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug. --1430446083.6A77dCc22.22709 Date: Thu, 30 Apr 2015 21:08:03 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" changed bug 1106
      What Removed Added
      CC   nathans@debian.org

      Comment # 2 on bug 1106 from 
      (In reply to comment #1)
> some progress - in a container, the NET_ADDR_INDOM (using ioctl(fd,
> SIOCGIFCONF, ..) is the same namespace as the host not of the container, but
> the NET_DEV_INDOM maps to the net namespace in the container (exported as
> /proc/net/dev).

I think I have a handle on the underlying problem for this aspect at least now
- fix should follow later today.

      You are receiving this mail because:
      • You are on the CC list for the bug.
      • You are the assignee for the bug.
      --1430446083.6A77dCc22.22709-- From wwwrun@oss.sgi.com Thu Apr 30 21:15:29 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=HTML_MESSAGE,NO_RELAYS autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: by oss.sgi.com (Postfix, from userid 30) id 2D0A77F51; Thu, 30 Apr 2015 21:15:29 -0500 (CDT) From: bugzilla-daemon@oss.sgi.com To: pcp@oss.sgi.com Subject: [Bug 1106] pmdalinux / pmdaroot container problems Date: Fri, 01 May 2015 02:15:29 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Classification: Unclassified X-Bugzilla-Product: pcp X-Bugzilla-Component: pcp X-Bugzilla-Keywords: X-Bugzilla-Severity: major X-Bugzilla-Who: mgoodwin@redhat.com X-Bugzilla-Status: NEW X-Bugzilla-Priority: P5 X-Bugzilla-Assigned-To: pcp@oss.sgi.com X-Bugzilla-Target-Milestone: --- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: multipart/alternative; boundary="1430446529.E1b6E512.23442"; charset="us-ascii" X-Bugzilla-URL: http://oss.sgi.com/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 --1430446529.E1b6E512.23442 Date: Thu, 30 Apr 2015 21:15:29 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" http://oss.sgi.com/bugzilla/show_bug.cgi?id=1106 --- Comment #3 from Mark Goodwin --- for network.interface.inet_addr (at least) you can walk /proc/net/dev (using the net namespace) and then use code like the following : #include #include #include #include #include #include #include #include #include int main(int argc, char *argv[]) { int i, fd; struct ifreq ifr; fd = socket(AF_INET, SOCK_DGRAM, 0); ifr.ifr_addr.sa_family = AF_INET; for (i=1; i < argc; i++) { strncpy(ifr.ifr_name, argv[i], IFNAMSIZ-1); if (ioctl(fd, SIOCGIFADDR, &ifr) == 0) printf("%s %s\n", inet_ntoa(((struct sockaddr_in *)&ifr.ifr_addr)->sin_addr), argv[i]); } close(fd); return 0; } With the above code, the NET_ADDR_INDOM and NET_DEV_INDOM indoms could be combined couldn't they? -- You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug. --1430446529.E1b6E512.23442 Date: Thu, 30 Apr 2015 21:15:29 -0500 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8"

      Comment # 3 on bug 1106 from 
      for network.interface.inet_addr (at least) you can walk /proc/net/dev (using
the net namespace) and then use code like the following :

#include <stdio.h>
#include <unistd.h>
#include <string.h>

#include <sys/types.h>
#include <sys/socket.h>
#include <sys/ioctl.h>
#include <netinet/in.h>
#include <net/if.h>
#include <arpa/inet.h>

int
main(int argc, char *argv[])
{
    int i, fd;
    struct ifreq ifr;

    fd = socket(AF_INET, SOCK_DGRAM, 0);
    ifr.ifr_addr.sa_family = AF_INET;

    for (i=1; i < argc; i++) {
        strncpy(ifr.ifr_name, argv[i], IFNAMSIZ-1);
        if (ioctl(fd, SIOCGIFADDR, &ifr) == 0)
            printf("%s %s\n", inet_ntoa(((struct sockaddr_in
*)&ifr.ifr_addr)->sin_addr), argv[i]);
    }

    close(fd);
    return 0;
}

With the above code, the NET_ADDR_INDOM and NET_DEV_INDOM indoms could be
combined couldn't they?

      You are receiving this mail because:
      • You are on the CC list for the bug.
      • You are the assignee for the bug.
      --1430446529.E1b6E512.23442-- From kenj@internode.on.net Thu Apr 30 23:45:50 2015 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.3.1 X-Original-To: pcp@oss.sgi.com Delivered-To: pcp@oss.sgi.com Received: from relay.sgi.com (relay1.corp.sgi.com [137.38.102.111]) by oss.sgi.com (Postfix) with ESMTP id E6DCB7F47 for ; Thu, 30 Apr 2015 23:45:50 -0500 (CDT) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay1.corp.sgi.com (Postfix) with ESMTP id D53428F8033 for ; Thu, 30 Apr 2015 21:45:50 -0700 (PDT) X-ASG-Debug-ID: 1430455544-04cb6c1cc748c520001-S8gJnT Received: from ipmail04.adl6.internode.on.net (ipmail04.adl6.internode.on.net [150.101.137.141]) by cuda.sgi.com with ESMTP id lF0wfkSARHMKnGCB for ; Thu, 30 Apr 2015 21:45:45 -0700 (PDT) X-Barracuda-Envelope-From: kenj@internode.on.net X-Barracuda-Apparent-Source-IP: 150.101.137.141 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2C+AQDyA0NVPKEh0XYNT4NfXIMdgy7AYIgyAQEBAQEBBwEBAQFBhQlVMAYCBRYLAgsDAgECATEnBgIBAbs+cJNrgSGPOYJSgUUFlXmcPYQpXYJFAQEB Received: from ppp118-209-33-161.lns20.mel4.internode.on.net (HELO [192.168.1.100]) ([118.209.33.161]) by ipmail04.adl6.internode.on.net with ESMTP; 01 May 2015 14:15:43 +0930 Message-ID: <554304F6.5050105@internode.on.net> Date: Fri, 01 May 2015 14:45:42 +1000 From: Ken McDonell User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: pcp@oss.sgi.com Subject: pcp updates - Debian and systemctl Content-Type: text/plain; charset=utf-8 X-ASG-Orig-Subj: pcp updates - Debian and systemctl Content-Transfer-Encoding: 7bit X-Barracuda-Connect: ipmail04.adl6.internode.on.net[150.101.137.141] X-Barracuda-Start-Time: 1430455544 X-Barracuda-URL: http://192.48.176.15:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.50 X-Barracuda-Spam-Status: No, SCORE=0.50 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.7 tests=BSF_SC1_TG070 X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.18511 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.50 BSF_SC1_TG070 Custom Rule TG070 Changes committed to git://git.pcp.io/kenj/pcp master Ken McDonell (4): src/pmcd/rc-proc.sh: more cautious approach to using systemctl qa/admin/myconfigure: be smarter and more robust qa/common.check: track init-rc changes for systemctl qa/555: track init-rc changes for systemctl qa/555 | 2 - qa/admin/myconfigure | 91 ++++++++++++++++++++++++++++++++++++++++++++++++--- qa/common.check | 26 +++++++++++++- src/pmcd/rc-proc.sh | 15 ++++++-- 4 files changed, 122 insertions(+), 12 deletions(-) Details ... commit 2992b429e5986c8ffca594e3e7162ad87e020b81 Author: Ken McDonell Date: Fri May 1 12:20:14 2015 +1000 qa/555: track init-rc changes for systemctl Make logic here follow the new logic in src/pmcd/rc-proc.sh. commit b2eb781fd753ccb5260857c44de163e240c236ed Author: Ken McDonell Date: Fri May 1 12:18:29 2015 +1000 qa/common.check: track init-rc changes for systemctl Make logic here follow the new logic in src/pmcd/rc-proc.sh. commit d312d7d38c1d5060e4fb064103c202e6fe049598 Author: Ken McDonell Date: Fri May 1 12:12:20 2015 +1000 qa/admin/myconfigure: be smarter and more robust First, get the Debian configopts directly from debian/rules instead of replicating the settings here and risking them diverging over time ... as happened! Second, for all platforms, since the objective of this script is to set up the workarea so that Makepkgs and make followed by "sudo make install" will produce the same results, try and check that the critical files installed from the package(s) (if found) match the corresponding files in the workarea after configure has been run. commit 51798da2e1000bec1ab7afd0661d2f610bc79d40 Author: Ken McDonell Date: Fri May 1 09:40:43 2015 +1000 src/pmcd/rc-proc.sh: more cautious approach to using systemctl On some Debian-derived systems, systemctl is present but a real systemd is not and our Debian builds are currently configured with --without-systemd. This commit makes the logic more restricitve so we'll only try and uses systemctl to control service "foo" if - systemctl inary exists, and - $PCP_SYSTEMDUNIT_DIR is not empty, and - $PCP_SYSTEMDUNIT_DIR/foo.service exists