pcp
[Top] [All Lists]

lustre pmda

To: pcp@xxxxxxxxxxx
Subject: lustre pmda
From: Martins Innus <minnus@xxxxxxxxxxx>
Date: Wed, 21 Jan 2015 13:26:44 -0500
Delivered-to: pcp@xxxxxxxxxxx
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.4.0
Hi,
I've been working on a new lustre pmda. Can be found here and merged if there are no issues:

https://github.com/ubccr/pcp/tree/lustre-pmda

Should merge cleanly with dev.

I didn't touch the existing lustrecomm pmda since the goal of that appears to be to support the communication layer of lustre. I am more interested in the overall filesystem statistics and it was easier for me to parse all the data with a perl pmda. Should have QA, manpage, etc. Let me know if I've missed anything. QA ran fine on two hosts, will run the rest overnight.

I will likely expand this as we find other metrics we are interested in.

We only have one small lustre filesystem. If anyone has some interesting or larger configurations, and can send me their /proc/fs/lustre and /proc/sys/lnet trees, I can add those to the QA.

Thanks

Martins


commit 317e7f480d617438d459bff8aebfb40cdf16e358
Merge: 8832bbb eee234a
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Wed Jan 21 13:16:19 2015 -0500

    Merge branch 'lustre-pmda' of github.com:ubccr/pcp into lustre-pmda

commit 8832bbb688ed296f1f427f50e71fae3da529dfd2
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Wed Jan 21 13:13:07 2015 -0500

    lustre pmda regex fixes

    Fix a missing escape
Minimize chance of error by using the array of metrics to generate the regex

 src/pmdas/lustre/pmdalustre.pl | 13 +++++++++----
 1 file changed, 9 insertions(+), 4 deletions(-)

commit eee234a364bc7643bcf5f357c5fe3fb2ac2fcacc
Merge: 819b183 05eb257
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Wed Jan 21 12:03:46 2015 -0500

    Merge branch 'dev' into lustre-pmda

commit 819b1835996e2b77d2940204fec40f2ab0bbf17f
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Wed Jan 21 11:32:08 2015 -0500

    Add a correct .out file for lustre qa

 qa/976.out |   34 +++++++++++++++++-----------------
 1 files changed, 17 insertions(+), 17 deletions(-)

commit ab71dbe3f4933f293a03fa125c90fc8dbf3c4ca4
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Wed Jan 21 15:55:34 2015 +0000

    Lustre pmda cleanups

    QA wasn't being installed properly
    Pick a sane domain number
    Add man page
    Better error handling if stats files are not found.  Turns
    out that pmda->err doesn't return a value.

 qa/976                                             |    9 ++-
 qa/GNUmakefile                                     |    2 +-
 qa/lustre/GNUmakefile                              |    2 +-
 qa/lustre/llite/GNUmakefile                        |    2 +-
 .../llite/lustre-ffff880378305c00/GNUmakefile      |    2 +-
 qa/lustre/lnet/GNUmakefile                         |    2 +-
src/pmdas/lustre/pmdalustre.1 | 59 ++++++++++++++++++++
 src/pmdas/lustre/pmdalustre.pl                     |   17 +++--
 src/pmns/stdpmid.pcp                               |    1 +
 9 files changed, 80 insertions(+), 16 deletions(-)

commit ceedd26a54e99031101014b4aa0fb40902846a04
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Thu Jan 8 16:37:55 2015 -0500

    Add QA for lustre pmda

qa/976 | 61 ++++++++++++++++++++
 qa/976.out                                         |   45 ++++++++++++++
 qa/group                                           |    1 +
 qa/lustre/GNUmakefile                              |   15 +++++
 qa/lustre/llite/GNUmakefile                        |   17 ++++++
 .../llite/lustre-ffff880378305c00/GNUmakefile      |   19 ++++++
 qa/lustre/llite/lustre-ffff880378305c00/stats      |   16 +++++
 qa/lustre/lnet/GNUmakefile                         |   18 ++++++
 qa/lustre/lnet/stats                               |    1 +
 src/pmdas/GNUmakefile                              |    2 +-
 10 files changed, 194 insertions(+), 1 deletions(-)

commit 94bc43d07c04d3852aa13274c3315d2070fe006f
Merge: 7f947da 64a0d4b
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Thu Jan 8 15:24:27 2015 -0500

    Merge branch 'dev' into lustre-pmda

commit 7f947da4a776d37fca07f90361d7be0caa7d7139
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Thu Jan 8 15:21:17 2015 -0500

    Lustre PMDA work

    llite cleanups
    add lnet metrics

src/pmdas/lustre/pmdalustre.pl | 274 +++++++++++++++++++++++++++++-----------
 1 files changed, 203 insertions(+), 71 deletions(-)

commit bf0f0c3e8550412c1952bc6a266561a6b8a93ca7
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Wed Jan 7 16:17:33 2015 -0500

    Lustre pmda work

    Still in progress
Initialize metrics to 0 since they are not reported by lustre if they are 0

 src/pmdas/lustre/GNUmakefile   |    2 +-
 src/pmdas/lustre/Install       |    2 +-
 src/pmdas/lustre/Remove        |    2 +-
src/pmdas/lustre/pmdalustre.pl | 90 +++++++++++++++++++++++++---------------
 4 files changed, 59 insertions(+), 37 deletions(-)

commit e2b69f74969520c5c093a3afd06ced52f1b5ab6a
Author: Martins Innus <minnus@xxxxxxxxxxx>
Date:   Wed Jan 7 14:42:02 2015 -0500

    Initial lustre pmda checkin.

    Work in progress.

 src/pmdas/lustre/GNUmakefile   |   45 ++++++++
 src/pmdas/lustre/Install       |   29 +++++
 src/pmdas/lustre/Remove        |   24 ++++
src/pmdas/lustre/pmdalustre.pl | 233 ++++++++++++++++++++++++++++++++++++++++
 4 files changed, 331 insertions(+), 0 deletions(-)

<Prev in Thread] Current Thread [Next in Thread>
  • lustre pmda, Martins Innus <=