pcp
[Top] [All Lists]

Re: [performancecopilot/pcp] pmwebd impossibly slow when using grafana w

To: performancecopilot/pcp <pcp@xxxxxxxxxxxxxxxxxx>
Subject: Re: [performancecopilot/pcp] pmwebd impossibly slow when using grafana with 300 archives (#117)
From: Marko Kevac <notifications@xxxxxxxxxx>
Date: Tue, 04 Oct 2016 05:25:44 -0700
Delivered-to: pcp@xxxxxxxxxxx
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=github.com; s=pf2014; t=1475583944; bh=iDoxmQuMSS9TmNsMoi07JQhh76FxH33JEg5ZtuELFXs=; h=From:Reply-To:To:In-Reply-To:References:Subject:List-ID: List-Archive:List-Post:List-Unsubscribe:From; b=X40kVBJUBKisRw2RlIy/jI8LqpEjUf4/xklnpLQLnEtFwRKvtgZC5VbQ28zkibpTZ hclQyFrdb05/uE+evenf6X0YBKdDhWX4yFoXid8gBcazFJ30ok9qtVtuFNWB56VK8v UGI+eIJ6VgMVqOakpWJfCiQeLqR4y/cT5lvbixY4=
In-reply-to: <performancecopilot/pcp/issues/117@xxxxxxxxxx>
List-archive: https://github.com/performancecopilot/pcp
List-id: performancecopilot/pcp <pcp.performancecopilot.github.com>
List-post: <mailto:reply+00bd08b6a855b06aecdeda5ac21bf863a94941a72d5bd64b92cf00000001140b61c892a169ce0abb9393@reply.github.com>
List-unsubscribe: <mailto:unsub+00bd08b6a855b06aecdeda5ac21bf863a94941a72d5bd64b92cf00000001140b61c892a169ce0abb9393@reply.github.com>, <https://github.com/notifications/unsubscribe/AL0ItlHOTlGXhD32LFbaOSvcgZsBo_QQks5qwkXIgaJpZM4KKD0Y>
References: <performancecopilot/pcp/issues/117@xxxxxxxxxx>
Reply-to: performancecopilot/pcp <reply+00bd08b6a855b06aecdeda5ac21bf863a94941a72d5bd64b92cf00000001140b61c892a169ce0abb9393@xxxxxxxxxxxxxxxx>

These are archives for one of the servers. One archive per day.

marko@xxxxxxxxxxxxxxxxx:/local/pcp/cppbig81.mlan> ll -h
total 11G
-rw-r--r-- 1 pcp pcp 807M Sep 29 01:12 20160928.0
-rw-r--r-- 1 pcp pcp 153K Sep 29 01:12 20160928.index
-rw-r--r-- 1 pcp pcp  24K Sep 28 14:22 20160928.meta
-rw-r--r-- 1 pcp pcp 1.8G Sep 30 01:09 20160929.0
-rw-r--r-- 1 pcp pcp 335K Sep 30 01:09 20160929.index
-rw-r--r-- 1 pcp pcp  24K Sep 29 01:12 20160929.meta
-rw-r--r-- 1 pcp pcp 1.8G Oct  1 01:09 20160930.0
-rw-r--r-- 1 pcp pcp 338K Oct  1 01:09 20160930.index
-rw-r--r-- 1 pcp pcp  24K Sep 30 01:09 20160930.meta
-rw-r--r-- 1 pcp pcp 1.8G Oct  2 00:58 20161001.0
-rw-r--r-- 1 pcp pcp 335K Oct  2 00:58 20161001.index
-rw-r--r-- 1 pcp pcp  24K Oct  1 01:09 20161001.meta
-rw-r--r-- 1 pcp pcp 1.8G Oct  3 00:48 20161002.0
-rw-r--r-- 1 pcp pcp 336K Oct  3 00:48 20161002.index
-rw-r--r-- 1 pcp pcp  24K Oct  2 00:58 20161002.meta
-rw-r--r-- 1 pcp pcp 1.4G Oct  3 18:52 20161003.00.10.0
-rw-r--r-- 1 pcp pcp 254K Oct  3 18:52 20161003.00.10.index
-rw-r--r-- 1 pcp pcp  24K Oct  3 00:48 20161003.00.10.meta
-rw-r--r-- 1 pcp pcp 992M Oct  4 08:16 20161003.18.57.0
-rw-r--r-- 1 pcp pcp 188K Oct  4 08:16 20161003.18.57.index
-rw-r--r-- 1 pcp pcp  24K Oct  3 18:57 20161003.18.57.meta
-rw-r--r-- 1 pcp pcp 291M Oct  4 12:22 20161004.08.28.0
-rw-r--r-- 1 pcp pcp  56K Oct  4 12:22 20161004.08.28.index
-rw-r--r-- 1 pcp pcp  24K Oct  4 08:28 20161004.08.28.meta
-rw-r--r-- 1 pcp pcp  222 Oct  4 08:28 Latest
-rw-r--r-- 1 pcp pcp 8.6K Oct  4 08:28 pmlogger.log
-rw-r--r-- 1 pcp pcp 8.9K Oct  4 08:16 pmlogger.log.prior

Server where collecting happens and pmwebd is has 64GiB of RAM and 24 CPUs.
We have disk space for approx 7 days when collection once a second.
They are not compressed.


You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

<Prev in Thread] Current Thread [Next in Thread>