From fant@pobox.com Thu Oct 10 09:28:06 2002 Received: with ECARTIS (v1.0.0; list csa); Thu, 10 Oct 2002 09:28:08 -0700 (PDT) Received: from net.bluemoon.net (root@net.bluemoon.net [63.237.147.10]) by oss.sgi.com (8.12.5/8.12.5) with SMTP id g9AGRxtG030876; Thu, 10 Oct 2002 09:28:05 -0700 Received: from localhost (fantom@localhost) by net.bluemoon.net (8.12.4/8.12.4) with ESMTP id g9AGRvBb024181; Thu, 10 Oct 2002 12:27:57 -0400 (EDT) (mail-from fant@pobox.com) X-Authentication-Warning: net.bluemoon.net: fantom owned process doing -bs Date: Thu, 10 Oct 2002 12:27:57 -0400 (EDT) From: Andrew Fant X-X-Sender: fantom@net.bluemoon.net To: pagg@oss.sgi.com, Subject: Status of development on PAGG and CSA Message-ID: <20021010122110.G21225-100000@net.bluemoon.net> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-archive-position: 2 X-ecartis-version: Ecartis v1.0.0 Sender: csa-bounce@oss.sgi.com Errors-to: csa-bounce@oss.sgi.com X-original-sender: fant@pobox.com Precedence: bulk X-list: csa *tap* *tap* *tap* Is this thing on? I'm sending this email to ask if there has been any more recent work done on the Process Aggregates and Comprehensive Accounting kernel patches for Linux. Once again, I am trying to build a cluster where these features are needed, and before I go too far in trying to shoehorn the relatively ancient patches on the FTP site into 2.4.19 with XFS, I wanted to make sure that there aren't new releases on the horizon. The last time I started in with this, there were already conflicts in the numbering of the system calls between the 2.4.2 patches for PAGG and the 2.4.9 stock kernel that I was supposed to use. Any other suggestions, comments, alternatives (*shudder*), etc. are, as always, welcomed. Thanks, Andy Andrew Fant | This | "If I could walk THAT way... Molecular Geek | Space | I wouldn't need the talcum powder!" fant@pobox.com | For | G. Marx (apropos of Aerosmith) Boston, MA USA | Hire | http://www.pharmawulf.com From jh@sgi.com Wed Oct 23 12:53:42 2002 Received: with ECARTIS (v1.0.0; list csa); Wed, 23 Oct 2002 12:53:48 -0700 (PDT) Received: from ledzep.americas.sgi.com (eaganfw1.sgi.com [198.149.7.1]) by oss.sgi.com (8.12.5/8.12.5) with SMTP id g9NJrfuR002115; Wed, 23 Oct 2002 12:53:41 -0700 Received: from thistle-e185.americas.sgi.com (thistle-e185.americas.sgi.com [128.162.185.204]) by ledzep.americas.sgi.com (SGI-8.9.3/americas-smart-nospam1.1) with ESMTP id OAA09162; Wed, 23 Oct 2002 14:53:44 -0500 (CDT) Received: from tux.americas.sgi.com (tux.americas.sgi.com [128.162.186.75]) by thistle-e185.americas.sgi.com (SGI-8.9.3/SGI-server-1.8) with ESMTP id OAA25678; Wed, 23 Oct 2002 14:53:43 -0500 (CDT) Received: (from jh@localhost) by tux.americas.sgi.com (8.11.6/8.11.6/erikj-RedHat-7.2-Eagan) id g9NJrgk06600; Wed, 23 Oct 2002 14:53:42 -0500 Date: Wed, 23 Oct 2002 14:53:42 -0500 From: John Hesterberg To: linux-kernel@vger.kernel.org, csa@oss.sgi.com, pagg@oss.sgi.com Cc: Robin Holt Subject: [PATCH] 2.5.44 CSA, Job, and PAGG Message-ID: <20021023145342.A6595@sgi.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5.1i X-archive-position: 3 X-ecartis-version: Ecartis v1.0.0 Sender: csa-bounce@oss.sgi.com Errors-to: csa-bounce@oss.sgi.com X-original-sender: jh@sgi.com Precedence: bulk X-list: csa 2.5.44 versions of CSA, Job, and PAGG patches are available at: ftp://oss.sgi.com/projects/pagg/download/linux-2.5.44-pagg.patch ftp://oss.sgi.com/projects/pagg/download/linux-2.5.44-job.patch ftp://oss.sgi.com/projects/csa/download/linux-2.5.44-csa.patch Apply them in that order. The CSA and job user-level code is in the same directories. CSA (Comprehensive System Accounting) provides methods for collecting per-process resource usage data, monitoring disk usage, and charging fees to specific login accounts. CSA provides features which are not available with the other Linux accounting packages. For more information, see: http://oss.sgi.com/projects/csa/ Linux Jobs is an inescapable process container that is typically created by point of entry processes like login, and inherited by children. PAGG (Process Aggregates) is a generic framework for implementing process containers such as Linux Jobs. For more information, see: http://oss.sgi.com/projects/pagg/ CSA depends on Linux Jobs, and Linux Jobs depends on PAGG. diffstat linux-2.5.44-pagg.patch Documentation/pagg.txt | 148 +++++++++++++++++ include/linux/init_task.h | 4 include/linux/pagg.h | 216 +++++++++++++++++++++++++ include/linux/sched.h | 4 init/Config.help | 6 init/Config.in | 1 kernel/Makefile | 3 kernel/exit.c | 4 kernel/fork.c | 11 + kernel/pagg.c | 396 ++++++++++++++++++++++++++++++++++++++++++++++ 10 files changed, 792 insertions(+), 1 deletion(-) diffstat linux-2.5.44-job.patch Documentation/job.txt | 434 ++++++++++ include/linux/job.h | 250 ++++++ init/Config.help | 22 init/Config.in | 3 kernel/Makefile | 3 kernel/job.c | 2001 ++++++++++++++++++++++++++++++++++++++++++++++++++ 6 files changed, 2712 insertions(+), 1 deletion(-) diffstat linux-2.5.44-csa.patch drivers/block/ll_rw_blk.c | 4 fs/exec.c | 4 fs/read_write.c | 25 include/linux/csa.h | 518 ++++++++++++++ include/linux/csa_internal.h | 84 ++ include/linux/sched.h | 20 init/Config.help | 19 init/Config.in | 1 kernel/Makefile | 1 kernel/csa_job_acct.c | 1582 +++++++++++++++++++++++++++++++++++++++++++ kernel/exit.c | 7 kernel/fork.c | 8 kernel/ksyms.c | 4 mm/memory.c | 18 mm/mmap.c | 10 mm/mremap.c | 8 mm/rmap.c | 3 mm/swapfile.c | 4 18 files changed, 2317 insertions(+), 3 deletions(-) John Hesterberg and Robin Holt From janfrode@ii.uib.no Thu Oct 24 00:46:21 2002 Received: with ECARTIS (v1.0.0; list csa); Thu, 24 Oct 2002 00:46:26 -0700 (PDT) Received: from smtp.ii.uib.no (eik.ii.uib.no [129.177.16.3]) by oss.sgi.com (8.12.5/8.12.5) with SMTP id g9O7kKuR024937; Thu, 24 Oct 2002 00:46:20 -0700 Received: from apal-192.ii.uib.no ([129.177.192.27] helo=apal.ii.uib.no) by smtp.ii.uib.no with esmtp (Exim 4.10) id 184Sve-00054z-00; Wed, 23 Oct 2002 23:20:38 +0200 Received: (from janfrode@localhost) by apal.ii.uib.no (8.11.6+Sun/8.11.6) id g9NLKcB04090; Wed, 23 Oct 2002 23:20:38 +0200 (MEST) Date: Wed, 23 Oct 2002 23:20:37 +0200 From: Jan-Frode Myklebust To: John Hesterberg Cc: linux-kernel@vger.kernel.org, csa@oss.sgi.com, pagg@oss.sgi.com, Robin Holt Message-ID: <20021023232037.A3752@ii.uib.no> References: <20021023145342.A6595@sgi.com> Mime-Version: 1.0 Content-Disposition: inline In-Reply-To: <20021023145342.A6595@sgi.com>; from jh@sgi.com on Wed, Oct 23, 2002 at 02:53:42PM -0500 Subject: Re: [PATCH] 2.5.44 CSA, Job, and PAGG Content-Type: text/plain; charset=us-ascii X-Scanner: exiscan *184Sve-00054z-00*.8WGmgJO90U* (ii.uib.no) X-Scanner: exiscan *184Sve-00054z-00*.8WGmgJO90U* (ii.uib.no) X-archive-position: 4 X-ecartis-version: Ecartis v1.0.0 Sender: csa-bounce@oss.sgi.com Errors-to: csa-bounce@oss.sgi.com X-original-sender: janfrode@parallab.no Precedence: bulk X-list: csa I see the struct acctcsa has a ac_prid.. Are you planning on adding project level accounting to linux, or is this just leftovers from IRIX? I'm not familiar with CSA, but have some experience with using the IRIX system audit trail for accounting (satd). satd isn't handling the accounting very well when we get hard hangs or power outages, and no end-of-job record is written. Then we have no account for the cpu-usage of the non-finished jobs at the time. Does CSA handle this better, or is it still depending on jobs being finished before writing any accounting records? (a way telling it to log periodic intermidiate accounting records would be nice) -jf