From owner-kaio@oss.sgi.com Wed Mar 1 00:58:14 2000 Received: by oss.sgi.com id ; Wed, 1 Mar 2000 00:58:04 -0800 Received: from www.mezon.net ([212.108.197.44]:13580 "EHLO szorvor.mezon.net") by oss.sgi.com with ESMTP id ; Wed, 1 Mar 2000 00:57:48 -0800 Received: from localhost (agdolla@localhost) by szorvor.mezon.net (8.9.3/8.9.3) with ESMTP id JAA74818; Wed, 1 Mar 2000 09:57:31 +0100 (CET) (envelope-from agdolla@mezon.net) Date: Wed, 1 Mar 2000 09:57:31 +0100 (CET) From: Gabor Dolla To: Rajagopal Ananthanarayanan cc: kaio@oss.sgi.com Subject: Re: kaio patch on linux 2.2.14 kernel In-Reply-To: <38BC7DC9.9E4D6340@sgi.com> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-kaio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;kaio-outgoing > > Hmm. sd_raw_fops is defined by the following patch > > ftp://oss.sgi.com/www/projects/rawio/download/sgi+straw2.2.13.patch > > which is the one you should be using on a vanilla linux kernel. well, the patch place kaio_is_raw function in sd.c at line 606 and sd_raw_fops struct defined at line 790... that is why I needed the pre definition.... > > void * > > kaio_raw_rw(int rw, struct file *filp, char *buf, size_t count, loff_t > > *ppos, > > int *error, struct semaphore *semp, struct kiobuf *iobufp) > > { > > return(sd_raw_rw(rw, filp, buf, count, ppos, error, semp, iobufp)); > > } > > > > the compiler said that sd_raw_rw needs 9 parameters > > > > so I changed it to: > > return(sd_raw_rw(rw, filp, buf, count, ppos, error, semp, iobufp, > > AS_USER)); > > > Yes this is the correct fix. Apparently the rawio patches > have been upgraded since made the kaio patches. there is another flag AS_KERNEL, maybe I should use that flag in the kernel source ???? thanks Gabor From owner-kaio@oss.sgi.com Wed Mar 1 08:12:51 2000 Received: by oss.sgi.com id ; Wed, 1 Mar 2000 08:12:41 -0800 Received: from mail.turbolinux.com ([38.170.88.25]:25875 "EHLO mail.turbolinux.com") by oss.sgi.com with ESMTP id ; Wed, 1 Mar 2000 08:12:20 -0800 Received: from localhost (yakker@localhost) by mail.turbolinux.com (8.9.3/8.9.3) with ESMTP id IAA18891; Wed, 1 Mar 2000 08:11:49 -0800 Date: Wed, 1 Mar 2000 08:11:49 -0800 (PST) From: "Matt D. Robinson" To: Gabor Dolla cc: Rajagopal Ananthanarayanan , kaio@oss.sgi.com Subject: Re: kaio patch on linux 2.2.14 kernel In-Reply-To: Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-kaio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;kaio-outgoing On Wed, 1 Mar 2000, Gabor Dolla wrote: |>> Hmm. sd_raw_fops is defined by the following patch |>> |>> ftp://oss.sgi.com/www/projects/rawio/download/sgi+straw2.2.13.patch |>> |>> which is the one you should be using on a vanilla linux kernel. |> |>well, the patch place kaio_is_raw function in sd.c at line 606 |>and sd_raw_fops struct defined at line 790... |>that is why I needed the pre definition.... |> |>> > void * |>> > kaio_raw_rw(int rw, struct file *filp, char *buf, size_t count, loff_t |>> > *ppos, |>> > int *error, struct semaphore *semp, struct kiobuf *iobufp) |>> > { |>> > return(sd_raw_rw(rw, filp, buf, count, ppos, error, semp, iobufp)); |>> > } |>> > |>> > the compiler said that sd_raw_rw needs 9 parameters |>> > |>> > so I changed it to: |>> > return(sd_raw_rw(rw, filp, buf, count, ppos, error, semp, iobufp, |>> > AS_USER)); |>> > |>> Yes this is the correct fix. Apparently the rawio patches |>> have been upgraded since made the kaio patches. |> |>there is another flag AS_KERNEL, maybe I should use that flag in the |>kernel source ???? The kernel flag is used for kernel memory -- the real reason is the LKCD code (http://oss.sgi.com/projects/lkcd) requires mapping kiobufs in kernel memory. The previous model didn't support anything but user memory, hence the addition of AS_KERNEL. It's recommended that unless you really require AS_KERNEL, there's no need to use it. Rarely will people want to map kiobufs with kernel memory unless you're doing something in the kernel to raw devices (IMHO). |>thanks |> |>Gabor --Matt From owner-kaio@oss.sgi.com Wed Mar 1 09:25:10 2000 Received: by oss.sgi.com id ; Wed, 1 Mar 2000 09:25:01 -0800 Received: from mail.turbolinux.com ([38.170.88.25]:38151 "EHLO mail.turbolinux.com") by oss.sgi.com with ESMTP id ; Wed, 1 Mar 2000 09:24:48 -0800 Received: from localhost (yakker@localhost) by mail.turbolinux.com (8.9.3/8.9.3) with ESMTP id JAA22690; Wed, 1 Mar 2000 09:24:11 -0800 Date: Wed, 1 Mar 2000 09:24:10 -0800 (PST) From: "Matt D. Robinson" To: Gabor Dolla cc: Rajagopal Ananthanarayanan , kaio@oss.sgi.com Subject: Re: kaio patch on linux 2.2.14 kernel In-Reply-To: Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-kaio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;kaio-outgoing Just out of curiosity, Ananth, do you have test and/or benchmark code that you can publish on oss.sgi.com to show some of the performance gains? --Matt On Wed, 1 Mar 2000, Matt D. Robinson wrote: |>On Wed, 1 Mar 2000, Gabor Dolla wrote: |>|>> Hmm. sd_raw_fops is defined by the following patch |>|>> |>|>> ftp://oss.sgi.com/www/projects/rawio/download/sgi+straw2.2.13.patch |>|>> |>|>> which is the one you should be using on a vanilla linux kernel. |>|> |>|>well, the patch place kaio_is_raw function in sd.c at line 606 |>|>and sd_raw_fops struct defined at line 790... |>|>that is why I needed the pre definition.... |>|> |>|>> > void * |>|>> > kaio_raw_rw(int rw, struct file *filp, char *buf, size_t count, loff_t |>|>> > *ppos, |>|>> > int *error, struct semaphore *semp, struct kiobuf *iobufp) |>|>> > { |>|>> > return(sd_raw_rw(rw, filp, buf, count, ppos, error, semp, iobufp)); |>|>> > } |>|>> > |>|>> > the compiler said that sd_raw_rw needs 9 parameters |>|>> > |>|>> > so I changed it to: |>|>> > return(sd_raw_rw(rw, filp, buf, count, ppos, error, semp, iobufp, |>|>> > AS_USER)); |>|>> > |>|>> Yes this is the correct fix. Apparently the rawio patches |>|>> have been upgraded since made the kaio patches. |>|> |>|>there is another flag AS_KERNEL, maybe I should use that flag in the |>|>kernel source ???? |> |>The kernel flag is used for kernel memory -- the real reason is |>the LKCD code (http://oss.sgi.com/projects/lkcd) requires mapping |>kiobufs in kernel memory. The previous model didn't support anything |>but user memory, hence the addition of AS_KERNEL. |> |>It's recommended that unless you really require AS_KERNEL, there's |>no need to use it. Rarely will people want to map kiobufs with kernel |>memory unless you're doing something in the kernel to raw devices (IMHO). |> |>|>thanks |>|> |>|>Gabor |> |>--Matt |> From owner-kaio@oss.sgi.com Wed Mar 1 14:25:00 2000 Received: by oss.sgi.com id ; Wed, 1 Mar 2000 14:24:51 -0800 Received: from deliverator.sgi.com ([204.94.214.10]:24181 "EHLO deliverator.sgi.com") by oss.sgi.com with ESMTP id ; Wed, 1 Mar 2000 14:24:40 -0800 Received: from madurai.engr.sgi.com (madurai.engr.sgi.com [163.154.5.75]) by deliverator.sgi.com (980309.SGI.8.8.8-aspam-6.2/980310.SGI-aspam) via ESMTP id NAA26472 for ; Wed, 1 Mar 2000 13:16:27 -0800 (PST) mail_from (ananth@sgi.com) Received: from sgi.com (mango.engr.sgi.com [163.154.5.76]) by madurai.engr.sgi.com (980427.SGI.8.8.8/970903.SGI.AUTOCF) via ESMTP id NAA71451; Wed, 1 Mar 2000 13:18:33 -0800 (PST) Message-ID: <38BD893C.960C3E30@sgi.com> Date: Wed, 01 Mar 2000 13:18:52 -0800 From: Rajagopal Ananthanarayanan X-Mailer: Mozilla 4.6 [en] (X11; I; Linux 2.2.10-1SGI_11smp i686) X-Accept-Language: en MIME-Version: 1.0 To: kaio@oss.sgi.com CC: Gabor Dolla Subject: Re: kaio patch on linux 2.2.14 kernel References: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-kaio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;kaio-outgoing "Matt D. Robinson" wrote: > > Just out of curiosity, Ananth, do you have test and/or benchmark > code that you can publish on oss.sgi.com to show some of the > performance gains? Ok, i'll look into releasing some of the smaller tests. Some of the performance is in the main page of the KAIO project, which talks about database tests. I can't release source code for that, for obvious reasons. regards, ananth. From owner-kaio@oss.sgi.com Wed Mar 1 14:25:10 2000 Received: by oss.sgi.com id ; Wed, 1 Mar 2000 14:25:01 -0800 Received: from deliverator.sgi.com ([204.94.214.10]:24181 "EHLO deliverator.sgi.com") by oss.sgi.com with ESMTP id ; Wed, 1 Mar 2000 14:24:40 -0800 Received: from madurai.engr.sgi.com (madurai.engr.sgi.com [163.154.5.75]) by deliverator.sgi.com (980309.SGI.8.8.8-aspam-6.2/980310.SGI-aspam) via ESMTP id NAA26086 for ; Wed, 1 Mar 2000 13:12:30 -0800 (PST) mail_from (ananth@sgi.com) Received: from sgi.com (mango.engr.sgi.com [163.154.5.76]) by madurai.engr.sgi.com (980427.SGI.8.8.8/970903.SGI.AUTOCF) via ESMTP id NAA71277; Wed, 1 Mar 2000 13:14:39 -0800 (PST) Message-ID: <38BD8852.6761EF45@sgi.com> Date: Wed, 01 Mar 2000 13:14:58 -0800 From: Rajagopal Ananthanarayanan X-Mailer: Mozilla 4.6 [en] (X11; I; Linux 2.2.10-1SGI_11smp i686) X-Accept-Language: en MIME-Version: 1.0 To: Gabor Dolla CC: kaio@oss.sgi.com Subject: Re: kaio patch on linux 2.2.14 kernel References: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-kaio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;kaio-outgoing Gabor Dolla wrote: > > > > > Hmm. sd_raw_fops is defined by the following patch > > > > ftp://oss.sgi.com/www/projects/rawio/download/sgi+straw2.2.13.patch > > > > which is the one you should be using on a vanilla linux kernel. > > well, the patch place kaio_is_raw function in sd.c at line 606 > and sd_raw_fops struct defined at line 790... > that is why I needed the pre definition.... Ah, I see your problem. This is due the way patch works, with line numbers. May be for the 2.3 patches, I'll include an aio patch that will have the line numbers correct after one applies the rawio patch. thanks for pointing it out, ananth. From owner-kaio@oss.sgi.com Wed Mar 1 14:32:20 2000 Received: by oss.sgi.com id ; Wed, 1 Mar 2000 14:32:10 -0800 Received: from mail.turbolinux.com ([38.170.88.25]:21766 "EHLO mail.turbolinux.com") by oss.sgi.com with ESMTP id ; Wed, 1 Mar 2000 14:31:59 -0800 Received: from localhost (yakker@localhost) by mail.turbolinux.com (8.9.3/8.9.3) with ESMTP id OAA18543; Wed, 1 Mar 2000 14:31:14 -0800 Date: Wed, 1 Mar 2000 14:31:13 -0800 (PST) From: "Matt D. Robinson" To: Rajagopal Ananthanarayanan cc: Gabor Dolla , kaio@oss.sgi.com Subject: Re: kaio patch on linux 2.2.14 kernel In-Reply-To: <38BD8852.6761EF45@sgi.com> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-kaio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;kaio-outgoing The AS_USER fix for the call to sd_raw_rw() in kaio_raw_rw() is also needed: - return(sd_raw_rw(rw, filp, buf, count, ppos, error, semp, iobufp)); + return(sd_raw_rw(rw, filp, buf, count, ppos, error, semp, iobufp, + AS_USER)); I'm working on some sample code now ... if I get it done before you post yours, I'll send it out. --Matt On Wed, 1 Mar 2000, Rajagopal Ananthanarayanan wrote: |>Gabor Dolla wrote: |>> |>> > |>> > Hmm. sd_raw_fops is defined by the following patch |>> > |>> > ftp://oss.sgi.com/www/projects/rawio/download/sgi+straw2.2.13.patch |>> > |>> > which is the one you should be using on a vanilla linux kernel. |>> |>> well, the patch place kaio_is_raw function in sd.c at line 606 |>> and sd_raw_fops struct defined at line 790... |>> that is why I needed the pre definition.... |> |>Ah, I see your problem. This is due the way patch works, |>with line numbers. May be for the 2.3 patches, I'll include |>an aio patch that will have the line numbers correct |>after one applies the rawio patch. |> |>thanks for pointing it out, |> |>ananth. From owner-kaio@oss.sgi.com Sat Mar 4 09:39:59 2000 Received: by oss.sgi.com id ; Sat, 4 Mar 2000 09:39:50 -0800 Received: from deliverator.sgi.com ([204.94.214.10]:40492 "EHLO deliverator.sgi.com") by oss.sgi.com with ESMTP id ; Sat, 4 Mar 2000 09:39:26 -0800 Received: from madurai.engr.sgi.com (madurai.engr.sgi.com [163.154.5.75]) by deliverator.sgi.com (980309.SGI.8.8.8-aspam-6.2/980310.SGI-aspam) via ESMTP id JAA11619 for ; Sat, 4 Mar 2000 09:34:52 -0800 (PST) mail_from (ananth@sgi.com) Received: from sgi.com (sgigate.sgi.com [198.29.75.75]) by madurai.engr.sgi.com (980427.SGI.8.8.8/970903.SGI.AUTOCF) via ESMTP id JAA74597 for ; Sat, 4 Mar 2000 09:36:11 -0800 (PST) Message-ID: <38C14988.725B31B6@sgi.com> Date: Sat, 04 Mar 2000 09:36:08 -0800 From: Rajagopal Ananthanarayanan X-Mailer: Mozilla 4.6 [en] (X11; I; Linux 2.2.10-1SGI_17 i686) X-Accept-Language: en MIME-Version: 1.0 To: kaio@oss.sgi.com Subject: KAIO Version 1.2 released Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-kaio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;kaio-outgoing Hi, I've uploaded version 1.2 of the kaio kernel patch and the corresponding library. The current patches are for the 2.2 kernel. Soon I'll release 1.2 patches for the 2.3 kernel. Please check "news" and "download/README.patches" from the main project page. As always please don't hesitate to send your feedback! thanks, ananth. From owner-kaio@oss.sgi.com Sat Mar 4 16:41:25 2000 Received: by oss.sgi.com id ; Sat, 4 Mar 2000 16:41:15 -0800 Received: from adsl-63-198-73-118.dsl.lsan03.pacbell.net ([63.198.73.118]:16398 "EHLO turing.xman.org") by oss.sgi.com with ESMTP id ; Sat, 4 Mar 2000 16:40:45 -0800 Received: from scherbius.xman.org (scherbius.intra.xman.org [192.168.1.7]) by turing.xman.org (8.9.3/8.9.3) with ESMTP id QAA14370; Sat, 4 Mar 2000 16:40:44 -0800 Received: by scherbius.xman.org (Postfix, from userid 502) id 226AA2FE7F; Sat, 4 Mar 2000 16:40:44 -0800 (PST) Date: Sat, 4 Mar 2000 16:40:44 -0800 From: Christopher Smith To: Rajagopal Ananthanarayanan Cc: kaio@oss.sgi.com Subject: Re: KAIO Version 1.2 released Message-ID: <20000304164043.B23576@xman.org> Mail-Followup-To: Rajagopal Ananthanarayanan , kaio@oss.sgi.com References: <38C14988.725B31B6@sgi.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.1.8i In-Reply-To: <38C14988.725B31B6@sgi.com>; from ananth@sgi.com on Sat, Mar 04, 2000 at 09:36:08AM -0800 Comment: I can't believe you're actually reading mail headers. Sender: owner-kaio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;kaio-outgoing On Sat, Mar 04, 2000 at 09:36:08AM -0800, Ananth Anathanarayanan wrote: > I've uploaded version 1.2 of the kaio kernel patch > and the corresponding library. The current patches > are for the 2.2 kernel. Soon I'll release 1.2 patches > for the 2.3 kernel. Please check "news" and > "download/README.patches" from the main project page. > > As always please don't hesitate to send your feedback! The "news" section was pretty thin and only mentions that the kernel lock isn't used as much and there was some cleanup of unused portions of the patch. The README.patches only says there were "extensive" changes (although it does give me credit for the helping to identify and provide a test case for the 1.1 socket patch --thanks! ;-). Is this about all that makes sense or is they're something more? --Chris From owner-kaio@oss.sgi.com Sun Mar 5 20:02:48 2000 Received: by oss.sgi.com id ; Sun, 5 Mar 2000 20:02:38 -0800 Received: from pneumatic-tube.sgi.com ([204.94.214.22]:52244 "EHLO pneumatic-tube.sgi.com") by oss.sgi.com with ESMTP id ; Sun, 5 Mar 2000 20:02:18 -0800 Received: from madurai.engr.sgi.com (madurai.engr.sgi.com [163.154.5.75]) by pneumatic-tube.sgi.com (980327.SGI.8.8.8-aspam/980310.SGI-aspam) via ESMTP id UAA02421 for ; Sun, 5 Mar 2000 20:05:31 -0800 (PST) mail_from (ananth@sgi.com) Received: from sgi.com (sgigate.sgi.com [198.29.75.75]) by madurai.engr.sgi.com (980427.SGI.8.8.8/970903.SGI.AUTOCF) via ESMTP id UAA62812 for ; Sun, 5 Mar 2000 20:00:18 -0800 (PST) Message-ID: <38C32D26.3EF35E9E@sgi.com> Date: Sun, 05 Mar 2000 19:59:34 -0800 From: Rajagopal Ananthanarayanan X-Mailer: Mozilla 4.6 [en] (X11; I; Linux 2.2.10-1SGI_17 i686) X-Accept-Language: en MIME-Version: 1.0 To: kaio@oss.sgi.com Subject: Re: KAIO Version 1.2 released References: <38C14988.725B31B6@sgi.com> <20000304164043.B23576@xman.org> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-kaio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;kaio-outgoing Christopher Smith wrote: > > On Sat, Mar 04, 2000 at 09:36:08AM -0800, Ananth Anathanarayanan wrote: > > I've uploaded version 1.2 of the kaio kernel patch > > and the corresponding library. The current patches > > are for the 2.2 kernel. Soon I'll release 1.2 patches > > for the 2.3 kernel. Please check "news" and > > "download/README.patches" from the main project page. > > > > As always please don't hesitate to send your feedback! > > The "news" section was pretty thin and only mentions that the kernel > lock isn't used as much and there was some cleanup of unused portions > of the patch. The README.patches only says there were "extensive" > changes (although it does give me credit for the helping to identify > and provide a test case for the 1.1 socket patch --thanks! ;-). Is > this about all that makes sense or is they're something more? > Chris, you are basically right in your assessment of the changes. There are no functional changes, only fixes for a couple of potential bugs that were uncovered in reworking the locking structure. The locking change, however, is significant and could use some testing. regards, ananth. From owner-kaio@oss.sgi.com Mon Mar 6 15:56:29 2000 Received: by oss.sgi.com id ; Mon, 6 Mar 2000 15:56:12 -0800 Received: from deliverator.sgi.com ([204.94.214.10]:55635 "EHLO deliverator.sgi.com") by oss.sgi.com with ESMTP id ; Mon, 6 Mar 2000 15:55:40 -0800 Received: from madurai.engr.sgi.com (madurai.engr.sgi.com [163.154.5.75]) by deliverator.sgi.com (980309.SGI.8.8.8-aspam-6.2/980310.SGI-aspam) via ESMTP id PAA03003 for ; Mon, 6 Mar 2000 15:51:04 -0800 (PST) mail_from (ananth@sgi.com) Received: from sgi.com (mango.engr.sgi.com [163.154.5.76]) by madurai.engr.sgi.com (980427.SGI.8.8.8/970903.SGI.AUTOCF) via ESMTP id PAA74818 for ; Mon, 6 Mar 2000 15:53:35 -0800 (PST) Message-ID: <38C44514.C15418EF@sgi.com> Date: Mon, 06 Mar 2000 15:53:56 -0800 From: Rajagopal Ananthanarayanan X-Mailer: Mozilla 4.6 [en] (X11; I; Linux 2.2.10-1SGI_11smp i686) X-Accept-Language: en MIME-Version: 1.0 To: kaio@oss.sgi.com Subject: Version 1.2 for 2.3.49 available Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-kaio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;kaio-outgoing Version 1.2 of the KAIO patch (kernel & library) are available for the 2.3.49 linux kernel. Please have a look at the download section, README.patches for details. Let me know your experiences with these patches. cheers, ananth.