From owner-rawio@oss.sgi.com Fri May 26 13:53:00 2000 Received: by oss.sgi.com id ; Fri, 26 May 2000 13:52:49 -0700 Received: from deliverator.sgi.com ([204.94.214.10]:377 "EHLO deliverator.sgi.com") by oss.sgi.com with ESMTP id ; Fri, 26 May 2000 13:52:39 -0700 Received: from getafix.engr.sgi.com (getafix.engr.sgi.com [163.154.5.110]) by deliverator.sgi.com (980309.SGI.8.8.8-aspam-6.2/980310.SGI-aspam) via ESMTP id OAA06966 for ; Fri, 26 May 2000 14:47:46 -0700 (PDT) mail_from (chait@getafix.engr.sgi.com) Received: from localhost (chait@localhost) by getafix.engr.sgi.com (980427.SGI.8.8.8/970903.SGI.AUTOCF) via SMTP id OAA86309 for ; Fri, 26 May 2000 14:50:50 -0700 (PDT) Message-Id: <200005262150.OAA86309@getafix.engr.sgi.com> To: rawio@oss.sgi.com Subject: Raw I/O enhancements for 2.3.99.pre9-2 kernels. Date: Fri, 26 May 2000 14:50:24 -0700 From: Chaitanya Tumuluri Sender: owner-rawio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;rawio-outgoing Hi, This email is to announce the availability of kiobuf-based I/O functionality for 2.3.99.pre9-2 kernels. First, the I/O queuing and scsi midlayer code in the Linux 2.3.99.pre9-2 kernel has been enhanced to handle kiobuf-based I/O requests. Second, Stephen Tweedie's rawio codepath has been extended to use this enhancement to directly issue kiobuf-based requests without having to restuff them into buffer-heads. This change does not change the device access semantics of Stephen Tweedie's code for raw devices. This enhancement only works for scsi disks currently. The complete patch (combining Stephen Tweedie's current patchset for Raw I/O and the new queueing/scsi-midlayer enhancements) is available from: http://oss.sgi.com/projects/rawio Thanks, -Chait. From owner-rawio@oss.sgi.com Fri May 26 16:43:18 2000 Received: by oss.sgi.com id ; Fri, 26 May 2000 16:42:58 -0700 Received: from mail.turbolinux.com ([38.170.88.25]:21253 "EHLO mail.turbolinux.com") by oss.sgi.com with ESMTP id ; Fri, 26 May 2000 16:42:41 -0700 Received: from localhost (yakker@localhost) by mail.turbolinux.com (8.9.3/8.9.3) with ESMTP id RAA26608; Fri, 26 May 2000 17:42:38 -0700 Date: Fri, 26 May 2000 17:42:37 -0700 (PDT) From: "Matt D. Robinson" To: Chaitanya Tumuluri cc: rawio@oss.sgi.com Subject: Re: Raw I/O enhancements for 2.3.99.pre9-2 kernels. In-Reply-To: <200005262150.OAA86309@getafix.engr.sgi.com> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-rawio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;rawio-outgoing Hey, Chait! Have you fully tested map_kernel_kiobuf() yet? I've had a few problems with it ... --Matt On Fri, 26 May 2000, Chaitanya Tumuluri wrote: |>Hi, |> |>This email is to announce the availability of kiobuf-based I/O |>functionality for 2.3.99.pre9-2 kernels. |> |>First, the I/O queuing and scsi midlayer code in the Linux |>2.3.99.pre9-2 kernel has been enhanced to handle kiobuf-based |>I/O requests. Second, Stephen Tweedie's rawio codepath has been |>extended to use this enhancement to directly issue kiobuf-based |>requests without having to restuff them into buffer-heads. |> |>This change does not change the device access semantics of Stephen |>Tweedie's code for raw devices. This enhancement only works for scsi |>disks currently. |> |>The complete patch (combining Stephen Tweedie's current patchset |>for Raw I/O and the new queueing/scsi-midlayer enhancements) is |>available from: |> |> http://oss.sgi.com/projects/rawio |> |>Thanks, |>-Chait. From owner-rawio@oss.sgi.com Fri May 26 17:38:19 2000 Received: by oss.sgi.com id ; Fri, 26 May 2000 17:37:59 -0700 Received: from pneumatic-tube.sgi.com ([204.94.214.22]:29975 "EHLO pneumatic-tube.sgi.com") by oss.sgi.com with ESMTP id ; Fri, 26 May 2000 17:37:30 -0700 Received: from getafix.engr.sgi.com (getafix.engr.sgi.com [163.154.5.110]) by pneumatic-tube.sgi.com (980327.SGI.8.8.8-aspam/980310.SGI-aspam) via ESMTP id SAA02859 for ; Fri, 26 May 2000 18:42:12 -0700 (PDT) mail_from (chait@getafix.engr.sgi.com) Received: from localhost (chait@localhost) by getafix.engr.sgi.com (980427.SGI.8.8.8/970903.SGI.AUTOCF) via SMTP id SAA87128; Fri, 26 May 2000 18:34:56 -0700 (PDT) Message-Id: <200005270134.SAA87128@getafix.engr.sgi.com> To: "Matt D. Robinson" cc: rawio@oss.sgi.com Subject: Re: Raw I/O enhancements for 2.3.99.pre9-2 kernels. In-reply-to: Your message of "Fri, 26 May 2000 17:42:37 PDT." Date: Fri, 26 May 2000 18:34:55 -0700 From: Chaitanya Tumuluri Sender: owner-rawio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;rawio-outgoing Hey Matt! What kind of problems and which kernel are you talking about? D'ju have any particular testcase I could use? -Chait. On Fri, 26 May 2000 17:42:37 PDT, "Matt D. Robinson" wrote: >Hey, Chait! Have you fully tested map_kernel_kiobuf() yet? I've >had a few problems with it ... > >--Matt > >On Fri, 26 May 2000, Chaitanya Tumuluri wrote: >|>Hi, >|> >|>This email is to announce the availability of kiobuf-based I/O >|>functionality for 2.3.99.pre9-2 kernels. >|> >|>First, the I/O queuing and scsi midlayer code in the Linux >|>2.3.99.pre9-2 kernel has been enhanced to handle kiobuf-based >|>I/O requests. Second, Stephen Tweedie's rawio codepath has been >|>extended to use this enhancement to directly issue kiobuf-based >|>requests without having to restuff them into buffer-heads. >|> >|>This change does not change the device access semantics of Stephen >|>Tweedie's code for raw devices. This enhancement only works for scsi >|>disks currently. >|> >|>The complete patch (combining Stephen Tweedie's current patchset >|>for Raw I/O and the new queueing/scsi-midlayer enhancements) is >|>available from: >|> >|> http://oss.sgi.com/projects/rawio >|> >|>Thanks, >|>-Chait. From owner-rawio@oss.sgi.com Tue May 30 13:32:27 2000 Received: by oss.sgi.com id ; Tue, 30 May 2000 13:32:18 -0700 Received: from [207.1.122.10] ([207.1.122.10]:3473 "HELO bouncer.lucasdigital.com") by oss.sgi.com with SMTP id ; Tue, 30 May 2000 13:31:56 -0700 Received: by bouncer.lucasdigital.com; id NAA07072; Tue, 30 May 2000 13:42:59 -0700 Received: from cyndi.lucasdigital.com(10.5.5.133) by bouncer.lucasdigital.com via smap (V4.2) id xma007070; Tue, 30 May 00 13:42:09 -0700 Received: (from kippa@localhost) by cyndi.lucasdigital.com (8.9.3/8.9.3) id NAA28306 for rawio@oss.sgi.com; Tue, 30 May 2000 13:30:44 -0700 Date: Tue, 30 May 2000 13:30:44 -0700 From: kippa Message-Id: <200005302030.NAA28306@cyndi.lucasdigital.com> To: rawio@oss.sgi.com Subject: raw io and lvm Sender: owner-rawio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;rawio-outgoing Hello. I have spent a day or two to see if we can get raw io working. I have built a patched kernel (2.3.99-pre8, w/ SGI kiobuf-enhancement.patch). Okay so far. I am unable to locate any specific instructions on making the /dev/ entries for these raw io devices, but stunbled through with mknod (i.e. mknod /dev/rawb c 8 16). Must be missing something tho... Can't seem to get things working to these devices. And as if that weren't enough, I was wondering if this version of rawio is happy with LVM? BTW, thanks for this effort. I hope the dmsdk folks and this group are in cahoots...(can't imagine they aren't)... Heres to hoping we can make this all work. Kipp From owner-rawio@oss.sgi.com Tue May 30 13:39:38 2000 Received: by oss.sgi.com id ; Tue, 30 May 2000 13:39:28 -0700 Received: from mail.turbolinux.com ([38.170.88.25]:14597 "EHLO mail.turbolinux.com") by oss.sgi.com with ESMTP id ; Tue, 30 May 2000 13:39:18 -0700 Received: from localhost (yakker@localhost) by mail.turbolinux.com (8.9.3/8.9.3) with ESMTP id NAA29968; Tue, 30 May 2000 13:40:33 -0700 Date: Tue, 30 May 2000 13:40:33 -0700 (PDT) From: "Matt D. Robinson" To: kippa cc: rawio@oss.sgi.com Subject: Re: raw io and lvm In-Reply-To: <200005302030.NAA28306@cyndi.lucasdigital.com> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-rawio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;rawio-outgoing There should be a 'raw' application available with RH 6.2 which will bind the raw device to some block device. What you'd want is: mknod /dev/raw c 162 0 mknod /dev/raw2 c 162 2 Then you'd run: raw /dev/raw2 /dev/sdb4 (or something to that effect). You can get the latest raw.c from the util-linux RPM off of freshmeat.net. If you still have problems finding it, send a mail here. --Matt On Tue, 30 May 2000, kippa wrote: |> |>Hello. |> |>I have spent a day or two to see if we can get raw io working. I have |>built a patched kernel (2.3.99-pre8, w/ SGI kiobuf-enhancement.patch). |>Okay so far. I am unable to locate any specific instructions on making |>the /dev/ entries for these raw io devices, but stunbled through with |>mknod (i.e. mknod /dev/rawb c 8 16). Must be missing something tho... |>Can't seem to get things working to these devices. |> |>And as if that weren't enough, I was wondering if this version of rawio |>is happy with LVM? |> |>BTW, thanks for this effort. I hope the dmsdk folks and this group are |>in cahoots...(can't imagine they aren't)... |> |>Heres to hoping we can make this all work. |> |>Kipp From owner-rawio@oss.sgi.com Tue May 30 14:23:58 2000 Received: by oss.sgi.com id ; Tue, 30 May 2000 14:23:38 -0700 Received: from ns.lucasfilm.com ([208.244.233.2]:1219 "EHLO brooklyn.lucasfilm.com") by oss.sgi.com with ESMTP id ; Tue, 30 May 2000 14:23:11 -0700 Received: from cerberus.lucasfilm.com ([150.0.40.12]) by brooklyn.lucasfilm.com with SMTP (Microsoft Exchange Internet Mail Service Version 5.5.2650.21) id LSH1DH8X; Tue, 30 May 2000 14:24:29 -0700 Received: from malone.lucasdigital.com ([10.10.192.51]) by cerberus.lucasfilm.com; Tue, 30 May 2000 14:24:25 +0000 (PST) Received: from lucasdigital.com (ilmex02 [10.5.90.25]) by malone.lucasdigital.com (8.8.8+Sun/8.8.8/990524-/HUB) with ESMTP id OAA06863; Tue, 30 May 2000 14:23:59 -0700 (PDT) Received: from ilm.com (cyndi.lucasdigital.com [10.5.5.133]) by ilmex02.lucasdigital.com with SMTP (Microsoft Exchange Internet Mail Service Version 5.5.2448.0) id LW99B3RW; Tue, 30 May 2000 14:24:16 -0700 Message-ID: <3934317B.731A380D@ilm.com> Date: Tue, 30 May 2000 14:24:11 -0700 From: "Kipp A. Aldrich" Organization: Industrial Light & Magic X-Mailer: Mozilla 4.61 [en] (X11; U; Linux 2.2.12-20 i686) X-Accept-Language: en MIME-Version: 1.0 To: "Matt D. Robinson" CC: rawio@oss.sgi.com Subject: Re: raw io and lvm References: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-rawio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;rawio-outgoing > > There should be a 'raw' application available with RH 6.2 which > will bind the raw device to some block device. > > What you'd want is: > > mknod /dev/raw c 162 0 > mknod /dev/raw2 c 162 2 > > Then you'd run: > > raw /dev/raw2 /dev/sdb4 > > (or something to that effect). > > You can get the latest raw.c from the util-linux RPM off of freshmeat.net. > If you still have problems finding it, send a mail here. > > --Matt Did that. Now if I try to use LVM's pvcreate on /dev/raw2 I get: "pvcreate -- invalid physical volume name "/dev/raw2"" Guess it is not possible to use raw devices in LVM. Am I missing something here? Thanks. kipp -- Kipp A. Aldrich Digital Video Engineering Industrial Light & Magic kippa@ilm.com 415.448.2443 From owner-rawio@oss.sgi.com Tue May 30 14:26:08 2000 Received: by oss.sgi.com id ; Tue, 30 May 2000 14:25:58 -0700 Received: from mail.turbolinux.com ([38.170.88.25]:57094 "EHLO mail.turbolinux.com") by oss.sgi.com with ESMTP id ; Tue, 30 May 2000 14:25:45 -0700 Received: from localhost (yakker@localhost) by mail.turbolinux.com (8.9.3/8.9.3) with ESMTP id OAA32460; Tue, 30 May 2000 14:27:02 -0700 Date: Tue, 30 May 2000 14:27:02 -0700 (PDT) From: "Matt D. Robinson" To: "Kipp A. Aldrich" cc: rawio@oss.sgi.com Subject: Re: raw io and lvm In-Reply-To: <3934317B.731A380D@ilm.com> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-rawio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;rawio-outgoing That sound about right, although I'm not entirely familiar with LVM to tell you a good answer. Can you use the 'dd.raw' to DD into and out of the device, so that you know your raw I/O is working? If so, then it's an LVM issue ... otherwise, it could still be a raw I/O configuration issue. Hope this helps ... --Matt On Tue, 30 May 2000, Kipp A. Aldrich wrote: |> |>> |>> There should be a 'raw' application available with RH 6.2 which |>> will bind the raw device to some block device. |>> |>> What you'd want is: |>> |>> mknod /dev/raw c 162 0 |>> mknod /dev/raw2 c 162 2 |>> |>> Then you'd run: |>> |>> raw /dev/raw2 /dev/sdb4 |>> |>> (or something to that effect). |>> |>> You can get the latest raw.c from the util-linux RPM off of freshmeat.net. |>> If you still have problems finding it, send a mail here. |>> |>> --Matt |> |>Did that. Now if I try to use LVM's pvcreate on /dev/raw2 I get: |>"pvcreate -- invalid physical volume name "/dev/raw2"" |> |>Guess it is not possible to use raw devices in LVM. |> |>Am I missing something here? |> |>Thanks. |> |>kipp |>-- |>Kipp A. Aldrich |>Digital Video Engineering |>Industrial Light & Magic |>kippa@ilm.com 415.448.2443 |> From owner-rawio@oss.sgi.com Tue May 30 14:47:47 2000 Received: by oss.sgi.com id ; Tue, 30 May 2000 14:47:37 -0700 Received: from ns.lucasfilm.com ([208.244.233.2]:17995 "EHLO brooklyn.lucasfilm.com") by oss.sgi.com with ESMTP id ; Tue, 30 May 2000 14:47:10 -0700 Received: from cerberus.lucasfilm.com ([150.0.40.12]) by brooklyn.lucasfilm.com with SMTP (Microsoft Exchange Internet Mail Service Version 5.5.2650.21) id LSH1DJCN; Tue, 30 May 2000 14:48:28 -0700 Received: from malone.lucasdigital.com ([10.10.192.51]) by cerberus.lucasfilm.com; Tue, 30 May 2000 14:48:25 +0000 (PST) Received: from lucasdigital.com (ilmex02 [10.5.90.25]) by malone.lucasdigital.com (8.8.8+Sun/8.8.8/990524-/HUB) with ESMTP id OAA08552; Tue, 30 May 2000 14:47:55 -0700 (PDT) Received: from ilm.com (cyndi.lucasdigital.com [10.5.5.133]) by ilmex02.lucasdigital.com with SMTP (Microsoft Exchange Internet Mail Service Version 5.5.2448.0) id LW99B3Z3; Tue, 30 May 2000 14:48:13 -0700 Message-ID: <39343717.D640CC1F@ilm.com> Date: Tue, 30 May 2000 14:48:07 -0700 From: "Kipp A. Aldrich" Organization: Industrial Light & Magic X-Mailer: Mozilla 4.61 [en] (X11; U; Linux 2.2.12-20 i686) X-Accept-Language: en MIME-Version: 1.0 To: "Matt D. Robinson" CC: rawio@oss.sgi.com Subject: Re: raw io and lvm References: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-rawio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;rawio-outgoing I will try dd.raw out and see where I end up. Thanks. kipp "Matt D. Robinson" wrote: > > That sound about right, although I'm not entirely familiar > with LVM to tell you a good answer. > > Can you use the 'dd.raw' to DD into and out of the device, > so that you know your raw I/O is working? > > If so, then it's an LVM issue ... otherwise, it could still > be a raw I/O configuration issue. Hope this helps ... > > --Matt > > On Tue, 30 May 2000, Kipp A. Aldrich wrote: > |> > |>> > |>> There should be a 'raw' application available with RH 6.2 which > |>> will bind the raw device to some block device. > |>> > |>> What you'd want is: > |>> > |>> mknod /dev/raw c 162 0 > |>> mknod /dev/raw2 c 162 2 > |>> > |>> Then you'd run: > |>> > |>> raw /dev/raw2 /dev/sdb4 > |>> > |>> (or something to that effect). > |>> > |>> You can get the latest raw.c from the util-linux RPM off of freshmeat.net. > |>> If you still have problems finding it, send a mail here. > |>> > |>> --Matt > |> > |>Did that. Now if I try to use LVM's pvcreate on /dev/raw2 I get: > |>"pvcreate -- invalid physical volume name "/dev/raw2"" > |> > |>Guess it is not possible to use raw devices in LVM. > |> > |>Am I missing something here? > |> > |>Thanks. > |> > |>kipp > |>-- > |>Kipp A. Aldrich > |>Digital Video Engineering > |>Industrial Light & Magic > |>kippa@ilm.com 415.448.2443 > |> -- Kipp A. Aldrich Digital Video Engineering Industrial Light & Magic kippa@ilm.com 415.448.2443 From owner-rawio@oss.sgi.com Wed May 31 11:27:26 2000 Received: by oss.sgi.com id ; Wed, 31 May 2000 11:27:17 -0700 Received: from deliverator.sgi.com ([204.94.214.10]:39174 "EHLO deliverator.sgi.com") by oss.sgi.com with ESMTP id ; Wed, 31 May 2000 11:27:07 -0700 Received: from nodin.corp.sgi.com (fddi-nodin.corp.sgi.com [198.29.75.193]) by deliverator.sgi.com (980309.SGI.8.8.8-aspam-6.2/980310.SGI-aspam) via ESMTP id MAA08602 for ; Wed, 31 May 2000 12:13:52 -0700 (PDT) mail_from (chait@getafix.engr.sgi.com) Received: from getafix.engr.sgi.com (getafix.engr.sgi.com [163.154.5.110]) by nodin.corp.sgi.com (980427.SGI.8.8.8/980728.SGI.AUTOCF) via ESMTP id MAA27605 for ; Wed, 31 May 2000 12:17:00 -0700 (PDT) Received: from localhost (chait@localhost) by getafix.engr.sgi.com (980427.SGI.8.8.8/970903.SGI.AUTOCF) via SMTP id MAA92867; Wed, 31 May 2000 12:12:34 -0700 (PDT) Message-Id: <200005311912.MAA92867@getafix.engr.sgi.com> To: "Matt D. Robinson" cc: "Kipp A. Aldrich" , rawio@oss.sgi.com Subject: Re: raw io and lvm In-reply-to: Your message of "Tue, 30 May 2000 14:27:02 PDT." Date: Wed, 31 May 2000 12:12:33 -0700 From: Chaitanya Tumuluri Sender: owner-rawio@oss.sgi.com Precedence: bulk Return-Path: X-Orcpt: rfc822;rawio-outgoing Sorry for the delayed reponse; I was fighting INS battles over the weekend and early part of this week. :^) I used the "raw" program from Stephen Tweedie's website which is essentially the RH utility that Matt pointed you at in his email. I have not looked into lvm based devices in this effort yet (or `md' ones for that matter). That is on my todo list. Offhand, I'd suspect that this rawio patch will not work with lvm devices since these are expecting buffer-head based requests....I'll have to get a dialogue going with Andrea Arcangeli/Martin Peters and a couple of LVM folks to see what can be done. It'd be good if they do pitch in... Cheers, -Chait. On Tue, 30 May 2000 14:27:02 PDT, "Matt D. Robinson" wrote: >That sound about right, although I'm not entirely familiar >with LVM to tell you a good answer. > >Can you use the 'dd.raw' to DD into and out of the device, >so that you know your raw I/O is working? > >If so, then it's an LVM issue ... otherwise, it could still >be a raw I/O configuration issue. Hope this helps ... > >--Matt > >On Tue, 30 May 2000, Kipp A. Aldrich wrote: >|> >|>> >|>> There should be a 'raw' application available with RH 6.2 which >|>> will bind the raw device to some block device. >|>> >|>> What you'd want is: >|>> >|>> mknod /dev/raw c 162 0 >|>> mknod /dev/raw2 c 162 2 >|>> >|>> Then you'd run: >|>> >|>> raw /dev/raw2 /dev/sdb4 >|>> >|>> (or something to that effect). >|>> >|>> You can get the latest raw.c from the util-linux RPM off of freshmeat.net. >|>> If you still have problems finding it, send a mail here. >|>> >|>> --Matt >|> >|>Did that. Now if I try to use LVM's pvcreate on /dev/raw2 I get: >|>"pvcreate -- invalid physical volume name "/dev/raw2"" >|> >|>Guess it is not possible to use raw devices in LVM. >|> >|>Am I missing something here? >|> >|>Thanks. >|> >|>kipp >|>-- >|>Kipp A. Aldrich >|>Digital Video Engineering >|>Industrial Light & Magic >|>kippa@ilm.com 415.448.2443 >|>