Received: with ECARTIS (v1.0.0; list xfs); Tue, 25 Sep 2007 05:50:19 -0700 (PDT) X-Spam-Checker-Version: SpamAssassin 3.2.0-pre1-r499012 (2007-01-23) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-0.0 required=5.0 tests=AWL,BAYES_00,SPF_HELO_PASS autolearn=ham version=3.2.0-pre1-r499012 Received: from lucidpixels.com (lucidpixels.com [75.144.35.66]) by oss.sgi.com (8.12.10/8.12.10/SuSE Linux 0.7) with ESMTP id l8PCoDQ3015336 for ; Tue, 25 Sep 2007 05:50:15 -0700 Received: by lucidpixels.com (Postfix, from userid 1001) id D4F831C000267; Tue, 25 Sep 2007 08:50:15 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by lucidpixels.com (Postfix) with ESMTP id C170E4019B78; Tue, 25 Sep 2007 08:50:15 -0400 (EDT) Date: Tue, 25 Sep 2007 08:50:15 -0400 (EDT) From: Justin Piszcz X-X-Sender: jpiszcz@p34.internal.lan To: Ralf Gross cc: linux-xfs@oss.sgi.com Subject: Re: mkfs options for a 16x hw raid5 and xfs (mostly large files) In-Reply-To: <20070925123501.GA20499@p15145560.pureserver.info> Message-ID: References: <20070923093841.GH19983@p15145560.pureserver.info> <20070924173155.GI19983@p15145560.pureserver.info> <20070924203958.GA4082@p15145560.pureserver.info> <20070924213358.GB4082@p15145560.pureserver.info> <20070924215223.GC4082@p15145560.pureserver.info> <20070925123501.GA20499@p15145560.pureserver.info> MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="-1463747160-6325792-1190724615=:11391" X-Virus-Scanned: ClamAV version 0.90, clamav-milter version devel-120207 on oss.sgi.com X-Virus-Status: Clean X-archive-position: 13092 X-ecartis-version: Ecartis v1.0.0 Sender: xfs-bounce@oss.sgi.com Errors-to: xfs-bounce@oss.sgi.com X-original-sender: jpiszcz@lucidpixels.com Precedence: bulk X-list: xfs This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. ---1463747160-6325792-1190724615=:11391 Content-Type: TEXT/PLAIN; charset=iso-8859-1; format=flowed Content-Transfer-Encoding: QUOTED-PRINTABLE On Tue, 25 Sep 2007, Ralf Gross wrote: > Ralf Gross schrieb: >>> What do you get when (reading) from the raw device? >>> >>> dd if=3D/dev/sda bs=3D1M count=3D10240 >> >> The server has 16 GB RAM, so I tried it with 20 GB of data. >> >> dd if=3D/dev/sdd of=3D/dev/null bs=3D1M count=3D20480 >> 20480+0 Datens=E4tze ein >> 20480+0 Datens=E4tze aus >> 21474836480 Bytes (21 GB) kopiert, 95,3738 Sekunden, 225 MB/s >> >> and a second try: >> >> dd if=3D/dev/sdd of=3D/dev/null bs=3D1M count=3D20480 >> 20480+0 Datens=E4tze ein >> 20480+0 Datens=E4tze aus >> 21474836480 Bytes (21 GB) kopiert, 123,78 Sekunden, 173 MB/s >> >> I'm taoo tired to interprete these numbers at the moment, I'll do some >> more testing tomorrow. > > There is a second RAID device attached to the server (24x RAID5). The > numbers I get from this device are a bit worse than the 16x RAID 5 > numbers (150MB/s read with dd). > > I'm really wondering how people can achieve transfer rates of > 400MB/s and more. I know that I'm limited by the FC controller, but > I don't even get >200MB/s. > > Ralf > > Perhaps something is wrong with your setup? Here are my 10 raptors in RAID5 using Software RAID (no hw raid=20 controller): p34:~# dd if=3D/dev/md3 of=3D/dev/null bs=3D1M count=3D16384 16384+0 records in 16384+0 records out 17179869184 bytes (17 GB) copied, 29.8193 seconds, 576 MB/s p34:~# ---1463747160-6325792-1190724615=:11391--