Received: with ECARTIS (v1.0.0; list xfs); Sat, 13 Jan 2007 01:41:39 -0800 (PST) Received: from lucidpixels.com (lucidpixels.com [66.45.37.187]) by oss.sgi.com (8.12.10/8.12.10/SuSE Linux 0.7) with ESMTP id l0D9fXqw020811 for ; Sat, 13 Jan 2007 01:41:34 -0800 Received: by lucidpixels.com (Postfix, from userid 1001) id E9CA51A000259; Sat, 13 Jan 2007 04:40:39 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by lucidpixels.com (Postfix) with ESMTP id E4DD0A000257; Sat, 13 Jan 2007 04:40:39 -0500 (EST) Date: Sat, 13 Jan 2007 04:40:39 -0500 (EST) From: Justin Piszcz X-X-Sender: jpiszcz@p34.internal.lan To: Al Boldi cc: linux-kernel@vger.kernel.org, linux-raid@vger.kernel.org, xfs@oss.sgi.com Subject: Re: Linux Software RAID 5 Performance Optimizations: 2.6.19.1: (211MB/s read & 195MB/s write) In-Reply-To: <200701130911.38240.a1426z@gawab.com> Message-ID: References: <200701130000.48717.a1426z@gawab.com> <200701130911.38240.a1426z@gawab.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-archive-position: 10283 X-ecartis-version: Ecartis v1.0.0 Sender: xfs-bounce@oss.sgi.com Errors-to: xfs-bounce@oss.sgi.com X-original-sender: jpiszcz@lucidpixels.com Precedence: bulk X-list: xfs Content-Length: 2096 Lines: 66 On Sat, 13 Jan 2007, Al Boldi wrote: > Justin Piszcz wrote: > > On Sat, 13 Jan 2007, Al Boldi wrote: > > > Justin Piszcz wrote: > > > > Btw, max sectors did improve my performance a little bit but > > > > stripe_cache+read_ahead were the main optimizations that made > > > > everything go faster by about ~1.5x. I have individual bonnie++ > > > > benchmarks of [only] the max_sector_kb tests as well, it improved the > > > > times from 8min/bonnie run -> 7min 11 seconds or so, see below and > > > > then after that is what you requested. > > > > > > Can you repeat with /dev/sda only? > > > > For sda-- (is a 74GB raptor only)-- but ok. > > Do you get the same results for the 150GB-raptor on sd{e,g,i,k}? > > > # uptime > > 16:25:38 up 1 min, 3 users, load average: 0.23, 0.14, 0.05 > > # cat /sys/block/sda/queue/max_sectors_kb > > 512 > > # echo 3 > /proc/sys/vm/drop_caches > > # dd if=/dev/sda of=/dev/null bs=1M count=10240 > > 10240+0 records in > > 10240+0 records out > > 10737418240 bytes (11 GB) copied, 150.891 seconds, 71.2 MB/s > > # echo 192 > /sys/block/sda/queue/max_sectors_kb > > # echo 3 > /proc/sys/vm/drop_caches > > # dd if=/dev/sda of=/dev/null bs=1M count=10240 > > 10240+0 records in > > 10240+0 records out > > 10737418240 bytes (11 GB) copied, 150.192 seconds, 71.5 MB/s > > # echo 128 > /sys/block/sda/queue/max_sectors_kb > > # echo 3 > /proc/sys/vm/drop_caches > > # dd if=/dev/sda of=/dev/null bs=1M count=10240 > > 10240+0 records in > > 10240+0 records out > > 10737418240 bytes (11 GB) copied, 150.15 seconds, 71.5 MB/s > > > > > > Does this show anything useful? > > Probably a latency issue. md is highly latency sensitive. > > What CPU type/speed do you have? Bootlog/dmesg? > > > Thanks! > > -- > Al > > - > To unsubscribe from this list: send the line "unsubscribe linux-raid" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > > What CPU type/speed do you have? Bootlog/dmesg? Core Duo E6300 The speed is great since I have tweaked the various settings..