xfs
[Top] [All Lists]

Re: nfs/local performance with software raid5 and xfs and SMP

To: Nathan Straz <nstraz@xxxxxxx>
Subject: Re: nfs/local performance with software raid5 and xfs and SMP
From: Tru Huynh <tru@xxxxxxxxxx>
Date: Fri, 20 Jul 2001 17:45:43 +0200
Cc: "linux-xfs@xxxxxxxxxxx" <linux-xfs@xxxxxxxxxxx>
Organization: Institut Pasteur
References: <200107191812.f6JICsI32762@jen.americas.sgi.com> <3B57CCB9.4386DD23@ch.sauter-bc.com> <20010720073345.A6470@sgi.com>
Sender: owner-linux-xfs@xxxxxxxxxxx
Hi

On the same "benchmark" theads of Nate Straz ...
(sotfware raid5 and xfs performance issue)

How long does it take to extract the 2.4.6 linux kernel and delete it?

    | create   | delete
    -------------------
a)  |   0:17   |   0:07
b)  |   0:24   |   0:25
c)  |   1:51'  |  16:45
d)  |   2:54   |   8:08

[tru@adm ~/tmp]$ du -sk /tmp/linux-2.4.6.tar.gz ./linux/
26312   /tmp/linux-2.4.6.tar.gz
130412  ./linux

a) local xfs partition on the will become nfs client
b) local xfs raid5 array on a single disk (/dev/md1) on the will become
nfs server
c) local xfs raid5 array on 3ware card 7disks (/dev/md0) on the will
become nfs server
d) nfs 

 bonnie block (K/sec)
   |output|input
   |------------
c) |47340 |77559
d) | 4390 |10777 

I will try to move the log out of the raid5 array as proposed by Steve.

Regards,

Tru
---- details ----
The server is running 2.4.7pre8 from yesterday's CVS

cat /proc/version
Linux version 2.4.7-pre8-xfs (tru@xxxxxxxxxxxxxxxxxxxxxxx) (gcc version
egcs-2.91.66 19990314/Linux (egcs-1.1.2 release)) #2 SMP Thu Jul 19
11:33:28 CEST 2001
[tru@sheridan ~]$ !98
cat /proc/cmdline
BOOT_IMAGE=1-smp-cvs ro root=301 BOOT_FILE=/boot/bzImage-2.4.7-pre8-xfs
ramdisk_size=2500 devfs=nomount noapic


a) local xfs partition
[tru@adm ~/tmp]$  date ; time tar xzf /tmp/linux-2.4.6.tar.gz ; date;
time  /bin/rm -rf linux ; date
Fri Jul 20 15:49:33 CEST 2001
2.910u 2.400s 0:17.22 30.8%     0+0k 0+0io 325pf+0w
Fri Jul 20 15:49:50 CEST 2001
0.080u 1.540s 0:06.81 23.7%     0+0k 0+0io 138pf+0w
Fri Jul 20 15:49:57 CEST 2001

b) local ide raid5 xfs access on the server
[tru@sheridan /scratch]$  date ; time tar xzf /tmp/linux-2.4.6.tar.gz ;
date; time  /bin/rm -rf linux ; date
Fri Jul 20 15:54:35 CEST 2001
4.640u 4.380s 0:24.20 37.2%     0+0k 0+0io 327pf+0w
Fri Jul 20 15:54:59 CEST 2001
0.060u 2.290s 0:25.06 9.3%      0+0k 0+0io 138pf+0w
Fri Jul 20 15:55:24 CEST 2001

c) local 3ware raid5 xfs access on the server
[tru@sheridan tru]$ date ; time tar xzf /tmp/linux-2.4.6.tar.gz ; date ;
time /bin/rm -rf linux ; date
Fri Jul 20 15:58:24 CEST 2001
4.540u 3.890s 1:51.42 7.5%      0+0k 0+0io 327pf+0w
Fri Jul 20 16:00:16 CEST 2001
0.050u 5.230s 16:45.66 0.5%     0+0k 0+0io 138pf+0w
Fri Jul 20 16:17:01 CEST 2001

[tru@sheridan tru]$ date ; ~tru/bonnie++-1.00g/bonnie++ -d
/raid5/home/Bis/tru ; date
Fri Jul 20 12:07:00 CEST 2001
Writing with putc()...done
Writing intelligently...done
Rewriting...done
Reading with getc()...done
Reading intelligently...done
start 'em...done...done...done...
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version 1.00g       ------Sequential Output------ --Sequential Input-
--Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP 
/sec %CP
sheridan.bis.pas 2G 10818  97 47340  85 23690  54 10329  97 77559  66
433.5   3
                    ------Sequential Create------ --------Random
Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP 
/sec %CP
                 16   147   6 +++++ +++   311  11   554  25 +++++ +++  
313  13
sheridan.bis.pasteur.fr,2G,10818,97,47340,85,23690,54,10329,97,77559,66,433.5,3,16,147,6,+++++,+++,311,11,554,25,+++++,+++,313,13
Fri Jul 20 12:20:43 CEST 2001



d) on nfs (/dev/md0 exported) case
[tru@adm tru]$  date ; time tar xzf /tmp/linux-2.4.6.tar.gz ; date ;
time /bin/rm -rf linux ; date
Fri Jul 20 16:22:20 CEST 2001
2.730u 2.320s 2:54.08 2.9%      0+0k 0+0io 325pf+0w
Fri Jul 20 16:25:14 CEST 2001
0.070u 0.740s 8:08.32 0.1%      0+0k 0+0io 138pf+0w
Fri Jul 20 16:33:22 CEST 2001

[tru@adm ~/Desktop]$ date; ~/rh71/build/bonnie++-1.00g/bonnie++ -d
/home/Bis/tru; date
Fri Jul 20 13:26:11 CEST 2001
Writing with putc()...done
Writing intelligently...done
Rewriting...done
Reading with getc()...done
Reading intelligently...done
start 'em...done...done...done...
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version 1.00g       ------Sequential Output------ --Sequential Input-
--Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP 
/sec %CP
adm.cluster      1G  4013  29  4390   2  3109   3 10463  88 10777   4
567.1   3
                    ------Sequential Create------ --------Random
Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP 
/sec %CP
                 16   506   1  4525  13   276   0   135   0  4931   6  
319   1
adm.cluster,1G,4013,29,4390,2,3109,3,10463,88,10777,4,567.1,3,16,506,1,4525,13,276,0,135,0,4931,6,319,1
Fri Jul 20 13:48:11 CEST 2001

/etc/raidtab
------------
# Sample raid-5 configuration
#
raiddev                 /dev/md0
raid-level              5
nr-raid-disks           7
# Spare disks for hot reconstruction
#nr-spare-disks         1
persistent-superblock   1

chunk-size              64


# the best one for maximum performance:
#
parity-algorithm        left-symmetric

#parity-algorithm       right-asymmetric
#parity-algorithm       right-symmetric


device                  /dev/sdb1
raid-disk               0
device                  /dev/sdc1
raid-disk               1
device                  /dev/sdd1
raid-disk               2
device                  /dev/sde1
raid-disk               3
device                  /dev/sdf1
raid-disk               4
device                  /dev/sdg1
raid-disk               5
device                  /dev/sdh1
raid-disk               6
#
#device                 /dev/sda1
#spare-disk             0
#
 
#-------------------------------
# raid5 on hda
#-------------------------------
raiddev                 /dev/md1
raid-level              5
nr-raid-disks           3
persistent-superblock   1
chunk-size              64
parity-algorithm        left-symmetric
#
device                  /dev/hda6
raid-disk               0
device                  /dev/hda7
raid-disk               1
device                  /dev/hda8
raid-disk               2
-- 
Dr Tru Huynh          | Bioinformatique Structurale
mailto:tru@xxxxxxxxxx | tel/fax +33 1 45 68 87 37/19
Institut Pasteur, 25-28 rue du Docteur Roux, 75724 Paris CEDEX 15 France


<Prev in Thread] Current Thread [Next in Thread>