xfs
[Top] [All Lists]

Re: Speeding up XFS

To: linux-xfs@xxxxxxxxxxx
Subject: Re: Speeding up XFS
From: Bruce Guenter <lists-linux-xfs@xxxxxxxxxxxxxxxxxxxxxxxx>
Date: Mon, 26 Apr 2004 11:33:00 -0600
In-reply-to: <200404261726.i3QHQ8Aj298772@zhadum.americas.sgi.com>
Mail-followup-to: linux-xfs@xxxxxxxxxxx
References: <20040426165155.GA19148@em.ca> <200404261726.i3QHQ8Aj298772@zhadum.americas.sgi.com>
Sender: linux-xfs-bounce@xxxxxxxxxxx
User-agent: Mutt/1.5.6i
On Mon, Apr 26, 2004 at 12:26:08PM -0500, Glen Overby wrote:
> On April 26, Bruce Guenter wrote:
> > So far, XFS with an external journal has by far the best delivery rate.
> > However, as the filesystem fills and delivery concurrency increases, the
> > time required to list, read and delete the delivered files slows down to
> > unacceptable levels.  Is there anything I can do, settings to modify,
> > patches to try, to improve this behavior?
> 
> Some generic suggestions:
> 
>  - more log buffers than fewer (try 8)

I'm already using:
        mount -t xfs -o noatime,logbufs=8,logbsize=65536

>  - It looks like you're doing a lot of metadata intense operations, so
>    you should try a larger log buffer size which are available in
>    version 2 logs.  I wrote version 2 logs, along with some other
>    changes, to speed up metadata intense benchmarks.  I think 128mb
>    log buffers work on linux. 

I'll try that.

>  - You didn't say what your filesystem size is.

I did so:

        Filesystem partition: 72GB on a software RAID-1 array of Fujitsu
        SCSI 15kRPM disks.

>    There is an ugly hack
>    we put in to kee inode numbers < 2**32.  This changes inode and
>    data placement (inodes are kept in the lower AGs, user data is
>    spread around in the upper AGs) and brings on the full-filesystem
>    case earlier.  I think thats what you hit.

Is there any way to avoid this situation?
-- 
Bruce Guenter <bruceg@xxxxx> http://em.ca/~bruceg/ http://untroubled.org/
OpenPGP key: 699980E8 / D0B7 C8DD 365D A395 29DA  2E2A E96F B2DC 6999 80E8

Attachment: pgpwRNcCbLEU0.pgp
Description: PGP signature

<Prev in Thread] Current Thread [Next in Thread>