On Mon, Apr 26, 2004 at 12:26:08PM -0500, Glen Overby wrote:
> On April 26, Bruce Guenter wrote:
> > So far, XFS with an external journal has by far the best delivery rate.
> > However, as the filesystem fills and delivery concurrency increases, the
> > time required to list, read and delete the delivered files slows down to
> > unacceptable levels. Is there anything I can do, settings to modify,
> > patches to try, to improve this behavior?
>
> Some generic suggestions:
>
> - more log buffers than fewer (try 8)
I'm already using:
mount -t xfs -o noatime,logbufs=8,logbsize=65536
> - It looks like you're doing a lot of metadata intense operations, so
> you should try a larger log buffer size which are available in
> version 2 logs. I wrote version 2 logs, along with some other
> changes, to speed up metadata intense benchmarks. I think 128mb
> log buffers work on linux.
I'll try that.
> - You didn't say what your filesystem size is.
I did so:
Filesystem partition: 72GB on a software RAID-1 array of Fujitsu
SCSI 15kRPM disks.
> There is an ugly hack
> we put in to kee inode numbers < 2**32. This changes inode and
> data placement (inodes are kept in the lower AGs, user data is
> spread around in the upper AGs) and brings on the full-filesystem
> case earlier. I think thats what you hit.
Is there any way to avoid this situation?
--
Bruce Guenter <bruceg@xxxxx> http://em.ca/~bruceg/ http://untroubled.org/
OpenPGP key: 699980E8 / D0B7 C8DD 365D A395 29DA 2E2A E96F B2DC 6999 80E8
pgpwRNcCbLEU0.pgp
Description: PGP signature
|