Performance problem with multiple parallel rm -rf's

[Sujit K M]

This I think is not dependent on XFS. Most File systems tend to give bad
performance when multiple rm -rf is being run. I think the Linux(XFS or any) are
object based and tend to lock on the filesystem, but donot have any
exact knowledge
of the Level at which it is being held.

Thanks,
Sujit

On Wed, Dec 2, 2009 at 3:32 PM, Jens Rosenboom <j.rosenboom at syseleven.de> wrote:
> On a large 13TB XFS volume that is being used for backups, I am seeing bad
> performance if multiple "rm -rf" processes are running in parallel. The
> backups are being done with rsnapshot and the first operation it does is
> removing the oldest snapshot. A single rsnapshot does this in reasonable
> time, but if four jobs are started at the same time, all their rm processes
> run for hours without making much progress.
>
> This seems to be related to the planned optimizations in
>
> http://xfs.org/index.php/Improving_Metadata_Performance_By_Reducing_Journal_Overhead
>
> Are there any other tuning options I might try? I'm already using
> "noatime,nodiratime,nobarrier,logbufs=8,logbsize=256k" as mount options and
> did enable lazy_counters for the fs.
>
> _______________________________________________
> xfs mailing list
> xfs at oss.sgi.com
> http://oss.sgi.com/mailman/listinfo/xfs
>