xfs
[Top] [All Lists]

Re: Slow delete

To: Andrei Deftu <andreideftu@xxxxxxxxx>
Subject: Re: Slow delete
From: Dave Chinner <david@xxxxxxxxxxxxx>
Date: Tue, 6 Jul 2010 09:34:48 +1000
Cc: xfs@xxxxxxxxxxx
In-reply-to: <AANLkTinPmhJRD3CDdsHtkLFzYd2jF9ee7gPqgO6XBSfl@xxxxxxxxxxxxxx>
References: <AANLkTinPmhJRD3CDdsHtkLFzYd2jF9ee7gPqgO6XBSfl@xxxxxxxxxxxxxx>
User-agent: Mutt/1.5.20 (2009-06-14)
On Mon, Jul 05, 2010 at 05:27:44PM +0300, Andrei Deftu wrote:
> Hi,
> 
> As many people have pointed out, xfs is very slow when deleting a
> large number of files. Does anyone has a technical answer to this
> problem? Also, I am interested to know if there is a way to
> temporarily speed up the delete process, regardless of all the other
> parameters.

The technical reason is to do with the architecture of the
transaction and logging subsystem of XFS. The key concept: relogging
of dirty objects. The reason it affects unlinks: removing files
from the same directory modifies the same objects repeatedly (e.g.
the directory btree blocks).

For a detailed explanation of the concept and how delayed logging
takes advantage of it to speed up stuff like deleting a large number
of files, see:

http://git.kernel.org/?p=linux/kernel/git/torvalds/linux-2.6.git;a=blob;f=Documentation/filesystems/xfs-delayed-logging-design.txt

Cheers,

Dave.
-- 
Dave Chinner
david@xxxxxxxxxxxxx

<Prev in Thread] Current Thread [Next in Thread>