xfs
[Top] [All Lists]

Re: hardlinking and deleting milions of small files

To: XFS mailing list <xfs@xxxxxxxxxxx>
Subject: Re: hardlinking and deleting milions of small files
From: "Carlos E. R." <robin.listas@xxxxxxxxxxxxxx>
Date: Sun, 24 Jul 2016 14:48:29 +0200
Delivered-to: xfs@xxxxxxxxxxx
In-reply-to: <201607241438.10035.arekm@xxxxxxxx>
References: <201607241438.10035.arekm@xxxxxxxx>
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.2
On 2016-07-24 14:38, Arkadiusz MiÅkiewicz wrote:
> 
> Hello.
> 
> I'm using rsnapshot to backup big servers (like 5TB fs, 25 000 000 inodes, 
> small files - mailboxes in form of maildirs, so each mail is a separate 
> file). 
> Backup server - kernel 4.6.3, V4 xfs filesystems.
> 
> cp -al for that amount takes about 1.5 day.
> rm -rf of hardlinked copy takes another 1.5 day

I hesitate to suggest reiserfs...
I know it is good in that situation, but I doubt it scales well nowdays.
Your filesystems are far bigger than my experience.

There was some suggestion that btrfs could do it (without snapshots).
But... ? Too green? You could try it up in a spare test server.

-- 
Cheers / Saludos,

                Carlos E. R.

  (from openSUSE Leap 42.1 x86_64 (test))

<Prev in Thread] Current Thread [Next in Thread>