hardlinking and deleting milions of small files
Carlos E. R.
robin.listas at telefonica.net
Sun Jul 24 07:48:29 CDT 2016
On 2016-07-24 14:38, Arkadiusz Miśkiewicz wrote:
>
> Hello.
>
> I'm using rsnapshot to backup big servers (like 5TB fs, 25 000 000 inodes,
> small files - mailboxes in form of maildirs, so each mail is a separate file).
> Backup server - kernel 4.6.3, V4 xfs filesystems.
>
> cp -al for that amount takes about 1.5 day.
> rm -rf of hardlinked copy takes another 1.5 day
I hesitate to suggest reiserfs...
I know it is good in that situation, but I doubt it scales well nowdays.
Your filesystems are far bigger than my experience.
There was some suggestion that btrfs could do it (without snapshots).
But... ? Too green? You could try it up in a spare test server.
--
Cheers / Saludos,
Carlos E. R.
(from openSUSE Leap 42.1 x86_64 (test))
More information about the xfs
mailing list