>>> On Tue, 19 Feb 2008 14:53:57 +0100, Tomasz Chmielewski
>>> <mangoo@xxxxxxxx> said:
mangoo> I have a ext3 filesystem with almost 200 million files
mangoo> (1.2 TB fs, ~65% full); most of the files are hardlinked
mangoo> multiple times, some of them are hardlinked thousands of
mangoo> times.
Lucky numbers! :-)
mangoo> In general, because new files and hardlinks are being
mangoo> added all the time and the old ones are being removed,
mangoo> this leads to a very, very poor performance.
That is not the cause of the poor performance. The ultimate
cause is rather different.
mangoo> When I want to remove a lot of directories/files (which
mangoo> will be hardlinks, mostly), I see disk write speed is
mangoo> down to 50 kB/s - 200 kB/s (fifty - two hundred
mangoo> kilobytes/s) - this is the "bandwidth" used during the
mangoo> deletion.
How is bandwidth relevant for that? OK that there are quotes,
but it seems very very stranget regardless.
mangoo> Also, the filesystem is very fragmented ("dd
mangoo> if=/dev/zero of=some_file bs=64k" writes only about 1
mangoo> MB/s).
Then more the merrier.
mangoo> Will xfs handle a large number of files, including lots
mangoo> of hardlinks, any better than ext3?
It shows consideration to consult the archives of a mailing list
before aking a question. It may be a good idea to do it even
after posting a question :-).
|