[Top] [All Lists]

Re: Dealing with a very large file -1,5TB

To: "Christoph Klocker" <cklocker@xxxxxx>
Subject: Re: Dealing with a very large file -1,5TB
From: "Simon Matter" <simon.matter@xxxxxxxxxxxxxxxx>
Date: Thu, 25 Sep 2003 15:29:31 +0200 (CEST)
Cc: linux-xfs@xxxxxxxxxxx
Importance: Normal
In-reply-to: <3F72E2D4.1030109@xxxxxx>
References: <3F72E2D4.1030109@xxxxxx>
Sender: linux-xfs-bounce@xxxxxxxxxxx
User-agent: SquirrelMail/1.4.1
Did you check the raw write speed of your devices using dd? When I did
tests in the past I got almost the same speed with XFS like raw. Until you
are sure your devices perform much better, XFS should not be involved too


> Hi
> I am developing a system to stream very large uncompressed videofiles
> which are about 1,5TB.
> I need a bandwith of 195MB/s.
> my system is now:
> kernel: 2.4.18
> xeon 2,4GHz
> 3ware escalade controller 12 s-ata harddisks, seagate barracuda 7200.7 -
> 120GB - SCSI
> when I do different tests with bonnie++ I get very good results for a
> 2GB file, readperformance 249mb/s,
> but when the files get larger the speed is going down significantly.
> at 10GB - 216MB/s
> at 100GB - 187MB/s
> at 1TB - 161MB/s
> the write performance stays at 183MB/s any time, up to 1TB.
> As my harddisk have a sustained rate of 32-50 MB/s it should not be the
> case that they influence the results.
> I am now thinking maybe the filesystem influences the result when the
> disks are getting fuller. I thought also about that the logfiles get
> bigger and bigger and that maybe a reason.
> I had a look if its possible to switch of the logging completely (there
> is no reason to have it because I just have one file) , but I think its
> not possible with xfs.
> Is there a special parameter configuration for having just one file at
> this size (1,5TB)
> /Christoph
> _____________
> Klocker Christoph
> 10044 Stockholm

Simon Matter              Tel:  +41 61 695 57 35
Fr.Sauter AG / CIT        Fax:  +41 61 695 53 30
Im Surinam 55
CH-4016 Basel             [mailto:simon.matter@xxxxxxxxxxxxxxxx]

<Prev in Thread] Current Thread [Next in Thread>