xfs
[Top] [All Lists]

Re: Question regarding performance on big files.

To: xfs@xxxxxxxxxxx
Subject: Re: Question regarding performance on big files.
From: Stan Hoeppner <stan@xxxxxxxxxxxxxxxxx>
Date: Thu, 23 Sep 2010 17:03:39 -0500
In-reply-to: <4C9B161A.1010301@xxxxxxxxxxxxxxxx>
References: <4C979439.7070906@xxxxxxxxxxxxxxxx> <4C97BA74.5030304@xxxxxxxxxxxxxxxxx> <4C99D9EB.20800@xxxxxxxxxxxxxxxx> <4C9A69DC.8020606@xxxxxxxxxxxxxxxxx> <4C9B161A.1010301@xxxxxxxxxxxxxxxx>
User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.2.9) Gecko/20100915 Thunderbird/3.1.4
Mathieu AVILA put forth on 9/23/2010 3:55 AM:

> The small writes are amortized in the stream of data writes from the
> application, and the application is not frozen.
> (so you were right: there was a page cache issue)

Given what you've described about the streaming write behavior of your
application, I'd suggest you rewrite it and use O_DIRECT writes to
bypass the page cache completely.  You may also want to look into using
the XFS realtime subvolume feature.

-- 
Stan

<Prev in Thread] Current Thread [Next in Thread>