xfs
[Top] [All Lists]

Re: fallocate bug?

To: Dave Chinner <david@xxxxxxxxxxxxx>
Subject: Re: fallocate bug?
From: Zhu Han <schumi.han@xxxxxxxxx>
Date: Tue, 8 May 2012 11:24:52 +0800
Cc: xfs@xxxxxxxxxxx
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=CdjUPx/CTHCyVb5ZEreBo4c/ful/W58OqiJQOvuWJbw=; b=qP6JuRI2LIF7jYU4thxMwdFRRI+xe1c6kAtdPI8L74CuSgvNI7ewqIp8czUyvOXBBP 3hlXpKEJg3bTRVbzkpgA4x2EkBtPEMH6ieb74tjbyfUPf9RT35pjJMbdo/TZzKa+gM1k hZys2A0zPJb636FFNA9JkP6i37ZHKKN6BUZ6BWgqRvbzbX760KrQVMvtSE4htMgIbyvH +iCx5DlVjBeT986eU/xPaWhr/D2gpYoUHTRH27YhaPRWnQAEtgaaBj8vf34aCRQDjwpQ ittOLBnqr9j6O24HowoblCpUOsOjbVt/91teIFCRI2hBAoJcNd1scuGiRqcU8SzlxY71 W/Fg==
In-reply-to: <20120507235955.GE5091@dastard>
References: <CAF7KpS-r4zRXZxBU3U8ohxA85-rEvbAzCewYZDr44MNdP+YmFg@xxxxxxxxxxxxxx> <20120507235955.GE5091@dastard>
On Tue, May 8, 2012 at 7:59 AM, Dave Chinner <david@xxxxxxxxxxxxx> wrote:
On Mon, May 07, 2012 at 08:44:17PM +0800, Zhu Han wrote:
> Seems like xfs of CentOS 6.X occupies much more storage space than desired
> if fallocate is used against the file. Here is the step to reproduce it:

You test case is not doing what you think it is doing.

Thanks for pointing it out.

 

> By the way, is it normal when the file is moved around after the
> preallocated region is filled with data?
>
> $ uname -r
> 2.6.32-220.7.1.el6.x86_64
>
> $fallocate -n --offset 0 -l 1G file    ---->Write a little more data than
> the preallocated size
>
> $ xfs_bmap -p -vv file
> file:
>  EXT: FILE-OFFSET      BLOCK-RANGE            AG AG-OFFSET
> TOTAL FLAGS
>    0: [0..2097151]:    2593408088..2595505239 21 (29420144..31517295)
> 2097152 10000
>
> $ dd if=/dev/zero of=/tmp/file bs=1M count=1026 conv=fsync

That does a truncate first, removing all the preallocated space. Use
conv=notrunc to avoid this. Hence the space allocated by this
new write is different to the space allocated by the above
preallocation. The file has not been moved, the filesystem just did
what you asked it to do.

>
> $ xfs_bmap -p -vv file
> file:
>  EXT: FILE-OFFSET      BLOCK-RANGE            AG AG-OFFSET
> TOTAL FLAGS
>    0: [0..4194303]:    2709184016..2713378319 22 (23101408..27295711)
> 4194304 00000

And so now you've triggered the speculative delayed allocation
beyond EOF, which is normal behaviour. Hence there are currently
unused blocks beyond EOF which will get removed either when the next
close(fd) occurs on the file or the inode is removed from the cache.

Close(fd) should be invoked before dd quits. But why the extra blocks beyond EOF are not freed?

The only way I found to remove the extra blocks is truncate the file to its real size.
 

Cheers,

Dave.
--
Dave Chinner
david@xxxxxxxxxxxxx

<Prev in Thread] Current Thread [Next in Thread>