[Top] [All Lists]

Re: XFS fragmentation on file append

To: Keyur Govande <keyurgovande@xxxxxxxxx>
Subject: Re: XFS fragmentation on file append
From: Stefan Ring <stefanrin@xxxxxxxxx>
Date: Thu, 24 Apr 2014 08:54:54 +0200
Cc: linux-fsdevel@xxxxxxxxxxxxxxx, Linux fs XFS <xfs@xxxxxxxxxxx>
Delivered-to: xfs@xxxxxxxxxxx
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=Q6/OaUvjh+PU82VFapk4Gd0UyseIRWMvD4GwZPC9Vnw=; b=xlITyB+3xDzLMSdgJrlx46R6aB3NysaQBWoSULrhWKxBMOrSTASWoSxFNwNatFKLCR yFyUa5YgbT+IWJ8uPAZMoZmJ3EE61tqtzLbED52WgF81on19WOE6hup+ecy+GUWu5N8t rRlOf9tw+LOezdD8NpLgbwdCO9qRHUXmasW+bhVB+zGK0vcmM+UTlq00ou25xMxnmbGA z/+dcL2XuIUiBnjoizKWeCk6NA2uFyWj0sfczSWmhXdp7c1jBkfhFW755M+hI66aFn37 FlCnJv2U50LkjxlmOhDsZENGUxNZPwNRh48V8eKQD8jIcPbrnVS4KmuQssLyBfWYWyY3 6vyw==
In-reply-to: <CAJhmKHk5fWVaDTEfL_oESULspavk83eBEsyw7=qEp8bC7f2S2g@xxxxxxxxxxxxxx>
References: <CAJhmKHmwvCBx=arJ6m2ZhuQVq=Jj-XbBGvEPjTPY5a1QtWRTCQ@xxxxxxxxxxxxxx> <20140408015012.GB22917@dastard> <CAJhmKHnap0vu8m4AXBxJr9L0RKoquFrm3NjKQdDBJwpRTYmfpw@xxxxxxxxxxxxxx> <20140408053117.GJ27017@dastard> <CAJhmKHk5fWVaDTEfL_oESULspavk83eBEsyw7=qEp8bC7f2S2g@xxxxxxxxxxxxxx>
I've become interested in this topic, as I'm also running MySQL with
O_DIRECT and innodb_file_per_table. Out of curiosity, I immediately
ran xfs_bmap on a moderately sized table space (34GB). It listed
around 30000 fragments, on average one for every MB.

I want to report what happened then: A flurry of activity started on
both disks (root/swap lives on one of them, the data volume containing
the MySQL files on another) and lasted for about two minutes.
Afterwards, all memory previously allocated to the file cache has
become free, and also everything XFS seems to keep buffered internally
(I think it's called SReclaimable) was released. Swap usage increased
only slightly. dmesg was silent during that time.

This is a 2.6.32-358.2.1.el6.x86_64 kernel with xfsprogs 3.1.1 (CentOS
6.4). The machine has 64GB of RAM (2 NUMA nodes) and 24 (virtual)
cores. Is this known behavior of xfs_bmap?

<Prev in Thread] Current Thread [Next in Thread>