xfs
[Top] [All Lists]

Re: High Fragmentation with XFS and NFS Sync

To: Stefan Ring <stefanrin@xxxxxxxxx>
Subject: Re: High Fragmentation with XFS and NFS Sync
From: Nick Fisk <friskyfisk10@xxxxxxxxxxxxxx>
Date: Sun, 3 Jul 2016 13:40:07 +0100
Cc: Linux fs XFS <xfs@xxxxxxxxxxx>
Delivered-to: xfs@xxxxxxxxxxx
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc; bh=EqG4gUY7DTWfi5mW4Qg1mwaDSMouSCeZx67xvt9iYaU=; b=JPRwWsbxx8AxbYoVbs48YxOS4qJEeL5o0GoRrCJIVuEXoXtOkgcbA+hRsowXcuQwUw cR2Kw6CAcwl9Ds+eYZCmZUmN4exa8iyxju5MZ/xpgHeGHd4a9y+PC5/1t1PSNO5rKBEP euzOCEN8VrJf5XOZEqBGK2YOC36FDWLViPubG5DxDSLXP6D9EE53wOi1/2Y9etUlEFTw UpxusWjAkaNZVCYZSJ3uUr78M+FV+nApsGUxHkH/LPYrS2YrqqFr1syK6a21TRem7El4 Q5Fceg/CUrq9q5N/xMHbHh/Nb2caiqbLd+yWIQOgElQZYLX6KDEGfb7RCGkovuqksmOS 4XUQ==
In-reply-to: <CAAxjCEx4sHH+Eo=HnEXR7+EXwV9unHOg53stRkAn9UecHyQpcg@xxxxxxxxxxxxxx>
References: <CAC5UwBi8Skjx90_XC5Z5B8P+CadawBZ3iUabKtm-2ZvrkgocZQ@xxxxxxxxxxxxxx> <CAAxjCEx4sHH+Eo=HnEXR7+EXwV9unHOg53stRkAn9UecHyQpcg@xxxxxxxxxxxxxx>


On 3 Jul 2016 1:34 p.m., "Stefan Ring" <stefanrin@xxxxxxxxx> wrote:
>
> On Sat, Jul 2, 2016 at 10:52 AM, Nick Fisk <friskyfisk10@xxxxxxxxxxxxxx> wrote:
> > Hi, hope someone can help me here.
> >
> > I'm exporting some XFS fs's to ESX via NFS with the sync option enabled. I'm
> > seeing really heavy fragmentation when multiple VM's are copied onto the
> > share at the same time. I'm also seeing kmem_alloc failures, which is
> > probably the biggest problem as this effectively takes everything down.
> >
>
> The same thing happens with MySQL's InnoDB files if O_DIRECT is in use.
>
> The kmem_alloc failure taking everything down is most likely a result
> of you calling xfs_bmap on these files and does not happen during
> normal use. I've had the same experience some time ago.

Unfortunately this did happen during normal use. It occurred over night after kicking a bunch copies off. Something like 5 million extents for 10-20 files. I suspect as suggested, it's to do with memory fragmentation.

<Prev in Thread] Current Thread [Next in Thread>