xfs
[Top] [All Lists]

Re: suddenly slow writes on XFS Filesystem

To: xfs@xxxxxxxxxxx
Subject: Re: suddenly slow writes on XFS Filesystem
From: Martin Steigerwald <Martin@xxxxxxxxxxxx>
Date: Mon, 7 May 2012 10:21:14 +0200
Cc: "Stefan Priebe - Profihost AG" <s.priebe@xxxxxxxxxxxx>, Dave Chinner <david@xxxxxxxxxxxxx>, stan@xxxxxxxxxxxxxxxxx
In-reply-to: <4FA76E11.1070708@xxxxxxxxxxxx>
References: <4FA63DDA.9070707@xxxxxxxxxxxx> <20120507013456.GW5091@dastard> <4FA76E11.1070708@xxxxxxxxxxxx> (sfid-20120507_095413_656560_122EB192)
User-agent: KMail/1.13.7 (Linux/3.3.0-trunk-amd64; KDE/4.7.4; x86_64; ; )
Am Montag, 7. Mai 2012 schrieb Stefan Priebe - Profihost AG:
> Hi,
> 
> after deleting 400GB it was faster. Now there are still 300GB free but
> it is slow as hell again ;-(

Well, before you had 200 GB free, now you have 300 GB free. Thats not that 
much more. You have 5 AGs, so if distributed evenly it would be 40 to 60 
GB free space per AG.

The 10% Dave recommended of 4,6 TB would be 460 GB.

Are other volumes of similar size are similarily full but faster?

Would be interesting to see whether you are able to sustain faster speeds 
by keeping the volume above 500 GB free or so.

> >> It is a raid 10 of 20 SATA Disks and i can only write to them with
> >> about 700kb/s while doing random i/o.
> > 
> > What sort of random IO? size, read, write, direct or buffered, data
> > or metadata, etc?
> 
> There are 4 rsync processes running and doing backups of other severs.

Which rsync version is involved? I strongly suggest to use rsync version 3 
or above.

> > Your filesystem is near full - the allocation algorithms definitely
> > slow down as you approach ENOSPC, and IO efficiency goes to hell
> > because of a lack of contiguous free space to allocate from.
> 
> I've now 94% used but it is still slow. It seems it was just getting
> fast with more than 450GB free space.
> 
> /dev/sdb1             4,6T  4,3T  310G  94% /mnt

Then: Will it stay fast if you keep it above 450 GB free space?

And is it as fast then as it used to be before you faced performance 
issues?

Ciao,
-- 
Martin 'Helios' Steigerwald - http://www.Lichtvoll.de
GPG: 03B0 0D6C 0040 0710 4AFA  B82F 991B EAAC A599 84C7

<Prev in Thread] Current Thread [Next in Thread>