xfs
[Top] [All Lists]

Re: extremely slow file creation/deletion after xfs ran full

To: Stan Hoeppner <stan@xxxxxxxxxxxxxxxxx>, Brian Foster <bfoster@xxxxxxxxxx>
Subject: Re: extremely slow file creation/deletion after xfs ran full
From: Carsten Aulbert <Carsten.Aulbert@xxxxxxxxxx>
Date: Tue, 13 Jan 2015 21:13:13 +0100
Cc: xfs@xxxxxxxxxxx
Delivered-to: xfs@xxxxxxxxxxx
In-reply-to: <54B57ACD.60600@xxxxxxxxxxxxxxxxx>
Organization: Max Planck Institute for Gravitational Physics - Albert Einstein Institute (AEI)
References: <54B387A1.6000807@xxxxxxxxxx> <54B3CC6A.4080405@xxxxxxxxxx> <20150112155206.GD25944@xxxxxxxxxxxxxxx> <54B3F19D.6030307@xxxxxxxxxx> <20150112163749.GE25944@xxxxxxxxxxxxxxx> <54B40552.50106@xxxxxxxxxx> <54B57ACD.60600@xxxxxxxxxxxxxxxxx>
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Icedove/31.3.0
Hi Stan

On 01/13/2015 09:06 PM, Stan Hoeppner wrote:
> This workload seems more suited to a database than a filesystem. Though
> surely you've already considered such, and chose not to go that route.
> 

Yepp, but as we do not fully control the server software and need to
work further on the binary blobs arriving, a database is also not that
well suited for it, but yes, we looked into it (and run mysql, marida,
cassandra, mongo, postgresql, ...)

> With high fragmentation you get lots of seeking.  What model disks are
> these?  What is your RAID10 geometry?  Are your partitions properly
> aligned to that geometry, and to the drives (512n/512e)?

Disks are 2TB Hitachi SATA drives (Ultrastar, HUA722020ALA330). As these
are some yrs old, they are native 512byte ones. They are connected via
an Areca 1261ML controller with a Supermicro backplane.

RAID striping is not ideal (128kByte per member disk) and thus our xfs
layout is not ideal as well. Things we plan to change with the next
attempt ;)

After the arrival of "advanced format" HDD and SSDs we usually try to
align everything to full 1 MByte or larger, just to be sure any
combination of 512b, 4kb, ... will eventually align :)

Cheers

Carsten

<Prev in Thread] Current Thread [Next in Thread>