xfs
[Top] [All Lists]

RE: mkfs.xfs -n size=65536

To: Dave Chinner <david@xxxxxxxxxxxxx>
Subject: RE: mkfs.xfs -n size=65536
From: "Al Lau (alau2)" <alau2@xxxxxxxxx>
Date: Tue, 13 Oct 2015 22:05:09 +0000
Accept-language: en-US
Cc: "xfs@xxxxxxxxxxx" <xfs@xxxxxxxxxxx>
Delivered-to: xfs@xxxxxxxxxxx
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@xxxxxxxxx; l=1647; q=dns/txt; s=iport; t=1444773925; x=1445983525; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=1ilifmY51R/U9+Y9iuvJR7aAjkq4yZpMwqIViv0/Dh0=; b=KVDTEkAgtbG0CTo7U7PSk98+rWBaxOCOTZkNUMlxNThfd6Zj3+GFFzK6 3Ig8bWP0aOEmMMJCZP9ZaTkSB+OgaT8oTlp3tz/mIOeVoGk3/P1nD8W5m XGMM2LE2ibFgyi9BwUmq2Z0gGaUj/tthFpNuC2cOw1s7p3dS9cYZX+MsA I=;
In-reply-to: <20151013002308.GI27164@dastard>
References: <0F279340237AA148AD7E3C6A70561A5E01266BE7@xxxxxxxxxxxxxxxxxxxxx> <20151013002308.GI27164@dastard>
Thread-index: AdEC1680Gy4Y381SQNu4wXlh8fvUqwCn49kAACLdkLA=
Thread-topic: mkfs.xfs -n size=65536
With xfs file system that has about 1 million files, would the default value 
for the directory structure be sufficient?  We can remove the "-n 
size=<value>'" option and just use the default.

Thanks,
-Al

-----Original Message-----
From: Dave Chinner [mailto:david@xxxxxxxxxxxxx] 
Sent: Monday, October 12, 2015 5:23 PM
To: Al Lau (alau2)
Cc: xfs@xxxxxxxxxxx
Subject: Re: mkfs.xfs -n size=65536

On Fri, Oct 09, 2015 at 10:40:00PM +0000, Al Lau (alau2) wrote:
> I am looking for more details on the "-n size=65536" option in 
> mkfs.xfs.  The question is the memory allocation this option 
> generates.  The system is Redhat EL 7.0 (3.10.0-229.1.2.el7.x86_64).
> 
> We have been getting this memory allocation deadlock message in the 
> /var/log/messages file.  The file system is used for ceph OSD and it 
> has about 531894 files.

So, if you only have half a million files being stored, why would you optimised 
the directory structure for tens of millions of files in a single directory?

> Oct  6 07:11:09 abc-ceph1-xyz kernel: XFS: possible memory allocation 
> deadlock in kmem_alloc (mode:0x8250)

mode = ___GFP_WAIT | ___GFP_IO | ___GFP_NOWARN | ___GFP_ZERO
     = GFP_NOFS | GFP_ZERO | GFP_NOWARN

which means it's come through kmem_zalloc() and so is a heap allocation and 
hence probably quite small.

Hence I doubt that has anything to do with the directory block size, as the 
directory blocks are allocated as single pages through a completely allocation 
different path and them virtually mapped...

Cheers,

Dave.
--
Dave Chinner
david@xxxxxxxxxxxxx

<Prev in Thread] Current Thread [Next in Thread>