xfs
[Top] [All Lists]

RE: mkfs.xfs -n size=65536

To: Dave Chinner <david@xxxxxxxxxxxxx>
Subject: RE: mkfs.xfs -n size=65536
From: "Al Lau (alau2)" <alau2@xxxxxxxxx>
Date: Tue, 13 Oct 2015 04:04:47 +0000
Accept-language: en-US
Cc: "xfs@xxxxxxxxxxx" <xfs@xxxxxxxxxxx>
Delivered-to: xfs@xxxxxxxxxxx
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@xxxxxxxxx; l=1792; q=dns/txt; s=iport; t=1444709110; x=1445918710; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=o3bND3QJRh59FddVPt5sHS/xjPcYevSgKTWgmWhiMio=; b=LRWetUJvQ0itRhrT8Gj2WL06uWh4TxIv0FAqumGGv/y/nlikAnuelRgV X1miCNOhb3L6RZF2BXsdgdk1WvzClfo5PEIVjGtvktUmsT/RomwCjTmz0 bdZDUBRRleeUie9PhqsBmp2d3/Ot2EEsD+Fd5cR3iAHH5VTNKWf7RLM/C 4=;
In-reply-to: <20151013033304.GL27164@dastard>
References: <0F279340237AA148AD7E3C6A70561A5E01266BE7@xxxxxxxxxxxxxxxxxxxxx> <20151013002308.GI27164@dastard> <8a1b26a3b869448e805485c529c447a4@xxxxxxxxxxxxxxxxxxxxx> <20151013033304.GL27164@dastard>
Thread-index: AdEC1680Gy4Y381SQNu4wXlh8fvUqwCn49kAAAhmBND///HgAIAAS+2w
Thread-topic: mkfs.xfs -n size=65536
I have sytemTap installed on the system.

This script is running in the background and hoping to catch the call-stack 
once the kemem_alloc message appears.

# stap -o /var/kmem_alloc/kmem_alloc_bt.out backtrace.stp

# cat backtrace.stp
#! /usr/bin/env stap
      2 
      3 probe module("xfs").function("xfs_err").call
      4 {
      5   print_backtrace();
      6 }
      9 
     10 


-----Original Message-----
From: Dave Chinner [mailto:david@xxxxxxxxxxxxx] 
Sent: Monday, October 12, 2015 8:33 PM
To: Al Lau (alau2)
Cc: xfs@xxxxxxxxxxx
Subject: Re: mkfs.xfs -n size=65536

On Tue, Oct 13, 2015 at 01:39:13AM +0000, Al Lau (alau2) wrote:
> Have a 3 TB file.  Logically divide into 1024 sections.  Each section 
> has a process doing dd to a randomly selected 4K block in a loop.  
> Will this test case eventually cause the extent fragmentation that 
> lead to the kmem_alloc message?
> 
> dd if=/var/kmem_alloc/junk of=/var/kmem_alloc/fragmented obs=4096 
> bs=4096 count=1 seek=604885543 conv=fsync,notrunc oflag=direct

If you were loking for a recipe to massively fragment a file, then you found 
it. And, yes, when you start to get millions of extents in a file such as this 
workload will cause, you'll start having memory allocation problems.

But I don't think that sets the GFP_ZERO flag anywhere, so that's not 
necessarily where the memroy shortage is coming from. I just committed some 
changes to the dev tree that allow for more detailed information from this 
allocation error point to be obtained - perhaps if woul dbe worthwhile trying a 
kernel build form the current for-next tree and turning the error level up to 
11?

Cheers,

Dave.
--
Dave Chinner
david@xxxxxxxxxxxxx

<Prev in Thread] Current Thread [Next in Thread>