xfs
[Top] [All Lists]

memory out with XFS quotacheck oom-killer

To: <xfs@xxxxxxxxxxx>
Subject: memory out with XFS quotacheck oom-killer
From: "Martin" <martin@xxxxxxxxxxxxxxxx>
Date: Tue, 20 Mar 2012 16:15:12 +0100
Thread-index: Ac0GrD5Z1c8nTLwRTPa7xAKqQrVG4A==

Linux version 2.6.32-5-amd64 (Debian 2.6.32-31) on VM

 

/etc/fstab

/dev/sdb1   /web   xfs   uquota,gquota,noatime,nodiratime,nobarrier,logbufs=8   0   2

….

 

#df

 

/dev/sdb1            419359452 227861008 191498444  55% /web

#cat /proc/meminfo

 

MemTotal:        2059676 kB

MemFree:         1217536 kB

Buffers:            4424 kB

Cached:           665212 kB

SwapCached:            0 kB

Active:           123396 kB

Inactive:         558180 kB

Active(anon):      11952 kB

Inactive(anon):      104 kB

Active(file):     111444 kB

Inactive(file):   558076 kB

Unevictable:           0 kB

Mlocked:               0 kB

SwapTotal:        392184 kB

SwapFree:         392184 kB

Dirty:               448 kB

Writeback:             0 kB

AnonPages:         11940 kB

Mapped:             8472 kB

Shmem:               116 kB

Slab:             106380 kB

SReclaimable:      88992 kB

SUnreclaim:        17388 kB

KernelStack:        2008 kB

PageTables:         1588 kB

NFS_Unstable:          0 kB

Bounce:                0 kB

WritebackTmp:          0 kB

CommitLimit:     1422020 kB

Committed_AS:      54892 kB

VmallocTotal:   34359738367 kB

VmallocUsed:      274196 kB

VmallocChunk:   34359444756 kB

HardwareCorrupted:     0 kB

HugePages_Total:       0

HugePages_Free:        0

HugePages_Rsvd:        0

HugePages_Surp:        0

Hugepagesize:       2048 kB

DirectMap4k:       10240 kB

DirectMap2M:     2086912 kB

 

We add the quota’s to fstab and restart.

 

Now we get:

 

Mar 20 14:40:56 nfs kernel: [7224126.442126] XFS mounting filesystem sdb1

Mar 20 14:41:10 nfs kernel: [7224139.613379] XFS mounting filesystem sdb1

Mar 20 14:41:10 nfs kernel: [7224139.772452] XFS quotacheck sdb1: Please wait.

Mar 20 14:43:02 nfs kernel: [7224251.264262] file invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0

Mar 20 14:43:02 nfs kernel: [7224251.264268] file cpuset=/ mems_allowed=0

Mar 20 14:43:02 nfs kernel: [7224251.264270] Pid: 9585, comm: file Not tainted 2.6.32-5-amd64 #1

Mar 20 14:43:02 nfs kernel: [7224251.264272] Call Trace:

Mar 20 14:43:02 nfs kernel: [7224251.264282]  [<ffffffff810b60e8>] ? oom_kill_process+0x7f/0x23f

Mar 20 14:43:02 nfs kernel: [7224251.264285]  [<ffffffff810b660c>] ? __out_of_memory+0x12a/0x141

Mar 20 14:43:02 nfs kernel: [7224251.264287]  [<ffffffff810b6763>] ? out_of_memory+0x140/0x172

Mar 20 14:43:02 nfs kernel: [7224251.264290]  [<ffffffff810ba4c1>] ? __alloc_pages_nodemask+0x4e5/0x5f4

Mar 20 14:43:02 nfs kernel: [7224251.264293]  [<ffffffff810bba25>] ? __do_page_cache_readahead+0x9b/0x1b4

Mar 20 14:43:02 nfs kernel: [7224251.264295]  [<ffffffff810bbb5a>] ? ra_submit+0x1c/0x20

Mar 20 14:43:02 nfs kernel: [7224251.264298]  [<ffffffff810bbe49>] ? page_cache_async_readahead+0x75/0xad

Mar 20 14:43:02 nfs kernel: [7224251.264301]  [<ffffffff810b4767>] ? filemap_fault+0xae/0x2f6

Mar 20 14:43:02 nfs kernel: [7224251.264305]  [<ffffffff810ca796>] ? __do_fault+0x54/0x3c3

Mar 20 14:43:02 nfs kernel: [7224251.264309]  [<ffffffff81040432>] ? set_next_entity+0x34/0x56

Mar 20 14:43:02 nfs kernel: [7224251.264313]  [<ffffffff810ccabf>] ? handle_mm_fault+0x3b8/0x80f

Mar 20 14:43:02 nfs kernel: [7224251.264316]  [<ffffffff8103a990>] ? pick_next_task+0x21/0x3c

Mar 20 14:43:02 nfs kernel: [7224251.264320]  [<ffffffff8101654b>] ? sched_clock+0x5/0x8

Mar 20 14:43:02 nfs kernel: [7224251.264323]  [<ffffffff8101180e>] ? call_function_single_interrupt+0xe/0x20

Mar 20 14:43:02 nfs kernel: [7224251.264327]  [<ffffffff812fe6b6>] ? do_page_fault+0x2e0/0x2fc

Mar 20 14:43:02 nfs kernel: [7224251.264329]  [<ffffffff812fc555>] ? page_fault+0x25/0x30

Mar 20 14:43:02 nfs kernel: [7224251.264331] Mem-Info:

Mar 20 14:43:02 nfs kernel: [7224251.264332] Node 0 DMA per-cpu:

Mar 20 14:43:02 nfs kernel: [7224251.264334] CPU    0: hi:    0, btch:   1 usd:   0

Mar 20 14:43:02 nfs kernel: [7224251.264335] CPU    1: hi:    0, btch:   1 usd:   0

Mar 20 14:43:02 nfs kernel: [7224251.264337] CPU    2: hi:    0, btch:   1 usd:   0

Mar 20 14:43:02 nfs kernel: [7224251.264338] CPU    3: hi:    0, btch:   1 usd:   0

Mar 20 14:43:02 nfs kernel: [7224251.264339] Node 0 DMA32 per-cpu:

Mar 20 14:43:02 nfs kernel: [7224251.264341] CPU    0: hi:  186, btch:  31 usd:  67

Mar 20 14:43:02 nfs kernel: [7224251.264342] CPU    1: hi:  186, btch:  31 usd:  63

Mar 20 14:43:02 nfs kernel: [7224251.264344] CPU    2: hi:  186, btch:  31 usd:  57

Mar 20 14:43:02 nfs kernel: [7224251.264345] CPU    3: hi:  186, btch:  31 usd:  40

Mar 20 14:43:02 nfs kernel: [7224251.264349] active_anon:84 inactive_anon:343 isolated_anon:0

Mar 20 14:43:02 nfs kernel: [7224251.264350]  active_file:318 inactive_file:3150 isolated_file:0

Mar 20 14:43:02 nfs kernel: [7224251.264350]  unevictable:0 dirty:7 writeback:0 unstable:0

Mar 20 14:43:02 nfs kernel: [7224251.264351]  free:3434 slab_reclaimable:496871 slab_unreclaimable:5914

Mar 20 14:43:02 nfs kernel: [7224251.264352]  mapped:654 shmem:0 pagetables:510 bounce:0

Mar 20 14:43:02 nfs kernel: [7224251.264353] Node 0 DMA free:8040kB min:40kB low:48kB high:60kB active_anon:0kB inactive_anon:0kB active_f

Mar 20 14:43:02 nfs kernel: [7224251.264361] lowmem_reserve[]: 0 2004 2004 2004

Mar 20 14:43:02 nfs kernel: [7224251.264363] Node 0 DMA32 free:5696kB min:5704kB low:7128kB high:8556kB active_anon:336kB inactive_anon:13

Mar 20 14:43:02 nfs kernel: [7224251.264371] lowmem_reserve[]: 0 0 0 0

Mar 20 14:43:02 nfs kernel: [7224251.264373] Node 0 DMA: 4*4kB 7*8kB 14*16kB 24*32kB 13*64kB 6*128kB 7*256kB 3*512kB 0*1024kB 1*2048kB 0*4

Mar 20 14:43:02 nfs kernel: [7224251.264379] Node 0 DMA32: 298*4kB 497*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB

Mar 20 14:43:02 nfs kernel: [7224251.264384] 3830 total pagecache pages

Mar 20 14:43:02 nfs kernel: [7224251.264386] 334 pages in swap cache

Mar 20 14:43:02 nfs kernel: [7224251.264387] Swap cache stats: add 12771, delete 12437, find 1426/2906

Mar 20 14:43:02 nfs kernel: [7224251.264388] Free swap  = 375488kB

Mar 20 14:43:02 nfs kernel: [7224251.264389] Total swap = 392184kB

Mar 20 14:43:02 nfs kernel: [7224251.268966] 524272 pages RAM

Mar 20 14:43:02 nfs kernel: [7224251.268968] 9417 pages reserved

Mar 20 14:43:02 nfs kernel: [7224251.268969] 1144 pages shared

 

What can we do? The system is productive, we only want to add quota support for xfs.

 

Thanks

Martin

<Prev in Thread] Current Thread [Next in Thread>