xfs
[Top] [All Lists]

xfs hang or slowness while removing files

To: xfs@xxxxxxxxxxx
Subject: xfs hang or slowness while removing files
From: Avi Kivity <avi@xxxxxxxxxxxx>
Date: Wed, 2 Dec 2015 13:07:56 +0200
Delivered-to: xfs@xxxxxxxxxxx
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=scylladb-com.20150623.gappssmtp.com; s=20150623; h=to:from:subject:message-id:date:user-agent:mime-version :content-type:content-transfer-encoding; bh=T+xGC0GgtA2jemLOnSR6E3citVk1bhYzV8AQITlLm7E=; b=bvyk6bqpu4z9t2oFI5rOvaUW565qRM2Q9LgavpuABSN+6B+R0nulImM4cmciRoIjAp A77QTzY6d/9jzC9y/cm1Qc+jP2IBDD080LSh4m/7z+oDBfDYMUBr2RJ/ueBnLsCZExSj uBFCXPkwxvK9vsZ90GFsmqywymYXJ6l/kod+dN4uzZuttGf1BgWYEcQ/DARSn0eGX3o/ A5EI9LZzdSiy+VVpjZzLMp7RhVLvvkTOho0jNwrKjrgf1vd3LmFSgYKfCx3XtP4+d2HJ CQ+uyGY1ro9U8x8b6P1d5q62AFEbutUF7NGNTUY5upOWo/gmpS3LZ6gMDOCRrMCNLNhJ e+iA==
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.3.0
Removing a directory with ~900 32MB files, we saw this:

[ 5645.684464] INFO: task xfsaild/md0:12247 blocked for more than 120 seconds. [ 5645.686488] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5645.687713] xfsaild/md0 D ffff88103f9d3680 0 12247 2 0x00000080 [ 5645.687729] ffff8810136f7d40 0000000000000046 ffff882026d82220 ffff8810136f7fd8 [ 5645.687732] ffff8810136f7fd8 ffff8810136f7fd8 ffff882026d82220 ffff882026d82220 [ 5645.687734] ffff88103f9d44c0 0000000000000001 0000000000000000 ffff8820285aa928
[ 5645.687737] Call Trace:
[ 5645.687747]  [<ffffffff816098d9>] schedule+0x29/0x70
[ 5645.687768]  [<ffffffffa06cd880>] _xfs_log_force+0x230/0x290 [xfs]
[ 5645.687773]  [<ffffffff810a9510>] ? wake_up_state+0x20/0x20
[ 5645.687796]  [<ffffffffa06cd906>] xfs_log_force+0x26/0x80 [xfs]
[ 5645.687808] [<ffffffffa06d2380>] ? xfs_trans_ail_cursor_first+0x90/0x90 [xfs]
[ 5645.687818]  [<ffffffffa06d24d1>] xfsaild+0x151/0x5e0 [xfs]
[ 5645.687828] [<ffffffffa06d2380>] ? xfs_trans_ail_cursor_first+0x90/0x90 [xfs]
[ 5645.687831]  [<ffffffff8109727f>] kthread+0xcf/0xe0
[ 5645.687834]  [<ffffffff810971b0>] ? kthread_create_on_node+0x140/0x140
[ 5645.687837]  [<ffffffff81614358>] ret_from_fork+0x58/0x90
[ 5645.687852]  [<ffffffff810971b0>] ? kthread_create_on_node+0x140/0x140

'rm' did not complete, but was killable. Nothing else was running on the system at the time.

The filesystem was mounted with the discard option set, but since that is discouraged, we'll retry without it.

<Prev in Thread] Current Thread [Next in Thread>