xfs
[Top] [All Lists]

xlog_write: reservation ran out. Need to up reservation

To: xfs@xxxxxxxxxxx
Subject: xlog_write: reservation ran out. Need to up reservation
From: Thomas Klaube <thomas@xxxxxxxxxx>
Date: Tue, 19 Aug 2014 17:34:30 +0200 (CEST)
Delivered-to: xfs@xxxxxxxxxxx
In-reply-to: <159192779.3859815.1408461799560.JavaMail.zimbra@xxxxxxxxxx>
Thread-index: MAXSuDewHo8arNYjMVm3SkM+CWalbg==
Thread-topic: xlog_write: reservation ran out. Need to up reservation
Hi all,

I am currently testing/benchmarking xfs on top of a bcache. When I run a heavy
IO workload (fio with 64 threads, read/write) on the device for ~30-45min I get

[ 9092.978268] XFS (bcache1): xlog_write: reservation summary:
[ 9092.978268]   trans type  = (null) (42)
[ 9092.978268]   unit res    = 18730384 bytes
[ 9092.978268]   current res = -1640 bytes
[ 9092.978268]   total reg   = 512 bytes (o/flow = 1163749592 bytes)
[ 9092.978268]   ophdrs      = 655304 (ophdr space = 7863648 bytes)
[ 9092.978268]   ophdr + reg = 1171613752 bytes
[ 9092.978268]   num regions = 2
[ 9092.978268] 
[ 9092.978272] XFS (bcache1): region[0]: LR header - 512 bytes
[ 9092.978273] XFS (bcache1): region[1]: commit - 0 bytes
[ 9092.978274] XFS (bcache1): xlog_write: reservation ran out. Need to up 
reservation
[ 9092.978303] XFS (bcache1): xfs_do_force_shutdown(0x2) called from line 2036 
of file fs/xfs/xfs_log.c.  Return address = 0xffffffffa04433c8
[ 9092.979189] XFS (bcache1): Log I/O Error Detected.  Shutting down filesystem
[ 9092.979210] XFS (bcache1): Please umount the filesystem and rectify the 
problem(s)
[ 9092.979238] XFS (bcache1): xfs_do_force_shutdown(0x2) called from line 1497 
of file fs/xfs/xfs_log.c.  Return address = 0xffffffffa0443b57
[ 9093.183869] XFS (bcache1): xfs_log_force: error 5 returned.
[ 9093.489944] XFS (bcache1): xfs_log_force: error 5 returned.

Kernel is 3.16.1 but this also happens with Ubuntu 3.13.0.34. 
With the bcache the fio puts ~30k IOps on the filesystem. 

xfs_info:
meta-data=/dev/bcache1           isize=256    agcount=8, agsize=268435455 blks
         =                       sectsz=512   attr=2
data     =                       bsize=4096   blocks=1949957886, imaxpct=5
         =                       sunit=0      swidth=0 blks
naming   =version 2              bsize=4096   ascii-ci=0
log      =internal               bsize=4096   blocks=521728, version=2
         =                       sectsz=512   sunit=0 blks, lazy-count=1
realtime =none                   extsz=4096   blocks=0, rtextents=0

umount/mount recovers the fs and the fs seems ok.

I can reproduce this behavior. Is there anything I could try to debug
this?

Regards
Thomas

<Prev in Thread] Current Thread [Next in Thread>