xfs
[Top] [All Lists]

Bug - xfs_repair asks me to report it

To: "xfs@xxxxxxxxxxx" <xfs@xxxxxxxxxxx>
Subject: Bug - xfs_repair asks me to report it
From: Björn Rafreider <bjoern_rafreider@xxxxxxxxxx>
Date: Fri, 27 Dec 2013 13:42:21 +0100
Accept-language: de-DE
Acceptlanguage: de-DE
Delivered-to: xfs@xxxxxxxxxxx
Thread-index: Ac8C67olwEN2i1cSSqudPWe7BEn8yQ==
Thread-topic: Bug - xfs_repair asks me to report it
Hi,
over christmas our backup system with XFS on LVM2 on iSCSI on Ubuntu 12.04.03 
gave me several errors. Turned out, that the XFS was halted because of an 
error. XFS_repair fixed several errors but finally quit with the following 
error message:

corrupt dinode 3328159430, extent total = 1, nblocks = 0.  This is a bug.
Please capture the filesystem metadata with xfs_metadump and
report it to xfs@xxxxxxxxxxxx
cache_node_purge: refcount was 1, not zero (node=0x1b928ab0)

fatal error -- couldn't map inode 3328159430, err = 117

the dump is running at the moment - but it already has 5G - little too big for 
sending it by mail so I add a little more information

The file System is ~2.9TB on two physical iSCSI drives with 1TB and 1.9TB, ~80% 
used
Kernel is: 3.2.0-57-generic #87-Ubuntu SMP Tue Nov 12 21:35:10 UTC 2013 x86_64 
x86_64 x86_64 GNU/Linux
System is running on Xen with 2G of memory (doubled it to 4G now without a 
change)

The backup is using snapback2, which is basically a wrapper around rsync. It 
hardlinks existing files so a real huge amount of inodes is created.
Filesystem                        Inodes    IUsed      IFree IUse% Mounted on
/dev/mapper/v4iscsibu-backups 1659061776 23831539 1635230237    2% /mnt/backups

Dmesg gave the following errors before shutting down the filesystem:
-------------------------------------------------------------
[   16.216309] scsi0 : iSCSI Initiator over TCP/IP
[   17.227571] scsi 0:0:0:0: Direct-Access     Promise  VessRAID 1840i   0306 
PQ: 0 ANSI: 5
[   17.228312] sd 0:0:0:0: [sda] 2147483648 512-byte logical blocks: (1.09 
TB/1.00 TiB)
[   17.228443] sd 0:0:0:0: Attached scsi generic sg0 type 0
[   17.229380] sd 0:0:0:0: [sda] Write Protect is off
[   17.229384] sd 0:0:0:0: [sda] Mode Sense: a3 00 10 08
[   17.229704] scsi 0:0:0:1: Direct-Access     Promise  VessRAID 1840i   0306 
PQ: 0 ANSI: 5
[   17.229889] sd 0:0:0:1: Attached scsi generic sg1 type 0
[   17.233345] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, 
supports DPO and FUA
[   17.233895] sd 0:0:0:1: [sdb] 4110147584 512-byte logical blocks: (2.10 
TB/1.91 TiB)
[   17.237268] sd 0:0:0:1: [sdb] Write Protect is off
[   17.237273] sd 0:0:0:1: [sdb] Mode Sense: a3 00 10 08
[   17.237852] sd 0:0:0:1: [sdb] Write cache: enabled, read cache: enabled, 
supports DPO and FUA
[   17.251513]  sda: unknown partition table
[   17.253550] sd 0:0:0:0: [sda] Attached SCSI disk
[   17.263924]  sdb: unknown partition table
[   17.266117] sd 0:0:0:1: [sdb] Attached SCSI disk
[   17.406363] init: failsafe main process (791) killed by TERM signal
[   17.736859] XFS (dm-2): Mounting Filesystem
[   17.933764] XFS (dm-2): Starting recovery (logdev: internal)
[   18.345411] XFS (dm-2): Ending recovery (logdev: internal)
[   18.778605] type=1400 audit(1387993447.308:11): apparmor="STATUS" 
operation="profile_replace" name="/sbin/dhclient" pid=1029 
comm="apparmor_parser"
[   18.779096] type=1400 audit(1387993447.308:12): apparmor="STATUS" 
operation="profile_replace" 
name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=1029 
comm="apparmor_parser"
[   18.779349] type=1400 audit(1387993447.308:13): apparmor="STATUS" 
operation="profile_replace" name="/usr/lib/connman/scripts/dhclient-script" 
pid=1029 comm="apparmor_parser"
[   18.807264] type=1400 audit(1387993447.340:14): apparmor="STATUS" 
operation="profile_load" name="/usr/sbin/dhcpd3" pid=1031 comm="apparmor_parser"
[   18.821018] type=1400 audit(1387993447.352:15): apparmor="STATUS" 
operation="profile_load" name="/usr/sbin/dhcpd" pid=1030 comm="apparmor_parser"
[   18.879035] type=1400 audit(1387993447.412:16): apparmor="STATUS" 
operation="profile_load" name="/usr/sbin/mysqld" pid=1032 comm="apparmor_parser"
[   18.882830] type=1400 audit(1387993447.412:17): apparmor="STATUS" 
operation="profile_load" name="/usr/sbin/tcpdump" pid=1034 
comm="apparmor_parser"
[   19.208464] type=1400 audit(1387993447.740:18): apparmor="STATUS" 
operation="profile_replace" name="/usr/sbin/mysqld" pid=1122 
comm="apparmor_parser"
[   19.248026] eth0: no IPv6 routers present
[   19.248031] eth1: no IPv6 routers present
[104404.965327] XFS (dm-2): Internal error xfs_trans_cancel at line 1925 of 
file /build/buildd/linux-3.2.0/fs/xfs/xfs_trans.c.  Caller 0xffffffffa0143773
[104404.965331]
[104404.965452] Pid: 10341, comm: rsync Not tainted 3.2.0-57-generic #87-Ubuntu
[104404.965458] Call Trace:
[104404.965503]  [<ffffffffa01336ef>] xfs_error_report+0x3f/0x50 [xfs]
[104404.965525]  [<ffffffffa0143773>] ? xfs_rename+0x363/0x760 [xfs]
[104404.965549]  [<ffffffffa018e177>] ? xfs_trans_ichgtime+0x27/0xa0 [xfs]
[104404.965571]  [<ffffffffa01847e5>] xfs_trans_cancel+0xe5/0x110 [xfs]
[104404.965588]  [<ffffffffa0143773>] xfs_rename+0x363/0x760 [xfs]
[104404.965605]  [<ffffffffa013c056>] xfs_vn_rename+0x66/0x70 [xfs]
[104404.965613]  [<ffffffff81186ade>] vfs_rename_other+0xde/0x130
[104404.965617]  [<ffffffff81187a1b>] vfs_rename+0xbb/0x240
[104404.965621]  [<ffffffff81185d11>] ? __lookup_hash.part.28+0x31/0xe0
[104404.965625]  [<ffffffff81185fca>] ? inode_permission+0x4a/0x110
[104404.965630]  [<ffffffff8118acc8>] sys_renameat+0x218/0x240
[104404.965635]  [<ffffffff81196501>] ? notify_change+0x271/0x360
[104404.965640]  [<ffffffff81197e6e>] ? vfsmount_lock_local_unlock+0x1e/0x30
[104404.965644]  [<ffffffff81199c80>] ? mntput_no_expire+0x30/0xf0
[104404.965648]  [<ffffffff81199d5f>] ? mntput+0x1f/0x30
[104404.965652]  [<ffffffff81185152>] ? path_put+0x22/0x30
[104404.965656]  [<ffffffff8118ad0b>] sys_rename+0x1b/0x20
[104404.965662]  [<ffffffff81669b82>] system_call_fastpath+0x16/0x1b
[104404.965668] XFS (dm-2): xfs_do_force_shutdown(0x8) called from line 1926 of 
file /build/buildd/linux-3.2.0/fs/xfs/xfs_trans.c.  Return address = 
0xffffffffa01847fe
[104404.979180] XFS (dm-2): xfs_imap_to_bp: xfs_trans_read_buf() returned error 
5.
[104404.983241] XFS (dm-2): Corruption of in-memory data detected.  Shutting 
down filesystem
[104404.983315] XFS (dm-2): Please umount the filesystem and rectify the 
problem(s)
[104426.080039] XFS (dm-2): xfs_log_force: error 5 returned.

Is there a way to get this filesystem working again? I will use another LUN 
with a fresh FS for now.

Thanks,
Björn
---------------------------------------------------------------------------------------------------------------------
N-E-W-S: >>> www.meine-moebelmanufaktur.de 
3D-Möbelkonfigurator - Erlebe Deinen Schrank schon vor der Bestellung im 
Internet<<
---------------------------------------
Björn Rafreider
visual4 GmbH
Schreiberstraße 27
70199 Stuttgart
www.visual4.de
Fon.: +49 (0)711 / 64.91.23.8
Fax.: +49 (0)711 / 64.91.23.9
-----------------------------------------
Sitz der Gesellschaft: Stuttgart
Handelsregister: Amtsgericht Stuttgart, HRB 736092
Geschäftsführung:
Dipl.-Ing. (FH) Christoph Plessner
Dipl.-Ing. Björn Rafreider
Dipl.-Ing. Walter H. Sindlinger

<Prev in Thread] Current Thread [Next in Thread>
  • Bug - xfs_repair asks me to report it, Björn Rafreider <=