xfs
[Top] [All Lists]

Re: Subject : Happened again, 20140811 -- Got "Internal error XFS_WANT_C

To: XFS mailing list <xfs@xxxxxxxxxxx>
Subject: Re: Subject : Happened again, 20140811 -- Got "Internal error XFS_WANT_CORRUPTED_GOTO". Filesystem needs reformatting to correct issue.
From: "Carlos E. R." <carlos.e.r@xxxxxxxxxxxx>
Date: Tue, 12 Aug 2014 00:36:31 +0200 (CEST)
Delivered-to: xfs@xxxxxxxxxxx
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:subject:in-reply-to:message-id:references :user-agent:mime-version:content-type:content-id; bh=F4sjoEpzCNjKWBghgkhZGYselSmOsi3hyaetBF4HueY=; b=mFO9QaCmxwsdbcqYuguvw6GNFINWW7PPEx7HfY+oMcWuOk95w/URCkqJrxbzvIQ4y0 +PztDJ22o1Y1EyTlASFXQcvg3N9NMt6Tyf0KiLvsa3V3BgDQPuQQbr1jF3OwcnOiaI/4 DXaON+b1LcN4V6Tg6pAxC2P9NO9Lh5IkhgA+nQgLpOzY+UD7trDZN9nb9m83Hi22LuHw vR97UypKm+Hubw15C6z5FEuaGu72t7a69XRHIJVbWKZA9va71xmZS2leZ6EAaY8HAp+q uNIveBDF7/ZQLsMUf/t6ELCiwXUKGhu9W0DVA+/rVvpk2NVvqk1weYO86YX6DnRDCC3E vJiA==
In-reply-to: <53E93C29.1020103@xxxxxxx>
References: <alpine.LSU.2.11.1407021104480.9881@xxxxxxxxxxxxxxxxx> <alpine.LSU.2.11.1408111559280.2447@xxxxxxxxxxxxxxxxxxxx> <53E8D9F6.7080704@xxxxxxx> <alpine.LSU.2.11.1408111720170.7326@xxxxxxxxxxxxxxxxxxxx> <53E93530.4070902@xxxxxxx> <alpine.LSU.2.11.1408112347480.17839@xxxxxxxxxxxxxxxxxxxx> <53E93C29.1020103@xxxxxxx>
Sender: Carlos Robinson <robin.listas@xxxxxxxxx>
User-agent: Alpine 2.11 (LSU 23 2013-08-11)
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Content-ID: <alpine.LSU.2.11.1408120019370.17839@xxxxxxxxxxxxxxxxxxxx>


El 2014-08-11 a las 16:56 -0500, Mark Tinguely escribiÃ:
On 08/11/14 16:50, Carlos E. R. wrote:

We should have quiesced the metadata/log before freezing xfs. Was
there a lot of items in the log?

Sorry, what log? The /var/log/messages file? I posted it in full, from
before the hibernation to powerdown.


Sorry, I was referring to the XFS log.

If you had a metadata dump before mounting/xfs_repair, then you can display the xfs log using the xfs_logprint.

Ah! Ok :-)



Telcontar:/data/storage_d/xfs_disaster_home/20140811 # xfs_logprint -f 
tgtfile_20140811
xfs_logprint:
    data device: 0xffffffffffffffff
    log device: 0xffffffffffffffff daddr: 0 length: 820476

cycle: 3        version: 2              lsn: 3,65730    tail_lsn: 3,65561
length of Log Record: 1024      prev offset: 65667              num ops: 10
uuid: 3a35756d-1b63-4b9b-9b3a-c12c8951b678   format: little endian linuxh_size: 
32768
- ----------------------------------------------------------------------------
Oper (0): tid: b80486ac  len: 0  clientid: TRANS  flags: START
- ----------------------------------------------------------------------------
Oper (1): tid: b80486ac  len: 16  clientid: TRANS  flags: none
TRAN:    type: CHECKPOINT       tid: b80486ac       num_items: 7
- ----------------------------------------------------------------------------
Oper (2): tid: b80486ac  len: 56  clientid: TRANS  flags: none
INODE: #regs: 3   ino: 0x20fcbc83  flags: 0x5   dsize: 96
        blkno: 264281664  len: 16  boff: 768
Oper (3): tid: b80486ac  len: 96  clientid: TRANS  flags: none
INODE CORE
magic 0x494e mode 0100644 version 2 format 2
nlink 1 uid 1000 gid 100
atime 0x53b9d2fd mtime 0x53c05b34 ctime 0x53c05b34
size 0x90f8 nblocks 0xa extsize 0x0 nextents 0x6
naextents 0x0 forkoff 0 dmevmask 0x0 dmstate 0x0
flags 0x0 gen 0xd2610167
Oper (4): tid: b80486ac  len: 96  clientid: TRANS  flags: none
EXTENTS inode data
- ----------------------------------------------------------------------------
Oper (5): tid: b80486ac  len: 56  clientid: TRANS  flags: none
INODE: #regs: 2   ino: 0x6048329c  flags: 0x1   dsize: 0
        blkno: 770365760  len: 16  boff: 7168
Oper (6): tid: b80486ac  len: 96  clientid: TRANS  flags: none
INODE CORE
magic 0x494e mode 0100600 version 2 format 2
nlink 1 uid 1000 gid 100
atime 0x53c05b25 mtime 0x53c05b34 ctime 0x53c05b34
size 0x0 nblocks 0x0 extsize 0x0 nextents 0x0
naextents 0x0 forkoff 0 dmevmask 0x0 dmstate 0x0
flags 0x0 gen 0x69e7b261
- ----------------------------------------------------------------------------
Oper (7): tid: b80486ac  len: 56  clientid: TRANS  flags: none
INODE: #regs: 2   ino: 0x600814ef  flags: 0x1   dsize: 0
        blkno: 768264816  len: 16  boff: 3840
Oper (8): tid: b80486ac  len: 96  clientid: TRANS  flags: none
INODE CORE
magic 0x494e mode 0100600 version 2 format 2
nlink 1 uid 1000 gid 100
atime 0x53b6ef00 mtime 0x53c05b34 ctime 0x53c05b34
size 0x1 nblocks 0x1 extsize 0x0 nextents 0x1
naextents 0x0 forkoff 0 dmevmask 0x0 dmstate 0x0
flags 0x0 gen 0x97ccc0ee
- ----------------------------------------------------------------------------
Oper (9): tid: b80486ac  len: 0  clientid: TRANS  flags: COMMIT

============================================================================
cycle: 3        version: 2              lsn: 3,65733    tail_lsn: 3,65561
length of Log Record: 32256     prev offset: 65730              num ops: 176
uuid: 3a35756d-1b63-4b9b-9b3a-c12c8951b678   format: little endian linux
h_size: 32768
**********************************************************************
* ERROR: data block=379316                                            *
**********************************************************************
Bad data in log
Telcontar:/data/storage_d/xfs_disaster_home/20140811 #



But I have no idea what any of that means.


Notice that the metadata was obtained using tools version 3.1.11, but the print above was made using tools version 3.2.1 - in case that has any relevance.



And, same operation on the metadata obtained after running repairs:



Telcontar:/data/storage_d/xfs_disaster_home/20140811 # xfs_logprint -f 
tgtfile_20140811_after_repair
xfs_logprint:
    data device: 0xffffffffffffffff
    log device: 0xffffffffffffffff daddr: 0 length: 820428

Log inconsistent or not a log (last==0, first!=1)
xfs_logprint: after 7 zeroed blocks
**********************************************************************
* ERROR: found data after zeroed blocks block=13                     *
**********************************************************************
Bad log - data after zeroed blocks
Telcontar:/data/storage_d/xfs_disaster_home/20140811 # xfs_logprint -f 
tgtfile_20140811_after_repair_bis
xfs_logprint:
    data device: 0xffffffffffffffff
    log device: 0xffffffffffffffff daddr: 0 length: 820428

Log inconsistent or not a log (last==0, first!=1)
xfs_logprint: after 7 zeroed blocks
**********************************************************************
* ERROR: found data after zeroed blocks block=13                     *
**********************************************************************
Bad log - data after zeroed blocks
Telcontar:/data/storage_d/xfs_disaster_home/20140811 #




Telcontar:/data/storage_d/xfs_disaster_home/20140811 # file tgtfile_20140811*
tgtfile_20140811:                        XFS filesystem metadump image
tgtfile_20140811_after_repair:           XFS filesystem metadump image
tgtfile_20140811_after_repair_bis:       XFS filesystem metadump image
tgtfile_20140811_obfus:                  XFS filesystem metadump image
tgtfile_20140811_obfus_after_repair:     XFS filesystem metadump image
tgtfile_20140811_obfus_after_repair_bis: XFS filesystem metadump image
Telcontar:/data/storage_d/xfs_disaster_home/20140811 #


tgtfile_20140811  is the metadata obtained before any mount or
   repairs, using tools 3.1.11.

tgtfile_20140811_after_repair  is the metadata obtained after
   mount and repair, using tools 3.1.11.

tgtfile_20140811_after_repair_bis is the metadata obtained after
   mount and repair, using tools 3.2.1



I will now attempt to upload the three obfuscated files. Sizes are quite different, after compression:

Telcontar:/data/storage_d/xfs_disaster_home/20140811/tmp # ls -lh
total 51M
 26M Aug 11 16:21 tgtfile_20140811_obfus.xz
 13M Aug 11 18:54 tgtfile_20140811_obfus_after_repair.xz
 13M Aug 11 23:16 tgtfile_20140811_obfus_after_repair_bis.xz

but all of them are about 401M before compression. The upload will take long, my ADSL upload is 0.3M/s at most.


- -- Cheers
       Carlos E. R.

       (from 13.1 x86_64 "Bottle" (Minas Tirith))
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (GNU/Linux)

iF4EAREIAAYFAlPpRXYACgkQja8UbcUWM1zsXwD/aGq1sLIqPi6U7nOTeB66B5CO
dTpXM/WZtk2gJl7JhvwBAIOeh+TkHN1+rdOQj3z80KG17IuOHpu/wrrPlZ+YqMPR
=3JHj
-----END PGP SIGNATURE-----
<Prev in Thread] Current Thread [Next in Thread>