xfs
[Top] [All Lists]

Re: silent corruption after kernel panic?

To: "hch@xxxxxxxxxxxxx" <hch@xxxxxxxxxxxxx>
Subject: Re: silent corruption after kernel panic?
From: "Assarsson, Emil" <Emil.Assarsson@xxxxxxxxxxxxxxxx>
Date: Fri, 23 Sep 2011 12:21:54 +0200
Accept-language: en-US, sv-SE
Acceptlanguage: en-US, sv-SE
Cc: "xfs@xxxxxxxxxxx" <xfs@xxxxxxxxxxx>
In-reply-to: <20110919142729.GA20750@xxxxxxxxxxxxx>
References: <2BF070A7A2375D46BA1B6087F8D5DCB68BEA722B40@xxxxxxxxxxxxxxxxxxxxxxx> <20110919142729.GA20750@xxxxxxxxxxxxx>
Thread-index: Acx52p2n3UrR8rctQTSRtFZ4/36eyg==
Thread-topic: silent corruption after kernel panic?
mån 2011-09-19 klockan 10:27 -0400 skrev Christoph Hellwig:
> On Mon, Sep 19, 2011 at 02:28:23PM +0200, Assarsson, Emil wrote:
> > Hi,
> > 
> > We are running a 20TB XFS filesystem on top of LVM2 and SAN storage (HP
> > Open-V) with multipathd. Ubuntu Lucid. The disk write cache is enabled
> > and we use mount options rw.
> 
> 
> > Sep 16 06:40:34 seldlnx034 kernel: [54607.977261] XFS internal error
> > XFS_WANT_CORRUPTED_RETURN at line 381 of
> > file /build/buildd/linux-2.6.32/fs/xfs/xfs_alloc.c.  Caller
> > 0xffffffffa01eed36
> > Sep 16 06:40:34 seldlnx034 kernel: [54607.996676]  [<ffffffffa0215383>]
> > xfs_error_report+0x43/0x50 [xfs]
> > Sep 16 06:40:34 seldlnx034 kernel: [54607.996689]
> 
> This (corrupted allocation btrees) is a typical indication of missing
> cache flushes.
> 
> Given that before ~2.6.35 LVM/device mapper was not able to pass through
> cache flush requests that is your most likely culprit.  A repair will
> rebuild the freespace btrees, and make sure to keep the write caches
> down the whole stack disabled.

Thanks for you help Christoph. I guess you are right. Some of our system
had write cache enabled and used Device Mapper. We have disabled the
cache.

We got some new, possibly related, problems and was forced to clear the
log. We decided to move the data to a fresh file system. We will use
xfs_dump/restore.

--
Emil Assarsson
<Prev in Thread] Current Thread [Next in Thread>