xfs
[Top] [All Lists]

Re: XFS Freezing occasionally hangs

To: xfs@xxxxxxxxxxx
Subject: Re: XFS Freezing occasionally hangs
From: Ryan Campbell <ryan.campbell@xxxxxxxxx>
Date: Fri, 25 Jan 2013 11:08:19 -0600
Delivered-to: xfs@xxxxxxxxxxx
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=Ad9jreT69rhZ+xbI6NsgBSifDAkClq/seI5q96HZvjE=; b=sqZ6w2OZSWxxMK1nR8lZT5eTfSYCP1UuGrCwAoef1JoSaEUqrrASeHZ36SArloR7BK 0P81MppqBjObQGs2ImpAC0la38M8AnJVjsRXH/EtPEYaSNyXYlobOvoO8RdJWopAijqx y28ZYalKik3H5nrvytYxU/J1LcWDq/ZsICv+Vq7tVpUuXI768SOPo5TGV2Rk+UZoRFIf CwLQz9a4TiKgxv0Es6qKheumB62Hq9ujMflAyfHUldXnR22IrTzXumh/1+D6KphHdY67 il3sXWdW9A9b+MUvaJOaoTk9Zhy+e2AIRpcWbSbDAM9WiJQgKwU13Xgzq3+Q4LHVHXLt lvVg==
In-reply-to: <CANHK=J0ZZ+Wx=GYPGh+m-=Dofn_FUnY3H=tdEM5JTrwj=8yq+Q@xxxxxxxxxxxxxx>
References: <CANHK=J0ZZ+Wx=GYPGh+m-=Dofn_FUnY3H=tdEM5JTrwj=8yq+Q@xxxxxxxxxxxxxx>
Is there any additional information I can provide to debug this issue? We are seeing it quite often.


On Thu, Jan 24, 2013 at 9:38 AM, Ryan Campbell <ryan.campbell@xxxxxxxxx> wrote:
We use XFS on EC2 EBS running on Arch Linux (kernel 3.6.7-1-ARCH). Before we take an EC2 snapshot, we call xfs_freeze on the mount so that we can have a consistent snapshot.

On instances running for around 30 days, we see the XFS freeze hang, resulting in a skyrocketing load (but not CPU). We can't kill the xfs_freeze process. The only route available is usually to force a reboot of the server without cleaning unmounting.

There are backtraces in dmesg complaining both of hung xfs processes, and hung java processes. https://gist.github.com/3d46830eac52df44d30f

Is this a known issue? We call xfs_freeze quite often on thousands of XFS volumes, so I wouldn't be surprised if we have encountered an edge case considering how often we do this.

Any help appreciated. I'm recampbell on #xfs/freenode.

Thanks,
Ryan

<Prev in Thread] Current Thread [Next in Thread>