<div dir="ltr"><div><div>Hi Eric,<br></div>I will enable them and run test again. I can only reproduce it with glusterfs rebalance. Glusterfs uses a mechanism it called syncop to unlink file. For rebalance it uses syncop_unlink(glusterfs/libglusterfs/src/syncop.c). In the glusterfs sync_task framework(glusterfs/libglusterfs/src/syncop.c) it uses <a href="http://www.opengroup.org/onlinepubs/009695399/functions/makecontext.html">"makecontext/swapcontext"</a>. Does it leads to racing unlink from different CPU core?<br>
</div>Thank you. <br></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/4/20 Eric Sandeen <span dir="ltr"><<a href="mailto:sandeen@sandeen.net" target="_blank">sandeen@sandeen.net</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div class="im">On 4/19/13 7:51 PM, ·ûÓÀÌÎ wrote:<br>
> After change mount option to sync shutdown still happens, and I got a trace again, the inode 0x1c57d is abnormal.<br>
<br>
</div>since this is a race on namespace operations, I wouldn't have expected sync to matter.<br>
<div class="im"><br>
> <a href="https://docs.google.com/file/d/0B7n2C4T5tfNCYW1jNWhBbXBYakE/edit?usp=sharing" target="_blank">https://docs.google.com/file/d/0B7n2C4T5tfNCYW1jNWhBbXBYakE/edit?usp=sharing</a><br>
> I have a question if the problem is hard to reproduce why I got 8 times in a week only in a test cluster with 8 node?<br>
> What's the problem?<br>
<br>
</div>you must have something unique in your environment, and we don't know what it is.<br>
<br>
To gather more information, can you also turn on tracepoints for:<br>
<br>
xfs_rename<br>
xfs_create<br>
xfs_link<br>
xfs_remove<br>
<br>
in addition to xfs_iunlink and xfs_iunlink_remove,<br>
and we'll see what that tells us.<br>
<br>
There are many paths that manipulate the di_nlink count, and something is racing, but we don't yet know what two callchains they are.<br>
<br>
The above are all the callers that manipulate the link count, so they will yield more information about who is manipulating the counts.<br>
<br>
Thanks,<br>
-Eric<br>
<br>
</blockquote></div><br><br clear="all"><br>-- <br>·ûÓÀÌÎ
</div>