xfs
[Top] [All Lists]

Re: need help how to debug xfs crash issue xfs_iunlink_remove: xfs_inoto

To: çææ <yongtaofu@xxxxxxxxx>
Subject: Re: need help how to debug xfs crash issue xfs_iunlink_remove: xfs_inotobp() returned error 22
From: Brian Foster <bfoster@xxxxxxxxxx>
Date: Fri, 12 Apr 2013 08:11:43 -0400
Cc: Eric Sandeen <sandeen@xxxxxxxxxxx>, Ben Myers <bpm@xxxxxxx>, "xfs@xxxxxxxxxxx" <xfs@xxxxxxxxxxx>
Delivered-to: xfs@xxxxxxxxxxx
In-reply-to: <CADFMGuJLEChscGDtQjhxNf1EOhpAP2Mj+2BfQsVtef2MSphjZA@xxxxxxxxxxxxxx>
References: <CADFMGuJm5bPPwbbUtYwrCVDL23KExJTw_-VRX2UEEdZjo+i5oA@xxxxxxxxxxxxxx> <CADFMGu+=MM2yc=_peboV7JTNJ8F05TJfexmEErzcf0D8mAWFRg@xxxxxxxxxxxxxx> <CADFMGuKqkPbpcU=taqjTR4sA3o=w1LLAnKoEuj=OhJqEbQVijw@xxxxxxxxxxxxxx> <20130409145238.GE22182@xxxxxxx> <CADFMGuJaiH0wuxOHrDjDn7qRVH+vQkLOOSPUyqSdXnLcS47t3w@xxxxxxxxxxxxxx> <CADFMGu+TdyjTjMTWMwpdHqmszhpCU162UA4Y-njARwSEjM1xNw@xxxxxxxxxxxxxx> <20130410121025.78a42b22@xxxxxxxxxxxxxxxxxxxx> <CADFMGu+yCg4ux0n6S98bqm_cXc=VCcijVBTqwRxvxmtKt_JO-A@xxxxxxxxxxxxxx> <CADFMGuLxgBFU=FUK94tPsCh+qxRW0rEELxSXYoMQLFJ1u3=q0Q@xxxxxxxxxxxxxx> <516746AC.3090808@xxxxxxxxxx> <CADFMGuK-tJQFQzN9wN0LiWWj6SY4tg_c0W9dJadctg=ytegB+w@xxxxxxxxxxxxxx> <516798AE.9050908@xxxxxxxxxxx> <CADFMGuK67G85+J3LAjS=w_nkkSrj7At9HnPLSL-DBO6g0V=ThA@xxxxxxxxxxxxxx> <CADFMGuJLEChscGDtQjhxNf1EOhpAP2Mj+2BfQsVtef2MSphjZA@xxxxxxxxxxxxxx>
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130110 Thunderbird/17.0.2
On 04/12/2013 02:00 AM, çææ wrote:
> stap -e 'probe module("xfs").function("xfs_iunlink"){}'
> WARNING: cannot find module xfs debuginfo: No DWARF information found
> semantic error: no match while resolving probe point
> module("xfs").function("xfs_iunlink")
> Pass 2: analysis failed.  Try again with another '--vp 01' option.
> 

This is the error I get if I remove
kernel-debuginfo-2.6.32-279.el6.x86_64.rpm. Otherwise, the example
xfs_iunlink() probe works for me. The xfs.ko.debug module installed to
my system matches the path you've listed below, as well.

I suppose it couldn't hurt to try and remove/reinstall that module. Do
you get any output from 'objdump --dwarf .../xfs.ko.debug?'

I also notice that you have a newer kernel installed on this system. Are
you sure you're still running the -279 build? I'm not an stap expert,
but it would be nice to find out where it's looking for debug info at
runtime...

Brian

P.S., The commands you've listed in another mail:

sudo stap -L 'kernel.trace("*")'|grep xfs_iunlink
sudo stap -L 'kernel.trace("*")'|grep xfs_ifree

... don't print anything on my box either, but as mentioned, the
xfs_iunlink() probe works. I suspect these are not relevant. Perhaps you
are listing tracepoints here? The following command prints the probe
point info on my box:

stap -L 'module("xfs").function("xfs_iunlink")'

> 
> 2013/4/12 çææ <yongtaofu@xxxxxxxxx <mailto:yongtaofu@xxxxxxxxx>>
> 
>     ls -l
>     
> /usr/lib/debug/lib/modules/2.6.32-279.el6.x86_64/kernel/fs/xfs/xfs.ko.debug
>     -r--r--r-- 1 root root 21393024 Apr 12 12:08
>     
> /usr/lib/debug/lib/modules/2.6.32-279.el6.x86_64/kernel/fs/xfs/xfs.ko.debug
> 
>     rpm -qa|grep  kernel
>     kernel-headers-2.6.32-279.el6.x86_64
>     kernel-devel-2.6.32-279.el6.x86_64
>     kernel-2.6.32-358.el6.x86_64
>     kernel-debuginfo-common-x86_64-2.6.32-279.el6.x86_64
>     abrt-addon-kerneloops-2.0.8-6.el6.x86_64
>     kernel-firmware-2.6.32-358.el6.noarch
>     kernel-debug-2.6.32-358.el6.x86_64
>     kernel-debuginfo-2.6.32-279.el6.x86_64
>     dracut-kernel-004-283.el6.noarch
>     libreport-plugin-kerneloops-2.0.9-5.el6.x86_64
>     kernel-devel-2.6.32-358.el6.x86_64
>     kernel-2.6.32-279.el6.x86_64
> 
>     rpm -q kernel-debuginfo
>     kernel-debuginfo-2.6.32-279.el6.x86_64
> 
>     rpm -q kernel
>     kernel-2.6.32-279.el6.x86_64
>     kernel-2.6.32-358.el6.x86_64
> 
>     do I need to re probe it?
> 
> 
>     2013/4/12 Eric Sandeen <sandeen@xxxxxxxxxxx
>     <mailto:sandeen@xxxxxxxxxxx>>
> 
>         On 4/11/13 11:32 PM, çææ wrote:
>         > Hi Brian,
>         > Sorry but when I execute the script it says:
>         > WARNING: cannot find module xfs debuginfo: No DWARF
>         information found
>         > semantic error: no match while resolving probe point
>         module("xfs").function("xfs_iunlink")
>         >
>         > uname -a
>         > 2.6.32-279.el6.x86_64
>         > kernel debuginfo has been installed.
>         >
>         > Where can I find the correct xfs debuginfo?
> 
>         it should be in the kernel-debuginfo rpm (of the same
>         version/release as the kernel rpm you're running)
> 
>         You should have:
> 
>         
> /usr/lib/debug/lib/modules/2.6.32-279.el6.x86_64/kernel/fs/xfs/xfs.ko.debug
> 
>         If not, can you show:
> 
>         # uname -a
>         # rpm -q kernel
>         # rpm -q kernel-debuginfo
> 
>         -Eric
> 
> 
> 
> 
> 
>     -- 
>     çææ
> 
> 
> 
> 
> -- 
> çææ

<Prev in Thread] Current Thread [Next in Thread>