xfs
[Top] [All Lists]

Re: Deadlock while running on XFS

To: linux-xfs@xxxxxxxxxxx
Subject: Re: Deadlock while running on XFS
From: Nathan Straz <nstraz@xxxxxxx>
Date: Mon, 9 Jul 2001 09:12:20 -0500
In-reply-to: <15498.994487739@xxxxxxxxxxxx>
Mail-followup-to: linux-xfs@xxxxxxxxxxx
References: <15498.994487739@xxxxxxxxxxxx>
Sender: owner-linux-xfs@xxxxxxxxxxx
User-agent: Mutt/1.3.18i
Okay, second try at decoding the output.  This one looks better, but I
still don't like how some parts look.  As a side note, I ran the same
tests on 2.4.3-XFS-PR3 for 30 hours this weekend without hitting this
deadlock. 

ksymoops 2.4.2 on i686 2.4.3-SGI_XFS_1.0.1smp.  Options used
     -V (default)
     -k ksyms (specified)
     -l /proc/modules (default)
     -o /lib/modules/2.4.3-SGI_XFS_1.0.1smp_1_IA32_SMP_20010705135821/ 
(specified)
     -m /boot/System.map-2.4.3-SGI_XFS_1.0.1smp_1_IA32_SMP_20010705135821 
(specified)

Error (pclose_local): find_objects pclose failed 0x100
Warning (compare_ksyms_lsmod): module ipchains is in lsmod but not in ksyms, 
probably no symbols exported
Warning (compare_ksyms_lsmod): module nfs is in lsmod but not in ksyms, 
probably no symbols exported
Warning (compare_maps): mismatch on symbol partition_name  , ksyms_base says 
c022c1d0, System.map says c01597b0.  Ignoring ksyms_base entry
init      S C476DF0C       0     1      0 19883  (NOTLB)        
Using defaults from ksymoops -t elf32-i386 -a i386
Call Trace: [<c0114691>] [<c01145b4>] [<c0146b28>] [<c0147102>] [<c0106e23>] 
keventd   S 00000000       0     2      1        (L-TLB)       3
Call Trace: [<c0122fc8>] [<c0105643>] 
kswapd    S C4769FA0       0     3      1        (L-TLB)       4     2
Call Trace: [<c0114691>] [<c01145b4>] [<c0114f82>] [<c029476e>] [<c012fbc9>] 
   [<c0105643>] 
kreclaimd  S 00000286       0     4      1        (L-TLB)       5     3
Call Trace: [<c0114f0d>] [<c0294778>] [<c012fcbb>] [<c010563a>] [<c0105643>] 
bdflush   S C477C000       0     5      1        (L-TLB)       6     4
Call Trace: [<c029550e>] [<c012f813>] [<c013b17e>] [<c0105643>] 
kupdated  D C477A000       0     6      1        (L-TLB)       7     5
Call Trace: [<c01d877e>] [<c01d885d>] [<c01d3e13>] [<c01ad831>] [<c01ad873>] 
   [<c01d3e13>] [<c01d3e13>] [<c01d27dd>] [<c016a910>] [<c01d2760>] 
[<c01c6037>] 
   [<c0169674>] [<c01d2760>] [<c01d293c>] [<c01d294f>] [<c01d2760>] 
[<c01d293c>] 
   [<c0127550>] [<c01d293c>] [<c014b937>] [<c013af87>] [<c013b28d>] 
[<c0105643>] 
pagebuf_daemon  S 00000286       0     7      1        (L-TLB)       8     6
Call Trace: [<c0114f0d>] [<c01685cc>] [<c01684d0>] [<c0105643>] 
mdrecoveryd  S F717C000       0     8      1        (L-TLB)     594     7
Call Trace: [<c02afdf1>] [<c0230682>] [<c0105643>] 
syslogd   S 7FFFFFFF       0   594      1        (NOTLB)     599     8
Call Trace: [<c0114627>] [<c0232437>] [<c0146b28>] [<c0147102>] [<c0106e23>] 
klogd     R F5E48000    4160   599      1        (NOTLB)     613   594
Call Trace: [<c0231ffd>] [<c0116ffc>] [<c01575e5>] [<c0136a1a>] [<c0106e23>] 
   [<c010002b>] 
portmap   S 7FFFFFFF       0   613      1        (NOTLB)     628   599
Call Trace: [<c024ebff>] [<c0232437>] [<c0114627>] [<c01473d3>] [<c014735f>] 
   [<c0147663>] [<c0106e23>] 
rpc.statd  S 7FFFFFFF       0   628      1        (NOTLB)     717   613
Call Trace: [<c0114627>] [<c0232437>] [<c0146b28>] [<c0147102>] [<c0136607>] 
   [<c0106e23>] 
ypbind    S 7FFFFFFF       0   717      1   719  (NOTLB)     776   628
Call Trace: [<c024ebff>] [<c0232437>] [<c0114627>] [<c01473d3>] [<c014735f>] 
   [<c0147663>] [<c0106e23>] 
ypbind    S F5F8BF10    4768   719    717   721  (NOTLB)        
Call Trace: [<c0114691>] [<c01145b4>] [<c014735f>] [<c0147663>] [<c01086c9>] 
   [<c01086e9>] [<c0106e23>] [<c010002b>] 
ypbind    S 00000000    4160   720    719        (NOTLB)     721
Call Trace: [<c0105fdb>] [<c0106e23>] [<c010002b>] 
ypbind    S F66B9F78    1392   721    719        (NOTLB)           720
Call Trace: [<c0130870>] [<c0146916>] [<c0114691>] [<c01145b4>] [<c011f1ab>] 
   [<c0106e23>] [<c010002b>] 
automount  S F64C2000      16   776      1        (NOTLB)     786   717
Call Trace: [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
automount  S F5CF2000    4160   786      1        (NOTLB)     796   776
Call Trace: [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
automount  S F5D56000       0   796      1        (NOTLB)     806   786
Call Trace: [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
automount  S F6712000    4488   806      1        (NOTLB)     816   796
Call Trace: [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
automount  S F5E2C000    4160   816      1        (NOTLB)     826   806
Call Trace: [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
automount  S F65B4000       0   826      1        (NOTLB)     836   816
Call Trace: [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
automount  S F66AC000       4   836      1        (NOTLB)     846   826
Call Trace: [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
automount  S F5D42000    4160   846      1        (NOTLB)     856   836
Call Trace: [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
automount  S C44F2000       0   856      1        (NOTLB)     866   846
Call Trace: [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
automount  S C44FE000       0   866      1        (NOTLB)     876   856
Call Trace: [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
automount  S C4504000       0   876      1        (NOTLB)     886   866
Call Trace: [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
automount  S C4608000       0   886      1        (NOTLB)     893   876
Call Trace: [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
automount  S F6454000       0   893      1        (NOTLB)     905   886
Call Trace: [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
atd       S F6689F78       0   905      1        (NOTLB)    1000   893
Call Trace: [<c0114691>] [<c01145b4>] [<c011f1ab>] [<c0106e23>] 
sshd      S 7FFFFFFF       0  1000      1        (NOTLB)    1080   905
Call Trace: [<c0114627>] [<c0232437>] [<c0146b28>] [<c0147102>] [<c0106e23>] 
xinetd    S 7FFFFFFF       0  1080      1 19899  (NOTLB)    1113  1000
Call Trace: [<c0114627>] [<c0232437>] [<c0146b28>] [<c0147102>] [<c0136607>] 
   [<c0106e23>] 
sendmail  S F5B1BF0C    2416  1113      1        (NOTLB)    1126  1080
Call Trace: [<c01469ae>] [<c0114691>] [<c01145b4>] [<c0146b28>] [<c0147102>] 
   [<c0106e23>] 
crond     S F5AFDF78       0  1126      1 19880  (NOTLB)    1165  1113
Call Trace: [<c0114691>] [<c01145b4>] [<c011f1ab>] [<c0106e23>] 
mingetty  S 7FFFFFFF       0  1165      1        (NOTLB)    1166  1126
Call Trace: [<c0114627>] [<c01ed24d>] [<c01e917c>] [<c0136a1a>] [<c0106e23>] 
mingetty  S 7FFFFFFF       0  1166      1        (NOTLB)    1167  1165
Call Trace: [<c0114627>] [<c01ed24d>] [<c01e917c>] [<c0136a1a>] [<c0106e23>] 
mingetty  S 7FFFFFFF       0  1167      1        (NOTLB)    1168  1166
Call Trace: [<c0114627>] [<c01ed24d>] [<c01e917c>] [<c0136a1a>] [<c0106e23>] 
mingetty  S 7FFFFFFF       0  1168      1        (NOTLB)    1169  1167
Call Trace: [<c0114627>] [<c01ed24d>] [<c01e917c>] [<c0136a1a>] [<c0106e23>] 
mingetty  S 7FFFFFFF       0  1169      1        (NOTLB)    5626  1168
Call Trace: [<c0114627>] [<c01ed24d>] [<c01e917c>] [<c0136a1a>] [<c0106e23>] 
in.rlogind  S 7FFFFFFF       0  1328   1080  1355  (NOTLB)   19750
Call Trace: [<c01ef51c>] [<c0114627>] [<c0146b28>] [<c0147102>] [<c0106e23>] 
   [<c010002b>] 
login     S 00000000    2416  1355   1328  1356  (NOTLB)        
Call Trace: [<c0114b12>] [<c011a596>] [<c0106e23>] 
tcsh      S 00000000       0  1356   1355  5567  (NOTLB)        
Call Trace: [<c0114b12>] [<c0105fdb>] [<c0106e23>] 
su        S 00000000       0  5567   1356  5568  (NOTLB)        
Call Trace: [<c011a596>] [<c0106e23>] 
bash      S 00000000       0  5568   5567 19749  (NOTLB)        
Call Trace: [<c01ea876>] [<c01eac4d>] [<c011a596>] [<c0106e23>] 
pmd       S 7FFFFFFF    3608  5626      1 23861  (NOTLB)    5978  1169
Call Trace: [<c0114627>] [<c0232437>] [<c0146b28>] [<c0147102>] [<c0106e23>] 
   [<c010002b>] 
getpgid2_01  S F4F8C000       0  5978      1        (NOTLB)   23496  5626
Call Trace: [<c010ca92>] [<c0106e23>] 
getpgid2_01  S F300C000    2416 23496      1        (NOTLB)   19776  5978
Call Trace: [<c010ca92>] [<c0106e23>] 
pmd       S F43D8000       0 23861   5626 19698  (NOTLB)        
Call Trace: [<c01145a7>] [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
renamer01  S 00000000       0 19588  23861 19622  (NOTLB)   19659
Call Trace: [<c0114b12>] [<c0105fdb>] [<c0106e23>] 
renamer   D F645C0E0       0 19622  19588        (NOTLB)        
Call Trace: [<c01d2555>] [<c0141935>] [<c0105b6b>] [<c0105d18>] [<c028799c>] 
   [<c0106e23>] [<c010002b>] 
rwtest    S 00000000       0 19659  23861 19699  (NOTLB)   19698 19588
Call Trace: 
wait_on_irq, CPU 0:
irq:  1 [ 0 1 0 0 ]
bh:   1 [ 1 0 0 0 ]
Stack dumps:
CPU 1:6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 
       6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 
       6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 
Call Trace: [<c0166599>] [<c0166599>] [<c0166599>] [<c0166599>] [<c0166806>] 
   [<c0166806>] [<c01675d7>] [<c019386b>] [<c01145a7>] [<c01b5ff4>] 
[<c01b609d>] 
   [<f880758a>] [<f88077c0>] [<f8807a9a>] [<f8817d86>] [<f880671d>] 
[<f8806cc6>] 
   [<c011eb87>] [<c011eee0>] [<c011ef63>] [<c010c160>] [<c01084d6>] 
[<c01086c9>] 
   [<c01086e9>] [<c0106ee4>] [<c0114b12>] [<c0114691>] [<c01145b4>] 
[<c0114f82>] 
   [<c029476e>] [<c012fbc9>] [<c0105643>] 
CPU 2:6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 
       6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 
       6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 
Call Trace: [<c01001c8>] [<c01effa0>] [<c01f04e2>] [<c0166599>] [<c0166599>] 
   [<f9c04e6a>] [<c0166599>] [<c0166599>] [<f894b5b0>] [<f8945a36>] 
[<c02405e4>] 
   [<c0238d06>] [<c0234312>] [<c0262e2e>] [<c0263099>] [<c02602cb>] 
[<f894b5b0>] 
   [<f8945a36>] [<c02405e4>] [<c0238d06>] [<c024cca3>] [<c023ef54>] 
[<c024b722>] 
   [<c024cc00>] [<c024b5cc>] [<c024bb0d>] [<c023ef54>] [<c024b5cc>] 
[<c025f81d>] 
   [<c025a59f>] [<c025a662>] [<c025b18b>] [<c0258648>] [<c01fff66>] 
[<c0200000>] 
   [<c011731b>] [<c011737f>] [<c011745b>] [<c0117696>] [<c011761e>] 
[<c01070bf>] 
   [<c028cde0>] [<c0107170>] [<c0115783>] [<c0115852>] [<c0201b6d>] 
[<c0201d1c>] 
   [<c02a3b80>] [<c02a3af6>] [<c0201cb3>] [<c02002fc>] [<c011eb87>] 
[<c0201286>] 
   [<c0201314>] [<c01084d6>] [<c01086c9>] [<c0105280>] [<c0105280>] 
[<c0106ee4>] 
   [<c0105280>] [<c0105280>] [<c0100018>] [<c01052ad>] [<c0105312>] 
[<c011737f>] 
CPU 3:6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 
       6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 
       6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 6db6db6d db6db6db 
Call Trace: 
CPU 0:c02e3ecc c028d37d 00000000 00000000 00000000 c010832d c028d392 f7159ec0 
       00000004 00000090 00000001 c01fb677 c03691c0 00000000 c01fb640 00000286 
       c011e81c 00000000 00000001 00001020 c03691c0 c0388a80 00000000 c011eda9 
Call Trace: [<c028d37d>] [<c010832d>] [<c028d392>] [<c01fb677>] [<c01fb640>] 
   [<c011e81c>] [<c011eda9>] [<c011b552>] [<c011b435>] [<c011b2da>] 
[<c010870a>] 
   [<c0105280>] [<c0105280>] [<c0106ee4>] [<c0105280>] [<c0105280>] 
[<c0100018>] 
   [<c01052ad>] [<c0105312>] [<c0105000>] [<c01001cf>] 
[<c0114b12>] [<c0105fdb>] [<c0106e23>] 
symlink02  D E4744000       0 19698  23861        (NOTLB)         19659
Call Trace: [<c01305b2>] [<c01c2792>] [<c01d877e>] [<c01d881c>] [<c01c74f2>] 
   [<c01ad856>] [<c01ad873>] [<c01c74f2>] [<c01c74f2>] [<c01d2555>] 
[<c0141935>] 
   [<c0142459>] [<c01428d8>] [<c01360ba>] [<c0106e23>] 
rm        D E42FA000       0 19699  19659        (NOTLB)        
Call Trace: [<c01c312c>] [<c014b6da>] [<c014c7bc>] [<c01d7c22>] [<c01ca027>] 
   [<c01ad99b>] [<c01d1e67>] [<c0143c2f>] [<c0143d32>] [<c0106e23>] 
top       S F4A23F0C       0 19749   5568        (NOTLB)        
Call Trace: [<c01469ae>] [<c0114691>] [<c01145b4>] [<c0146b28>] [<c0147102>] 
   [<c0106e23>] [<c010002b>] 
in.rlogind  S 7FFFFFFF       0 19750   1080 19777  (NOTLB)   19899  1328
Call Trace: [<c01ef51c>] [<c0114627>] [<c0146b28>] [<c0147102>] [<c0106e23>] 
rpciod    S E5922000       0 19775      1        (L-TLB)   19832 19776
Call Trace: [<f89c4912>] [<f89bd2f0>] [<f89bde2b>] [<f89bdc4c>] [<f89c6d84>] 
   [<f89c6d7c>] [<f89c6d7c>] [<c0105643>] [<f89c6d84>] [<f89c6d84>] 
lockd     S 7FFFFFFF       0 19776      1        (L-TLB)   19775 23496
Call Trace: [<c0114627>] [<c0136607>] [<f89c0cbe>] [<f898bc44>] [<c0105643>] 
login     S 00000000    4540 19777  19750 19778  (NOTLB)        
Call Trace: [<c0114b12>] [<c011a596>] [<c0106e23>] [<c010002b>] 
tcsh      S 00000000       0 19778  19777 19802  (NOTLB)        
Call Trace: [<c0114b12>] [<c0105fdb>] [<c0106e23>] 
su        S 00000000    1392 19802  19778 19803  (NOTLB)        
Call Trace: [<c011a596>] [<c0106e23>] 
bash      S 7FFFFFFF       0 19803  19802 19831  (NOTLB)        
Call Trace: [<c0114627>] [<c01ed24d>] [<c01e917c>] [<c0136a1a>] [<c0106e23>] 
strace    T 00000014    4768 19831  19803 19700  (NOTLB)        
Call Trace: [<c0106c37>] [<c011a5c1>] [<c0106e74>] 
pmd       D E2E6C000       0 19700  19831        (NOTLB)        
Call Trace: [<c029abdc>] [<c029abdc>] [<c01d877e>] [<c01d881c>] [<c01c74f2>] 
   [<c01ad856>] [<c01ad873>] [<c01c74f2>] [<c01c74f2>] [<c01d2555>] 
[<c0141935>] 
   [<c0142459>] [<c013fbf1>] [<c013fbff>] [<c01406c6>] [<c01305b2>] 
[<c0124cf8>] 
   [<c0124d0b>] [<c01254db>] [<c0113c9f>] [<c0113b00>] [<c01207c4>] 
[<c01417cb>] 
   [<c0105a43>] [<c0106e23>] 
mingetty  S 7FFFFFFF       0 19832      1        (NOTLB)   19883 19775
Call Trace: [<c0114627>] [<c01f5dae>] [<c01ed24d>] [<c01e917c>] [<c0136a1a>] 
   [<c0106e23>] 
crond     S E3C84000       0 19880   1126 19881  (NOTLB)        
Call Trace: [<c012634a>] [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
run-parts  S 00000000       0 19881  19880 19884  (NOTLB)        
Call Trace: [<c011a596>] [<c0106e23>] 
sa1       S 00000000       0 19883      1 19886  (NOTLB)         19832
Call Trace: [<c011a596>] [<c0106e23>] 
awk       S E4F86000       0 19884  19881        (NOTLB)        
Call Trace: [<c014a2f1>] [<c0140add>] [<c0140bb9>] [<c0136a1a>] [<c0106e23>] 
sadc      S E5C92000       0 19886  19883        (NOTLB)        
Call Trace: [<c0137f62>] [<c010ca92>] [<c0106e23>] 
in.rlogind  S 7FFFFFFF       0 19899   1080 19902  (NOTLB)         19750
Call Trace: [<c01ef51c>] [<c0114627>] [<c0146b28>] [<c0147102>] [<c0106e23>] 
login     S 00000000       0 19902  19899 19903  (NOTLB)        
Call Trace: [<c0114b12>] [<c011a596>] [<c0106e23>] 
tcsh      S 7FFFFFFF       0 19903  19902        (NOTLB)        
Call Trace: [<c01254db>] [<c0114627>] [<c01ed24d>] [<c01e917c>] [<c0136a1a>] 
   [<c0106e23>] 
Warning (Oops_read): Code line not seen, dumping what data is available

Proc;  init
>>EIP; c476df0c <_end+43aecbc/38440e10>   <=====
Trace; c0114691 <schedule_timeout+81/a4>
Trace; c01145b4 <process_timeout+0/5c>
Trace; c0146b28 <do_select+b8/234>
Trace; c0147102 <sys_select+436/5a8>
Trace; c0106e23 <system_call+33/38>
Proc;  keventd
>>EIP; 00000000 Before first symbol
Trace; c0122fc8 <context_thread+128/1e4>
Trace; c0105643 <kernel_thread+23/30>
Proc;  kswapd
>>EIP; c4769fa0 <_end+43aad50/38440e10>   <=====
Trace; c0114691 <schedule_timeout+81/a4>
Trace; c01145b4 <process_timeout+0/5c>
Trace; c0114f82 <interruptible_sleep_on_timeout+52/7c>
Trace; c029476e <error_table+47ee/63d8>
Trace; c012fbc9 <kswapd+e9/11c>
Trace; c0105643 <kernel_thread+23/30>
Proc;  kreclaimd
>>EIP; 00000286 Before first symbol   <=====
Trace; c0114f0d <interruptible_sleep_on+4d/70>
Trace; c0294778 <error_table+47f8/63d8>
Trace; c012fcbb <kreclaimd+5b/e0>
Trace; c010563a <kernel_thread+1a/30>
Trace; c0105643 <kernel_thread+23/30>
Proc;  bdflush
>>EIP; c477c000 <_end+43bcdb0/38440e10>   <=====
Trace; c029550e <error_table+558e/63d8>
Trace; c012f813 <free_shortage+1f/e8>
Trace; c013b17e <bdflush+e6/f0>
Trace; c0105643 <kernel_thread+23/30>
Proc;  kupdated
>>EIP; c477a000 <_end+43badb0/38440e10>   <=====
Trace; c01d877e <lock_wait+ae/dc>
Trace; c01d885d <mrupdatef+29/50>
Trace; c01d3e13 <xfs_bmap+a3/22c>
Trace; c01ad831 <xfs_ilock_ra+65/94>
Trace; c01ad873 <xfs_ilock+13/18>
Trace; c01d3e13 <xfs_bmap+a3/22c>
Trace; c01d3e13 <xfs_bmap+a3/22c>
Trace; c01d27dd <linvfs_pb_bmap+7d/b0>
Trace; c016a910 <pagebuf_delalloc_convert+44/d4>
Trace; c01d2760 <linvfs_pb_bmap+0/b0>
Trace; c01c6037 <xfs_syncsub+ba3/bcc>
Trace; c0169674 <pagebuf_write_full_page+64/174>
Trace; c01d2760 <linvfs_pb_bmap+0/b0>
Trace; c01d293c <linvfs_write_full_page_unlock+0/50>
Trace; c01d294f <linvfs_write_full_page_unlock+13/50>
Trace; c01d2760 <linvfs_pb_bmap+0/b0>
Trace; c01d293c <linvfs_write_full_page_unlock+0/50>
Trace; c0127550 <filemap_fdatasync+c0/120>
Trace; c01d293c <linvfs_write_full_page_unlock+0/50>
Trace; c014b937 <sync_unlocked_inodes+8b/164>
Trace; c013af87 <sync_old_buffers+2f/78>
Trace; c013b28d <kupdate+105/108>
Trace; c0105643 <kernel_thread+23/30>
Proc;  pagebuf_daemon
>>EIP; 00000286 Before first symbol   <=====
Trace; c0114f0d <interruptible_sleep_on+4d/70>
Trace; c01685cc <pagebuf_daemon+e4/26c>
Trace; c01684d0 <pb_daemon_wakeup+0/18>
Trace; c0105643 <kernel_thread+23/30>
Proc;  mdrecoveryd
>>EIP; f717c000 <_end+36dbcdb0/38440e10>   <=====
Trace; c02afdf1 <fb_con+21f1/40a0>
Trace; c0230682 <md_thread+14a/1a8>
Trace; c0105643 <kernel_thread+23/30>
Proc;  syslogd
>>EIP; 7fffffff Before first symbol   <=====
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c0232437 <sock_poll+23/28>
Trace; c0146b28 <do_select+b8/234>
Trace; c0147102 <sys_select+436/5a8>
Trace; c0106e23 <system_call+33/38>
Proc;  klogd
>>EIP; f5e48000 <_end+35a88db0/38440e10>   <=====
Trace; c0231ffd <sock_sendmsg+81/a4>
Trace; c0116ffc <do_syslog+bc/368>
Trace; c01575e5 <kmsg_read+11/18>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Trace; c010002b <startup_32+2b/cb>
Proc;  portmap
>>EIP; 7fffffff Before first symbol   <=====
Trace; c024ebff <tcp_poll+2f/160>
Trace; c0232437 <sock_poll+23/28>
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c01473d3 <do_poll+ab/e8>
Trace; c014735f <do_poll+37/e8>
Trace; c0147663 <sys_poll+253/370>
Trace; c0106e23 <system_call+33/38>
Proc;  rpc.statd
>>EIP; 7fffffff Before first symbol   <=====
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c0232437 <sock_poll+23/28>
Trace; c0146b28 <do_select+b8/234>
Trace; c0147102 <sys_select+436/5a8>
Trace; c0136607 <filp_close+9b/a4>
Trace; c0106e23 <system_call+33/38>
Proc;  ypbind
>>EIP; 7fffffff Before first symbol   <=====
Trace; c024ebff <tcp_poll+2f/160>
Trace; c0232437 <sock_poll+23/28>
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c01473d3 <do_poll+ab/e8>
Trace; c014735f <do_poll+37/e8>
Trace; c0147663 <sys_poll+253/370>
Trace; c0106e23 <system_call+33/38>
Proc;  ypbind
>>EIP; f5f8bf10 <_end+35bcccc0/38440e10>   <=====
Trace; c0114691 <schedule_timeout+81/a4>
Trace; c01145b4 <process_timeout+0/5c>
Trace; c014735f <do_poll+37/e8>
Trace; c0147663 <sys_poll+253/370>
Trace; c01086c9 <do_IRQ+99/ec>
Trace; c01086e9 <do_IRQ+b9/ec>
Trace; c0106e23 <system_call+33/38>
Trace; c010002b <startup_32+2b/cb>
Proc;  ypbind
>>EIP; 00000000 Before first symbol
Trace; c0105fdb <sys_rt_sigsuspend+113/130>
Trace; c0106e23 <system_call+33/38>
Trace; c010002b <startup_32+2b/cb>
Proc;  ypbind
>>EIP; f66b9f78 <_end+362fad28/38440e10>   <=====
Trace; c0130870 <free_pages+24/28>
Trace; c0146916 <poll_freewait+46/50>
Trace; c0114691 <schedule_timeout+81/a4>
Trace; c01145b4 <process_timeout+0/5c>
Trace; c011f1ab <sys_nanosleep+12f/1b4>
Trace; c0106e23 <system_call+33/38>
Trace; c010002b <startup_32+2b/cb>
Proc;  automount
>>EIP; f64c2000 <_end+36102db0/38440e10>   <=====
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  automount
>>EIP; f5cf2000 <_end+35932db0/38440e10>   <=====
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  automount
>>EIP; f5d56000 <_end+35996db0/38440e10>   <=====
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  automount
>>EIP; f6712000 <_end+36352db0/38440e10>   <=====
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  automount
>>EIP; f5e2c000 <_end+35a6cdb0/38440e10>   <=====
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  automount
>>EIP; f65b4000 <_end+361f4db0/38440e10>   <=====
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  automount
>>EIP; f66ac000 <_end+362ecdb0/38440e10>   <=====
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  automount
>>EIP; f5d42000 <_end+35982db0/38440e10>   <=====
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  automount
>>EIP; c44f2000 <_end+4132db0/38440e10>   <=====
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  automount
>>EIP; c44fe000 <_end+413edb0/38440e10>   <=====
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  automount
>>EIP; c4504000 <_end+4144db0/38440e10>   <=====
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  automount
>>EIP; c4608000 <_end+4248db0/38440e10>   <=====
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  automount
>>EIP; f6454000 <_end+36094db0/38440e10>   <=====
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  atd
>>EIP; f6689f78 <_end+362cad28/38440e10>   <=====
Trace; c0114691 <schedule_timeout+81/a4>
Trace; c01145b4 <process_timeout+0/5c>
Trace; c011f1ab <sys_nanosleep+12f/1b4>
Trace; c0106e23 <system_call+33/38>
Proc;  sshd
>>EIP; 7fffffff Before first symbol   <=====
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c0232437 <sock_poll+23/28>
Trace; c0146b28 <do_select+b8/234>
Trace; c0147102 <sys_select+436/5a8>
Trace; c0106e23 <system_call+33/38>
Proc;  xinetd
>>EIP; 7fffffff Before first symbol   <=====
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c0232437 <sock_poll+23/28>
Trace; c0146b28 <do_select+b8/234>
Trace; c0147102 <sys_select+436/5a8>
Trace; c0136607 <filp_close+9b/a4>
Trace; c0106e23 <system_call+33/38>
Proc;  sendmail
>>EIP; f5b1bf0c <_end+3575ccbc/38440e10>   <=====
Trace; c01469ae <__pollwait+8e/94>
Trace; c0114691 <schedule_timeout+81/a4>
Trace; c01145b4 <process_timeout+0/5c>
Trace; c0146b28 <do_select+b8/234>
Trace; c0147102 <sys_select+436/5a8>
Trace; c0106e23 <system_call+33/38>
Proc;  crond
>>EIP; f5afdf78 <_end+3573ed28/38440e10>   <=====
Trace; c0114691 <schedule_timeout+81/a4>
Trace; c01145b4 <process_timeout+0/5c>
Trace; c011f1ab <sys_nanosleep+12f/1b4>
Trace; c0106e23 <system_call+33/38>
Proc;  mingetty
>>EIP; 7fffffff Before first symbol   <=====
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c01ed24d <read_chan+3ad/718>
Trace; c01e917c <tty_read+d8/118>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  mingetty
>>EIP; 7fffffff Before first symbol   <=====
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c01ed24d <read_chan+3ad/718>
Trace; c01e917c <tty_read+d8/118>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  mingetty
>>EIP; 7fffffff Before first symbol   <=====
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c01ed24d <read_chan+3ad/718>
Trace; c01e917c <tty_read+d8/118>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  mingetty
>>EIP; 7fffffff Before first symbol   <=====
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c01ed24d <read_chan+3ad/718>
Trace; c01e917c <tty_read+d8/118>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  mingetty
>>EIP; 7fffffff Before first symbol   <=====
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c01ed24d <read_chan+3ad/718>
Trace; c01e917c <tty_read+d8/118>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  in.rlogind
>>EIP; 7fffffff Before first symbol   <=====
Trace; c01ef51c <pty_chars_in_buffer+1c/34>
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c0146b28 <do_select+b8/234>
Trace; c0147102 <sys_select+436/5a8>
Trace; c0106e23 <system_call+33/38>
Trace; c010002b <startup_32+2b/cb>
Proc;  login
>>EIP; 00000000 Before first symbol
Trace; c0114b12 <schedule+3c6/5c0>
Trace; c011a596 <sys_wait4+3ca/400>
Trace; c0106e23 <system_call+33/38>
Proc;  tcsh
>>EIP; 00000000 Before first symbol
Trace; c0114b12 <schedule+3c6/5c0>
Trace; c0105fdb <sys_rt_sigsuspend+113/130>
Trace; c0106e23 <system_call+33/38>
Proc;  su
>>EIP; 00000000 Before first symbol
Trace; c011a596 <sys_wait4+3ca/400>
Trace; c0106e23 <system_call+33/38>
Proc;  bash
>>EIP; 00000000 Before first symbol
Trace; c01ea876 <tiocspgrp+5e/7c>
Trace; c01eac4d <tty_ioctl+29d/3b0>
Trace; c011a596 <sys_wait4+3ca/400>
Trace; c0106e23 <system_call+33/38>
Proc;  pmd
>>EIP; 7fffffff Before first symbol   <=====
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c0232437 <sock_poll+23/28>
Trace; c0146b28 <do_select+b8/234>
Trace; c0147102 <sys_select+436/5a8>
Trace; c0106e23 <system_call+33/38>
Trace; c010002b <startup_32+2b/cb>
Proc;  getpgid2_01
>>EIP; f4f8c000 <_end+34bccdb0/38440e10>   <=====
Trace; c010ca92 <sys_pause+12/20>
Trace; c0106e23 <system_call+33/38>
Proc;  getpgid2_01
>>EIP; f300c000 <_end+32c4cdb0/38440e10>   <=====
Trace; c010ca92 <sys_pause+12/20>
Trace; c0106e23 <system_call+33/38>
Proc;  pmd
>>EIP; f43d8000 <_end+34018db0/38440e10>   <=====
Trace; c01145a7 <reschedule_idle+23f/24c>
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  renamer01
>>EIP; 00000000 Before first symbol
Trace; c0114b12 <schedule+3c6/5c0>
Trace; c0105fdb <sys_rt_sigsuspend+113/130>
Trace; c0106e23 <system_call+33/38>
Proc;  renamer
>>EIP; f645c0e0 <_end+3609ce90/38440e10>   <=====
Trace; c01d2555 <linvfs_permission+1d/24>
Trace; c0141935 <permission+49/84>
Trace; c0105b6b <__down+73/d0>
Trace; c0105d18 <__down_failed+8/c>
Trace; c028799c <stext_lock+2c18/b1fc>
Trace; c0106e23 <system_call+33/38>
Trace; c010002b <startup_32+2b/cb>
Proc;  rwtest
>>EIP; 00000000 Before first symbol
Trace; c0166599 <avl_remove+cd/dc>
Trace; c0166599 <avl_remove+cd/dc>
Trace; c0166599 <avl_remove+cd/dc>
Trace; c0166599 <avl_remove+cd/dc>
Trace; c0166806 <avl_delete+62/7c>
Trace; c0166806 <avl_delete+62/7c>
Trace; c01675d7 <pagebuf_unpin+27/28>
Trace; c019386b <xfs_buf_item_unpin+23/6c>
Trace; c01145a7 <reschedule_idle+23f/24c>
Trace; c01b5ff4 <xlog_state_do_callback+2b4/2fc>
Trace; c01b609d <xlog_state_done_syncing+61/68>
Trace; f880758a <[scsi_mod]scsi_queue_next_request+52/124>
Trace; f88077c0 <[scsi_mod]__scsi_end_request+164/170>
Trace; f8807a9a <[scsi_mod]scsi_io_completion+1da/3bc>
Trace; f8817d86 <[sd_mod]rw_intr+1f6/204>
Trace; f880671d <[scsi_mod]scsi_old_done+3d/600>
Trace; f8806cc6 <[scsi_mod]scsi_old_done+5e6/600>
Trace; c011eb87 <update_wall_time+b/3c>
Trace; c011eee0 <update_times+20/98>
Trace; c011ef63 <do_timer+b/60>
Trace; c010c160 <timer_interrupt+fc/18c>
Trace; c01084d6 <handle_IRQ_event+4e/78>
Trace; c01086c9 <do_IRQ+99/ec>
Trace; c01086e9 <do_IRQ+b9/ec>
Trace; c0106ee4 <ret_from_intr+0/20>
Trace; c0114b12 <schedule+3c6/5c0>
Trace; c0114691 <schedule_timeout+81/a4>
Trace; c01145b4 <process_timeout+0/5c>
Trace; c0114f82 <interruptible_sleep_on_timeout+52/7c>
Trace; c029476e <error_table+47ee/63d8>
Trace; c012fbc9 <kswapd+e9/11c>
Trace; c0105643 <kernel_thread+23/30>
Trace; c01001c8 <is386+5a/61>
Trace; c01effa0 <add_timer_randomness+d0/d8>
Trace; c01f04e2 <extract_entropy+322/350>
Trace; c0166599 <avl_remove+cd/dc>
Trace; c0166599 <avl_remove+cd/dc>
Trace; f9c04e6a <END_OF_CODE+122f93a/????>
Trace; c0166599 <avl_remove+cd/dc>
Trace; c0166599 <avl_remove+cd/dc>
Trace; f894b5b0 <[usbcore]proc_releaseinterface+30/40>
Trace; f8945a36 <[usbcore]usb_find_interface_driver+3a/190>
Trace; c02405e4 <qdisc_restart+14/178>
Trace; c0238d06 <dev_queue_xmit+136/268>
Trace; c0234312 <sk_alloc+12/5c>
Trace; c0262e2e <tcp_create_openreq_child+16/4c8>
Trace; c0263099 <tcp_create_openreq_child+281/4c8>
Trace; c02602cb <tcp_v4_syn_recv_sock+113/2f4>
Trace; f894b5b0 <[usbcore]proc_releaseinterface+30/40>
Trace; f8945a36 <[usbcore]usb_find_interface_driver+3a/190>
Trace; c02405e4 <qdisc_restart+14/178>
Trace; c0238d06 <dev_queue_xmit+136/268>
Trace; c024cca3 <ip_finish_output2+a3/dc>
Trace; c023ef54 <nf_hook_slow+128/17c>
Trace; c024b722 <ip_output+156/160>
Trace; c024cc00 <ip_finish_output2+0/dc>
Trace; c024b5cc <ip_output+0/160>
Trace; c024bb0d <ip_queue_xmit+3e1/57c>
Trace; c023ef54 <nf_hook_slow+128/17c>
Trace; c024b5cc <ip_output+0/160>
Trace; c025f81d <tcp_v4_send_check+6d/ac>
Trace; c025a59f <tcp_transmit_skb+46b/5f0>
Trace; c025a662 <tcp_transmit_skb+52e/5f0>
Trace; c025b18b <tcp_write_xmit+21f/2d0>
Trace; c0258648 <__tcp_data_snd_check+50/c4>
Trace; c01fff66 <serial_console_write+9a/184>
Trace; c0200000 <serial_console_write+134/184>
Trace; c011731b <__call_console_drivers+3b/4c>
Trace; c011737f <_call_console_drivers+53/58>
Trace; c011745b <call_console_drivers+d7/e0>
Trace; c0117696 <release_console_sem+22/a0>
Trace; c011761e <printk+14a/164>
Trace; c01070bf <show_trace+1f/c0>
Trace; c028cde0 <stext_lock+805c/b1fc>
Trace; c0107170 <show_trace_task+10/14>
Trace; c0115783 <show_task+18f/198>
Trace; c0115852 <show_state+42/60>
Trace; c0201b6d <sysrq_handle_showstate+5/8>
Trace; c0201d1c <__handle_sysrq_nolock+60/e4>
Trace; c02a3b80 <NR_TYPES+608/628>
Trace; c02a3af6 <NR_TYPES+57e/628>
Trace; c0201cb3 <handle_sysrq+27/30>
Trace; c02002fc <handle_scancode+16c/2d4>
Trace; c011eb87 <update_wall_time+b/3c>
Trace; c0201286 <handle_kbd_event+122/194>
Trace; c0201314 <keyboard_interrupt+1c/28>
Trace; c01084d6 <handle_IRQ_event+4e/78>
Trace; c01086c9 <do_IRQ+99/ec>
Trace; c0105280 <default_idle+0/34>
Trace; c0105280 <default_idle+0/34>
Trace; c0106ee4 <ret_from_intr+0/20>
Trace; c0105280 <default_idle+0/34>
Trace; c0105280 <default_idle+0/34>
Trace; c0100018 <startup_32+18/cb>
Trace; c01052ad <default_idle+2d/34>
Trace; c0105312 <cpu_idle+3e/54>
Trace; c011737f <_call_console_drivers+53/58>
Trace; c028d37d <stext_lock+85f9/b1fc>
Trace; c010832d <__global_cli+8d/12c>
Trace; c028d392 <stext_lock+860e/b1fc>
Trace; c01fb677 <rs_timer+37/11c>
Trace; c01fb640 <rs_timer+0/11c>
Trace; c011e81c <__run_timers+cc/110>
Trace; c011eda9 <run_all_timers+29/48>
Trace; c011b552 <bh_action+4e/b0>
Trace; c011b435 <tasklet_hi_action+51/7c>
Trace; c011b2da <do_softirq+5a/88>
Trace; c010870a <do_IRQ+da/ec>
Trace; c0105280 <default_idle+0/34>
Trace; c0105280 <default_idle+0/34>
Trace; c0106ee4 <ret_from_intr+0/20>
Trace; c0105280 <default_idle+0/34>
Trace; c0105280 <default_idle+0/34>
Trace; c0100018 <startup_32+18/cb>
Trace; c01052ad <default_idle+2d/34>
Trace; c0105312 <cpu_idle+3e/54>
Trace; c0105000 <do_linuxrc+0/d8>
Trace; c01001cf <L6+0/2>
Trace; c0114b12 <schedule+3c6/5c0>
Trace; c0105fdb <sys_rt_sigsuspend+113/130>
Trace; c0106e23 <system_call+33/38>
Proc;  symlink02
>>EIP; e4744000 <_end+24384db0/38440e10>   <=====
Trace; c01305b2 <__alloc_pages+6a/294>
Trace; c01c2792 <xfs_trans_unlocked_item+22/3c>
Trace; c01d877e <lock_wait+ae/dc>
Trace; c01d881c <mraccessf+48/60>
Trace; c01c74f2 <xfs_access+1a/38>
Trace; c01ad856 <xfs_ilock_ra+8a/94>
Trace; c01ad873 <xfs_ilock+13/18>
Trace; c01c74f2 <xfs_access+1a/38>
Trace; c01c74f2 <xfs_access+1a/38>
Trace; c01d2555 <linvfs_permission+1d/24>
Trace; c0141935 <permission+49/84>
Trace; c0142459 <path_walk+7c1/7e8>
Trace; c01428d8 <__user_walk+3c/58>
Trace; c01360ba <sys_chown+16/48>
Trace; c0106e23 <system_call+33/38>
Proc;  rm
>>EIP; e42fa000 <_end+23f3adb0/38440e10>   <=====
Trace; c01c312c <xfs_trans_log_buf+5c/64>
Trace; c014b6da <__wait_on_inode+7a/98>
Trace; c014c7bc <igrab+84/8c>
Trace; c01d7c22 <vn_hold+22/30>
Trace; c01ca027 <xfs_remove+49f/640>
Trace; c01ad99b <xfs_iunlock+5f/68>
Trace; c01d1e67 <linvfs_unlink+23/68>
Trace; c0143c2f <vfs_unlink+18b/1e8>
Trace; c0143d32 <sys_unlink+a6/11c>
Trace; c0106e23 <system_call+33/38>
Proc;  top
>>EIP; f4a23f0c <_end+34664cbc/38440e10>   <=====
Trace; c01469ae <__pollwait+8e/94>
Trace; c0114691 <schedule_timeout+81/a4>
Trace; c01145b4 <process_timeout+0/5c>
Trace; c0146b28 <do_select+b8/234>
Trace; c0147102 <sys_select+436/5a8>
Trace; c0106e23 <system_call+33/38>
Trace; c010002b <startup_32+2b/cb>
Proc;  in.rlogind
>>EIP; 7fffffff Before first symbol   <=====
Trace; c01ef51c <pty_chars_in_buffer+1c/34>
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c0146b28 <do_select+b8/234>
Trace; c0147102 <sys_select+436/5a8>
Trace; c0106e23 <system_call+33/38>
Proc;  rpciod
>>EIP; e5922000 <_end+25562db0/38440e10>   <=====
Trace; f89c4912 <[sunrpc]proc_dodebug+1c4a2/25bf0>
Trace; f89bd2f0 <[sunrpc]proc_dodebug+14e80/25bf0>
Trace; f89bde2b <[sunrpc]proc_dodebug+159bb/25bf0>
Trace; f89bdc4c <[sunrpc]proc_dodebug+157dc/25bf0>
Trace; f89c6d84 <[sunrpc]proc_dodebug+1e914/25bf0>
Trace; f89c6d7c <[sunrpc]proc_dodebug+1e90c/25bf0>
Trace; f89c6d7c <[sunrpc]proc_dodebug+1e90c/25bf0>
Trace; c0105643 <kernel_thread+23/30>
Trace; f89c6d84 <[sunrpc]proc_dodebug+1e914/25bf0>
Trace; f89c6d84 <[sunrpc]proc_dodebug+1e914/25bf0>
Proc;  lockd
>>EIP; 7fffffff Before first symbol   <=====
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c0136607 <filp_close+9b/a4>
Trace; f89c0cbe <[sunrpc]proc_dodebug+1884e/25bf0>
Trace; f898bc44 <[usb-uhci]uhci_pci_driver+33da4/40dc0>
Trace; c0105643 <kernel_thread+23/30>
Proc;  login
>>EIP; 00000000 Before first symbol
Trace; c0114b12 <schedule+3c6/5c0>
Trace; c011a596 <sys_wait4+3ca/400>
Trace; c0106e23 <system_call+33/38>
Trace; c010002b <startup_32+2b/cb>
Proc;  tcsh
>>EIP; 00000000 Before first symbol
Trace; c0114b12 <schedule+3c6/5c0>
Trace; c0105fdb <sys_rt_sigsuspend+113/130>
Trace; c0106e23 <system_call+33/38>
Proc;  su
>>EIP; 00000000 Before first symbol
Trace; c011a596 <sys_wait4+3ca/400>
Trace; c0106e23 <system_call+33/38>
Proc;  bash
>>EIP; 7fffffff Before first symbol   <=====
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c01ed24d <read_chan+3ad/718>
Trace; c01e917c <tty_read+d8/118>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  strace
>>EIP; 00000014 Before first symbol   <=====
Trace; c0106c37 <do_signal+19f/2a0>
Trace; c011a5c1 <sys_wait4+3f5/400>
Trace; c0106e74 <signal_return+14/18>
Proc;  pmd
>>EIP; e2e6c000 <_end+22aacdb0/38440e10>   <=====
Trace; c029abdc <quota_versions+487c/4a20>
Trace; c029abdc <quota_versions+487c/4a20>
Trace; c01d877e <lock_wait+ae/dc>
Trace; c01d881c <mraccessf+48/60>
Trace; c01c74f2 <xfs_access+1a/38>
Trace; c01ad856 <xfs_ilock_ra+8a/94>
Trace; c01ad873 <xfs_ilock+13/18>
Trace; c01c74f2 <xfs_access+1a/38>
Trace; c01c74f2 <xfs_access+1a/38>
Trace; c01d2555 <linvfs_permission+1d/24>
Trace; c0141935 <permission+49/84>
Trace; c0142459 <path_walk+7c1/7e8>
Trace; c013fbf1 <open_exec+19/c0>
Trace; c013fbff <open_exec+27/c0>
Trace; c01406c6 <do_execve+1e/1f0>
Trace; c01305b2 <__alloc_pages+6a/294>
Trace; c0124cf8 <do_wp_page+324/360>
Trace; c0124d0b <do_wp_page+337/360>
Trace; c01254db <handle_mm_fault+a3/d8>
Trace; c0113c9f <do_page_fault+19f/500>
Trace; c0113b00 <do_page_fault+0/500>
Trace; c01207c4 <do_sigaction+c4/118>
Trace; c01417cb <getname+5b/a0>
Trace; c0105a43 <sys_execve+2f/60>
Trace; c0106e23 <system_call+33/38>
Proc;  mingetty
>>EIP; 7fffffff Before first symbol   <=====
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c01f5dae <set_cursor+6e/80>
Trace; c01ed24d <read_chan+3ad/718>
Trace; c01e917c <tty_read+d8/118>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  crond
>>EIP; e3c84000 <_end+238c4db0/38440e10>   <=====
Trace; c012634a <do_munmap+56/258>
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  run-parts
>>EIP; 00000000 Before first symbol
Trace; c011a596 <sys_wait4+3ca/400>
Trace; c0106e23 <system_call+33/38>
Proc;  sa1
>>EIP; 00000000 Before first symbol
Trace; c011a596 <sys_wait4+3ca/400>
Trace; c0106e23 <system_call+33/38>
Proc;  awk
>>EIP; e4f86000 <_end+24bc6db0/38440e10>   <=====
Trace; c014a2f1 <dput+21/16c>
Trace; c0140add <pipe_wait+7d/a4>
Trace; c0140bb9 <pipe_read+b5/228>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>
Proc;  sadc
>>EIP; e5c92000 <_end+258d2db0/38440e10>   <=====
Trace; c0137f62 <sys_fdatasync+6a/8c>
Trace; c010ca92 <sys_pause+12/20>
Trace; c0106e23 <system_call+33/38>
Proc;  in.rlogind
>>EIP; 7fffffff Before first symbol   <=====
Trace; c01ef51c <pty_chars_in_buffer+1c/34>
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c0146b28 <do_select+b8/234>
Trace; c0147102 <sys_select+436/5a8>
Trace; c0106e23 <system_call+33/38>
Proc;  login
>>EIP; 00000000 Before first symbol
Trace; c0114b12 <schedule+3c6/5c0>
Trace; c011a596 <sys_wait4+3ca/400>
Trace; c0106e23 <system_call+33/38>
Proc;  tcsh
>>EIP; 7fffffff Before first symbol   <=====
Trace; c01254db <handle_mm_fault+a3/d8>
Trace; c0114627 <schedule_timeout+17/a4>
Trace; c01ed24d <read_chan+3ad/718>
Trace; c01e917c <tty_read+d8/118>
Trace; c0136a1a <sys_read+8e/c4>
Trace; c0106e23 <system_call+33/38>


4 warnings and 1 error issued.  Results may not be reliable.

-- 
Nate Straz                                              nstraz@xxxxxxx
sgi, inc                                           http://www.sgi.com/
Linux Test Project                                  http://ltp.sf.net/

<Prev in Thread] Current Thread [Next in Thread>