Here is the stack trace from this kernel. This is 2.4.18-27 errata + XFS
1.2.0 release. I did re-work the spec file, but only to disable options
we don't want and also re-worked the config to our liking. I have one
patch I apply, but it is to scsi_scan.c for a BLIST entry for our
hardware. Overall, the core kernel config and source is relatively
unchanged. We patch nothing else, and just use RH's src.rpm to create
our i686 rpm. Usually, right before the crash, all the fiber channel
devices go unaccessible, local are still ok, and whole system is XFS,
then the poof. This only seems to occur during the load test I put this
thing through. If anyone would like to see it, I'd be happy to provide
the info.
The ksymoops output is below:
ksymoops 2.4.1 on i686 2.4.18-27SGI_XFS_1.2.0_CMsmp. Options used
-V (specified)
-k /proc/ksyms (specified)
-l /proc/modules (specified)
-o /lib/modules/2.4.18-27SGI_XFS_1.2.0_CMsmp (specified)
-m /boot/System.map-2.4.18-27SGI_XFS_1.2.0_CMsmp (specified)
Unable to handle kernel NULL pointer dereference at virtual address
00000034
c0190213
*pde = 19e18001
Oops: 0000
CPU: 2
EIP: 0010:[<c0190213>] Not tainted
Using defaults from ksymoops -t elf32-i386 -a i386
EFLAGS: 00010246
eax: 00000000 ebx: 00000001 ecx: c99c9a08 edx: 00000000
esi: 00000000 edi: dab14eec ebp: 00000000 esp: d5d77820
ds: 0018 es: 0018 ss: 0018
Process spew-fork.pl (pid: 28924, stackpage=d5d77000)
Stack: dab14eec 00000000 00000000 00000000 dab14f2c 00000000 00000001
f6b7e800
00000000 00000001 00000001 00000003 00000001 00000000 c84a5300 f710bc80
00000001 00000004 c018ca3d dab14eec 00000002 d5d778e8 d5d778e8 f6b7e800
Call Trace: [<c018ca3d>] (0xd5d77868))
[<c018c796>] (0xd5d778fc))
[<c018ebaa>] (0xd5d7790c))
[<c019bc64>] (0xd5d77938))
[<c023f340>] (0xd5d77940))
[<c01a514f>] (0xd5d77974))
[<c01a514f>] (0xd5d7797c))
[<c019d7b4>] (0xd5d77998))
[<c019f13d>] (0xd5d77a28))
[<c01c4b46>] (0xd5d77adc))
[<c01d0e00>] (0xd5d77b14))
[<c01e4e65>] (0xd5d77b30))
[<c01e5bfa>] (0xd5d77ba4))
[<c01e535a>] (0xd5d77bfc))
[<c01dfed7>] (0xd5d77c38))
[<c01dfa04>] (0xd5d77c78))
[<c01e5444>] (0xd5d77cb4))
[<c01e48bc>] (0xd5d77cd4))
[<c01df441>] (0xd5d77d00))
[<c01e00b5>] (0xd5d77d20))
[<c013f6d2>] (0xd5d77d40))
[<c0140deb>] (0xd5d77d84))
[<c0141119>] (0xd5d77dac))
[<c014113a>] (0xd5d77db8))
[<c0140883>] (0xd5d77dc0))
[<c0140799>] (0xd5d77de4))
[<c01413d1>] (0xd5d77df0))
[<c0141b76>] (0xd5d77e0c))
[<c01dfdf0>] (0xd5d77e24))
[<c012f661>] (0xd5d77e40))
[<c0112217>] (0xd5d77e9c))
[<c01c1f22>] (0xd5d77eb8))
[<c01e45a4>] (0xd5d77ee4))
[<c01e06d1>] (0xd5d77f28))
[<c013e456>] (0xd5d77f5c))
[<c0122195>] (0xd5d77f74))
[<c01128d9>] (0xd5d77f98))
[<c0108c93>] (0xd5d77fc0))
Code: 8b 70 34 50 8b 5c 24 24 53 56 57 e8 2d 62 01 00 83 c4 1c 85
>>EIP; c0190213 <xfs_alloc_lookup+103/330> <=====
Trace; c018ca3d <xfs_alloc_ag_vextent_near+5d/b50>
Trace; c018c796 <xfs_alloc_ag_vextent+36/f0>
Trace; c018ebaa <xfs_alloc_vextent+2ca/350>
Trace; c019bc64 <xfs_bmap_alloc+ed4/11a0>
Trace; c023f340 <scsi_request_fn+1b0/350>
Trace; c01a514f <xfs_bmbt_get_state+2f/40>
Trace; c01a514f <xfs_bmbt_get_state+2f/40>
Trace; c019d7b4 <xfs_bmap_do_search_extents+344/370>
Trace; c019f13d <xfs_bmapi+72d/10b0>
Trace; c01c4b46 <xfs_log_reserve+86/90>
Trace; c01d0e00 <xfs_trans_reserve+50/160>
Trace; c01e4e65 <xfs_strategy+4d5/6b0>
Trace; c01e5bfa <xfs_iomap_write_delay+58a/5f0>
Trace; c01e535a <xfs_iomap_read+10a/130>
Trace; c01dfed7 <linvfs_pb_bmap+57/f0>
Trace; c01dfa04 <delalloc_convert+e4/300>
Trace; c01e5444 <xfs_iomap_write+c4/d0>
Trace; c01e48bc <xfs_bmap+11c/1f0>
Trace; c01df441 <write_full_page+71/b0>
Trace; c01e00b5 <linvfs_write_full_page+65/90>
Trace; c013f6d2 <write_some_buffers+b2/180>
Trace; c0140deb <unmap_underlying_metadata+1b/60>
Trace; c0141119 <__block_prepare_write+e9/2f0>
Trace; c014113a <__block_prepare_write+10a/2f0>
Trace; c0140883 <__refile_buffer+53/60>
Trace; c0140799 <balance_dirty+29/30>
Trace; c01413d1 <__block_commit_write+b1/e0>
Trace; c0141b76 <generic_commit_write+36/a0>
Trace; c01dfdf0 <linvfs_get_block+0/30>
Trace; c012f661 <generic_file_write_nolock+571/810>
Trace; c0112217 <smp_call_function_interrupt+27/3d>
Trace; c01c1f22 <xfs_ichgtime+42/d0>
Trace; c01e45a4 <xfs_write+2e4/4e0>
Trace; c01e06d1 <linvfs_write+b1/f0>
Trace; c013e456 <sys_write+96/110>
Trace; c0122195 <update_process_times+25/30>
Trace; c01128d9 <smp_apic_timer_interrupt+a9/d0>
Trace; c0108c93 <system_call+33/38>
Code; c0190213 <xfs_alloc_lookup+103/330>
00000000 <_EIP>:
Code; c0190213 <xfs_alloc_lookup+103/330> <=====
0: 8b 70 34 mov 0x34(%eax),%esi <=====
Code; c0190216 <xfs_alloc_lookup+106/330>
3: 50 push %eax
Code; c0190217 <xfs_alloc_lookup+107/330>
4: 8b 5c 24 24 mov 0x24(%esp,1),%ebx
Code; c019021b <xfs_alloc_lookup+10b/330>
8: 53 push %ebx
Code; c019021c <xfs_alloc_lookup+10c/330>
9: 56 push %esi
Code; c019021d <xfs_alloc_lookup+10d/330>
a: 57 push %edi
Code; c019021e <xfs_alloc_lookup+10e/330>
b: e8 2d 62 01 00 call 1623d <_EIP+0x1623d> c01a6450
<xfs_btree_check_sblock+0/d0>
Code; c0190223 <xfs_alloc_lookup+113/330>
10: 83 c4 1c add $0x1c,%esp
Code; c0190226 <xfs_alloc_lookup+116/330>
13: 85 00 test %eax,(%eax)
--
Austin Gonyou <austin@xxxxxxxxxxxxxxx>
Coremetrics, Inc.
|