[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Kernel oops on new mailserver

To: XFS mailing list <linux-xfs@oss.sgi.com>
Subject: Re: Kernel oops on new mailserver
From: Paul Schutte <paul@it.up.ac.za>
Date: Wed, 20 Mar 2002 17:42:32 +0200
References: <3C965130.2CAB0A19@it.up.ac.za>
Sender: owner-linux-xfs@oss.sgi.com
It struck again.

kernel 2.4.18 from cvs checked out on March 14 2002
gcc version 2.95.4 (just to see if it made a difference over egcs-2.91.66)

I notice that the process was always 'modprobe' in all of the dumps.
I assume that the kernel kicks off the modprobe. There are nothing in the
crontabs.
The modutils are 2.4.13 that came with debian 3.0 (woody).

I had the source for 2.4.11 and compiled and installed it in an attempt to
get stability on the server. (I am probably kludging at straws here)

I included the output of depmod -v at the end.
Maybe it can give someone a clue to what's going wrong.

kernel BUG at ll_rw_blk.c:978!
invalid operand: 0000
CPU:    1
EIP:    0010:[<c0213896>]    Tainted: P
Using defaults from ksymoops -t elf32-i386 -a i386
EFLAGS: 00010202
eax: 0000001f   ebx: cd7d98a0   ecx: c03c1920   edx: 00002ddb
esi: 00000000   edi: 00000200   ebp: c7e4dcf0   esp: c7e4dcd4
ds: 0018   es: 0018   ss: 0018
Process modprobe (pid: 19735, stackpage=c7e4d000)
Stack: c02f3ea2 000003d2 cd7d98a0 caaec180 cd7d98a0 00001000 00000200
c7e4defc
       c0136780 00000001 00000001 c7e4dd14 cd7d98a0 00000001 c03c8480
00000000
       caaec180 00000000 00000000 c7e4de74 c01907a9 cfd76080 c02e5cd4
c7e4dd44
Call Trace: [<c0136780>] [<c01907a9>] [<c01907a9>] [<c01907a9>]
[<c023f000>]
   [<c0136ba6>] [<c0136bc9>] [<c0136af9>] [<c01e4c40>] [<c01e4f9c>]
[<c01120da>]
   [<c01d65f3>] [<c01c318c>] [<c01df3c5>] [<c01eac9e>] [<c01e3eb1>]
[<c01e6ef3>]
   [<c01db541>] [<c01e6a06>] [<c0135f66>] [<c010715b>]
Code: 0f 0b 83 c4 08 90 8d 74 26 00 46 3b 75 0c 7c ba 8b 55 08 f6

>>EIP; c0213896 <ll_rw_block+86/1f0>   <=====
Trace; c0136780 <fsync_inode_data_buffers+b8/190>
Trace; c01907a8 <xfs_acl_iaccess+28/84>
Trace; c01907a8 <xfs_acl_iaccess+28/84>
Trace; c01907a8 <xfs_acl_iaccess+28/84>
Trace; c023f000 <read_callback+4/e8>
Trace; c0136ba6 <__refile_buffer+56/60>
Trace; c0136bc8 <refile_buffer+18/24>
Trace; c0136af8 <__mark_buffer_dirty+28/30>
Trace; c01e4c40 <set_buffer_dirty_uptodate+34/48>
Trace; c01e4f9c <__pb_block_commit_write_async+2c/50>
Trace; c01120da <reschedule_idle+62/268>
Trace; c01d65f2 <xfs_trans_unlocked_item+22/40>
Trace; c01c318c <xfs_iunlock+4c/58>
Trace; c01df3c4 <xfs_rwunlock+30/6c>
Trace; c01eac9e <xfs_write+45e/46c>
Trace; c01e3eb0 <pagebuf_flush+18/2c>
Trace; c01e6ef2 <fs_flush_pages+2a/34>
Trace; c01db540 <xfs_fsync+e0/300>
Trace; c01e6a06 <linvfs_fsync+42/50>
Trace; c0135f66 <sys_fdatasync+6a/b4>
Trace; c010715a <system_call+32/38>
Code;  c0213896 <ll_rw_block+86/1f0>
00000000 <_EIP>:
Code;  c0213896 <ll_rw_block+86/1f0>   <=====
   0:   0f 0b                     ud2a      <=====
Code;  c0213898 <ll_rw_block+88/1f0>
   2:   83 c4 08                  add    $0x8,%esp
Code;  c021389a <ll_rw_block+8a/1f0>
   5:   90                        nop
Code;  c021389c <ll_rw_block+8c/1f0>
   6:   8d 74 26 00               lea    0x0(%esi,1),%esi
Code;  c02138a0 <ll_rw_block+90/1f0>
   a:   46                        inc    %esi
Code;  c02138a0 <ll_rw_block+90/1f0>
   b:   3b 75 0c                  cmp    0xc(%ebp),%esi
Code;  c02138a4 <ll_rw_block+94/1f0>
   e:   7c ba                     jl     ffffffca <_EIP+0xffffffca>
c0213860 <ll_rw_block+50/1f0>
Code;  c02138a6 <ll_rw_block+96/1f0>
  10:   8b 55 08                  mov    0x8(%ebp),%edx
Code;  c02138a8 <ll_rw_block+98/1f0>
  13:   f6 00 00                  testb  $0x0,(%eax)

Entering kdb (current=0xc7e4c000, pid 19735) on processor 1 Oops: invalid
operand
eax = 0x0000001f ebx = 0xcd7d98a0 ecx = 0xc03c1920 edx = 0x00002ddb

[1]kdb> bt
    EBP       EIP         Function(args)
0xc7e4dcf0 0xc0213896 ll_rw_block+0x86 (0x1, 0x1, 0xc7e4dd14, 0xcd7d98a0,
0x1)
                               kernel .text 0xc0100000 0xc0213810
0xc0213a00
0xc7e4defc 0xc0136780 fsync_inode_data_buffers+0xb8 (0xcd7d98a0,
0xcd7d9954, 0x0)
                               kernel .text 0xc0100000 0xc01366c8
0xc0136858
0xc7e4df10 0xc01e3eb1 pagebuf_flush+0x19 (0xcd7d98a0, 0x0, 0x0, 0x0)
                               kernel .text 0xc0100000 0xc01e3e98
0xc01e3ec4
0xc7e4df28 0xc01e6ef3 fs_flush_pages+0x2b (0xcfb78e38, 0x0, 0x0,
0xffffffff, 0xffffffff)
                               kernel .text 0xc0100000 0xc01e6ec8
0xc01e6efc
0xc7e4df64 0xc01db541 xfs_fsync+0xe1 (0xcfb78e38, 0x5, 0x0, 0x0, 0x0)
                               kernel .text 0xc0100000 0xc01db460
0xc01db760
0xc7e4df90 0xc01e6a06 linvfs_fsync+0x42 (0xcc5b57a0, 0xce38d7a0, 0x1,
0xcd7d9954, 0xc7e4c000)
                               kernel .text 0xc0100000 0xc01e69c4
0xc01e6a14
0xc7e4dfbc 0xc0135f66 sys_fdatasync+0x6a (0x0, 0x8063600, 0xbfffeca0,
0x8063600, 0x4013b6e0)
                               kernel .text 0xc0100000 0xc0135efc
0xc0135fb0
           0xc010715b system_call+0x33
                               kernel .text 0xc0100000 0xc0107128
0xc0107160
[1]kdb>

[1]kdb> cpu
Currently on cpu 1
Available cpus: 0, 1
[1]kdb> cpu 0

Entering kdb (current=0xcf672000, pid 160) on processor 0 due to cpu switch

[0]kdb> bt
    EBP       EIP         Function(args)
0xcf673d3c 0xc01370db create_empty_buffers+0x5b (0xc117f540, 0x802, 0x1000,
0xc117f540, 0x1aa600)
                               kernel .text 0xc0100000 0xc0137080
0xc01370e8
0xcf673d60 0xc013878b brw_page+0x37 (0x0, 0xc117f540, 0x802, 0xcf673da0,
0x1000)
                               kernel .text 0xc0100000 0xc0138754
0xc0138804
0xcf673dc0 0xc012e21a rw_swap_page_base+0xfa (0x0, 0x1aa600, 0xc117f540,
0xc117f540, 0x0)
                               kernel .text 0xc0100000 0xc012e120
0xc012e22c
0xcf673ddc 0xc012e28f rw_swap_page+0x63 (0x0, 0xc117f540, 0x0, 0x6, 0x8)
                               kernel .text 0xc0100000 0xc012e22c
0xc012e2a8
0xcf673df8 0xc012f258 read_swap_cache_async+0x7c (0x1aa600, 0x1aa300, 0x0,
0xcfec5b40, 0x1aa6)
                               kernel .text 0xc0100000 0xc012f1dc
0xc012f27e
0xcf673e14 0xc0123e9f swapin_readahead+0x3f (0x1aa300, 0xcfec5b40,
0x804dca0, 0x1, 0x1)
                               kernel .text 0xc0100000 0xc0123e60
0xc0123eb0
0xcf673e30 0xc0123edf do_swap_page+0x2f (0xcfec5b40, 0xcf7c7e60, 0x804dca0,
0xcf670134, 0x1aa300)
                               kernel .text 0xc0100000 0xc0123eb0
0xc0123fbc
0xcf673e5c 0xc012431e handle_mm_fault+0x6e (0xcfec5b40, 0xcf7c7e60,
0x804dca0, 0x1, 0xcf672000)
                               kernel .text 0xc0100000 0xc01242b0
0xc0124368
0xcf673f10 0xc01118f9 do_page_fault+0x1a1 (0xcf673f20, 0x2, 0xc0473d00,
0x804dca0, 0xc03c193c)
                               kernel .text 0xc0100000 0xc0111758
0xc0111c3e
           0xc010724c error_code+0x34
                               kernel .text 0xc0100000 0xc0107218
0xc0107254
Interrupt registers:
[0]more>
eax = 0x00000fff ebx = 0xcf673f20 ecx = 0x00000002 edx = 0xc0473d00
esi = 0x0804dca0 edi = 0xc03c193c esp = 0x00000010 eip = 0x00000018
ebp = 0x00000000 xss = 0x00010246 xcs = 0xffffffff eflags = 0xc011558e
xds = 0xcf673f84 xes = 0x00000000 origeax = 0xc03c0018 &regs = 0xcf673f18
Interrupt from user space, end of kernel trace
[0]kdb> lsmod
Module                  Size  modstruct     Used by
e100                   89752  0xd0850000     1
[0]kdb>



Here is the output of depmod -v



xftw starting at /lib/modules/boot lstat on /lib/modules/boot failed
xftw starting at /lib/modules/2.4.18-xfs-only
xftw_readdir /lib/modules/2.4.18-xfs-only
pruned build
pruned modules.dep
pruned modules.generic_string
pruned modules.ieee1394map
pruned modules.isapnpmap
pruned modules.parportmap
pruned modules.pcimap
pruned modules.pnpbiosmap
pruned modules.usbmap
type 2 /lib/modules/2.4.18-xfs-only/kernel
xftw_readdir /lib/modules/2.4.18-xfs-only/kernel
user function /lib/modules/2.4.18-xfs-only/kernel
type 2 /lib/modules/2.4.18-xfs-only/kernel/drivers
xftw_readdir /lib/modules/2.4.18-xfs-only/kernel/drivers
user function /lib/modules/2.4.18-xfs-only/kernel/drivers
type 2 /lib/modules/2.4.18-xfs-only/kernel/drivers/net
xftw_readdir /lib/modules/2.4.18-xfs-only/kernel/drivers/net
user function /lib/modules/2.4.18-xfs-only/kernel/drivers/net
user function /lib/modules/2.4.18-xfs-only/kernel/drivers/net/3c59x.o
user function /lib/modules/2.4.18-xfs-only/kernel/drivers/net/e100.o
user function /lib/modules/2.4.18-xfs-only/kernel/drivers/net/eepro100.o
user function /lib/modules/2.4.18-xfs-only/kernel/drivers/net/mii.o
user function /lib/modules/2.4.18-xfs-only/kernel/drivers/net/starfire.o
type 2 /lib/modules/2.4.18-xfs-only/kernel/fs
xftw_readdir /lib/modules/2.4.18-xfs-only/kernel/fs
user function /lib/modules/2.4.18-xfs-only/kernel/fs
type 2 /lib/modules/2.4.18-xfs-only/kernel/fs/ext2
xftw_readdir /lib/modules/2.4.18-xfs-only/kernel/fs/ext2
user function /lib/modules/2.4.18-xfs-only/kernel/fs/ext2
user function /lib/modules/2.4.18-xfs-only/kernel/fs/ext2/ext2.o
type 2 /lib/modules/2.4.18-xfs-only/kernel/fs/ext3
xftw_readdir /lib/modules/2.4.18-xfs-only/kernel/fs/ext3
user function /lib/modules/2.4.18-xfs-only/kernel/fs/ext3
user function /lib/modules/2.4.18-xfs-only/kernel/fs/ext3/ext3.o
type 2 /lib/modules/2.4.18-xfs-only/kernel/fs/jbd
xftw_readdir /lib/modules/2.4.18-xfs-only/kernel/fs/jbd
user function /lib/modules/2.4.18-xfs-only/kernel/fs/jbd
user function /lib/modules/2.4.18-xfs-only/kernel/fs/jbd/jbd.o
type 2 /lib/modules/2.4.18-xfs-only/kernel/fs/jfs
xftw_readdir /lib/modules/2.4.18-xfs-only/kernel/fs/jfs
user function /lib/modules/2.4.18-xfs-only/kernel/fs/jfs
user function /lib/modules/2.4.18-xfs-only/kernel/fs/jfs/jfs.o
type 2 /lib/modules/2.4.18-xfs-only/kernel/fs/reiserfs
xftw_readdir /lib/modules/2.4.18-xfs-only/kernel/fs/reiserfs
user function /lib/modules/2.4.18-xfs-only/kernel/fs/reiserfs
user function /lib/modules/2.4.18-xfs-only/kernel/fs/reiserfs/reiserfs.o
type 2 /lib/modules/2.4.18-xfs-only/kernel/fs/xfs
xftw_readdir /lib/modules/2.4.18-xfs-only/kernel/fs/xfs
user function /lib/modules/2.4.18-xfs-only/kernel/fs/xfs
user function /lib/modules/2.4.18-xfs-only/kernel/fs/xfs/xfsidbg.o
type 2 /lib/modules/2.4.18-xfs-only/kernel/kdb
xftw_readdir /lib/modules/2.4.18-xfs-only/kernel/kdb
user function /lib/modules/2.4.18-xfs-only/kernel/kdb
type 2 /lib/modules/2.4.18-xfs-only/kernel/kdb/modules
xftw_readdir /lib/modules/2.4.18-xfs-only/kernel/kdb/modules
user function /lib/modules/2.4.18-xfs-only/kernel/kdb/modules
user function /lib/modules/2.4.18-xfs-only/kernel/kdb/modules/kdbm_pg.o
user function /lib/modules/2.4.18-xfs-only/kernel/kdb/modules/kdbm_vm.o
type 2 /lib/modules/2.4.18-xfs-only/pcmcia
xftw_readdir /lib/modules/2.4.18-xfs-only/pcmcia
user function /lib/modules/2.4.18-xfs-only/pcmcia
xftw starting at /lib/modules/2.4 lstat on /lib/modules/2.4 failed
xftw starting at /lib/modules/kernel lstat on /lib/modules/kernel failed
xftw starting at /lib/modules/fs lstat on /lib/modules/fs failed
xftw starting at /lib/modules/net
xftw_readdir /lib/modules/net
type 2 /lib/modules/net
xftw_readdir /lib/modules/net
user function /lib/modules/net
xftw starting at /lib/modules/scsi lstat on /lib/modules/scsi failed
xftw starting at /lib/modules/block lstat on /lib/modules/block failed
xftw starting at /lib/modules/cdrom lstat on /lib/modules/cdrom failed
xftw starting at /lib/modules/ipv4 lstat on /lib/modules/ipv4 failed
xftw starting at /lib/modules/ipv6 lstat on /lib/modules/ipv6 failed
xftw starting at /lib/modules/sound lstat on /lib/modules/sound failed
xftw starting at /lib/modules/fc4 lstat on /lib/modules/fc4 failed
xftw starting at /lib/modules/video lstat on /lib/modules/video failed
xftw starting at /lib/modules/misc lstat on /lib/modules/misc failed
xftw starting at /lib/modules/pcmcia lstat on /lib/modules/pcmcia failed
xftw starting at /lib/modules/atm lstat on /lib/modules/atm failed
xftw starting at /lib/modules/usb lstat on /lib/modules/usb failed
xftw starting at /lib/modules/ide lstat on /lib/modules/ide failed
xftw starting at /lib/modules/ieee1394 lstat on /lib/modules/ieee1394
failed
xftw starting at /lib/modules/mtd lstat on /lib/modules/mtd failed
/lib/modules/2.4.18-xfs-only/kernel/drivers/net/3c59x.o
/lib/modules/2.4.18-xfs-only/kernel/drivers/net/e100.o
/lib/modules/2.4.18-xfs-only/kernel/drivers/net/eepro100.o
/lib/modules/2.4.18-xfs-only/kernel/drivers/net/mii.o
/lib/modules/2.4.18-xfs-only/kernel/drivers/net/starfire.o
/lib/modules/2.4.18-xfs-only/kernel/fs/ext2/ext2.o
/lib/modules/2.4.18-xfs-only/kernel/fs/ext3/ext3.o
/lib/modules/2.4.18-xfs-only/kernel/fs/jbd/jbd.o
/lib/modules/2.4.18-xfs-only/kernel/fs/jfs/jfs.o
/lib/modules/2.4.18-xfs-only/kernel/fs/reiserfs/reiserfs.o
/lib/modules/2.4.18-xfs-only/kernel/fs/xfs/xfsidbg.o
/lib/modules/2.4.18-xfs-only/kernel/kdb/modules/kdbm_pg.o
/lib/modules/2.4.18-xfs-only/kernel/kdb/modules/kdbm_vm.o
Follow-Ups:
- Re: Kernel oops on new mailserver
  - From: Steve Lord <lord@sgi.com>
References:
- Kernel oops on new mailserver
  - From: Paul Schutte <paul@it.up.ac.za>
Prev by Date: Re: Corrupted files on 2.4.18.
Next by Date: Re: Kernel oops on new mailserver
Previous by thread: Re: Kernel oops on new mailserver
Next by thread: Re: Kernel oops on new mailserver
Index(es):
- Date
- Thread