I also am seeing the "Bad write on page" errors. Attached is syslog
info from two incidents. The first was after three weeks uptime, the
second was after one week uptime. The system is a heavily-loaded mail
server, IBM Netfinity x370 8-way PIII Xeon, 8.5GB RAM (HIGHMEM enabled)
running 2.4.9 + patch-2.4.9-xfs-2001-08-17 compiled with egcs-2.91.66.
The XFS filesystems are on top of LVM, on top of hardware RAID1E. After
the errors the system becomes unresponsive. I suspected a 2.4 VM bug
but searching LKML archives turns up no hits, so maybe it is XFS
related. I also saw the error after six hours running 2.4.9 +
linux-2.4.9-xfs-2001-08-26.patch.
Jim Sep 11 17:05:41 xxxx kernel: Bad write on page 0xc13169a8
Sep 11 17:05:49 xxxx kernel: Warning: buffer 0xeaa97c60 with weird blockno (0)
Sep 11 17:05:49 xxxx kernel: kernel BUG at ll_rw_blk.c:1011!
Sep 11 17:05:49 xxxx kernel: invalid operand: 0000
Sep 11 17:05:49 xxxx kernel: CPU: 1
Sep 11 17:05:49 xxxx kernel: EIP: 0010:[ll_rw_block+141/540]
Sep 11 17:05:49 xxxx kernel: EIP: 0010:[<c017f421>]
Sep 11 17:05:49 xxxx kernel: EFLAGS: 00010286
Sep 11 17:05:49 xxxx kernel: eax: 00000020 ebx: 00003a04 ecx: 00000001
edx: 00000001
Sep 11 17:05:49 xxxx kernel: esi: 00000000 edi: 00000200 ebp: d3fc9d44
esp: d3fc9cec
Sep 11 17:05:49 xxxx kernel: ds: 0018 es: 0018 ss: 0018
Sep 11 17:05:49 xxxx kernel: Process procmail (pid: 6664, stackpage=d3fc9000)
Sep 11 17:05:49 xxxx kernel: Stack: c022d850 c022db02 000003f3 dae17bf8
eaa97c60 d3fc9d60 00000000 eaa97c60
Sep 11 17:05:49 xxxx kernel: 4e4d4c4b 5251504f 56555453 5a595857
00001000 c0137764 00000001 00000001
Sep 11 17:05:49 xxxx kernel: d3fc9d44 dae17be0 e336a24c e336a234
00000001 d3fc9d60 eaa97c60 37633630
Sep 11 17:05:49 xxxx kernel: Call Trace: [fsync_inode_buffers+176/396]
[scrup+107/260] [reschedule_idle+575/588] [lf+47/92] [printk+417/432]
Sep 11 17:05:49 xxxx kernel: Call Trace: [<c0137764>] [<c017150b>] [<c0112b47>]
[<c0172c3b>] [<c0115d91>]
Sep 11 17:05:49 xxxx kernel: [__refile_buffer+100/108]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-525546/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-524566/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-522417/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-522112/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-121076/96]
Sep 11 17:05:49 xxxx kernel: [<c0137bdc>] [<f89a7b16>] [<f89a7eea>]
[<f89a874f>] [<f89a8880>] [<f8a0a70c>]
Sep 11 17:05:49 xxxx kernel:
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-135678/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-221589/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-96284/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-63804/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-529609/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-8064/96]
Sep 11 17:05:49 xxxx kernel: [<f8a06e02>] [<f89f1e6b>] [<f8a107e4>]
[<f8a186c4>] [<f89a6b37>] [<f8a26080>]
Sep 11 17:05:49 xxxx kernel:
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-82175/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-115171/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-8064/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-83263/96]
[sys_fsync+92/140] [system_call+51/56]
Sep 11 17:05:49 xxxx kernel: [<f8a13f01>] [<f8a0be1d>] [<f8a26080>]
[<f8a13ac1>] [<c0136d48>] [<c0106f9b>]
Sep 11 17:05:49 xxxx kernel:
Sep 11 17:05:49 xxxx kernel: Code: 0f 0b 83 c4 0c 83 c5 04 46 3b 74 24 30 7c b0
8b 4c 24 2c f6
Sep 11 17:06:18 xxxx kernel: kernel BUG at ll_rw_blk.c:692!
Sep 11 17:06:18 xxxx kernel: invalid operand: 0000
Sep 11 17:06:18 xxxx kernel: CPU: 1
Sep 11 17:06:18 xxxx kernel: EIP: 0010:[__make_request+180/1968]
Sep 11 17:06:18 xxxx kernel: EIP: 0010:[<c017eb14>]
Sep 11 17:06:18 xxxx kernel: EFLAGS: 00010282
Sep 11 17:06:18 xxxx kernel: eax: 0000001f ebx: eaa97c60 ecx: 00000002
edx: 00000004
Sep 11 17:06:18 xxxx kernel: esi: 00002000 edi: 00004000 ebp: ca13b218
esp: ca19be80
Sep 11 17:06:18 xxxx kernel: ds: 0018 es: 0018 ss: 0018
Sep 11 17:06:18 xxxx kernel: Process kupdated (pid: 14, stackpage=ca19b000)
Sep 11 17:06:18 xxxx kernel: Stack: c022d850 c022db02 000002b4 00000008
eaa97c60 031d9000 00000000 ca115a80
Sep 11 17:06:18 xxxx kernel: 00000001 00000008 ca14b370 ca14b200
f7137000 00000000 00004000 ca13b248
Sep 11 17:06:18 xxxx kernel: ca116620 0841b240 002007d0 00000000
00000000 002007d0 00000202 c017f2c0
Sep 11 17:06:18 xxxx kernel: Call Trace: [generic_make_request+176/272]
[submit_bh+88/116] [write_locked_buffers+30/40] [write_some_buffers+202/308]
[sync_old_buffers+112/168]
Sep 11 17:06:18 xxxx kernel: Call Trace: [<c017f2c0>] [<c017f378>] [<c013680a>]
[<c01368de>] [<c0139e1c>]
Sep 11 17:06:18 xxxx kernel: [kupdate+309/316] [stext+0/100]
[kernel_thread+26/48] [kernel_thread+35/48]
Sep 11 17:06:18 xxxx kernel: [<c013a125>] [<c0105000>] [<c010575a>]
[<c0105763>]
Sep 11 17:06:18 xxxx kernel:
Sep 11 17:06:18 xxxx kernel: Code: 0f 0b 83 c4 0c 8d b4 26 00 00 00 00 8b 74 24
5c 56 8b 7c 24
Sep 18 18:04:24 xxxx kernel: Bad write on page 0xc1fcfff0
Sep 18 18:04:24 xxxx kernel: Warning: buffer 0xf2404720 with weird blockno (0)
Sep 18 18:04:24 xxxx kernel: Warning: buffer 0xf2404720 with weird blockno (0)
Sep 18 18:04:24 xxxx kernel: kernel BUG at ll_rw_blk.c:1011!
Sep 18 18:04:24 xxxx kernel: invalid operand: 0000
Sep 18 18:04:24 xxxx kernel: CPU: 3
Sep 18 18:04:24 xxxx kernel: EIP: 0010:[ll_rw_block+141/540]
Sep 18 18:04:24 xxxx kernel: EIP: 0010:[<c017f421>]
Sep 18 18:04:24 xxxx kernel: EFLAGS: 00010286
Sep 18 18:04:24 xxxx kernel: eax: 00000020 ebx: 00003a04 ecx: 00000001
edx: 00000001
Sep 18 18:04:24 xxxx kernel: esi: 00000000 edi: 00000200 ebp: d6bf3d44
esp: d6bf3cec
Sep 18 18:04:24 xxxx kernel: ds: 0018 es: 0018 ss: 0018
Sep 18 18:04:24 xxxx kernel: Process procmail (pid: 12614, stackpage=d6bf3000)
Sep 18 18:04:24 xxxx kernel: Stack: c022d850 c022db02 000003f3 f4f5bbd8
f2404720 d6bf3d60 00000000 f2404720
Sep 18 18:04:24 xxxx kernel: 4e4d4c4b 5251504f 56555453 5a595857
00001000 c0137764 00000001 00000001
Sep 18 18:04:24 xxxx kernel: d6bf3d44 f4f5bbc0 ec8ac614 ec8ac5fc
00000001 d6bf3d60 f2404720 34373230
Sep 18 18:04:24 xxxx kernel: Call Trace: [fsync_inode_buffers+176/396]
[scrup+107/260] [lf+47/92] [vt_console_print+728/752] [printk+417/432]
Sep 18 18:04:24 xxxx kernel: Call Trace: [<c0137764>] [<c017150b>] [<c0172c3b>]
[<c01756f4>] [<c0115d91>]
Sep 18 18:04:24 xxxx kernel:
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-525593/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-517888/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-525561/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-524566/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-522417/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-522112/96]
Sep 18 18:04:24 xxxx kernel: [<f8a9dae7>] [<f8a9f900>] [<f8a9db07>]
[<f8a9deea>] [<f8a9e74f>] [<f8a9e880>]
Sep 18 18:04:24 xxxx kernel:
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-121076/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-135678/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-221589/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-96284/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-63804/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-529609/96]
Sep 18 18:04:24 xxxx kernel: [<f8b0070c>] [<f8afce02>] [<f8ae7e6b>]
[<f8b067e4>] [<f8b0e6c4>] [<f8a9cb37>]
Sep 18 18:04:24 xxxx kernel:
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-8064/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-82175/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-115171/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-8064/96]
[3c59x:__insmod_3c59x_O/lib/modules/2.4.9-xfs/kernel/drivers/net/3+-83263/96]
[sys_fsync+92/140]
Sep 18 18:04:24 xxxx kernel: [<f8b1c080>] [<f8b09f01>] [<f8b01e1d>]
[<f8b1c080>] [<f8b09ac1>] [<c0136d48>]
Sep 18 18:04:24 xxxx kernel: [system_call+51/56]
Sep 18 18:04:24 xxxx kernel: [<c0106f9b>]
Sep 18 18:04:24 xxxx kernel:
Sep 18 18:04:24 xxxx kernel: Code: 0f 0b 83 c4 0c 83 c5 04 46 3b 74 24 30 7c b0
8b 4c 24 2c f6
Sep 18 18:04:29 xxxx kernel: kernel BUG at ll_rw_blk.c:692!
Sep 18 18:04:29 xxxx kernel: invalid operand: 0000
Sep 18 18:04:29 xxxx kernel: CPU: 6
Sep 18 18:04:29 xxxx kernel: EIP: 0010:[__make_request+180/1968]
Sep 18 18:04:29 xxxx kernel: EIP: 0010:[<c017eb14>]
Sep 18 18:04:29 xxxx kernel: EFLAGS: 00010282
Sep 18 18:04:29 xxxx kernel: eax: 0000001f ebx: f2404720 ecx: 00000002
edx: 00000010
Sep 18 18:04:29 xxxx kernel: esi: 00002000 edi: 00004000 ebp: ca11ae18
esp: ca19be80
Sep 18 18:04:29 xxxx kernel: ds: 0018 es: 0018 ss: 0018
Sep 18 18:04:29 xxxx kernel: Process kupdated (pid: 14, stackpage=ca19b000)
Sep 18 18:04:29 xxxx kernel: Stack: c022d850 c022db02 000002b4 00000008
f2404720 031d9000 00000000 ca1196c0
Sep 18 18:04:29 xxxx kernel: 00000001 00000008 f7144970 f7144800
f70a0000 00000000 00004000 ca11ae48
Sep 18 18:04:29 xxxx kernel: ca1189e0 0841ae40 002007d0 00000000
00000000 002007d0 00000202 c017f2c0
Sep 18 18:04:29 xxxx kernel: Call Trace: [generic_make_request+176/272]
[submit_bh+88/116] [write_locked_buffers+30/40] [write_some_buffers+290/308]
[sync_old_buffers+112/168]
Sep 18 18:04:29 xxxx kernel: Call Trace: [<c017f2c0>] [<c017f378>] [<c013680a>]
[<c0136936>] [<c0139e1c>]
Sep 18 18:04:29 xxxx kernel: [kupdate+309/316] [stext+0/100]
[kernel_thread+26/48] [kernel_thread+35/48]
Sep 18 18:04:29 xxxx kernel: [<c013a125>] [<c0105000>] [<c010575a>]
[<c0105763>]
Sep 18 18:04:29 xxxx kernel:
Sep 18 18:04:29 xxxx kernel: Code: 0f 0b 83 c4 0c 8d b4 26 00 00 00 00 8b 74 24
5c 56 8b 7c 24
|