Hi there,
We are seeing two (very similar?) kernel dumps (order:5, mode 0xd0 /
order:4 mode 0x50) on our systems,
I have search the mailing list and it seem to somehow related to the
fragmentation problem? (ours is at > 99%) though someone maintained this
is not Fatal, but our system usually becomes unresponsive when the dump
starts to appear (sometimes its ok after a while, but most of time it
just dumps forever and system becomes unusable and we have to reboot)
are there fixes / workaround we can try?
Are these two message dump the same thing?
Thanks,
Sep 26 00:09:39 localhost kernel: EngineMain: page allocation failure.
order:5, mode:0xd0
Sep 26 00:09:39 localhost kernel: [<02146dbe>] __alloc_pages+0x28b/0x298
Sep 26 00:09:39 localhost kernel: [<02146de3>] __get_free_pages+0x18/0x24
Sep 26 00:09:39 localhost kernel: [<0214a4f1>] kmem_getpages+0x15/0x94
Sep 26 00:09:39 localhost kernel: [<0214b27d>] cache_grow+0x155/0x29a
Sep 26 00:09:39 localhost kernel: [<0214b5cf>]
cache_alloc_refill+0x20d/0x23d
Sep 26 00:09:39 localhost kernel: [<0214bb80>] __kmalloc+0x6b/0x7d
Sep 26 00:09:39 localhost kernel: [<2291e964>] kmem_alloc+0x50/0x96 [xfs]
Sep 26 00:09:39 localhost kernel: [<228fe7df>]
xfs_iread_extents+0x73/0xc4 [xfs]
Sep 26 00:09:39 localhost kernel: [<228de41a>] xfs_bmapi+0x2b8/0x129f [xfs]
Sep 26 00:09:39 localhost kernel: [<0224f390>] cfq_add_crq_rb+0x3b/0x4d
Sep 26 00:09:39 localhost kernel: [<0224fb19>] cfq_enqueue+0x33/0x64
Sep 26 00:09:39 localhost kernel: [<0224fbb7>] cfq_insert_request+0x6d/0xdf
Sep 26 00:09:39 localhost kernel: [<0226c42b>] __ide_dma_begin+0x21/0x2f
Sep 26 00:09:39 localhost kernel: [<0226c36d>] __ide_dma_read+0x8a/0x95
Sep 26 00:09:39 localhost kernel: [<0226c0ef>] dma_timer_expiry+0x0/0x6e
Sep 26 00:09:39 localhost kernel: [<0226e823>] __ide_do_rw_disk+0x2d8/0x4aa
Sep 26 00:09:39 localhost kernel: [<02302380>] schedule+0x478/0x5a4
Sep 26 00:09:39 localhost kernel: [<0211ba79>] __wake_up_locked+0x11/0x13
Sep 26 00:09:39 localhost kernel: [<229020c3>] xfs_iomap+0x23a/0x3ec [xfs]
Sep 26 00:09:39 localhost kernel: [<02142938>] find_lock_page+0x84/0x228
Sep 26 00:09:39 localhost kernel: [<229263a2>] xfs_bmap+0x1a/0x1e [xfs]
Sep 26 00:09:39 localhost kernel: [<2291fac9>]
linvfs_get_block_core+0x6b/0x22b [xfs]
Sep 26 00:09:39 localhost kernel: [<02302db4>] __cond_resched+0x14/0x3b
Sep 26 00:09:39 localhost kernel: [<02168b48>] set_bh_page+0x2c/0x34
Sep 26 00:09:40 localhost kernel: [<2291fc9c>]
linvfs_get_block+0x13/0x17 [xfs]
Sep 26 00:09:40 localhost kernel: [<02169224>]
__block_prepare_write+0x15b/0x3dd
Sep 26 00:09:40 localhost kernel: [<02151de2>] follow_page_pfn+0xec/0xfd
Sep 26 00:09:40 localhost kernel: [<02169b04>]
block_prepare_write+0x16/0x22
Sep 26 00:09:40 localhost kernel: [<2291fc89>]
linvfs_get_block+0x0/0x17 [xfs]
Sep 26 00:09:40 localhost kernel: [<2291ffb5>]
linvfs_prepare_write+0x12/0x15 [xfs]
Sep 26 00:09:40 localhost kernel: [<2291fc89>]
linvfs_get_block+0x0/0x17 [xfs]
Sep 26 00:09:40 localhost kernel: [<02144290>]
generic_file_buffered_write+0x1b4/0x48e
Sep 26 00:09:40 localhost kernel: [<228fc7a6>] xfs_iget+0x62/0x103 [xfs]
Sep 26 00:09:40 localhost kernel: [<02302db4>] __cond_resched+0x14/0x3b
Sep 26 00:09:40 localhost kernel: [<228fcd93>] xfs_ilock+0xce/0xdc [xfs]
/////////////////////////////////////////////////////////////////////////
localhost kernel: possible deadlock in kmem_alloc (mode:0x50)
localhost last message repeated 39 times
localhost kernel: printk: 4168 messages suppressed.
localhost kernel: EngineMain: page allocation failure. order:4, mode:0x50
localhost kernel: [<02146dbe>] __alloc_pages+0x28b/0x298
localhost kernel: [<02146de3>] __get_free_pages+0x18/0x24
localhost kernel: [<0214a4f1>] kmem_getpages+0x15/0x94
localhost kernel: [<0214b27d>] cache_grow+0x155/0x29a
localhost kernel: [<0214b5cf>] cache_alloc_refill+0x20d/0x23d
localhost kernel: [<0214bb80>] __kmalloc+0x6b/0x7d
localhost kernel: [<421ee964>] kmem_alloc+0x50/0x96 [xfs]
localhost kernel: [<421eea2c>] kmem_realloc+0x17/0x52 [xfs]
localhost kernel: [<421cff07>] xfs_iext_realloc+0xc9/0xdc [xfs]
localhost kernel: [<421aca5b>] xfs_bmap_insert_exlist+0x22/0x77 [xfs]
localhost kernel: [<421a9e77>] xfs_bmap_add_extent_hole_delay+0x438/0x48e
[xfs]
localhost kernel: [<421a78e9>] xfs_bmap_add_extent+0x133/0x386 [xfs]
localhost kernel: [<421aec42>] xfs_bmapi+0xae0/0x129f [xfs]
localhost kernel: [<02108a01>] do_IRQ+0x187/0x309
localhost kernel: [<421ae462>] xfs_bmapi+0x300/0x129f [xfs]
localhost kernel: [<421d2cdc>] xfs_iomap_write_delay+0x62b/0x705 [xfs]
localhost kernel: [<421d1c26>] xfs_imap_to_bmap+0x2a/0x28d [xfs]
localhost kernel: [<02108af0>] do_IRQ+0x276/0x309
localhost kernel: [<421d20c3>] xfs_iomap+0x23a/0x3ec [xfs]
localhost kernel: [<421d216d>] xfs_iomap+0x2e4/0x3ec [xfs]
localhost kernel: [<0210cc88>] do_gettimeofday+0x14/0x90
localhost kernel: [<421f63a2>] xfs_bmap+0x1a/0x1e [xfs]
localhost kernel: [<421efac9>] linvfs_get_block_core+0x6b/0x22b [xfs]
localhost kernel: [<02302db4>] __cond_resched+0x14/0x3b
localhost kernel: [<02168b48>] set_bh_page+0x2c/0x34
localhost kernel: [<421efc9c>] linvfs_get_block+0x13/0x17 [xfs]
localhost kernel: [<02169224>] __block_prepare_write+0x15b/0x3dd
localhost kernel: [<02151de2>] follow_page_pfn+0xec/0xfd
localhost kernel: [<02169b04>] block_prepare_write+0x16/0x22
localhost kernel: [<421efc89>] linvfs_get_block+0x0/0x17 [xfs]
localhost kernel: [<421effb5>] linvfs_prepare_write+0x12/0x15 [xfs]
localhost kernel: [<421efc89>] linvfs_get_block+0x0/0x17 [xfs]
localhost kernel: [<02144290>] generic_file_buffered_write+0x1b4/0x48e
localhost kernel: [<0215e45f>] rw_vm+0x3f7/0x482
localhost kernel: [<022a780c>] skb_copy_datagram_iovec+0x4f/0x1e1
localhost kernel: [<022cace1>] cleanup_rbuf+0xbf/0xdb
localhost kernel: [<421f600b>] xfs_write+0x598/0x8dd [xfs]
localhost kernel: [<421f2521>] linvfs_write+0x6f/0x77 [xfs]
localhost kernel: [<02165612>] do_sync_write+0x97/0xc9
localhost kernel: [<0211953a>] do_page_fault+0x1bc/0x511
localhost kernel: [<02302380>] schedule+0x478/0x5a4
localhost kernel: [<0211cf5b>] autoremove_wake_function+0x0/0x2d
localhost kernel: [<0215e45f>] rw_vm+0x3f7/0x482
localhost kernel: [<021656fa>] vfs_write+0xb6/0xe2
localhost kernel: [<021657c4>] sys_write+0x3c/0x62
|