On Thu, 2002-10-10 at 17:31, I.D.Hardy@xxxxxxxxxxx wrote:
>
> On 10 Oct 2002 12:23:43 -0500: Steve Lord Wrote:
>
> >
> > Ian, did you run xfs_check and repair before mounting the fs or
> > after? You should mount again after reboot, then run check.
> > The in memory corruption error means it failed an internal check
> > on a memory buffer, not that it had found bad data on the disk.
> >
> > If you have the check/repair output, please send it, but there is
> > no real way to tell if the issues in it were from running the
> > commands with a dirty log or not.
> >
> > We really need to improve that particular trace message, there
> > are 80 some places it could have originated. Lets see if we
> > can do something about that.
> >
> > Steve
> >
> >
>
> Steve, thanks as always for your reply. Yes, the server was rebooted, and the
> filesystem mounted and unmounted prior to running xfs_check/repair. Also,
> a 'xfs_fsr' was run when we upgraded the kernel (on an idle system), the
> system
> was then rebooted and 'xfs_check' ran on the filesystem (clean) before the
> server was but back into service (and therefore prior to the 2 filesystem
> shutdowns); I can therefore be confident that any FS corruption occurred
> while
> running the new (Wed 8th) XFS CVS kernel.
>
> Here's the output from the xfs_check/xfs_repair runs following the first
> filesystem shutdown (xfs_clean was clean following the 2nd shutdown).
>
> ..... (sorry I missed capturing the top of this xfs_check session, though
> I think this was near the start).
Hmm, you have ascii data on top of inodes by the look of it. So this
looks like a rogue write. You have 64 inodes here which look like they
were completely overwritten. Working out where this came from is key
here. I am not aware of anything which changed recently which might
relate to this.
Steve
> bad magic number 0x2020 for inode 19701440
> bad magic number 0x2020 for inode 19701441
> bad magic number 0x2020 for inode 19701442
> bad magic number 0x2031 for inode 19701443
> bad magic number 0x3137 for inode 19701444
> bad magic number 0x372e for inode 19701445
> bad magic number 0x2e33 for inode 19701446
> bad magic number 0x3030 for inode 19701447
> bad magic number 0x3034 for inode 19701448
> bad magic number 0x3832 for inode 19701449
> bad magic number 0x3030 for inode 19701450
> bad magic number 0x3933 for inode 19701451
> bad magic number 0x3832 for inode 19701452
> bad magic number 0x3233 for inode 19701453
> bad magic number 0x3836 for inode 19701454
> bad magic number 0x3733 for inode 19701455
> bad magic number 0x3539 for inode 19701456
> bad magic number 0x3435 for inode 19701457
> bad magic number 0x3736 for inode 19701458
> bad magic number 0x3331 for inode 19701459
> bad magic number 0x3520 for inode 19701460
> bad magic number 0x2020 for inode 19701461
> bad magic number 0x2020 for inode 19701462
> bad magic number 0x2020 for inode 19701463
> bad magic number 0x2020 for inode 19701464
> bad magic number 0x202d for inode 19701465
> bad magic number 0x2d30 for inode 19701466
> bad magic number 0x302e for inode 19701467
> bad magic number 0x2e35 for inode 19701468
> bad magic number 0x3330 for inode 19701469
> bad magic number 0x3737 for inode 19701470
> bad magic number 0x3730 for inode 19701471
> bad magic number 0x3039 for inode 19701472
> bad magic number 0x3032 for inode 19701473
> bad magic number 0x3637 for inode 19701474
> bad magic number 0x3134 for inode 19701475
> bad magic number 0x3630 for inode 19701476
> bad magic number 0x3333 for inode 19701477
> bad magic number 0x3638 for inode 19701478
> bad magic number 0x3735 for inode 19701479
> bad magic number 0x3134 for inode 19701480
> bad magic number 0x3635 for inode 19701481
> bad magic number 0x3333 for inode 19701482
> bad magic number 0x3831 for inode 19701483
> bad magic number 0x3020 for inode 19701484
> bad magic number 0x2020 for inode 19701485
> bad magic number 0x2d30 for inode 19701486
> bad magic number 0x2020 for inode 19701487
> bad magic number 0x2020 for inode 19701488
> bad magic number 0x200a for inode 19701489
> bad magic number 0xa20 for inode 19701490
> bad magic number 0x2020 for inode 19701491
> bad magic number 0x2035 for inode 19701492
> bad magic number 0x3439 for inode 19701493
> bad magic number 0x302e for inode 19701494
> bad magic number 0x2e33 for inode 19701495
> bad magic number 0x3831 for inode 19701496
> bad magic number 0x3935 for inode 19701497
> bad magic number 0x3033 for inode 19701498
> bad magic number 0x3430 for inode 19701499
> bad magic number 0x3737 for inode 19701500
> bad magic number 0x3739 for inode 19701501
> bad magic number 0x3536 for inode 19701502
> bad magic number 0x3639 for inode 19701503
> link count mismatch for inode 19701440 (name ?), nlink 0, counted 1
> link count mismatch for inode 19701441 (name ?), nlink 0, counted 1
> link count mismatch for inode 19701442 (name ?), nlink 0, counted 1
> link count mismatch for inode 19701443 (name ?), nlink 0, counted 1
> user quota id 39946, have/exp bc 33686153/33685628 ic 377630/377629
> user quota id 5102, have/exp ic 57152/57148
> sh-2.05a#
> sh-2.05a# xfs_repair /dev/md0
>
> Phase 1 - find and verify superblock...
> Phase 2 - using internal log
> - zero log...
> - scan filesystem freespace and inode maps...
> - found root inode chunk
> Phase 3 - for each AG...
> - scan and clear agi unlinked lists...
> - process known inodes and perform inode discovery...
> - agno = 0
> - agno = 1
> - agno = 2
> bad magic number 0x2020 on inode 19701440
> bad version number 0x31 on inode 19701440
> bad inode format in inode 19701440
> bad magic number 0x2020 on inode 19701441
> bad version number 0x37 on inode 19701441
> bad inode format in inode 19701441
> bad magic number 0x2020 on inode 19701442
> bad version number 0x2e on inode 19701442
> bad inode format in inode 19701442
> bad magic number 0x2031 on inode 19701443
> bad version number 0x32 on inode 19701443
> bad inode format in inode 19701443
> bad magic number 0x3137 on inode 19701444
> bad version number 0x37 on inode 19701444
> bad inode format in inode 19701444
> bad magic number 0x372e on inode 19701445
> bad version number 0x34 on inode 19701445
> bad inode format in inode 19701445
> bad magic number 0x2e33 on inode 19701446
> bad version number 0x34 on inode 19701446
> bad inode format in inode 19701446
> bad magic number 0x3030 on inode 19701447
> bad version number 0x35 on inode 19701447
> bad inode format in inode 19701447
> bad magic number 0x3034 on inode 19701448
> bad version number 0x32 on inode 19701448
> bad inode format in inode 19701448
> bad magic number 0x3832 on inode 19701449
> bad version number 0x34 on inode 19701449
> bad inode format in inode 19701449
> bad magic number 0x3030 on inode 19701450
> bad version number 0x39 on inode 19701450
> bad inode format in inode 19701450
> bad magic number 0x3933 on inode 19701451
> bad version number 0x39 on inode 19701451
> bad inode format in inode 19701451
> bad magic number 0x3832 on inode 19701452
> bad version number 0x37 on inode 19701452
> bad inode format in inode 19701452
> bad magic number 0x3233 on inode 19701453
> bad version number 0x39 on inode 19701453
> bad inode format in inode 19701453
> bad magic number 0x3836 on inode 19701454
> bad version number 0x37 on inode 19701454
> bad inode format in inode 19701454
> bad magic number 0x3733 on inode 19701455
> bad version number 0x35 on inode 19701455
> bad inode format in inode 19701455
> bad magic number 0x3539 on inode 19701456
> bad version number 0x37 on inode 19701456
> bad inode format in inode 19701456
> bad magic number 0x3435 on inode 19701457
> bad version number 0x20 on inode 19701457
> bad inode format in inode 19701457
> bad magic number 0x3736 on inode 19701458
> bad version number 0x20 on inode 19701458
> bad inode format in inode 19701458
> bad magic number 0x3331 on inode 19701459
> bad version number 0x20 on inode 19701459
> bad inode format in inode 19701459
> bad magic number 0x3520 on inode 19701460
> bad version number 0x20 on inode 19701460
> bad inode format in inode 19701460
> bad magic number 0x2020 on inode 19701461
> bad version number 0x20 on inode 19701461
> bad inode format in inode 19701461
> bad magic number 0x2020 on inode 19701462
> bad version number 0x2d on inode 19701462
> bad inode format in inode 19701462
> bad magic number 0x2020 on inode 19701463
> bad version number 0x30 on inode 19701463
> bad inode format in inode 19701463
> bad magic number 0x2020 on inode 19701464
> bad version number 0x2e on inode 19701464
> bad inode format in inode 19701464
> bad magic number 0x202d on inode 19701465
> bad version number 0x36 on inode 19701465
> bad inode format in inode 19701465
> bad magic number 0x2d30 on inode 19701466
> bad version number 0x30 on inode 19701466
> bad inode format in inode 19701466
> bad magic number 0x302e on inode 19701467
> bad version number 0x31 on inode 19701467
> bad inode format in inode 19701467
> bad magic number 0x2e35 on inode 19701468
> bad version number 0x37 on inode 19701468
> bad inode format in inode 19701468
> bad magic number 0x3330 on inode 19701469
> bad version number 0x38 on inode 19701469
> bad inode format in inode 19701469
> bad magic number 0x3737 on inode 19701470
> bad version number 0x32 on inode 19701470
> bad inode format in inode 19701470
> bad magic number 0x3730 on inode 19701471
> bad version number 0x34 on inode 19701471
> bad inode format in inode 19701471
> bad magic number 0x3039 on inode 19701472
> bad version number 0x39 on inode 19701472
> bad inode format in inode 19701472
> bad magic number 0x3032 on inode 19701473
> bad version number 0x34 on inode 19701473
> bad inode format in inode 19701473
> bad magic number 0x3637 on inode 19701474
> bad version number 0x30 on inode 19701474
> bad inode format in inode 19701474
> bad magic number 0x3134 on inode 19701475
> bad version number 0x32 on inode 19701475
> bad inode format in inode 19701475
> bad magic number 0x3630 on inode 19701476
> bad version number 0x34 on inode 19701476
> bad inode format in inode 19701476
> bad magic number 0x3333 on inode 19701477
> bad version number 0x38 on inode 19701477
> bad inode format in inode 19701477
> bad magic number 0x3638 on inode 19701478
> bad version number 0x30 on inode 19701478
> bad inode format in inode 19701478
> bad magic number 0x3735 on inode 19701479
> bad version number 0x36 on inode 19701479
> bad inode format in inode 19701479
> bad magic number 0x3134 on inode 19701480
> bad version number 0x34 on inode 19701480
> bad inode format in inode 19701480
> bad magic number 0x3635 on inode 19701481
> bad version number 0x20 on inode 19701481
> bad inode format in inode 19701481
> bad magic number 0x3333 on inode 19701482
> bad version number 0x20 on inode 19701482
> bad inode format in inode 19701482
> bad magic number 0x3831 on inode 19701483
> bad version number 0x30 on inode 19701483
> bad inode format in inode 19701483
> bad magic number 0x3020 on inode 19701484
> bad version number 0x20 on inode 19701484
> bad inode format in inode 19701484
> bad magic number 0x2020 on inode 19701485
> bad version number 0x20 on inode 19701485
> bad inode format in inode 19701485
> bad magic number 0x2d30 on inode 19701486
> bad version number 0xa on inode 19701486
> bad inode format in inode 19701486
> bad magic number 0x2020 on inode 19701487
> bad version number 0x20 on inode 19701487
> bad inode format in inode 19701487
> bad magic number 0x2020 on inode 19701488
> bad version number 0x20 on inode 19701488
> bad inode format in inode 19701488
> bad magic number 0x200a on inode 19701489
> bad version number 0x35 on inode 19701489
> bad inode format in inode 19701489
> bad magic number 0xa20 on inode 19701490
> bad version number 0x39 on inode 19701490
> bad inode format in inode 19701490
> bad magic number 0x2020 on inode 19701491
> bad version number 0x2e on inode 19701491
> bad inode format in inode 19701491
> bad magic number 0x2035 on inode 19701492
> bad version number 0x33 on inode 19701492
> bad inode format in inode 19701492
> bad magic number 0x3439 on inode 19701493
> bad version number 0x39 on inode 19701493
> bad inode format in inode 19701493
> bad magic number 0x302e on inode 19701494
> bad version number 0x33 on inode 19701494
> bad inode format in inode 19701494
> bad magic number 0x2e33 on inode 19701495
> bad version number 0x37 on inode 19701495
> bad inode format in inode 19701495
> bad magic number 0x3831 on inode 19701496
> bad version number 0x39 on inode 19701496
> bad inode format in inode 19701496
> bad magic number 0x3935 on inode 19701497
> bad version number 0x35 on inode 19701497
> bad inode format in inode 19701497
> bad magic number 0x3033 on inode 19701498
> bad version number 0x37 on inode 19701498
> bad inode format in inode 19701498
> bad magic number 0x3430 on inode 19701499
> bad version number 0x35 on inode 19701499
> bad inode format in inode 19701499
> bad magic number 0x3737 on inode 19701500
> bad version number 0x31 on inode 19701500
> bad inode format in inode 19701500
> bad magic number 0x3739 on inode 19701501
> bad version number 0x36 on inode 19701501
> bad inode format in inode 19701501
> bad magic number 0x3536 on inode 19701502
> bad version number 0x35 on inode 19701502
> bad inode format in inode 19701502
> bad magic number 0x3639 on inode 19701503
> bad version number 0x34 on inode 19701503
> bad inode format in inode 19701503
> - agno = 3
> - agno = 4
> - agno = 5
> .... removed similar lines
> - agno = 265
> - agno = 266
> - agno = 267
> - process newly discovered inodes...
> Phase 4 - check for duplicate blocks...
> - setting up duplicate extent list...
> - clear lost+found (if it exists) ...
> - clearing existing "lost+found" inode
> - marking entry "lost+found" to be deleted
> - check for inodes claiming duplicate blocks...
> - agno = 0
> - agno = 1
> - agno = 2
> entry "pltfile-9-75" at block 4 offset 2672 in directory inode 16777499
> references non-existent inode 19701440
> clearing inode number in entry at offset 2672...
> entry "nrg-10-75" at block 14 offset 2992 in directory inode 16777499
> references non-existent inode 19701442
> clearing inode number in entry at offset 2992...
> entry "output-10-75" at block 14 offset 4040 in directory inode 16777499
> references non-existent inode 19701441
> clearing inode number in entry at offset 4040...
> entry "pltfile-10-75" at block 15 offset 2024 in directory inode 16777499
> references non-existent inode 19701443
> clearing inode number in entry at offset 2024...
> - agno = 3
> - agno = 4
> - agno = 5
> ... removed lines upto ....
> - agno = 265
> - agno = 266
> - agno = 267
> Phase 5 - rebuild AG headers and trees...
> - reset superblock...
> Phase 6 - check inode connectivity...
> - resetting contents of realtime bitmap and summary inodes
> - ensuring existence of lost+found directory
> - traversing filesystem starting at / ...
> rebuilding directory inode 64
> rebuilding directory inode 16777499
> - traversal finished ...
> - traversing all unattached subtrees ...
> - traversals finished ...
> - moving disconnected inodes to lost+found ...
> Phase 7 - verify and correct link counts...
>
>
> Regards and thanks
>
> Ian Hardy
> Research Services
> Information Systems Services
> Southampton University
|