Hi all
I
have encountered a problem on RH4 U2 and U3 with mdadm as the volume manager
and XFS as the filesystem. The issue seems to be a max capacity problem that
did not exist on a 64bit RH3 kernel. We were previously running on the ia32e
kernel supplied with CXFS 3.4.6 for Linux. With this Kernel we were able to use
mdadm and a 13TB filesystem with great performance and no capacity issues.
The
configuration has been tested on 2 different platforms and both QLogic and Atto
FC cards as well as RH4U2 and RH4U3. Below if the scenario (what fails and what
doesn’t) as well as the netdump log file.
External 4 Gig FC RAID storage.
8 LUNs of 726 gigs
Mdadm 1.6.0-2
Open src XFS
This failed
External 4 Gig FC RAID storage.
8 LUNs of 726 gigs
Mdadm 2.5.2-1
Open src XFS
This failed
External 4 Gig FC RAID storage.
8 LUNs of 726 gigs
Mdadm 2.5.2-1
CXFS 4.0 version of XFS
This failed
External 4 Gig FC RAID storage.
6 LUNs of 726 gigs
This passes with any version of XFS and
MDADM
If I use XVM and XFS
I can configure the full storage configuration, make a filesystem and run fine.
There is some kind of link between mdadm and XFS that is failing.
Any help would be appreciated.
LOG FILE FROM NETDUMP
Unable to handle kernel paging request at
000001015a441340 RIP:
<ffffffffa0b9fab4>{:raid0:raid0_make_request+444}
PML4 8063 PGD 0
Oops: 0000 [1] SMP
CPU 2
Modules linked in: netconsole netdump raid0
celerityfc(U) wacom(U) sg mvfs(U) vnode(U) nfsd exportfs md5 ipv6 parport_pc lp
parport autofs4 nfs lockd nfs_acl sunrpc ics_sdp(U) ics_offload(U) ipoib(U)
ics_dsc(U) mt25218vpd(U) ibt(U) mst(U) ide_scsi xfs(U) dmapi(U) dm_mirror
dm_mod ohci1394 ieee1394 ohci_hcd0000010071d3db40
<ffffffff8024b0ea>{generic_make_request+355}
<ffffffff80134e7e>{autoremove_wake_function+0}
<ffffffff8024b1f6>{submit_bio+247}
<ffffffff8017c6b8>{bio_alloc+288}
<ffffffff8017a5e6>{submit_bh+255}
<ffffffff8017c115>{block_read_full_page+584}
<ffffffff8017e847>{blkdev_get_block+0}
<ffffffff80159814>{do_generic_mapping_read+567}
<ffffffff801599d4>{file_read_actor+0}
<ffffffff8015af96>{__generic_file_aio_write_nolock+731}
<ffffffff8015b59c>{__generic_file_aio_read+385}
<ffffffff8015b737>{generic_file_read+187}
<ffffffff801e8b09>{__up_read+16} <ffffffff80134e7e>{autoremove_wake_function+0}
<ffffffff80134e7e>{autoremove_wake_function+0}
<ffffffff80191a38>{dnotify_parent+34}
<ffffffff80177f43>{vfs_read+207} <ffffffff80178287>{sys_pread64+86}
<ffffffff80110236>{system_call+126}
Code: 48 8b 14 d0 48 8b 42 28 48 89 43 10 48 03 4a
40 b8 01 00 00
RIP
<ffffffffa0b9fab4>{:raid0:raid0_make_request+444} RSP
<0000010071d3dac8>
CR2: 000001015a441340
Billy Russell
Storage
& Networking Technical Lead
Autodesk – Media
and Entertainment Division
10 rue Duke
Montreal, QC. H3C
2L7
514-954-7377 (office)
billy.russell@xxxxxxxxxxxx