[Top] [All Lists]

Re: 128TB filesystem limit?

To: Eric Sandeen <sandeen@xxxxxxxxxxx>
Subject: Re: 128TB filesystem limit?
From: david@xxxxxxx
Date: Thu, 25 Mar 2010 21:56:41 -0700 (PDT)
Cc: Dave Chinner <david@xxxxxxxxxxxxx>, xfs@xxxxxxxxxxx
In-reply-to: <4BAC3990.30403@xxxxxxxxxxx>
References: <alpine.DEB.2.00.1003251609160.12435@xxxxxxxxxxxxxx> <20100325235433.GM3335@dastard> <alpine.DEB.2.00.1003251702190.12435@xxxxxxxxxxxxxx> <20100326003511.GN3335@dastard> <alpine.DEB.2.00.1003251900110.12435@xxxxxxxxxxxxxx> <4BAC3990.30403@xxxxxxxxxxx>
User-agent: Alpine 2.00 (DEB 1167 2008-08-23)
On Thu, 25 Mar 2010, Eric Sandeen wrote:

david@xxxxxxx wrote:
On Fri, 26 Mar 2010, Dave Chinner wrote:


Is there any reason for putting partitions on these block devices?
You could just use the block devices without partitions, and that
will avoid alignment potential problems....

I would like to raid to auto-assemble and I can't do that without
partitions, can I

I think you can.... it's not like MD is putting anything in the partition
table; you just give it block devices, I doubt it cares if it's a whole
disk or some partition.

Worth a check anyway ;)

I know that md will work on raw devices, but the auto-assembly stuff looks for the right partition type, I would have to maintain a conf file across potential system rebuilds if I used the raw partitions.


the next fun thing is figuring out what sort of stride, etc parameters I
should have used for this filesystem.

mkfs.xfs should suss that out for you automatically based on talking to md;
of course you'd want to configure md to line up well with the hardware

in this case md thinks it's working with 10 12.8TB drives, I really doubt that it's going to do the right thing.

I'm not exactly sure what the right thing is in this case. the hardware raid is useing 64K chunks across 16 drives (so 14 * 64K worth of data per stripe), but there are 10 of these stripes before you get back to hitting the same drive again.

David Lang

<Prev in Thread] Current Thread [Next in Thread>