[Top] [All Lists]

Re: 1 Gb Ethernet based HPC storage deployment plan

To: Stan Hoeppner <stan@xxxxxxxxxxxxxxxxx>
Subject: Re: 1 Gb Ethernet based HPC storage deployment plan
From: Lee Eric <openlinuxsource@xxxxxxxxx>
Date: Mon, 25 Jul 2011 22:37:53 +0800
Cc: Emmanuel Florac <eflorac@xxxxxxxxxxxxxx>, xfs@xxxxxxxxxxx
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=Xn/wNMXkXXASY0HBm2Ox1ylW1l88L1XbjUbfAYNB508=; b=P9U9EQ6PNiwsmlNQuabWPigGw/AwVsR2E+Q9yddrSn4Dn+1+HjD3UCLhAch3/4oDYO 64de0wJ8G5Zqo8UVIMo12SI2wmlM9yu8jWPiE8c9AcOuOQXeiS74+FQIemGb4DuNNvNz Kujlq55ieU7DP/++u+0yJRYhtzgP6kMzMu7a8=
In-reply-to: <4E2D767D.3020801@xxxxxxxxxxxxxxxxx>
References: <CAOJJ1Zp821vD0JbGf5PuNGcW4VX4E_3SfcWYxVA4es2o0pyJXQ@xxxxxxxxxxxxxx> <CAOJJ1ZpL89-3xrhJTQgO97AebSSgnmfyM+mah75XOWiyi-wHwQ@xxxxxxxxxxxxxx> <20110723113027.162de009@xxxxxxxxxxxxxx> <4E2BBC00.50902@xxxxxxxxxxxxxxxxx> <CAOJJ1Zod9BgFCOZkav3zYy3k2wR9ohiN0U0R0sr1QdW5CWzV6g@xxxxxxxxxxxxxx> <4E2D767D.3020801@xxxxxxxxxxxxxxxxx>
Thanks Stan. Well, because the size of cluster is not very big so
here's what I considered on its storage deployment. The users home
directory and data will be stored in OpenAFS. And also as I mentioned
in the first thread, 8 SATA disks will be used by using IP SAN to
share with compute nodes.

Some file systems I considered but not sure. Lustre, I know it has
good performance but I just use GigaEther network environment in this
cluster hence I am not pretty sure the performance would be good
seemed only high speed storage connected network can get good result.
GFS2, yeah, I ever heard about some institutes use such distributed
file systems for cluster computing field but still no evidence for its
scalability and performance. So my simple way just to use XFS as
underlayer and export it by using NFS.

For the real workload, I run bioinformatics software actually. They
may write many large or small files as parallel computing to the



On Mon, Jul 25, 2011 at 9:58 PM, Stan Hoeppner <stan@xxxxxxxxxxxxxxxxx> wrote:
> On 7/25/2011 6:52 AM, Lee Eric wrote:
>> Thanks mates. So the typical storage solution for the small size
>> cluster may use IP SAN as I know before. Yes, I can export the data by
>> using NFS directly without iSCSI/AoE but is there any good point to
>> use XFS? I just know XFS is better for parallelized read/write
>> operations in local disks.
>> By the way, is there any good advantage to use XFS as the underlying
>> local filesystem for cluster/distributed/parallel filesystem?
> Narrow down your candidate list of distributed filesystems and read the
> documentation for each of them.  I'd guess that each one of them has a
> recommendation of some sort for the local storage node filesystem and
> the reasoning behind the recommendation.  Given the manner in which most
> of them derive their parallel performance, the local filesystem is
> likely not critical.
> You mentioned an IP SAN.  Have you looked at GFS2 and OCFS?  You haven't
> mentioned a workload.  We could better serve you if you described the
> workload.
> --
> Stan

<Prev in Thread] Current Thread [Next in Thread>