On 5/6/2014 3:09 PM, Dave Chinner wrote:
> On Tue, May 06, 2014 at 03:51:49PM +0200, Emmanuel Florac wrote:
>> Le Tue, 6 May 2014 14:14:35 +0100 (BST)
>> Steve Brooks <steveb@xxxxxxxxxxxxxxxx> écrivait:
>>> Thanks for the reply Emmanuel, I installed and rua bonnie++ although
>>> I will need to research the results
>> Yup, they're... weird :) Write speed is abysmal, but random seeks very
>> high. Please try my settings so that we can compare the numbers more
> Friends don't let friends use bonnie++ for benchmarking storage.
> The numbers you get will be irrelevant to you application, and it's
> so synthetic is doesn't reflect any real-world workload at all.
> The only useful benchmark for determining if changes are going to
> improve application performance is to measure your application's
Exactly. The OP's post begins with:
"After much reading around this is what I came up with... All hosts
have 16x4TB WD RE WD4000FYYZ drives and will run RAID 6...
Stripe-unit size : 512 KB"
That's a 7 MB stripe width. Such a setup is suitable for large
streaming workloads which generate no RMW, and that's about it. For
anything involving random writes the performance will be very low, even
with write cache enabled, because each writeback operation will involve
reading and writing 1.5 MB minimum. Depending on the ARC firmware, if
it does scrubbing, it may read/write 7 MB for each RMW operation.
"Everything begins and ends with the workload".
Describe the workload on each machine, if not all the same, and we'll be
in a far better position to advise what RAID level and stripe unit size
you should use, and how best to configure XFS.
All the best,