Search String: Display: Description: Sort:

Results:

References: [ +subject:/^(?:^\s*(re|sv|fwd|fw)[\[\]\d]*[:>-]+\s*)*Performance\s+problem\s+\-\s+reads\s+slower\s+than\s+writes\s*$/: 30 ]

Total 30 documents matching your query.

1. Performance problem - reads slower than writes (score: 1)
Author: Brian Candler <B.Candler@xxxxxxxxx>
Date: Mon, 30 Jan 2012 22:00:19 +0000
I am doing some performance testing of XFS. I am using Ubuntu 11.10 amd64 (server), on an i3-2130 (3.4GHz) with 8GB RAM. This will eventually run with a bunch of Hitachi 3TB Deskstar drives, but the
/archives/xfs/2012-01/msg00478.html (18,550 bytes)

2. Re: Performance problem - reads slower than writes (score: 1)
Author: Dave Chinner <david@xxxxxxxxxxxxx>
Date: Tue, 31 Jan 2012 13:05:08 +1100
Write order is different to read order, and read performance is sensitive to cache hit rates and IO latency. When you working set is larger than memory (which is definitely true here), read performan
/archives/xfs/2012-01/msg00482.html (14,304 bytes)

3. Re: Performance problem - reads slower than writes (score: 1)
Author: Brian Candler <B.Candler@xxxxxxxxx>
Date: Tue, 31 Jan 2012 10:31:26 +0000
Absolutely. It's reading the entire files - I had grepped out the read(...) = 8192 lines so that the stat/open/read/close pattern could be seen. Yes it does. The particular application I'm tuning for
/archives/xfs/2012-01/msg00487.html (14,133 bytes)

4. Re: Performance problem - reads slower than writes (score: 1)
Author: Brian Candler <B.Candler@xxxxxxxxx>
Date: Tue, 31 Jan 2012 14:16:04 +0000
Updates: (1) The bug in bonnie++ is to do with memory allocation, and you can work around it by putting '-n' before '-s' on the command line and using the same custom chunk size before both (or by us
/archives/xfs/2012-01/msg00491.html (13,315 bytes)

5. Re: Performance problem - reads slower than writes (score: 1)
Author: Christoph Hellwig <hch@xxxxxxxxxxxxx>
Date: Tue, 31 Jan 2012 09:52:05 -0500
You don't just read a single file at a time but multiple ones, don't you? Try playing with the following tweaks to get larger I/O to the disk: a) make sure you use the noop or deadline elevators b) i
/archives/xfs/2012-01/msg00492.html (9,119 bytes)

6. Re: Performance problem - reads slower than writes (score: 1)
Author: Dave Chinner <david@xxxxxxxxxxxxx>
Date: Wed, 1 Feb 2012 07:06:35 +1100
You forgot the directory IO. If you've got enough entries in the directory to push it out to leaf/node format, then it could certainly take 3-4 IOs just to find the directory entry you are looking fo
/archives/xfs/2012-01/msg00502.html (15,705 bytes)

7. Re: Performance problem - reads slower than writes (score: 1)
Author: Dave Chinner <david@xxxxxxxxxxxxx>
Date: Wed, 1 Feb 2012 07:25:26 +1100
Right, because it is doing buffered IO and reading and writing into the page cache for small Io sizes is much faster than waiting for physical IO. Hence there is much less of a penalty for small buff
/archives/xfs/2012-01/msg00503.html (14,837 bytes)

8. Re: Performance problem - reads slower than writes (score: 1)
Author: Brian Candler <B.Candler@xxxxxxxxx>
Date: Tue, 31 Jan 2012 21:35:22 +0000
Ah. And if the IOs are not stacked up, then the platter has to rotate nearly a whole turn to perform the next one. Excellent, just what I wanted. I've made a start with this and will report back. Man
/archives/xfs/2012-01/msg00506.html (10,473 bytes)

9. Re: Performance problem - reads slower than writes (score: 1)
Author: Brian Candler <brian@xxxxxxxxxxxxxx>
Date: Tue, 31 Jan 2012 21:52:10 +0000
It's sequential at the moment, although I'll do further tests with the -c (concurrency) option to bonnie++ Thank you very much: I will do further tests with these. Is the read_ahead_kb knob aware of
/archives/xfs/2012-01/msg00511.html (9,999 bytes)

10. Re: Performance problem - reads slower than writes (score: 1)
Author: Raghavendra D Prabhu <raghu.prabhu13@xxxxxxxxx>
Date: Wed, 1 Feb 2012 06:20:57 +0530
Hi, * On Tue, Jan 31, 2012 at 09:52:10PM +0000, Brian Candler <brian@xxxxxxxxxxxxxx> wrote: On Tue, Jan 31, 2012 at 09:52:05AM -0500, Christoph Hellwig wrote: You don't just read a single file at a t
/archives/xfs/2012-01/msg00522.html (12,916 bytes)

11. Re: Performance problem - reads slower than writes (score: 1)
Author: Dave Chinner <david@xxxxxxxxxxxxx>
Date: Wed, 1 Feb 2012 14:59:15 +1100
Yes, readahead only occurs within the file, and won't readahead past EOF. Cheers, Dave. -- Dave Chinner david@xxxxxxxxxxxxx
/archives/xfs/2012-01/msg00524.html (10,235 bytes)

12. Re: Performance problem - reads slower than writes (score: 1)
Author: Stan Hoeppner <stan@xxxxxxxxxxxxxxxxx>
Date: Wed, 01 Feb 2012 01:29:30 -0600
Yeah, the voice coil actuator and spindle rotation limits the peak random seek rate of good 7.2k drive/controller combos to about 150/s. 15k drives do about 250-300 seeks/s max. Simple tool to test m
/archives/xfs/2012-02/msg00000.html (9,124 bytes)

13. Re: Performance problem - reads slower than writes (score: 1)
Author: Brian Candler <B.Candler@xxxxxxxxx>
Date: Fri, 3 Feb 2012 11:54:34 +0000
The default settings on this system are: noop [deadline] cfq (I think the one in brackets is the active one) 512 128 I did a series of tests where I increased either or both of those to 1024, but it
/archives/xfs/2012-02/msg00062.html (16,940 bytes)

14. Re: Performance problem - reads slower than writes (score: 1)
Author: Brian Candler <B.Candler@xxxxxxxxx>
Date: Fri, 3 Feb 2012 18:47:23 +0000
I've done a whole bunch of testing, which I won't describe in detail unless you're interested, but I've finally found out what's causing the sudden change in performance. With defaults, the files in
/archives/xfs/2012-02/msg00076.html (15,148 bytes)

15. Re: Performance problem - reads slower than writes (score: 1)
Author: Christoph Hellwig <hch@xxxxxxxxxxxxx>
Date: Fri, 3 Feb 2012 14:03:04 -0500
Not sure if you mentioned it somewhere before, but: a) how large is the filesystem? b) do use the inode64 mount option c) can you see the same good behaviour when using inode64 and small inodes (not
/archives/xfs/2012-02/msg00078.html (16,644 bytes)

16. Re: Performance problem - reads slower than writes (score: 1)
Author: Stan Hoeppner <stan@xxxxxxxxxxxxxxxxx>
Date: Fri, 03 Feb 2012 13:42:54 -0600
3TB, 32MB cache, 5940 RPM You stated you're writing 100,000 of these files across 1,000 directories, with Bonnie, then reading them back with dd in your custom script. You state this is similar to yo
/archives/xfs/2012-02/msg00079.html (10,616 bytes)

17. Re: Performance problem - reads slower than writes (score: 1)
Author: Brian Candler <B.Candler@xxxxxxxxx>
Date: Fri, 3 Feb 2012 21:01:14 +0000
3TB. No: the only mount options I've given are noatime,nodiratime. I created a fresh filesystem (/dev/sdh), default parameters, but mounted it with inode64. Then I tar'd across my corpus of 100K file
/archives/xfs/2012-02/msg00082.html (16,026 bytes)

18. Re: Performance problem - reads slower than writes (score: 1)
Author: Brian Candler <B.Candler@xxxxxxxxx>
Date: Fri, 3 Feb 2012 21:17:41 +0000
Although perversely, keeping all the inodes at one end of the disk does increase throughput with random reads, and also under high concurrency loads (for this corpus of ~65GB anyway, maybe not true f
/archives/xfs/2012-02/msg00083.html (11,605 bytes)

19. Re: Performance problem - reads slower than writes (score: 1)
Author: Brian Candler <B.Candler@xxxxxxxxx>
Date: Fri, 3 Feb 2012 22:10:15 +0000
Thanks for your suggestion, but unfortunately your maths isn't correct: 20M x 0.65MB = 13TB. And that's just one of many possible datasets like this. I'm aware that I'm working with low-performance d
/archives/xfs/2012-02/msg00086.html (10,641 bytes)

20. Re: Performance problem - reads slower than writes (score: 1)
Author: Stan Hoeppner <stan@xxxxxxxxxxxxxxxxx>
Date: Sat, 04 Feb 2012 03:59:08 -0600
Wow, you're right. How did I miss so many zeros? Got in hurry I guess. SSDs would fulfill criteria 1/2 but obviously not 3/4. Will you be using mdraid or hardware RAID across those 24 spindles? -- St
/archives/xfs/2012-02/msg00094.html (11,091 bytes)


This search system is powered by Namazu