[Top] [All Lists]

[PATCH-v3 0/6] add support for a lazytime mount option

To: Linux Filesystem Development List <linux-fsdevel@xxxxxxxxxxxxxxx>
Subject: [PATCH-v3 0/6] add support for a lazytime mount option
From: Theodore Ts'o <tytso@xxxxxxx>
Date: Tue, 25 Nov 2014 00:34:28 -0500
Cc: Ext4 Developers List <linux-ext4@xxxxxxxxxxxxxxx>, Linux btrfs Developers List <linux-btrfs@xxxxxxxxxxxxxxx>, XFS Developers <xfs@xxxxxxxxxxx>, Theodore Ts'o <tytso@xxxxxxx>
Delivered-to: xfs@xxxxxxxxxxx
Dkim-signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=thunk.org; s=ef5046eb; h=Message-Id:Date:Subject:Cc:To:From; bh=GdKJLfzY8KjSpmxjKzMcdqx+G6HPHLmi7GKGuO0IO1c=; b=LKih/cRZof5Jd3tqZpDr2Vwx7mmnsw9fNGxLi06O09XE6/OaWoz/lGmIkIZU+vKRSZzDyPIcDgFAecv0wV3kXO1sXzW4eN52LFU0n58r+R115tuY4wEkvtQpOSfDB4QOkjfWtjNCiAob8l/Lg8EDpGWpx4jaQqrbfqZpNb2ni+s=;
This is an updated version of what had originally been an
ext4-specific patch which significantly improves performance by lazily
writing timestamp updates (and in particular, mtime updates) to disk.
The in-memory timestamps are always correct, but they are only written
to disk when required for correctness.

This provides a huge performance boost for ext4 due to how it handles
journalling, but it's valuable for all file systems running on flash
storage or drive-managed SMR disks by reducing the metadata write
load.  So upon request, I've moved the functionality to the VFS layer.
Once the /sbin/mount program adds support for MS_LAZYTIME, all file
systems should be able to benefit from this optimization.

There is still an ext4-specific optimization, which may be applicable
for other file systems which store more than one inode in a block, but
it will require file system specific code.  It is purely optional,

Please note the changes to update_time() and the new write_time() inode
operations functions, which impact btrfs and xfs.  The changes are
fairly simple, but I would appreciate confirmation from the btrfs and
xfs teams that I got things right.   Thanks!!

Any objections to my carrying these patches in the ext4 git tree?

Changes since -v2:
   - If update_time() updates i_version, it will not use lazytime (i..e,
       the inode will be marked dirty so the change will be persisted on to
       disk sooner rather than later).  Yes, this eliminates the
       benefits of lazytime if the user is experting the file system via
       NFSv4.  Sad, but NFS's requirements seem to mandate this.
   - Fix time wrapping bug 49 days after the system boots (on a system
        with a 32-bit jiffies).   Use get_monotonic_boottime() instead.
   - Clean up type warning in include/tracing/ext4.h
   - Added explicit parenthesis for stylistic reasons    
   - Added an is_readonly() inode operations method so btrfs doesn't
       have to duplicate code in update_time().

Changes since -v1:
   - Added explanatory comments in update_time() regarding i_ts_dirty_days
   - Fix type used for days_since_boot
   - Improve SMP scalability in update_time and ext4_update_other_inodes_time
   - Added tracepoints to help test and characterize how often and under
         what circumstances inodes have their timestamps lazily updated

Theodore Ts'o (6):
  fs: split update_time() into update_time() and write_time()
  vfs: add support for a lazytime mount option
  vfs: don't let the dirty time inodes get more than a day stale
  vfs: add lazytime tracepoints for better debugging
  ext4: add support for a lazytime mount option
  btrfs: add an is_readonly() so btrfs can use common code for

 Documentation/filesystems/Locking |  2 +
 fs/btrfs/inode.c                  | 34 +++++++--------
 fs/ext4/inode.c                   | 48 +++++++++++++++++++--
 fs/ext4/super.c                   |  9 ++++
 fs/fs-writeback.c                 | 42 +++++++++++++++++-
 fs/inode.c                        | 91 ++++++++++++++++++++++++++++++++++++++-
 fs/proc_namespace.c               |  1 +
 fs/sync.c                         |  7 +++
 fs/xfs/xfs_iops.c                 | 39 +++++++----------
 include/linux/fs.h                |  7 ++-
 include/trace/events/ext4.h       | 30 +++++++++++++
 include/uapi/linux/fs.h           |  1 +
 12 files changed, 262 insertions(+), 49 deletions(-)


<Prev in Thread] Current Thread [Next in Thread>