mm: propagate VM_SOFTDIRTY on merge

Patch series "make VM_SOFTDIRTY a sticky VMA flag", v2.

Currently we set VM_SOFTDIRTY when a new mapping is set up (whether by
establishing a new VMA, or via merge) as implemented in __mmap_complete()
and do_brk_flags().

However, when performing a merge of existing mappings such as when
performing mprotect(), we may lose the VM_SOFTDIRTY flag.

Now we have the concept of making VMA flags 'sticky', that is that they
both don't prevent merge and, importantly, are propagated to merged VMAs,
this seems a sensible alternative to the existing special-casing of
VM_SOFTDIRTY.

We additionally add a self-test that demonstrates that this logic behaves
as expected.


This patch (of 2):

Currently we set VM_SOFTDIRTY when a new mapping is set up (whether by
establishing a new VMA, or via merge) as implemented in __mmap_complete()
and do_brk_flags().

However, when performing a merge of existing mappings such as when
performing mprotect(), we may lose the VM_SOFTDIRTY flag.

This is because currently we simply ignore VM_SOFTDIRTY for the purposes
of merge, so one VMA may possess the flag and another not, and whichever
happens to be the target VMA will be the one upon which the merge is
performed which may or may not have VM_SOFTDIRTY set.

Now we have the concept of 'sticky' VMA flags, let's make VM_SOFTDIRTY one
which solves this issue.

Additionally update VMA userland tests to propagate changes.

[akpm@linux-foundation.org: update comments, per Lorenzo]
  Link: https://lkml.kernel.org/r/0019e0b8-ee1e-4359-b5ee-94225cbe5588@lucifer.local
Link: https://lkml.kernel.org/r/cover.1763399675.git.lorenzo.stoakes@oracle.com
Link: https://lkml.kernel.org/r/955478b5170715c895d1ef3b7f68e0cd77f76868.1763399675.git.lorenzo.stoakes@oracle.com
Signed-off-by: Lorenzo Stoakes <lorenzo.stoakes@oracle.com>
Suggested-by: Vlastimil Babka <vbabka@suse.cz>
Acked-by: David Hildenbrand (Red Hat) <david@kernel.org>
Reviewed-by: Pedro Falcato <pfalcato@suse.de>
Acked-by: Andrey Vagin <avagin@gmail.com>
Reviewed-by: Vlastimil Babka <vbabka@suse.cz>
Acked-by: Cyrill Gorcunov <gorcunov@gmail.com>
Cc: Jann Horn <jannh@google.com>
Cc: Liam Howlett <liam.howlett@oracle.com>
Cc: Michal Hocko <mhocko@suse.com>
Cc: Mike Rapoport <rppt@kernel.org>
Cc: Suren Baghdasaryan <surenb@google.com>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
This commit is contained in:
Lorenzo Stoakes
2025-11-17 17:33:38 +00:00
committed by Andrew Morton
parent 6e57c1ce81
commit 6707915e03
2 changed files with 13 additions and 20 deletions

View File

@@ -532,28 +532,27 @@ extern unsigned int kobjsize(const void *objp);
* possesses it but the other does not, the merged VMA should nonetheless have
* applied to it:
*
* VM_SOFTDIRTY - if a VMA is marked soft-dirty, that is has not had its
* references cleared via /proc/$pid/clear_refs, any merged VMA
* should be considered soft-dirty also as it operates at a VMA
* granularity.
*
* VM_MAYBE_GUARD - If a VMA may have guard regions in place it implies that
* mapped page tables may contain metadata not described by the
* VMA and thus any merged VMA may also contain this metadata,
* and thus we must make this flag sticky.
*/
#define VM_STICKY VM_MAYBE_GUARD
#define VM_STICKY (VM_SOFTDIRTY | VM_MAYBE_GUARD)
/*
* VMA flags we ignore for the purposes of merge, i.e. one VMA possessing one
* of these flags and the other not does not preclude a merge.
*
* VM_SOFTDIRTY - Should not prevent from VMA merging, if we match the flags but
* dirty bit -- the caller should mark merged VMA as dirty. If
* dirty bit won't be excluded from comparison, we increase
* pressure on the memory system forcing the kernel to generate
* new VMAs when old one could be extended instead.
*
* VM_STICKY - When merging VMAs, VMA flags must match, unless they are
* 'sticky'. If any sticky flags exist in either VMA, we simply
* set all of them on the merged VMA.
*/
#define VM_IGNORE_MERGE (VM_SOFTDIRTY | VM_STICKY)
#define VM_IGNORE_MERGE VM_STICKY
/*
* Flags which should result in page tables being copied on fork. These are

View File

@@ -122,28 +122,22 @@ extern unsigned long dac_mmap_min_addr;
* possesses it but the other does not, the merged VMA should nonetheless have
* applied to it:
*
* VM_MAYBE_GUARD - If a VMA may have guard regions in place it implies that
* mapped page tables may contain metadata not described by the
* VMA and thus any merged VMA may also contain this metadata,
* and thus we must make this flag sticky.
* VM_SOFTDIRTY - if a VMA is marked soft-dirty, that is has not had its
* references cleared via /proc/$pid/clear_refs, any merged VMA
* should be considered soft-dirty also as it operates at a VMA
* granularity.
*/
#define VM_STICKY VM_MAYBE_GUARD
#define VM_STICKY (VM_SOFTDIRTY | VM_MAYBE_GUARD)
/*
* VMA flags we ignore for the purposes of merge, i.e. one VMA possessing one
* of these flags and the other not does not preclude a merge.
*
* VM_SOFTDIRTY - Should not prevent from VMA merging, if we match the flags but
* dirty bit -- the caller should mark merged VMA as dirty. If
* dirty bit won't be excluded from comparison, we increase
* pressure on the memory system forcing the kernel to generate
* new VMAs when old one could be extended instead.
*
* VM_STICKY - When merging VMAs, VMA flags must match, unless they are
* 'sticky'. If any sticky flags exist in either VMA, we simply
* set all of them on the merged VMA.
*/
#define VM_IGNORE_MERGE (VM_SOFTDIRTY | VM_STICKY)
#define VM_IGNORE_MERGE VM_STICKY
/*
* Flags which should result in page tables being copied on fork. These are