Mike Kravetz d8f5f7e445 hugetlb: set hugetlb page flag before optimizing vmemmap ... Currently, vmemmap optimization of hugetlb pages is performed before the hugetlb flag (previously hugetlb destructor) is set identifying it as a hugetlb folio. This means there is a window of time where an ordinary folio does not have all associated vmemmap present. The core mm only expects vmemmap to be potentially optimized for hugetlb and device dax. This can cause problems in code such as memory error handling that may want to write to tail struct pages. There is only one call to perform hugetlb vmemmap optimization today. To fix this issue, simply set the hugetlb flag before that call. There was a similar issue in the free hugetlb path that was previously addressed. The two routines that optimize or restore hugetlb vmemmap should only be passed hugetlb folios/pages. To catch any callers not following this rule, add VM_WARN_ON calls to the routines. In the hugetlb free code paths, some calls could be made to restore vmemmap after clearing the hugetlb flag. This was 'safe' as in these cases vmemmap was already present and the call was a NOOP. However, for consistency these calls where eliminated so that we can add the VM_WARN_ON checks. Link: https://lkml.kernel.org/r/20230829213734.69673-1-mike.kravetz@oracle.com Fixes: f41f2ed43c ("mm: hugetlb: free the vmemmap pages associated with each HugeTLB page") Signed-off-by: Mike Kravetz <mike.kravetz@oracle.com> Reviewed-by: Muchun Song <songmuchun@bytedance.com> Cc: James Houghton <jthoughton@google.com> Cc: Miaohe Lin <linmiaohe@huawei.com> Cc: Michal Hocko <mhocko@suse.com> Cc: Naoya Horiguchi <naoya.horiguchi@linux.dev> Cc: Usama Arif <usama.arif@bytedance.com> Signed-off-by: Andrew Morton <akpm@linux-foundation.org>		2023-10-04 10:32:19 -07:00
..
damon	mm/damon/vaddr-test: fix memory leak in damon_do_test_apply_three_regions()	2023-09-29 17:20:47 -07:00
kasan	kasan: Cleanup the __HAVE_ARCH_SHADOW_MAP usage	2023-09-20 14:26:29 +08:00
kfence	LoongArch changes for v6.6	2023-09-08 12:16:52 -07:00
kmsan	mm: kmsan: use helper macros PAGE_ALIGN and PAGE_ALIGN_DOWN	2023-08-21 13:37:29 -07:00
backing-dev.c	writeback: remove redundant checks for root memcg	2023-08-21 13:37:48 -07:00
balloon_compaction.c
bootmem_info.c
cma.c	dma-maping updates for Linux 6.6	2023-08-29 20:32:10 -07:00
cma.h
cma_debug.c
cma_sysfs.c	mm: cma: make kobj_type structure constant	2023-03-28 16:20:06 -07:00
compaction.c	mm/compaction: factor out code to test if we should run compaction for target order	2023-10-04 10:32:19 -07:00
debug.c	mm: update validate_mm() to use vma iterator	2023-06-09 16:25:31 -07:00
debug_page_alloc.c	mm: page_alloc: split out DEBUG_PAGEALLOC	2023-06-09 16:25:23 -07:00
debug_page_ref.c
debug_vm_pgtable.c	Add x86 shadow stack support	2023-08-31 12:20:12 -07:00
dmapool.c	dmapool: create/destroy cleanup	2023-06-09 16:25:17 -07:00
dmapool_test.c	dmapool: add alloc/free performance test	2023-04-05 19:42:38 -07:00
early_ioremap.c	mm/early_ioremap.c: improve the execution efficiency of early_ioremap_setup()	2023-06-09 16:25:56 -07:00
fadvise.c	mm: remove unnecessary pagevec includes	2023-06-23 16:59:31 -07:00
fail_page_alloc.c	mm: page_alloc: split out FAIL_PAGE_ALLOC	2023-06-09 16:25:23 -07:00
failslab.c
filemap.c	mm: report success more often from filemap_map_folio_range()	2023-09-29 17:20:45 -07:00
folio-compat.c	filemap: Add fgf_t typedef	2023-07-24 18:04:30 -04:00
gup.c	Add x86 shadow stack support	2023-08-31 12:20:12 -07:00
gup_test.c	Merge mm-hotfixes-stable into mm-stable to pick up depended-upon changes.	2023-06-23 16:58:19 -07:00
gup_test.h
highmem.c	mm: ptep_get() conversion	2023-06-19 16:19:25 -07:00
hmm.c	mm: enable page walking API to lock vmas during the walk	2023-08-21 13:07:20 -07:00
huge_memory.c	Add x86 shadow stack support	2023-08-31 12:20:12 -07:00
hugetlb.c	hugetlb: set hugetlb page flag before optimizing vmemmap	2023-10-04 10:32:19 -07:00
hugetlb_cgroup.c	mm/hugetlb: increase use of folios in alloc_huge_page()	2023-02-13 15:54:27 -08:00
hugetlb_vmemmap.c	hugetlb: set hugetlb page flag before optimizing vmemmap	2023-10-04 10:32:19 -07:00
hugetlb_vmemmap.h
hwpoison-inject.c
init-mm.c	mm: move dummy_vm_ops out of a header	2023-08-21 13:37:46 -07:00
internal.h	Add x86 shadow stack support	2023-08-31 12:20:12 -07:00
interval_tree.c
io-mapping.c
ioremap.c	mm: ioremap: remove unneeded ioremap_allowed and iounmap_allowed	2023-08-18 10:12:36 -07:00
Kconfig	- Some swap cleanups from Ma Wupeng ("fix WARN_ON in add_to_avail_list")	2023-08-29 14:25:26 -07:00
Kconfig.debug	mm: page_table_check: Make it dependent on EXCLUSIVE_SYSTEM_RAM	2023-05-29 16:14:28 +01:00
khugepaged.c	- Some swap cleanups from Ma Wupeng ("fix WARN_ON in add_to_avail_list")	2023-08-29 14:25:26 -07:00
kmemleak.c	mm/kmemleak: move up cond_resched() call in page scanning loop	2023-09-02 15:17:34 -07:00
ksm.c	mm: memory-failure: use rcu lock instead of tasklist_lock when collect_procs()	2023-09-05 11:11:52 -07:00
list_lru.c
maccess.c	mm: Fix copy_from_user_nofault().	2023-04-12 17:36:23 -07:00
madvise.c	swap: remove remnants of polling from read_swap_cache_async	2023-08-24 16:20:16 -07:00
Makefile	- Some swap cleanups from Ma Wupeng ("fix WARN_ON in add_to_avail_list")	2023-08-29 14:25:26 -07:00
mapping_dirty_helpers.c	mm: fix clean_record_shared_mapping_range kernel-doc	2023-08-24 16:20:30 -07:00
memblock.c	mm: disable kernelcore=mirror when no mirror memory	2023-08-21 13:37:43 -07:00
memcontrol.c	mm, memcg: reconsider kmem.limit_in_bytes deprecation	2023-09-29 17:20:47 -07:00
memfd.c	revert "memfd: improve userspace warnings for missing exec-related flags".	2023-09-05 11:11:52 -07:00
memory-failure.c	Seven hotfixes. Four are cc:stable and the remainder pertain to issues	2023-09-05 12:22:39 -07:00
memory-tiers.c	memory tier: use helper macro __ATTR_RW()	2023-08-18 10:12:38 -07:00
memory.c	Add x86 shadow stack support	2023-08-31 12:20:12 -07:00
memory_hotplug.c	mm/memory_hotplug: embed vmem_altmap details in memory block	2023-08-21 13:37:49 -07:00
mempolicy.c	mm: mempolicy: keep VMA walk if both MPOL_MF_STRICT and MPOL_MF_MOVE are specified	2023-09-29 17:20:48 -07:00
mempool.c
memremap.c	mm/memremap.c: fix outdated comment in devm_memremap_pages	2023-02-09 16:51:46 -08:00
memtest.c	mm: memtest: convert to memtest_report_meminfo()	2023-08-21 13:37:47 -07:00
migrate.c	mm: hugetlb: add huge page size param to set_huge_pte_at()	2023-09-29 17:20:47 -07:00
migrate_device.c	Add x86 shadow stack support	2023-08-31 12:20:12 -07:00
mincore.c	mm: enable page walking API to lock vmas during the walk	2023-08-21 13:07:20 -07:00
mlock.c	merge mm-hotfixes-stable into mm-stable to pick up depended-upon changes	2023-08-21 14:26:20 -07:00
mm_init.c	mm/mm_init: use helper macro BITS_PER_LONG and BITS_PER_BYTE	2023-08-21 13:37:47 -07:00
mm_slot.h
mmap.c	mm: fix unaccount of memory on vma_link() failure	2023-10-04 10:32:19 -07:00
mmap_lock.c
mmu_gather.c	mm: fix kernel-doc warning from tlb_flush_rmaps()	2023-08-24 16:20:30 -07:00
mmu_notifier.c	mmu_notifiers: rename invalidate_range notifier	2023-08-18 10:12:41 -07:00
mmzone.c
mprotect.c	Add x86 shadow stack support	2023-08-31 12:20:12 -07:00
mremap.c	mm/mremap: fix unaccount of memory on vma_merge() failure	2023-10-04 10:32:19 -07:00
msync.c
nommu.c	Add x86 shadow stack support	2023-08-31 12:20:12 -07:00
oom_kill.c	mm: remove redundant K() macro definition	2023-08-21 13:37:44 -07:00
page-writeback.c	mm: remove folio_account_redirty	2023-08-21 14:52:16 +02:00
page_alloc.c	mm: page_alloc: fix CMA and HIGHATOMIC landing on the wrong buddy list	2023-09-19 13:21:32 -07:00
page_counter.c
page_ext.c	mm/page_ext: move functions around for minor cleanups to page_ext	2023-08-18 10:12:31 -07:00
page_idle.c	mm: page_idle: convert page idle to use a folio	2023-01-18 17:12:52 -08:00
page_io.c	zswap: make zswap_load() take a folio	2023-08-21 13:37:27 -07:00
page_isolation.c	mm/hugetlb: get rid of page_hstate()	2023-08-18 10:12:39 -07:00
page_owner.c	mm/page_ext: use page_ext_data helper in page_owner	2023-08-21 13:37:27 -07:00
page_poison.c	mm/page_poison: remove unused page_ext.h from page_poison	2023-08-21 13:37:30 -07:00
page_reporting.c	mm, treewide: redefine MAX_ORDER sanely	2023-04-05 19:42:46 -07:00
page_reporting.h
page_table_check.c	mm: convert page_table_check_pte_set() to page_table_check_ptes_set()	2023-08-24 16:20:18 -07:00
page_vma_mapped.c	mm: correct stale comment of function check_pte	2023-08-18 10:12:13 -07:00
pagewalk.c	mm/pagewalk: fix bootstopping regression from extra pte_unmap()	2023-09-02 08:39:21 -07:00
percpu-internal.h	percpu-internal/pcpu_chunk: re-layout pcpu_chunk structure to reduce false sharing	2023-06-19 16:19:29 -07:00
percpu-km.c
percpu-stats.c
percpu-vm.c
percpu.c	mm/percpu.c: print error message too if atomic alloc failed	2023-08-25 08:04:59 -07:00
pgalloc-track.h
pgtable-generic.c	mm/pgtable: notes on pte_offset_map[_lock]()	2023-08-18 10:12:25 -07:00
process_vm_access.c	mm/gup: remove unused vmas parameter from pin_user_pages_remote()	2023-06-09 16:25:25 -07:00
ptdump.c	mm: ptdump should use ptep_get_lockless()	2023-06-19 16:19:24 -07:00
readahead.c	filemap: Allow __filemap_get_folio to allocate large folios	2023-07-24 18:04:30 -04:00
rmap.c	mm: hugetlb: add huge page size param to set_huge_pte_at()	2023-09-29 17:20:47 -07:00
rodata_test.c
secretmem.c	mm/secretmem: use a folio in secretmem_fault()	2023-08-21 13:38:02 -07:00
shmem.c	Revert "tmpfs: add support for multigrain timestamps"	2023-09-20 18:05:30 +02:00
shmem_quota.c	shmem: Add default quota limit mount options	2023-08-09 09:15:40 +02:00
show_mem.c	mm,thp: no space after colon in Mem-Info fields	2023-08-21 13:38:01 -07:00
shrinker_debug.c	Revert "mm: shrinkers: make count and scan in shrinker debugfs lockless"	2023-06-19 13:19:34 -07:00
shuffle.c
shuffle.h	mm, treewide: redefine MAX_ORDER sanely	2023-04-05 19:42:46 -07:00
slab.c	Randomized slab caches for kmalloc()	2023-07-18 10:07:47 +02:00
slab.h	Randomized slab caches for kmalloc()	2023-07-18 10:07:47 +02:00
slab_common.c	slab fixes for 6.6-rc4	2023-09-29 12:10:12 -07:00
slub.c	mm/slub: remove freelist_dereference()	2023-07-14 09:57:21 +02:00
sparse-vmemmap.c	mm/vmemmap: allow architectures to override how vmemmap optimization works	2023-08-18 10:12:53 -07:00
sparse.c	mm/sparse: remove redundant judgments from macro for_each_present_section_nr	2023-08-18 10:12:14 -07:00
swap.c	mm: remove references to pagevec	2023-06-23 16:59:30 -07:00
swap.h	swap: remove remnants of polling from read_swap_cache_async	2023-08-24 16:20:16 -07:00
swap_cgroup.c
swap_slots.c
swap_state.c	mm/swap: inline folio_set_swap_entry() and folio_swap_entry()	2023-08-24 16:20:28 -07:00
swapfile.c	mm/swap: inline folio_set_swap_entry() and folio_swap_entry()	2023-08-24 16:20:28 -07:00
truncate.c	- Some swap cleanups from Ma Wupeng ("fix WARN_ON in add_to_avail_list")	2023-08-29 14:25:26 -07:00
usercopy.c	mm: Fix copy_from_user_nofault().	2023-04-12 17:36:23 -07:00
userfaultfd.c	Add x86 shadow stack support	2023-08-31 12:20:12 -07:00
util.c	rcu: dump vmalloc memory info safely	2023-09-05 10:13:45 -07:00
vmalloc.c	mm: hugetlb: add huge page size param to set_huge_pte_at()	2023-09-29 17:20:47 -07:00
vmpressure.c	net-memcg: Fix scope of sockmem pressure indicators	2023-08-16 12:21:32 +01:00
vmscan.c	mm/swap: inline folio_set_swap_entry() and folio_swap_entry()	2023-08-24 16:20:28 -07:00
vmstat.c	mm/vmstat: remove unused page_ext.h from vmstat	2023-08-21 13:37:30 -07:00
workingset.c	mm: memcg: use rstat for non-hierarchical stats	2023-08-24 16:20:18 -07:00
z3fold.c	mm/z3fold: remove obsolete comment for struct z3fold_pool	2023-08-21 13:37:51 -07:00
zbud.c	mm: zswap: remove shrink from zpool interface	2023-06-19 16:19:27 -07:00
zpool.c	mm: zswap: remove shrink from zpool interface	2023-06-19 16:19:27 -07:00
zsmalloc.c	merge mm-hotfixes-stable into mm-stable to pick up depended-upon changes	2023-08-21 14:26:20 -07:00
zswap.c	mm: zswap: fix potential memory corruption on duplicate store	2023-09-29 17:20:47 -07:00