Johannes Weiner 6b3379e8dc zswap: fix writeback lock ordering for zsmalloc ... Patch series "Implement writeback for zsmalloc", v7. Unlike other zswap allocators such as zbud or z3fold, zsmalloc currently lacks the writeback mechanism. This means that when the zswap pool is full, it will simply reject further allocations, and the pages will be written directly to swap. This series of patches implements writeback for zsmalloc. When the zswap pool becomes full, zsmalloc will attempt to evict all the compressed objects in the least-recently used zspages. This patch (of 6): zswap's customary lock order is tree->lock before pool->lock, because the tree->lock protects the entries' refcount, and the free callbacks in the backends acquire their respective pool locks to dispatch the backing object. zsmalloc's map callback takes the pool lock, so zswap must not grab the tree->lock while a handle is mapped. This currently only happens during writeback, which isn't implemented for zsmalloc. In preparation for it, move the tree->lock section out of the mapped entry section Link: https://lkml.kernel.org/r/20221128191616.1261026-1-nphamcs@gmail.com Link: https://lkml.kernel.org/r/20221128191616.1261026-2-nphamcs@gmail.com Signed-off-by: Johannes Weiner <hannes@cmpxchg.org> Signed-off-by: Nhat Pham <nphamcs@gmail.com> Reviewed-by: Sergey Senozhatsky <senozhatsky@chromium.org> Cc: Dan Streetman <ddstreet@ieee.org> Cc: Minchan Kim <minchan@kernel.org> Cc: Nitin Gupta <ngupta@vflare.org> Cc: Seth Jennings <sjenning@redhat.com> Cc: Vitaly Wool <vitaly.wool@konsulko.com> Signed-off-by: Andrew Morton <akpm@linux-foundation.org>		2022-12-11 18:12:09 -08:00
..
damon	mm/damon: use kstrtobool() instead of strtobool()	2022-11-30 15:58:45 -08:00
kasan	memory: move hotplug memory notifier priority to same file for easy sorting	2022-11-08 17:37:17 -08:00
kfence	mm/kfence: remove hung_task cruft	2022-11-30 15:58:53 -08:00
kmsan	kmsan: core: kmsan_in_runtime() should return true in NMI context	2022-11-08 15:57:24 -08:00
backing-dev.c	mm: add /sys/class/bdi/<bdi>/min_ratio_fine knob	2022-11-30 15:59:06 -08:00
balloon_compaction.c	mm: Convert all PageMovable users to movable_operations	2022-08-02 12:34:03 -04:00
bootmem_info.c	bootmem: remove the vmemmap pages from kmemleak in put_page_bootmem	2022-08-28 14:02:45 -07:00
cma.c	Revert "mm/cma.c: remove redundant cma_mutex lock"	2022-05-13 15:11:26 -07:00
cma.h	mm/cma: provide option to opt out from exposing pages on activation failure	2022-03-22 15:57:09 -07:00
cma_debug.c	mm/cma_debug: show complete cma name in debugfs directories	2022-09-11 20:25:50 -07:00
cma_sysfs.c
compaction.c	mm, compaction: fix fast_isolate_around() to stay within boundaries	2022-11-30 15:59:07 -08:00
debug.c	mm,thp,rmap: simplify compound page mapcount handling	2022-11-30 15:58:46 -08:00
debug_page_ref.c
debug_vm_pgtable.c	mm: remove unused savedwrite infrastructure	2022-11-30 15:58:49 -08:00
dmapool.c
early_ioremap.c	mm/early_ioremap: declare early_memremap_pgprot_adjust()	2022-03-22 15:57:11 -07:00
fadvise.c	riscv: compat: syscall: Add compat_sys_call_table implementation	2022-04-26 13:36:25 -07:00
failslab.c	mm: fix unexpected changes to {failslab|fail_page_alloc}.attr	2022-11-22 18:50:44 -08:00
filemap.c	filemap: find_get_entries() now updates start offset	2022-11-08 17:37:12 -08:00
folio-compat.c	folio-compat: remove try_to_release_page()	2022-11-30 15:59:02 -08:00
frontswap.c	frontswap: don't call ->init if no ops are registered	2022-09-26 12:14:34 -07:00
gup.c	mm/gup: remove FOLL_MIGRATION	2022-12-11 18:12:09 -08:00
gup_test.c	mm/gup_test: start/stop/read functionality for PIN LONGTERM test	2022-11-08 17:37:15 -08:00
gup_test.h	mm/gup_test: start/stop/read functionality for PIN LONGTERM test	2022-11-08 17:37:15 -08:00
highmem.c	highmem: fix kmap_to_page() for kmap_local_page() addresses	2022-10-12 18:51:51 -07:00
hmm.c	mm/swap: add swp_offset_pfn() to fetch PFN from swap entry	2022-09-26 19:46:05 -07:00
huge_memory.c	mm: remove VM_FAULT_WRITE	2022-12-11 18:12:08 -08:00
hugetlb.c	mm/gup: reliable R/O long-term pinning in COW mappings	2022-11-30 15:58:58 -08:00
hugetlb_cgroup.c	mm/hugeltb_cgroup: convert hugetlb_cgroup_commit_charge*() to folios	2022-11-30 15:58:43 -08:00
hugetlb_vmemmap.c	mm/hugetlb_vmemmap: remap head page to newly allocated page	2022-11-30 15:58:47 -08:00
hugetlb_vmemmap.h	mm: hugetlb_vmemmap: improve hugetlb_vmemmap code readability	2022-08-08 18:06:43 -07:00
hwpoison-inject.c	mm/hwpoison: add __init/__exit annotations to module init/exit funcs	2022-10-03 14:03:05 -07:00
init-mm.c	mm: remove rb tree.	2022-09-26 19:46:16 -07:00
internal.h	mm/hwpoison: introduce per-memory_block hwpoison counter	2022-11-08 17:37:22 -08:00
interval_tree.c
io-mapping.c
ioremap.c	mm: ioremap: Add ioremap/iounmap_allowed()	2022-06-27 12:22:31 +01:00
Kconfig	mm: Kconfig: make config SECRETMEM visible with EXPERT	2022-11-30 15:58:56 -08:00
Kconfig.debug	Two followon fixes for the post-5.19 series "Use pageblock_order for cma	2022-05-27 11:40:49 -07:00
khugepaged.c	mm/khugepaged: add tracepoint to collapse_file()	2022-12-11 18:12:09 -08:00
kmemleak.c	mm/kmemleak.c: fix a comment	2022-11-30 15:58:54 -08:00
ksm.c	mm/ksm: convert break_ksm() to use walk_page_range_vma()	2022-12-11 18:12:09 -08:00
list_lru.c	mm: kmem: make mem_cgroup_from_obj() vmalloc()-safe	2022-06-16 19:48:31 -07:00
maccess.c	asm-generic updates for 5.18	2022-03-23 18:03:08 -07:00
madvise.c	mm/madvise: fix madvise_pageout for private file mappings	2022-12-11 18:12:09 -08:00
Makefile	mm: memcontrol: drop dead CONFIG_MEMCG_SWAP config symbol	2022-10-03 14:03:36 -07:00
mapping_dirty_helpers.c
memblock.c	mm: add pageblock_align() macro	2022-10-03 14:03:04 -07:00
memcontrol.c	Merge branch 'mm-hotfixes-stable' into mm-stable	2022-12-09 19:31:11 -08:00
memfd.c	memfd: fix F_SEAL_WRITE after shmem huge page allocated	2022-03-05 11:08:32 -08:00
memory-failure.c	mm/memory-failure.c: cleanup in unpoison_memory	2022-11-30 15:59:08 -08:00
memory-tiers.c	mm/demotion: fix NULL vs IS_ERR checking in memory_tier_init	2022-11-30 15:58:54 -08:00
memory.c	mm: remove VM_FAULT_WRITE	2022-12-11 18:12:08 -08:00
memory_hotplug.c	mm: add pageblock_aligned() macro	2022-10-03 14:03:04 -07:00
mempolicy.c	mm/mempolicy: fix mbind_range() arguments to vma_merge()	2022-10-20 21:27:21 -07:00
mempool.c	mempool: do not use ksize() for poisoning	2022-11-30 15:58:41 -08:00
memremap.c	mm/memremap.c: map FS_DAX device memory as decrypted	2022-11-08 15:57:23 -08:00
memtest.c
migrate.c	mm/migrate.c: stop using 0 as NULL pointer	2022-11-30 15:59:00 -08:00
migrate_device.c	mm/migrate_device: return number of migrating pages in args->cpages	2022-11-22 18:50:43 -08:00
mincore.c	mm: convert find_get_incore_page() to filemap_get_incore_folio()	2022-11-08 17:37:18 -08:00
mlock.c	mm/mlock: drop dead code in count_mm_mlocked_page_nr()	2022-09-26 19:46:27 -07:00
mm_init.c	memory: move hotplug memory notifier priority to same file for easy sorting	2022-11-08 17:37:17 -08:00
mm_slot.h	mm: introduce common struct mm_slot	2022-10-03 14:02:43 -07:00
mmap.c	Merge branch 'mm-hotfixes-stable' into mm-stable	2022-12-09 19:31:11 -08:00
mmap_lock.c
mmu_gather.c	Revert "kmsan: unpoison @tlb in arch_tlb_gather_mmu()"	2022-11-30 15:59:02 -08:00
mmu_notifier.c	mm/mmu_notifier.c: fix race in mmu_interval_notifier_remove()	2022-04-21 20:01:10 -07:00
mmzone.c	mm: multi-gen LRU: groundwork	2022-09-26 19:46:09 -07:00
mprotect.c	mm/autonuma: use can_change_(pte|pmd)_writable() to replace savedwrite	2022-11-30 15:58:49 -08:00
mremap.c	mm: add merging after mremap resize	2022-09-26 19:46:28 -07:00
msync.c	mm/msync: use vma_find() instead of vma linked list	2022-09-26 19:46:25 -07:00
nommu.c	mm: remove the vma linked list	2022-09-26 19:46:26 -07:00
oom_kill.c	mm: reduce noise in show_mem for lowmem allocations	2022-09-26 19:46:29 -07:00
page-writeback.c	mm: add bdi_set_min_ratio_no_scale() function	2022-11-30 15:59:06 -08:00
page_alloc.c	mm/page_alloc: simplify locking during free_unref_page_list	2022-11-30 15:59:01 -08:00
page_counter.c	mm: page_counter: remove unneeded atomic ops for low/min	2022-09-11 20:26:01 -07:00
page_ext.c	Merge branch 'mm-hotfixes-stable' into mm-stable	2022-11-30 14:58:42 -08:00
page_idle.c	mm: don't be stuck to rmap lock on reclaim path	2022-05-19 14:08:54 -07:00
page_io.c	swap: convert swap_writepage() to use a folio	2022-10-03 14:02:52 -07:00
page_isolation.c	mm/page_isolation: fix clang deadcode warning	2022-10-28 13:37:22 -07:00
page_owner.c	mm: reuse pageblock_start/end_pfn() macro	2022-10-03 14:03:03 -07:00
page_poison.c
page_reporting.c
page_reporting.h
page_table_check.c	mm: use kstrtobool() instead of strtobool()	2022-11-30 15:58:45 -08:00
page_vma_mapped.c	mm/swap: add swp_offset_pfn() to fetch PFN from swap entry	2022-09-26 19:46:05 -07:00
pagewalk.c	mm/pagewalk: add walk_page_range_vma()	2022-12-11 18:12:08 -08:00
percpu-internal.h	percpu: improve percpu_alloc_percpu event trace	2022-05-13 07:20:18 -07:00
percpu-km.c
percpu-stats.c	mm: use vmalloc_array and vcalloc for array allocations	2022-03-08 09:30:46 -05:00
percpu-vm.c
percpu.c	mm: percpu: use kmemleak_ignore_phys() instead of kmemleak_free()	2022-07-17 17:14:47 -07:00
pgalloc-track.h
pgtable-generic.c	mm: avoid unnecessary flush on change_huge_pmd()	2022-05-13 07:20:05 -07:00
process_vm_access.c
ptdump.c	mm: pagewalk: Fix race between unmap and page walker	2022-09-03 10:13:13 -07:00
readahead.c	mm: add PSI accounting around ->read_folio and ->readahead calls	2022-09-20 08:24:38 -06:00
rmap.c	mm,thp,rmap: subpages_mapcount COMPOUND_MAPPED if PMD-mapped	2022-11-30 15:58:48 -08:00
rodata_test.c	mm/rodata_test: use PAGE_ALIGNED() helper	2022-10-03 14:03:05 -07:00
secretmem.c	mm/secretmem: remove reduntant return value	2022-10-03 14:03:36 -07:00
shmem.c	Merge branch 'mm-hotfixes-stable' into mm-stable	2022-12-09 19:31:11 -08:00
shrinker_debug.c	mm: shrinkers: fix double kfree on shrinker name	2022-07-29 18:07:13 -07:00
shuffle.c	mm/shuffle: convert module_param_call to module_param_cb	2022-10-03 14:03:07 -07:00
shuffle.h
slab.c	Random number generator fixes for Linux 6.1-rc1.	2022-10-16 15:27:07 -07:00
slab.h	- Yu Zhao's Multi-Gen LRU patches are here. They've been under test in	2022-10-10 17:53:04 -07:00
slab_common.c	- Yu Zhao's Multi-Gen LRU patches are here. They've been under test in	2022-10-10 17:53:04 -07:00
slob.c	Merge branch 'slab/for-6.1/kmalloc_size_roundup' into slab/for-next	2022-09-29 11:30:55 +02:00
slub.c	mm/slub.c: use hotplug_memory_notifier() directly	2022-11-08 17:37:16 -08:00
sparse-vmemmap.c	mm: hugetlb_vmemmap: move vmemmap code related to HugeTLB to hugetlb_vmemmap.c	2022-08-08 18:06:42 -07:00
sparse.c	mm/hwpoison: introduce per-memory_block hwpoison counter	2022-11-08 17:37:22 -08:00
swap.c	mm: teach release_pages() to take an array of encoded page pointers too	2022-11-30 15:58:50 -08:00
swap.h	mm: convert find_get_incore_page() to filemap_get_incore_folio()	2022-11-08 17:37:18 -08:00
swap_cgroup.c	mm: memcontrol: don't allocate cgroup swap arrays when memcg is disabled	2022-10-03 14:03:36 -07:00
swap_slots.c	mm/swap: convert put_swap_page() to put_swap_folio()	2022-10-03 14:02:46 -07:00
swap_state.c	mm: mmu_gather: prepare to gather encoded page pointers with flags	2022-11-30 15:58:50 -08:00
swapfile.c	mm: use pte markers for swap errors	2022-11-30 15:58:46 -08:00
truncate.c	filemap: find_get_entries() now updates start offset	2022-11-08 17:37:12 -08:00
usercopy.c	mm: use kstrtobool() instead of strtobool()	2022-11-30 15:58:45 -08:00
userfaultfd.c	mm/shmem: use page_mapping() to detect page cache for uffd continue	2022-11-08 15:57:23 -08:00
util.c	mm,thp,rmap: simplify compound page mapcount handling	2022-11-30 15:58:46 -08:00
vmalloc.c	mm: vmalloc: use trace_free_vmap_area_noflush event	2022-11-08 17:37:17 -08:00
vmpressure.c
vmscan.c	mm: vmscan: use sysfs_emit() to instead of scnprintf()	2022-11-30 15:59:08 -08:00
vmstat.c	mm: vmscan: split khugepaged stats from direct reclaim stats	2022-11-30 15:58:41 -08:00
workingset.c	mm: vmscan: make rotations a secondary factor in balancing anon vs file	2022-11-08 17:37:11 -08:00
z3fold.c	mm: Convert all PageMovable users to movable_operations	2022-08-02 12:34:03 -04:00
zbud.c
zpool.c	zswap: do not allocate from atomic pool	2022-11-30 15:59:07 -08:00
zsmalloc.c	zram: add size class equals check into recompression	2022-11-30 15:58:52 -08:00
zswap.c	zswap: fix writeback lock ordering for zsmalloc	2022-12-11 18:12:09 -08:00