Matthew Wilcox (Oracle) f9bff0e318 minmax: add in_range() macro ... Patch series "New page table range API", v6. This patchset changes the API used by the MM to set up page table entries. The four APIs are: set_ptes(mm, addr, ptep, pte, nr) update_mmu_cache_range(vma, addr, ptep, nr) flush_dcache_folio(folio) flush_icache_pages(vma, page, nr) flush_dcache_folio() isn't technically new, but no architecture implemented it, so I've done that for them. The old APIs remain around but are mostly implemented by calling the new interfaces. The new APIs are based around setting up N page table entries at once. The N entries belong to the same PMD, the same folio and the same VMA, so ptep++ is a legitimate operation, and locking is taken care of for you. Some architectures can do a better job of it than just a loop, but I have hesitated to make too deep a change to architectures I don't understand well. One thing I have changed in every architecture is that PG_arch_1 is now a per-folio bit instead of a per-page bit when used for dcache clean/dirty tracking. This was something that would have to happen eventually, and it makes sense to do it now rather than iterate over every page involved in a cache flush and figure out if it needs to happen. The point of all this is better performance, and Fengwei Yin has measured improvement on x86. I suspect you'll see improvement on your architecture too. Try the new will-it-scale test mentioned here: https://lore.kernel.org/linux-mm/20230206140639.538867-5-fengwei.yin@intel.com/ You'll need to run it on an XFS filesystem and have CONFIG_TRANSPARENT_HUGEPAGE set. This patchset is the basis for much of the anonymous large folio work being done by Ryan, so it's received quite a lot of testing over the last few months. This patch (of 38): Determine if a value lies within a range more efficiently (subtraction + comparison vs two comparisons and an AND). It also has useful (under some circumstances) behaviour if the range exceeds the maximum value of the type. Convert all the conflicting definitions of in_range() within the kernel; some can use the generic definition while others need their own definition. Link: https://lkml.kernel.org/r/20230802151406.3735276-1-willy@infradead.org Link: https://lkml.kernel.org/r/20230802151406.3735276-2-willy@infradead.org Signed-off-by: Matthew Wilcox (Oracle) <willy@infradead.org> Signed-off-by: Andrew Morton <akpm@linux-foundation.org>		2023-08-24 16:20:18 -07:00
..
842	…
crypto	This update includes the following changes:	2023-06-30 21:27:13 -07:00
dim	linux/dim: Do nothing if no time delta between samples	2023-05-09 11:06:45 +02:00
fonts	…
kunit	- Arnd Bergmann has fixed a bunch of -Wmissing-prototypes in	2023-06-28 10:59:38 -07:00
livepatch	…
lz4	…
lzo	…
math	…
mpi	lib/mpi: Fix buffer overrun when SG is too long	2023-01-06 17:15:46 +08:00
pldmfw	lib: remove MODULE_LICENSE in non-modules	2023-04-13 13:13:53 -07:00
raid6	raid6: neon: add missing prototypes	2023-06-13 15:13:20 -07:00
reed_solomon	…
test_fortify	…
vdso	vdso: Improve cmd_vdso_check to check all dynamic relocations	2023-03-21 21:15:34 +01:00
xz	…
zlib_deflate	lib/zlib: DFLTCC deflate does not write all available bits for Z_NO_FLUSH	2023-02-27 17:00:14 -08:00
zlib_dfltcc	lib/zlib: remove redundation assignement of avail_in dfltcc_gdht()	2023-02-02 22:50:10 -08:00
zlib_inflate	lib/zlib: Split deflate and inflate states for DFLTCC	2023-02-02 22:50:09 -08:00
zstd	add intptr_t	2023-06-09 17:44:13 -07:00
.gitignore	…
Kconfig	Kconfig: introduce HAS_IOPORT option and select it as necessary	2023-04-05 22:15:19 +02:00
Kconfig.debug	hardening fixes for v6.5-rc1	2023-07-08 12:08:39 -07:00
Kconfig.kasan	kasan: treat meminstrinsic as builtins in uninstrumented files	2023-03-02 21:54:22 -08:00
Kconfig.kcsan	Kernel concurrency sanitizer (KCSAN) updates for v6.3	2023-02-25 13:02:20 -08:00
Kconfig.kfence	…
Kconfig.kgdb	…
Kconfig.kmsan	…
Kconfig.ubsan	ubsan: remove cc-option test for UBSAN_TRAP	2023-05-17 12:01:54 -07:00
Makefile	- Yosry Ahmed brought back some cgroup v1 stats in OOM logs.	2023-06-28 10:28:11 -07:00
argv_split.c	…
ashldi3.c	…
ashrdi3.c	…
asn1_decoder.c	…
asn1_encoder.c	…
assoc_array.c	…
atomic64.c	…
atomic64_test.c	…
audit.c	…
base64.c	…
bcd.c	…
bch.c	…
bitfield_kunit.c	…
bitmap.c	lib/bitmap: drop optimization of bitmap_{from,to}_arr64	2023-06-22 13:57:41 -07:00
bitrev.c	…
bootconfig-data.S	…
bootconfig.c	…
bsearch.c	…
btree.c	btree: remove MODULE_LICENSE in non-modules	2023-04-13 13:13:54 -07:00
bucket_locks.c	…
bug.c	cpuidle: lib/bug: Disable rcu_is_watching() during WARN/BUG	2023-01-31 15:01:45 +01:00
build_OID_registry	…
buildid.c	ELF: fix all "Elf" typos	2023-04-08 13:45:37 -07:00
bust_spinlocks.c	…
check_signature.c	…
checksum.c	…
checksum_kunit.c	x86/csum: Improve performance of `csum_partial`	2023-05-25 10:55:18 -07:00
clz_ctz.c	…
clz_tab.c	…
cmdline.c	…
cmdline_kunit.c	…
cmpdi2.c	…
compat_audit.c	…
cpu_rmap.c	lib: cpu_rmap: Fix potential use-after-free in irq_cpu_rmap_release()	2023-06-07 21:25:00 -07:00
cpumask.c	cpumask: fix function description kernel-doc notation	2023-06-22 13:57:41 -07:00
cpumask_kunit.c	cpumask: re-introduce constant-sized cpumask optimizations	2023-03-05 14:30:34 -08:00
crc-ccitt.c	…
crc-itu-t.c	…
crc-t10dif.c	…
crc4.c	…
crc7.c	…
crc8.c	…
crc16.c	…
crc32.c	…
crc32defs.h	…
crc32test.c	…
crc64-rocksoft.c	…
crc64.c	…
ctype.c	…
debug_info.c	…
debug_locks.c	…
debugobjects.c	debugobjects: Recheck debug_objects_enabled before reporting	2023-06-07 14:16:12 +02:00
dec_and_lock.c	perf: Fix perf_event_pmu_context serialization	2023-01-31 20:37:18 +01:00
decompress.c	…
decompress_bunzip2.c	…
decompress_inflate.c	decompressor: provide missing prototypes	2023-06-09 17:44:17 -07:00
decompress_unlz4.c	…
decompress_unlzma.c	…
decompress_unlzo.c	…
decompress_unxz.c	decompressor: provide missing prototypes	2023-06-09 17:44:17 -07:00
decompress_unzstd.c	decompressor: provide missing prototypes	2023-06-09 17:44:17 -07:00
devmem_is_allowed.c	lib: devmem_is_allowed: include linux/io.h	2023-06-09 17:44:15 -07:00
devres.c	devres: show which resource was invalid in __devm_ioremap_resource()	2023-06-23 17:04:04 -07:00
dhry.h	lib: add Dhrystone benchmark test	2023-02-02 22:50:01 -08:00
dhry_1.c	lib: dhry: fix sleeping allocations inside non-preemptable section	2023-07-08 09:29:32 -07:00
dhry_2.c	lib: add Dhrystone benchmark test	2023-02-02 22:50:01 -08:00
dhry_run.c	lib: dhry: fix unstable smp_processor_id(_) usage	2023-03-23 17:18:35 -07:00
digsig.c	…
dump_stack.c	…
dynamic_debug.c	dyndbg: use the module notifier callbacks	2023-03-09 12:58:36 -08:00
dynamic_queue_limits.c	…
earlycpio.c	…
errname.c	printf: fix errname.c list	2023-02-15 15:44:43 +01:00
error-inject.c	error-injection: remove EI_ETYPE_NONE	2023-02-02 22:50:00 -08:00
errseq.c	…
extable.c	…
fault-inject-usercopy.c	…
fault-inject.c	fault-inject: allow configuration via configfs	2023-04-13 07:38:54 -06:00
fdt.c	…
fdt_addresses.c	…
fdt_empty_tree.c	…
fdt_ro.c	…
fdt_rw.c	…
fdt_strerror.c	…
fdt_sw.c	…
fdt_wip.c	…
find_bit.c	cpumask: introduce for_each_cpu_or	2023-03-19 10:02:04 -07:00
find_bit_benchmark.c	…
flex_proportions.c	…
fortify_kunit.c	Revert "fortify: Allow KUnit test to build without FORTIFY"	2023-07-03 12:50:26 -07:00
gen_crc32table.c	…
gen_crc64table.c	…
genalloc.c	misc/genalloc: Name subpools by of_node_full_name()	2023-07-26 09:45:01 +02:00
generic-radix-tree.c	…
glob.c	…
globtest.c	…
group_cpus.c	lib/group_cpus: Export group_cpus_evenly()	2023-04-21 03:02:31 -04:00
hashtable_test.c	lib/hashtable_test.c: add test for the hashtable structure	2023-02-08 14:28:17 -07:00
hexdump.c	…
hweight.c	…
idr.c	…
inflate.c	…
interval_tree.c	…
interval_tree_test.c	…
iomap.c	…
iomap_copy.c	…
iommu-helper.c	…
iov_iter.c	iov_iter: Mark copy_iovec_from_user() noclone	2023-07-10 09:52:28 +02:00
irq_poll.c	…
irq_regs.c	…
is_signed_type_kunit.c	…
is_single_threaded.c	…
kasprintf.c	…
kfifo.c	…
klist.c	…
kobject.c	kobject: Use return value of strreplace()	2023-06-05 15:31:12 -07:00
kobject_uevent.c	…
kstrtox.c	…
kstrtox.h	…
libcrc32c.c	libcrc32c: remove crc32c_impl	2023-04-17 18:01:23 +02:00
linear_ranges.c	…
list-test.c	list: test: Test the klist structure	2023-03-31 09:21:35 -06:00
list_debug.c	…
list_sort.c	…
llist.c	…
locking-selftest-hardirq.h	…
locking-selftest-mutex.h	…
locking-selftest-rlock-hardirq.h	…
locking-selftest-rlock-softirq.h	…
locking-selftest-rlock.h	…
locking-selftest-rsem.h	…
locking-selftest-rtmutex.h	…
locking-selftest-softirq.h	…
locking-selftest-spin-hardirq.h	…
locking-selftest-spin-softirq.h	…
locking-selftest-spin.h	…
locking-selftest-wlock-hardirq.h	…
locking-selftest-wlock-softirq.h	…
locking-selftest-wlock.h	…
locking-selftest-wsem.h	…
locking-selftest.c	…
lockref.c	lockref: stop doing cpu_relax in the cmpxchg loop	2023-01-13 14:35:38 -06:00
logic_iomem.c	…
logic_pio.c	minmax: add in_range() macro	2023-08-24 16:20:18 -07:00
lru_cache.c	…
lshrdi3.c	…
maple_tree.c	merge mm-hotfixes-stable into mm-stable to pick up depended-upon changes	2023-08-24 15:25:56 -07:00
memcat_p.c	…
memcpy_kunit.c	kunit: memcpy: Split slow memcpy tests into MEMCPY_SLOW_KUNIT_TEST	2023-01-25 12:24:40 -08:00
memory-notifier-error-inject.c	…
memregion.c	…
memweight.c	…
muldi3.c	…
net_utils.c	mac_pton: Clean up the header inclusions	2023-06-06 13:18:32 +02:00
netdev-notifier-error-inject.c	…
nlattr.c	netlink: prevent potential spectre v1 gadgets	2023-01-20 17:52:32 -08:00
nmi_backtrace.c	x86/nmi: Print reasons why backtrace NMIs are ignored	2023-01-19 15:55:12 -08:00
notifier-error-inject.c	…
notifier-error-inject.h	…
objagg.c	…
of-reconfig-notifier-error-inject.c	…
oid_registry.c	…
once.c	…
overflow_kunit.c	overflow: Add struct_size_t() helper	2023-05-26 13:52:19 -07:00
packing.c	lib: packing: remove MODULE_LICENSE in non-modules	2023-03-09 23:08:04 -08:00
parman.c	…
parser.c	lib: parser: update documentation for match_NUMBER functions	2023-03-02 21:54:22 -08:00
pci_iomap.c	…
percpu-refcount.c	…
percpu_counter.c	pcpcntr: remove percpu_counter_sum_all()	2023-03-19 10:02:04 -07:00
percpu_test.c	…
plist.c	…
pm-notifier-error-inject.c	…
polynomial.c	…
radix-tree.c	radix tree: remove unused variable	2023-08-21 13:07:22 -07:00
radix-tree.h	radix-tree: move declarations to header	2023-06-12 11:31:50 -07:00
random32.c	…
ratelimit.c	…
rbtree.c	lib/rbtree: use '+' instead of '|' for setting color.	2023-04-18 16:39:33 -07:00
rbtree_test.c	…
rcuref.c	atomics: Provide rcuref - scalable reference counting	2023-03-28 10:39:29 +02:00
ref_tracker.c	lib/ref_tracker: remove warnings in case of allocation failure	2023-06-05 15:28:42 -07:00
refcount.c	…
rhashtable.c	…
sbitmap.c	sbitmap: fix batching wakeup	2023-07-21 11:40:20 -06:00
scatterlist.c	crypto, cifs: fix error handling in extract_iter_to_sg()	2023-08-04 13:03:40 -07:00
seq_buf.c	seq_buf: Add seq_buf_do_printk() helper	2023-04-25 21:03:14 -04:00
sg_pool.c	…
sg_split.c	…
siphash.c	…
siphash_kunit.c	…
slub_kunit.c	…
smp_processor_id.c	…
sort.c	…
stackdepot.c	lib/stackdepot: kmsan: mark API outputs as initialized	2023-03-28 16:20:13 -07:00
stackinit_kunit.c	kernel/range: Uplevel the cxl subsystem's range_contains() helper	2023-02-10 17:32:37 -08:00
stmp_device.c	…
strcat_kunit.c	string: Add Kunit tests for strcat() family	2023-05-16 14:08:02 -07:00
string.c	string: use __builtin_memcpy() in strlcpy/strlcat	2023-06-01 11:24:50 -07:00
string_helpers.c	lib/string_helpers: Change returned value of the strreplace()	2023-06-05 15:31:12 -07:00
strncpy_from_user.c	…
strnlen_user.c	…
strscpy_kunit.c	…
syscall.c	…
test-kstrtox.c	…
test-string_helpers.c	lib/test-string_helpers: replace UNESCAPE_ANY by UNESCAPE_ALL_MASK	2023-04-08 13:45:39 -07:00
test_bitmap.c	lib/test_bitmap: increment failure counter properly	2023-06-22 13:57:41 -07:00
test_bitops.c	…
test_bits.c	…
test_blackhole_dev.c	…
test_bpf.c	bpf/tests: Use struct_size()	2023-05-31 12:58:38 +02:00
test_debug_virtual.c	…
test_dynamic_debug.c	…
test_firmware.c	test_firmware: return ENOMEM instead of ENOSPC on failed memory allocation	2023-06-15 13:42:18 +02:00
test_fprobe.c	fprobe: Pass return address to the handlers	2023-06-06 21:39:55 +09:00
test_fpu.c	…
test_free_pages.c	…
test_hash.c	…
test_hexdump.c	…
test_hmm.c	…
test_hmm_uapi.h	…
test_ida.c	…
test_kmod.c	test_kmod: stop kernel-doc warnings	2023-01-25 14:07:21 -08:00
test_kprobes.c	test_kprobes: Add recursed kprobe test case	2023-02-21 08:52:42 +09:00
test_linear_ranges.c	…
test_list_sort.c	…
test_lockup.c	…
test_maple_tree.c	maple_tree: add benchmarking for mas_prev()	2023-08-18 10:12:47 -07:00
test_memcat_p.c	…
test_meminit.c	lib/test_meminit: allocate pages up to order MAX_ORDER	2023-08-18 10:12:32 -07:00
test_min_heap.c	…
test_module.c	…
test_objagg.c	…
test_parman.c	…
test_printf.c	mm, printk: introduce new format %pGt for page_type	2023-03-28 16:20:09 -07:00
test_ref_tracker.c	lib/ref_tracker: improve printing stats	2023-06-05 15:28:42 -07:00
test_rhashtable.c	…
test_scanf.c	…
test_sort.c	…
test_static_key_base.c	…
test_static_keys.c	…
test_string.c	…
test_sysctl.c	test_sysclt: Test for registering a mount point	2023-06-18 02:32:54 -07:00
test_ubsan.c	…
test_user_copy.c	…
test_uuid.c	…
test_vmalloc.c	lib/test_vmalloc.c: avoid garbage in page array	2023-06-12 11:31:51 -07:00
test_xarray.c	…
textsearch.c	…
timerqueue.c	…
trace_readwrite.c	…
ts_bm.c	lib/ts_bm: reset initial match offset for every block of text	2023-06-26 13:26:39 +02:00
ts_fsm.c	…
ts_kmp.c	…
ubsan.c	ubsan: add prototypes for internal functions	2023-05-30 16:42:01 -07:00
ubsan.h	ubsan: add prototypes for internal functions	2023-05-30 16:42:01 -07:00
ucmpdi2.c	…
ucs2_string.c	…
usercopy.c	uaccess: Add speculation barrier to copy_from_user()	2023-02-21 14:45:22 -08:00
uuid.c	…
vsprintf.c	- Nick Piggin's "shoot lazy tlbs" series, to improve the peformance of	2023-04-27 19:42:02 -07:00
win_minmax.c	lib/win_minmax: use /* notation for regular comments	2023-01-11 16:14:21 -08:00
xarray.c	radix-tree: move declarations to header	2023-06-12 11:31:50 -07:00
xxhash.c	…