Pavel Tatashin 9017217b6f mm: adaptive hash table scaling ... Allow hash tables to scale with memory but at slower pace, when HASH_ADAPT is provided every time memory quadruples the sizes of hash tables will only double instead of quadrupling as well. This algorithm starts working only when memory size reaches a certain point, currently set to 64G. This is example of dentry hash table size, before and after four various memory configurations: MEMORY SCALE HASH_SIZE old new old new 8G 13 13 8M 8M 16G 13 13 16M 16M 32G 13 13 32M 32M 64G 13 13 64M 64M 128G 13 14 128M 64M 256G 13 14 256M 128M 512G 13 15 512M 128M 1024G 13 15 1024M 256M 2048G 13 16 2048M 256M 4096G 13 16 4096M 512M 8192G 13 17 8192M 512M 16384G 13 17 16384M 1024M 32768G 13 18 32768M 1024M 65536G 13 18 65536M 2048M The effect of this change on runtime is undetectable as filesystem growth is not proportional to machine memory size as is currently assumed. The change effects only large memory machine. Additional tuning might be needed, but that can be done by the clients of the kmem_cache_create interface, not the generic cache allocator itself. The adaptive hashing is disabled on 32 bit systems to avoid confusion of whether base should be different for smaller systems, and to avoid overflows. [mhocko@suse.com: drop HASH_ADAPT] Link: http://lkml.kernel.org/r/20170509094607.GG6481@dhcp22.suse.cz [pasha.tatashin@oracle.com: UL -> ULL fix] Link: http://lkml.kernel.org/r/1495300013-653283-2-git-send-email-pasha.tatashin@oracle.com [pasha.tatashin@oracle.com: disable adaptive hash on 32 bit systems] Link: http://lkml.kernel.org/r/1495469329-755807-2-git-send-email-pasha.tatashin@oracle.com Link: http://lkml.kernel.org/r/1488432825-92126-5-git-send-email-pasha.tatashin@oracle.com Signed-off-by: Pavel Tatashin <pasha.tatashin@oracle.com> Signed-off-by: Michal Hocko <mhocko@suse.com> Acked-by: Michal Hocko <mhocko@suse.com> Cc: David Miller <davem@davemloft.net> Cc: Al Viro <viro@zeniv.linux.org.uk> Cc: Babu Moger <babu.moger@oracle.com> Signed-off-by: Andrew Morton <akpm@linux-foundation.org> Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>		2017-07-06 16:24:33 -07:00
..
kasan	Merge branch 'core-rcu-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip	2017-05-10 10:30:46 -07:00
backing-dev.c	bdi: Drop 'parent' argument from bdi_register[_va]()	2017-04-20 12:09:55 -06:00
balloon_compaction.c	mm: balloon: use general non-lru movable page feature	2016-07-26 16:19:19 -07:00
bootmem.c	mm/bootmem.c: cosmetic improvement of code readability	2017-02-22 16:41:29 -08:00
cleancache.c	fs: switch ->s_uuid to uuid_t	2017-06-05 16:59:12 +02:00
cma.c	cma: Introduce cma_for_each_area	2017-04-18 20:41:12 +02:00
cma.h	cma: Store a name in the cma structure	2017-04-18 20:41:12 +02:00
cma_debug.c	cma: Store a name in the cma structure	2017-04-18 20:41:12 +02:00
compaction.c	mm, compaction: skip over holes in __reset_isolation_suitable	2017-07-06 16:24:32 -07:00
debug.c	mm, debug: print raw struct page data in __dump_page()	2016-12-12 18:55:08 -08:00
debug_page_ref.c	mm/page_ref: add tracepoint to track down page reference manipulation	2016-03-17 15:09:34 -07:00
dmapool.c	lib/vsprintf.c: remove %Z support	2017-02-27 18:43:47 -08:00
early_ioremap.c
fadvise.c	mm: fadvise: avoid expensive remote LRU cache draining after FADV_DONTNEED	2016-12-20 09:48:46 -08:00
failslab.c	mm: fault-inject take over bootstrap kmem_cache check	2016-03-15 16:55:16 -07:00
filemap.c	Merge branch 'sched-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip	2017-07-03 13:08:04 -07:00
frame_vector.c	treewide: use kv[mz]alloc* rather than opencoded variants	2017-05-08 17:15:13 -07:00
frontswap.c	mm, frontswap: convert frontswap_enabled to static key	2016-07-26 16:19:19 -07:00
gup.c	mm/follow_page_mask: add support for hugepage directory entry	2017-07-06 16:24:33 -07:00
highmem.c	mm/highmem: make nr_free_highpages() handles all highmem zones by itself	2016-05-19 19:12:14 -07:00
huge_memory.c	mm, THP, swap: check whether THP can be split firstly	2017-07-06 16:24:31 -07:00
hugetlb.c	mm/follow_page_mask: add support for hugepage directory entry	2017-07-06 16:24:33 -07:00
hugetlb_cgroup.c	mm, hugetlb_cgroup: round limit_in_bytes down to hugepage size	2016-05-20 17:58:30 -07:00
hwpoison-inject.c	mm: hwpoison: call shake_page() unconditionally	2017-05-03 15:52:12 -07:00
init-mm.c	mm: Add a user_ns owner to mm_struct and fix ptrace permission checks	2016-11-22 11:49:48 -06:00
internal.h	mm, compaction: finish whole pageblock to reduce fragmentation	2017-05-08 17:15:10 -07:00
interval_tree.c
Kconfig	mm, THP, swap: delay splitting THP during swap out	2017-07-06 16:24:31 -07:00
Kconfig.debug	mm: enable page poisoning early at boot	2017-05-03 15:52:10 -07:00
khugepaged.c	mm, thp: remove cond_resched from __collapse_huge_page_copy	2017-06-23 16:15:55 -07:00
kmemcheck.c	mm: Rename SLAB_DESTROY_BY_RCU to SLAB_TYPESAFE_BY_RCU	2017-04-18 11:42:36 -07:00
kmemleak-test.c	mm: convert printk(KERN_<LEVEL> to pr_<level>	2016-03-17 15:09:34 -07:00
kmemleak.c	mm: fix section name for .data..ro_after_init	2017-03-31 17:13:30 -07:00
ksm.c	ksm: optimize refile of stable_node_dup at the head of the chain	2017-07-06 16:24:31 -07:00
list_lru.c	mm/list_lru.c: avoid error-path NULL pointer deref	2016-10-27 18:43:42 -07:00
maccess.c	x86: remove more uaccess_32.h complexity	2016-05-22 17:21:27 -07:00
madvise.c	mm/madvise: move up the behavior parameter validation	2017-05-03 15:52:11 -07:00
Makefile	percpu: expose statistics about percpu memory via debugfs	2017-06-20 15:31:38 -04:00
memblock.c	mm: consider memblock reservations for deferred memory initialization sizing	2017-06-02 15:07:38 -07:00
memcontrol.c	mm, THP, swap: delay splitting THP during swap out	2017-07-06 16:24:31 -07:00
memory-failure.c	mm/madvise: enable (soft|hard) offline of HugeTLB pages at PGD level	2017-07-06 16:24:33 -07:00
memory.c	mm: larger stack guard gap, between vmas	2017-06-19 21:50:20 +08:00
memory_hotplug.c	mm, memory_hotplug: remove unused cruft after memory hotplug rework	2017-07-06 16:24:32 -07:00
mempolicy.c	mm/mempolicy.c: fix error handling in set_mempolicy and mbind.	2017-04-08 10:57:55 -07:00
mempool.c	sched/wait: Rename wait_queue_t => wait_queue_entry_t	2017-06-20 12:18:27 +02:00
memtest.c
migrate.c	mm/hugetlb/migration: use set_huge_pte_at instead of set_pte_at	2017-07-06 16:24:33 -07:00
mincore.c	mm: remove shmem_mapping() shmem_zero_setup() duplicates	2017-02-24 17:46:56 -08:00
mlock.c	mlock: fix mlock count can not decrease in race condition	2017-06-02 15:07:38 -07:00
mm_init.c	mm: convert printk(KERN_<LEVEL> to pr_<level>	2016-03-17 15:09:34 -07:00
mmap.c	mm/mmap.c: mark protection_map as __ro_after_init	2017-07-06 16:24:31 -07:00
mmu_context.c	sched/headers: Prepare to move the task_lock()/unlock() APIs to <linux/sched/task.h>	2017-03-02 08:42:38 +01:00
mmu_notifier.c	mm: Use static initialization for "srcu"	2017-04-18 11:38:22 -07:00
mmzone.c	mm/mmzone.c: swap likely to unlikely as code logic is different for next_zones_zonelist()	2017-02-22 16:41:29 -08:00
mprotect.c	mm: convert generic code to 5-level paging	2017-03-09 11:48:47 -08:00
mremap.c	mm: convert generic code to 5-level paging	2017-03-09 11:48:47 -08:00
msync.c
nobootmem.c	mm/nobootmem.c: return 0 when start_pfn equals end_pfn	2017-07-06 16:24:31 -07:00
nommu.c	mm, vmalloc: use __GFP_HIGHMEM implicitly	2017-05-08 17:15:13 -07:00
oom_kill.c	oom: improve oom disable handling	2017-05-03 15:52:10 -07:00
page-writeback.c	Add GETFSMAP support; some performance improvements for very large	2017-05-08 11:30:05 -07:00
page_alloc.c	mm: adaptive hash table scaling	2017-07-06 16:24:33 -07:00
page_counter.c
page_ext.c	mm: enable page poisoning early at boot	2017-05-03 15:52:10 -07:00
page_idle.c	mm: make rmap_one boolean function	2017-05-03 15:52:10 -07:00
page_io.c	block: switch bios to blk_status_t	2017-06-09 09:27:32 -06:00
page_isolation.c	mm: __first_valid_page skip over offline pages	2017-07-06 16:24:32 -07:00
page_owner.c	mm/page_owner: don't define fields on struct page_ext by hard-coding	2016-10-07 18:46:27 -07:00
page_poison.c	mm: enable page poisoning early at boot	2017-05-03 15:52:10 -07:00
page_vma_mapped.c	mm: fix page_vma_mapped_walk() for ksm pages	2017-04-08 00:47:48 -07:00
pagewalk.c	mm: convert generic code to 5-level paging	2017-03-09 11:48:47 -08:00
percpu-internal.h	percpu: fix early calls for spinlock in pcpu_stats	2017-06-21 13:53:52 -04:00
percpu-km.c	percpu: fix static checker warnings in pcpu_destroy_chunk	2017-06-29 11:23:38 -04:00
percpu-stats.c	percpu: expose statistics about percpu memory via debugfs	2017-06-20 15:31:38 -04:00
percpu-vm.c	percpu: fix static checker warnings in pcpu_destroy_chunk	2017-06-29 11:23:38 -04:00
percpu.c	percpu: resolve err may not be initialized in pcpu_alloc	2017-06-21 12:00:45 -04:00
pgtable-generic.c	mm: convert generic code to 5-level paging	2017-03-09 11:48:47 -08:00
process_vm_access.c	sched/headers: Prepare for new header dependencies before moving code to <linux/sched/mm.h>	2017-03-02 08:42:28 +01:00
quicklist.c	fix Christoph's email addresses	2016-03-17 15:09:34 -07:00
readahead.c	mm: don't cap request size based on read-ahead setting	2016-12-12 18:55:08 -08:00
rmap.c	mm, x86/mm: Make the batched unmap TLB flush API more generic	2017-05-24 10:18:27 +02:00
rodata_test.c	mm: remove rodata_test_data export, add pr_fmt	2017-05-03 15:52:09 -07:00
shmem.c	mm, THP, swap: unify swap slot free functions to put_swap_page	2017-07-06 16:24:31 -07:00
slab.c	mm/slab.c: replace open-coded round-up code with ALIGN	2017-07-06 16:24:30 -07:00
slab.h	mm: Rename SLAB_DESTROY_BY_RCU to SLAB_TYPESAFE_BY_RCU	2017-04-18 11:42:36 -07:00
slab_common.c	mm: allow slab_nomerge to be set at build time	2017-07-06 16:24:31 -07:00
slob.c	mm: Rename SLAB_DESTROY_BY_RCU to SLAB_TYPESAFE_BY_RCU	2017-04-18 11:42:36 -07:00
slub.c	mm/slub.c: wrap kmem_cache->cpu_partial in config CONFIG_SLUB_CPU_PARTIAL	2017-07-06 16:24:30 -07:00
sparse-vmemmap.c	mm: convert generic code to 5-level paging	2017-03-09 11:48:47 -08:00
sparse.c	mm, memory_hotplug: do not associate hotadded memory to zones until online	2017-07-06 16:24:32 -07:00
swap.c	mm: move MADV_FREE pages into LRU_INACTIVE_FILE list	2017-05-03 15:52:08 -07:00
swap_cgroup.c	mm, THP, swap: delay splitting THP during swap out	2017-07-06 16:24:31 -07:00
swap_slots.c	mm, THP, swap: delay splitting THP during swap out	2017-07-06 16:24:31 -07:00
swap_state.c	mm, THP, swap: move anonymous THP split logic to vmscan	2017-07-06 16:24:31 -07:00
swapfile.c	mm, THP, swap: unify swap slot free functions to put_swap_page	2017-07-06 16:24:31 -07:00
truncate.c	mm: fix data corruption due to stale mmap reads	2017-05-12 15:57:15 -07:00
usercopy.c	mm/usercopy: Drop extra is_vmalloc_or_module() check	2017-04-05 12:30:18 -07:00
userfaultfd.c	mm: convert generic code to 5-level paging	2017-03-09 11:48:47 -08:00
util.c	mm: clarify why we want kmalloc before falling backto vmallock	2017-06-02 15:07:37 -07:00
vmacache.c	sched/headers: Prepare to move 'init_task' and 'init_thread_union' from <linux/sched.h> to <linux/sched/task.h>	2017-03-02 08:42:38 +01:00
vmalloc.c	mm/vmalloc.c: huge-vmap: fail gracefully on unexpected huge vmap mappings	2017-06-23 16:15:55 -07:00
vmpressure.c	mm: correct the comment when reclaimed pages exceed the scanned pages	2017-06-17 06:37:05 +09:00
vmscan.c	mm, THP, swap: enable THP swap optimization only if has compound map	2017-07-06 16:24:31 -07:00
vmstat.c	mm, vmstat: skip reporting offline pages in pagetypeinfo	2017-07-06 16:24:32 -07:00
workingset.c	mm: memcontrol: use node page state naming scheme for memcg	2017-05-03 15:52:11 -07:00
z3fold.c	z3fold: fix page locking in z3fold_alloc()	2017-04-13 18:24:20 -07:00
zbud.c
zpool.c
zsmalloc.c	zsmalloc: expand class bit	2017-04-13 18:24:21 -07:00
zswap.c	zswap: don't param_set_charp while holding spinlock	2017-02-27 18:43:45 -08:00