Rik van Riel e8a03feb54 rmap: add exclusively owned pages to the newest anon_vma ... The recent anon_vma fixes cause many anonymous pages to end up in the parent process anon_vma, even when the page is exclusively owned by the current process. Adding exclusively owned anonymous pages to the top anon_vma reduces rmap scanning overhead, especially in workloads with forking servers. This patch adds a parameter to __page_set_anon_rmap that can be used to indicate whether or not the added page is exclusively owned by the current process. Pages added through page_add_new_anon_rmap are exclusively owned by the current process, and can be added to the top anon_vma. Pages added through page_add_anon_rmap can be either shared or exclusively owned, so we do the conservative thing and add it to the oldest anon_vma. A next step would be to add the exclusive parameter to page_add_anon_rmap, to be used from functions where we do know for sure whether a page is exclusively owned. Signed-off-by: Rik van Riel <riel@redhat.com> Reviewed-by: Johannes Weiner <hannes@cmpxchg.org> Lightly-tested-by: Borislav Petkov <bp@alien8.de> Reviewed-by: Minchan Kim <minchan.kim@gmail.com> [ Edited to look nicer - Linus ] Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>		2010-04-19 16:28:20 -07:00
..
backing-dev.c	backing-dev: Handle class_create() failure	2010-04-02 09:46:55 +02:00
bootmem.c	Merge branch 'x86-fixes-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/x86/linux-2.6-tip	2010-04-07 11:02:23 -07:00
bounce.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
debug-pagealloc.c
dmapool.c	dmapools: protect page_list walk in show_pools()	2009-06-30 18:56:00 -07:00
fadvise.c	readahead: introduce FMODE_RANDOM for POSIX_FADV_RANDOM	2010-03-06 11:26:25 -08:00
failslab.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
filemap.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
filemap_xip.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
fremap.c	mm: clean up mm_counter	2010-03-06 11:26:23 -08:00
highmem.c	grammar fix in comment	2010-02-05 12:22:40 +01:00
hugetlb.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
hwpoison-inject.c	HWPOISON: Don't do early filtering if filter is disabled	2009-12-16 12:20:01 +01:00
init-mm.c	mm: consolidate init_mm definition	2009-06-16 19:47:28 -07:00
internal.h	HWPOISON: add an interface to switch off/on all the page filters	2009-12-16 12:19:59 +01:00
Kconfig	Merge branch 'x86-bootmem-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip	2010-03-03 08:15:05 -08:00
Kconfig.debug	trivial: improve help text for mm debug config options	2009-09-21 15:14:57 +02:00
kmemcheck.c	kmemcheck: Fix build errors due to missing slab.h	2010-03-30 22:02:32 +09:00
kmemleak-test.c	percpu: clean up percpu variable definitions	2009-06-24 15:13:48 +09:00
kmemleak.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
ksm.c	mm/ksm.c is doing an unneeded _notify in write_protect_page.	2010-03-24 16:31:20 -07:00
maccess.c	maccess,probe_kernel: Allow arch specific override probe_kernel_(read|write)	2010-01-07 11:58:36 -06:00
madvise.c	HWPOISON: Add a madvise() injector for soft page offlining	2009-12-16 12:20:00 +01:00
Makefile	percpu: don't implicitly include slab.h from percpu.h	2010-03-30 22:02:32 +09:00
memcontrol.c	memcg: fix race in file_mapped accounting	2010-04-07 08:38:05 -07:00
memory-failure.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
memory.c	mm: avoid null-pointer deref in sync_mm_rss()	2010-04-07 08:38:02 -07:00
memory_hotplug.c	mm: introduce dump_page() and print symbolic flag names	2010-03-12 15:52:28 -08:00
mempolicy.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
mempool.c	mm: remove broken 'kzalloc' mempool	2009-09-22 07:17:35 -07:00
migrate.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
mincore.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
mlock.c	mm: use rlimit helpers	2010-03-06 11:26:24 -08:00
mm_init.c
mmap.c	vma_adjust: fix the copying of anon_vma chains	2010-04-12 17:54:11 -07:00
mmu_context.c	exit: fix oops in sync_mm_rss	2010-03-24 16:31:21 -07:00
mmu_notifier.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
mmzone.c	[ARM] Double check memmap is actually valid with a memmap has unexpected holes V2	2009-05-18 11:22:24 +01:00
mprotect.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
mremap.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
msync.c
nommu.c	NOMMU: Fix __get_user_pages() to pin last page on offset buffers	2010-03-25 14:13:27 -07:00
oom_kill.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
page-writeback.c	writeback: remove unused nonblocking and congestion checks	2009-12-03 13:54:25 +01:00
page_alloc.c	mm: introduce dump_page() and print symbolic flag names	2010-03-12 15:52:28 -08:00
page_cgroup.c	memcg: avoid use cmpxchg in swap cgroup maintainance	2010-03-17 18:43:47 -07:00
page_io.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
page_isolation.c
pagewalk.c	pagemap: fix pfn calculation for hugepage	2010-04-07 08:38:04 -07:00
percpu.c	percpu, module: implement and use is_kernel/module_percpu_address()	2010-03-29 23:07:12 +09:00
percpu_up.c	percpu: don't implicitly include slab.h from percpu.h	2010-03-30 22:02:32 +09:00
prio_tree.c
quicklist.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
readahead.c	readahead: fix NULL filp dereference	2010-04-07 08:38:03 -07:00
rmap.c	rmap: add exclusively owned pages to the newest anon_vma	2010-04-19 16:28:20 -07:00
shmem.c	Fix breakage in shmem.c	2009-12-16 19:48:48 -05:00
slab.c	slab: Generify kernel pointer validation	2010-04-09 10:09:50 -07:00
slob.c	slab: remove duplicate kmem_cache_init_late() declarations	2009-08-06 11:36:25 +03:00
slub.c	slub: Fix kmem_ptr_validate() for non-kernel pointers	2010-04-09 10:09:50 -07:00
sparse-vmemmap.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
sparse.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
swap.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
swap_state.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
swapfile.c	memcg: move charges of anonymous swap	2010-03-12 15:52:36 -08:00
thrash.c	mm: pass mm to grab_swap_token	2009-06-23 12:50:05 -07:00
truncate.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
util.c	slab: Generify kernel pointer validation	2010-04-09 10:09:50 -07:00
vmalloc.c	mm: purge fragmented percpu vmap blocks	2010-02-02 12:50:47 -08:00
vmscan.c	mm: revert "vmscan: get_scan_ratio() cleanup"	2010-04-07 08:38:03 -07:00
vmstat.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00