Darrick J. Wong 40b1de007a xfs: throttle inode inactivation queuing on memory reclaim ... Now that we defer inode inactivation, we've decoupled the process of unlinking or closing an inode from the process of inactivating it. In theory this should lead to better throughput since we now inactivate the queued inodes in batches instead of one at a time. Unfortunately, one of the primary risks with this decoupling is the loss of rate control feedback between the frontend and background threads. In other words, a rm -rf /* thread can run the system out of memory if it can queue inodes for inactivation and jump to a new CPU faster than the background threads can actually clear the deferred work. The workers can get scheduled off the CPU if they have to do IO, etc. To solve this problem, we configure a shrinker so that it will activate the /second/ time the shrinkers are called. The custom shrinker will queue all percpu deferred inactivation workers immediately and set a flag to force frontend callers who are releasing a vfs inode to wait for the inactivation workers. On my test VM with 560M of RAM and a 2TB filesystem, this seems to solve most of the OOMing problem when deleting 10 million inodes. Signed-off-by: Darrick J. Wong <djwong@kernel.org> Reviewed-by: Dave Chinner <dchinner@redhat.com>		2021-08-09 11:13:17 -07:00
..
libxfs	xfs: remove the active vs running quota differentiation	2021-08-06 11:05:37 -07:00
scrub	xfs: don't run speculative preallocation gc when fs is frozen	2021-08-09 10:52:19 -07:00
Kconfig
kmem.c
kmem.h
Makefile
mrlock.h
xfs.h
xfs_acl.c	xfs: support idmapped mounts	2021-01-24 14:43:46 +01:00
xfs_acl.h	fs: make helpers idmap mount aware	2021-01-24 14:27:20 +01:00
xfs_aops.c	fs: remove noop_set_page_dirty()	2021-06-29 10:53:48 -07:00
xfs_aops.h
xfs_attr_inactive.c	xfs: Add delay ready attr remove routines	2021-06-01 10:49:47 -07:00
xfs_attr_list.c	xfs: rename and simplify xfs_bmap_one_block	2021-04-15 09:35:50 -07:00
xfs_bio_io.c	xfs: async blkdev cache flush	2021-06-21 10:05:51 -07:00
xfs_bmap_item.c	treewide: Change list_sort to use const pointers	2021-04-08 16:04:22 -07:00
xfs_bmap_item.h
xfs_bmap_util.c	New code for 5.14:	2021-07-02 14:30:27 -07:00
xfs_bmap_util.h
xfs_buf.c	xfs: remove xfs_blkdev_issue_flush	2021-06-21 10:05:46 -07:00
xfs_buf.h	xfs: remove ->b_offset handling for page backed buffers	2021-06-07 11:49:50 +10:00
xfs_buf_item.c	xfs: remove dead stale buf unpin handling code	2021-06-21 10:14:24 -07:00
xfs_buf_item.h
xfs_buf_item_recover.c	xfs: prevent spoofing of rtbitmap blocks when recovering buffers	2021-07-29 09:27:29 -07:00
xfs_dir2_readdir.c	xfs: remove XFS_IFINLINE	2021-04-15 09:35:51 -07:00
xfs_discard.c	xfs: convert allocbt cursors to use perags	2021-06-02 10:48:24 +10:00
xfs_discard.h
xfs_dquot.c	xfs: remove the active vs running quota differentiation	2021-08-06 11:05:37 -07:00
xfs_dquot.h	xfs: queue inactivation immediately when quota is nearing enforcement	2021-08-09 10:52:18 -07:00
xfs_dquot_item.c	xfs: remove support for disabling quota accounting on a mounted file system	2021-08-06 11:05:36 -07:00
xfs_dquot_item.h	xfs: remove support for disabling quota accounting on a mounted file system	2021-08-06 11:05:36 -07:00
xfs_dquot_item_recover.c
xfs_error.c	xfs: add error injection for per-AG resv failure	2021-03-25 16:47:53 -07:00
xfs_error.h
xfs_export.c	xfs: Fix fall-through warnings for Clang	2021-05-26 14:51:26 -05:00
xfs_export.h
xfs_extent_busy.c	xfs: pass perags through to the busy extent code	2021-06-02 10:48:24 +10:00
xfs_extent_busy.h	xfs: pass perags through to the busy extent code	2021-06-02 10:48:24 +10:00
xfs_extfree_item.c	treewide: Change list_sort to use const pointers	2021-04-08 16:04:22 -07:00
xfs_extfree_item.h
xfs_file.c	New code for 5.14:	2021-07-02 14:30:27 -07:00
xfs_filestream.c	xfs: move xfs_perag_get/put to xfs_ag.[ch]	2021-06-02 10:48:24 +10:00
xfs_filestream.h	xfs: move the di_flags field to struct xfs_inode	2021-04-07 14:37:05 -07:00
xfs_fsmap.c	xfs: remove agno from btree cursor	2021-06-02 10:48:24 +10:00
xfs_fsmap.h
xfs_fsops.c	xfs: shorten the shutdown messages to a single line	2021-06-21 10:14:13 -07:00
xfs_fsops.h	xfs: get rid of xfs_growfs_{data,log}_t	2021-02-03 09:18:50 -08:00
xfs_globals.c	xfs: consolidate the eofblocks and cowblocks workers	2021-02-03 09:18:49 -08:00
xfs_health.c	xfs: drop IDONTCACHE on inodes when we mark them sick	2021-06-08 09:30:20 -07:00
xfs_icache.c	xfs: throttle inode inactivation queuing on memory reclaim	2021-08-09 11:13:17 -07:00
xfs_icache.h	xfs: throttle inode inactivation queuing on memory reclaim	2021-08-09 11:13:17 -07:00
xfs_icreate_item.c
xfs_icreate_item.h
xfs_inode.c	xfs: detach dquots from inode if we don't need to inactivate it	2021-08-06 11:05:39 -07:00
xfs_inode.h	xfs: per-cpu deferred inode inactivation queues	2021-08-06 11:05:39 -07:00
xfs_inode_item.c	xfs: xfs_log_force_lsn isn't passed a LSN	2021-06-21 10:12:33 -07:00
xfs_inode_item.h	xfs: xfs_log_force_lsn isn't passed a LSN	2021-06-21 10:12:33 -07:00
xfs_inode_item_recover.c	xfs: logging the on disk inode LSN can make it go backwards	2021-07-29 09:27:29 -07:00
xfs_ioctl.c	xfs: remove the active vs running quota differentiation	2021-08-06 11:05:37 -07:00
xfs_ioctl.h	xfs: convert to fileattr	2021-04-12 15:04:29 +02:00
xfs_ioctl32.c	xfs: convert to fileattr	2021-04-12 15:04:29 +02:00
xfs_ioctl32.h	xfs: convert to fileattr	2021-04-12 15:04:29 +02:00
xfs_iomap.c	xfs: Fix fall-through warnings for Clang	2021-05-26 14:51:26 -05:00
xfs_iomap.h
xfs_iops.c	xfs: remove the active vs running quota differentiation	2021-08-06 11:05:37 -07:00
xfs_iops.h	xfs: support idmapped mounts	2021-01-24 14:43:46 +01:00
xfs_itable.c	xfs: avoid buffer deadlocks when walking fs inodes	2021-08-09 11:13:16 -07:00
xfs_itable.h	xfs: support idmapped mounts	2021-01-24 14:43:46 +01:00
xfs_iwalk.c	xfs: avoid buffer deadlocks when walking fs inodes	2021-08-09 11:13:16 -07:00
xfs_iwalk.h
xfs_linux.h	xfs: async blkdev cache flush	2021-06-21 10:05:51 -07:00
xfs_log.c	xfs: limit iclog tail updates	2021-07-29 09:27:29 -07:00
xfs_log.h	xfs: xfs_log_force_lsn isn't passed a LSN	2021-06-21 10:12:33 -07:00
xfs_log_cil.c	xfs: fix ordering violation between cache flushes and tail updates	2021-07-29 09:27:28 -07:00
xfs_log_priv.h	xfs: need to see iclog flags in tracing	2021-07-29 09:27:29 -07:00
xfs_log_recover.c	xfs: per-cpu deferred inode inactivation queues	2021-08-06 11:05:39 -07:00
xfs_message.c
xfs_message.h	once: implement DO_ONCE_LITE for non-fast-path "do once" functionality	2021-06-28 15:54:57 -07:00
xfs_mount.c	xfs: throttle inode inactivation queuing on memory reclaim	2021-08-09 11:13:17 -07:00
xfs_mount.h	xfs: throttle inode inactivation queuing on memory reclaim	2021-08-09 11:13:17 -07:00
xfs_mru_cache.c	xfs: set WQ_SYSFS on all workqueues in debug mode	2021-02-03 09:18:49 -08:00
xfs_mru_cache.h
xfs_ondisk.h	xfs: rename struct xfs_legacy_ictimestamp	2021-04-22 18:29:25 -07:00
xfs_pnfs.c	xfs: move the di_size field to struct xfs_inode	2021-04-07 14:37:03 -07:00
xfs_pnfs.h
xfs_pwork.c	xfs: increase the default parallelism levels of pwork clients	2021-02-03 09:18:49 -08:00
xfs_pwork.h	xfs: increase the default parallelism levels of pwork clients	2021-02-03 09:18:49 -08:00
xfs_qm.c	xfs: queue inactivation immediately when quota is nearing enforcement	2021-08-09 10:52:18 -07:00
xfs_qm.h	xfs: remove support for disabling quota accounting on a mounted file system	2021-08-06 11:05:36 -07:00
xfs_qm_bhv.c	xfs: move the di_projid field to struct xfs_inode	2021-04-07 14:37:03 -07:00
xfs_qm_syscalls.c	xfs: flush inode inactivation work when compiling usage statistics	2021-08-09 10:52:18 -07:00
xfs_quota.h	xfs: queue inactivation immediately when quota is nearing enforcement	2021-08-09 10:52:18 -07:00
xfs_quotaops.c	xfs: remove the active vs running quota differentiation	2021-08-06 11:05:37 -07:00
xfs_refcount_item.c	treewide: Change list_sort to use const pointers	2021-04-08 16:04:22 -07:00
xfs_refcount_item.h
xfs_reflink.c	xfs: convert refcount btree cursor to use perags	2021-06-02 10:48:24 +10:00
xfs_reflink.h
xfs_rmap_item.c	treewide: Change list_sort to use const pointers	2021-04-08 16:04:22 -07:00
xfs_rmap_item.h
xfs_rtalloc.c	xfs: fix an integer overflow error in xfs_growfs_rt	2021-07-15 09:58:42 -07:00
xfs_rtalloc.h	xfs: remove xfs_buf_t typedef	2020-12-16 16:07:34 -08:00
xfs_stats.c
xfs_stats.h
xfs_super.c	xfs: don't run speculative preallocation gc when fs is frozen	2021-08-09 10:52:19 -07:00
xfs_super.h	xfs: remove xfs_blkdev_issue_flush	2021-06-21 10:05:46 -07:00
xfs_symlink.c	xfs: get rid of xfs_dir_ialloc()	2021-06-02 10:48:24 +10:00
xfs_symlink.h	xfs: support idmapped mounts	2021-01-24 14:43:46 +01:00
xfs_sysctl.c	xfs: restore speculative_cow_prealloc_lifetime sysctl	2021-02-24 10:16:08 -08:00
xfs_sysctl.h	xfs: consolidate the eofblocks and cowblocks workers	2021-02-03 09:18:49 -08:00
xfs_sysfs.c
xfs_sysfs.h
xfs_trace.c	xfs: move perag structure and setup to libxfs/xfs_ag.[ch]	2021-06-02 10:48:24 +10:00
xfs_trace.h	xfs: throttle inode inactivation queuing on memory reclaim	2021-08-09 11:13:17 -07:00
xfs_trans.c	xfs: use background worker pool when transactions can't get free space	2021-08-09 11:13:16 -07:00
xfs_trans.h	xfs: xfs_log_force_lsn isn't passed a LSN	2021-06-21 10:12:33 -07:00
xfs_trans_ail.c
xfs_trans_buf.c	xfs: Fix fall-through warnings for Clang	2021-05-26 14:51:26 -05:00
xfs_trans_dquot.c	xfs: remove the active vs running quota differentiation	2021-08-06 11:05:37 -07:00
xfs_trans_priv.h
xfs_xattr.c	xfs: prevent metadata files from being inactivated	2021-03-25 16:47:50 -07:00