Pavel Begunkov 4a0fef6278 io_uring: optimize io_uring_task layout ... task_work bits of io_uring_task are split into two cache lines causing extra cache bouncing, place them into a separate cache line. Also move the most used submission path fields closer together, so there are hot. Cc: stable@vger.kernel.org # 5.15+ Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> Signed-off-by: Jens Axboe <axboe@kernel.dk>		2022-07-24 18:39:15 -06:00
..
advise.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
advise.h	io_uring: split out fadvise/madvise operations	2022-07-24 18:39:11 -06:00
cancel.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
cancel.h	io_uring: move a few private types to local headers	2022-07-24 18:39:14 -06:00
epoll.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
epoll.h	io_uring: move epoll handler to its own file	2022-07-24 18:39:11 -06:00
fdinfo.c	io_uring: move a few private types to local headers	2022-07-24 18:39:14 -06:00
fdinfo.h	io_uring: move fdinfo helpers to its own file	2022-07-24 18:39:12 -06:00
filetable.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
filetable.h	io_uring: make io_uring_types.h public	2022-07-24 18:39:14 -06:00
fs.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
fs.h	io_uring: split out filesystem related operations	2022-07-24 18:39:11 -06:00
io-wq.c
io-wq.h	io_uring: make io_uring_types.h public	2022-07-24 18:39:14 -06:00
io_uring.c	io_uring: consistent naming for inline completion	2022-07-24 18:39:15 -06:00
io_uring.h	io_uring: consistent naming for inline completion	2022-07-24 18:39:15 -06:00
kbuf.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
kbuf.h	io_uring: don't inline io_put_kbuf	2022-07-24 18:39:13 -06:00
Makefile	io_uring: move opcode table to opdef.c	2022-07-24 18:39:12 -06:00
msg_ring.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
msg_ring.h	io_uring: move msg_ring into its own file	2022-07-24 18:39:12 -06:00
net.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
net.h	io_uring: split network related opcodes into its own file	2022-07-24 18:39:11 -06:00
nop.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
nop.h	io_uring: move nop into its own file	2022-07-24 18:39:11 -06:00
opdef.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
opdef.h	io_uring: move opcode table to opdef.c	2022-07-24 18:39:12 -06:00
openclose.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
openclose.h	io_uring: split out open/close operations	2022-07-24 18:39:11 -06:00
poll.c	io_uring: add a warn_once for poll_find	2022-07-24 18:39:15 -06:00
poll.h	io_uring: move a few private types to local headers	2022-07-24 18:39:14 -06:00
refs.h	io_uring: make io_uring_types.h public	2022-07-24 18:39:14 -06:00
rsrc.c	io_uring: move io_import_fixed()	2022-07-24 18:39:15 -06:00
rsrc.h	io_uring: move io_import_fixed()	2022-07-24 18:39:15 -06:00
rw.c	io_uring: move io_import_fixed()	2022-07-24 18:39:15 -06:00
rw.h	io_uring: move read/write related opcodes to its own file	2022-07-24 18:39:12 -06:00
splice.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
splice.h	io_uring: split out splice related operations	2022-07-24 18:39:11 -06:00
sqpoll.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
sqpoll.h	io_uring: move SQPOLL related handling into its own file	2022-07-24 18:39:12 -06:00
statx.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
statx.h	io_uring: move statx handling to its own file	2022-07-24 18:39:11 -06:00
sync.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
sync.h	io_uring: split out fs related sync/fallocate functions	2022-07-24 18:39:11 -06:00
tctx.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
tctx.h	io_uring: optimize io_uring_task layout	2022-07-24 18:39:15 -06:00
timeout.c	io_uring: introduce locking helpers for CQE posting	2022-07-24 18:39:14 -06:00
timeout.h	io_uring: move a few private types to local headers	2022-07-24 18:39:14 -06:00
uring_cmd.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
uring_cmd.h	io_uring: move uring_cmd handling to its own file	2022-07-24 18:39:11 -06:00
xattr.c	io_uring: kill extra io_uring_types.h includes	2022-07-24 18:39:14 -06:00
xattr.h	io_uring: move xattr related opcodes to its own file	2022-07-24 18:39:11 -06:00