Pavel Begunkov 93238e6618 io_uring: add memory region registration ... Regions will serve multiple purposes. First, with it we can decouple ring/etc. object creation from registration / mapping of the memory they will be placed in. We already have hacks that allow to put both SQ and CQ into the same huge page, in the future we should be able to: region = create_region(io_ring); create_pbuf_ring(io_uring, region, offset=0); create_pbuf_ring(io_uring, region, offset=N); The second use case is efficiently passing parameters. The following patch enables back on top of regions IORING_ENTER_EXT_ARG_REG, which optimises wait arguments. It'll also be useful for request arguments replacing iovecs, msghdr, etc. pointers. Eventually it would also be handy for BPF as well if it comes to fruition. Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> Link: https://lore.kernel.org/r/0798cf3a14fad19cfc96fc9feca5f3e11481691d.1731689588.git.asml.silence@gmail.com Signed-off-by: Jens Axboe <axboe@kernel.dk>		2024-11-15 09:58:34 -07:00
..
advise.c	io_uring/advise: support 64-bit lengths	2024-06-16 14:54:55 -06:00
advise.h	io_uring: split out fadvise/madvise operations	2022-07-24 18:39:11 -06:00
alloc_cache.h	io_uring/alloc_cache: switch to array based caching	2024-04-15 08:10:25 -06:00
cancel.c	io_uring: move struct io_kiocb from task_struct to io_uring_task	2024-11-06 13:55:38 -07:00
cancel.h	io_uring/cancel: get rid of init_hash_table() helper	2024-10-29 13:43:27 -06:00
epoll.c	io_uring: undeprecate epoll_ctl support	2023-05-26 20:22:41 -06:00
epoll.h	io_uring: move epoll handler to its own file	2022-07-24 18:39:11 -06:00
eventfd.c	io_uring/eventfd: move ctx->evfd_last_cq_tail into io_ev_fd	2024-10-29 13:43:26 -06:00
eventfd.h	io_uring/eventfd: move eventfd handling to separate file	2024-06-16 14:54:55 -06:00
fdinfo.c	io_uring/napi: add static napi tracking strategy	2024-11-06 13:55:38 -07:00
fdinfo.h	io_uring: move fdinfo helpers to its own file	2022-07-24 18:39:12 -06:00
filetable.c	io_uring/rsrc: pass 'struct io_ring_ctx' reference to rsrc helpers	2024-11-07 15:24:33 -07:00
filetable.h	io_uring/rsrc: pass 'struct io_ring_ctx' reference to rsrc helpers	2024-11-07 15:24:33 -07:00
fs.c	io_uring/fs: consider link->flags when getting path for LINKAT	2023-11-20 09:01:42 -07:00
fs.h	io_uring: split out filesystem related operations	2022-07-24 18:39:11 -06:00
futex.c	io_uring: move cancelations to be io_uring_task based	2024-11-06 13:55:38 -07:00
futex.h	io_uring: move cancelations to be io_uring_task based	2024-11-06 13:55:38 -07:00
io_uring.c	io_uring: add memory region registration	2024-11-15 09:58:34 -07:00
io_uring.h	io_uring: avoid normal tw intermediate fallback	2024-11-06 13:55:38 -07:00
io-wq.c	io_uring/io-wq: inherit cpuset of cgroup in io worker	2024-09-11 07:27:56 -06:00
io-wq.h	io_uring/io-wq: make io_wq_work flags atomic	2024-06-16 14:54:55 -06:00
kbuf.c	for-6.12/io_uring-20240913	2024-09-16 13:29:00 +02:00
kbuf.h	io_uring/kbuf: add support for incremental buffer consumption	2024-08-29 08:44:58 -06:00
Makefile	io_uring: add GCOV_PROFILE_URING Kconfig option	2024-08-30 10:52:02 -06:00
memmap.c	io_uring: introduce concept of memory regions	2024-11-15 09:58:34 -07:00
memmap.h	io_uring: introduce concept of memory regions	2024-11-15 09:58:34 -07:00
msg_ring.c	switch io_msg_ring() to CLASS(fd)	2024-11-15 09:55:54 -07:00
msg_ring.h	io_uring/msg_ring: add support for sending a sync message	2024-10-29 13:43:26 -06:00
napi.c	io_uring/napi: add static napi tracking strategy	2024-11-06 13:55:38 -07:00
napi.h	io_uring/napi: add static napi tracking strategy	2024-11-06 13:55:38 -07:00
net.c	io_uring/rsrc: add & apply io_req_assign_buf_node()	2024-11-07 15:24:33 -07:00
net.h	io_uring: Introduce IORING_OP_LISTEN	2024-06-19 07:57:21 -06:00
nop.c	io_uring/rsrc: add & apply io_req_assign_buf_node()	2024-11-07 15:24:33 -07:00
nop.h	io_uring: move nop into its own file	2022-07-24 18:39:11 -06:00
notif.c	io_uring: move struct io_kiocb from task_struct to io_uring_task	2024-11-06 13:55:38 -07:00
notif.h	io_uring/notif: implement notification stacking	2024-04-22 19:31:18 -06:00
opdef.c	io_uring/splice: open code 2nd direct file assignment	2024-10-29 13:43:28 -06:00
opdef.h	io_uring: Fix probe of disabled operations	2024-06-19 08:58:00 -06:00
openclose.c	io_uring: enable audit and restrict cred override for IORING_OP_FIXED_FD_INSTALL	2024-01-23 15:25:14 -07:00
openclose.h	io_uring/openclose: add support for IORING_OP_FIXED_FD_INSTALL	2023-12-12 07:42:57 -07:00
poll.c	io_uring: move struct io_kiocb from task_struct to io_uring_task	2024-11-06 13:55:38 -07:00
poll.h	io_uring: move cancelations to be io_uring_task based	2024-11-06 13:55:38 -07:00
refs.h	io_uring: kill dead code in io_req_complete_post	2024-04-15 08:10:26 -06:00
register.c	io_uring: add memory region registration	2024-11-15 09:58:34 -07:00
register.h	io_uring: temporarily disable registered waits	2024-11-15 09:58:34 -07:00
rsrc.c	io_uring/rsrc: remove '->ctx_ptr' of 'struct io_rsrc_node'	2024-11-07 15:24:33 -07:00
rsrc.h	io_uring/rsrc: add & apply io_req_assign_buf_node()	2024-11-07 15:24:33 -07:00
rw.c	io_uring/rsrc: add & apply io_req_assign_buf_node()	2024-11-07 15:24:33 -07:00
rw.h	io_uring/alloc_cache: switch to array based caching	2024-04-15 08:10:25 -06:00
slist.h	io_uring: silence variable ‘prev’ set but not used warning	2023-03-09 10:10:58 -07:00
splice.c	io_uring/rsrc: pass 'struct io_ring_ctx' reference to rsrc helpers	2024-11-07 15:24:33 -07:00
splice.h	io_uring/splice: open code 2nd direct file assignment	2024-10-29 13:43:28 -06:00
sqpoll.c	io_uring/sqpoll: wait on sqd->wait for thread parking	2024-10-29 13:43:27 -06:00
sqpoll.h	io_uring/sqpoll: statistics of the true utilization of sq threads	2024-03-01 06:28:19 -07:00
statx.c	vfs: retire user_path_at_empty and drop empty arg from getname_flags	2024-06-05 17:03:57 +02:00
statx.h	io_uring: move statx handling to its own file	2022-07-24 18:39:11 -06:00
sync.c	io_uring: for requests that require async, force it	2023-01-29 15:18:26 -07:00
sync.h	io_uring: split out fs related sync/fallocate functions	2022-07-24 18:39:11 -06:00
tctx.c	io_uring: move struct io_kiocb from task_struct to io_uring_task	2024-11-06 13:55:38 -07:00
tctx.h	io_uring: simplify __io_uring_add_tctx_node	2022-10-07 12:25:30 -06:00
timeout.c	io_uring: move struct io_kiocb from task_struct to io_uring_task	2024-11-06 13:55:38 -07:00
timeout.h	io_uring: move cancelations to be io_uring_task based	2024-11-06 13:55:38 -07:00
truncate.c	io_uring: add support for ftruncate	2024-02-09 09:04:39 -07:00
truncate.h	io_uring: add support for ftruncate	2024-02-09 09:04:39 -07:00
uring_cmd.c	io_uring/uring_cmd: fix buffer index retrieval	2024-11-11 08:11:37 -07:00
uring_cmd.h	io_uring: move cancelations to be io_uring_task based	2024-11-06 13:55:38 -07:00
waitid.c	io_uring: move struct io_kiocb from task_struct to io_uring_task	2024-11-06 13:55:38 -07:00
waitid.h	io_uring: move cancelations to be io_uring_task based	2024-11-06 13:55:38 -07:00
xattr.c	vfs: retire user_path_at_empty and drop empty arg from getname_flags	2024-06-05 17:03:57 +02:00
xattr.h	io_uring: move xattr related opcodes to its own file	2022-07-24 18:39:11 -06:00