David Wei
f46b9cdb22
io_uring: limit local tw done
...
Instead of eagerly running all available local tw, limit the amount of
local tw done to the max of IO_LOCAL_TW_DEFAULT_MAX (20) or wait_nr. The
value of 20 is chosen as a reasonable heuristic to allow enough work
batching but also keep latency down.
Add a retry_llist that maintains a list of local tw that couldn't be
done in time. No synchronisation is needed since it is only modified
within the task context.
Signed-off-by: David Wei <dw@davidwei.uk>
Link: https://lore.kernel.org/r/20241120221452.3762588-3-dw@davidwei.uk
Signed-off-by: Jens Axboe <axboe@kernel.dk>
2024-11-21 07:11:00 -07:00
..
2024-09-04 15:01:17 +01:00
2024-08-13 14:51:29 -07:00
2024-09-10 19:52:30 -05:00
2024-10-02 17:23:23 -04:00
2024-09-01 20:43:24 -07:00
2024-09-25 11:01:27 +02:00
2024-08-28 23:35:13 +05:30
2024-08-16 09:59:32 +01:00
2024-09-11 08:55:35 +00:00
2024-10-11 15:59:15 -07:00
2024-09-17 16:46:22 +02:00
2024-08-10 11:19:36 +01:00
2024-09-05 21:43:42 -07:00
2024-11-06 13:55:38 -07:00
2024-10-08 17:44:27 +02:00
2024-09-01 10:04:56 -04:00
2024-09-23 14:17:08 -07:00
2024-10-02 17:14:53 -07:00
2024-09-21 08:20:50 -07:00
2024-10-02 17:23:23 -04:00
2024-08-16 13:09:12 +01:00
2024-08-04 00:54:49 +02:00
2024-09-26 12:00:25 -07:00
2024-08-30 15:43:52 +01:00
2024-10-09 12:47:19 -07:00
2024-10-11 08:39:23 +02:00
2024-10-15 07:54:16 +02:00
2024-09-10 12:41:42 +01:00
2024-10-02 17:23:23 -04:00
2024-09-26 10:27:10 -07:00
2024-09-06 14:49:20 +02:00
2024-09-27 09:55:30 -07:00
2024-09-09 16:39:18 -07:00
2024-08-22 12:23:47 -04:00
2024-08-20 15:40:44 +01:00
2024-08-30 16:30:41 +01:00
2024-09-13 15:41:42 +02:00
2024-09-03 12:48:51 +02:00
2024-08-29 04:32:32 -06:00
2024-09-27 12:10:45 -07:00
2024-08-28 06:53:58 -07:00
2024-09-25 14:56:40 -07:00
2024-09-13 13:22:09 -06:00
2024-09-13 12:31:45 -06:00
2024-09-20 00:19:48 -06:00
2024-09-05 13:29:06 -07:00
2024-09-03 12:06:24 -07:00
2024-09-24 14:54:26 -07:00
2024-08-21 10:37:52 -07:00
2024-09-16 08:54:30 +02:00
2024-09-11 09:58:30 -07:00
2024-09-21 07:29:05 -07:00
2024-09-21 09:44:57 -07:00
2024-09-29 08:51:30 -07:00
2024-09-05 13:48:00 -07:00
2024-09-05 13:51:46 -07:00
2024-10-09 16:57:57 -04:00
2024-09-03 21:15:36 -07:00
2024-08-22 17:04:43 -07:00
2024-09-26 14:01:44 -07:00
2024-09-04 15:56:32 +02:00
2024-08-15 21:30:43 +05:30
2024-09-18 07:52:24 +02:00
2024-09-26 11:39:02 -07:00
2024-08-20 15:02:38 +01:00
2024-08-20 15:02:38 +01:00
2024-10-01 20:43:44 +02:00
2024-09-18 15:03:58 +02:00
2024-09-27 12:10:45 -07:00
2024-08-30 10:00:16 -10:00
2024-09-09 16:39:00 -07:00
2024-09-27 08:18:43 -07:00
2024-08-21 13:12:12 +02:00
2024-09-04 07:08:51 +03:00
2024-08-22 06:18:00 +02:00
2024-08-30 11:41:05 -07:00
2024-09-22 18:47:51 +02:00
2024-08-29 07:22:49 +03:00
2024-08-26 19:21:14 -07:00
2024-08-27 12:22:18 +02:00
2024-09-03 21:15:38 -07:00
2024-10-02 17:23:23 -04:00
2024-08-26 09:33:58 -07:00
2024-08-12 14:16:24 +01:00
2024-09-11 03:30:27 +00:00
2024-08-28 16:53:57 +02:00
2024-09-01 20:43:33 -07:00
2024-09-19 10:18:15 +02:00
2024-09-29 21:52:29 -04:00
2024-09-23 09:35:36 -07:00
2024-08-30 08:22:33 +02:00
2024-09-21 09:27:50 -07:00
2024-08-18 10:07:59 -07:00
2024-09-12 22:30:37 +09:00
2024-10-01 17:01:40 +02:00
2024-10-09 12:47:18 -07:00
2024-10-02 15:14:29 +02:00
2024-09-09 09:41:47 -04:00
2024-09-09 16:39:03 -07:00
2024-09-09 16:39:05 -07:00
2024-09-02 11:47:06 +02:00
2024-09-24 16:10:12 +02:00
2024-08-27 16:18:51 +02:00
2024-09-13 15:14:56 +02:00
2024-08-29 10:39:37 +02:00
2024-10-15 18:46:25 +02:00
2024-10-17 00:28:10 -07:00
2024-09-26 14:01:43 -07:00
2024-09-13 07:27:36 -07:00
2024-09-21 12:46:00 +02:00
2024-08-02 18:27:05 +02:00
2024-10-02 17:23:23 -04:00
2024-08-26 09:37:22 -07:00
2024-08-12 16:21:31 +02:00
2024-08-23 20:50:19 +02:00
2024-11-21 07:11:00 -07:00
2024-09-04 11:38:34 +02:00
2024-10-15 11:37:42 +02:00
2024-09-22 18:48:00 +02:00
2024-08-23 11:16:39 +02:00
2024-09-05 12:43:53 -03:00
2024-08-07 18:32:38 +02:00
2024-08-26 10:19:55 -07:00
2024-09-12 12:20:42 +02:00
2024-08-08 17:15:02 +02:00
2024-08-09 22:37:54 +02:00
2024-08-26 23:49:15 -04:00
2024-09-08 20:47:40 +02:00
2024-08-27 14:12:51 +02:00
2024-09-03 21:15:46 -07:00
2024-09-20 18:28:26 +03:00
2024-09-01 20:26:03 -07:00
2024-09-09 16:39:04 -07:00
2024-09-25 20:12:58 +09:00
2024-09-17 11:38:20 -04:00
2024-09-07 10:16:56 +09:00
2024-08-02 16:32:29 -07:00
2024-09-01 20:43:29 -07:00
2024-08-22 12:23:47 -04:00
2024-09-24 14:54:26 -07:00
2024-08-22 12:24:10 -04:00
2024-09-09 16:39:06 -07:00
2024-08-11 19:18:52 +03:00
2024-09-17 01:07:01 -07:00
2024-09-03 21:15:28 -07:00
2024-09-03 21:15:59 -07:00
2024-08-11 17:04:29 +01:00
2024-09-01 20:25:51 -07:00
2024-09-03 21:15:44 -07:00
2024-09-23 08:58:31 -07:00
2024-09-01 20:25:59 -07:00
2024-09-23 11:07:55 +02:00
2024-08-09 12:44:50 +02:00
2024-08-17 13:55:50 +08:00
2024-09-13 07:36:02 +02:00
2024-09-03 11:36:43 +02:00
2024-10-01 10:48:52 +02:00
2024-09-26 13:03:03 +02:00
2024-09-12 12:20:41 +02:00
2024-08-13 10:58:58 +02:00
2024-09-20 19:31:03 -04:00
2024-09-23 15:03:29 -04:00
2024-10-03 16:19:13 -04:00
2024-09-23 15:03:29 -04:00
2024-09-23 15:03:30 -04:00
2024-10-03 16:19:43 -04:00
2024-08-18 10:08:00 -07:00
2024-09-03 21:15:32 -07:00
2024-09-03 21:15:28 -07:00
2024-08-22 13:25:07 -07:00
2024-08-26 08:11:19 -07:00
2024-08-26 09:51:32 -07:00
2024-09-11 20:53:45 -07:00
2024-08-30 10:57:24 -07:00
2024-09-01 20:25:53 -07:00
2024-09-09 16:39:04 -07:00
2024-09-20 17:53:17 -07:00
2024-09-01 20:25:59 -07:00
2024-08-13 14:16:22 +02:00
2024-08-30 08:22:38 +02:00
2024-09-23 14:08:08 -07:00
2024-08-30 14:29:30 +02:00
2024-09-19 14:25:32 -05:00
2024-09-03 17:11:05 -05:00
2024-09-19 14:25:34 -05:00
2024-08-19 13:45:03 +02:00
2024-10-17 00:28:07 -07:00
2024-09-18 15:03:58 +02:00
2024-09-09 16:39:18 -07:00
2024-09-17 01:06:59 -07:00
2024-08-23 13:04:34 +01:00
2024-08-23 13:04:34 +01:00
2024-09-11 11:06:11 +01:00
2024-09-03 13:00:50 +02:00
2024-08-20 11:19:49 +02:00
2024-09-03 23:20:28 +02:00
2024-08-21 14:56:25 +02:00
2024-08-04 13:36:28 -07:00
2024-08-26 13:33:50 -07:00
2024-10-02 17:23:23 -04:00
2024-09-08 18:40:33 +01:00
2024-09-05 11:14:14 +02:00
2024-09-01 20:43:38 -07:00
2024-09-05 16:56:15 +02:00
2024-09-09 00:03:55 +05:30
2024-09-09 00:09:47 +05:30
2024-09-18 08:53:53 +02:00
2024-09-18 08:53:53 +02:00
2024-08-05 14:34:23 -07:00
2024-08-13 12:45:01 +01:00
2024-08-28 11:13:08 +02:00
2024-08-27 10:28:55 +02:00
2024-08-14 16:59:28 -04:00
2024-09-09 16:39:03 -07:00
2024-08-26 13:16:20 +02:00
2024-09-20 00:20:06 -06:00
2024-10-17 09:58:07 +02:00
2024-08-28 21:54:13 +01:00
2024-10-09 12:47:18 -07:00
2024-09-22 13:35:36 -07:00
2024-08-07 13:13:35 +02:00
2024-08-21 14:56:23 +02:00
2024-09-11 15:47:13 +02:00
2024-09-17 01:07:00 -07:00
2024-08-23 13:04:34 +01:00
2024-09-09 16:39:12 -07:00
2024-09-11 20:44:31 -07:00
2024-09-11 20:44:31 -07:00
2024-09-21 07:29:05 -07:00
2024-09-18 07:52:24 +02:00
2024-09-11 20:44:32 -07:00
2024-08-12 23:50:58 +05:30
2024-09-10 16:42:11 -07:00
2024-09-05 09:50:16 -07:00
2024-09-19 10:18:15 +02:00
2024-08-08 19:59:06 -07:00
2024-09-03 21:15:47 -07:00
2024-09-05 11:39:17 +02:00
2024-08-26 19:14:48 -04:00
2024-10-11 10:49:32 +02:00
2024-08-26 13:16:20 +02:00
2024-08-23 15:42:58 +02:00
2024-09-08 20:47:40 +02:00
2024-10-02 17:23:23 -04:00
2024-08-09 09:43:46 -07:00
2024-09-25 23:23:44 +09:00
2024-09-22 11:19:35 -07:00
2024-08-06 13:42:40 +02:00
2024-09-12 12:20:39 +02:00
2024-10-02 17:23:23 -04:00
2024-08-20 14:05:33 -04:00
2024-09-17 01:07:01 -07:00
2024-09-03 09:54:39 +02:00
2024-09-12 12:16:09 +02:00
2024-09-01 20:25:53 -07:00
2024-09-10 02:51:48 -04:00
2024-10-02 17:21:59 -07:00
2024-08-02 09:20:28 +01:00
2024-08-15 19:14:19 -07:00
2024-09-09 16:39:04 -07:00
2024-09-01 20:25:43 -07:00
2024-09-03 21:15:36 -07:00
2024-08-21 06:37:39 -10:00
2024-09-21 07:29:05 -07:00
2024-09-01 20:43:27 -07:00
2024-09-09 16:39:06 -07:00
2024-09-01 20:26:02 -07:00