Dylan Yudaken b3fdea6ecb
io_uring: multishot recv ...
Support multishot receive for io_uring.
Typical server applications will run a loop where for each recv CQE it
requeues another recv/recvmsg.
This can be simplified by using the existing multishot functionality
combined with io_uring's provided buffers.
The API is to add the IORING_RECV_MULTISHOT flag to the SQE. CQEs will
then be posted (with IORING_CQE_F_MORE flag set) when data is available
and is read. Once an error occurs or the socket ends, the multishot will
be removed and a completion without IORING_CQE_F_MORE will be posted.
The benefit to this is that the recv is much more performant.
* Subsequent receives are queued up straight away without requiring the
application to finish a processing loop.
* If there are more data in the socket (sat the provided buffer size is
smaller than the socket buffer) then the data is immediately
returned, improving batching.
* Poll is only armed once and reused, saving CPU cycles
Signed-off-by: Dylan Yudaken <dylany@fb.com >
Link: https://lore.kernel.org/r/20220630091231.1456789-11-dylany@fb.com
Signed-off-by: Jens Axboe <axboe@kernel.dk >
2022-07-24 18:39:17 -06:00
2022-06-03 11:36:34 -07:00
2021-12-21 15:09:46 -08:00
2020-07-15 20:34:11 -07:00
2022-05-16 22:03:45 +02:00
2021-09-13 14:51:10 -05:00
2021-08-23 09:49:09 -07:00
2020-01-21 11:41:36 +01:00
2022-02-21 19:33:05 +00:00
2019-09-07 17:44:25 +02:00
2021-01-25 18:44:44 +01:00
2020-05-28 11:22:14 +02:00
2022-02-10 17:29:56 -08:00
2019-10-04 14:25:17 -07:00
2020-05-04 11:30:15 -05:00
2019-10-04 14:25:17 -07:00
2019-10-04 14:25:17 -07:00
2021-10-02 15:50:45 -04:00
2020-07-21 22:05:32 -07:00
2020-11-19 11:25:47 +01:00
2022-04-19 13:13:47 +01:00
2021-06-16 17:47:53 +02:00
2022-04-19 12:20:45 +02:00
2021-03-18 09:02:27 +01:00
2022-04-29 14:38:03 -07:00
2021-10-05 16:14:10 +02:00
2019-06-26 20:14:13 -04:00
2022-05-13 10:56:10 +02:00
2018-11-19 19:03:43 -07:00
2021-11-01 13:36:08 +00:00
2019-04-25 19:33:34 +02:00
2020-07-13 17:01:44 -07:00
2022-06-03 20:09:27 +08:00
2020-08-12 10:58:00 -07:00
2019-03-07 18:32:01 -08:00
2021-05-19 11:40:15 +02:00
2021-02-06 09:22:10 +01:00
2021-02-06 09:22:10 +01:00
2019-01-04 13:13:47 -08:00
2021-02-15 18:28:30 +01:00
2021-04-02 11:18:30 -06:00
2020-10-09 12:47:02 -06:00
2022-07-08 10:55:53 +02:00
2019-07-25 11:05:10 +02:00
2022-04-03 17:06:52 -07:00
2022-05-16 17:03:16 +02:00
2022-03-14 13:13:51 +01:00
2022-05-18 00:11:18 +08:00
2021-05-27 09:42:21 +02:00
2021-07-12 15:17:47 -05:00
2021-01-12 17:31:14 +01:00
2022-05-15 18:31:28 -06:00
2021-06-02 14:08:09 +02:00
2022-04-24 07:40:13 +01:00
2020-10-29 18:39:43 -07:00
2019-10-09 22:31:14 -04:00
2020-12-04 12:06:15 +01:00
2019-07-16 19:23:23 -07:00
2019-09-25 17:51:39 -07:00
2021-11-26 16:48:59 +01:00
2020-12-15 12:13:36 -08:00
2020-09-17 18:46:04 +02:00
2022-03-18 14:04:30 +01:00
2019-08-02 14:44:02 +10:00
2022-04-22 16:12:04 -07:00
2022-01-26 14:49:46 +01:00
2019-10-28 13:41:01 -07:00
2022-05-05 15:47:23 -07:00
2021-10-18 12:28:53 -07:00
2022-02-21 15:36:33 -05:00
2022-05-17 13:05:19 +02:00
2019-12-17 21:37:40 +05:30
2021-03-18 17:03:54 +01:00
2022-06-03 20:09:27 +08:00
2022-06-03 20:09:27 +08:00
2020-07-19 19:20:22 -07:00
2022-04-15 11:41:35 -07:00
2022-05-01 17:45:35 +01:00
2020-12-03 00:12:08 -08:00
2022-04-25 14:43:03 +02:00
2022-04-04 08:55:23 +02:00
2020-05-14 16:44:25 +02:00
2021-04-20 08:59:03 -06:00
2020-05-12 19:34:52 +03:00
2020-06-05 16:19:28 -07:00
2021-02-26 09:41:03 -08:00
2019-03-27 13:30:07 -07:00
2020-07-06 21:37:08 -07:00
2021-08-02 13:37:28 -06:00
2020-11-16 11:41:12 -08:00
2022-02-21 19:38:17 +10:30
2021-01-27 15:13:52 +01:00
2022-02-17 09:09:37 +01:00
2021-02-07 14:51:19 -08:00
2021-12-14 11:09:36 +01:00
2021-10-07 13:51:11 +02:00
2019-11-05 18:20:55 -08:00
2020-10-03 14:18:29 -07:00
2021-02-08 13:01:24 +01:00
2022-05-04 11:06:13 +02:00
2019-09-04 12:43:54 +02:00
2022-03-11 08:28:05 -08:00
2018-11-16 14:09:40 +08:00
2020-11-27 15:48:31 +01:00
2020-07-27 12:20:40 -07:00
2022-02-18 13:08:18 +00:00
2021-11-15 07:53:10 -08:00
2021-11-15 07:53:10 -08:00
2021-06-03 15:31:34 -07:00
2021-03-30 13:29:39 -07:00
2022-04-11 19:36:54 +05:30
2022-02-18 21:20:06 -08:00
2020-11-06 14:29:11 +11:00
2020-05-04 11:30:15 -05:00
2021-07-29 15:06:50 +01:00
2021-05-07 00:26:34 -07:00
2022-03-17 16:49:57 -07:00
2022-03-01 18:29:27 -08:00
2021-03-10 12:45:16 -08:00
2022-05-16 10:18:55 +01:00
2020-03-16 01:42:31 -07:00
2020-11-09 16:41:40 -08:00
2020-08-22 12:44:37 -07:00
2019-03-21 13:19:15 -07:00
2022-03-11 08:28:27 -08:00
2019-04-19 13:58:17 -07:00
2020-05-01 12:24:40 -07:00
2020-07-13 15:32:56 -07:00
2020-04-20 12:43:24 -07:00
2019-01-22 17:18:09 -08:00
2021-07-21 08:14:33 -07:00
2021-08-05 11:46:42 +01:00
2020-09-03 15:17:28 -07:00
2022-04-17 13:13:53 -07:00
2022-07-17 07:52:46 -07:00
2022-07-24 18:39:17 -06:00
2021-07-21 08:14:33 -07:00
2022-02-04 20:24:45 -08:00
2021-07-21 08:14:33 -07:00
2022-02-28 13:25:48 +01:00
2021-08-18 07:23:15 -06:00
2019-07-04 02:29:49 +02:00
2021-11-01 19:57:14 -07:00
2019-07-25 11:05:10 +02:00
2020-09-15 09:57:45 -05:00
2021-10-05 06:54:16 -05:00
2022-05-31 11:36:57 +02:00
2020-07-27 16:34:12 +03:00
2019-08-22 17:24:51 +02:00
2020-01-04 13:55:09 -08:00
2020-11-16 16:27:03 +01:00
2019-03-05 21:07:14 -08:00
2020-12-15 12:13:36 -08:00
2022-06-03 20:09:27 +08:00
2020-11-04 16:43:38 +01:00
2020-05-19 15:19:06 +01:00
2022-03-15 14:25:17 -04:00
2022-01-11 15:44:27 -05:00
2021-06-17 14:25:39 -04:00
2022-07-19 08:54:11 -04:00
2021-03-03 16:55:02 -08:00
2022-05-23 13:27:59 +02:00
2019-03-07 18:31:59 -08:00
2022-05-25 09:51:36 -07:00
2022-05-10 06:30:05 -06:00
2021-07-21 08:14:33 -07:00
2022-02-21 14:57:26 +01:00
2021-03-10 09:34:06 +01:00
2021-03-24 08:26:29 +01:00
2021-10-21 23:36:28 +02:00
2022-02-09 12:00:11 +00:00
2022-05-01 17:45:35 +01:00
2020-12-14 11:47:37 -08:00
2022-04-24 08:27:37 +01:00
2020-08-18 15:44:44 +02:00
2020-09-25 14:23:27 +02:00
2021-09-03 09:58:17 -07:00
2020-05-06 17:45:45 -07:00
2020-09-15 22:13:31 +10:00
2022-01-11 18:45:02 -08:00
2021-07-26 14:45:18 +02:00
2022-06-28 20:45:43 -07:00
2022-02-19 16:05:54 +00:00
2020-09-10 12:25:51 -07:00
2021-01-23 12:38:42 -08:00
2019-01-04 13:13:47 -08:00
2019-11-15 14:38:29 +01:00
2021-06-30 15:34:04 -06:00
2018-11-17 21:09:49 -08:00
2022-03-11 15:53:13 -08:00
2022-04-13 12:46:26 +01:00
2022-02-09 17:25:57 -08:00
2018-11-27 16:20:20 -08:00
2021-12-29 12:31:36 -08:00
2021-06-18 13:02:45 -07:00
2018-10-25 10:25:22 +02:00
2018-12-01 12:38:32 +01:00
2018-12-01 12:38:32 +01:00
2018-12-01 12:38:32 +01:00
2021-10-14 23:06:28 +02:00
2022-04-13 12:46:26 +01:00
2021-03-11 16:12:59 -08:00
2021-12-27 14:58:37 +00:00
2021-01-25 09:36:25 -05:00
2022-02-25 18:50:12 -05:00
2022-03-13 12:59:35 -04:00
2019-04-25 14:18:14 -04:00
2020-10-02 09:37:41 -04:00
2019-07-12 11:05:40 -07:00
2021-09-14 11:11:20 +02:00
2021-10-21 17:25:17 +02:00
2022-05-04 22:50:01 +02:00
2022-05-20 06:17:33 -06:00
2022-02-27 10:58:04 -08:00
2021-01-04 11:42:26 -05:00
2022-03-10 20:14:52 -08:00
2022-04-25 10:53:38 +01:00
2021-07-06 10:37:46 -05:00
2022-03-22 13:06:49 -07:00
2021-12-23 09:32:51 +01:00
2021-12-27 17:12:58 +01:00
2019-10-02 20:32:27 -06:00
2020-09-04 12:34:50 +02:00
2022-04-20 11:09:13 +01:00
2021-10-20 15:24:36 -07:00
2019-01-22 10:21:45 +01:00
2019-07-30 20:34:34 +02:00
2019-12-01 14:00:59 -08:00
2020-12-21 17:36:48 -08:00
2022-04-22 18:50:54 +01:00
2021-03-25 15:31:22 -07:00
2022-02-21 16:02:55 +00:00
2020-04-30 15:19:33 +10:00
2020-07-19 19:22:56 -07:00
2022-03-18 09:44:19 -05:00
2020-01-07 16:07:01 -05:00
2020-06-25 16:26:25 -07:00
2022-02-17 09:09:38 +01:00
2020-08-04 20:16:37 -07:00
2021-12-10 17:10:55 -08:00
2022-05-09 14:00:07 +02:00
2021-04-06 10:29:56 +02:00
2020-03-29 22:30:57 -07:00
2021-01-25 15:14:16 -08:00
2020-11-24 10:10:59 -06:00
2022-03-13 11:49:53 -05:00
2022-02-02 13:11:34 +01:00
2022-03-23 19:58:40 +01:00
2022-03-17 16:49:57 -07:00
2020-10-05 16:35:57 +01:00
2019-12-04 19:44:12 -08:00
2020-02-12 17:57:51 -05:00
2021-06-22 11:28:51 -07:00
2022-05-03 14:11:58 -07:00
2019-11-04 07:11:31 -07:00
2020-08-03 17:57:40 -07:00
2021-06-18 11:35:47 -07:00
2019-11-15 14:38:29 +01:00
2022-02-26 10:03:21 +01:00
2021-07-27 12:05:46 +02:00
2021-03-10 09:34:06 +01:00
2020-03-24 15:59:34 -07:00
2022-04-07 16:47:12 +02:00
2019-11-15 14:38:29 +01:00
2021-05-18 16:20:54 -05:00
2022-02-02 07:42:41 -08:00
2022-02-11 11:14:58 +00:00
2021-12-01 19:06:09 -08:00
2020-02-27 18:50:19 -08:00
2022-06-01 16:48:05 -07:00
2019-04-19 14:07:40 -07:00
2022-01-08 17:41:00 +09:00
2020-12-03 10:03:14 -08:00
2022-03-31 13:04:44 -07:00
2020-02-21 11:22:15 -08:00
2020-01-15 11:00:39 -06:00
2021-11-01 19:57:14 -07:00
2021-08-03 07:27:42 -04:00
2022-06-01 15:55:25 -07:00
2021-02-11 18:25:05 -08:00
2022-04-26 10:17:03 +02:00
2021-01-07 16:17:32 +01:00
2022-02-03 19:50:49 +01:00
2019-12-18 18:07:33 +01:00
2020-02-21 11:22:15 -08:00
2019-12-18 18:07:33 +01:00
2022-04-06 13:48:02 +01:00
2020-09-18 13:58:37 -07:00
2020-09-18 13:58:37 -07:00
2022-06-09 21:51:57 -07:00
2021-04-10 10:36:34 +02:00
2022-06-27 15:56:10 +02:00
2022-05-25 10:08:59 -07:00
2019-12-09 09:59:07 +01:00
2020-03-29 23:29:08 +02:00
2019-05-22 10:36:35 -07:00
2019-08-14 16:52:13 +02:00
2022-05-13 07:20:11 -07:00
2019-11-15 14:38:29 +01:00
2022-01-20 08:52:54 +02:00
2021-03-22 10:24:07 +01:00
2018-11-20 13:22:40 -05:00
2022-04-24 08:35:01 +01:00
2020-09-26 10:22:29 +02:00
2021-03-22 10:22:22 +01:00
2020-07-10 13:45:32 +02:00
2020-07-10 13:45:32 +02:00
2022-05-31 12:44:20 -04:00
2021-09-06 07:20:58 -04:00
2020-06-03 11:27:43 +02:00
2020-10-07 14:23:44 -06:00
2022-05-16 12:39:43 -06:00
2022-05-31 12:44:29 -04:00
2022-05-31 12:44:31 -04:00
2022-05-17 09:36:03 +02:00
2020-08-05 09:30:19 -04:00
2020-08-05 09:30:20 -04:00
2020-08-05 11:08:39 -04:00
2021-04-08 12:26:34 +02:00
2022-03-28 16:52:58 -04:00
2020-08-05 11:08:39 -04:00
2022-03-28 16:52:58 -04:00
2020-09-10 11:39:22 +02:00
2021-11-04 16:36:54 +01:00
2021-09-29 09:22:29 +02:00
2021-11-01 05:26:48 -04:00
2022-05-10 07:22:28 -04:00
2020-08-05 11:08:40 -04:00
2021-12-06 15:03:05 +01:00
2021-11-10 15:32:38 +01:00
2020-09-10 10:05:58 +02:00
2020-08-05 11:08:41 -04:00
2020-09-10 10:05:58 +02:00
2021-08-26 22:28:03 +02:00
2020-08-05 11:08:40 -04:00
2020-06-02 02:45:13 -04:00
2021-08-05 10:24:08 +01:00
2020-08-05 11:08:40 -04:00
2021-03-07 09:07:16 +01:00
2021-09-05 16:23:09 -04:00
2021-10-08 16:21:53 +01:00
2019-07-25 11:05:10 +02:00
2019-08-01 21:49:46 +02:00
2020-05-19 15:19:06 +01:00
2019-12-16 19:22:22 -08:00
2020-07-31 09:24:23 +02:00
2019-07-25 11:05:10 +02:00
2021-06-12 13:16:45 -07:00
2020-06-12 13:23:34 -04:00
2020-07-13 15:32:56 -07:00
2022-02-09 09:00:40 +01:00
b3fdea6ecb