Xiaoguang Wang bbde017a32
io_uring: add memory barrier to synchronize io_kiocb's result and iopoll_completed ...
In io_complete_rw_iopoll(), stores to io_kiocb's result and iopoll
completed are two independent store operations, to ensure that once
iopoll_completed is ture and then req->result must been perceived by
the cpu executing io_do_iopoll(), proper memory barrier should be used.
And in io_do_iopoll(), we check whether req->result is EAGAIN, if it is,
we'll need to issue this io request using io-wq again. In order to just
issue a single smp_rmb() on the completion side, move the re-submit work
to io_iopoll_complete().
Cc: stable@vger.kernel.org
Signed-off-by: Xiaoguang Wang <xiaoguang.wang@linux.alibaba.com >
[axboe: don't set ->iopoll_completed for -EAGAIN retry]
Signed-off-by: Jens Axboe <axboe@kernel.dk >
2020-06-17 12:49:09 -06:00
2020-03-27 09:29:56 +00:00
2020-04-20 15:45:22 -06:00
2020-04-20 15:45:22 -06:00
2020-06-11 16:04:30 -07:00
2020-03-13 21:08:17 -04:00
2020-04-20 15:45:22 -06:00
2020-06-14 09:47:25 -07:00
2020-06-01 15:45:27 -07:00
2020-06-01 13:22:53 +02:00
2020-06-12 16:31:06 -05:00
2020-05-05 09:22:21 -06:00
2020-06-01 15:45:27 -07:00
2020-04-20 15:45:22 -06:00
2020-06-01 12:10:17 -07:00
2020-04-27 09:34:55 +02:00
2020-06-05 16:43:16 -07:00
2020-06-01 15:45:27 -07:00
2020-02-23 21:59:42 +01:00
2020-06-02 20:16:55 -07:00
2020-06-09 11:24:59 -07:00
2019-11-11 09:21:59 -05:00
2020-06-09 09:39:14 -07:00
2020-06-09 10:04:47 -07:00
2020-06-09 11:28:59 -07:00
2020-06-04 19:06:25 -07:00
2020-06-03 16:27:18 -07:00
2020-06-09 15:48:24 -07:00
2020-06-08 12:47:09 -07:00
2020-06-02 15:29:19 -07:00
2020-05-22 08:45:46 -06:00
2020-03-29 23:23:00 +02:00
2020-06-06 10:08:17 -07:00
2020-06-09 09:39:14 -07:00
2020-06-13 12:44:30 -07:00
2020-06-02 15:29:19 -07:00
2020-06-05 16:19:28 -07:00
2020-02-07 14:48:37 -05:00
2020-06-02 20:11:35 -07:00
2020-06-09 09:39:14 -07:00
2020-02-04 03:05:26 +00:00
2020-06-11 12:22:41 -07:00
2020-06-11 10:33:13 -07:00
2020-06-10 19:14:17 -07:00
2020-06-14 01:57:21 +09:00
2020-06-14 01:57:21 +09:00
2020-06-02 12:21:36 -07:00
2020-06-11 18:17:47 -07:00
2020-06-02 10:59:07 -07:00
2020-06-05 16:44:36 -07:00
2020-06-09 15:40:50 -07:00
2020-06-13 13:29:16 -07:00
2020-06-01 16:18:46 -07:00
2020-06-02 10:59:07 -07:00
2020-04-27 02:07:40 -04:00
2020-02-07 14:48:37 -05:00
2020-06-04 13:53:10 -07:00
2020-06-14 01:57:21 +09:00
2020-06-02 12:21:36 -07:00
2020-06-05 14:05:57 -07:00
2020-04-20 15:45:22 -06:00
2019-12-10 22:29:58 -05:00
2020-06-02 10:59:11 -07:00
2020-06-02 15:29:19 -07:00
2020-03-25 11:50:48 +01:00
2020-05-07 08:45:47 -06:00
2020-05-12 16:44:00 -07:00
2020-06-13 12:40:24 -07:00
2020-06-04 13:50:13 -07:00
2020-06-10 19:14:18 -07:00
2019-12-08 19:10:50 -05:00
2020-06-03 23:16:55 -04:00
2020-05-07 16:55:47 -05:00
2020-06-10 16:02:54 -07:00
2020-06-10 16:02:54 -07:00
2020-06-04 19:18:29 -07:00
2020-06-10 16:02:54 -07:00
2020-06-04 19:18:29 -07:00
2020-06-04 19:18:29 -07:00
2020-06-02 15:37:03 -07:00
2020-06-02 10:59:07 -07:00
2020-05-14 16:44:23 +02:00
2020-06-05 13:45:21 -07:00
2020-06-09 09:39:14 -07:00
2020-04-02 19:15:03 -07:00
2020-06-03 16:27:18 -07:00
2020-06-14 09:47:25 -07:00
2020-04-27 02:07:40 -04:00
2020-05-06 22:33:43 -04:00
2020-05-14 10:00:35 -07:00
2020-06-09 09:39:14 -07:00
2020-03-03 10:55:06 -05:00
2020-06-03 16:27:18 -07:00
2020-05-19 18:29:36 -04:00
2020-04-10 15:36:22 -07:00
2020-05-14 16:44:25 +02:00
2020-04-02 09:35:26 -07:00
2020-06-05 16:19:28 -07:00
2020-02-07 14:48:35 -05:00
2020-06-05 16:26:36 -07:00
2020-06-05 16:19:28 -07:00
2020-06-17 12:49:09 -06:00
2020-06-15 08:51:34 -06:00
2020-06-15 08:51:38 -06:00
2020-06-03 23:16:55 -04:00
2020-06-14 01:57:21 +09:00
2020-06-14 01:57:21 +09:00
2020-05-22 08:45:46 -06:00
2020-06-11 10:33:13 -07:00
2020-03-05 21:00:40 -05:00
2020-05-14 16:44:24 +02:00
2020-06-02 10:59:07 -07:00
2020-06-08 11:04:19 -07:00
2020-06-10 16:09:11 -07:00
2020-05-13 11:41:22 +02:00
2020-06-02 12:21:36 -07:00
2020-06-13 09:56:21 -07:00
2020-04-27 10:37:14 -04:00
2020-06-08 11:04:19 -07:00
2020-06-04 13:54:34 -07:00
2020-04-03 00:09:59 +11:00
2020-05-01 20:29:54 -04:00
2020-05-29 19:10:42 -04:00
2020-06-04 19:06:25 -07:00
2020-06-13 09:56:21 -07:00
2019-12-08 14:37:36 +01:00
2020-06-02 19:45:12 -07:00
2020-06-10 16:09:11 -07:00
2020-06-09 15:40:50 -07:00
2020-01-14 12:20:53 +01:00
2020-06-09 09:39:14 -07:00
2020-05-14 16:44:24 +02:00
2020-04-09 15:33:09 -04:00
bbde017a32