Kui-Feng Lee b671c2067a
bpf: Retire the struct_ops map kvalue->refcnt. ...
We have replaced kvalue-refcnt with synchronize_rcu() to wait for an
RCU grace period.
Maintenance of kvalue->refcnt was a complicated task, as we had to
simultaneously keep track of two reference counts: one for the
reference count of bpf_map. When the kvalue->refcnt reaches zero, we
also have to reduce the reference count on bpf_map - yet these steps
are not performed in an atomic manner and require us to be vigilant
when managing them. By eliminating kvalue->refcnt, we can make our
maintenance more straightforward as the refcount of bpf_map is now
solely managed!
To prevent the trampoline image of a struct_ops from being released
while it is still in use, we wait for an RCU grace period. The
setsockopt(TCP_CONGESTION, "...") command allows you to change your
socket's congestion control algorithm and can result in releasing the
old struct_ops implementation. It is fine. However, this function is
exposed through bpf_setsockopt(), it may be accessed by BPF programs
as well. To ensure that the trampoline image belonging to struct_op
can be safely called while its method is in use, the trampoline
safeguarde the BPF program with rcu_read_lock(). Doing so prevents any
destruction of the associated images before returning from a
trampoline and requires us to wait for an RCU grace period.
Signed-off-by: Kui-Feng Lee <kuifeng@meta.com >
Link: https://lore.kernel.org/r/20230323032405.3735486-2-kuifeng@meta.com
Signed-off-by: Martin KaFai Lau <martin.lau@kernel.org >
2023-03-22 22:51:47 -07:00
2023-01-16 09:26:05 +01:00
2023-01-25 08:55:19 -08:00
2022-11-04 12:59:25 +02:00
2023-02-08 21:53:24 +01:00
2023-02-02 13:40:23 +01:00
2023-01-16 09:26:05 +01:00
2023-02-10 10:16:42 +01:00
2023-02-24 17:18:54 -08:00
2023-01-13 08:40:41 +00:00
2023-02-27 10:04:49 -08:00
2023-01-20 18:20:38 -08:00
2023-02-22 11:05:56 -08:00
2023-02-16 13:42:22 +01:00
2022-12-28 17:19:44 +00:00
2022-09-16 06:38:50 -07:00
2023-02-22 14:21:40 -08:00
2022-08-02 15:06:57 -05:00
2023-02-26 18:31:37 +00:00
2023-02-25 15:16:23 -08:00
2023-02-24 15:11:03 -08:00
2023-02-24 15:11:03 -08:00
2023-02-27 09:47:26 -08:00
2023-02-23 10:28:29 +01:00
2023-01-02 15:10:05 +01:00
2022-08-23 18:23:15 +02:00
2023-02-25 11:30:21 -08:00
2023-02-03 10:52:49 +05:30
2023-02-24 17:12:23 -08:00
2023-02-25 15:01:32 -08:00
2023-01-09 17:00:54 +01:00
2022-10-03 21:52:33 -07:00
2022-11-14 09:35:50 -08:00
2022-12-08 13:02:37 +00:00
2023-01-06 09:16:16 -07:00
2023-02-14 08:19:38 -08:00
2023-02-23 17:09:35 -08:00
2023-02-27 10:04:49 -08:00
2023-02-24 17:29:52 -08:00
2023-02-24 12:58:55 -08:00
2023-01-27 13:45:52 +01:00
2023-02-20 09:20:55 -05:00
2023-02-24 12:58:55 -08:00
2023-02-24 12:07:00 -08:00
2022-11-07 14:02:11 +00:00
2023-02-24 12:58:55 -08:00
2022-09-17 01:40:11 +09:00
2023-02-03 21:59:41 +01:00
2023-01-24 13:41:57 +01:00
2022-12-01 15:51:32 +00:00
2022-10-21 07:55:44 +09:00
2023-02-07 12:53:53 +01:00
2023-01-12 11:22:22 +01:00
2022-07-29 18:12:35 -07:00
2022-11-30 15:59:06 -08:00
2022-08-02 12:34:03 -04:00
2022-08-02 17:14:47 -06:00
2022-11-09 10:27:10 -08:00
2022-09-29 16:38:05 -07:00
2023-02-15 19:38:50 +01:00
2023-01-19 14:46:25 +01:00
2022-09-26 12:19:12 -07:00
2022-10-12 11:00:22 -07:00
2023-01-31 14:42:10 +01:00
2022-12-07 09:43:12 -07:00
2022-09-26 19:17:28 -06:00
2022-11-21 11:39:05 -07:00
2022-12-13 10:43:59 -08:00
2022-08-22 10:07:53 -06:00
2022-08-22 10:07:53 -06:00
2022-08-22 10:07:53 -06:00
2022-12-13 10:43:59 -08:00
2023-02-23 17:09:35 -08:00
2022-08-11 16:14:29 -07:00
2023-02-22 08:27:49 +09:00
2023-03-10 11:05:28 -08:00
2022-12-04 12:59:58 -08:00
2023-02-22 12:59:32 -08:00
2022-10-25 23:19:19 -07:00
2023-03-10 08:31:42 -08:00
2022-08-23 16:08:21 -07:00
2023-03-22 22:51:47 -07:00
2022-08-04 16:57:43 -07:00
2022-08-17 11:49:23 +01:00
2023-03-07 07:49:28 -08:00
2023-03-10 16:38:05 -08:00
2023-01-18 17:12:39 -08:00
2022-11-09 12:31:16 -05:00
2023-02-03 08:20:55 -07:00
2022-09-26 19:46:29 -07:00
2023-01-31 16:02:02 +01:00
2023-01-19 09:24:29 +01:00
2022-09-26 10:13:13 -07:00
2022-09-26 10:13:13 -07:00
2022-10-31 07:12:13 -10:00
2022-11-02 08:18:27 -07:00
2022-12-12 15:48:36 -08:00
2023-02-22 06:34:08 -08:00
2022-09-15 09:32:06 -07:00
2022-09-30 14:50:11 -07:00
2023-01-13 11:48:15 +01:00
2022-10-19 09:58:49 +02:00
2023-02-21 15:27:48 -08:00
2023-02-21 15:27:48 -08:00
2022-10-10 17:53:04 -07:00
2022-11-08 17:37:20 -08:00
2022-11-02 12:39:27 -07:00
2022-09-07 21:53:49 +02:00
2022-12-02 11:11:27 +01:00
2023-01-19 15:06:42 +01:00
2023-02-24 12:17:14 -08:00
2023-01-31 12:44:20 +01:00
2023-01-31 15:01:45 +01:00
2022-12-12 18:18:34 -08:00
2023-01-19 10:16:47 +00:00
2023-01-20 11:38:15 +00:00
2022-10-17 09:51:29 -04:00
2023-01-13 11:48:15 +01:00
2023-02-09 20:19:18 +01:00
2023-02-25 11:30:21 -08:00
2023-01-18 12:27:17 +01:00
2023-02-21 18:24:12 -08:00
2023-02-13 18:35:15 +08:00
2023-02-02 22:33:25 -08:00
2023-02-10 17:33:34 -08:00
2022-10-10 19:45:17 -07:00
2022-11-30 16:13:16 -08:00
2022-09-26 19:46:07 -07:00
2023-01-30 07:37:40 -08:00
2023-02-14 14:23:06 -05:00
2023-02-08 13:37:54 +01:00
2023-01-19 16:07:40 +01:00
2022-08-23 15:02:47 -05:00
2023-02-14 14:23:06 -05:00
2023-02-14 14:23:06 -05:00
2023-02-14 14:23:06 -05:00
2023-02-14 14:23:06 -05:00
2023-02-14 14:23:06 -05:00
2022-11-24 10:39:08 +01:00
2023-02-15 12:35:20 +01:00
2022-09-07 10:38:28 +02:00
2023-02-24 17:18:54 -08:00
2023-02-03 11:06:03 +01:00
2023-01-29 15:18:33 -07:00
2023-01-29 15:18:33 -07:00
2023-01-29 15:18:33 -07:00
2023-01-29 15:18:33 -07:00
2022-09-07 17:04:49 +02:00
2022-09-01 05:15:51 +02:00
2023-02-23 14:41:48 -08:00
2023-01-05 15:12:12 +00:00
2022-10-11 18:51:11 -07:00
2023-02-02 22:50:00 -08:00
2023-02-06 19:06:58 +01:00
2023-01-26 15:28:25 +01:00
2023-02-13 11:05:12 +00:00
2022-12-13 10:33:08 -08:00
2023-01-19 09:24:28 +01:00
2022-09-29 04:40:15 +09:00
2023-02-25 12:53:42 -08:00
2022-10-04 13:31:45 -07:00
2023-02-07 12:53:53 +01:00
2022-11-22 18:50:44 -08:00
2023-02-22 18:28:03 -08:00
2023-01-19 09:24:27 +01:00
2023-01-11 06:52:43 -05:00
2023-03-22 15:11:30 -07:00
2023-02-07 18:20:00 -08:00
2023-02-24 12:58:55 -08:00
2022-11-16 15:53:33 -08:00
2023-01-05 12:08:29 -08:00
2022-09-07 21:53:50 +02:00
2022-12-13 09:47:48 -08:00
2022-12-01 10:46:54 -05:00
2023-02-23 17:09:35 -08:00
2022-11-23 10:31:13 -08:00
2023-02-20 12:33:41 -08:00
2023-01-27 14:46:31 -08:00
2023-01-24 11:49:42 +00:00
2023-02-08 13:37:54 +01:00
2022-08-22 17:16:24 -07:00
2022-08-29 12:47:15 +01:00
2023-02-02 22:33:13 -08:00
2022-11-30 14:49:40 -08:00
2023-01-30 15:55:29 +01:00
2023-01-17 18:50:06 +01:00
2022-09-04 15:31:59 +03:00
2023-01-18 22:08:38 +01:00
2022-12-20 15:24:57 +01:00
2023-02-22 10:44:31 +01:00
2023-02-13 14:16:35 +01:00
2023-02-09 16:51:30 -08:00
2023-02-24 12:47:33 -08:00
2023-01-26 15:55:38 +01:00
2022-09-13 14:04:34 +02:00
2022-12-02 13:10:36 -08:00
2023-02-02 22:33:00 -08:00
2023-02-13 15:54:27 -08:00
2023-02-23 17:09:35 -08:00
2022-08-30 10:56:22 +02:00
2022-11-18 16:59:34 +08:00
2022-12-04 16:45:02 -08:00
2023-02-16 11:34:19 -08:00
2023-02-24 12:58:55 -08:00
2023-01-17 09:29:59 +01:00
2023-02-02 21:08:32 +01:00
2023-02-16 09:33:25 +01:00
2023-01-03 19:48:43 +01:00
2022-11-03 20:46:32 -07:00
2022-09-20 08:59:18 -07:00
2022-09-20 08:59:18 -07:00
2022-11-11 18:18:05 -08:00
2023-01-27 11:19:45 +00:00
2023-02-22 12:36:25 -08:00
2022-11-30 16:13:18 -08:00
2022-10-03 14:03:21 -07:00
2022-12-30 19:57:38 +01:00
2023-02-06 13:47:40 +01:00
2022-08-16 16:38:42 +03:00
2022-11-29 16:34:15 -04:00
2023-01-29 15:17:41 -07:00
2022-12-07 06:47:13 -07:00
2022-12-11 19:30:19 -08:00
2022-11-19 10:44:16 +01:00
2022-09-01 18:04:43 +02:00
2023-02-22 13:50:13 -08:00
2023-02-24 14:34:12 -08:00
2023-02-03 15:45:23 -04:00
2022-12-16 03:54:54 -08:00
2022-08-10 09:15:16 +02:00
2022-09-08 12:59:00 -06:00
2022-09-26 13:31:20 +02:00
2023-02-01 20:54:27 -08:00
2022-10-03 14:21:44 -07:00
2023-02-05 10:57:55 +00:00
2022-09-28 14:21:53 +01:00
2022-09-19 15:08:38 +02:00
2022-12-05 22:22:34 +01:00
2023-02-24 14:34:12 -08:00
2022-11-24 17:55:05 +01:00
2022-09-15 10:28:18 +02:00
2023-01-25 09:46:49 +00:00
2023-01-26 06:59:40 -05:00
2023-01-18 17:12:51 -08:00
2022-12-01 15:53:05 -08:00
2022-11-15 00:42:02 -08:00
2023-01-18 17:12:55 -08:00
2022-12-11 19:30:20 -08:00
2023-01-05 12:21:11 -08:00
2022-11-29 09:26:07 +00:00
2023-02-18 14:34:09 -05:00
2022-09-01 18:08:44 +02:00
2023-02-02 22:50:05 -08:00
2023-02-13 10:11:20 +02:00
2022-11-30 15:58:41 -08:00
2022-10-28 13:37:23 -07:00
2022-10-03 14:03:19 -07:00
2022-10-03 14:03:21 -07:00
2022-10-03 14:03:25 -07:00
2022-11-22 17:34:43 +01:00
2023-01-27 13:45:53 +01:00
2023-02-21 08:49:16 +09:00
2022-10-03 14:02:43 -07:00
2022-11-10 13:11:58 +00:00
2023-02-07 17:58:19 -08:00
2023-01-19 21:48:38 +00:00
2023-01-30 08:03:35 +00:00
2023-01-14 07:32:42 +09:00
2023-02-13 17:01:05 -08:00
2022-11-30 14:49:42 -08:00
2022-09-16 22:27:19 +02:00
2022-10-17 16:40:58 +02:00
2023-01-06 16:37:46 +01:00
2023-02-06 15:31:05 +01:00
2022-11-22 19:38:39 -07:00
2023-01-19 09:24:28 +01:00
2023-01-19 09:24:28 +01:00
2023-02-09 16:51:30 -08:00
2023-01-31 15:01:47 +01:00
2022-12-08 21:49:25 -05:00
2023-01-27 13:45:49 +01:00
2022-10-04 12:06:58 -06:00
2023-01-10 15:53:36 -08:00
2023-02-13 11:12:31 +00:00
2022-09-12 15:23:11 +03:00
2022-10-03 11:29:10 -07:00
2023-02-23 17:09:35 -08:00
2022-10-03 14:03:29 -07:00
2022-11-08 17:37:17 -08:00
2022-11-08 17:37:22 -08:00
2022-09-11 20:25:50 -07:00
2022-11-16 09:44:26 -07:00
2023-02-10 17:33:29 -08:00
2023-01-05 16:15:26 -06:00
2023-01-27 12:31:41 +05:30
2023-02-08 09:16:07 +00:00
2023-02-20 12:46:18 -08:00
2022-11-18 13:55:07 -08:00
2022-11-24 17:12:15 +01:00
2023-02-02 22:33:27 -08:00
2022-11-30 15:58:40 -08:00
2023-02-23 17:09:35 -08:00
2023-02-23 17:09:35 -08:00
2023-02-02 22:33:24 -08:00
2022-09-19 14:35:08 +02:00
2023-02-02 22:32:54 -08:00
2023-02-02 22:33:28 -08:00
2023-01-19 09:24:30 +01:00
2023-03-17 13:45:51 +01:00
2023-02-23 14:00:10 -08:00
2023-02-24 19:20:07 -08:00
2022-08-02 12:34:04 -04:00
2022-09-02 20:34:31 -07:00
2022-09-02 20:34:31 -07:00
2022-12-05 22:22:34 +01:00
2023-01-11 16:27:23 -04:00
2022-11-07 08:42:19 +00:00
2023-02-22 14:21:40 -08:00
2022-10-24 13:44:11 -07:00
2023-03-07 23:57:19 -08:00
2022-08-22 14:26:30 +01:00
2023-02-22 21:25:23 -08:00
2023-02-20 17:25:43 -06:00
2023-02-01 21:04:09 -08:00
2022-12-10 11:01:12 -05:00
2023-02-22 14:47:20 -08:00
2023-02-14 14:22:33 -05:00
2023-02-20 09:20:21 -05:00
2023-01-19 15:55:12 -08:00
2022-10-03 14:03:15 -07:00
2022-11-18 02:15:15 +01:00
2023-02-21 14:45:22 -08:00
2022-10-25 15:15:52 -07:00
2022-08-02 17:14:49 -06:00
2022-12-28 06:26:31 -10:00
2023-02-06 19:06:59 +01:00
2023-02-06 19:06:59 +01:00
2022-08-02 19:24:24 -07:00
2023-01-25 11:48:27 +01:00
2023-01-27 13:45:28 +01:00
2023-01-30 15:55:31 +01:00
2023-01-25 11:48:28 +01:00
2022-09-28 14:11:28 +01:00
2022-11-29 10:45:53 +01:00
2023-02-24 13:31:53 -08:00
2022-10-03 17:34:32 -07:00
2022-09-26 19:46:27 -07:00
2022-11-02 12:39:27 -07:00
2022-09-26 19:46:29 -07:00
2023-02-02 22:33:22 -08:00
2022-09-11 20:25:57 -07:00
2023-01-11 16:14:22 -08:00
2022-09-26 19:46:09 -07:00
2023-02-02 22:33:34 -08:00
2022-10-03 14:03:04 -07:00
2023-02-23 17:09:35 -08:00
2023-02-02 22:33:18 -08:00
2023-01-18 17:12:39 -08:00
2022-12-02 13:04:44 -08:00
2023-01-20 13:12:00 +01:00
2023-01-16 09:26:06 +01:00
2023-01-31 09:34:41 +09:00
2023-02-25 11:48:02 -08:00
2023-02-14 07:27:32 +09:00
2023-02-14 07:27:32 +09:00
2023-02-25 09:19:23 -08:00
2022-09-05 10:16:53 +01:00
2022-12-05 09:31:46 +01:00
2023-02-02 22:50:01 -08:00
2023-01-13 11:48:17 +01:00
2022-08-30 10:56:23 +02:00
2022-12-12 16:07:04 -08:00
2023-01-18 11:57:20 +01:00
2023-02-09 16:51:40 -08:00
2023-03-07 18:19:09 -08:00
2022-11-07 17:54:57 -08:00
2023-01-18 17:12:37 -08:00
2023-02-20 17:25:43 -06:00
2023-01-04 14:44:13 -07:00
2023-01-17 19:04:17 +01:00
2023-01-10 11:07:10 -06:00
2022-10-04 20:52:38 +02:00
2023-02-13 19:17:34 +01:00
2023-02-21 18:24:12 -08:00
2022-10-28 10:00:26 +02:00
2023-01-19 09:24:28 +01:00
2022-09-11 10:52:05 +02:00
2022-12-20 03:13:45 +01:00
2022-09-19 14:35:07 +02:00
2023-01-11 15:35:11 +01:00
2022-11-08 16:42:15 +00:00
2023-01-19 14:39:04 +01:00
2022-10-30 10:12:14 +01:00
2022-09-09 11:08:33 +02:00
2022-10-17 13:14:32 -07:00
2023-01-13 08:40:41 +00:00
2022-11-11 10:58:39 +00:00
2022-10-23 18:06:54 -04:00
2023-02-22 10:55:22 +00:00
2022-12-21 09:41:28 -08:00
2022-10-24 13:30:15 +01:00
2023-01-19 09:24:29 +01:00
2022-08-14 13:31:03 -07:00
2022-12-20 03:13:45 +01:00
2023-02-10 17:32:37 -08:00
2023-01-03 17:28:33 -08:00
2023-02-02 16:33:43 -08:00
2023-01-03 17:48:40 -08:00
2023-01-03 17:48:40 -08:00
2022-10-04 15:59:36 +02:00
2023-02-17 00:08:44 +00:00
2022-11-15 14:30:41 -08:00
2022-09-28 10:46:21 -06:00
2023-01-23 17:40:30 +01:00
2022-12-09 10:42:56 +00:00
2022-11-23 19:08:30 -05:00
2023-02-13 15:54:29 -08:00
2022-10-31 18:10:21 -07:00
2022-07-30 14:01:28 -04:00
2022-09-15 16:14:02 +02:00
2022-11-11 08:38:29 -07:00
2023-03-13 12:42:24 -07:00
2023-01-19 09:49:54 +00:00
2022-11-09 18:06:35 +00:00
2022-11-17 21:43:34 -08:00
2022-12-02 11:33:48 -08:00
2023-01-19 09:24:28 +01:00
2022-12-08 09:18:58 -07:00
2022-11-22 17:53:10 +01:00
2022-09-22 16:30:14 +02:00
2023-01-19 16:04:35 +01:00
2023-01-19 15:01:19 +01:00
2022-12-15 10:37:27 -08:00
2022-10-28 21:56:18 -07:00
2023-02-09 16:51:42 -08:00
2023-02-09 15:56:51 -08:00
2023-03-20 21:57:49 -07:00
2022-12-01 01:07:32 +01:00
2023-01-18 17:12:55 -08:00
2022-12-12 09:13:06 -08:00
2023-01-18 17:12:55 -08:00
2022-10-25 11:44:20 -07:00
2022-09-02 20:34:30 -07:00
2022-09-15 16:14:02 +02:00
2022-09-15 16:14:02 +02:00
2022-09-15 16:14:02 +02:00
2022-09-15 16:14:02 +02:00
2023-01-31 20:37:18 +01:00
2023-01-03 17:49:22 -08:00
2022-08-31 05:10:15 -07:00
2023-01-03 17:49:22 -08:00
2023-02-16 20:43:52 -08:00
2022-11-18 02:18:10 +01:00
2023-01-26 07:00:06 -05:00
2022-10-17 16:41:16 +02:00
2023-01-30 07:21:25 +00:00
2023-02-09 22:30:24 -08:00
2023-01-18 17:12:47 -08:00
2022-10-10 09:10:28 -07:00
2022-09-07 12:42:25 +01:00
2022-10-03 14:03:36 -07:00
2023-01-31 17:25:17 -08:00
2022-09-26 19:46:05 -07:00
2023-01-18 17:12:38 -08:00
2023-02-16 18:10:18 +01:00
2022-10-19 09:58:49 +02:00
2022-08-08 18:06:43 -07:00
2022-09-29 15:20:29 +02:00
2022-10-28 10:47:42 +01:00
2022-09-09 10:44:35 +02:00
2023-02-02 15:26:45 +01:00
2023-01-13 11:48:16 +01:00
2022-08-31 14:05:12 +01:00
2022-08-09 20:02:13 +02:00
2022-12-01 11:35:40 +01:00
2022-11-24 15:09:12 +01:00
2022-11-17 11:26:20 +01:00
2022-09-02 14:44:54 +02:00
2023-02-07 18:20:00 -08:00
2023-01-13 17:15:17 +01:00
2023-02-13 10:11:20 +02:00
2023-02-12 10:23:39 -05:00
2023-01-31 15:01:46 +01:00
2023-02-07 12:42:54 -05:00
2023-02-07 12:49:56 -05:00
2023-02-23 10:20:49 -08:00
2023-01-20 14:22:50 +01:00
2022-11-09 13:02:16 +01:00
2022-09-22 16:12:34 +02:00
2022-11-09 13:02:16 +01:00
2023-01-19 16:04:35 +01:00
2023-01-19 16:04:35 +01:00
2023-01-19 16:04:35 +01:00
2023-01-12 20:57:43 -08:00
2023-01-20 12:06:26 +01:00
2023-02-08 15:26:58 -08:00
2023-02-08 15:26:58 -08:00
2022-11-16 09:43:35 +00:00
2023-02-22 17:12:44 -08:00
2022-09-07 21:53:48 +02:00
2022-08-28 16:52:28 +01:00
2023-01-23 15:38:08 +01:00
2022-09-29 10:17:37 -04:00
2023-01-18 17:12:53 -08:00
2023-02-23 17:55:40 -08:00
2022-10-23 12:01:01 -07:00
2023-02-03 07:23:03 +01:00
2023-02-20 19:26:58 -05:00
2022-09-21 17:32:49 -07:00
2022-09-21 14:15:10 -06:00
2023-02-09 11:43:39 -07:00
2022-08-01 07:42:49 +02:00
2023-02-15 06:46:22 -05:00
2022-12-12 09:29:56 +00:00
2022-10-07 09:32:40 -04:00
2022-08-11 04:06:40 -04:00
2023-02-20 19:26:58 -05:00
2023-01-16 13:26:33 +00:00
2023-01-27 13:45:46 +01:00
2022-11-30 15:58:41 -08:00
2023-02-09 16:51:42 -08:00
2022-09-26 19:46:18 -07:00
2023-02-20 19:26:59 -05:00
2022-09-01 16:55:35 +02:00
2022-08-26 09:30:25 -07:00
2022-11-16 11:33:03 -07:00
2022-10-07 15:00:25 +02:00
2023-01-04 12:25:29 -10:00
2023-02-02 22:33:34 -08:00
2022-11-02 11:51:03 +00:00
2023-02-02 22:33:24 -08:00
2023-01-19 09:24:28 +01:00
2022-11-30 15:58:52 -08:00
2022-10-24 12:12:32 -07:00
b671c2067a