Peilin Ye 880442305a
bpf: Introduce load-acquire and store-release instructions ...
Introduce BPF instructions with load-acquire and store-release
semantics, as discussed in [1]. Define 2 new flags:
#define BPF_LOAD_ACQ 0x100
#define BPF_STORE_REL 0x110
A "load-acquire" is a BPF_STX | BPF_ATOMIC instruction with the 'imm'
field set to BPF_LOAD_ACQ (0x100).
Similarly, a "store-release" is a BPF_STX | BPF_ATOMIC instruction with
the 'imm' field set to BPF_STORE_REL (0x110).
Unlike existing atomic read-modify-write operations that only support
BPF_W (32-bit) and BPF_DW (64-bit) size modifiers, load-acquires and
store-releases also support BPF_B (8-bit) and BPF_H (16-bit). As an
exception, however, 64-bit load-acquires/store-releases are not
supported on 32-bit architectures (to fix a build error reported by the
kernel test robot).
An 8- or 16-bit load-acquire zero-extends the value before writing it to
a 32-bit register, just like ARM64 instruction LDARH and friends.
Similar to existing atomic read-modify-write operations, misaligned
load-acquires/store-releases are not allowed (even if
BPF_F_ANY_ALIGNMENT is set).
As an example, consider the following 64-bit load-acquire BPF
instruction (assuming little-endian):
db 10 00 00 00 01 00 00 r0 = load_acquire((u64 *)(r1 + 0x0))
opcode (0xdb): BPF_ATOMIC | BPF_DW | BPF_STX
imm (0x00000100): BPF_LOAD_ACQ
Similarly, a 16-bit BPF store-release:
cb 21 00 00 10 01 00 00 store_release((u16 *)(r1 + 0x0), w2)
opcode (0xcb): BPF_ATOMIC | BPF_H | BPF_STX
imm (0x00000110): BPF_STORE_REL
In arch/{arm64,s390,x86}/net/bpf_jit_comp.c, have
bpf_jit_supports_insn(..., /*in_arena=*/true) return false for the new
instructions, until the corresponding JIT compiler supports them in
arena.
[1] https://lore.kernel.org/all/20240729183246.4110549-1-yepeilin@google.com/
Acked-by: Eduard Zingerman <eddyz87@gmail.com >
Acked-by: Ilya Leoshkevich <iii@linux.ibm.com >
Cc: kernel test robot <lkp@intel.com >
Signed-off-by: Peilin Ye <yepeilin@google.com >
Link: https://lore.kernel.org/r/a217f46f0e445fbd573a1a024be5c6bf1d5fe716.1741049567.git.yepeilin@google.com
Signed-off-by: Alexei Starovoitov <ast@kernel.org >
2025-03-15 11:48:28 -07:00
2024-07-31 13:56:00 +02:00
2021-12-21 15:09:46 -08:00
2024-06-20 11:52:56 +02:00
2021-09-13 14:51:10 -05:00
2024-04-15 13:42:38 +02:00
2022-11-17 22:49:39 +01:00
2024-11-03 20:33:43 +00:00
2024-10-16 09:32:40 +02:00
2022-06-28 21:26:05 +02:00
2025-01-09 14:42:16 +01:00
2022-06-28 21:26:05 +02:00
2023-08-22 15:13:20 +02:00
2022-06-28 21:26:05 +02:00
2022-08-09 19:51:05 +02:00
2023-04-27 18:49:24 -04:00
2025-01-13 07:36:29 -08:00
2024-09-11 11:23:56 +02:00
2024-07-29 01:19:51 +01:00
2021-06-16 17:47:53 +02:00
2024-02-19 10:58:24 +00:00
2024-12-04 16:08:34 +01:00
2022-04-29 14:38:03 -07:00
2022-11-23 19:55:22 +01:00
2023-06-20 14:28:17 -06:00
2022-05-13 10:56:10 +02:00
2021-11-01 13:36:08 +00:00
2022-11-04 16:56:41 +01:00
2022-08-11 10:31:19 -07:00
2022-12-22 18:18:37 -08:00
2023-03-10 21:05:16 +01:00
2024-12-18 17:00:29 -08:00
2023-05-30 16:42:00 -07:00
2024-08-30 08:22:36 +02:00
2024-02-16 12:42:59 +11:00
2024-10-05 18:23:38 +02:00
2021-02-15 18:28:30 +01:00
2024-08-28 06:53:58 -07:00
2024-09-11 10:45:28 -06:00
2021-04-02 11:18:30 -06:00
2023-07-24 20:11:54 -06:00
2025-03-15 11:48:28 -07:00
2025-02-05 16:17:59 -08:00
2024-07-11 15:33:28 +02:00
2024-11-11 14:34:22 +01:00
2022-05-18 00:11:18 +08:00
2024-02-13 11:47:13 +01:00
2023-06-06 17:05:54 -04:00
2022-05-15 18:31:28 -06:00
2022-09-24 08:50:04 +02:00
2024-08-08 15:23:21 +02:00
2023-07-14 08:43:49 -10:00
2024-05-24 10:36:55 +01:00
2021-11-26 16:48:59 +01:00
2022-06-28 21:26:05 +02:00
2024-08-28 06:53:58 -07:00
2023-10-16 11:38:56 -04:00
2024-10-05 13:22:04 +08:00
2024-04-30 08:48:10 -07:00
2022-01-26 14:49:46 +01:00
2022-06-28 21:26:05 +02:00
2023-01-20 09:33:22 +00:00
2024-04-08 14:10:45 +01:00
2021-10-18 12:28:53 -07:00
2023-07-20 17:24:57 -05:00
2024-06-11 12:57:49 -05:00
2023-03-06 15:49:07 -06:00
2025-01-17 22:23:47 +01:00
2022-06-28 21:26:05 +02:00
2022-06-20 18:21:25 +02:00
2024-06-05 14:52:15 +05:30
2024-11-04 18:11:47 -08:00
2021-03-18 17:03:54 +01:00
2022-08-29 15:32:13 +02:00
2022-06-03 20:09:27 +08:00
2023-08-23 14:17:42 -07:00
2024-11-27 11:19:09 -08:00
2025-01-17 20:01:09 -08:00
2025-01-14 11:44:19 +01:00
2025-02-06 16:35:21 -08:00
2023-06-15 14:55:15 +02:00
2024-02-14 11:01:01 +00:00
2024-09-18 07:40:56 +09:00
2023-04-19 23:39:42 -04:00
2024-11-01 01:19:00 +00:00
2024-08-28 16:53:57 +02:00
2024-12-10 12:03:17 +01:00
2024-01-27 18:08:54 -08:00
2024-12-18 17:00:29 -08:00
2021-04-20 08:59:03 -06:00
2024-12-19 16:02:21 +01:00
2024-12-22 11:29:50 +01:00
2023-06-06 07:54:00 +09:00
2023-03-16 21:20:32 -07:00
2025-01-20 20:27:33 -08:00
2023-09-25 22:34:33 -07:00
2023-08-09 15:43:27 +09:30
2022-02-17 09:09:37 +01:00
2025-01-24 11:54:08 +01:00
2023-09-21 19:22:05 +02:00
2022-08-10 13:49:50 +01:00
2024-02-15 08:44:57 +01:00
2023-10-27 09:21:13 +02:00
2024-05-07 01:35:57 +02:00
2023-05-24 22:05:24 -07:00
2023-10-27 18:04:30 +08:00
2022-09-20 11:53:32 +01:00
2024-08-29 10:39:37 +02:00
2023-03-10 21:05:16 +01:00
2022-02-18 13:08:18 +00:00
2021-11-15 07:53:10 -08:00
2021-11-15 07:53:10 -08:00
2021-06-03 15:31:34 -07:00
2024-05-06 11:13:56 +02:00
2023-10-04 13:00:34 +05:30
2022-02-18 21:20:06 -08:00
2022-10-28 12:36:34 +08:00
2022-06-28 21:26:05 +02:00
2021-07-29 15:06:50 +01:00
2021-05-07 00:26:34 -07:00
2023-12-20 11:27:20 +00:00
2022-09-15 09:08:09 +02:00
2021-03-10 12:45:16 -08:00
2025-01-07 15:39:09 -08:00
2022-08-18 20:37:35 -07:00
2024-08-26 09:37:22 -07:00
2022-06-28 21:26:05 +02:00
2024-04-02 18:24:33 -07:00
2022-12-12 09:29:56 +00:00
2024-04-01 10:49:28 +01:00
2024-07-25 11:57:27 +02:00
2022-06-28 21:26:05 +02:00
2024-02-27 18:22:49 -08:00
2024-09-04 16:40:33 -07:00
2024-12-05 10:01:09 +01:00
2024-08-26 09:37:23 -07:00
2024-03-06 13:13:00 +01:00
2025-01-15 16:26:41 +02:00
2022-07-17 07:52:46 -07:00
2025-01-10 17:12:42 -07:00
2024-02-28 11:19:41 +00:00
2024-08-22 10:45:12 +02:00
2023-01-06 19:22:53 -08:00
2025-01-21 13:55:49 -04:00
2023-08-15 10:06:49 -06:00
2022-06-28 21:26:05 +02:00
2024-12-05 10:01:09 +01:00
2022-10-17 09:51:26 -05:00
2021-10-05 06:54:16 -05:00
2024-12-05 10:01:28 +01:00
2023-07-28 13:30:51 -07:00
2022-06-28 21:26:05 +02:00
2023-03-16 15:18:02 +01:00
2022-06-28 21:26:05 +02:00
2022-06-28 21:26:05 +02:00
2024-06-01 07:28:21 +02:00
2024-09-01 20:26:05 -07:00
2024-04-23 14:59:01 +10:00
2024-10-22 17:51:20 -04:00
2024-10-28 16:41:33 -04:00
2021-06-17 14:25:39 -04:00
2024-12-18 14:19:37 -08:00
2022-09-20 09:13:38 +02:00
2024-09-16 23:50:52 +02:00
2024-09-12 20:28:46 -07:00
2022-05-25 09:51:36 -07:00
2022-07-08 10:46:53 -07:00
2022-05-10 06:30:05 -06:00
2024-08-19 22:36:26 -04:00
2022-08-29 10:44:08 +02:00
2024-05-08 17:29:24 -04:00
2021-03-10 09:34:06 +01:00
2021-03-24 08:26:29 +01:00
2021-10-21 23:36:28 +02:00
2024-02-22 13:32:55 +01:00
2025-01-16 17:22:59 -08:00
2024-11-05 13:26:42 +02:00
2023-05-25 16:21:22 +02:00
2023-03-23 17:25:46 +01:00
2023-12-15 17:01:30 +01:00
2023-01-07 11:29:29 +01:00
2023-01-18 17:12:37 -08:00
2024-02-22 10:24:46 -08:00
2022-06-28 21:26:05 +02:00
2024-07-19 20:22:12 +02:00
2022-01-11 18:45:02 -08:00
2024-11-14 17:03:25 +01:00
2024-12-27 11:16:21 -08:00
2024-04-11 08:19:54 -07:00
2022-02-19 16:05:54 +00:00
2021-06-30 15:34:04 -06:00
2024-09-06 08:31:40 -06:00
2022-06-28 21:26:05 +02:00
2022-11-03 20:46:32 -07:00
2022-06-28 21:26:05 +02:00
2024-10-10 08:30:22 -07:00
2024-12-16 12:51:40 +00:00
2021-06-18 13:02:45 -07:00
2024-11-11 18:45:05 -08:00
2022-09-07 16:46:03 +02:00
2023-10-20 11:43:35 +01:00
2024-08-12 17:50:34 -07:00
2024-11-07 10:21:58 +01:00
2025-01-21 15:30:01 -05:00
2022-03-13 12:59:35 -04:00
2024-05-06 12:47:24 -04:00
2024-07-08 14:10:05 -04:00
2021-09-14 11:11:20 +02:00
2021-10-21 17:25:17 +02:00
2025-01-13 15:34:09 +01:00
2023-09-27 09:40:02 +02:00
2024-09-16 11:15:26 +02:00
2023-11-28 19:05:16 +00:00
2025-01-08 13:18:11 +01:00
2022-05-20 06:17:33 -06:00
2022-02-27 10:58:04 -08:00
2024-07-05 17:45:47 -07:00
2024-04-25 12:37:12 -07:00
2023-03-23 12:22:19 +09:00
2025-01-23 13:05:06 -06:00
2025-01-21 09:44:14 -06:00
2024-11-05 12:55:43 +01:00
2021-12-23 09:32:51 +01:00
2021-12-27 17:12:58 +01:00
2024-10-24 13:54:51 +02:00
2024-08-14 20:37:47 -07:00
2024-10-04 15:37:54 -07:00
2023-06-07 14:26:09 -06:00
2025-01-08 13:18:09 +01:00
2022-12-01 03:22:20 +00:00
2024-11-27 11:19:09 -08:00
2024-07-05 17:45:47 -07:00
2024-10-24 16:30:33 -07:00
2023-07-20 22:14:21 +12:00
2024-08-14 13:05:42 -04:00
2024-09-08 18:40:33 +01:00
2023-04-16 14:23:07 +02:00
2023-08-09 09:15:39 +02:00
2024-07-19 20:22:48 +02:00
2023-12-20 19:26:31 -05:00
2022-05-09 14:00:07 +02:00
2024-08-14 16:42:58 +03:00
2022-06-28 21:26:05 +02:00
2023-01-06 19:28:01 -08:00
2023-07-15 11:35:02 -07:00
2022-12-27 12:52:12 +01:00
2022-03-23 19:58:40 +01:00
2025-01-09 12:54:45 +01:00
2024-06-18 10:09:17 -10:00
2023-03-09 11:31:44 +01:00
2023-07-17 16:08:08 -07:00
2024-12-18 17:00:29 -08:00
2024-10-22 08:16:40 -06:00
2022-08-03 16:29:08 -07:00
2022-09-20 12:33:22 +02:00
2022-06-28 21:26:05 +02:00
2023-10-10 08:51:10 +02:00
2023-09-18 11:14:42 +02:00
2024-01-27 18:15:24 -08:00
2024-09-05 20:11:43 +02:00
2024-07-16 11:44:00 -04:00
2021-05-18 16:20:54 -05:00
2023-12-26 20:24:33 +00:00
2024-08-20 11:38:23 +02:00
2025-01-14 13:28:13 -08:00
2022-06-01 16:48:05 -07:00
2022-01-08 17:41:00 +09:00
2025-01-09 16:23:17 +01:00
2024-12-20 09:05:53 -08:00
2022-06-28 21:26:05 +02:00
2022-11-09 14:06:51 +01:00
2023-12-02 01:17:48 +02:00
2022-06-30 13:14:35 +02:00
2023-03-24 16:59:09 -04:00
2025-02-17 22:40:02 -08:00
2024-07-01 09:44:27 +01:00
2024-05-13 14:48:04 -07:00
2022-11-17 11:04:23 -08:00
2024-04-03 14:03:09 +02:00
2025-02-11 20:53:14 +01:00
2023-12-04 10:37:46 +01:00
2022-04-06 13:48:02 +01:00
2022-09-27 17:29:09 -07:00
2023-06-15 13:41:53 +02:00
2024-07-03 16:40:45 -04:00
2021-04-10 10:36:34 +02:00
2022-06-27 16:25:41 +02:00
2024-09-30 09:20:59 +01:00
2024-10-22 08:16:37 -06:00
2024-10-09 19:55:40 -07:00
2024-09-11 20:44:32 -07:00
2024-07-03 12:24:54 +02:00
2022-06-28 21:26:05 +02:00
2022-08-31 09:07:53 +02:00
2024-03-18 10:13:03 -04:00
2023-12-29 11:58:24 -08:00
2023-03-23 17:25:46 +01:00
2023-01-15 23:45:15 +02:00
2022-12-07 17:58:46 +01:00
2024-06-10 10:24:30 +02:00
2024-11-08 13:38:09 +01:00
2024-04-29 14:56:36 +02:00
2024-04-29 14:56:37 +02:00
2024-08-22 16:56:24 -07:00
2024-09-10 02:51:48 -04:00
2025-01-08 06:37:13 -05:00
2024-01-27 18:08:54 -08:00
2022-07-11 09:54:37 +02:00
2024-11-05 10:24:16 +00:00
2023-11-01 09:20:00 -04:00
2024-04-08 04:11:04 -04:00
2024-10-16 09:32:39 +02:00
2022-06-28 21:26:05 +02:00
2024-09-10 02:51:48 -04:00
2023-04-04 11:01:57 -04:00
2024-05-14 10:54:49 -04:00
2023-12-19 11:51:31 -07:00
2024-10-05 13:22:04 +08:00
2021-11-04 16:36:54 +01:00
2024-07-24 20:49:42 +03:00
2021-11-01 05:26:48 -04:00
2022-05-10 07:22:28 -04:00
2021-12-06 15:03:05 +01:00
2024-05-22 08:31:15 -04:00
2024-04-30 10:51:32 +02:00
2025-01-27 09:39:25 -05:00
2021-08-26 22:28:03 +02:00
2024-01-10 13:01:37 -05:00
2022-08-16 01:40:24 -04:00
2021-08-05 10:24:08 +01:00
2025-02-14 12:58:02 +01:00
2021-09-05 16:23:09 -04:00
2023-10-15 13:19:42 +01:00
2024-10-09 12:16:18 +01:00
2023-05-28 19:07:48 -06:00
2021-06-12 13:16:45 -07:00
2025-02-13 19:35:31 -08:00
2024-12-05 10:01:15 +01:00
2024-06-04 08:59:58 +02:00
880442305a