Dragos Tatulea
df5135fced
net/mlx5e: SHAMPO, Allow high order pages in zerocopy mode
Allow high order pages only when SHAMPO mode is enabled (hw-gro) and the
queue is used for zerocopy (has memory provider ops set). The limit is
128K and it was chosen for the following reasons:
- 256K size requires a special case during MTT calculation to split the
page in two. That's because two MTTs are needed to form an octword.
- Higher sizes require increasing WQE size and/or reducing the number
of WQEs.
- Having the RQ lined with too few large pages can lead to refill
issues.
Results show an increase in BW and a decrease in CPU usage.
The benchmark was done with the zcrx samples from liburing [0].
rx_buf_len=4K, oncpu [1]:
packets=3358832 (MB=820027), rps=55794 (MB/s=13621)
Average: CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle
Average: 9 1.56 0.00 18.09 13.42 0.00 66.80 0.00 0.00 0.00 0.12
rx_buf_len=128K, oncpu [2]:
packets=3781376 (MB=923187), rps=62813 (MB/s=15335)
Average: CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle
Average: 9 0.33 0.00 7.61 18.86 0.00 73.08 0.00 0.00 0.00 0.12
rx_buf_len=4K, offcpu [3]:
packets=3460368 (MB=844816), rps=57481 (MB/s=14033)
Average: CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle
Average: 9 0.00 0.00 0.26 0.00 0.00 92.63 0.00 0.00 0.00 7.11
Average: 11 3.04 0.00 68.09 28.87 0.00 0.00 0.00 0.00 0.00 0.00
rx_buf_len=128K, offcpu [4]:
packets=4119840 (MB=1005820), rps=68435 (MB/s=16707)
Average: CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle
Average: 9 0.00 0.00 0.87 0.00 0.00 63.77 0.00 0.00 0.00 35.36
Average: 11 1.96 0.00 43.68 54.37 0.00 0.00 0.00 0.00 0.00 0.00
[0] https://github.com/isilence/liburing/tree/zcrx/rx-buf-len
[1] commands:
$> taskset -c 9 ./zcrx 6 -i eth2 -q 9 -A 1 -B 4096 -S 33554432
$> ./send-zerocopy tcp -6 -D 2001:db8::1 -t 60 -C 0 -l 1 -b 1 -n 1 -z 1 -d -s 256000
[2] commands:
$> taskset -c 9 ./zcrx 6 -i eth2 -q 9 -A 1 -B 131072 -S 33554432
$> ./send-zerocopy tcp -6 -D 2001:db8::1 -t 60 -C 0 -l 1 -b 1 -n 1 -z 1 -d -s 256000
[3] commands:
$> taskset -c 11 ./zcrx 6 -i eth2 -q 9 -A 1 -B 4096 -S 33554432
$> ./send-zerocopy tcp -6 -D 2001:db8::1 -t 60 -C 0 -l 1 -b 1 -n 1 -z 1 -d -s 256000
[4] commands:
$> taskset -c 11 ./zcrx 6 -i eth2 -q 9 -A 1 -B 131072 -S 33554432
$> ./send-zerocopy tcp -6 -D 2001:db8::1 -t 60 -C 0 -l 1 -b 1 -n 1 -z 1 -d -s 256000
Signed-off-by: Dragos Tatulea <dtatulea@nvidia.com>
Reviewed-by: Cosmin Ratiu <cratiu@nvidia.com>
Signed-off-by: Tariq Toukan <tariqt@nvidia.com>
Link: https://patch.msgid.link/20260223204155.1783580-16-tariqt@nvidia.com
Signed-off-by: Paolo Abeni <pabeni@redhat.com>
2026-02-26 10:54:24 +01:00
..
2026-02-17 09:11:04 -08:00
2026-02-18 14:28:57 -08:00
2026-02-17 09:11:04 -08:00
2026-02-12 17:12:43 -08:00
2026-02-19 10:39:08 -08:00
2026-02-12 12:13:01 -08:00
2026-02-18 14:11:47 -08:00
2026-02-17 08:48:45 -08:00
2026-02-17 09:30:52 -08:00
2026-02-17 09:11:04 -08:00
2026-02-03 20:58:13 -06:00
2026-02-18 20:50:32 -08:00
2026-02-16 09:30:44 -08:00
2026-02-10 19:01:45 -08:00
2026-02-17 09:11:04 -08:00
2026-02-11 18:27:08 -08:00
2026-02-18 14:11:47 -08:00
2026-02-13 15:39:15 -08:00
2026-02-12 16:33:05 -08:00
2026-02-18 20:50:32 -08:00
2026-02-17 11:47:17 -08:00
2026-02-12 15:52:39 -08:00
2026-02-17 17:06:51 -08:00
2026-02-10 18:14:36 -08:00
2026-02-12 15:43:02 -08:00
2026-02-17 09:11:04 -08:00
2026-01-22 17:08:06 +08:00
2026-01-27 16:35:36 +01:00
2026-01-27 16:04:08 +01:00
2026-02-13 12:02:18 -08:00
2026-02-18 20:50:32 -08:00
2026-02-15 08:24:19 -08:00
2026-02-14 11:07:12 +01:00
2026-02-12 12:13:01 -08:00
2026-02-10 20:45:30 -08:00
2026-02-17 09:11:04 -08:00
2026-02-17 09:11:04 -08:00
2026-01-31 00:05:22 +01:00
2026-02-02 17:08:30 +01:00
2026-02-12 17:05:20 -08:00
2026-02-15 08:24:19 -08:00
2026-01-30 16:46:45 +01:00
2026-02-12 19:17:44 -08:00
2026-02-16 09:30:44 -08:00
2026-02-16 11:15:19 -08:00
2026-02-10 20:45:30 -08:00
2026-01-27 15:54:09 +01:00
2026-02-17 08:48:45 -08:00
2026-02-12 12:13:01 -08:00
2026-01-23 21:32:34 -05:00
2026-02-16 11:05:44 -08:00
2026-02-17 09:11:04 -08:00
2026-02-16 09:30:44 -08:00
2026-01-27 15:53:30 +01:00
2026-02-13 15:06:58 -08:00
2026-02-05 17:07:37 +01:00
2026-02-26 10:54:24 +01:00
2026-02-06 20:54:50 -08:00
2026-01-26 12:26:01 +01:00
2026-02-04 13:16:40 -06:00
2026-02-17 08:48:45 -08:00
2026-02-17 09:11:04 -08:00
2026-02-12 12:13:01 -08:00
2026-01-27 10:58:50 +05:30
2026-02-10 21:42:10 -08:00
2026-02-12 16:33:05 -08:00
2026-01-27 16:36:52 -06:00
2026-02-03 19:43:52 +00:00
2026-02-17 11:40:04 -08:00
2026-02-16 09:35:24 -08:00
2026-02-17 09:36:43 -08:00
2026-02-06 10:10:39 -08:00
2026-02-12 18:24:37 -08:00
2026-02-12 14:49:14 +01:00
2026-01-27 15:54:27 +01:00
2026-02-12 12:13:01 -08:00
2026-02-11 17:43:59 -08:00
2026-01-31 16:16:07 -08:00
2026-02-10 18:14:36 -08:00
2026-02-16 11:05:44 -08:00
2026-02-03 09:23:12 -07:00
2026-01-24 16:53:02 +01:00
2026-02-16 09:30:44 -08:00
2026-02-12 15:43:02 -08:00
2026-02-13 12:02:18 -08:00
2026-01-27 15:53:49 +01:00
2026-02-17 11:40:04 -08:00
2026-02-17 10:07:13 -08:00
2026-02-17 09:11:04 -08:00
2026-01-23 19:24:39 +01:00
2026-02-17 09:20:58 -08:00
2026-02-12 15:43:02 -08:00
2026-02-18 14:33:18 -08:00
2026-02-17 09:36:43 -08:00
2026-02-17 09:30:52 -08:00
2026-02-12 15:43:02 -08:00
2026-02-17 09:36:43 -08:00
2026-02-09 12:21:32 -05:00
2026-02-12 15:52:39 -08:00
2026-02-13 12:02:18 -08:00
2026-02-16 11:10:33 -08:00
2026-02-15 10:20:37 -08:00
2026-02-13 12:02:18 -08:00
2026-02-16 12:21:22 -08:00
2026-02-10 19:01:45 -08:00
2026-02-04 20:45:26 +05:30