Paul E. McKenney 448b66a7aa refscale: Add non-atomic per-CPU increment readers ...

This commit adds refscale readers based on READ_ONCE() and WRITE_ONCE()
that are unprotected (can lose counts, "refscale.scale_type=incpercpu"),
preempt-disabled ("refscale.scale_type=incpercpupreempt"),
bh-disabled ("refscale.scale_type=incpercpubh"), and irq-disabled
("refscale.scale_type=incpercpuirqsave").  On my x86 laptop, these are
about 4.3ns, 3.8ns, and 7.3ns per pair, respectively.

Signed-off-by: Paul E. McKenney <paulmck@kernel.org>
Signed-off-by: Frederic Weisbecker <frederic@kernel.org>

2025-11-07 14:37:17 +01:00

..

Kconfig

srcu: Make FORCE_NEED_SRCU_NMI_SAFE depend on RCU_EXPERT

2025-03-28 21:19:17 -07:00

Kconfig.debug

rcutorture: Move RCU_TORTURE_TEST_{CHK_RDR_STATE,LOG_CPU} to bool

2025-02-05 07:14:40 -08:00

Makefile

rcuperf: Change rcuperf to rcuscale

2020-08-24 18:39:24 -07:00

rcu_segcblist.c

rcu/nocb: Simplify (de-)offloading state machine

2024-09-09 00:03:55 +05:30

rcu_segcblist.h

rcu: Remove unused declaration rcu_segcblist_offload()

2024-10-22 15:36:56 +02:00

rcu.h

Merge branches 'rcu/misc-for-6.16', 'rcu/seq-counters-for-6.16' and 'rcu/torture-for-6.16' into rcu/for-next

2025-05-16 11:18:16 -04:00

rcuscale.c

mm: replace (20 - PAGE_SHIFT) with common macros for pages<->MB conversion

2025-09-13 16:54:42 -07:00

rcutorture.c

rcutorture: Use kcalloc() instead of kzalloc()

2025-08-22 06:26:22 -07:00

refscale.c

refscale: Add non-atomic per-CPU increment readers

2025-11-07 14:37:17 +01:00

srcutiny.c

srcu/tiny: Remove preempt_disable/enable() in srcu_gp_start_if_needed()

2025-09-15 05:16:28 -07:00

srcutree.c

srcu: Document srcu_flip() memory-barrier D relation to SRCU-fast

2025-09-15 05:16:28 -07:00

sync.c

rcu: Eliminate lockless accesses to rcu_sync->gp_count

2024-07-04 13:48:57 -07:00

tasks.h

rcu: replace use of system_wq with system_percpu_wq

2025-09-23 02:01:18 -07:00

tiny.c

Merge tag 'rcu-next-v6.15' of git://git.kernel.org/pub/scm/linux/kernel/git/rcu/linux

2025-03-24 19:41:37 -07:00

tree_exp.h

rcu/exp: Remove needless CPU up quiescent state report

2025-07-08 23:21:13 +05:30

tree_nocb.h

rcu: Fix delayed execution of hurry callbacks

2025-07-18 09:25:34 +05:30

tree_plugin.h

rcu: Remove local_irq_save/restore() in rcu_preempt_deferred_qs_handler()

2025-08-14 15:25:15 -07:00

tree_stall.h

Merge tag 'sched_ext-for-6.17' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/sched_ext

2025-07-31 16:29:46 -07:00

tree.c

Merge tag 'hyperv-next-signed-20251006' of git://git.kernel.org/pub/scm/linux/kernel/git/hyperv/linux

2025-10-07 08:40:15 -07:00

tree.h

rcu: Fix racy re-initialization of irq_work causing hangs

2025-08-11 08:43:49 +05:30

update.c

torture: Add dowarn argument to torture_sched_setaffinity()

2024-12-14 16:38:23 +01:00