kernel/rcu/update.c

50 #include "rcu.h"
68  * rcu_read_lock_held_common() - might we be in RCU-sched read-side critical section?
77  * RCU-sched read-side critical section.  In absence of
78  * CONFIG_DEBUG_LOCK_ALLOC, this assumes we are in an RCU-sched read-side
80  * of preemption (including disabling irqs) counts as an RCU-sched
82  * that required that they be called within an RCU-sched read-side
88  * Note that if the CPU is in the idle loop from an RCU point of view (ie:
91  * rcu_read_lock().  The reason for this is that RCU ignores CPUs that are
93  * so such a CPU is effectively never in an RCU read-side critical section
94  * regardless of what RCU primitives it invokes.  This state of affairs is
95  * required --- we need to keep an RCU-free window in idle where the CPU may
100  * Similarly, we avoid claiming an RCU read lock held if the current
135  * non-expedited counterparts?  Intended for use within RCU.  Note
161  * rcu_async_hurry - Make future async RCU callbacks not lazy.
174  * rcu_async_relax - Make future async RCU callbacks lazy.
189  * use within RCU.  Note that this function takes the rcu_expedited
201  * rcu_expedite_gp - Expedite future RCU grace periods
231  * Inform RCU of the end of the in-kernel boot sequence.
262 	pr_info("Running RCU synchronous self tests\n");  in rcu_test_sync_prims()
270  * Switch to run-time mode once RCU has fully initialized.
312 // Tell lockdep when RCU callbacks are being invoked.
326  * rcu_read_lock_held() - might we be in RCU read-side critical section?
328  * If CONFIG_DEBUG_LOCK_ALLOC is selected, returns nonzero iff in an RCU
330  * this assumes we are in an RCU read-side critical section unless it can
332  * require that they be called within an RCU read-side critical section.
343  * offline from an RCU perspective, so check for those as well.
356  * rcu_read_lock_bh_held() - might we be in RCU-bh read-side critical section?
362  * that require that they be called within an RCU read-side critical
368  * offline from an RCU perspective, so check for those as well.
404 	struct rcu_synchronize *rcu;  in wakeme_after_rcu()  local
406 	rcu = container_of(head, struct rcu_synchronize, head);  in wakeme_after_rcu()
407 	complete(&rcu->completion);  in wakeme_after_rcu()
563 // Suppress boot-time RCU CPU stall warnings and rcutorture writer stall
595 	pr_info("RCU test callback executed %d\n", rcu_self_test_counter);  in test_callback()
624 	pr_info("Running RCU self tests\n");  in rcu_early_boot_tests()