diff options
| author | Thomas Gleixner <tglx@linutronix.de> | 2020-05-21 22:05:22 +0200 |
|---|---|---|
| committer | Thomas Gleixner <tglx@linutronix.de> | 2020-06-11 15:15:06 +0200 |
| commit | 98a3bf195e1a14755da3d2b83e1dbb4a3158866d (patch) | |
| tree | 5d61c4a5c3d7eae95f58ce2754fee7c5b6b04272 /include/linux | |
| parent | 8a6bc4787f05d087fda8e11ead225c8830250703 (diff) | |
genirq: Provide __irq_enter/exit_raw()
Like __irq_enter/exit() but without time accounting. To be used for "empty"
system vectors like the scheduler IPI to avoid the overhead.
Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
Signed-off-by: Ingo Molnar <mingo@kernel.org>
Reviewed-by: Andy Lutomirski <luto@kernel.org>
Link: https://lore.kernel.org/r/20200521202117.671682341@linutronix.de
Diffstat (limited to 'include/linux')
| -rw-r--r-- | include/linux/hardirq.h | 20 |
1 files changed, 20 insertions, 0 deletions
diff --git a/include/linux/hardirq.h b/include/linux/hardirq.h index 3dc9102d16cf..03c9fece7d43 100644 --- a/include/linux/hardirq.h +++ b/include/linux/hardirq.h @@ -38,6 +38,17 @@ static __always_inline void rcu_irq_enter_check_tick(void) } while (0) /* + * Like __irq_enter() without time accounting for fast + * interrupts, e.g. reschedule IPI where time accounting + * is more expensive than the actual interrupt. + */ +#define __irq_enter_raw() \ + do { \ + preempt_count_add(HARDIRQ_OFFSET); \ + lockdep_hardirq_enter(); \ + } while (0) + +/* * Enter irq context (on NO_HZ, update jiffies): */ void irq_enter(void); @@ -57,6 +68,15 @@ void irq_enter_rcu(void); } while (0) /* + * Like __irq_exit() without time accounting + */ +#define __irq_exit_raw() \ + do { \ + lockdep_hardirq_exit(); \ + preempt_count_sub(HARDIRQ_OFFSET); \ + } while (0) + +/* * Exit irq context and process softirqs if needed: */ void irq_exit(void); |