Thomas Gleixner 9321f8152d rtmutex: Wake up the waiters lockless while dropping the read lock. ...

The rw_semaphore and rwlock_t implementation both wake the waiter while
holding the rt_mutex_base::wait_lock acquired.
This can be optimized by waking the waiter lockless outside of the
locked section to avoid a needless contention on the
rt_mutex_base::wait_lock lock.

Extend rt_mutex_wake_q_add() to also accept task and state and use it in
__rwbase_read_unlock().

Suggested-by: Davidlohr Bueso <dave@stgolabs.net>
Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
Signed-off-by: Sebastian Andrzej Siewior <bigeasy@linutronix.de>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Link: https://lkml.kernel.org/r/20210928150006.597310-3-bigeasy@linutronix.de

2021-10-01 13:57:52 +02:00

..

irqflag-debug.c

lockdep: Noinstr annotate warn_bogus_irq_restore()

2021-02-10 14:44:39 +01:00

lock_events_list.h

locking/rwsem: Remove reader optimistic spinning

2020-12-09 17:08:48 +01:00

lock_events.c

locking/lock_events: Don't show pvqspinlock events on bare metal

2019-04-10 10:56:05 +02:00

lock_events.h

locking/lock_events: Use raw_cpu_{add,inc}() for stats

2019-06-03 12:32:56 +02:00

lockdep_internals.h

lockdep: Allow tuning tracing capacity constants.

2021-04-05 20:33:57 +09:00

lockdep_proc.c

locking/lockdep: Fix meaningless /proc/lockdep output of lock classes on !CONFIG_PROVE_LOCKING

2021-07-05 10:44:52 +02:00

lockdep_states.h

locking/lockdep: Rework FS_RECLAIM annotation

2017-08-10 12:29:03 +02:00

lockdep.c

lockdep: Improve comments in wait-type checks

2021-09-17 15:08:45 +02:00

locktorture.c

locktorture: Count lock readers

2021-07-27 11:39:30 -07:00

Makefile

locking/ww_mutex: Implement rtmutex based ww_mutex API functions

2021-08-17 19:05:26 +02:00

mcs_spinlock.h

locking: Fix typos in comments

2021-03-22 02:45:52 +01:00

mutex-debug.c

locking/ww_mutex: Gather mutex_waiter initialization

2021-08-17 19:04:41 +02:00

mutex.c

kernel/locking: Add context to ww_mutex_trylock()

2021-09-17 15:08:41 +02:00

mutex.h

locking/mutex: Move the 'struct mutex_waiter' definition from <linux/mutex.h> to the internal header

2021-08-17 18:24:31 +02:00

osq_lock.c

locking: Fix typos in comments

2021-03-22 02:45:52 +01:00

percpu-rwsem.c

locking/percpu-rwsem: Use this_cpu_{inc,dec}() for read_count

2020-09-16 16:26:56 +02:00

qrwlock.c

locking/qrwlock: Cleanup queued_write_lock_slowpath()

2021-05-06 15:33:49 +02:00

qspinlock_paravirt.h

Revert "locking/pvqspinlock: Don't wait if vCPU is preempted"

2019-09-25 10:22:37 +02:00

qspinlock_stat.h

treewide: Replace GPLv2 boilerplate/reference with SPDX - rule 157

2019-05-30 11:26:37 -07:00

qspinlock.c

x86/kvm: Add "nopvspin" parameter to disable PV spinlocks

2020-07-08 16:21:57 -04:00

rtmutex_api.c

locking/rtmutex: Prevent lockdep false positive with PI futexes

2021-08-17 19:06:02 +02:00

rtmutex_common.h

locking/rtmutex: Dont dereference waiter lockless

2021-08-25 15:42:32 +02:00

rtmutex.c

rtmutex: Wake up the waiters lockless while dropping the read lock.

2021-10-01 13:57:52 +02:00

rwbase_rt.c

rtmutex: Wake up the waiters lockless while dropping the read lock.

2021-10-01 13:57:52 +02:00

rwsem.c

locking/rwsem: Add missing __init_rwsem() for PREEMPT_RT

2021-09-02 22:07:17 +02:00

semaphore.c

locking/semaphore: Add might_sleep() to down_*() family

2021-08-20 12:33:17 +02:00

spinlock_debug.c

locking/rwlock: Provide RT variant

2021-08-17 17:50:51 +02:00

spinlock_rt.c

locking/rt: Take RCU nesting into account for __might_resched()

2021-10-01 13:57:51 +02:00

spinlock.c

locking/rwlock: Provide RT variant

2021-08-17 17:50:51 +02:00

test-ww_mutex.c

locking/ww-mutex: Fix uninitialized use of ret in test_aa()

2021-10-01 13:57:49 +02:00

ww_mutex.h

locking/ww_mutex: Add rt_mutex based lock type and accessors

2021-08-17 19:05:11 +02:00

ww_rt_mutex.c

kernel/locking: Add context to ww_mutex_trylock()

2021-09-17 15:08:41 +02:00