Peter Zijlstra 71365d4023 locking/percpu-rwsem: Move __this_cpu_inc() into the slowpath ...

As preparation to rework __percpu_down_read() move the
__this_cpu_inc() into it.

Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Signed-off-by: Ingo Molnar <mingo@kernel.org>
Reviewed-by: Davidlohr Bueso <dbueso@suse.de>
Acked-by: Will Deacon <will@kernel.org>
Acked-by: Waiman Long <longman@redhat.com>
Tested-by: Juri Lelli <juri.lelli@redhat.com>
Link: https://lkml.kernel.org/r/20200131151540.041600199@infradead.org

2020-02-11 13:10:54 +01:00

..

lock_events_list.h

locking/rwsem: Adaptive disabling of reader optimistic spinning

2019-06-17 12:28:09 +02:00

lock_events.c

locking/lock_events: Don't show pvqspinlock events on bare metal

2019-04-10 10:56:05 +02:00

lock_events.h

locking/lock_events: Use raw_cpu_{add,inc}() for stats

2019-06-03 12:32:56 +02:00

lockdep_internals.h

locking/lockdep: Reuse freed chain_hlocks entries

2020-02-11 13:10:52 +01:00

lockdep_proc.c

locking/lockdep: Reuse freed chain_hlocks entries

2020-02-11 13:10:52 +01:00

lockdep_states.h

locking/lockdep: Rework FS_RECLAIM annotation

2017-08-10 12:29:03 +02:00

lockdep.c

locking/lockdep: Reuse freed chain_hlocks entries

2020-02-11 13:10:52 +01:00

locktorture.c

locking: locktorture: Do not include rwlock.h directly

2019-10-05 11:50:24 -07:00

Makefile

locking/rwsem: Merge rwsem.h and rwsem-xadd.c into rwsem.c

2019-06-17 12:27:57 +02:00

mcs_spinlock.h

locking/mcs: Use smp_cond_load_acquire() in MCS spin loop

2018-04-27 09:48:49 +02:00

mutex-debug.c

locking/mutex: Replace spin_is_locked() with lockdep

2018-11-12 09:06:22 -08:00

mutex-debug.h

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

mutex.c

Revert "locking/mutex: Complain upon mutex API misuse in IRQ contexts"

2019-12-11 00:27:43 +01:00

mutex.h

mutex: Fix up mutex_waiter usage

2019-08-08 09:09:25 +02:00

osq_lock.c

locking/osq: Use optimized spinning loop for arm64

2020-01-17 10:19:30 +01:00

percpu-rwsem.c

locking/percpu-rwsem: Move __this_cpu_inc() into the slowpath

2020-02-11 13:10:54 +01:00

qrwlock.c

treewide: Replace GPLv2 boilerplate/reference with SPDX - rule 157

2019-05-30 11:26:37 -07:00

qspinlock_paravirt.h

Revert "locking/pvqspinlock: Don't wait if vCPU is preempted"

2019-09-25 10:22:37 +02:00

qspinlock_stat.h

treewide: Replace GPLv2 boilerplate/reference with SPDX - rule 157

2019-05-30 11:26:37 -07:00

qspinlock.c

locking/qspinlock: Fix inaccessible URL of MCS lock paper

2020-01-17 10:19:30 +01:00

rtmutex_common.h

locking/rtmutex: Handle non enqueued waiters gracefully in remove_waiter()

2018-03-28 23:01:30 +02:00

rtmutex-debug.c

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

rtmutex-debug.h

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

rtmutex.c

locking/lockdep: Remove unused @nested argument from lock_release()

2019-10-09 12:46:10 +02:00

rtmutex.h

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

rwsem.c

locking/percpu-rwsem, lockdep: Make percpu-rwsem use its own lockdep_map

2020-02-11 13:10:53 +01:00

rwsem.h

locking/percpu-rwsem, lockdep: Make percpu-rwsem use its own lockdep_map

2020-02-11 13:10:53 +01:00

semaphore.c

treewide: Replace GPLv2 boilerplate/reference with SPDX - rule 436

2019-06-05 17:37:17 +02:00

spinlock_debug.c

locking/spinlock/debug: Fix various data races

2019-11-29 08:03:27 +01:00

spinlock.c

asm-generic/mmiowb: Add generic implementation of mmiowb() tracking

2019-04-08 11:59:39 +01:00

test-ww_mutex.c

treewide: Replace GPLv2 boilerplate/reference with SPDX - rule 9

2019-05-21 11:28:40 +02:00