Paul E. McKenney c3422bea5f rcu: Simplify rcu_read_unlock_special() quiescent-state accounting ...

The earlier approach required two scheduling-clock ticks to note an
preemptable-RCU quiescent state in the situation in which the
scheduling-clock interrupt is unlucky enough to always interrupt an
RCU read-side critical section.

With this change, the quiescent state is instead noted by the
outermost rcu_read_unlock() immediately following the first
scheduling-clock tick, or, alternatively, by the first subsequent
context switch.  Therefore, this change also speeds up grace
periods.

Suggested-by: Josh Triplett <josh@joshtriplett.org>
Signed-off-by: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
Cc: laijs@cn.fujitsu.com
Cc: dipankar@in.ibm.com
Cc: akpm@linux-foundation.org
Cc: mathieu.desnoyers@polymtl.ca
Cc: dvhltc@us.ibm.com
Cc: niv@us.ibm.com
Cc: peterz@infradead.org
Cc: rostedt@goodmis.org
Cc: Valdis.Kletnieks@vt.edu
LKML-Reference: <12528585111945-git-send-email->
Signed-off-by: Ingo Molnar <mingo@elte.hu>

2009-09-18 00:06:33 +02:00

..

gcov

powerpc: Enable GCOV

2009-08-20 10:29:28 +10:00

irq

Merge branch 'irq-threaded-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip

2009-09-11 13:21:31 -07:00

power

PM: Trivial fixes

2009-09-14 20:26:59 +02:00

time

clockevent: Prevent dead lock on clockevents_lock

2009-08-19 18:15:10 +02:00

trace

Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/percpu

2009-09-15 09:39:44 -07:00

.gitignore

…

acct.c

bsdacct: switch credentials for writing to the accounting file

2009-08-24 11:33:40 +10:00

async.c

async: Fix lack of boot-time console due to insufficient synchronization

2009-06-08 12:31:53 -07:00

audit_tree.c

Fix rule eviction order for AUDIT_DIR

2009-06-24 00:02:38 -04:00

audit_watch.c

Audit: clean up all op= output to include string quoting

2009-06-24 00:00:52 -04:00

audit.c

Fix rule eviction order for AUDIT_DIR

2009-06-24 00:02:38 -04:00

audit.h

Fix rule eviction order for AUDIT_DIR

2009-06-24 00:02:38 -04:00

auditfilter.c

Audit: clean up all op= output to include string quoting

2009-06-24 00:00:52 -04:00

auditsc.c

Fix rule eviction order for AUDIT_DIR

2009-06-24 00:02:38 -04:00

backtracetest.c

…

bounds.c

…

capability.c

[CVE-2009-0029] System call wrappers part 04

2009-01-14 14:15:19 +01:00

cgroup_debug.c

debug cgroup: remove unneeded cgroup_lock

2009-04-02 19:04:54 -07:00

cgroup_freezer.c

…

cgroup.c

writeback: add name to backing_dev_info

2009-09-11 09:20:26 +02:00

compat.c

signals: implement sys_rt_tgsigqueueinfo

2009-04-30 19:24:24 +02:00

configs.c

…

cpu.c

Merge branch 'x86-pat-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip

2009-09-15 09:19:38 -07:00

cpuset.c

cpuset,mm: update tasks' mems_allowed in time

2009-06-16 19:47:31 -07:00

cred-internals.h

…

cred.c

CRED: Allow put_cred() to cope with a NULL groups list

2009-09-15 09:10:57 +10:00

delayacct.c

schedstat: consolidate per-task cpu runtime stats

2008-12-18 13:54:01 +01:00

dma.c

…

exec_domain.c

Get rid of indirect include of fs_struct.h

2009-03-31 23:00:27 -04:00

exit.c

Merge branch 'core-rcu-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip

2009-09-11 13:20:18 -07:00

extable.c

Merge branch 'tracing-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip

2009-04-05 11:04:19 -07:00

fork.c

Merge branch 'core-rcu-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip

2009-09-11 13:20:18 -07:00

freezer.c

sched: fix nr_uninterruptible accounting of frozen tasks really

2009-07-18 14:19:53 +02:00

futex_compat.c

futex: Fix compat_futex to be same as futex for REQUEUE_PI

2009-08-10 15:41:12 +02:00

futex.c

Merge branch 'core-futexes-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip

2009-09-11 13:16:22 -07:00

groups.c

groups: move code to kernel/groups.c

2009-06-16 19:47:48 -07:00

hrtimer.c

pktgen: spin using hrtimer

2009-08-28 23:41:29 -07:00

hung_task.c

softlockup: ensure the task has been switched out once

2009-02-11 11:04:16 +01:00

itimer.c

timers: split process wide cpu clocks/timers

2009-02-05 13:04:33 +01:00

kallsyms.c

kernel/kallsyms.c: replace deprecated __initcall with device_initcall and fix whitespace

2009-06-09 22:37:52 +02:00

Kconfig.freezer

…

Kconfig.hz

…

Kconfig.preempt

rcu: provide RCU options on non-preempt architectures too

2008-12-25 09:31:28 +01:00

kexec.c

kexec: fix omitting offset in extended crashkernel syntax

2009-07-29 19:10:34 -07:00

kfifo.c

kernel/kfifo.c: replace conditional test with is_power_of_2()

2009-06-16 19:47:47 -07:00

kgdb.c

sysrq, intel_fb: fix sysrq g collision

2009-05-15 07:56:24 -05:00

kmod.c

Merge branch 'tracing-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip

2009-09-11 13:24:03 -07:00

kprobes.c

Merge branch 'linus' into tracing/core

2009-08-11 14:19:09 +02:00

ksysfs.c

kernel/ksysfs.c:fix dependence on CONFIG_NET

2009-01-06 10:44:31 -08:00

kthread.c

sched: Keep kthreads at default priority

2009-09-09 17:30:06 +02:00

latencytop.c

sched, latencytop: incorporate review feedback from Andrew Morton

2009-02-11 10:18:04 +01:00

lockdep_internals.h

lockdep: BFS cleanup

2009-07-24 10:53:29 +02:00

lockdep_proc.c

Merge commit 'v2.6.31-rc8' into core/locking

2009-08-31 18:05:25 +02:00

lockdep_states.h

lockdep: move state bit definitions around

2009-02-14 23:27:59 +01:00

lockdep.c

lockdep: Remove recursion stattistics

2009-08-29 13:22:36 +02:00

Makefile

driver-core: move dma-coherent.c from kernel to driver/base

2009-09-15 09:50:47 -07:00

marker.c

…

module.c

Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/percpu

2009-09-15 09:39:44 -07:00

mutex-debug.c

mutex: implement adaptive spinning

2009-01-14 18:09:02 +01:00

mutex-debug.h

mutex: implement adaptive spinning

2009-01-14 18:09:02 +01:00

mutex.c

Merge branch 'linus' into perfcounters/core

2009-06-11 17:55:42 +02:00

mutex.h

mutex: implement adaptive spinning

2009-01-14 18:09:02 +01:00

notifier.c

Merge commit 'v2.6.28-rc6' into core/debug

2008-11-26 08:22:50 +01:00

ns_cgroup.c

cgroups: relax ns_can_attach checks to allow attaching to grandchild cgroups

2009-04-02 19:04:53 -07:00

nsproxy.c

nsproxy: extract create_nsproxy()

2009-06-18 13:03:56 -07:00

panic.c

trace: stop tracer in oops_enter()

2009-07-24 15:30:45 -04:00

params.c

module_param: allow 'bool' module_params to be bool, not just int.

2009-06-12 21:46:58 +09:30

perf_counter.c

Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/percpu

2009-09-15 09:39:44 -07:00

pid_namespace.c

pidns: rewrite copy_pid_ns()

2009-06-18 13:03:55 -07:00

pid.c

kmemleak: Remove alloc_bootmem annotations introduced in the past

2009-07-09 17:07:02 +01:00

pm_qos_params.c

…

posix-cpu-timers.c

posix_cpu_timers_exit_group(): Do not use thread_group_cputimer()

2009-08-08 18:30:25 +02:00

posix-timers.c

posix-timers: Fix oops in clock_nanosleep() with CLOCK_MONOTONIC_RAW

2009-08-04 10:16:41 +02:00

printk.c

cleanup console_print()

2009-09-14 17:41:42 -07:00

profile.c

profile: suppress warning about large allocations when profile=1 is specified

2009-07-29 19:10:36 -07:00

ptrace.c

Merge branch 'master' into next

2009-07-14 00:30:40 +10:00

rcupdate.c

rcu: Delay rcu_barrier() wait until beginning of next CPU-hotunplug operation.

2009-08-19 13:58:54 +02:00

rcutorture.c

rcutorture: Occasionally delay readers enough to make RCU force_quiescent_state

2009-09-18 00:05:34 +02:00

rcutree_plugin.h

rcu: Simplify rcu_read_unlock_special() quiescent-state accounting

2009-09-18 00:06:33 +02:00

rcutree_trace.c

rcu: Merge preemptable-RCU functionality into hierarchical RCU

2009-08-23 10:32:40 +02:00

rcutree.c

rcu: Simplify rcu_read_unlock_special() quiescent-state accounting

2009-09-18 00:06:33 +02:00

rcutree.h

rcu: Changes from reviews: avoid casts, fix/add warnings, improve comments

2009-08-29 15:34:40 +02:00

relay.c

Merge branch 'tracing-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip

2009-04-05 11:04:19 -07:00

res_counter.c

memcg: add interface to reset limits

2009-06-18 13:03:48 -07:00

resource.c

kernel/resource.c: fix sign extension in reserve_setup()

2009-06-30 18:56:00 -07:00

rtmutex_common.h

rt_mutex: add proxy lock routines

2009-04-06 11:14:02 +02:00

rtmutex-debug.c

…

rtmutex-debug.h

…

rtmutex-tester.c

…

rtmutex.c

rtmutex: Avoid deadlock in rt_mutex_start_proxy_lock()

2009-08-06 05:50:21 +02:00

rtmutex.h

…

rwsem.c

…

sched_clock.c

sched: Fix fallback sched_clock()'s offset when using jiffies

2009-05-09 10:08:19 +02:00

sched_cpupri.c

sched: Add new prio to cpupri before removing old prio

2009-08-02 14:26:09 +02:00

sched_cpupri.h

cpumask: remove cpumask_t from core

2009-03-30 22:05:17 +10:30

sched_debug.c

sched: Provide iowait counters

2009-09-02 08:44:08 +02:00

sched_fair.c

sched: Fix sched::sched_stat_wait tracepoint field

2009-09-10 20:52:54 +02:00

sched_features.h

sched: Disable NEW_FAIR_SLEEPERS for now

2009-09-10 20:34:48 +02:00

sched_idletask.c

sched, timers: move calc_load() to scheduler

2009-05-15 15:32:45 +02:00

sched_rt.c

sched: Scale down cpu_power due to RT tasks

2009-09-04 10:09:55 +02:00

sched_stats.h

sched: remove unused fields from struct rq

2009-03-24 23:16:51 +01:00

sched.c

Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/percpu

2009-09-15 09:39:44 -07:00

seccomp.c

x86-64: seccomp: fix 32/64 syscall hole

2009-03-02 15:41:30 -08:00

semaphore.c

…

signal.c

do_sigaltstack: small cleanups

2009-08-01 11:18:56 -07:00

slow-work.c

slow-work: use round_jiffies() for thread pool's cull and OOM timers

2009-06-16 19:47:49 -07:00

smp.c

Merge branch 'x86/urgent' into x86/pat

2009-08-26 17:24:28 -07:00

softirq.c

rcu: Renamings to increase RCU clarity

2009-08-23 10:32:37 +02:00

softlockup.c

softlockup: decouple hung tasks check from softlockup detection

2009-01-16 14:06:04 +01:00

spinlock.c

locking: Allow arch-inlined spinlocks

2009-08-31 18:08:50 +02:00

srcu.c

…

stacktrace.c

stacktrace: provide save_stack_trace_tsk() weak alias

2008-12-25 11:44:43 +01:00

stop_machine.c

cpumask: remove cpumask_t from core

2009-03-30 22:05:17 +10:30

sys_ni.c

Merge commit 'v2.6.29-rc2' into perfcounters/core

2009-01-21 16:37:27 +01:00

sys.c

groups: move code to kernel/groups.c

2009-06-16 19:47:48 -07:00

sysctl_check.c

net: add ARP notify option for devices

2009-02-01 01:04:33 -08:00

sysctl.c

block: fix linkage problem with blk_iopoll and !CONFIG_BLOCK

2009-09-15 21:53:11 +02:00

taskstats.c

genetlink: make netns aware

2009-07-12 14:03:27 -07:00

test_kprobes.c

kprobes: add tests for register_kprobes

2009-01-06 15:59:20 -08:00

time.c

[CVE-2009-0029] System call wrappers part 01

2009-01-14 14:15:18 +01:00

timeconst.pl

…

timer.c

rcu: Simplify rcu_pending()/rcu_check_callbacks() API

2009-08-23 10:32:39 +02:00

tracepoint.c

tracing: Don't trace kernel thread syscalls

2009-08-26 21:29:52 +02:00

tsacct.c

Fix fixpoint divide exception in acct_update_integrals

2009-03-09 08:13:35 -07:00

uid16.c

[CVE-2009-0029] System call wrappers part 19

2009-01-14 14:15:26 +01:00

up.c

smp_call_function_single(): be slightly less stupid, fix #2

2009-01-12 16:04:37 +01:00

user_namespace.c

Fix recursive lock in free_uid()/free_user_ns()

2009-02-27 16:26:21 -08:00

user.c

sched: delayed cleanup of user_struct

2009-06-15 21:30:23 -07:00

utsname_sysctl.c

proc_sysctl: use CONFIG_PROC_SYSCTL around ipc and utsname proc_handlers

2009-04-02 19:05:01 -07:00

utsname.c

utsns: extract creeate_uts_ns()

2009-06-18 13:03:55 -07:00

wait.c

locking, sched: Give waitqueue spinlocks their own lockdep classes

2009-08-10 14:43:09 +02:00

workqueue.c

Merge branch 'sched-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip

2009-09-11 13:23:18 -07:00