Anton Blanchard 152d523e63 powerpc: Create context switch helpers save_sprs() and restore_sprs() ...

Move all our context switch SPR save and restore code into two
helpers. We do a few optimisations:

- Group all mfsprs and all mtsprs. In many cases an mtspr sets a
scoreboarding bit that an mfspr waits on, so the current practise of
mfspr A; mtspr A; mfpsr B; mtspr B is the worst scheduling we can
do.

- SPR writes are slow, so check that the value is changing before
writing it.

A context switch microbenchmark using yield():

http://ozlabs.org/~anton/junkcode/context_switch2.c

./context_switch2 --test=yield 0 0

shows an improvement of almost 10% on POWER8.

Signed-off-by: Anton Blanchard <anton@samba.org>
Signed-off-by: Michael Ellerman <mpe@ellerman.id.au>

2015-12-01 13:52:24 +11:00

..

vdso32

powerpc: Standardise on NR_syscalls rather than __NR_syscalls.

2015-11-26 22:11:17 +11:00

vdso64

powerpc: Standardise on NR_syscalls rather than __NR_syscalls.

2015-11-26 22:11:17 +11:00

.gitignore

…

align.c

powerpc: Remove double braces in alignment code.

2014-11-10 09:59:32 +11:00

asm-offsets.c

Merge tag 'for-linus' of git://git.kernel.org/pub/scm/virt/kvm/kvm

2015-09-10 16:42:49 -07:00

audit.c

…

btext.c

powerpc/btext: Fix CONFIG_PPC_EARLY_DEBUG_BOOTX on ppc32

2013-08-27 16:01:23 +10:00

cacheinfo.c

powerpc: Fix missing L2 cache size in /sys/devices/system/cpu

2015-04-11 20:49:28 +10:00

cacheinfo.h

…

compat_audit.c

…

cpu_setup_6xx.S

…

cpu_setup_44x.S

…

cpu_setup_fsl_booke.S

powerpc/booke: Restrict SPE exception handlers to e200/e500 cores

2014-09-22 10:11:31 +02:00

cpu_setup_pa6t.S

…

cpu_setup_power.S

powerpc/book3s: Fix flush_tlb cpu_spec hook to take a generic argument.

2015-03-17 07:52:48 +11:00

cpu_setup_ppc970.S

…

cputable.c

powerpc/tm: Abort syscalls in active transactions

2015-06-19 17:10:28 +10:00

crash_dump.c

powerpc: Remove superfluous bootmem includes

2014-11-10 09:59:26 +11:00

crash.c

powerpc/book3e/kdump: Enable crash_kexec_wait_realmode

2015-10-27 18:13:27 -05:00

dbell.c

powerpc/powernv: Fixes for hypervisor doorbell handling

2015-03-20 14:51:53 +11:00

dma-iommu.c

powerpc/iommu: Support "hybrid" iommu/direct DMA ops for coherent_mask < dma_mask

2015-07-13 10:10:55 +10:00

dma-swiotlb.c

powerpc/iommu: Support "hybrid" iommu/direct DMA ops for coherent_mask < dma_mask

2015-07-13 10:10:55 +10:00

dma.c

powerpc/dma: dma_set_coherent_mask() should not be GPL only

2015-10-28 14:20:50 +09:00

eeh_cache.c

powerpc/eeh: fix start/end/flags type in struct pci_io_addr_range{}

2015-05-13 14:00:07 +10:00

eeh_dev.c

powerpc/eeh: Create eeh_dev from pci_dn instead of device_node

2015-03-24 13:15:51 +11:00

eeh_driver.c

powerpc/eeh: Force reset on fenced PHB

2015-10-21 20:41:43 +11:00

eeh_event.c

powerpc/powernv: Fix killed EEH event

2014-06-11 17:04:33 +10:00

eeh_pe.c

powerpc/eeh: Disable automatically blocked PCI config

2015-08-18 19:34:42 +10:00

eeh_sysfs.c

powerpc/eeh: Fix PE state format

2014-11-27 09:32:58 +11:00

eeh.c

powerpc/eeh: More relaxed condition for enabled IO path

2015-10-21 20:41:43 +11:00

entry_32.S

powerpc/kernel: Change the do_syscall_trace_enter() API

2015-07-29 11:56:11 +10:00

entry_64.S

powerpc: Create context switch helpers save_sprs() and restore_sprs()

2015-12-01 13:52:24 +11:00

epapr_hcalls.S

powerpc: Add paravirt idle loop for 64-bit Book-E

2013-03-13 14:19:36 -05:00

epapr_paravirt.c

Merge branch 'next' of git://git.kernel.org/pub/scm/linux/kernel/git/benh/powerpc

2014-06-10 18:54:22 -07:00

exceptions-64e.S

powerpc/book3e: support CONFIG_RELOCATABLE

2015-10-27 18:13:27 -05:00

exceptions-64s.S

powerpc/64: Include KVM guest test in all interrupt vectors

2015-12-01 13:52:23 +11:00

fadump.c

powerpc/fadump: Fix endianess issues in firmware assisted dump handling

2014-10-30 16:52:46 +11:00

firmware.c

…

fpu.S

powerpc: Don't disable MSR bits in do_load_up_transact_*() functions

2015-12-01 13:52:24 +11:00

fsl_booke_entry_mapping.S

powerpc/fsl: Force coherent memory on e500mc derivatives

2015-08-07 23:00:01 -05:00

ftrace.c

Merge tag 'powerpc-3.19-1' of git://git.kernel.org/pub/scm/linux/kernel/git/mpe/linux

2014-12-11 17:48:14 -08:00

head_8xx.S

powerpc/8xx: Implementation of PAGE_EXEC

2015-06-02 21:37:28 -05:00

head_32.S

powerpc: Call do_page_fault() with interrupts off

2012-03-09 10:55:08 +11:00

head_40x.S

powerpc: Remove check for CONFIG_SERIAL_TEXT_DEBUG

2014-06-11 16:31:21 +10:00

head_44x.S

powerpc/ppc476: Disable BTAC

2014-08-13 15:13:42 +10:00

head_64.S

powerpc/book3e: support CONFIG_RELOCATABLE

2015-10-27 18:13:27 -05:00

head_booke.h

powerpc: Fix interrupt range check on debug exception

2013-05-02 10:31:01 +10:00

head_fsl_booke.S

powerpc/booke: Revert SPE/AltiVec common defines for interrupt numbers

2014-09-22 10:11:31 +02:00

hw_breakpoint.c

powerpc: Replace __get_cpu_var uses

2014-11-03 12:12:32 +11:00

ibmebus.c

powerpc: make of_device_ids const

2014-09-25 23:14:46 +10:00

idle_6xx.S

powerpc: Use CURRENT_THREAD_INFO instead of open coded assembly

2012-07-11 14:18:22 +10:00

idle_book3e.S

powerpc: No need to use dot symbols when branching to a function

2014-04-23 10:05:16 +10:00

idle_e500.S

powerpc/e500mc: Remove dead L2 flushing code in idle_e500.S

2015-06-02 21:37:19 -05:00

idle_power4.S

powerpc: No need to use dot symbols when branching to a function

2014-04-23 10:05:16 +10:00

idle_power7.S

powerpc/powernv: Fix race in updating core_idle_state

2015-07-07 10:16:52 +10:00

idle.c

powerpc/idle: Convert use of typedef ctl_table to struct ctl_table

2013-07-01 11:10:35 +10:00

io-workarounds.c

powerpc/mm: Differentiate between hugetlb and THP during page walk

2015-10-12 15:30:09 +11:00

io.c

powerpc/powernv: Add PIO accessors for Power8 LPC bus

2013-08-14 14:58:08 +10:00

iomap.c

powerpc/kerenl: Enable EEH for IO accessors

2014-06-24 12:43:13 +10:00

iommu.c

powerpc/iommu/powernv: Release replaced TCE

2015-06-11 15:16:49 +10:00

irq.c

powerpc, irq: Use access helper irq_data_get_affinity_mask()

2015-09-15 17:06:28 +02:00

isa-bridge.c

POWERPC: drivers: remove __dev* attributes.

2013-01-03 15:57:04 -08:00

jump_label.c

jump_label: Rename JUMP_LABEL_{EN,DIS}ABLE to JUMP_LABEL_{JMP,NOP}

2015-08-03 11:34:12 +02:00

kgdb.c

powerpc: Replace __get_cpu_var uses

2014-11-03 12:12:32 +11:00

kprobes.c

powerpc: Replace __get_cpu_var uses

2014-11-03 12:12:32 +11:00

kvm_emul.S

KVM: PPC: Not optimizing MSR_CE and MSR_ME with paravirt.

2012-05-30 11:43:11 +02:00

kvm.c

powerpc: Remove redundant breaks

2015-08-06 15:10:20 +10:00

l2cr_6xx.S

…

legacy_serial.c

powerpc: make of_device_ids const

2014-09-25 23:14:46 +10:00

machine_kexec_32.c

…

machine_kexec_64.c

powerpc/book3e-64: Enable kexec

2015-10-27 18:13:30 -05:00

machine_kexec.c

powerpc: Fix endian issues in kexec and crash dump code

2014-02-11 11:24:52 +11:00

Makefile

powerpc/ftrace: add powerpc timebase as a trace clock source

2015-08-06 16:36:23 +10:00

mce_power.c

powerpc/book3s: Fix flush_tlb cpu_spec hook to take a generic argument.

2015-03-17 07:52:48 +11:00

mce.c

powerpc/mce: fix off by one errors in mce event handling

2015-05-12 19:44:01 +10:00

misc_32.S

atomic: Collapse all atomic_{set,clear}_mask definitions

2015-07-27 14:06:24 +02:00

misc_64.S

powerpc/book3e-64: Enable kexec

2015-10-27 18:13:30 -05:00

misc.S

powerpc: Rename __get_SP() to current_stack_pointer()

2014-10-15 11:23:20 +11:00

module_32.c

powerpc: Use pr_fmt in module loader code

2014-10-02 17:33:54 +10:00

module_64.c

powerpc: Use pr_fmt in module loader code

2014-10-02 17:33:54 +10:00

module.c

powerpc: Move local setup.h declarations to arch includes

2013-10-30 16:00:31 +11:00

msi.c

powerpc: Remove MSI-related PCI controller ops from ppc_md

2015-06-02 11:47:45 +10:00

nvram_64.c

powerpc/nvram: Fix function name in some errors messages.

2015-10-02 22:55:05 +10:00

of_platform.c

powerpc/eeh: Do probe on pci_dn

2015-03-24 13:15:52 +11:00

paca.c

powerpc/book3e-64: Don't limit paca to 256 MiB

2015-10-27 18:13:28 -05:00

pci_32.c

powerpc: Remove more traces of bootmem

2014-11-19 21:41:51 +11:00

pci_64.c

Merge tag 'powerpc-3.19-1' of git://git.kernel.org/pub/scm/linux/kernel/git/mpe/linux

2014-12-11 17:48:14 -08:00

pci_dn.c

powerpc/powernv: Shift VF resource with an offset

2015-03-31 13:02:38 +11:00

pci_of_scan.c

Merge tag 'libnvdimm-for-4.3' of git://git.kernel.org/pub/scm/linux/kernel/git/nvdimm/nvdimm

2015-09-08 14:35:59 -07:00

pci-common.c

powerpc/pci: export pcibios_free_controller()

2015-10-15 20:31:57 +11:00

pci-hotplug.c

powerpc/pci: Add release_device() hook to phb ops

2015-06-03 13:27:15 +10:00

pmc.c

bug.h: add include of it to various implicit C users

2012-02-29 17:15:08 -05:00

ppc32.h

powerpc: switch to generic old sigaction()

2013-02-03 18:16:10 -05:00

ppc_ksyms_32.c

powerpc: Separate ppc32 symbol exports into ppc_ksyms_32.c

2014-09-25 23:14:40 +10:00

ppc_ksyms.c

powerpc: Rename __get_SP() to current_stack_pointer()

2014-10-15 11:23:20 +11:00

ppc_save_regs.S

…

proc_powerpc.c

proc_powerpc: switch to fixed_size_llseek()

2013-06-29 12:57:50 +04:00

process.c

powerpc: Create context switch helpers save_sprs() and restore_sprs()

2015-12-01 13:52:24 +11:00

prom_init_check.sh

powerpc: Simplify symbol check in prom_init_check.sh

2014-09-25 23:14:46 +10:00

prom_init.c

vTPM: get the buffer allocated for event log instead of the actual log

2015-10-19 01:01:23 +02:00

prom_parse.c

powerpc: of_parse_dma_window should take a __be32 *dma_window

2013-08-14 15:33:26 +10:00

prom.c

powerpc/prom: Use of_get_next_parent() in of_get_ibm_chip_id()

2015-10-28 12:08:32 +09:00

ptrace32.c

powerpc: move debug registers in a structure

2013-10-18 18:44:49 -05:00

ptrace.c

powerpc: Add rN aliases to the pt_regs_offset table.

2015-11-26 22:11:17 +11:00

reloc_32.S

powerpc: Don't flush/invalidate the d/icache for an unknown relocation type

2013-07-01 11:10:34 +10:00

reloc_64.S

powerpc: Align p_dyn, p_rela and p_st symbols

2014-03-07 13:50:19 +11:00

rtas_flash.c

powerpc: Fix endianness of flash_block_list in rtas_flash

2014-07-28 11:30:54 +10:00

rtas_pci.c

powerpc: move find_and_init_phbs() to pSeries specific code

2015-04-11 20:49:09 +10:00

rtas-proc.c

powerpc: LLVM complains about forward declaration of struct rtas_sensors

2014-11-10 09:59:32 +11:00

rtas-rtc.c

…

rtas.c

powerpc/rtas: Validate rtas.entry before calling enter_rtas()

2015-10-22 11:03:25 +11:00

rtasd.c

powerpc: Make a bunch of things static

2014-09-25 23:14:41 +10:00

setup_32.c

powerpc32: memset: only use dcbz once cache is enabled

2015-09-17 10:36:53 +10:00

setup_64.c

powerpc/book3e-64/kexec: Enable SMP release

2015-10-27 18:13:29 -05:00

setup-common.c

powerpc: Convert power off logic to pm_power_off

2014-11-03 12:12:51 +11:00

signal_32.c

Merge tag 'powerpc-4.3-1' of git://git.kernel.org/pub/scm/linux/kernel/git/powerpc/linux

2015-09-03 16:41:38 -07:00

signal_64.c

powerpc/signal: Add helper function to fetch quad word aligned pointer

2015-07-21 11:38:29 +10:00

signal.c

powerpc: Use sigsp()

2014-08-06 13:04:32 +02:00

signal.h

powerpc: Use get_signal() signal_setup_done()

2014-08-06 13:03:09 +02:00

smp-tbsync.c

powerpc: Delete non-required instances of include <linux/init.h>

2014-01-15 13:46:44 +11:00

smp.c

powerpc/smp: Wait until secondaries are active & online

2015-03-04 13:19:33 +11:00

stacktrace.c

powerpc: Rename __get_SP() to current_stack_pointer()

2014-10-15 11:23:20 +11:00

suspend.c

nosave: consolidate __nosave_{begin,end} in <asm/sections.h>

2014-10-09 22:26:04 -04:00

swsusp_32.S

…

swsusp_64.c

Disintegrate asm/system.h for PowerPC

2012-03-28 18:30:02 +01:00

swsusp_asm64.S

powerpc: Only save/restore SDR1 if in hypervisor mode

2013-10-31 12:37:29 +11:00

swsusp_booke.S

powerpc/fsl-booke: Use SPRN_SPRGn rather than mfsprg/mtsprg

2014-01-07 19:06:03 -06:00

swsusp.c

Disintegrate asm/system.h for PowerPC

2012-03-28 18:30:02 +01:00

sys_ppc32.c

unify compat fanotify_mark(2), switch to COMPAT_SYSCALL_DEFINE

2013-05-09 13:46:38 -04:00

syscalls.c

powerpc: Add a proper syscall for switching endianness

2015-03-28 22:03:40 +11:00

sysfs.c

powerpc/dscr: Add some in-code documentation

2015-06-07 19:29:15 +10:00

systbl_chk.c

powerpc: Standardise on NR_syscalls rather than __NR_syscalls.

2015-11-26 22:11:17 +11:00

systbl_chk.sh

powerpc: Standardise on NR_syscalls rather than __NR_syscalls.

2015-11-26 22:11:17 +11:00

systbl.S

powerpc: Add a proper syscall for switching endianness

2015-03-28 22:03:40 +11:00

tau_6xx.c

…

time.c

powerpc/time: Migrate to new 'set-state' interface

2015-08-10 11:41:02 +02:00

tm.S

powerpc/kernel: Rename PACA_DSCR to PACA_DSCR_DEFAULT

2015-06-07 19:29:00 +10:00

trace_clock.c

powerpc/ftrace: add powerpc timebase as a trace clock source

2015-08-06 16:36:23 +10:00

traps.c

powerpc: Remove unused function trace_syscall()

2015-11-26 22:11:16 +11:00

udbg_16550.c

powerpc: Fix bad NULL pointer check in udbg_uart_getc_poll()

2014-11-12 13:47:20 +11:00

udbg.c

powerpc: Remove the celleb support

2015-04-07 17:15:13 +10:00

uprobes.c

uprobes/powerpc: Kill arch_uprobe->ainsn

2013-11-20 16:31:01 +01:00

vdso.c

powerpc: Standardise on NR_syscalls rather than __NR_syscalls.

2015-11-26 22:11:17 +11:00

vecemu.c

powerpc: Put FP/VSX and VR state into structures

2013-10-11 17:26:49 +11:00

vector.S

powerpc: Don't disable MSR bits in do_load_up_transact_*() functions

2015-12-01 13:52:24 +11:00

vio.c

powerpc: use for_each_sg()

2015-06-24 17:49:38 -07:00

vmlinux.lds.S

powerpc: discard .exit.data at runtime

2015-10-15 20:31:59 +11:00