Paul Mackerras bf72aeba2f powerpc: Use 64k pages without needing cache-inhibited large pages ...

Some POWER5+ machines can do 64k hardware pages for normal memory but
not for cache-inhibited pages.  This patch lets us use 64k hardware
pages for most user processes on such machines (assuming the kernel
has been configured with CONFIG_PPC_64K_PAGES=y).  User processes
start out using 64k pages and get switched to 4k pages if they use any
non-cacheable mappings.

With this, we use 64k pages for the vmalloc region and 4k pages for
the imalloc region.  If anything creates a non-cacheable mapping in
the vmalloc region, the vmalloc region will get switched to 4k pages.
I don't know of any driver other than the DRM that would do this,
though, and these machines don't have AGP.

When a region gets switched from 64k pages to 4k pages, we do not have
to clear out all the 64k HPTEs from the hash table immediately.  We
use the _PAGE_COMBO bit in the Linux PTE to indicate whether the page
was hashed in as a 64k page or a set of 4k pages.  If hash_page is
trying to insert a 4k page for a Linux PTE and it sees that it has
already been inserted as a 64k page, it first invalidates the 64k HPTE
before inserting the 4k HPTE.  The hash invalidation routines also use
the _PAGE_COMBO bit, to determine whether to look for a 64k HPTE or a
set of 4k HPTEs to remove.  With those two changes, we can tolerate a
mix of 4k and 64k HPTEs in the hash table, and they will all get
removed when the address space is torn down.

Signed-off-by: Paul Mackerras <paulus@samba.org>

2006-06-15 10:45:18 +10:00

..

iseries

[PATCH] powerpc: merge the rest of the vio code

2006-04-29 18:02:02 +10:00

8253pit.h

[PATCH] powerpc: Standardize on _ASM_POWERPC header symbol prefix

2005-09-09 22:11:34 +10:00

a.out.h

[PATCH] powerpc: Merge include/asm-ppc*/a.out.h into include/asm-powerpc

2005-09-21 19:21:08 +10:00

abs_addr.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

agp.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

asm-compat.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

atomic.h

[PATCH] powerpc: native atomic_add_unless

2006-02-24 14:06:02 +11:00

auxvec.h

[PATCH] powerpc: Merge vdso's and add vdso support to 32 bits kernel

2005-11-11 22:25:39 +11:00

backlight.h

powerpc: Merged asm/backlight.h

2005-10-11 09:59:38 +10:00

bitops.h

[PATCH] remove powerpc bitops in favor of existing generic bitops

2006-05-24 16:08:58 +10:00

bootx.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

btext.h

[PATCH] powerpc: Unify udbg (#2)

2006-01-09 14:49:54 +11:00

bug.h

[PATCH] git-powerpc: WARN was a dumb idea

2006-03-28 20:48:54 +11:00

bugs.h

[PATCH] powerpc: Make check_bugs() static inline

2005-09-09 22:11:35 +10:00

byteorder.h

[PATCH] powerpc: merge byteorder.h

2005-09-28 15:42:53 +10:00

cache.h

[PATCH] Kill L1_CACHE_SHIFT_MAX

2006-01-08 20:13:39 -08:00

cacheflush.h

[PATCH] powerpc: Merge cacheflush.h and cache.h

2005-11-10 13:09:22 +11:00

checksum.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

compat.h

[PATCH] powerpc signal __user annotations

2006-02-08 01:03:46 -05:00

cputable.h

[PATCH] powerpc: Implement support for setting little-endian mode via prctl

2006-06-09 21:24:15 +10:00

cputime.h

powerpc: Implement accurate task and CPU time accounting

2006-02-24 14:05:56 +11:00

current.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

dbdma.h

powerpc: Merge various powermac-related header files.

2005-10-20 20:53:39 +10:00

delay.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

div64.h

[PATCH] Move the identical files from include/asm-ppc{,64}

2005-08-30 13:32:05 +10:00

dma-mapping.h

[PATCH] remove bogus asm/bug.h includes.

2006-02-07 20:56:35 -05:00

dma.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

eeh_event.h

[PATCH] powerpc/pseries: clear PCI failure counter if no new failures

2006-04-22 18:46:13 +10:00

eeh.h

[PATCH] powerpc: remove io_page_mask

2006-04-22 18:45:05 +10:00

elf.h

[PATCH] powerpc vdso updates

2006-06-09 21:20:57 +10:00

emergency-restart.h

[PATCH] Move the identical files from include/asm-ppc{,64}

2005-08-30 13:32:05 +10:00

errno.h

[PATCH] powerpc: Standardize on _ASM_POWERPC header symbol prefix

2005-09-09 22:11:34 +10:00

fcntl.h

[PATCH] Consolidate the asm-ppc*/fcntl.h files into asm-powerpc

2005-09-07 16:57:39 -07:00

firmware.h

[PATCH] powerpc: Rename and export ppc64_firmware_features

2006-03-28 16:45:20 +11:00

floppy.h

[PATCH] powerpc: make ISA floppies work again

2006-03-28 16:45:36 +11:00

futex.h

[PATCH] lightweight robust futexes updates

2006-03-27 08:44:49 -08:00

grackle.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

hardirq.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

heathrow.h

powerpc: Fix some #ifndef __KERNEL__ that should be #ifdef

2006-01-09 15:14:05 +11:00

hvcall.h

[PATCH] powerpc: Extends HCALL interface for InfiniBand usage

2006-04-01 22:37:00 +11:00

hvconsole.h

[PATCH] powerpc: hvc_console updates

2006-03-28 16:45:26 +11:00

hvcserver.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

hw_irq.h

ppc64: remove ppc_irq_dispatch_handler

2005-11-09 16:19:53 +11:00

i8259.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

ibmebus.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

ide.h

powerpc: merge ide.h

2005-11-08 12:20:34 +11:00

io.h

Merge branch 'merge'

2006-04-29 16:15:57 +10:00

ioctl.h

[PATCH] powerpc: Standardize on _ASM_POWERPC header symbol prefix

2005-09-09 22:11:34 +10:00

ioctls.h

powerpc: remove duplicate ioctl definitions

2005-11-01 14:36:30 +11:00

iommu.h

[PATCH] powerpc: node-aware dma allocations

2006-06-09 21:24:01 +10:00

ipc.h

[PATCH] Move the identical files from include/asm-ppc{,64}

2005-08-30 13:32:05 +10:00

ipcbuf.h

[PATCH] powerpc: Keep fixing merged ipcbuf.h

2005-11-03 16:58:17 +11:00

ipic.h

[PATCH] powerpc: moved ipic code to arch/powerpc

2006-01-09 14:48:57 +11:00

irq.h

powerpc: iSeries has only 256 IRQs

2006-04-04 14:49:48 +10:00

kdebug.h

[PATCH] Notifier chain update: API changes

2006-03-27 08:44:50 -08:00

kdump.h

[PATCH] powerpc: Kdump header cleanup

2006-05-19 15:02:16 +10:00

kexec.h

[PATCH] powerpc: Move crashkernel= handling into the kernel.

2006-05-19 15:02:18 +10:00

keylargo.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

kmap_types.h

[PATCH] powerpc: Merge kmap_types.h

2005-09-19 09:38:49 +10:00

kprobes.h

[PATCH] kprobes: fix build breakage

2006-01-10 08:01:40 -08:00

linkage.h

[PATCH] powerpc: Standardize on _ASM_POWERPC header symbol prefix

2005-09-09 22:11:34 +10:00

lmb.h

[PATCH] powerpc: Remove calculation of io hole

2006-03-22 15:04:30 +11:00

local.h

[PATCH] Move all the very similar files to asm-powerpc

2005-08-30 13:32:06 +10:00

lppaca.h

[PATCH] Fix sparse parse error in lppaca.h

2006-01-17 17:18:25 -08:00

machdep.h

powerpc: Fix define_machine so machine_is() works from modules

2006-04-23 10:42:04 +10:00

macio.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

mc146818rtc.h

[PATCH] powerpc: Standardize on _ASM_POWERPC header symbol prefix

2005-09-09 22:11:34 +10:00

mediabay.h

powerpc: Merge various powermac-related header files.

2005-10-20 20:53:39 +10:00

mman.h

[PATCH] add asm-generic/mman.h

2006-02-15 15:32:22 -08:00

mmu_context.h

powerpc: Remove unused paca->pgdir field

2006-06-12 18:38:21 +10:00

mmu.h

powerpc: Use 64k pages without needing cache-inhibited large pages

2006-06-15 10:45:18 +10:00

mmzone.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

module.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

mpic.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

msgbuf.h

[PATCH] powerpc: Merge a few more include files

2005-09-09 22:11:35 +10:00

mutex.h

[PATCH] mutex subsystem, add default include/asm-*/mutex.h files

2006-01-09 15:59:19 -08:00

namei.h

[PATCH] powerpc: Standardize on _ASM_POWERPC header symbol prefix

2005-09-09 22:11:34 +10:00

nvram.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

of_device.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

ohare.h

powerpc: Fix some #ifndef __KERNEL__ that should be #ifdef

2006-01-09 15:14:05 +11:00

oprofile_impl.h

[PATCH] powerpc: Remove oprofile spinlock backtrace code

2006-03-29 13:44:16 +11:00

paca.h

powerpc: Use 64k pages without needing cache-inhibited large pages

2006-06-15 10:45:18 +10:00

page_32.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

page_64.h

[PATCH] powerpc: Fix pagetable bloat for hugepages

2006-04-28 15:02:51 +10:00

page.h

[PATCH] powerpc vdso updates

2006-06-09 21:20:57 +10:00

param.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

parport.h

[PATCH] powerpc: parallel port init fix

2006-01-11 14:49:24 +11:00

pci-bridge.h

[PATCH] powerpc: remove LogicalSlot from pci_dn

2006-05-24 16:08:56 +10:00

pci.h

[PATCH] powerpc: make pcibios_claim_one_bus available to other code

2006-01-09 14:51:08 +11:00

percpu.h

[PATCH] for_each_possible_cpu: powerpc

2006-03-29 13:44:15 +11:00

pgalloc.h

[PATCH] powerpc: Fix pagetable bloat for hugepages

2006-04-28 15:02:51 +10:00

pgtable-4k.h

powerpc: Use 64k pages without needing cache-inhibited large pages

2006-06-15 10:45:18 +10:00

pgtable-64k.h

powerpc: Use 64k pages without needing cache-inhibited large pages

2006-06-15 10:45:18 +10:00

pgtable.h

powerpc: Use 64k pages without needing cache-inhibited large pages

2006-06-15 10:45:18 +10:00

pmac_feature.h

[PATCH] powerpc: Kill _machine and hard-coded platform numbers

2006-03-28 23:15:54 +11:00

pmac_low_i2c.h

[PATCH] 3/5 powerpc: Add platform functions interpreter

2006-01-09 15:47:18 +11:00

pmac_pfunc.h

[PATCH] powerpc: enable irq's for platform functions.

2006-02-01 08:53:10 -08:00

pmc.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

poll.h

[PATCH] POLLRDHUP/EPOLLRDHUP handling for half-closed devices notifications

2006-03-25 08:22:56 -08:00

posix_types.h

[PATCH] powerpc: Merge asm-ppc*/posix_types.h

2005-09-21 19:21:07 +10:00

ppc_asm.h

powerpc: Implement accurate task and CPU time accounting

2006-02-24 14:05:56 +11:00

ppc-pci.h

[PATCH] powerpc: properly configure DDR/P5IOC children devs

2006-03-16 16:55:07 +11:00

processor.h

[PATCH] powerpc: Implement PR_[GS]ET_UNALIGN prctls for powerpc

2006-06-09 21:24:16 +10:00

prom.h

[PATCH] powerpc: Add of_parse_dma_window()

2006-05-19 15:02:21 +10:00

pSeries_reconfig.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

ptrace.h

[PATCH] powerpc: enable PPC_PTRACE_[GS]ETREGS on ppc32

2006-06-09 21:20:51 +10:00

reg_8xx.h

[PATCH] powerpc: Merge cacheflush.h and cache.h

2005-11-10 13:09:22 +11:00

reg.h

[PATCH] powerpc: oprofile support for POWER6

2006-06-09 21:24:05 +10:00

resource.h

[PATCH] Move all the very similar files to asm-powerpc

2005-08-30 13:32:06 +10:00

rtas.h

[PATCH] powerpc: reorg RTAS delay code

2006-06-09 21:21:06 +10:00

rtc.h

powerpc: Make set_rtc_time() return error code from lower-level function

2005-10-22 15:57:55 +10:00

rwsem.h

[PATCH] powerpc: trivial: modify comments to refer to new location of files

2006-02-10 16:53:51 +11:00

scatterlist.h

[PATCH] powerpc: merge scatterlist.h

2005-10-27 16:45:52 +10:00

seccomp.h

powerpc: Fix some #ifndef __KERNEL__ that should be #ifdef

2006-01-09 15:14:05 +11:00

sections.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

semaphore.h

Merge ../linux-2.6 by hand

2005-10-31 13:37:12 +11:00

sembuf.h

[PATCH] powerpc: Standardize on _ASM_POWERPC header symbol prefix

2005-09-09 22:11:34 +10:00

serial.h

powerpc: Introduce a new config symbol to control 16550 early debug code

2006-01-10 16:19:05 +11:00

setup.h

[PATCH] powerpc: Merge a few more include files

2005-09-09 22:11:35 +10:00

shmbuf.h

[PATCH] powerpc: Fix __power64__ typos that should be __powerpc64__

2005-09-09 22:11:35 +10:00

shmparam.h

[PATCH] powerpc: Standardize on _ASM_POWERPC header symbol prefix

2005-09-09 22:11:34 +10:00

sigcontext.h

powerpc: merge sigcontext.h

2005-11-03 16:24:25 +11:00

siginfo.h

[PATCH] ppc64: Add definitions for new PTRACE calls

2005-09-12 17:19:12 +10:00

signal.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

smp.h

[PATCH] powerpc: Allow non zero boot cpuids

2006-03-27 14:48:48 +11:00

smu.h

[PATCH] powerpc: Thermal control for dual core G5s

2006-02-07 22:05:14 -08:00

socket.h

[PATCH] powerpc: Standardize on _ASM_POWERPC header symbol prefix

2005-09-09 22:11:34 +10:00

sockios.h

[PATCH] powerpc: Standardize on _ASM_POWERPC header symbol prefix

2005-09-09 22:11:34 +10:00

sparsemem.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

spinlock_types.h

[PATCH] powerpc: merge include/asm-ppc*/spinlock_types.h into include/asm-powerpc/spinlock_types.h

2005-09-21 19:21:09 +10:00

spinlock.h

[PATCH] powerpc: use lwsync in atomics, bitops, lock functions

2006-01-13 21:18:50 +11:00

spu_csa.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

spu.h

[PATCH] powerpc: cell: Add numa id to struct spu

2006-05-01 18:17:46 -07:00

sstep.h

powerpc: Make single-stepping emulation (mostly) usable on 32-bit

2005-10-28 22:48:08 +10:00

stat.h

powerpc: merge stat.h

2005-11-03 16:02:23 +11:00

statfs.h

[PATCH] powerpc: merge include/asm-ppc*/statfs.h into include/asm-powerpc/statfs.h

2005-09-21 19:21:10 +10:00

string.h

powerpc: fix strncasecmp prototype

2006-03-25 09:41:40 -08:00

synch.h

[PATCH] powerpc: newline for ISYNC_ON_SMP

2006-02-24 14:06:00 +11:00

syscalls.h

[PATCH] powerpc: declare arch syscalls in <asm/syscalls.h>

2006-03-27 14:48:22 +11:00

system.h

[NET]: Allow skb headroom to be overridden

2006-03-31 02:27:06 -08:00

tce.h

[PATCH] powerpc: kill union tce_entry

2006-04-29 18:07:54 +10:00

termbits.h

[PATCH] Add CMSPAR to termbits.h for powerpc and alpha

2006-05-26 11:55:46 -07:00

termios.h

powerpc: use asm-generic/termios.h

2005-11-01 14:36:55 +11:00

thread_info.h

powerpc: Use correct sequence for putting CPU into nap mode

2006-04-18 21:49:11 +10:00

time.h

powerpc: Implement accurate task and CPU time accounting

2006-02-24 14:05:56 +11:00

timex.h

[PATCH] ppc32: Fix timekeeping

2005-10-12 08:24:47 -07:00

tlb.h

[PATCH] powerpc: sanitize header files for user space includes

2006-01-09 15:13:08 +11:00

tlbflush.h

[PATCH] ppc64: support 64k pages

2005-11-06 16:56:47 -08:00

topology.h

[PATCH] powerpc: implement pcibus_to_node and pcibus_to_cpumask

2006-06-09 21:21:08 +10:00

types.h

[PATCH] 2TB files: add blkcnt_t

2006-03-26 08:57:00 -08:00

uaccess.h

powerpc: Fix incorrect might_sleep in __get_user/__put_user on kernel addresses

2006-05-03 23:06:46 +10:00

ucontext.h

powerpc: merge ucontext.h

2005-11-03 16:59:17 +11:00

udbg.h

[PATCH] powerpc: udbg_printf() formatting attribute

2006-05-19 15:02:19 +10:00

unaligned.h

[PATCH] powerpc: Standardize on _ASM_POWERPC header symbol prefix

2005-09-09 22:11:34 +10:00

uninorth.h

powerpc: Merge various powermac-related header files.

2005-10-20 20:53:39 +10:00

unistd.h

[PATCH] powerpc: wire up sys_[gs]et_robust_list

2006-05-23 10:35:32 -07:00

user.h

[PATCH] powerpc: Merge a few more include files

2005-09-09 22:11:35 +10:00

vdso_datapage.h

[PATCH] powerpc: Kill _machine and hard-coded platform numbers

2006-03-28 23:15:54 +11:00

vdso.h

[PATCH] powerpc: Make the vDSO functions set error code (#2)

2005-11-16 14:05:11 +11:00

vga.h

[PATCH] powerpc: Merge asm-ppc*/vga.h

2005-09-21 19:21:09 +10:00

vio.h

[PATCH] powerpc: merge the rest of the vio code

2006-04-29 18:02:02 +10:00

xmon.h

powerpc: Simplify and clean up the xmon terminal I/O

2005-11-08 22:55:08 +11:00

xor.h

[PATCH] Move the identical files from include/asm-ppc{,64}

2005-08-30 13:32:05 +10:00