Ard Biesheuvel 34e526cb7d arm64/head: Disable MMU at EL2 before clearing HCR_EL2.E2H ... Even though the boot protocol stipulates otherwise, an exception has been made for the EFI stub, and entering the core kernel with the MMU enabled is permitted. This allows a substantial amount of cache maintenance to be elided, wich is significant when fast boot times are critical (e.g., for booting micro-VMs) Once the initial ID map has been populated, the MMU is disabled as part of the logic sequence that puts all system registers into a known state. Any code that needs to execute within the window where the MMU is off is cleaned to the PoC explicitly, which includes all of HYP text when entering at EL2. However, the current sequence of initializing the EL2 system registers is not safe: HCR_EL2 is set to its nVHE initial state before SCTLR_EL2 is reprogrammed, and this means that a VHE-to-nVHE switch may occur while the MMU is enabled. This switch causes some system registers as well as page table descriptors to be interpreted in a different way, potentially resulting in spurious exceptions relating to MMU translation. So disable the MMU explicitly first when entering in EL2 with the MMU and caches enabled. Fixes: 6178617038 ("efi: arm64: enter with MMU and caches enabled") Signed-off-by: Ard Biesheuvel <ardb@kernel.org> Cc: <stable@vger.kernel.org> # 6.3.x Acked-by: Mark Rutland <mark.rutland@arm.com> Acked-by: Marc Zyngier <maz@kernel.org> Link: https://lore.kernel.org/r/20240415075412.2347624-6-ardb+git@google.com Signed-off-by: Catalin Marinas <catalin.marinas@arm.com>		2024-04-18 18:00:55 +01:00
..
pi	Revert "arm64: mm: add support for WXN memory translation attribute"	2024-03-13 10:53:20 +00:00
probes	arm64: kretprobes: acquire the regs via a BRK exception	2024-02-20 18:13:57 +00:00
vdso	kbuild: unify vdso_install rules	2023-10-28 21:09:02 +09:00
vdso32	arm64: vdso32: Remove unused vdso32-offsets.h	2024-01-30 11:59:17 +00:00
.gitignore	…
Makefile	- Sumanth Korikkar has taught s390 to allocate hotplug-time page frames	2024-03-14 17:43:30 -07:00
acpi.c	arm64: acpi: Fix possible memory leak of ffh_ctxt	2023-02-24 14:21:49 +00:00
acpi_numa.c	…
acpi_parking_protocol.c	arm64: smp: Remove dedicated wakeup IPI	2023-09-25 17:15:28 +01:00
alternative.c	Merge branches 'for-next/kpti', 'for-next/missing-proto-warn', 'for-next/iss2-decode', 'for-next/kselftest', 'for-next/misc', 'for-next/feat_mops', 'for-next/module-alloc', 'for-next/sysreg', 'for-next/cpucap', 'for-next/acpi', 'for-next/kdump', 'for-next/acpi-doc', 'for-next/doc' and 'for-next/tpidr2-fix', remote-tracking branch 'arm64/for-next/perf' into for-next/core	2023-06-23 18:32:20 +01:00
armv8_deprecated.c	arm: Remove now superfluous sentinel elem from ctl_table arrays	2023-10-10 15:22:02 -07:00
asm-offsets.c	arm64: make member of struct pt_regs and it's offset macro in the same order	2024-02-22 19:07:49 +00:00
cacheinfo.c	cacheinfo: Add arm64 early level initializer implementation	2023-04-13 09:32:33 +01:00
compat_alignment.c	arm64: compat: Work around uninitialized variable warning	2023-04-05 17:51:47 +01:00
cpu-reset.S	arm64: kernel: remove SHF_WRITE|SHF_EXECINSTR from .idmap.text	2023-05-02 12:42:22 +01:00
cpu_errata.c	arm64: Subscribe Microsoft Azure Cobalt 100 to ARM Neoverse N2 errata	2024-02-15 11:47:22 +00:00
cpu_ops.c	…
cpufeature.c	S390:	2024-03-15 13:03:13 -07:00
cpuidle.c	arm64: Explicitly include correct DT includes	2023-07-31 14:45:38 +01:00
cpuinfo.c	S390:	2024-03-15 13:03:13 -07:00
crash_dump.c	…
debug-monitors.c	arm64: kgdb: Set PSTATE.SS to 1 to re-enable single-step	2023-04-14 13:39:47 +01:00
efi-header.S	arm64: efi: Enable BTI codegen and add PE/COFF annotation	2023-04-20 15:43:45 +02:00
efi-rt-wrapper.S	arm64: efi: Avoid workqueue to check whether EFI runtime is live	2023-01-16 15:27:31 +01:00
efi.c	arm64/mm: new ptep layer to manage contig bit	2024-02-22 15:27:18 -08:00
elfcore.c	arm64: mte: Avoid the racy walk of the vma list during core dump	2023-01-05 15:12:12 +00:00
entry-common.c	arm64: Unmask Debug + SError in do_notify_resume()	2024-02-20 18:12:13 +00:00
entry-fpsimd.S	arm64/sme: Implement context switching for ZT0	2023-01-20 12:23:06 +00:00
entry-ftrace.S	arm64: ftrace: Enable HAVE_FUNCTION_GRAPH_RETVAL	2023-06-20 18:38:37 -04:00
entry.S	arm64: entry: simplify kernel_exit logic	2024-01-18 11:00:09 +00:00
fpsimd.c	arm64 updates for 6.9:	2024-03-14 15:35:42 -07:00
ftrace.c	arm64: module: mandate MODULE_PLTS	2023-06-06 17:39:05 +01:00
head.S	arm64/head: Disable MMU at EL2 before clearing HCR_EL2.E2H	2024-04-18 18:00:55 +01:00
hibernate-asm.S	…
hibernate.c	arm64: hibernate: remove WARN_ON in save_processor_state	2023-06-21 13:33:49 +01:00
hw_breakpoint.c	arm64/hw_breakpoint: Directly use ESR_ELx_WNR for an watchpoint exception	2024-03-01 17:36:51 +00:00
hyp-stub.S	ARM64:	2023-07-03 15:32:22 -07:00
idle.c	arm64: idle: Tag the arm64 idle functions as __cpuidle	2023-09-25 17:15:28 +01:00
image-vars.h	arm64: Enable LPA2 at boot if supported by the system	2024-02-16 12:42:40 +00:00
image.h	…
io.c	…
irq.c	arm64: irq: set the correct node for shadow call stack	2023-12-13 12:09:00 +00:00
jump_label.c	…
kaslr.c	arm64: kaslr: Use feature override instead of parsing the cmdline again	2024-02-16 12:42:31 +00:00
kexec_image.c	kexec_file, arm64: print out debugging message if required	2023-12-20 15:02:57 -08:00
kgdb.c	arm64: kgdb: Set PSTATE.SS to 1 to re-enable single-step	2023-04-14 13:39:47 +01:00
kuser32.S	arm64: Update Documentation/arm references	2023-06-12 06:33:48 -06:00
machine_kexec.c	arm64, crash: wrap crash dumping code into crash related ifdefs	2024-02-23 17:48:23 -08:00
machine_kexec_file.c	arm64, crash: wrap crash dumping code into crash related ifdefs	2024-02-23 17:48:23 -08:00
module-plts.c	Merge branch 'for-next/cpus_have_const_cap' into for-next/core	2023-10-26 17:10:18 +01:00
module.c	arm64: head: move dynamic shadow call stack patching into early C runtime	2024-02-16 12:42:30 +00:00
mte.c	arm64/mm: new ptep layer to manage contig bit	2024-02-22 15:27:18 -08:00
paravirt.c	…
patching.c	arm64: patching: implement text_poke API	2024-02-28 13:44:47 -08:00
pci.c	arm64: Explicitly include correct DT includes	2023-07-31 14:45:38 +01:00
perf_callchain.c	arm64: use XPACLRI to strip PAC	2023-04-13 12:27:11 +01:00
perf_regs.c	…
pointer_auth.c	…
process.c	arm64: remove unneeded BUILD_BUG_ON assertion	2024-02-22 11:02:51 +00:00
proton-pack.c	arm64: Avoid cpus_have_const_cap() for ARM64_UNMAP_KERNEL_AT_EL0	2023-10-16 14:17:06 +01:00
psci.c	…
ptrace.c	arm64/ptrace: Use saved floating point state type to determine SVE layout	2024-04-03 15:02:00 +01:00
reloc_test_core.c	…
reloc_test_syms.S	…
relocate_kernel.S	…
return_address.c	…
sdei.c	arm64: sdei: abort running SDEI handlers during crash	2023-08-04 17:35:33 +01:00
setup.c	Merge branch 'for-next/stage1-lpa2' into for-next/core	2024-03-07 19:05:29 +00:00
signal.c	arm64 updates for 6.9:	2024-03-14 15:35:42 -07:00
signal32.c	x86/shstk: Add user control-protection fault handler	2023-08-02 15:01:50 -07:00
sigreturn32.S	…
sleep.S	arm64: mm: Handle LVA support as a CPU feature	2024-02-16 12:42:36 +00:00
smccc-call.S	…
smp.c	arm64: Align boot cpucap handling with system cpucap handling	2023-12-13 16:02:01 +00:00
smp_spin_table.c	…
stacktrace.c	Networking changes for 6.9.	2024-03-12 17:44:08 -07:00
suspend.c	arm64/sme: Restore SME registers on exit from suspend	2024-02-20 12:19:15 +00:00
sys.c	…
sys32.c	…
sys_compat.c	arm64: Avoid cpus_have_const_cap() for ARM64_WORKAROUND_1542419	2023-10-16 14:17:06 +01:00
syscall.c	arm64: remove unnecessary ifdefs around is_compat_task()	2024-02-28 18:01:23 +00:00
time.c	…
topology.c	arm64/amu: Use capacity_ref_freq() to set AMU ratio	2023-12-23 15:52:36 +01:00
trace-events-emulation.h	…
traps.c	ARM:	2023-11-02 15:45:15 -10:00
vdso-wrap.S	…
vdso.c	arm64: vdso: Use generic union vdso_data_store	2024-02-20 20:56:00 +01:00
vdso32-wrap.S	…
vmcore_info.c	crash: split vmcoreinfo exporting code out from crash_core.c	2024-02-23 17:48:22 -08:00
vmlinux.lds.S	arm64: head: Move early kernel mapping routines into C code	2024-02-16 12:42:33 +00:00
watchdog_hld.c	arm64: enable perf events based hard lockup detector	2023-06-09 17:44:22 -07:00