arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Hardware and Architecture

ParaSol: Thread-Level Speculation for Modern High-Performance Cores

Timothy M. Jones

See on the map

Abstract

To scale ILP, designers build deeper and wider out-of-order superscalar CPUs. However, this approach incurs quadratic scaling complexity, area, and energy costs with each generation. While small loops may benefit from increased instruction-window sizes and large loops may see speedups via thread-level parallelism across cores, there remains unexploited parallelism at a medium granularity. The ParaSol project taps into this potential by bringing thread-level speculation schemes into the modern era. Our approach runs multiple loop iterations from a single thread in parallel within the microarchitecture. Compiler-inserted hints indicate where the core can spawn future loop iterations as new microarchitectural threadlets, which can leapfrog execution beyond the parent thread’s instruction window, exposing a new, medium-grained parallelism, orthogonal to traditional ILP and TLP. The hardware monitors data dependencies between executing threadlets, forwards data for true dependencies and squashes threadlets when ordering violations occur. Across a range of hard-to-parallelise workload created by the our compiler, we can achieve meaningful whole-program speedups with only modest area and power overheads.

More like this