arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Matthew D. Sinclair

79 papers · 2007–2026

2007: 12008: 02009: 02010: 02011: 12012: 12013: 22014: 02015: 32016: 32017: 52018: 122019: 22020: 92021: 52022: 62023: 62024: 92025: 92026: 5
2007peak 12 in 20182026

Frequent co-authors

Papers

showing 1–25 of 79 RSS

The gem5 Simulator: Version 20.0+

Jason Lowe-Power, Abdul Mutaal Ahmad, Ayaz Akram +75 more

cs.AR · · cited 451× · arXiv ↗ · more like this ·

The open-source and community-supported gem5 simulator is one of the most popular tools for computer architecture research. This simulation infrastructure allows researchers to model modern computer hardware at the cycle level, and it has enough fidelity to boot unmodified Linux-based operating systems and run full applications for multiple architectures including x86, Arm, and RISC-V. The gem5 simulator has been under active development over the last nine years since the original gem5 release. In this time, there have been over 7500 commits to the codebase from over 250 unique contributors which have improved the simulator by adding new features, fixing bugs, and increasing the code quality. In this paper, we give and overview of gem5's usage and features, describe the current state of the gem5 simulator, and enumerate the major changes since the initial release of gem5. We also…

Analyzing Machine Learning Workloads Using a Detailed GPU Simulator

Jonathan Lew, Deval Shah, Suchita Pati +8 more

cs.DC · · cited 84× · arXiv ↗ · more like this ·

Most deep neural networks deployed today are trained using GPUs via high-level frameworks such as TensorFlow and PyTorch. This paper describes changes we made to the GPGPU-Sim simulator to enable it to run PyTorch by running PTX kernels included in NVIDIA's cuDNN library. We use the resulting modified simulator, which has been made available publicly with this paper, to study some simple deep learning workloads. With our changes to GPGPU-Sim's functional simulation model, we find GPGPU-Sim performance model running a cuDNN enabled implementation of LeNet for MNIST reports results within 30% of real hardware. Using GPGPU-Sim's AerialVision performance analysis tool we observe that cuDNN API calls contain many varying phases and appear to include potentially inefficient microarchitecture behaviour such as DRAM partition bank camping, at least when executed on GPGPU-Sim's current…

Lost in Abstraction: Pitfalls of Analyzing GPUs at the Intermediate Language Level

Anthony Gutierrez, Bradford M. Beckmann, Alexandru Duțu +9 more

Hardware and Architecture · · cited 74× · DOI ↗ · more like this ·

Modern GPU frameworks use a two-phase compilation approach. Kernels written in a high-level language are initially compiled to an implementation agnostic intermediate language (IL), then finalized to the machine ISA only when the target GPU hardware is known. Most GPU microarchitecture simulators available to academics execute IL instructions because there is substantially less functional state associated with the instructions, and in some situations, the machine ISA's intellectual property may not be publicly disclosed. In this paper, we demonstrate the pitfalls of evaluating GPUs using this higher-level abstraction, and make the case that several important microarchitecture interactions are only visible when executing lower-level instructions. Our analysis shows that given identical application source code and GPU microarchitecture models, execution behavior will differ significantly…

Stash

Rakesh Komuravelli, Matthew D. Sinclair, Johnathan Alsop +5 more

Hardware and Architecture · · cited 62× · DOI ↗ · more like this ·

Heterogeneous systems employ specialization for energy efficiency. Since data movement is expected to be a dominant consumer of energy, these systems employ specialized memories (e.g., scratchpads and FIFOs) for better efficiency for targeted data. These memory structures, however, tend to exist in local address spaces, incurring significant performance and energy penalties due to inefficient data movement between the global and private spaces. We propose an efficient heterogeneous memory system where specialized memory components are tightly coupled in a unified and coherent address space. This paper applies these ideas to a system with CPUs and GPUs with scratchpads and caches.

Efficient GPU synchronization without scopes

Matthew D. Sinclair, Johnathan Alsop, Sarita V. Adve

Hardware and Architecture · · cited 55× · DOI ↗ · more like this ·

As GPUs have become increasingly general purpose, applications with more general sharing patterns and fine- grained synchronization have started to emerge. Unfortunately, conventional GPU coherence protocols are fairly simplistic, with heavyweight requirements for synchronization accesses. Prior work has tried to resolve these inefficiencies by adding scoped synchronization to conventional GPU coherence protocols, but the resulting memory consistency model, heterogeneous-race-free (HRF), is more complex than the common data-race-free (DRF) model. This work applies the DeNovo coherence protocol to GPUs and compares it with conventional GPU coherence under the DRF and HRF consistency models. The results show that the complexity of the HRF model is neither necessary nor sufficient to obtain high performance. DeNovo with DRF provides a sweet spot in performance, energy, overhead, and memory…

Atlas-ISTN: Joint Segmentation, Registration and Atlas Construction with Image-and-Spatial Transformer Networks

Matthew Sinclair, Andreas Schuh, Karl Hahn +5 more

eess.IV · · cited 47× · arXiv ↗ · more like this ·

Deep learning models for semantic segmentation are able to learn powerful representations for pixel-wise predictions, but are sensitive to noise at test time and do not guarantee a plausible topology. Image registration models on the other hand are able to warp known topologies to target images as a means of segmentation, but typically require large amounts of training data, and have not widely been benchmarked against pixel-wise segmentation models. We propose Atlas-ISTN, a framework that jointly learns segmentation and registration on 2D and 3D image data, and constructs a population-derived atlas in the process. Atlas-ISTN learns to segment multiple structures of interest and to register the constructed, topologically consistent atlas labelmap to an intermediate pixel-wise segmentation. Additionally, Atlas-ISTN allows for test time refinement of the model's parameters to optimize the…

HPVM

Maria Kotsifakou, Prakalp Srivastava, Matthew D. Sinclair +3 more

Hardware and Architecture · · cited 47× · DOI ↗ · more like this ·

We propose a parallel program representation for heterogeneous systems, designed to enable performance portability across a wide range of popular parallel hardware, including GPUs, vector instruction sets, multicore CPUs and potentially FPGAs. Our representation, which we call HPVM, is a hierarchical dataflow graph with shared memory and vector instructions. HPVM supports three important capabilities for programming heterogeneous systems: a compiler intermediate representation (IR), a virtual instruction set (ISA), and a basis for runtime scheduling; previous systems focus on only one of these capabilities. As a compiler IR, HPVM aims to enable effective code generation and optimization for heterogeneous systems. As a virtual ISA, it can be used to ship executable programs, in order to achieve both functional portability and performance portability across such systems. At runtime, HPVM…

Not All GPUs Are Created Equal: Characterizing Variability in Large-Scale, Accelerator-Rich Systems

Prasoon Sinha, Akhil Guliani, Rutwik Jain +3 more

cs.DC · · cited 45× · arXiv ↗ · more like this ·

Scientists are increasingly exploring and utilizing the massive parallelism of general-purpose accelerators such as GPUs for scientific breakthroughs. As a result, datacenters, hyperscalers, national computing centers, and supercomputers have procured hardware to support this evolving application paradigm. These systems contain hundreds to tens of thousands of accelerators, enabling peta- and exa-scale levels of compute for scientific workloads. Recent work demonstrated that power management (PM) can impact application performance in CPU-based HPC systems, even when machines have the same architecture and SKU (stock keeping unit). This variation occurs due to manufacturing variability and the chip's PM. However, while modern HPC systems widely employ accelerators such as GPUs, it is unclear how much this variability affects applications. Accordingly, we seek to characterize the extent…

Spandex: A Flexible Interface for Efficient Heterogeneous Coherence

Johnathan Alsop, Matthew D. Sinclair, Sarita V. Adve

Hardware and Architecture · · cited 40× · DOI ↗ · more like this ·

Recent heterogeneous architectures have trended toward tighter integration and shared memory largely due to the efficient communication and programmability enabled by this shift. However, such integration is complex, because accelerators have widely disparate methods for accessing and keeping data coherent. Some processors use caches %that are backed by hardware coherence protocols like MESI, while others prefer lightweight software coherence protocols or use specialized memories like scratchpads with differing state and communication granularities. Modern solutions tend to build interfaces that extend existing MESI-style CPU coherence protocols, often by adding hierarchical indirection through intermediate shared caches. Although functionally correct, these strategies lack flexibility and generally suffer from performance limitations that make them sub-optimal for some emerging…

Automated cardiovascular magnetic resonance image analysis with fully convolutional networks

Wenjia Bai, Matthew Sinclair, Giacomo Tarroni +20 more

cs.CV · · cited 36× · arXiv ↗ · more like this ·

Cardiovascular magnetic resonance (CMR) imaging is a standard imaging modality for assessing cardiovascular diseases (CVDs), the leading cause of death globally. CMR enables accurate quantification of the cardiac chamber volume, ejection fraction and myocardial mass, providing information for diagnosis and monitoring of CVDs. However, for years, clinicians have been relying on manual approaches for CMR image analysis, which is time consuming and prone to subjective errors. It is a major clinical challenge to automatically derive quantitative and clinically relevant information from CMR images. Deep neural networks have shown a great potential in image pattern recognition and segmentation for a variety of tasks. Here we demonstrate an automated analysis method for CMR images, which is based on a fully convolutional network (FCN). The network is trained and evaluated on a large-scale…

Chasing Away RAts

Matthew D. Sinclair, Johnathan Alsop, Sarita V. Adve

Hardware and Architecture · · cited 35× · DOI ↗ · more like this ·

An unambiguous and easy-to-understand memory consistency model is crucial for ensuring correct synchronization and guiding future design of heterogeneous systems. In a widely adopted approach, the memory model guarantees sequential consistency (SC) as long as programmers obey certain rules. The popular data-race-free-0 (DRF0) model exemplifies this SC-centric approach by requiring programmers to avoid data races. Recent industry models, however, have extended such SC-centric models to incorporate relaxed atomics. These extensions can improve performance, but are difficult to specify formally and use correctly. This work addresses the impact of relaxed atomics on consistency models for heterogeneous systems in two ways. First, we introduce a new model, Data-Race-Free-Relaxed (DRFrlx), that extends DRF0 to provide SC-centric semantics for the common use cases of relaxed atomics. Second…

Demystifying BERT: System Design Implications

Suchita Pati, Shaizeen Aga, Nuwan Jayasena +1 more

Artificial Intelligence · · cited 24× · DOI ↗ · more like this ·

Transfer learning in natural language processing (NLP) uses increasingly large models that tackle challenging problems. Consequently, these applications are driving the requirements of future systems. To this end, we study the computationally and time-intensive training phase of NLP models and identify how its algorithmic behavior can guide future accelerator design. We focus on BERT (Bi-directional Encoder Representations from Transformer), one of the most popular Transformer-based NLP models, and identify key operations which are worthy of attention in accelerator design. In particular, we focus on the manifestation, size, and arithmetic behavior of these operations which remain constant irrespective of hardware choice. Our results show that although computations which manifest as matrix multiplications dominate BERT’s execution, they have considerable heterogeneity. Furthermore, we…

HeteroSync: A benchmark suite for fine-grained synchronization on tightly coupled GPUs

Matthew D. Sinclair, Johnathan Alsop, Sarita V. Adve

Hardware and Architecture · · cited 22× · DOI ↗ · more like this ·

Traditionally GPUs focused on streaming, data-parallel applications, with little data reuse or sharing and coarse-grained synchronization. However, the rise of general-purpose GPU (GPGPU) computing has made GPUs desirable for applications with more general sharing patterns and fine-grained synchronization, especially for recent GPUs that have a unified address space and coherent caches. Prior work has introduced microbenchmarks to measure the impact of these changes, but each paper uses its own set of microbenchmarks. In this work, we combine several of these sets together in a single suite, HeteroSync. HeteroSync includes several synchronization primitives, data sharing at different levels of the memory hierarchy, and relaxed atomics. We characterize the scalability of HeteroSync for different coherence protocols and consistency models on modern, tightly coupled CPU-GPU systems and…

Tale of Two Cs: Computation vs. Communication Scaling for Future Transformers on Future Hardware

Suchita Pati, Shaizeen Aga, Mahzabeen Islam +2 more

Computer Vision and Pattern Recognition · · cited 18× · DOI ↗ · more like this ·

Scaling neural network models has delivered dramatic quality gains across ML problems. However, this scaling also increased the reliance on efficient distributed training techniques. Accordingly, like other distributed computing scenarios, it is important to understand how compute and communication will scale relative to one another as models scale and hardware evolves? A careful study which answers this question can better guide the design of future systems which can efficiently train future large models.Accordingly, we comprehensively analyze compute vs. communication (Comp-vs.-Comm) scaling for future Transformer models on future hardware, across multiple axes (algorithmic, empirical, hardware evolution). First, our algorithmic analysis shows that compute generally enjoys an edge over communication as models scale. However, these trends are being stressed since device memory capacity…

Challenge benchmarks that must be conquered to sustain the gpu revolution

Emily Blem, Matthew D. Sinclair, Karthikeyan Sankaralingam

Hardware and Architecture · · cited 18× · OpenAlex ↗ · more like this ·

Abstract—The shift from GPUs to GPGPUs has brought with it many changes to the GPU architecture (e.g. more caches, more concurrent kernels, better synchronization). As GPUs press further into the general-purpose domain, architects must continue to address the performance of challenging workloads. This paper presents a set of challenge benchmarks and their key performance limitations to help direct future GPU architecture research. Our study shows GPUs must develop multiple innovative architectural techniques to efficiently execute these applications to continue making inroads into general purpose computing. I.

Inter-kernel Reuse-aware Thread Block Scheduling

Muhammad Huzaifa, Johnathan Alsop, Abdulrahman Mahmoud +3 more

Hardware and Architecture · ACM Transactions on Architecture and Code Optimization · · cited 17× · DOI ↗ · more like this ·

As GPUs have become more programmable, their performance and energy benefits have made them increasingly popular. However, while GPU compute units continue to improve in performance, on-chip memories lag behind and data accesses are becoming increasingly expensive in performance and energy. Emerging GPU coherence protocols can mitigate this bottleneck by exploiting data reuse in GPU caches across kernel boundaries. Unfortunately, current GPU thread block schedulers are typically not designed to expose such reuse. This article proposes new hardware thread block schedulers that optimize inter-kernel reuse while using work stealing to preserve load balance. Our schedulers are simple, decentralized, and have extremely low overhead. Compared to a baseline round-robin scheduler, the best performing scheduler reduces average execution time and energy by 19% and 11%, respectively, in regular…

School funding in Australia: A critical policy analysis of school sector influence in the processes of policy production

Matthew P. Sinclair, Jeffrey S. Brooks

Education · Education Policy Analysis Archives · · cited 16× · DOI ↗ · more like this ·

The distribution of government funding for schooling can lead to significant differences in educational opportunities and outcomes for students. Unsurprisingly, school funding policy has been a site of intense political and public debate in many countries. In Australia, the Public, Catholic, and Independent school sectors, which collectively make up the Australian education system, all receive government funding. This article examines the representation and influence of the three school sectors at key moments in the policymaking cycle of the Review of Funding for Schooling, a pivotal 2011 report that shaped the trajectory of school funding policy in Australia. This case study focused on the report's development and found a disproportional representation of the Independent and Catholic school sectors at key points in the Review's policy cycle. In light of this critique, the article…

Deadline-Aware Offloading for High-Throughput Accelerators

Tsung Tai Yeh, Matthew D. Sinclair, Bradford M. Beckmann +1 more

Hardware and Architecture · · cited 16× · DOI ↗ · more like this ·

Contemporary GPUs are widely used for throughput-oriented data-parallel workloads and increasingly are being considered for latency-sensitive applications in datacenters. Examples include recurrent neural network (RNN) inference, network packet processing, and intelligent personal assistants. These data parallel applications have both high throughput demands and real-time deadlines (40μs-7ms). Moreover, the kernels in these applications have relatively few threads that do not fully utilize the device unless a large batch size is used. However, batching forces jobs to wait, which increases their latency, especially when realistic job arrival times are considered.Previously, programmers have managed the tradeoffs associated with concurrent, latency-sensitive jobs by using a combination of GPU streams and advanced scheduling algorithms running on the CPU host. Although GPU streams allow…

Improving the Scalability of GPU Synchronization Primitives

Preyesh Dalmia, Rohan Mahapatra, Jeremy Intan +2 more

Hardware and Architecture · IEEE Transactions on Parallel and Distributed Systems · · cited 14× · DOI ↗ · more like this ·

General-purpose GPU applications increasingly use synchronization to enforce ordering between many threads accessing shared data. Accordingly, recently there has been a push to establish a common set of GPU synchronization primitives. However, the expressiveness of existing GPU synchronization primitives is limited. In particular the expensive GPU atomics often used to implement fine-grained synchronization make it challenging to implement efficient algorithms. Consequently, as GPU algorithms scale to millions or billions of threads, existing GPU synchronization primitives either scale poorly or suffer from livelock or deadlock issues because of heavy contention between threads accessing shared synchronization objects. We seek to overcome these inefficiencies by designing more efficient, scalable GPU barriers and semaphores. In particular, we show how multi-level sense reversing…

Deterministic Atomic Buffering

Yuan Hsi Chou, Christopher Ng, Shaylin Cattell +5 more

Hardware and Architecture · · cited 13× · DOI ↗ · more like this ·

Deterministic execution for GPUs is a desirable property as it helps with debuggability and reproducibility. It is also important for safety regulations, as safety critical workloads are starting to be deployed onto GPUs. Prior deterministic architectures, such as GPUDet, attempt to provide strong determinism for all types of workloads, incurring significant performance overheads due to the many restrictions that are required to satisfy determinism. We observe that a class of reduction workloads, such as graph applications and neural architecture search for machine learning, do not require such severe restrictions to preserve determinism. This motivates the design of our system, Deterministic Atomic Buffering (DAB), which provides deterministic execution with low area and performance overheads by focusing solely on ordering atomic instructions instead of all memory instructions. By…

Automatic left ventricular outflow tract classification for accurate cardiac MR planning

İlkay Öksüz, Bram Ruijsink, Esther Puyol‐Antón +4 more

Computer Vision and Pattern Recognition · · cited 13× · DOI ↗ · more like this ·

Cardiac MR planning is important to ensure high quality image data and to enable accurate quantification of cardiac function. One result of inaccurate planning is an `off-axis' orientation of the 4-chamber view, often recognized by the presence of the left ventricular outflow tract (LVOT). This can lead to difficulties in assessment of atrial volumes and septal wall motion, either manually by experts or by automated image analysis algorithms. For large datasets such as the UK biobank, manual labelling is tedious and automated analysis pipelines including automatic image quality assessment need to be developed. In this paper, we propose a method to automatically detect the presence of the LVOT in cardiac MRI, which can aid identifying poorly planned 4-chamber images. Our method is based on Convolutional Neural Networks (CNNs) and is able to detect LVOT in 4-chamber images in less than…

Fostering a Sense of Community in Residence Halls: A Role for Housing and Residential Professionals in Increasing College Student Persistence

Natalee M. Erb, Matthew S. Sinclair, John M. Braxton

Education · Strategic Enrollment Management Quarterly · · cited 13× · DOI ↗ · more like this ·

Fostering a sense of community should be at the center of every housing and residence life professional's efforts. Research conducted by Braxton et al. (2014) revealed that students who are able to identify with their residence hall community, interact with peers in this community, and find solidarity within the community experience an increased sense of communal potential. This heightened communal potential is positively correlated with student persistence. Therefore, this article explores Berger's (1997) three dimensions of community—identity, interaction, and solidarity—by identifying currently implemented policies and practices within residence hall communities that seemingly foster these dimensions of community. These policies and programs, and the like, are strongly encouraged within residence hall communities, especially those housing first‐year students.

GSI: A GPU Stall Inspector to characterize the sources of memory stalls for tightly coupled GPUs

Johnathan Alsop, Matthew D. Sinclair, Rakesh Komuravelli +1 more

Hardware and Architecture · IDEALS (University of Illinois Urbana-Champaign) · · cited 12× · DOI ↗ · more like this ·

In recent years the power wall has prevented the continued scaling of single core performance. This has lead to the rise of dark silicon and motivated a move toward parallelism and specialization. As a result, energy-efficient high-throughput GPU cores are increasingly favored for accelerating data-parallel applications. However, the best way to efficiently communicate and synchronize across heterogeneous cores remains an important open research question. Many methods have been proposed to improve the efficiency of heterogeneous memory systems, but current methods for evaluating the performance effects of these innovations are limited in their ability to attribute differences in execution time to sources of latency in the memory system. Performance characterization of tightly coupled CPU-GPU systems is complicated by the high levels of parallelism present in GPU codes. Existing…

Only Buffer When You Need To: Reducing On-chip GPU Traffic with Reconfigurable Local Atomic Buffers

Preyesh Dalmia, Rohan Mahapatra, Matthew D. Sinclair

Hardware and Architecture · · cited 11× · DOI ↗ · more like this ·

In recent years, due to their wide availability and ease of programming, GPUs have emerged as the accelerator of choice for a wide variety of applications including graph analytics and machine learning training. These applications use atomics to update shared global variables. However, since GPUs do not efficiently support atomics, this limits scalability. We propose to use hardware-software co-design to address this bottleneck and improve scalability. At the software level, we leverage recently proposed extensions to the GPU memory consistency model to identify atomic updates where the ordering can be relaxed. For example, in these algorithms the updates are commutative. At the hardware level, we propose a buffering mechanism that extends the reconfigurable local SRAM per SM. By buffering partial updates of these atomics locally, our design increases reuse, reduces atomic serialization…

Enabling Reproducible and Agile Full-System Simulation

Bobby R. Bruce, Ayaz Akram, Hoa D. Nguyen +6 more

Hardware and Architecture · · cited 10× · DOI ↗ · more like this ·

Running experiments in modern computer architecture simulators can be a difficult and error-prone endeavor. Users must track many configurations, components and outputs between simulation runs. The gem5 simulator is no exception to this, requiring researchers to gather, organize, and create a significant number of components for a single simulation. In this paper, we present the gem5art framework, a tool to aid gem5 users in better structuring and running architecture simulations, and gem5 resources, a suite of resources with known compatibility with the simulator. These new additions to the gem5 project make full system simulation easier, allowing researchers to concentrate more so on their architectural innovations over setting up the simulation framework. The gem5art framework carefully logs the resources used in a gem5 simulation and places the results obtained within a database…