arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Christopher Rodrigues

25 papers · 2007–2018

2007: 12008: 52009: 22010: 12011: 12012: 42013: 22014: 42015: 22016: 12017: 02018: 2
2007peak 5 in 20082018

Frequent co-authors

Papers

showing 1–25 of 25 RSS

Optimization principles and application performance evaluation of a multithreaded GPU using CUDA

Shane Ryoo, Christopher Rodrigues, Sara S. Baghsorkhi +3 more

Hardware and Architecture · · cited 906× · DOI ↗ · more like this ·

GPUs have recently attracted the attention of many application developers as commodity data-parallel coprocessors. The newest generations of GPU architecture provide easier programmability and increased generality while maintaining the tremendous memory bandwidth and computational power of traditional GPUs. This opportunity should redirect efforts in GPGPU research from ad hoc porting of applications to establishing principles and strategies that allow efficient mapping of computation to graphics hardware. In this work we discuss the GeForce 8800 GTX processor's organization, features, and generalized optimization strategies. Key to performance on this platform is using massive multithreading to utilize the large number of cores and hide global memory latency. To achieve this, developers face the challenge of striking the right balance between each thread's resource usage and the number…

Parboil: A Revised Benchmark Suite for Scientific and Commercial Throughput Computing

John A. Stratton, Christopher Rodrigues, I-Jui Sung +5 more

Hardware and Architecture · · cited 701× · OpenAlex ↗ · more like this ·

The Parboil benchmarks are a set of throughput computing applications useful for studying the performance of throughput computing architecture and compilers. The name comes from the culinary term for a partial cooking process, which represents our belief that useful throughput computing benchmarks must be “cooked”, or preselected to implement a scalable algorithm with fine-grained paralle l tasks. But useful benchmarks for this field cannot be “fully cooked”, because the architectures and programming models and supporting tools are evolving rapidly enough that static benchmark codes will lose relevance very quickly. We have collected benchmarks from throughput computing application researchers in many different scientific and commercial fields including image processing, biomolec ular simulation, fluid dynamics, and astronomy. Each benchmark includes several implementations. Some…

Program optimization space pruning for a multithreaded gpu

Shane Ryoo, Christopher Rodrigues, Sam S. Stone +4 more

Hardware and Architecture · · cited 290× · DOI ↗ · more like this ·

Program optimization for highly-parallel systems has historically been considered an art, with experts doing much of the performance tuning by hand. With the introduction of inexpensive, single-chip, massively parallel platforms, more developers will be creating highly-parallel applications for these platforms, who lack the substantial experience and knowledge needed to maximize their performance. This creates a need for more structured optimization methods with means to estimate their performance effects. Furthermore these methods need to be understandable by most programmers. This paper shows the complexity involved in optimizing applications for one such system and one relatively simple methodology for reducing the workload involved in the optimization process.

Adaptive Cache Management for Energy-Efficient GPU Computing

Xuhao Chen, Li‐Wen Chang, Christopher Rodrigues +3 more

Hardware and Architecture · · cited 152× · DOI ↗ · more like this ·

With the SIMT execution model, GPUs can hide memory latency through massive multithreading for many applications that have regular memory access patterns. To support applications with irregular memory access patterns, cache hierarchies have been introduced to GPU architectures to capture temporal and spatial locality and mitigate the effect of irregular accesses. However, GPU caches exhibit poor efficiency due to the mismatch of the throughput-oriented execution model and its cache hierarchy design, which limits system performance and energy-efficiency. The massive amount of memory requests generated by GPU scause cache contention and resource congestion. Existing CPUcache management policies that are designed for multicoresystems, can be suboptimal when directly applied to GPUcaches. We propose a specialized cache management policy for GPGPUs. The cache hierarchy is protected from…

XMalloc: A Scalable Lock-free Dynamic Memory Allocator for Many-core Machines

Xiaohuang Huang, Christopher Rodrigues, S. T. Jones +2 more

Computer Networks and Communications · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · · cited 64× · DOI ↗ · more like this ·

There are two avenues for many-core machines to gain higher performance: increasing the number of processors, and increasing the number of vector units in one SIMD processor. A truly scalable algorithm should take advantage of both. However, most past research on scalable memory allocators scales well with the number of processors, but poorly with the number of vector units in one SIMD processor. As a result, they are not truly scalable on many-core architectures. In this work, we introduce our proposed solution through the design of XMalloc, a truly scalable, efficient lock-free memory allocator. We will present (1) our solution for transforming traditional atomic compare-and-swap based lock-free algorithm to scale on SIMD architectures, and (2) a hierarchical cachelike buffer solution to reduce the average latency of accesses to non-scalable or slow resources such as main memory in a…

Compute Unified Device Architecture Application Suitability

Wen‐mei Hwu, Christopher Rodrigues, Shane Ryoo +1 more

Hardware and Architecture · Computing in Science & Engineering · · cited 56× · DOI ↗ · more like this ·

Graphics processing units (GPUs) can provide excellent speedups on some, but not all, general-purpose workloads. Using a set of computational GPU kernels as examples, the authors show how to adapt kernels to utilize the architectural features of a GeForce 8800 GPU and what finally limits the achievable performance.

Algorithm and Data Optimization Techniques for Scaling to Massively Threaded Systems

John A. Stratton, Christopher Rodrigues, I-Jui Sung +5 more

Hardware and Architecture · Computer · · cited 49× · DOI ↗ · more like this ·

A study of the implementation patterns among massively threaded applications for many-core GPUs reveals that each of the seven most commonly used algorithm and data optimization techniques can enhance the performance of applicable kernels by 2 to 10× in current processors while also improving future scalability.

Program Optimization Study on a 128-Core GPU

Shane Ryoo, Christopher Rodrigues, Sam S. Stone +3 more

Hardware and Architecture · · cited 38× · OpenAlex ↗ · more like this ·

Abstract — The newest generations of graphics processing unit (GPU) architecture, such as the NVIDIA GeForce 8-series, feature new interfaces that improve programmability and generality over previous GPU generations. Using NVIDIA’s Compute Unified Device Architecture (CUDA), the GPU is presented to developers as a flexible parallel architecture. This flexibility introduces the opportunity to perform a wide variety of parallelization optimizations on applications, but it can be difficult to choose and control optimizations to give reliable performance benefit. This work presents a study that examines a broad space of optimization combinations performed on several applications ported to the GeForce 8800 GTX. By doing an exhaustive search of the optimization space, we find configurations that are up to 74 % faster than those previously thought optimal. We explain the effects that…

Optimization and architecture effects on GPU computing workload performance

John A. Stratton, Nasser Anssari, Christopher Rodrigues +5 more

Hardware and Architecture · · cited 37× · DOI ↗ · more like this ·

It is unquestionable that successive hardware generations have significantly improved GPU computing workload performance over the last several years. Moore's law and DRAM scaling have respectively increased single-chip peak instruction throughput by 3X and off-chip bandwidth by 2.2X from NVIDIA's GeForce 8800 GTX in November 2006 to its GeForce GTX 580 in November 2010. However, raw capability numbers typically underestimate the improvements in real application performance over the same time period, due to significant architectural feature improvements. To demonstrate the effects of architecture features and optimizations over time, we conducted experiments on a set of benchmarks from diverse application domains for multiple GPU architecture generations to understand how much performance has truly been improving for those workloads. First, we demonstrate that certain architectural…

The parallelization of video processing

Dennis Lin, Xiaohuang Huang, Quang H. Nguyen +6 more

Computer Vision and Pattern Recognition · IEEE Signal Processing Magazine · · cited 25× · DOI ↗ · more like this ·

The explosive growth of digital video content from commodity devices and on the Internet has precipitated a renewed interest in video processing technology, which broadly encompasses the compression, enhancement, analysis, and synthesis of digital video. Video processing is computationally intensive and often has accompanying real-time or super-real-time requirements. For example, surveillance and monitoring systems need to robustly analyze video from multiple cameras in real time to automatically detect and signal unusual events. Beyond today's known applications, the continued growth of functionality and speed of video processing systems will likely further enable novel applications.

Income Level and Volatility by Children's Race and Hispanic Ethnicity

Lisa A. Gennetian, Christopher Rodrigues, Heather D. Hill +1 more

Health · Journal of Marriage and the Family · · cited 24× · DOI ↗ · more like this ·

Objective: This study documents how income dynamics during childhood differ across racial/ethnic groups and among Hispanics by nativity, citizenship, and the English‐language proficiency of households. Background: Income volatility has emerged as a distinct form of economic disadvantage that can impact family life and child well‐being. Yet little is understood about how income volatility is stratified by race and ethnicity. Method: Using longitudinal data on children from the 2004 ( n = 7,651) and 2008 ( n = 12,183) panels of the Survey of Income and Program Participation, this study examined income level and volatility among Hispanic, non‐Hispanic White, and non‐Hispanic Black children. Results: When compared with peers, Hispanic children were more likely to be low income, but experience slightly less income volatility. Income volatility among low‐income Hispanic children was similar…

Efficient kernel synthesis for performance portable programming

Li‐Wen Chang, Izzat El Hajj, Christopher Rodrigues +2 more

Hardware and Architecture · · cited 11× · DOI ↗ · more like this ·

The diversity of microarchitecture designs in heterogeneous computing systems allows programs to achieve high performance and energy efficiency, but results in substantial software re-development cost for each type or generation of hardware. To mitigate this cost, a performance portable programming system is required. One fundamental difference between architectures that makes performance portability challenging is the hierarchical organization of their computing elements. To address this challenge, we introduce TANGRAM, a kernel synthesis framework that composes architecture-neutral computations and composition rules into high-performance kernels customized for different architectural hierarchies. TANGRAM is based on an extensible architectural model that can be used to specify a variety of architectures. This model is coupled with a generic design space exploration and composition…

Tangram: a High-level Language for Performance Portable Code Synthesis

Li‐Wen Chang, Abdul Dakkak, Christopher Rodrigues +1 more

Hardware and Architecture · · cited 7× · OpenAlex ↗ · more like this ·

We propose Tangram, a general-purpose high-level language that achieves high performance across architectures. In Tangram, a program is written by synthesizing elemental pieces of code snippets, called codelets. A codelet can have multiple semantic-preserving implementations to enable automated algorithm and implementation selection. An implementation of a codelet can be written with tunable knobs to allow architecture-specific parameterization. The Tangram compiler produces highly optimized code by choosing and composing architecture-friendly codelets, and then tuning the knobs for the target architecture. We demonstrate that Tangram’s synthesized programs are comparable in performance to existing well-optimized codes on both CPUs and GPUs. The language is defined in a concise and maintainable way to improve debuggability and to enable progressive improvement. This strategy allows…

Triolet

Christopher Rodrigues, Thomas B. Jablin, Abdul Dakkak +1 more

Hardware and Architecture · · cited 6× · DOI ↗ · more like this ·

Functional algorithmic skeletons promise a high-level programming interface for distributed-memory clusters that free developers from concerns of task decomposition, scheduling, and communication. Unfortunately, prior distributed functional skeleton frameworks do not deliver performance comparable to that achievable in a low-level distributed programming model such as C with MPI and OpenMP, even when used in concert with high-performance array libraries. There are several causes: they do not take advantage of shared memory on each cluster node; they impose a fixed partitioning strategy on input data; and they have limited ability to fuse loops involving skeletons that produce a variable number of outputs per input.

SIMDization of Small Tensor Multiplication Kernels for Wide SIMD Vector Processors

Christopher Rodrigues, Amarin Phaosawasdi, Peng Wu

Hardware and Architecture · · cited 3× · DOI ↗ · more like this ·

Developers often rely on automatic vectorization to speed up fine-grained data-parallel code. However, for loop nests where the loops are shorter than the processor's SIMD width, automatic vectorization performs poorly. Vectorizers attempt to vectorize a single short loop, using (at best) a fraction of the processor's SIMD capacity. It is not straightforward to vectorize multiple nested loops together because they typically have memory accesses with multiple strides, which conventional methods cannot profitably vectorize.

Supporting high-level, high-performance parallel programming with library-driven optimization

Christopher Rodrigues

Computer Networks and Communications · · cited 2× · OpenAlex ↗ · more like this ·

Parallel programming is a demanding task for developers partly because achieving scal-able parallel speedup requires drawing upon a repertoire of complex, algorithm-specific, architecture-aware programming techniques. Ideally, developers of programming tools would be able to build algorithm-specific, high-level programming interfaces that hide the complex architecture-aware details. However, it is a monumental undertaking to develop such tools from scratch, and it is challenging to provide reusable functionality for developing such tools without sacrificing the hosted interface’s performance or ease of use. In particular, to get high performance on a cluster of multicore computers without requiring developers to manually place data and computation onto processors, it is necessary to combine prior methods for shared memory parallelism with new methods for algorithm-aware distribution of…

Optimization

Christopher Rodrigues, Thomas Jablin, Abdul Dakkak +1 more

Hardware and Architecture · · cited 0× · OpenAlex ↗ · more like this ·

Functional algorithmic skeletons promise a high-level pro-gramming interface for distributed-memory clusters that free developers from concerns of task decomposition, schedul-ing, and communication. Unfortunately, prior distributed functional skeleton frameworks do not deliver performance comparable to that achievable in a low-level distributed pro-gramming model such as C with MPI and OpenMP, even when used in concert with high-performance array libraries. There are several causes: they do not take advantage of shared memory on each cluster node; they impose a xed partitioning strategy on input data; and they have limited ability to fuse loops involving skeletons that produce a vari-able number of outputs per input. We address these shortcomings in the Triolet program-ming language through a modular library design that sep-arates concerns of parallelism, loop nesting, and data…

1 Does Money Really Matter? Estimating Impacts of Family Income on Children’s Achievement with Data from Random-Assignment Experiments

Pamela Morris, Greg J. Duncan, Christopher Rodrigues

Gender Studies · · cited 0× · OpenAlex ↗ · more like this ·

Foundation. We thank the original sponsors of the studies for permitting re-analyses of the data; Beth Clark-Kauffman, Heather Hill, and Ginette Azcona for analytical and research assistance; Joshua Angrist, Raquel Bernal, Dan Black, David Card, Robert Moffitt, and Chris Taber and MDRC’s Income Support Studies Committee members for thoughtful comments on earlier drafts. Please direct all correspondence regarding this submission to Greg J. Duncan. 2

Cover Feature Algorithm and Data Optimization Techniques for Scaling to Massively Threaded Systems

John A. Stratton, Christopher Rodrigues, I-jui (ray Sung +3 more

Hardware and Architecture · · cited 0× · OpenAlex ↗ · more like this ·

A study of the implementation patterns among massively threaded applications for many-core GPUs reveals that each of the seven most commonly used algorithm and data optimization techniques can enhance the performance of applicable kernels by 2 to 10 × in current processors while also improving future scalability. Recent many-core processors support hundreds of hardware threads and require thousands of tasks in applications to fully utilize their execution throughput. Scaling to such large numbers of threads requires more than just identifying and expressing parallelism. Each of those thousands of tasks will require data bandwidth, an increasingly

C omputer A rchitecture Compute Unified Device Architecture Application Suitability

Wen-mei Hwu, Christopher Rodrigues, Shane Ryoo +1 more

Hardware and Architecture · · cited 0× · OpenAlex ↗ · more like this ·

Graphics processing units (GPUs) can provide excellent speedups on some, but not all, general-purpose workloads. Using a set of computational GPU kernels as examples, the authors show how to adapt kernels to utilize the architectural features of a GeForce 8800 GPU and what finally limits the achievable performance. 1521-9615/09/$25.00 © 2009 IEEE Copublished by the IEEE CS and the AIP Computational scientists have long been interested in graphics processing units (GPUs) due to their relatively low cost per unit of floating-point (FP) performance. Unlike conventional multiprocessors, a GPU’s processor cores are specialized for program behaviors common to graphics shaders—thousands of independent threads, each comprising only dozens or hundreds of instructions, performing few memory accesses and producing a small number of output values. 1 Recent advances in hardware and programmability…

Unboxed Polymorphic Objects for Functional Numerical Programming

Christopher Rodrigues, Wen-mei Hwu

Hardware and Architecture · · cited 0× · OpenAlex ↗ · more like this ·

One approach to making numerical algorithms easier to write and understand is to provide a high-level library of polymorphic container types and higher-order functions for manipulating collections of data. Although polymorphic functions and data types are a common feature of programming languages, programming language implementations conventionally rely on compile-time knowledge of data layout when generating machine code. Ensuring that sizes are known at compile time requires boxing objects, which sacrifices performance; dynamically compiling functions, which requires heavyweight runtime support; prohibiting first-class polymorphism, which limits expressiveness; or using a predetermined set of monomorphic data types, which limits the range of usable types. To use efficient data layouts in statically compiled polymorphic code without limiting the use of polymorphism, we propose a…

Optimization Principles and Application Performance Evaluation of a Multithreaded GPU Using CUDA Abstract

Shane Ryoo, Christopher I. Rodrigues, Sara S. Baghsorkhi +1 more

Hardware and Architecture · · cited 0× · OpenAlex ↗ · more like this ·

GPUs have recently attracted the attention of many application developers as commodity data-parallel coprocessors. The newest generations of GPU architecture provide easier programmability and increased generality while maintaining the tremendous memory bandwidth and computational power of traditional GPUs. This opportunity should redirect efforts in GPGPU research from ad hoc porting of applications to establishing principles and strategies that allow efficient mapping of computation to graphics hardware. In this work we discuss the GeForce 8800 GTX processor’s organization, features, and generalized optimization strategies. Key to performance on this platform is using massive multithreading to utilize the large number of cores and hide global memory latency. To achieve this, developers face the challenge of striking the right balance between each thread’s resource usage and the number…

Hwu. Program optimization space pruning for a multithreaded gpu

Shane Ryoo, Christopher I. Rodrigues, Sam S. Stone +4 more

Hardware and Architecture · · cited 0× · OpenAlex ↗ · more like this ·

Program optimization for highly-parallel systems has historically been considered an art, with experts doing much of the performance tuning by hand. With the introduction of inexpensive, single-chip, massively parallel platforms, more developers will be creating highly-parallel applications for these platforms, who lack the substantial experience and knowledge needed to maximize their performance. This creates a need for more structured optimization methods with means to estimate their performance effects. Furthermore these methods need to be understandable by most programmers. This paper shows the complexity involved in optimizing applications for one such system and one relatively simple methodology for reducing the workload involved in the optimization process. This work is based on one such highly-parallel system, the GeForce 8800 GTX using CUDA. Its flexible allocation of resources…

University of Illinois at Urbana-Champaign Center for Reliable and High-Performance Computing

John A. Stratton, Christopher Rodrigues, I-jui Sung +5 more

Hardware and Architecture · · cited 0× · OpenAlex ↗ · more like this ·

The Parboil benchmarks are a set of throughput computing applications useful for studying the performance of throughput computing architecture and compilers. The name comes from the culinary term for a partial cooking process, which represents our belief that useful throughput computing benchmarks must be “cooked”, or preselected to implement a scalable algorithm with fine-grained parallel tasks. But useful benchmarks for this field cannot be “fully cooked”, because the architectures and programming models and supporting tools are evolving rapidly enough that static benchmark codes will lose relevance very quickly. We have collected benchmarks from throughput computing application researchers in many different scientific and commercial fields including image processing, biomolecular simulation, fluid dynamics, and astronomy. Each benchmark includes several implementations. Some…

Automatic Discovery of Coarse-Grained ParallelisminMediaApplications. TransactionsonHighPerformance Embedded Architectures and Compilers

Shane Ryoo, Sain-zee Ueng, Christopher I. Rodrigues +3 more

Hardware and Architecture · · cited 0× · OpenAlex ↗ · more like this ·

Abstract. With the increasing use of multi-core microprocessors and hardware accelerators in embedded media processing systems, there is an increasing need to discover coarse-grained parallelism in media applications written in C and C++. Common versions of these codes use a pointer-heavy, sequential programming model to implement algorithms with high levels of inherent parallelism. The lack of automated tools capable of discovering this parallelism has hampered the productivity of parallel programmers and application-specific hardware designers, as well as inhibited the development of automatic parallelizing compilers. Automatic discovery is challenging due to shifts in the prevalent programming languages, scalability problems of analysis techniques, and the lack of experimental research in combining the numerous analyses necessary to achieve a clear view of the relations among memory…