arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Al Davis

64 papers · 1994–2023

1994: 21995: 11996: 21997: 01998: 11999: 02000: 22001: 32002: 02003: 22004: 32005: 22006: 12007: 32008: 22009: 22010: 72011: 52012: 72013: 22014: 52015: 32016: 52017: 02018: 12019: 12020: 02021: 02022: 02023: 2
1994peak 7 in 20102023

Frequent co-authors

Papers

showing 1–25 of 64 RSS

HyperX

Jung Ho Ahn, Nathan Binkert, Al Davis +2 more

Computer Networks and Communications · · cited 257× · DOI ↗ · more like this ·

In the push to achieve exascale performance, systems will grow to over 100,000 sockets, as growing cores-per-socket and improved single-core performance provide only part of the speedup needed. These systems will need affordable interconnect structures that scale to this level. To meet the need, we consider an extension of the hypercube and flattened butterfly topologies, the HyperX, and give an adaptive routing algorithm, DAL. HyperX takes advantage of high-radix switch components that integrated photonics will make available. Our main contributions include a formal descriptive framework, enabling a search method that finds optimal HyperX configurations; DAL; and a low cost packaging strategy for an exascale HyperX. Simulations show that HyperX can provide performance as good as a folded Clos, with fewer switches. We also describe a HyperX packaging scheme that reduces system cost. Our…

Rethinking DRAM design and organization for energy-constrained multi-cores

Aniruddha N. Udipi, Naveen Muralimanohar, Niladrish Chatterjee +3 more

Hardware and Architecture · · cited 241× · DOI ↗ · more like this ·

DRAM vendors have traditionally optimized the cost-per-bit metric, often making design decisions that incur energy penalties. A prime example is the overfetch feature in DRAM, where a single request activates thousands of bit-lines in many DRAM chips, only to return a single cache line to the CPU. The focus on cost-per-bit is questionable in modern-day servers where operating costs can easily exceed the purchase cost. Modern technology trends are also placing very different demands on the memory system: (i)queuing delays are a significant component of memory access time, (ii) there is a high energy premium for the level of reliability expected for business-critical computing, and (iii) the memory access stream emerging from multi-core systems exhibits limited locality. All of these trends necessitate an overhaul of DRAM architecture, even if it means a slight compromise in the…

Micro-pages

Kshitij Sudan, Niladrish Chatterjee, David Nellans +3 more

Hardware and Architecture · ACM SIGARCH Computer Architecture News · · cited 139× · DOI ↗ · more like this ·

Power consumption and DRAM latencies are serious concerns in modern chip-multiprocessor (CMP or multi-core) based compute systems. The management of the DRAM row buffer can significantly impact both power consumption and latency. Modern DRAM systems read data from cell arrays and populate a row buffer as large as 8 KB on a memory request. But only a small fraction of these bits are ever returned back to the CPU. This ends up wasting energy and time to read (and subsequently write back) bits which are used rarely. Traditionally, an open-page policy has been used for uni-processor systems and it has worked well because of spatial and temporal locality in the access stream. In future multi-core processors, the possibly independent access streams of each core are interleaved, thus destroying the available locality and significantly under-utilizing the contents of the row buffer. In this…

Handling the problems and opportunities posed by multiple on-chip memory controllers

Manu Awasthi, David Nellans, Kshitij Sudan +2 more

Hardware and Architecture · · cited 133× · DOI ↗ · more like this ·

Modern processors such as Tilera's Tile64, Intel's Nehalem, and AMD's Opteron are migrating memory controllers (MCs) on-chip, while maintaining a large, flat memory address space. This trend to utilize multiple MC's will likely continue and a core or socket will consequently need to route memory requests to the appropriate MC via an inter- or intra-socket interconnect fabric similar to AMD's HyperTransport(TM), or Intel's Quick-Path Interconnect(TM). Such systems are therefore subject to non-uniform memory access (NUMA) latencies because of the time spent traveling to remote MCs. Each MC will act as the gateway to a particular piece of the physical memory. Data placement will therefore become increasingly critical in minimizing memory access latencies.

LOT-ECC

Aniruddha N. Udipi, Naveen Muralimanohar, Rajeev Balsubramonian +2 more

Hardware and Architecture · ACM SIGARCH Computer Architecture News · · cited 93× · DOI ↗ · more like this ·

Memory system reliability is a serious and growing concern in modern servers. Existing chipkill-level memory protection mechanisms suffer from several drawbacks. They activate a large number of chips on every memory access -- this increases energy consumption, and reduces performance due to the reduction in rank-level parallelism. Additionally, they increase access granularity, resulting in wasted bandwidth in the absence of sufficient access locality. They also restrict systems to use narrow-I/O x4 devices, which are known to be less energy-efficient than the wider x8 DRAM devices. In this paper, we present LOT-ECC, a localized and multi-tiered protection scheme that attempts to solve these problems. We separate error detection and error correction functionality, and employ simple checksum and parity codes effectively to provide strong fault-tolerance, while simultaneously simplifying…

MemZip: Exploring unconventional benefits from memory compression

Ali Shafiee, Meysam Taassori, Rajeev Balasubramonian +1 more

Hardware and Architecture · · cited 90× · DOI ↗ · more like this ·

Memory compression has been proposed and deployed in the past to grow the capacity of a memory system and reduce page fault rates. Compression also has secondary benefits: it can reduce energy and bandwidth demands. However, most prior mechanisms have been designed to focus on the capacity metric and few prior works have attempted to explicitly reduce energy or bandwidth. Further, mechanisms that focus on the capacity metric also require complex logic to locate the requested data in memory. In this paper, we design a highly simple compressed memory architecture that does not target the capacity metric. Instead, it focuses on complexity, energy, bandwidth, and reliability. It relies on rank subsetting and a careful placement of compressed data and metadata to achieve these benefits. Further, the space made available via compression is used to boost other metrics - the space can be used…

A low-power accelerator for the SPHINX 3 speech recognition system

Binu Mathew, Al Davis, Zhen Fang

Hardware and Architecture · · cited 72× · DOI ↗ · more like this ·

Accurate real-time speech recognition is not currently possible in the mobile embedded space where the need for natural voice interfaces is clearly important. The continuous nature of speech recognition coupled with an inherently large working set creates significant cache interference with other processes. Hence real-time recognition is problematic even on high-performance general-purpose platforms. This paper provides a detailed analysis of CMU's latest speech recognizer (Sphinx 3.2), identifies three distinct processing phases, and quantifies the architectural requirements for each phase. Several optimizations are then described which expose parallelism and drastically reduce the bandwidth and power requirements for real-time recognition. A special-purpose accelerator for the dominant Gaussiann probability phase is developed for a 0.25μ CMOS process which is then analyzed and…

Staged Reads: Mitigating the impact of DRAM writes on DRAM reads

Niladrish Chatterjee, Naveen Muralimanohar, Rajeev Balasubramonian +2 more

Hardware and Architecture · · cited 63× · DOI ↗ · more like this ·

Main memory latencies have always been a concern for system performance. Given that reads are on the critical path for CPU progress, reads must be prioritized over writes. However, writes must be eventually processed and they often delay pending reads. In fact, a single channel in the main memory system offers almost no parallelism between reads and writes. This is because a single off-chip memory bus is shared by reads and writes and the direction of the bus has to be explicitly turned around when switching from writes to reads. This is an expensive operation and its cost is amortized by carrying out a burst of writes or reads every time the bus direction is switched. As a result, no reads can be processed while a memory channel is busy servicing writes. This paper proposes a novel mechanism to boost read-write parallelism and perform useful components of read operations even when the…

Leveraging Heterogeneity in DRAM Main Memories to Accelerate Critical Word Access

Niladrish Chatterjee, Manjunath Shevgoor, Rajeev Balasubramonian +4 more

Hardware and Architecture · · cited 58× · DOI ↗ · more like this ·

The DRAM main memory system in modern servers is largely homogeneous. In recent years, DRAM manufacturers have produced chips with vastly differing latency and energy characteristics. This provides the opportunity to build a heterogeneous main memory system where different parts of the address space can yield different latencies and energy per access. The limited prior work in this area has explored smart placement of pages with high activities. In this paper, we propose a novel alternative to exploit DRAM heterogeneity. We observe that the critical word in a cache line can be easily recognized beforehand and placed in a low-latency region of the main memory. Other non-critical words of the cache line can be placed in a low-energy region. We design an architecture that has low complexity and that can accelerate the transfer of the critical word by tens of cycles. For our benchmark…

Fast, effective BVH updates for animated scenes

Daniel Kopta, Thiago Ize, Josef Spjut +3 more

Computer Graphics and Computer-Aided Design · · cited 39× · DOI ↗ · more like this ·

Bounding volume hierarchies (BVHs) are a popular acceleration structure choice for animated scenes rendered with ray tracing. This is due to the relative simplicity of refitting bounding volumes around moving geometry. However, the quality of such a refitted tree can degrade rapidly if objects in the scene deform or rearrange significantly as the animation progresses, resulting in dramatic increases in rendering times and a commensurate reduction in the frame rate. The BVH could be rebuilt on every frame, but this could take significant time. We present a method to efficiently extend refitting for animated scenes with tree rotations, a technique previously proposed for off-line improvement of BVH quality for static scenes. Tree rotations are local restructuring operations which can mitigate the effects that moving primitives have on BVH quality by rearranging nodes in the tree during…

LOT-ECC: Localized and tiered reliability mechanisms for commodity memory systems

Aniruddha N. Udipi, Naveen Muralimanohar, Rajeev Balsubramonian +2 more

Hardware and Architecture · · cited 38× · DOI ↗ · more like this ·

Memory system reliability is a serious and growing concern in modern servers. Existing chipkill-level memory protection mechanisms suffer from several draw-backs. They activate a large number of chips on every memory access - this increases energy consumption, and reduces performance due to the reduction in rank-level parallelism. Additionally, they increase access granularity, resulting in wasted bandwidth in the absence of sufficient access locality. They also restrict systems to use narrow-I/O ×4 devices, which are known to be less energy-efficient than the wider ×8 DRAM devices. In this paper, we present LOT-ECC, a localized and multi-tiered protection scheme that attempts to solve these problems. We separate error detection and error correction functionality, and employ simple checksum and parity codes effectively to provide strong fault-tolerance, while simultaneously simplifying…

A loop accelerator for low power embedded VLIW processors

Binu Mathew, Al Davis

Hardware and Architecture · · cited 36× · DOI ↗ · more like this ·

The high transistor density afforded by modern VLSI processes have enabled the design of embedded processors that use clustered execution units to deliver high levels of performance. However, delivering data to the execution resources in a timely manner remains a major problem that limits ILP. It is particularly significant for embedded systems where memory and power budgets are limited. A distributed address generation and loop acceleration architecture for VLIW processors is presented. This decentralized on-chip memory architecture uses multiple SRAMs to provide high intra-processor bandwidth. Each SRAM has an associated stream address generator capable of implementing a variety of addressing modes in conjunction with a shared loop accelerator.The architecture is extremely useful for generating application specific embedded processors, particularly for processing input data which is…

Prediction Based DRAM Row-Buffer Management in the Many-Core Era

Manu Awasthi, David Nellans, Rajeev Balasubramonian +1 more

Hardware and Architecture · · cited 32× · DOI ↗ · more like this ·

Modern processors are experiencing interleaved memory access streams from different threads/cores, reducing the spatial locality that is seen at the memory controller, making the combined stream appear increasingly random. Traditional methods for exploiting locality at the DRAM level, such as open-page and timer-based policies, become less effective as the number of threads accessing memory increases. Employing closed-page policies in such systems can improve performance but it eliminates any possibility of exploiting locality. In this paper, we build upon the key insight that a history-based predictor that tracks the number of accesses to a given DRAM page is a much better indicator of DRAM locality than timer based policies. We extend prior work to propose a simple Access Based Predictor (ABP) that tracks limited access history at the page level to determine page closure decisions…

An energy and bandwidth efficient ray tracing architecture

Daniel Kopta, Konstantin Shkurko, Josef Spjut +2 more

Computer Graphics and Computer-Aided Design · · cited 29× · DOI ↗ · more like this ·

We propose two hardware mechanisms to decrease energy consumption on massively parallel graphics processors for ray tracing while keeping performance high. First, we use a streaming data model and configure part of the L2 cache into a ray stream memory to enable efficient data processing through ray reordering. This increases the L1 hit rate and reduces off-chip memory accesses substantially. Second, we employ reconfigurable special-purpose pipelines than are constructed dynamically under program control. These pipelines use shared execution units (XUs) that can be configured to support the common compute kernels that are the foundation of the ray tracing algorithm, such as acceleration structure traversal and triangle intersection. This reduces the overhead incurred by memory and register accesses. These two synergistic features yield a ray tracing architecture that significantly…

Modeling NoC traffic locality and energy consumption with rent's communication probability distribution

George Bezerra, Stephanie Forrest, Melanie E. Moses +2 more

Computer Networks and Communications · · cited 28× · DOI ↗ · more like this ·

In systems on chip, the energy consumed by the Network on Chip (NoC) depends heavily on the network traffic pattern. The higher the communication locality, the lower the energy consumption will be. In this paper, we use the Communication Probability Distribution (CPD) to model communication locality and energy consumption in NoC. Firstly, based on recent results showing that communication patterns of many parallel applications follow Rent's rule, we propose a Rent's rule [6] traffic generator. In this method, the probability of communication between cores is derived directly from Rent's rule, which results in CPDs displaying high locality. Next, we provide a model for predicting NoC energy consumption based on the CPD. The model was tested on two NoC systems and several workloads, including Rent's rule traffic, and obtained accurate results when compared to simulations. The results also…

StreamRay

Karthik Ramani, Steven D. Gribble, Al Davis

Computer Graphics and Computer-Aided Design · · cited 21× · DOI ↗ · more like this ·

The wide availability of commodity graphics processors has made real-time graphics an intrinsic component of the human/computer interface. These graphics cores accelerate the z-buffer algorithm and provide a highly interactive experience at a relatively low cost. However, many applications in entertainment, science, and industry require high quality lighting effects such as accurate shadows, reflection, and refraction. These effects can be difficult to achieve with z-buffer algorithms but are straightforward to implement using ray tracing. Although ray tracing is computationally more complex, the algorithm exhibits excellent scaling and parallelism properties. Nevertheless, ray tracing memory access patterns are difficult to predict and the parallelism speedup promise is therefore hard to achieve.

A low power architecture for embedded perception

Binu Mathew, Al Davis, Mike Parker

Signal Processing · · cited 17× · DOI ↗ · more like this ·

Recognizing speech, gestures, and visual features are important interface capabilities for future embedded mobile systems. Unfortunately, the real-time performance requirements of complex perception applications cannot be met by current embedded processors and often even exceed the performance of high performance microprocessors whose energy consumption far exceeds embedded energy budgets. Though custom ASICs provide a solution to this problem, they incur expensive and lengthy design cycles and are inflexible. This paper introduces a VLIW perception processor which uses a combination of clustered function units, compiler controlled dataflow and compiler controlled clock-gating in conjunction with a scratch-pad memory system to achieve high performance for perceptual algorithms at low energy consumption. The architecture is evaluated using ten benchmark applications taken from complex…

Practical and efficient incremental adaptive routing for HyperX networks

Nie McDonald, Mikhail Isaev, Adriana Flores +2 more

Computer Networks and Communications · · cited 16× · DOI ↗ · more like this ·

In efforts to increase performance and reduce cost, modern low-diameter networks are designed for average case traffic and rely on non-minimal adaptive routing for network load-balancing when adversarial traffic patterns are encountered. Source adaptive routing is the predominant method for adaptive routing even though it presents many deficiencies related to making global decisions based solely on local information. In contrast, incremental adaptive routing, which performs an adaptive decision at every hop, is able to increase throughput and reduce latency by overcoming the deficiencies of source adaptive routing. We present two incremental adaptive routing algorithms for HyperX which are the first to be fully implementable in modern high-radix router architectures and interconnection network protocols. Using cycle accurate simulations of a 4,096 node network, our evaluation shows…

SuperSim: Extensible Flit-Level Simulation of Large-Scale Interconnection Networks

Nic McDonald, Adriana Flores, Al Davis +3 more

Computer Networks and Communications · · cited 13× · DOI ↗ · more like this ·

The interconnection networks of modern largescale computing systems are quickly increasing in size and complexity to keep up with the demand for computing capability. These systems rely heavily on complex router microarchitectures and intelligent adaptive routing algorithms structured for cost-optimized low-diameter networks. These technologies need to be properly modeled and evaluated during design space exploration and for performance characterization of the system. We present SuperSim, an open-source flit-level interconnection network simulator that enables focused evaluation of issues related to designing and deploying large-scale highperformance networks. SuperSim is a programmer-centric simulation framework explicitly designed to be flexibly extended and is supported by a number of tools making it easy to use and allowing users to model systems quickly. In this work we show the…

Design trade-offs for user-level I/O architectures

Lambert Schaelicke, Al Davis

Computer Networks and Communications · IEEE Transactions on Computers · · cited 11× · DOI ↗ · more like this ·

To address the growing I/O bottleneck, next-generation distributed I/O architectures employ scalable point-to-point interconnects and minimize operating system overhead by providing user-level access to the I/O subsystem. Reduced I/O overhead allows I/O intensive applications to efficiently employ latency hiding techniques for improved throughput. This paper presents the design of a novel scalable user-level I/O architecture and evaluates the impact of various architectural mechanisms in terms of overall performance improvement. Results demonstrate that eliminating data movement across protection domains is the dominant contributor to improved scalability. Eliminating system call and interrupt overhead only has a small additional benefit that may not justify the additional hardware support required. While this evaluation is based on one specific design, the conclusions can be…

Application driven embedded system design

Karthik Ramani, Al Davis

Hardware and Architecture · · cited 10× · DOI ↗ · more like this ·

The key to increasing performance without a commensurate increase in power consumption in modern processors lies in increasing both parallelism and core specialization. Core specialization has been employed in the embedded space and is likely to play an important role in future heterogeneous multi-core architectures as well. In this paper, the face recognition application domain is employed as a case study to showcase an architectural design methodology which generates a specialized core with high performance and very low powercharacteristics. Specifically, we create "ASIC-like" execution flows to sustain the high memory parallelism generated within the core. The price of this benefit is a significant increase in compilation complexity. The crux of the problem is the need to co-schedule the often conflicting constraints of data access, data movement, and computation. A modular compiler…

Improving I/O performance with a conditional store buffer

Lambert Schaelicke, Al Davis

Hardware and Architecture · International Symposium on Microarchitecture · · cited 10× · DOI ↗ · more like this ·

Microprocessor I/O performance is becoming increasingly critical in order to support efficient communication interfaces as modern microprocessors continue to be used in a variety of multiprocessor configurations. Numerous performance enhancements have been made to improve processor performance by improving the latency and bandwidth to main memory or creating efficient mechanisms to hide main memory latency. These include speculative out of order instruction execution, lock-up free caches, and improved memory bus designs. Sadly these improvements are not directly applicable to improved I/O system performance and may even complicate high performance I/O system design. This paper introduces and analyzes the design of a simple mechanism called the conditional store buffer. The conditional score buffer improves I/O write performance by making better use of the system bus to increase…

The perception processor

Al Davis, Binu K. Mathew

Signal Processing · · cited 9× · OpenAlex ↗ · more like this ·

Recognizing speech, gestures, and visual features are important interface capabilities for future embedded mobile systems. Unfortunately the real-time performance requirements of complex perception applications cannot be met by current embedded processors and often even exceed the capability of high performance microprocessors. The energy budget of current high performance processors is infeasible in the embedded space. The normal approach is to resort to a custom ASIC to meet performance and energy constraints. However ASICs incur expensive and lengthy design cycles. They are so specialized that they are unable to support multiple applications or even evolutionary improvements in a single application. This dissertation introduces a VLIW perception processor that uses a combination of clustered function units, compiler controlled data-flow and compiler controlled clock-gating in…

Photonics and future datacenter networks

Al Davis

Information Systems · · cited 8× · DOI ↗ · more like this ·

- Advances in electronics will continue BUT • processing benefits from these advances • data center communications will benefit but not as much • optics is the transport choice, electronics is the processor choice in an ideal world - NOTE: we don't live in an ideal world - Complete change to optical communication will not happen in one step • e.g. multi-core was a tough bridge for merchant semiconductors to cross - argument with Albert Yu in 2000 but Kunle had presented the case well in 1996 - Tejas cancelled in 2004 - note the 8 year lag between research and industry adoption • industry momentum is significant but so is the research side - Power wall is here to stay (I don't see the magic technology which moves the wall) • going green is not going to be easy if consumption is based on MORE • getting more performance for less power is problematic • replacing long wires with optical…

Algorithmic foundations for a parallel vector access memory system

Binu K. Mathew, Sally A. McKee, John B. Carter +1 more

Hardware and Architecture · · cited 7× · DOI ↗ · more like this ·

This paper presents mathematical foundations for the design of a memory controller subcomponent that helps to bridge the processor/memory performance gap for applications with strided access patterns. The Parallel Vector Access (PVA) unit exploits the regularity of vectors or streams to access them efficiently in parallel on a multi-bank SDRAM memory system. The PVA unit performs scatter/gather operations so that only the elements accessed by the application are transmitted across the system bus. Vector operations are broadcast in parallel to all memory banks, each of which implements an efficient algorithm to determine which vector elements it holds. Earlier performance evaluations have demonstrated that our PVA implementation loads elements up to 32.8 times faster than a conventional memory system and 3.3 times faster than a pipelined vector unit, without hurting the performance of…