arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Brett Bode

24 papers · 1999–2025

1999: 12000: 22001: 02002: 02003: 02004: 12005: 22006: 22007: 02008: 02009: 12010: 12011: 12012: 12013: 02014: 12015: 12016: 12017: 32018: 12019: 02020: 02021: 02022: 12023: 12024: 02025: 3
1999peak 3 in 20172025

Frequent co-authors

Papers

showing 1–24 of 24 RSS

The portable batch scheduler and the maui scheduler on linux clusters

Brett Bode, David Halstead, Ricky A. Kendall +2 more

Computer Networks and Communications · · cited 164× · OpenAlex ↗ · more like this ·

The motivation for a stable, efficient, backfill scheduler that runs in a consistent manner on multiple hardware platforms and operating systems is outlined and justified in this work. The combination of the Maui Scheduler and the Portable Batch System (PBS), are evaluated on several cluster solutions of various size, performance and communications profiles. The total job throughput is simulated in this work, with particular attention given to maximizing resource utilization and to the execution of large parallel jobs.

The Blue Waters Super-System for Super-Science

Brett Bode, Michelle Butler, Thom H. Dunning +4 more

Computer Networks and Communications · · cited 43× · DOI ↗ · more like this ·

Blue Waters is a very well-balanced sustained petascale system being deployed into the National Science Foundation (NSF) Office of Cyber Infrastructure portfolio in 2012 for a diverse range of unique science and engineering challenges that require huge amounts of sustained performance. NSF is the primary sponsor of the Blue Waters Project, along with substantial support from the state of Illinois and the University of Illinois at Urbana-Champaign (UIUC). NCSA was established in 1986 as one of the original sites of the NSF's Supercomputer Centers Program as a partnership of the University of Illinois, the state of Illinois, and the federal government. By agreement with the NSF allocations at least 80% of the Blue Waters resources are allocated via the Petascale Computing Resource Allocation process known as Partner Allocation Process and Assumptions (PRAC). Blue Waters have the most…

Deploying a Large Petascale System: The Blue Waters Experience

Celso L. Mendes, Brett Bode, Gregory H. Bauer +3 more

Hardware and Architecture · Procedia Computer Science · · cited 18× · DOI ↗ · more like this ·

Deployment of a large parallel system is typically a very complex process, involving several steps of preparation, delivery, installation, testing and acceptance. Despite the availability of various petascale machines currently, the steps and lessons from their deployment are rarely described in the literature. This paper presents the experiences observed during the deployment of Blue Waters, the largest supercomputer ever built by Cray and one of the most powerful machines currently available for open science. The presentation is focused on the final deployment steps, where the system was intensively tested and accepted by NCSA. After a brief introduction of the Blue Waters architecture, a detailed description of the set of acceptance tests employed is provided, including many of the obtained results. This is followed by the major lessons learned during the process. Those experiences…

Unstructured grid applications on GPU

Lizandro Solano-Quinde, Z.J. Wang, Brett Bode +1 more

Computer Networks and Communications · · cited 17× · DOI ↗ · more like this ·

Performance of applications running on GPUs is mainly affected by hardware occupancy and global memory latency. Scientific applications that rely on analysis using unstructured grids could benefit from the high performance capabilities provided by GPUs, however, its memory access pattern and algorithm limit the potential benefits.

Performance analysis of memory transfers and GEMM subroutines on NVIDIA Tesla GPU cluster

Veerendra Allada, Troy Benjegerdes, Brett Bode

Hardware and Architecture · University of North Texas Digital Library (University of North Texas) · · cited 16× · DOI ↗ · more like this ·

Commodity clusters augmented with application accelerators are evolving as competitive high performance computing systems. The Graphical Processing Unit (GPU) with a very high arithmetic density and performance per price ratio is a good platform for the scientific application acceleration. In addition to the interconnect bottlenecks among the cluster compute nodes, the cost of memory copies between the host and the GPU device have to be carefully amortized to improve the overall efficiency of the application. Scientific applications also rely on efficient implementation of the Basic Linear Algebra Subroutines (BLAS), among which the General Matrix Multiply (GEMM) is considered as the workhorse subroutine. In this paper, we study the performance of the memory copies and GEMM subroutines that are crucial to port the computational chemistry algorithms to the GPU clusters. To that end, a…

A Performance Comparison of Tree and Ring Topologies in Distributed Systems

Min Huang, Brett Bode

Information Systems · · cited 13× · DOI ↗ · more like this ·

A distributed system is a collection of computers that are connected via a communication network. Distributed systems have become commonplace due to the wide availability of low-cost, high performance computers and network devices. However, the management infrastructure often does not scale well when distributed systems get very large. The considerations in building a distributed system are the choice of the network topology and the method used to construct the distributed system so as to optimize the scalability and reliability of the system, lower the cost of linking nodes together and minimize the message delay in transmission, and simplify system resource management. We have developed a new distributed management system that is able to handle the dynamic increase of system size, detect and recover the unexpected failure of system services, and manage system resources. The topologies…

Cluster interconnect overview

Brett Bode, Jason Hill, Troy Benjegerdes

Computer Networks and Communications · USENIX Annual Technical Conference · · cited 7× · OpenAlex ↗ · more like this ·

Today cluster computers are more commonplace than ever and there are a variety of choices for the interconnect. The right choice for a particular installation will depend on a variety of factors including price, raw performance, scalability, etc. This paper will present an overview of the popular network technologies available today including Gigabit Ethernet, 10 Gigabit Ethernet, Myrinet, SCI, Quadrics, and InfiniBand. Where possible a comparison will be included for multiple vendors of a given technology. Included will be comparisons of cost and performance of each along with suggestions for when each might present the best choice for a cluster installation.

Best practices for management and operation of large HPC installations

Scott Lathrop, Celso L. Mendes, Jeremy Enos +4 more

Computer Networks and Communications · Concurrency and Computation Practice and Experience · · cited 4× · DOI ↗ · more like this ·

Summary To achieve their mission and goals, HPC centers continually strive to improve the effectiveness of their resources and services to best serve their constituencies. Collectively, the community has learned a great deal about how to manage and operate HPC centers, provide robust and effective services, and develop new communities as well as about other important aspects. Yet, cataloguing best practices to help inform and guide the broader HPC community is not often done. To improve the situation, the Blue Waters project has documented sets of best practices that have been adopted for the deployment and operation over the past five years of the Blue Waters leadership system, a large Cray XE6/XK7 supercomputer at NCSA. Those practices, described in this paper, cover aspects of managing and operating the system and its resources, supporting its users, and expanding the diversity of…

Holistic Measurement-Driven System Assessment

Saurabh Jha, Jim Brandt, Ann Gentile +9 more

Computer Networks and Communications · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · · cited 4× · DOI ↗ · more like this ·

In high-performance computing systems, application performance and throughput are dependent on a complex interplay of hardware and software subsystems and variable workloads with competing resource demands. Data-driven insights into the potentially widespread scope and propagationof impact of events, such as faults and contention for shared resources, can be used to drive more effective use of resources, for improved root cause diagnosis, and for predicting performance impacts. We present work developing integrated capabilities for holistic monitoring and analysis to understand and characterize propagation of performance-degrading events. These characterizations can be used to determine and invoke mitigating responses by system administrators, applications, and system software.

Coarse grain computation-communication overlap for efficient application-level checkpointing for GPUs

Lizandro Solano-Quinde, Brett Bode, Arun K. Somani

Computer Networks and Communications · · cited 4× · DOI ↗ · more like this ·

Graphics Processing Units (GPUs) are increasingly used to solve non-graphical scientific problems. However, it has been shown that the reliability of the GPUs is a concern because of the occurrence of the soft and hard errors. The checkpoint/restart is the most commonly used technique to achieve fault tolerance in the presence of failures. This work present an application-level checkpoint scheme for systems composed of GPUs. Our scheme exploits the benefits of the divide-and-conquer technique and of the communication-computation overlapping to improve the execution time and checkpoint overhead. By dividing the problem and checkpointing in n subprocesses, we show that our scheme improves the checkpoint overhead by a factor of n. We also show that dividing the problem with finer granularity is not beneficial.

Techniques for the parallelization of unstructured grid applications on multi-GPU systems

Lizandro Solano-Quinde, Brett Bode, Arun K. Somani

Computer Networks and Communications · · cited 3× · DOI ↗ · more like this ·

Currently the set of scientific applications suitable for running on GPUs has increased due to the computational power of GPUs and the availability of programming languages that make more approachable writing scientific applications for GPUs. However, as the size of the problems increases, the global memory of GPUs becomes a limitation for running applications.

Scalable system software: a component-based approach

Brett Bode, Rick Bradshaw, Erik Debenedictus +9 more

Hardware and Architecture · Journal of Physics Conference Series · · cited 3× · DOI ↗ · more like this ·

The growth in computing resources at scientific computing centers has created new challenges for system software. These multi-teraflop systems often exceed the capabilities of the system software and require new approaches to accommodate these large processor counts. The costs associated with development and maintenance of this software are also significant impediments, which are compounded by a lack of interoperability because of site-specific enhancements. The Scalable System Software project seeks to address these issues through a component based approach to system software development. An overview of this design and the benefits of such an approach will be discussed in this paper.

DeltaAI: A National Resource for AI/ML Research

Brett Bode, Gregory H. Bauer, Laura Herriott +2 more

Artificial Intelligence · · cited 1× · DOI ↗ · more like this ·

DeltaAI is a new NSF funded resource supporting researchers nationwide via the ACCESS and NAIRR Pilot programs. DeltaAI builds upon the success of Delta and supplants Delta as the most powerful GPU resource available via the ACCESS program. DeltaAI leverages the Delta environment sharing storage and infrastructure resources while offering a more scalable platform capable of scaling jobs up to the full node count of the system. DeltaAI offers the latest NVIDIA H100 GPUs as part of the innovative Grace Hopper architecture. This paper describes the full architecture of DeltaAI and our experiences benchmarking applications and supporting research teams during the acceptance process for DeltaAI.

Automatic Parallelization of GPU Applications Using OpenCL

Lizandro Solano-Quinde, Brett Bode, Arun K. Somani

Hardware and Architecture · Americanae (AECID Library) · · cited 1× · DOI ↗ · more like this ·

Graphics Processing Units (GPUs) have been successfully used to accelerate scientific applications due to their computation power and the availability of programming languages that make more approachable writing scientific applications for GPUs. However, since the programming model of GPUs requires offloading all the data to the GPU memory, the memory footprint of the application is limited to the size of the GPU memory. Multi-GPU systems can make memory limited problems tractable by parallelizing the computation and data among the available GPUs. Parallelizing applications written for running on single-GPU systems can be done (i) at runtime through an environment that captures the memory operations and kernel calls and distributes among the available GPUs, and (ii) at compile time through a pre-compiler that transforms the application for decomposing the data and computation among the…

Understanding the Landscape of Ampere GPU Memory Errors

Zhu Zhu, Yu Sun, Dhatri Parakal +9 more

cs.DC · · cited 0× · arXiv ↗ · more like this ·

Graphics Processing Units (GPUs) have become a de facto solution for accelerating high-performance computing (HPC) applications. Understanding their memory error behavior is an essential step toward achieving efficient and reliable HPC systems. In this work, we present a large-scale cross-supercomputer study to characterize GPU memory reliability, covering three supercomputers - Delta, Polaris, and Perlmutter - all equipped with NVIDIA A100 GPUs. We examine error logs spanning 67.77 million GPU device-hours across 10,693 GPUs. We compare error rates and mean-time-between-errors (MTBE) and highlight both shared and distinct error characteristics among these three systems. Based on these observations and analyses, we discuss the implications and lessons learned, focusing on the reliable operation of supercomputers, the choice of checkpointing interval, and the comparison of reliability…

Blue <scp>Waters</scp> system and component reliability

Brett Bode, David King, Celso L. Mendes +5 more

Computer Networks and Communications · Concurrency and Computation Practice and Experience · · cited 0× · DOI ↗ · more like this ·

Summary The Blue Waters system, installed in 2012 at NCSA, has the largest component count of any system Cray has built. Blue Waters includes a mix of dual‐socket CPU (XE) and single‐socket CPU, single GPU (XK) nodes. The primary storage is provided by Cray's Sonexion/ClusterStor Luster storage system delivering 35 PB (raw) storage at 1 TB/s. The statistical failure rates over time for each component including CPU, DIMM, GPU, disk drive, power supply, blower, etc and their impact on higher level failure rates for individual nodes and the systems as a whole are presented in detail, with a particular emphasis on identifying any increases in rate that might indicate the right‐side of the expected bathtub curve has been reached. Strategies employed by NCSA and Cray for minimizing the impact of component failure, such as the preemptive removal of suspect disk drives, are also presented.

Analysis of User-Support Tickets in the Lifetime of the Blue Waters System

Gregory H. Bauer, Albert Bode, Brett Bode +3 more

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

We present an analysis of the collection of user support tickets created during nearly nine years of operation of the Blue Waters supercomputer. The analysis is based on information obtained from the Jira ticketing system and its corresponding queues. The paper contains a set of statistics showing, in quantitative form, the distribution of tickets across system areas. It also shows the computed metrics related to management of tickets by our staff. Additionally, we present an analysis, based on Machine Learning and Sentiment Analysis techniques, conducted over the text entered in tickets, targeting detecting trends on users' views and perspectives about the Blue Waters system. This kind of study, which is uncommon in the literature, could provide guidance for operators of future large systems about the expected volume of user support demanded by each system area, and about how to…

Account Management of a Large-Scale HPC Resource

Brett Bode, Tim Bouvet, Jeremy Enos +1 more

Computer Networks and Communications · IUScholarWorks (Indiana University) · · cited 0× · OpenAlex ↗ · more like this ·

Blue Waters is the largest system that Cray has built and operates in a very open network environment. This paper will discuss the design of the Blue Waters logical administrative network and how that design provides a secure and reliable environment that separates the user and administrative access paths. The paper will then describe how accounts and other user and project information is provisioned efficiently across its 27,000+ nodes.

Storage challenge---Trading memory for disk

Troy Benjegerdes, Brett Bode, Kyle Schochenmaier

Computer Networks and Communications · · cited 0× · DOI ↗ · more like this ·

We present a novel approach for using high performance network attached parallel storage for out-of-core computation. Our approach utilizes many parallel disks and storage controllers with a near 1:1 ratio of compute nodes to storage servers. This, when combined with 30 Gigabit 12X InfiniBand interconnects, allows remote storage subsystem bandwidth to reach the same performance level as local memory-cache file I/O performance. This combination allows computational chemistry application problem sizes which require more than 100GB of intermediate data to store this data on disk without the disk I/O subsystem becoming the limiting factor. With sequential storage access speeds on the same order of magnitude as main memory performance, this allows out-of-core computation to become practical due to disk storage size being several orders of magnitude cheaper per GB than main memory storage.

The node monitoring component of a scalable systems software environment

Sam Miller, Brett Bode

Computer Networks and Communications · Iowa State University Digital Repository (Iowa State University) · · cited 0× · DOI ↗ · more like this ·

We describe Fountain, an implementation of the scalable systems software node monitor specification targeted at aggregate node monitoring for clusters. Fountain is designed from the ground up as a hierarchical system with scalability in mind. It leverages widely used technologies such as XML and HTTP to present an interface to other components in the SSS environment. In this paper we describe the design choices of Fountain and discuss some preliminary performance measurements on medium sized clusters.

USENIX Association

Th Annual Linux, Brett Bode, David M. Halstead +4 more

Cultural Studies · · cited 0× · OpenAlex ↗ · more like this ·

The motivation for a stable, efficient, backfill scheduler that runs in a consistent manner on multiple hardware platforms and operating systems is outlined and justified in this work. The combination of the Maui Scheduler and the Portable Batch System (PBS), are evaluated on several cluster solutions of various size, performance and communications profiles. The total job throughput is simulated in this work, with particular attention given to maximizing resource utilization and to the execution of large parallel jobs.

Giga-Plant Scalable Cluster

David Halstead Brett, David M. Halstead, Brett Bode +2 more

Hardware and Architecture · · cited 0× · OpenAlex ↗ · more like this ·

The Giga-Plant is a next generation compute cluster architecture under construction within the Scalable Computing Laboratory (SCL). This work describes the general cluster design philosophy utilized on this machine and others, and illustrates the performance evaluation process that was exercised in order to make an informed hardware purchasing decision. We present network communication throughput results taken from several hardware platforms using Fast Ethernet and Gigabit Ethernet with and without Jumbo Frames. We show that, despite throughput in excess of 800Mbit/s, communication latency is the critical factor in determining the viability of commodity network hardware in parallel processing applications. 1 Introduction This work will document the general design philosophy used for clusters constructed within the SCL, a philosophy that extends from the component evaluation, to cluster…

Story of Two GPUs: Characterizing the Resilience of Hopper H100 and Ampere A100 GPUs

Shengkun Cui, Archit Patke, Hung Nguyen +11 more

cs.DC · · arXiv ↗ · more like this ·

This study characterizes GPU resilience in Delta, a large-scale AI system that consists of 1,056 A100 and H100 GPUs, with over 1,300 petaflops of peak throughput. We used 2.5 years of operational data (11.7 million GPU hours) on GPU errors. Our major findings include: (i) H100 GPU memory resilience is worse than A100 GPU memory, with 3.2x lower per-GPU MTBE for memory errors, (ii) The GPU memory error-recovery mechanisms on H100 GPUs are insufficient to handle the increased memory capacity, (iii) H100 GPUs demonstrate significantly improved GPU hardware resilience over A100 GPUs with respect to critical hardware components, (iv) GPU errors on both A100 and H100 GPUs frequently result in job failures due to the lack of robust recovery mechanisms at the application level, and (v) We project the impact of GPU node availability on larger-scales and find that significant overprovisioning of…

Workload Analysis of Blue Waters

Matthew D. Jones, Joseph P. White, Martins Innus +12 more

cs.DC · · arXiv ↗ · more like this ·

Blue Waters is a Petascale-level supercomputer whose mission is to enable the national scientific and research community to solve "grand challenge" problems that are orders of magnitude more complex than can be carried out on other high performance computing systems. Given the important and unique role that Blue Waters plays in the U.S. research portfolio, it is important to have a detailed understanding of its workload in order to guide performance optimization both at the software and system configuration level as well as inform architectural balance tradeoffs. Furthermore, understanding the computing requirements of the Blue Water's workload (memory access, IO, communication, etc.), which is comprised of some of the most computationally demanding scientific problems, will help drive changes in future computing architectures, especially at the leading edge. With this objective in…