an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org
Author
30 papers · 2001–2022
showing 1–25 of 30 RSS
Weiqun Zhang, Ann Almgren, Vince Beckner +9 more
AMReX is a C++ software framework that supports the development of block-structured adaptive mesh refinement (AMR) algorithms for solving systems of partial differential equations (PDEs) with complex boundary conditions on current and emerging architectures.
Jason Ansel, Cy Chan, Yee Lok Wong +4 more
It is often impossible to obtain a one-size-fits-all solution for high performance algorithms when considering different choices for data distributions, parallelism, transformations, and blocking. The best solution to these choices is often tightly coupled to different architectures, problem sizes, data, and available system resources. In some cases, completely different algorithms may provide the best performance. Current compiler and programming language techniques are able to change some of these parameters, but today there is no simple way for the programmer to express or the compiler to choose different algorithms to handle different parts of the data. Existing solutions normally can handle only coarse-grained, library level selections or hand coded cutoffs between base cases and recursive cases.
Shoaib Kamil, Cy Chan, Leonid Oliker +2 more
Although stencil auto-tuning has shown tremendous potential in effectively utilizing architectural resources, it has hitherto been limited to single kernel instantiations; in addition, the large variety of stencil kernels used in practice makes this computation pattern difficult to assemble into a library. This work presents a stencil auto-tuning framework that significantly advances programmer productivity by automatically converting a straightforward sequential Fortran 95 stencil expression into tuned parallel implementations in Fortran, C, or CUDA, thus allowing performance portability across diverse computer architectures, including the AMD Barcelona, Intel Nehalem, Sun Victoria Falls, and the latest NVIDIA GPUs. Results show that our generalized methodology delivers significant performance gains of up to 22× speedup over the reference serial implementation. Overall we demonstrate…
Jason Ansel, Yee Lok Wong, Cy Chan +3 more
Abstract—Approximating ideal program outputs is a common technique for solving computationally difficult problems, for adhering to processing or timing constraints, and for performance optimization in situations where perfect precision is not necessary. To this end, programmers often use approximation algorithms, iterative methods, data resampling, and other heuristics. However, programming such variable accuracy algorithms presents difficult challenges since the optimal algorithms and parameters may change with different accuracy requirements and usage environments. This problem is further compounded when multiple variable accuracy algorithms are nested together due to the complex way that accuracy requirements can propagate across algorithms and because of the size of the set of allowable compositions. As a result, programmers often deal with this issue in an ad-hoc manner that can…
James Ang, Richard Frederick Barrett, Robert E. Benner +9 more
To achieve exascale computing, fundamental hardware architectures must change. This will significantly impact scientific applications that run on current high performance computing (HPC) systems, many of which codify years of scientific domain knowledge and refinements for contemporary computer systems. To adapt to exascale architectures, developers must be able to reason about new hardware and determine what programming models and algorithms will provide the best blend of performance and energy efficiency in the future. An abstract machine model is designed to expose to the application developers and system software only the aspects of the machine that are important or relevant to performance and code structure. These models are intended as communication aids between application developers and hardware architects during the co-design process. A proxy architecture is a parameterized…
Jason Ansel, Maciej Pacula, Yee Lok Wong +4 more
Modern high performance libraries, such as ATLAS and FFTW, and programming languages, such as PetaBricks, have shown that autotuning computer programs can lead to significant speedups. However, autotuning can be burdensome to the deployment of a program, since the tuning process can take a long time and should be re-run whenever the program, microarchitecture, execution environment, or tool chain changes. Failure to re-autotune programs often leads to widespread use of sub-optimal algorithms. With the growth of cloud computing, where computations can run in environments with unknown load and migrate between different (possibly unknown) microarchitectures, the need for online autotuning has become increasingly important.
Didem Unat, Cy Chan, Weiqun Zhang +4 more
One of the emerging challenges to designing HPC systems is understanding and projecting the requirements of exascale applications. In order to determine the performance consequences of different hardware designs, analytic models are essential because they can provide fast feedback to the co-design centers and chip designers without costly simulations. However, current attempts to analytically model program performance typically rely on the user manually specifying a performance model. We introduce the ExaSAT framework that automates the extraction of parameterized performance models directly from source code using compiler analysis. The parameterized analytic model enables quantitative evaluation of a broad range of hardware design trade-offs and software optimizations on a variety of different performance metrics, with a primary focus on data movement as a metric. We demonstrate the…
C.K.M. Lee, CY Chan, Sophie Ho +2 more
Purpose – The purpose of this paper is to explore the feasibility of adopting crowdsourcing for enhancing innovative problem solving through task design on task attributes. Task attributes have been proven to be an important factor influencing participation and engagement of crowdworkers. Design/methodology/approach – A survey questionnaire was developed and data from potential and experienced crowdworkers was collected and analyzed to identify the influence of task attributes on the quantity and quality of innovative solutions from crowds. This study finds that extrinsic and intrinsic motivation of task attributes are linked to psychological participation attention and the contribution of innovative solutions. Findings – It is found that crowdsourcing projects with higher awards and recognition as extrinsic motivation is positively associated with the quantity of solution. Competitive…
Shoaib Kamil, Cy Chan, Samuel Williams +5 more
ABSTRACT: This work introduces a generalized framework for automatically tuning stencil computations to achieve superior performance on a broad range of multicore architectures. Stencil (nearest-neighbor) based kernels constitute the core of many important scientific applications involving block-structured grids. Auto-tuning systems search over optimization strategies to find the combination of tunable parameters that maximizes computational efficiency for a given algorithmic kernel. Although the auto-tuning strategy has been successfully applied to libraries, generalized stencil kernels are not amenable to packaging as libraries. Studied kernels in this work include both memory-bound kernels as well as a computation-bound bilateral filtering kernel. We introduce a generalized stencil auto-tuning framework that takes a straightforward Fortran expression of a stencil kernel and…
Cy Chan, Jason Ansel, Yee Lok Wong +2 more
Algorithmic choice is essential in any problem domain to realizing optimal computational performance. Multigrid is a prime example: not only is it possible to make choices at the highest grid resolution, but a program can switch techniques as the problem is recursively attacked on coarser grid levels to take advantage of algorithms with different scaling behaviors. Additionally, users with different convergence criteria must experiment with parameters to yield a tuned algorithm that meets their accuracy requirements. Even after a tuned algorithm has been found, users often have to start all over when migrating from one machine to another.
Preston A. Jackson, Cy Chan, Jonathan Scalera +2 more
MIT Lincoln Laboratory has recently developed a new systolic FFT architecture for FPGAs. This architecture utilizes a parallel design to provide high throughput and excellent numerical accuracy. Using this design, an 8192-point real-time FFT, operating at 1.2 billion samples per second and performing 78 Gops with 70 dB of accuracy, fits on a single Xilinx Virtex II 8000.
Cy Chan, Anu Kuncheria, Jane Macfarlane
The rapid introduction of mobile navigation aides that use real-time road network information to suggest alternate routes to drivers is making it more difficult for researchers and government transportation agencies to understand and predict the dynamics of congested transportation systems. Computer simulation is a key capability for these organizations to analyze hypothetical scenarios; however, the complexity of transportation systems makes it challenging for them to simulate very large geographical regions, such as multi-city metropolitan areas. In this paper, we describe the Mobiliti traffic simulator, which includes mechanisms to capture congestion delays, timing constraints, and link storage capacity constraints. The simulator is designed to support distributed memory parallel execution and be scalable on high-performance computing platforms. We introduce a method to model dynamic…
Cy Chan, John Bachan, Joseph P. Kenny +4 more
We introduce a topology-aware performance optimization and modeling workflow for AMR simulation that includes two new modeling tools, ProgrAMR and Mota Mapper, which interface with the BoxLib AMR framework and the SSTmacro network simulator. ProgrAMR allows us to generate and model the execution of task dependency graphs from high-level specifications of AMR-based applications, which we demonstrate by analyzing two example AMR-based multigrid solvers with varying degrees of asynchrony. Mota Mapper generates multiobjective, network topology-aware box mappings, which we apply to optimize the data layout for the example multigrid solvers. While the sensitivity of these solvers to layout and execution strategy appears to be modest for balanced scenarios, the impact of better mapping algorithms can be significant when performance is highly constrained by network hop latency. Furthermore, we…
Zhengtian Wu, Jiafu Tang, C.K. Kwong +1 more
In this paper, a model is proposed where the cost and reliability of activities of reuse-based development can be predicted or measured, and all possible reuse scenarios can be analyzed and compared to support the selection of alternative scenarios. A scheme of typical reuse mode is designed from the perspectives of application engineering and domain engineering activities. According to the scheme, six reuse modes are addressed from the sequences of activities. Alternative industry reuse scenarios can be derived from the modes. An optimization model is proposed that can assist decision-makers in selecting a reuse scenario for minimizing cost, maximizing reliability and satisfying system requirements. To solve efficiently the bi-objective 0-1 integer programming involved in the model, a new algorithm is presented that can find the entire set of efficient solutions.
Chao Zhang, Maximilian Bremer, Cy Chan +2 more
Sparse linear algebra is an important kernel in many different applications. Among various sparse general matrix-matrix multiplication (SpGEMM) algorithms, Gustavson’s column-wise SpGEMM has good locality when reading input matrix and can be easily parallelized by distributing the computation of different columns of an output matrix to different processors. However, the sparse accumulation (SPA) step in column-wise SpGEMM, which merges partial sums from each of the multiplications by the row indices, is still a performance bottleneck. The state-of-the-art software implementation uses a hash table for partial sum search in the SPA, which makes SPA the largest contributor to the execution time of SpGEMM. There are three reasons that cause the SPA to become the bottleneck: (1) hash probing requires data-dependent branches that are difficult for a branch predictor to predict correctly; (2)…
Maximilian Bremer, John Bachan, Cy Chan
The performance of hurricane storm surge simulations is critical to forecast and mitigate the deadly effects of hurricane landfall. Supercomputers play a key role to run these simulations quickly; however, disruptive changes in future computer architectures will require adapting simulators to maintain high performance, such as increasing asynchrony and improving load balance. We introduce two new multi-constraint, fully asynchronous load balancers and a new discrete-event simulator (DGSim) that is able to natively model the execution of task-based hurricane simulations based on efficient one-sided, active message-based communication protocols. We calibrate and validate DGSim, use it to compare the algorithms' load balancing capabilities and task migration costs under many parameterizations, saving of over 5,000x core-hours compared to running the application code directly. Our load…
H. T. Kung, Pai-Hsiang Hsiao, Adon Hwang +9 more
MotusNet is a content network in which the addressable objects, contents, are decoupled from the physical nodes that carry them. The content names in MotusNet are hierarchical, so that they can be aggregated in the routing tables to support a larger number of contents. Further, the process of content replication improves availability, performance, and defends against denial of service attacks by localizing their effect. Additionally, using content migration, similar contents can be placed closer together in order to improve the degree of aggregation. A networking class at Harvard University has built a prototype of MotusNet.
Cy Chan, Joseph P. Kenny, Gilbert Hendry +3 more
The ability to predict the performance of irregular, asynchronous applications on future hardware is essential to the exascale co-design process. Adaptive Mesh Refinement (AMR) applications are inherently irregular and dynamic in their computation and communication patterns, resulting in complex hardware/software interactions. We have developed a methodology to use architectural simulators to assess the performance of different AMR data placement strategies on a selection of potential hardware interconnect topologies for exascale-class supercomputers. We use our framework to study the CASTRO AMR compressible astrophysics code for the simulation of supernovae. The results show a performance improvement of up to 18 percent may be obtained through the use of locality-aware data distributions for some network topologies on an exascale-class supercomputer.
Cy Chan, Anu Kuncheria, Bingyu Zhao +5 more
Traffic assignment methods are some of the key approaches used to model flow patterns that arise in transportation networks. Since static traffic assignment does not have a notion of time, it is not designed to represent temporal dynamics that arise as vehicles flow through the network and demand varies through the day. Dynamic traffic assignment methods attempt to resolve these issues, but require significant computational resources if modeling urban-scale regions (on the order of millions of links and vehicles) and often take days of compute time to complete. The focus of this work is two-fold: 1) to introduce a new traffic assignment approach - a quasi-dynamic traffic assignment (QDTA) model and 2) to describe how we parallelized the QDTA algorithms to leverage High-Performance Computing (HPC) and scale to large metropolitan areas while dramatically reducing compute time. We examine…
With the dawn of the multi-core era, programmers are being challenged to write code that performs well on an increasingly diverse array of architectures. A single program or library may be used on systems ranging in power from large servers with dozens or hundreds of cores to small single-core netbooks or mobile phones. A program may need to run efficiently both on architectures with many simple cores and on those with fewer monolithic cores. Some of the systems a program encounters might have GPU coprocessors, while others might not. Looking forward, processor designs such as asymmetric multi-core [3], with different types of cores on a single chip, will present an even greater challenge for programmers to utilize effectively. Programmers often find they must make algorithmic changes to their program in order to get performance when moving between these different types
Cy Chan, Pamela Silva, Chao Zhang
We would like to thank everyone who helped us with this report, including but not limited to: John Bolduc, Steve Lenkauskas, George Fernandes, and the staff at the City of Cambridge and Danehy Park who helped shape this report and made on-site instrument installation and data collection possible. Mark Lipson, Jack Clarke and Jean Rogers for their guidance with the environmental and community impact assessment. Bob Paine and Scott Abbett for their thoughts and experiences with the Medford McGlynn School wind turbine. This preliminary assessment report investigates the wind resource available at Danehy Park in the City of Cambridge, providing estimated power generation figures as well as cost and revenue estimates and
Shoaib Kamil, Cy Chan, Leonid Oliker +2 more
Although stencil auto-tuning has shown tremendous potential in effectively utilizing architectural resources, it has hitherto been limited to single kernel instantiations; in addition, the large variety of stencil kernels used in practice makes this computation pattern difficult to assemble into a library. This work presents a stencil auto-tuning framework that significantly advances programmer productivity by automatically converting a straightforward sequential Fortran 95 stencil expression into tuned parallel implementations in Fortran, C, or CUDA, thus allowing performance portability across diverse computer architectures, including the AMD Barcelona, Intel Nehalem, Sun Victoria Falls, and the latest NVIDIA GPUs. Results show that our generalized methodology delivers significant performance gains of up to 22 × speedup over the reference serial implementation. Overall we demonstrate…
Jason Ansel, Yee Lok Wong, Cy Chan +8 more
Approximating ideal program outputs is a common technique for solving computationally difficult problems, for adhering to processing or timing constraints, and for performance optimization in situations where perfect precision is not necessary. To this end, programmers often use approximation algorithms, iterative methods, data resampling, and other heuristics. However, programming such variable accuracy algorithms presents difficult challenges since the optimal algorithms and parameters may change with different accuracy requirements and usage environments. This problem is further compounded when multiple variable accuracy algorithms are nested together due to the complex way that accuracy requirements can propagate across algorithms and because of the resulting size of the set of allowable compositions.
Cy Chan, Vesselin Drensky, Alan Edelman +2 more
Abstract We present two new algorithms for computing all Schur functions sκ(x1,...,xn) for partitions κ such that |κ | ≤ N. Both algorithms have the property that for nonnegative arguments x1,...,xn the output is computed to high relative accuracy and the cost per Schur function is O(n 2).
Cy Chan, Vesselin Drensky, Alan Edelman +1 more
Abstract. We present a new algorithm for computing all Schur functions sλ(x1, x2,..., xn) for all partitions λ of integers not exceeding N in time O(n 2 KN), where KN ≡ #{λ | |λ | ≤ N} is the number of those partitions. In particular, this algorithm has optimal complexity for evaluating truncated series of Schur functions such as the hypergeometric function of a matrix argument. 1.