Author

Heshan Lin

33 papers · 2002–2024

2002peak 9 in 20102024

Frequent co-authors

Papers

showing 1–25 of 33 RSS

MOON

Heshan Lin, Xiaosong Ma, Jeremy Archuleta +3 more

Information Systems · 21 Jun 2010 · cited 152× · DOI ↗ · more like this ·

MapReduce offers an ease-of-use programming paradigm for processing large data sets, making it an attractive model for distributed volunteer computing systems. However, unlike on dedicated resources, where MapReduce has mostly been deployed, such volunteer computing systems have significantly higher rates of node unavailability. Furthermore, nodes are not fully controlled by the MapReduce framework. Consequently, we found the data and task replication scheme adopted by existing MapReduce implementations woefully inadequate for resources with high unavailability.

Power and Performance Characterization of Computational Kernels on the GPU

Yizheng Jiao, Heshan Lin, Pavan Balaji +1 more

Hardware and Architecture · December 2010 · cited 106× · DOI ↗ · more like this ·

Nowadays Graphic Processing Units (GPU) are gaining increasing popularity in high performance computing (HPC). While modern GPUs can offer much more computational power than CPUs, they also consume much more power. Energy efficiency is one of the most important factors that will affect a broader adoption of GPUs in HPC. In this paper, we systematically characterize the power and energy efficiency of GPU computing. Specifically, using three different applications with various degrees of compute and memory intensiveness, we investigate the correlation between power consumption and different computational patterns under various voltage and frequency levels. Our study revealed that energy saving mechanisms on GPUs behave considerably different than CPUs. The characterization results also suggest possible ways to improve the 'greenness' of GPU computing.

Efficient Data Access for Parallel BLAST

Heshan Lin, Xiaosong Ma, Pratheep Chandramohan +2 more

Artificial Intelligence · 19 Apr 2005 · cited 92× · DOI ↗ · more like this ·

Searching biological sequence databases is one of the most routine tasks in computational biology. This task is significantly hampered by the exponential growth in sequence database sizes. Recent advances in parallelization of biological sequence search applications have enabled bioinformatics researchers to utilize high-performance computing platforms and, as a result, greatly reduce the execution time of their sequence database searches. However, existing parallel sequence search tools have been focusing mostly on parallelizing the sequence alignment engine. While the computation-intensive alignment tasks become cheaper with larger machines, data-intensive initial preparation and result merging tasks become more expensive. Inefficient handling of input and output data can easily create performance bottlenecks even on supercomputers. It also causes a considerable data management…

VOCL: An optimized environment for transparent virtualization of graphics processing units

Shucai Xiao, Pavan Balaji, Qian Zhu +6 more

Hardware and Architecture · May 2012 · cited 69× · DOI ↗ · more like this ·

Graphics processing units (GPUs) have been widely used for general-purpose computation acceleration. However, current programming models such as CUDA and OpenCL can support GPUs only on the local computing node, where the application execution is tightly coupled to the physical GPU hardware. In this work, we propose a virtual OpenCL (VOCL) framework to support the transparent utilization of local or remote GPUs. This framework, based on the OpenCL programming model, exposes physical GPUs as decoupled virtual resources that can be transparently managed independent of the application execution. The proposed framework requires no source code modifications. We also propose various strategies for reducing the overhead caused by data communication and kernel launching and demonstrate about 85% of the data write bandwidth and 90% of the data read bandwidth compared to data write and read…

Grid applications---Parallel genomic sequence-searching on an ad-hoc grid

Mark K. Gardner, Wu-chun Feng, Jeremy Archuleta +2 more

Artificial Intelligence · 2006 · cited 57× · DOI ↗ · more like this ·

The Basic Local Alignment Search Tool (BLAST) allows bioinformaticists to characterize an unknown sequence by comparing it against a database of known sequences. The similarity between sequences enables biologists to detect evolutionary relationships and infer biological properties of the unknown sequence.mpiBLAST, our parallel BLAST, decreases the search time of a 300 KB query on the current NT database from over two full days to under 10 minutes on a 128-processor cluster and allows larger query files to be compared. Consequently, we propose to compare the largest query available, the entire NT database, against the largest database available, the entire NT database. The result of this comparison will provide critical information to the biology community, including insightful evolutionary, structural, and functional relationships between every sequence and family in the NT…

Coordinating Computation and I/O in Massively Parallel Sequence Search

Heshan Lin, Xiaosong Ma, Wu-chun Feng +1 more

Artificial Intelligence · IEEE Transactions on Parallel and Distributed Systems · 3 Jun 2010 · cited 56× · DOI ↗ · more like this ·

With the explosive growth of genomic information, the searching of sequence databases has emerged as one of the most computation and data-intensive scientific applications. Our previous studies suggested that parallel genomic sequence-search possesses highly irregular computation and I/O patterns. Effectively addressing these runtime irregularities is thus the key to designing scalable sequence-search tools on massively parallel computers. While the computation scheduling for irregular scientific applications and the optimization of noncontiguous file accesses have been well-studied independently, little attention has been paid to the interplay between the two. In this paper, we systematically investigate the computation and I/O scheduling for data-intensive, irregular scientific applications within the context of genomic sequence search. Our study reveals that the lack of coordination…

OpenCL and the 13 dwarfs

Wu-chun Feng, Heshan Lin, Tom Scogland +1 more

Hardware and Architecture · 22 Apr 2012 · cited 55× · DOI ↗ · more like this ·

In the past, evaluating the architectural innovation of parallel computing devices relied on a benchmark suite based on existing programs, e.g., EEMBC or SPEC. However, with the growing ubiquity of parallel computing devices, we argue that it is unclear how best to express parallel computation, and hence, a need exists to identify a higher level of abstraction for reasoning about parallel application requirements. Therefore, the goal of this combination "Work-in-Progress and Vision" paper is to delineate application requirements in a manner that is not overly specific to individual applications or the optimizations used for certain hardware platforms, so that we can draw broader conclusions about hardware requirements. Our initial effort, dubbed "OpenCL and the 13 Dwarfs" or OCD for short, realizes Berkeley's 13 computational dwarfs of scientific computing in OpenCL, where each dwarf…

Enhancing MapReduce via Asynchronous Data Processing

Marwa K. Elteir, Heshan Lin, Wu-chun Feng

Information Systems · December 2010 · cited 45× · DOI ↗ · more like this ·

The Map Reduce programming model simplifies large-scale data processing on commodity clusters by having users specify a map function that processes input key/value pairs to generate intermediate key/value pairs, and a reduce function that merges and converts intermediate key/value pairs into final results. Typical Map Reduce implementations such as Hadoop enforce barrier synchronization between the map and reduce phases, i.e., the reduce phase does not start until all map tasks are finished. In turn, this synchronization requirement can cause inefficient utilization of computing resources and can adversely impact performance. Thus, we present and evaluate two different approaches to cope with the synchronization drawback of existing Map Reduce implementations. The first approach, hierarchical reduction, starts a reduce task as soon as a predefined number of map tasks completes, it then…

StreamMR: An Optimized MapReduce Framework for AMD GPUs

Marwa K. Elteir, Heshan Lin, Wu-chun Feng +1 more

Information Systems · December 2011 · cited 42× · DOI ↗ · more like this ·

MapReduce is a programming model from Google that facilitates parallel processing on a cluster of thousands of commodity computers. The success of MapReduce in cluster environments has motivated several studies of implementing MapReduce on a graphics processing unit (GPU), but generally focusing on the NVIDIA GPU. Our investigation reveals that the design and mapping of the MapReduce framework needs to be revisited for AMD GPUs due to their notable architectural differences from NVIDIA GPUs. For instance, current state-of-the-art MapReduce implementations employ atomic operations to coordinate the execution of different threads. However, atomic operations can implicitly cause inefficient memory access, and in turn, severely impact performance. In this paper, we propose Streamer, an OpenCL MapReduce framework optimized for AMD GPUs. With efficient atomic-free algorithms for output…

Massively Parallel Genomic Sequence Search on the Blue Gene/P Architecture

Heshan Lin, Pavan Balaji, Ruth J. Poole +3 more

Artificial Intelligence · 21 Apr 2009 · cited 41× · OpenAlex ↗ · more like this ·

Abstract—This paper presents our first experiences in mapping and optimizing genomic sequence search onto the massively parallel IBM Blue Gene/P (BG/P) platform. Specifically, we performed our work on mpiBLAST, a parallel sequence-search code that has been optimized on numerous supercomputing environments. In doing so, we identify several critical performance issues. Consequently, we propose and study different approaches for mapping sequence-search and parallel I/O tasks on such massively parallel architectures. We demonstrate that our optimizations can deliver nearly linear scaling (93 % efficiency) on up to 32,768 cores of BG/P. In addition, we show that such scalability enables us to complete a large-scale bioinformatics problem — sequence searching a microbial genome database against itself to support the discovery of missing genes in genomes — in only a few hours on BG/P.…

Transparent Accelerator Migration in a Virtualized GPU Environment

Shucai Xiao, Pavan Balaji, James Dinan +7 more

Information Systems · May 2012 · cited 36× · DOI ↗ · more like this ·

This paper presents a framework to support transparent, live migration of virtual GPU accelerators in a virtualized execution environment. Migration is a critical capability in such environments because it provides support for fault tolerance, on-demand system maintenance, resource management, and load balancing in the mapping of virtual to physical GPUs. Techniques to increase responsiveness and reduce migration overhead are explored. The system is evaluated by using four application kernels and is demonstrated to provide low migration overheads. Through transparent load balancing, our system provides a speedup of 1.7 to 1.9 for three of the four application kernels.

Performance Characterization and Optimization of Atomic Operations on AMD GPUs

Marwa K. Elteir, Heshan Lin, Wu-chun Feng

Hardware and Architecture · September 2011 · cited 34× · DOI ↗ · more like this ·

Atomic operations are important building blocks in supporting general-purpose computing on graphics processing units (GPUs). For instance, they can be used to coordinate execution between concurrent threads, and in turn, assist in constructing complex data structures such as hash tables or implementing GPU-wide barrier synchronization. While the performance of atomic operations has improved substantially on the latest NVIDIA Fermi-based GPUs, system-provided atomic operations still incur significant performance penalties on AMD GPUs. A memory-bound kernel on an AMD GPU, for example, can suffer severe performance degradation when including an atomic operation, even if the atomic operation is never executed. In this paper, we first quantify the performance impact of atomic instructions to application kernels on AMD GPUs. We then propose a novel software-based implementation of atomic…

RSVM: a region-based software virtual memory for GPU

Feng Ji, Heshan Lin, Xiaosong Ma

Hardware and Architecture · International Conference on Parallel Architectures and Compilation Techniques · 7 Oct 2013 · cited 31× · DOI ↗ · more like this ·

While Graphics Processing Units (GPU) have gained much success in general purpose computing in recent years, their programming is still difficult, due to, particularly, explicitly managed GPU memory and manual CPU-GPU data transfer. Despite recent calls for managing GPU resources as first-class citizens in the operating system, a mature GPU memory management mechanism is still missing, which leads to reinventing the wheels in various GPU system software. Meanwhile, due to ever enlarging problem sizes, we urgently need a system-level mechanism for unified CPU-GPU memory management. In this work, we present the design of Region-based Software Virtual Memory (RSVM), a software virtual memory running on both CPU and GPU in a distributed and cooperative way. In addition to automatic GPU memory management and GPU-CPU data transfer, RSVM offers two novel features: 1) GPU kernel-issued…

Cognitive Radio Rides on the Cloud

Feng Ge, Heshan Lin, Amin Khajeh +5 more

Computer Networks and Communications · October 2010 · cited 30× · DOI ↗ · more like this ·

Cognitive Radio (CR) is capable of adaptive learning and reconfiguration, promising consistent communications performance for C4ISR <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> systems even in dynamic and hostile battlefield environments. As such, the vision of Network-Centric Operations becomes feasible. However, enabling adaptation and learning in CRs may require both storing a vast volume of data and processing it fast. Because a CR usually has limited computing and storage capacity determined by its size and battery, it may not be able to achieve its full capability. The cloud <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> can provide its computing and storage utility for CRs to overcome such challenges. On the other hand, the cloud can also store and process enormous…

Massive distributed and parallel log analysis for organizational security

Xiaokui Shu, John Smiy, Danfeng Yao +1 more

Computer Networks and Communications · December 2013 · cited 22× · DOI ↗ · more like this ·

Security log analysis is extremely useful for uncovering intrusions and anomalies. However, the sheer volume of log data demands new frameworks and techniques of computing and security. We present a lightweight distributed and parallel security log analysis framework that allows organizations to analyze a massive number of system, network, and transaction logs efficiently and scalably. Different from the general distributed frameworks, e.g., MapReduce, our framework is specifically designed for security log analysis. It features a minimum set of necessary properties, such as dynamic task scheduling for streaming logs. For prototyping, we implement our framework in Amazon cloud environments (EC2 and S3) with a basic analysis application. Our evaluation demonstrates the effectiveness of our design and shows the potential of our cloud-based distributed framework in large-scale log analysis…

Optimizing Dynamic Programming on Graphics Processing Units via Adaptive Thread-Level Parallelism

Chao‐Chin Wu, Jenn-Yang Ke, Heshan Lin +1 more

Computer Networks and Communications · December 2011 · cited 21× · DOI ↗ · more like this ·

Dynamic programming (DP) is an important computational method for solving a wide variety of discrete optimization problems such as scheduling, string editing, packaging, and inventory management. In general, DP is classified into four categories based on the characteristics of the optimization equation. Because applications that are classified in the same category of DP have similar program behavior, the research community has sought to propose general solutions for parallelizing each category of DP. However, most existing studies focus on running DP on CPU-based parallel systems rather than on accelerating DP algorithms on the graphics processing unit (GPU). This paper presents the GPU acceleration of an important category of DP problems called nonserial polyadic dynamic programming (NPDP). In NPDP applications, the degree of parallelism varies significantly in different stages of…

Spectral Method Characterization on FPGA and GPU Accelerators

Karl Pereira, Peter Athanas, Heshan Lin +1 more

Signal Processing · November 2011 · cited 16× · DOI ↗ · more like this ·

Hybrid core computing, with CPUs augmented with FPGAs and/or GPUs, offers a promising pathway of addressing emerging high-performance computing demands, particularly with respect to performance, power and productivity. This paper compares the sustained performance of a complex, single precision, floating-point, 1D, Fast Fourier Transform (FFT) implementation on state-of-the-art FPGA and GPU accelerators. As results show, FPGA floating-point performance is highly sensitive to the availability of dedicated FPGA resources: DSP48E slices, block RAMs and FPGA I/O banks in particular. Provided results show that for the floating-point FFT benchmark on FPGAs, these resources are the performance limiting factor. For fixed-point FFTs, however, FPGAs exploit a flexible data path width to trade-off circuit cost with speed of computation in applications requiring smaller precision to improve…

Adjusting Thread Parallelism Dynamically to Accelerate Dynamic Programming with Irregular Workload Distribution on GPGPUs

Chao‐Chin Wu, Jenn-Yang Ke, Heshan Lin +1 more

Computer Networks and Communications · International Journal of Grid and High Performance Computing · 2014 · cited 11× · DOI ↗ · more like this ·

Dynamic Programming (DP) is an important and popular method for solving a wide variety of discrete optimization problems such as scheduling, string-editing, packaging, and inventory management. DP breaks problems into simpler subproblems and combines their solutions into solutions to original ones. This paper focuses on one type of dynamic programming called Nonserial Polyadic Dynamic Programming (NPDP). To run NPDP applications efficiently on an emerging General-Purpose Graphic Processing Unit (GPGPU), the authors have to exploit more parallelism to fully utilize the computing power of the hundreds of processing units in it. However, the parallelism degree varies significantly in different phases of the NPDP applications. To address the problem, the authors propose a method that can adjust the thread-level parallelism to provide a sufficient and steadier parallelism degree for…

The Green500 List: Year two

Wu-chun Feng, Heshan Lin

Hardware and Architecture · April 2010 · cited 10× · DOI ↗ · more like this ·

The Green500 turned two years old this past November at the ACM/IEEE SC|09 Conference. As part of the grassroots movement of the Green500, this paper takes a look back and reflects on how the Green500 has evolved in its second year as well as since its inception. Specifically, it analyzes trends in the Green500 and reports on the implications of these trends. In addition, based on significant feedback from the high-end computing (HEC) community, the Green500 announced three exploratory sub-lists: the Little Green500, the Open Green500, and the HPCC Green500, which are each discussed in this paper.

Semantic-based distributed i/o with the paramedic framework

Pavan Balaji, Wu-chun Feng, Heshan Lin

Computer Networks and Communications · 23 Jun 2008 · cited 6× · DOI ↗ · more like this ·

Many large-scale applications simultaneously rely on multiple resources for efficient execution. For example, such applications may require both large compute and storage resources; however, very few supercomputing centers can provide large quantities of both. Thus, data generated at the compute site oftentimes has to be moved to a remote storage site for either storage or visualization and analysis. Clearly, this is not an efficient model, especially when the two sites are distributed over a wide-area network.

Breaking SIMD shackles with an exposed flexible microarchitecture and the access execute PDG

Feng Ji, Heshan Lin, Xiaosong Ma

Hardware and Architecture · October 2013 · cited 5× · DOI ↗ · more like this ·

Distributed I/O with ParaMEDIC: Experiences with a Worldwide Supercomputer

Pavan Balaji, Wu-chun Feng, Heshan Lin +9 more

Computer Networks and Communications · 2008 · cited 4× · OpenAlex ↗ · more like this ·

Achieving high performance for distributed I/O on a wide-area network continues to be an elusive holy grail. Despite enhancements in network hardware as well as software stacks, achieving high-performance remains a challenge. In this paper, our worldwide team took a completely new and non-traditional approach to distributed I/O, called ParaMEDIC: Parallel Metadata Environment for Distributed I/O and Computing, by utilizing application-specific transformation of data to orders-of-magnitude smaller meta-data before performing the actual I/O. Specifically, this paper details our experiences in deploying a large-scale system to facilitate the discovery of missing genes and constructing a genome similarity tree by encapsulating the mpiBLAST sequence-search algorithm into ParaMEDIC. The overall project involved nine different computational sites spread across the U.S. generating more than a…

Consolidating Applications for Energy Efficiency in Heterogeneous Computing Systems

Jing Zhang, Hao Wang, Heshan Lin +1 more

Information Systems · November 2013 · cited 3× · DOI ↗ · more like this ·

By scheduling multiple applications with complementary resource requirements on a smaller number of compute nodes, we aim to improve performance, resource utilization, energy consumption, and energy efficiency simultaneously. In addition to our naive consolidation approach, which already achieves the aforementioned goals, we propose a new energy efficiency-aware (EEA) scheduling policy and compare its performance with current state-of-the-art policies, namely round-robin (RR), resource utilization-aware (RUA), adaptive shortest-job first (ASJF) in order to support the consolidation of applications in heterogeneous computing systems, and in turn, simultaneously improve performance, resource utilization, energy consumption, and energy efficiency, as measured by the energy-delay product. Of particular note, our experimental results on a real heterogeneous computing system demonstrate the…

Poster

Kenneth S. Lee, Heshan Lin, Wu-chun Feng

Hardware and Architecture · 12 Nov 2011 · cited 3× · DOI ↗ · more like this ·

The cost of data transfers over PCI-Express often limits application performance on traditional discrete GPUs. To address this, AMD Fusion introduces a novel architecture that fuses the CPU and GPU onto a single die and connects the two with a high-performance memory controller. This architecture features a shared memory space between CPU and GPU, enabling several new memory access techniques that are not available on discrete architectures. For instance, a kernel running on the GPU can now directly access a host memory buffer and vice versa. As an initial step towards understanding the implications of the fused CPU+GPU architecture to heterogeneous computing, we characterize the performance impact of various memory-access techniques on applications running on an AMD Fusion platform (i.e., Llano A8-3850). The experimental results show that AMD Fusion can outperform a discrete GPU of the…

A Spatial–Temporal Analysis and Multi-Scenario Projections of Carbon Sequestration in Sea Islands: A Case Study of Pingtan Island

Siyu Chen, Ming Xu, Heshan Lin +5 more

Sociology and Political Science · Journal of Marine Science and Engineering · 3 Oct 2024 · cited 2× · DOI ↗ · more like this ·

As an indispensable part of the marine ecosystem, the health status of the sea affects the stability and enhancement of the overall ecological function of the ocean. Clarifying the future land and sea utilization pattern and the impacts on the carbon stocks of island ecosystems is of great scientific value for maintaining marine ecological balance and promoting the sustainable development of the island ecosystem. Using Pingtan Island as an example, we simulate and predict changes in island utilization and carbon stocks for historical periods and multiple scenarios in 2030 via the PLUS-InVEST model and the marine biological carbon sink accounting method. The results show that (1) from 2006 to 2022, the carbon stock of Pingtan Island decreased by 7.218 × 104 t, resulting in a cumulative economic loss of approximately USD 13.35 million; furthermore, from 2014 to 2018, the implementation of…