arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Simin You

46 papers · 2010–2018

2010: 32011: 22012: 92013: 32014: 62015: 112016: 92017: 22018: 1
2010peak 11 in 20152018

Frequent co-authors

Papers

showing 1–25 of 46 RSS

Large-scale spatial join query processing in Cloud

Simin You, Jianting Zhang, Le Gruenwald

Signal Processing · · cited 201× · DOI ↗ · more like this ·

The rapidly increasing amount of location data available in many applications has made it desirable to process their large-scale spatial queries in Cloud for performance and scalability. We report our designs and implementations of two prototype systems that are ready for Cloud deployments: SpatialSpark based on Apache Spark and ISP-MC based on Cloudera Impala. Both systems support indexed spatial joins based on point-in-polygon test and point-to-polyline distance computation. Experiments on the pickup locations of ~170 million taxi trips in New York City and ~10 million global species occurrences records have demonstrated both efficiency and scalability using Amazon EC2 clusters.

Speeding up large-scale point-in-polygon test based spatial join on GPUs

Jianting Zhang, Simin You

Signal Processing · · cited 64× · DOI ↗ · more like this ·

Point-in-Polygon (PIP) test is fundamental to spatial databases and GIS. Motivated by the slow response times in joining large-scale point locations with polygons using traditional spatial databases and GIS, we have designed and developed an end-to-end system completely on Graphics Processing Units (GPUs) to associate points with the polygons that they fall within by utilizing massively data parallel computing power of GPUs. The system includes an efficient module to generate point quadrants that have at most K points from large-scale unordered points, a simple grid-file based spatial filtering approach to associate point quadrants and polygons, and, a PIP test module to assign polygons to points in a GPU computing block using both the block and thread level parallelisms. Experiments on joining 170 million points with more than 40 thousand polygons have resulted in a runtime of 11.165…

Parallel spatial query processing on GPUs using R-trees

Simin You, Jianting Zhang, Le Gruenwald

Signal Processing · · cited 62× · DOI ↗ · more like this ·

R-Trees are popular spatial indexing techniques that have been widely adopted in many geospatial applications. As commodity GPUs (Graphics Processing Units) are increasingly becoming available on personal workstations and cluster computers, there are considerable research interests in applying the massive data parallel GPGPU (General Purpose computing on GPUs) technologies to index and query large-scale geospatial data on GPUs using R-Trees. In this study, we aim at evaluating the potentials of accelerating both R-Tree bulk loading and spatial window query processing on GPUs using R-Trees. In addition to designing an efficient data layout schema for R-Trees on GPUs, we have implemented several parallel spatial window query processing techniques on GPUs using both dynamically generated R-Trees constructed on CPUs and bulk loaded R-Trees constructed on GPUs. Extensive experiments using…

High-performance quadtree constructions on large-scale geospatial rasters using GPGPU parallel primitives

Jianting Zhang, Simin You

Signal Processing · International Journal of Geographical Information Systems · · cited 30× · DOI ↗ · more like this ·

The increasingly available graphics processing units (GPU) hardware and the emerging general purpose computing on GPU (GPGPU) technologies provide an attractive solution to high-performance geospatial computing. In this study, we have proposed a parallel, primitive-based approach to quadtree construction by transforming a multidimensional geospatial computing problem into chaining a set of generic parallel primitives that are designed for one-dimensional (1D) arrays. The proposed approach is largely data-independent and can be efficiently implemented on GPGPUs. Experiments on 4096*4096 and 16384*16384 raster tiles have shown that the implementation can complete the quadtree constructions in 13.33 ms and 250.75 ms, respectively, on average on an NVidia GPU device. Compared with an optimized serial CPU implementation based on the traditional recursive depth-first search (DFS) tree…

U <sup>2</sup> STRA

Jianting Zhang, Simin You, Le Gruenwald

Signal Processing · · cited 27× · DOI ↗ · more like this ·

Volumes of GPS recorded trajectory data in ubiquitous urban sensing applications are increasing fast. Many trajectory queries are both I/O and computing intensive. In this study, we propose to develop the U2STRA prototype system to efficiently manage large-scale GPS trajectory data using General Purpose computing on Graphics Processing Units (GPGPU) technologies. Towards this end, we have developed a trajectory data layout schema using simple in-memory array structures which is not only flexible for data accesses but also cache friendly. We have further developed an end-to-end trajectory similarity query processing technique on GPUs. Our experiments on two publically available large trajectory datasets (GeoLife and T-Drive) have demonstrated the efficiency of massively data parallel GPGPU computing. An impressive 87X speedup for spatial aggregations of GPS point locations and 25-40X…

Large-scale spatial data processing on GPUs and GPU-accelerated clusters

Jianting Zhang, Simin You, Le Gruenwald

Signal Processing · SIGSPATIAL Special · · cited 26× · DOI ↗ · more like this ·

The massive data parallel computing power provided by inexpensive commodity Graphics Processing Units(GPUs) makes large-scale spatial data processing on GPUs and GPU-accelerated clusters attractive from both a research and practical perspective. In this article, we report our works on data parallel designs of spatial indexing, spatial joins and several other spatial operations, including polygon rasterization, polygon decomposition and point interpolation. The data parallel designs are further scaled out to distributed computing nodes by integrating single-node GPU implementations with High-Performance Computing (HPC) toolset and the new generation in-memory Big Data systems such as Cloudera Impala. In addition to introducing GPGPU computing background and outlining data parallel designs for spatial operations, references to individual works are provided as a summary chart for…

Indexing large-scale raster geospatial data using massively parallel GPGPU computing

Jianting Zhang, Simin You, Le Gruenwald

Signal Processing · · cited 26× · DOI ↗ · more like this ·

Advances in geospatial technologies have generated large amounts of raster geospatial data. Massively parallel General Purpose Graphics Processing Unit (GPGPU) computing technologies have provided personal computers with tremendous computing capabilities. In this paper, we report our work on fast indexing of large-scale raster geospatial data using GPGPU computing. We have designed a cache conscious quadtree data structure (CCQ-Tree) that is suitable for GPU indexing. A set of algorithms have been developed and integrated to construct CCQ-Trees on GPUs by utilizing multiple pyramid data structures and Z-order based prefix sum. Experiments on multiple 4096*4096 blocks of a global precipitation raster data have shown that CCQ-Tree indexing using a 112-core Nvidia Quadro FX3700 GPU device reduces construction times from around 9.83 seconds to 0.42 seconds (23X speedup).

Parallel quadtree coding of large-scale raster geospatial data on GPGPUs

Jianting Zhang, Simin You, Le Gruenwald

Artificial Intelligence · · cited 22× · DOI ↗ · more like this ·

Global remote sensing and large-scale environmental modeling have generated huge amounts of raster geospatial data. While the inherent data parallelism of large-scale raster geospatial data allows straightforward coarse-grained parallelization at the chunk level on CPUs, it is largely unclear how to effectively exploit such data parallelism on massively parallel General Purpose Graphics Processing Units (GPGPUs) that require fine-grained parallelization. In this study, we have developed an efficient spatial data structure called BQ-Tree to code raster geospatial data by exploiting the uniform distributions of quadrants of bitmaps at the bitplanes of a raster. A fine-grained parallelization scheme has been implemented using Nvidia CUDA. Experiments show that the GPGPU implementation is capable of decoding a BQ-Tree encoded 16-bits NASA MODIS geospatial raster with 22,658*15,586 cells in…

CudaGIS

Jianting Zhang, Simin You

Signal Processing · · cited 21× · DOI ↗ · more like this ·

We report the preliminary design and realization of a high-performance, general purposed, parallel GIS (CudaGIS), based on the General Purpose computing on Graphics Processing Units (GPGPU) technologies. Still under active developments, CudaGIS currently supports major types of geospatial data (point, polyline, polygon and raster) and provides modules for spatial indexing, spatial join and other types of geospatial operations on such geospatial data types. Experiments have demonstrated 10-40X on main-memory systems due to GPU accelerations and 1000-10000X speedups over serial CPU implementations and disk-resident systems by integrating additional performance boosting techniques, such as efficient in-memory data structures and algorithmic engineering.

Spatial Join Query Processing in Cloud: Analyzing Design Choices and Performance Comparisons

Simin You, Jianting Zhang, Le Gruenwald

Signal Processing · · cited 20× · DOI ↗ · more like this ·

Data volumes of GPS recorded locations and many other types of geospatial data are fast increasing. Processing large-scale spatial joins in Cloud for performance and scalability is becoming increasingly popular. In this study, we compare three leading Cloud-based spatial data management systems, namely Hadoop GIS, Spatial Hadoop and Spatial Spark, both conceptually through analysis of design choices and empirically through experiments using real world datasets. Using both a workstation serving as a single-node cluster and up to 10 nodes Amazon EC2 clusters, the results show that the combined factors, including Cloud platforms, data access models and the underlying geometry libraries, have significant impacts in their realized performance. While Spatial Hadoop generally wins on robustness, Spatial Spark is the clear winner of efficiency due to in-memory processing.

High-performance online spatial and temporal aggregations on multi-core CPUs and many-core GPUs

Jianting Zhang, Simin You, Le Gruenwald

Signal Processing · · cited 17× · DOI ↗ · more like this ·

Motivated by the practical needs for efficiently processing large-scale taxi trip data, we have developed techniques for high performance online spatial, temporal and spatiotemporal aggregations. These techniques include timestamp compression to reduce memory footprint, simple linear data structures for efficient in-memory scans and utilization of massively data parallel GPU accelerations for spatial joins. Our experiments have shown that the combined performance boosting techniques are able to perform various spatial, temporal and spatiotemporal aggregations on hundreds of millions of taxi trips in the order of a few seconds using commodity personal computers equipped with multi-core CPUs and many-core GPUs. The high throughputs in a personal computing environment are encouraging in the sense that high-performance OLAP queries on large-scale data is feasible when the parallel…

Efficient Parallel Zonal Statistics on Large-Scale Global Biodiversity Data on GPUs

Jianting Zhang, Simin You, Le Gruenwald

Signal Processing · · cited 16× · DOI ↗ · more like this ·

Analyzing how species are distributed on the Earth has been one of the fundamental questions in the intersections of environmental sciences, geosciences and biological sciences. With world-wide data contributions, more than 375 million species occurrence records for nearly 1.5 million species have been deposited into the Global Biodiversity Information Facility (GBIF) data portal. The sheer amounts of point and polygon data and the computation-intensive point-in-polygon tests for zonal statistics for biodiversity studies have imposed significant technical challenges. In this study, we have developed efficient techniques to enable parallel zonal statistics on the global GBIF data completely on GPUs with limited memory capacity. Experiment results have shown that an impressive end-to-end response time under 100 seconds can be achieved for zonal statistics on the 375+ million species…

High-Performance Spatial Query Processing on Big Taxi Trip Data Using GPGPUs

Jianting Zhang, Simin You, Le Gruenwald

Signal Processing · · cited 16× · DOI ↗ · more like this ·

City-wide GPS recorded taxi trip data contains rich information for traffic and travel analysis to facilitate transportation planning and urban studies. However, traditional data management techniques are largely incapable of processing big taxi trip data at the scale of hundreds of millions. In this study, we aim at utilizing the General Purpose computing on Graphics Processing Units (GPGPUs) technologies to speed up processing complex spatial queries on big taxi data on inexpensive commodity GPUs. By using the land use types of tax lot polygons as a proxy for trip purposes at the pickup and drop-off locations, we formulate a taxi trip data analysis problem as a large-scale nearest neighbor spatial query problem based on point-to-polygon distance. Experiments on nearly 170 million taxi trips in the New York City (NYC) in 2009 and 735,488 tax lot polygons with 4,698,986 vertices have…

Dynamic tiled map services

Jianting Zhang, Simin You

Signal Processing · · cited 11× · DOI ↗ · more like this ·

Query based visual explorations of raster geospatial data plays an important role in stimulating scientific hypothesis and subsequently seeking casual relationships. While it is desirable to enable visual explorations of large-scale raster geospatial data in a Web environment, improving the end-to-end performance between query backend and the client applications remains a challenging technical issue. Techniques for providing tiled map services that are adopted by major commercial Internet maps APIs have been successful in handling static geospatial data. Motivated by the practical needs of supporting query-based visual explorations in a Web environment, we have proposed a dynamic tiled map services approach that integrates and extends existing Web-based standards and best practices in serving tiled images for static raster geospatial data. The approach includes quadtree-based indexing…

Scalable and efficient spatial data management on multi-core CPU and GPU clusters: A preliminary implementation based on Impala

Simin You, Jianting Zhang, Le Gruenwald

Signal Processing · · cited 10× · DOI ↗ · more like this ·

Fast increasing volumes of spatial data has made it imperative to develop both scalable and efficient spatial data management techniques by leveraging modern parallel hardware and distributed systems. By integrating a leading open source Big Data system called Impala and our previous work on data parallel designs for spatial indexing and query processing, we have developed ISP-MC+ and ISP-GPU for large-scale spatial data management on computer clusters equipped with multi-core CPUs and Graphics Processing Units (GPUs), respectively. Both ISP-MC+ and ISP-GPU have shown high efficiency and good scalability on a 10-node Amazon EC2 cluster equipped with multi-core CPUs and GPUs. Comparison with a baseline implementation using traditional techniques on a single CPU core have demonstrated orders of magnitude of speedups on a real world dataset with hundreds of millions of point locations.

Sampling Big Trajectory Data for Traversal Trajectory Aggregate Query

Yichen Ding, Yanhua Li, Xun Zhou +3 more

Signal Processing · IEEE Transactions on Big Data · · cited 9× · DOI ↗ · more like this ·

This paper defines and investigates a novel trajectory query, namely, Traversal Trajectory Aggregate (TTA) Query: Given a trajectory database and a pair of upstream and downstream spatio-temporal (ST) regions (i.e., spatial area coupled with a time interval), a TTA query aims to retrieve the total number of unique trajectories that traverse through these two ST regions. Such TTA queries play an important role in various urban applications, such as route planning, taxi dispatching, and location-based advertising. Two baselines can answer such TTA queries: (a) exact search (over the entire ST query regions) can obtain the exact answer, but it leads to extremely long running time when the ST query regions are huge; (b) uniform-sampling-based approaches estimate the query answer with sampled trajectories. However, the uniform sampling distribution may lead to significant estimation variance…

High-performance polyline intersection based spatial join on GPU-accelerated clusters

Simin You, Jianting Zhang, Le Gruenwald

Signal Processing · · cited 9× · DOI ↗ · more like this ·

The rapid growing volumes of spatial data have brought significant challenges on developing high-performance spatial data processing techniques in parallel and distributed computing environments. Spatial joins are important data management techniques in gaining insights from large-scale geospatial data. While several distributed spatial join techniques based on spatial partitions have been implemented on top of existing Big Data systems, they are not capable of natively exploiting massively data parallel computing power provided by modern commodity Graphics Processing Units (GPUs). In this study, as an important component of our research initiative in developing high-performance spatial join techniques on GPUs, we have designed and implemented a polyline intersection based spatial join technique that is capable of exploiting massively data parallel computing power on GPUs. The proposed…

TKSimGPU: A parallel top-K trajectory similarity query processing algorithm for GPGPUs

Eleazar Leal, Le Gruenwald, Jianting Zhang +1 more

Signal Processing · · cited 9× · DOI ↗ · more like this ·

There exist large datasets containing the sequences of points that moving objects occupy in space as time goes by. Such sequences of moving objects are known as trajectories. Being able to issue queries that allow the extraction of patterns from the movements of these objects is important to many real world applications, such as urban planning in transportation and bird migration tracking in ecology. One example of such queries is the top-K trajectory similarity query. This type of query receives as input arguments two sets P and Q of trajectories and a positive integer k, and seeks to find for every trajectory p in P the set of k trajectories in Q that are the most similar to p. However, querying these trajectory data is both compute and I/O intensive. In this paper we explore the potential of GPGPUs for supporting, in a scalable manner, top-K trajectory similarity queries. To this…

Quadtree-based lightweight data compression for large-scale geospatial rasters on multi-core CPUs

Jianting Zhang, Simin You, Le Gruenwald

Artificial Intelligence · · cited 8× · DOI ↗ · more like this ·

Huge amounts of geospatial rasters, such as remotely sensed imagery and environmental modeling output, are being generated with increasingly finer spatial, temporal, spectral and thematic resolutions. In this study, we aim at developing a lightweight lossless data compression technique that balances the performance between compression and decompression for large-scale geospatial rasters. Our Bitplane bitmap Quadtree (or BQ-Tree) based technique encodes the bitmaps of raster bitplanes as compact quadtrees which can compress and index rasters simultaneously. The technique is simple by design and lightweight by implementations. Except computing Z-order codes for cache efficiency, only bit level operations are required. Extensive experiments using 36 rasters of the NASA Shuttle Range Topography Mission (SRTM) 30 meter resolution elevation data with 20 billion raster cells have shown that…

Lightweight Distributed Execution Engine for Large-Scale Spatial Join Query Processing

Jianting Zhang, Simin You, Le Gruenwald

Signal Processing · · cited 7× · DOI ↗ · more like this ·

Existing Big Data systems are mostly designed for relational data. They are either incapable or inefficient in processing large-scale semi-structured data efficiently due to the inherent limitations on data abstraction, indexing support and exposure to native parallel programming tools. In this study, we report our work in developing a lightweight distributed execution engine for spatial join query processing on large-scale geospatial data. By integrating data parallel designs for single computing nodes, our execution engine is able to automatically dispatch data partitions to distributed computing nodes for efficient local execution on multi-core CPUs and GPUs. The execution engine supports asynchronous data transfer over network, asynchronous disk I/O and asynchronous computing. It also directly accesses distributed file systems to support creating and using indices conveniently and…

Tiny GPU Cluster for Big Spatial Data: A Preliminary Performance Evaluation

Jianting Zhang, Simin You, Le Gruenwald

Computer Networks and Communications · · cited 6× · DOI ↗ · more like this ·

GPU-equipped computing nodes have much higher ratios between floating point computing power (in the order of TFlops and is fast growing) and network bandwidth (in the order of Gbps and remains stable) than regular computing nodes at which Hadoop-based systems are targeting. The gap makes efficient and scalable processing of large-scale data challenging, especially for geo-referenced spatial (or geospatial) data, whose processing is both data intensive and computing intensive. We aim at developing a tiny GPU cluster using Nvidia Tegra K1 (TK1) System on Chip (SoC) boards as a downscaled, low-cost GPU cluster for Big (Spatial) Data research. The tiny GPU cluster is equipped with standard gigabyte Ethernet network while has much less computing power and energy footprint when compared with a regular GPU cluster and represents a new platform with more balanced compute to communication ratio.…

Parallel QuadTree encoding of large-scale raster geospatial data on multicore CPUs and GPGPUs

Nathalie Kaligirwa, Eleazar Leal, Le Gruenwald +2 more

Signal Processing · · cited 6× · DOI ↗ · more like this ·

Global remote sensing and large-scale environment modeling have generated vast amounts of raster geospatial images. To gain a better understanding of this data, researchers are interested in performing spatial queries over them, and the computation of those queries' results is greatly facilitated by the existence of spatial indices. Additionally, though there have been major advances in computational power, the I/O transfer is becoming the major bottleneck in the overall system performance. One of the solutions to the I/O channel bandwidth issue is to compress data first and then send it over an I/O channel. Therefore, a compression technique that achieves not only indexing but also compression is highly desirable. The performance of geospatial raster data compression and indexing can benefit from high performance technologies such as General Purpose Graphics Processing Units (GPGPUs)…

High-Performance Spatial Join Processing on GPGPUs with Applications to Large-Scale Taxi Trip Data

Jianting Zhang, Simin You, Le Gruenwald

Signal Processing · · cited 6× · OpenAlex ↗ · more like this ·

Spatially joining GPS recorded locations with infrastructure data, such as points of interests, road network, land cover and different types of zones, and assigning a point with its nearest polyline or polygon is a prerequisite for trip related analysis, which is becoming increasingly important in ubiquitous computing. However, existing spatial databases and GIS are incapable of handling large-scale data. The poor performance of these systems that takes tens of hours to dozens of days to complete such a commonly used spatial join query is undesirable. By leveraging several high-performance techniques, including massive data parallel General Purpose computing on Graphics Processing Units (GPGPU) technologies and cache friendly main-memory data structures, we are able to design an efficient spatial join query processing system. The experiments using a commodity workstation equipped with a…

Towards an Efficient Top-K Trajectory Similarity Query Processing Algorithm for Big Trajectory Data on GPGPUs

Eleazar Leal, Le Gruenwald, Jianting Zhang +1 more

Signal Processing · · cited 5× · DOI ↗ · more like this ·

Through the use of location-sensing devices, it has been possible to collect very large datasets of trajectories. These datasets make it possible to issue spatio-temporal queries with which users can gather information about the characteristics of the movements of objects, derive patterns from that information, and understand the objects themselves. Among such spatio-temporal queries that can be issued is the top-K trajectory similarity query. This query finds many applications, such as bird migration analysis in ecology and trajectory sharing in social networks. However, the large size of the trajectory query sets and databases poses significant computational challenges. In this work, we propose a parallel GPGPU algorithm Top-KaBT that is specifically designed to reduce the size of the candidate set generated while processing these queries, and in doing so strives to address these…

Prototyping A Web-based High-Performance Visual Analytics Platform for Origin-Destination Data

Jianting Zhang, Simin You, Yinglong Xia

Signal Processing · · cited 5× · DOI ↗ · more like this ·

Origin-Destination (OD) data has quickly emerged as a popular and fast growing spatiotemporal data type due to widely adoption of GPS, smartphones and location dependent social networks. Several previous works have developed techniques for managing and visualizing large-scale OD data in desktop computing environments. In this study, by leveraging our experiences in Web-GIS and parallel spatial data processing and learning from successful OD data visualization case studies, we have developed a Web-based high-performance visual analytics prototype platform for OD data. Observing that interactive spatial queries typically only involve a limited number of Regions of Interests (ROIs), we propose a simple yet effective technique to aggregate OD records into dynamically defined OD polygons by data parallel scanning OD point locations for cache efficiency and easy parallelization on…