arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

In Mapreduce

3 papers · 2013–2015

2013: 12014: 02015: 2
2013peak 2 in 20152015

Frequent co-authors

Papers

showing 1–3 of 3 RSS

Toward Intersection Filter-Based Optimization for Joins

In Mapreduce, Thuong-cang Phan

Education · · cited 0× · OpenAlex ↗ · more like this ·

MapReduce has become an attractive and dominant model for processing large-scale datasets. However, this model is not designed to directly support operations with multiple inputs as joins. Many studies on join algorithms including Bloom join in MapReduce have been conducted but they still have too much non-joining data generated and transmitted over the network. This research will help us eliminate the problem by providing an intersection filter based on probabilistic models to remove most disjoint elements between two datasets. Namely, three ways are proposed to build the intersection Bloom filter. To apply the filter to joins, a corresponding MapReduce job will be adjusted in a consistent way without increasing related costs. We then consider two-way joins and join cascades and analyze their costs. As a result, thanks to the high accuracy intersection filter, join processing can…

Readings in Algorithms- CS167 Filtering: A Method for Solving Graph Problems

In Mapreduce, A Paper Lattanzi, Nikolaos A. Platias

Computer Vision and Pattern Recognition · · cited 0× · OpenAlex ↗ · more like this ·

The paper by Lattanzi et al. develops a novel technique for solving graph problems in MapReduce [8]. MapReduce is an extensively used framework for parallel computation and large scale data analysis, both in industry and academia, since its formulation in 2004 by Dean et al. at Google [5]. We will review its key ideas and capabilities, as they will prove useful in the development of

BrackitMR: Flexible XQuery Processing

In Mapreduce, Caetano Sauer Sebastian Bächle

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

Abstract. We present BrackitMR, a framework that executes XQuery programs over distributed data using MapReduce. The main goal is to provide flexible MapReduce-based data processing with minimal performance penalties. Based on the Brackit query engine, a generic query compilation and optimization infrastructure, our system allows for a transparent integration of multiple data sources, such as XML, JSON, and CSV files, as well as relational databases, NoSQL stores, and lower-level record APIs such as BerkeleyDB. 1