arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Adam Marcus

76 papers · 2003–2026

2003: 12004: 02005: 12006: 12007: 42008: 52009: 32010: 62011: 72012: 42013: 82014: 52015: 62016: 32017: 52018: 22019: 22020: 12021: 52022: 12023: 22024: 02025: 12026: 3
2003peak 8 in 20132026

Frequent co-authors

Papers

showing 1–25 of 76 RSS

Scalable semantic web data management using vertical partitioning

Daniel J. Abadi, Adam Marcus, Samuel Madden +1 more

Artificial Intelligence · · cited 656× · OpenAlex ↗ · more like this ·

Efficient management of RDF data is an important factor in real-izing the Semantic Web vision. Performance and scalability issues are becoming increasingly pressing as Semantic Web technology is applied to real-world applications. In this paper, we examine the reasons why current data management solutions for RDF data scale poorly, and explore the fundamental scalability limitations of these approaches. We review the state of the art for improving perfor-mance for RDF databases and consider a recent suggestion, “prop-erty tables. ” We then discuss practically and empirically why this solution has undesirable features. As an improvement, we propose an alternative solution: vertically partitioning the RDF data. We compare the performance of vertical partitioning with prior art on queries generated by a Web-based RDF browser over a large-scale (more than 50 million triples) catalog of…

Interlacing Families I: Bipartite Ramanujan Graphs of All Degrees

Adam Marcus, Daniel A. Spielman, Nikhil Srivastava

math.CO · · cited 480× · arXiv ↗ · more like this ·

We prove that there exist infinite families of regular bipartite Ramanujan graphs of every degree bigger than 2. We do this by proving a variant of a conjecture of Bilu and Linial about the existence of good 2-lifts of every graph. We also establish the existence of infinite families of `irregular Ramanujan' graphs, whose eigenvalues are bounded by the spectral radius of their universal cover. Such families were conjectured to exist by Linial and others. In particular, we prove the existence of infinite families of (c,d)-biregular bipartite graphs with all non-trivial eigenvalues bounded by sqrt{c-1}+sqrt{d-1}, for all c, d \geq 3. Our proof exploits a new technique for demonstrating the existence of useful combinatorial objects that we call the "method of interlacing polynomials'".

Human-powered Sorts and Joins

Adam Marcus, Eugene Wu, David Karger +2 more

cs.DB · · cited 324× · arXiv ↗ · more like this ·

Crowdsourcing markets like Amazon's Mechanical Turk (MTurk) make it possible to task people with small jobs, such as labeling images or looking up phone numbers, via a programmatic interface. MTurk tasks for processing datasets with humans are currently designed with significant reimplementation of common workflows and ad-hoc selection of parameters such as price to pay per task. We describe how we have integrated crowds into a declarative workflow engine called Qurk to reduce the burden on workflow designers. In this paper, we focus on how to use humans to compare items for sorting and joining data, two of the most common operations in DBMSs. We describe our basic query interface and the user interface of the tasks we post to MTurk. We also propose a number of optimizations, including task batching, replacing pairwise comparisons with numerical ratings, and pre-filtering tables before…

Crowdsourced Databases: Query Processing with People

Adam Marcus, Eugene Wu, David R. Karger +2 more

Computer Science Applications · DSpace@MIT (Massachusetts Institute of Technology) · · cited 199× · OpenAlex ↗ · more like this ·

Amazon’s Mechanical Turk (“MTurk”) service allows users to post short tasks (“HITs”) that other users can receive a small amount of money for completing. Common tasks on the system include labelling a collection of images, combining two sets of images to identify people which appear in both, or extracting sentiment from a corpus of text snippets. Designing a workflow of various kinds of HITs for filtering, aggregating, sorting, and joining data sources together is common, and comes with a set of challenges in optimizing the cost per HIT, the overall time to task completion, and the accuracy of MTurk results. We propose Qurk, a novel query system for managing these workflows, allowing MTurk-style processing of relational databases. We describe a number of query execution and optimization challenges, and discuss some potential solutions.

Challenges in Data Crowdsourcing

Héctor García-Molina, Manas Joglekar, Adam Marcus +2 more

Computer Science Applications · IEEE Transactions on Knowledge and Data Engineering · · cited 139× · DOI ↗ · more like this ·

Crowdsourcing refers to solving large problems by involving human workers that solve component sub-problems or tasks. In data crowdsourcing, the problem involves data acquisition, management, and analysis. In this paper, we provide an overview of data crowdsourcing, giving examples of problems that the authors have tackled, and presenting the key design steps involved in implementing a crowdsourced solution. We also discuss some of the open challenges that remain to be solved.

Interlacing Families IV: Bipartite Ramanujan Graphs of All Sizes

Adam W. Marcus, Nikhil Srivastava, Daniel A. Spielman

math.CO · · cited 113× · arXiv ↗ · more like this ·

We prove that there exist bipartite Ramanujan graphs of every degree and every number of vertices. The proof is based on analyzing the expected characteristic polynomial of a union of random perfect matchings, and involves three ingredients: (1) a formula for the expected characteristic polynomial of the sum of a regular graph with a random permutation of another regular graph, (2) a proof that this expected polynomial is real rooted and that the family of polynomials considered in this sum is an interlacing family, and (3) strong bounds on the roots of the expected characteristic polynomial of a union of random perfect matchings, established using the framework of finite free convolutions we recently introduced.

Counting with the crowd

Adam Marcus, David R. Karger, Samuel Madden +2 more

Computer Science Applications · Proceedings of the VLDB Endowment · · cited 97× · DOI ↗ · more like this ·

In this paper, we address the problem of selectivity estimation in a crowdsourced database. Specifically, we develop several techniques for using workers on a crowdsourcing platform like Amazon's Mechanical Turk to estimate the fraction of items in a dataset (e.g., a collection of photos) that satisfy some property or predicate (e.g., photos of trees). We do this without explicitly iterating through every item in the dataset. This is important in crowd-sourced query optimization to support predicate ordering and in query evaluation, when performing a GROUP BY operation with a COUNT or AVG aggregate. We compare sampling item labels, a traditional approach, to showing workers a collection of items and asking them to estimate how many satisfy some predicate. Additionally, we develop techniques to eliminate spammers and colluding attackers trying to skew selectivity estimates when using…

Finite free convolutions of polynomials

Adam Marcus, Daniel A. Spielman, Nikhil Srivastava

math.CO · · cited 94× · arXiv ↗ · more like this ·

We study three convolutions of polynomials in the context of free probability theory. We prove that these convolutions can be written as the expected characteristic polynomials of sums and products of unitarily invariant random matrices. The symmetric additive and multiplicative convolutions were introduced by Walsh and Szegö in different contexts, and have been studied for a century. The asymmetric additive convolution, and the connection of all of them with random matrices, is new. By developing the analogy with free probability, we prove that these convolutions produce real rooted polynomials and provide strong bounds on the locations of the roots of these polynomials.

What Studies of Retractions Tell Us

Adam Marcus, Ivan Oransky

Safety Research · Journal of Microbiology and Biology Education · · cited 78× · DOI ↗ · more like this ·

The retraction is receiving a growing amount of attention as an important event in scientific and scholarly publishing. Not only are some journals becoming increasingly open in their handling of the articles they withdraw-allowing researchers to gain important insights into the work of their colleagues-but scholars, too, have greater access to the reasons for retractions, information that is dramatically reshaping our understanding of such events. As this article will demonstrate, recent research has inverted the accepted lore about why retractions happen and their impact.

Extensions of the linear bound in the Furedi-Hajnal conjecture

Martin Klazar, Adam Marcus

math.CO · · cited 73× · arXiv ↗ · more like this ·

We present two extensions of the linear bound, due to Marcus and Tardos, on the number of 1's in an n by n 0-1 matrix avoiding a fixed permutation matrix. We first extend the linear bound to hypergraphs with ordered vertex sets and, using previous results of Klazar, we prove an exponential bound on the number of hypergraphs on n vertices which avoid a fixed permutation. This, in turn, solves various conjectures of Klazar as well as a conjecture of Branden and Mansour.We then extend the original Furedi-Hajnal problem from ordinary matrices to d-dimensional matrices and show that the number of 1's in a d-dimensional 0-1 matrix with side length n which avoids a d-dimensional permutation matrix is O(n^{d-1}).

Argonaut

Daniel Haas, Jason Ansel, Lydia Gu +1 more

Computer Science Applications · Proceedings of the VLDB Endowment · · cited 71× · DOI ↗ · more like this ·

Crowdsourced workflows are used in research and industry to solve a variety of tasks. The databases community has used crowd workers in query operators/optimization and for tasks such as entity resolution. Such research utilizes microtasks where crowd workers are asked to answer simple yes/no or multiple choice questions with little training. Typically, microtasks are used with voting algorithms to combine redundant responses from multiple crowd workers to achieve result quality. Microtasks are powerful, but fail in cases where larger context (e.g., domain knowledge) or significant time investment is needed to solve a problem, for example in large-document structured data extraction. In this paper, we consider context-heavy data processing tasks that may require many hours of work, and refer to such tasks as macrotasks. Leveraging the infrastructure and worker pools of existing…

Entropy and set cardinality inequalities for partition-determined functions

Mokshay Madiman, Adam Marcus, Prasad Tetali

cs.IT · · cited 61× · arXiv ↗ · more like this ·

A new notion of partition-determined functions is introduced, and several basic inequalities are developed for the entropy of such functions of independent random variables, as well as for cardinalities of compound sets obtained using these functions. Here a compound set means a set obtained by varying each argument of a function of several variables over a set associated with that argument, where all the sets are subsets of an appropriate algebraic structure so that the function is well defined. On the one hand, the entropy inequalities developed for partition-determined functions imply entropic analogues of general inequalities of Plünnecke-Ruzsa type. On the other hand, the cardinality inequalities developed for compound sets imply several inequalities for sumsets, including for instance a generalization of inequalities proved by Gyarmati, Matolcsi and Ruzsa (2010). We also provide…

Enhancing directed content sharing on the web

Michael S. Bernstein, Adam Marcus, David R. Karger +1 more

Communication · DSpace@MIT (Massachusetts Institute of Technology) · · cited 57× · DOI ↗ · more like this ·

To find interesting, personally relevant web content, people rely on friends and colleagues to pass links along as they encounter them. In this paper, we study and augment link-sharing via e-mail, the most popular means of sharing web content today. Armed with survey data indicating that active sharers of novel web content are often those that actively seek it out, we developed FeedMe, a plug-in for Google Reader that makes directed sharing of content a more salient part of the user experience. FeedMe recommends friends who may be interested in seeing content that the user is viewing, provides information on what the recipient has seen and how many emails they have received recently, and gives recipients the opportunity to provide lightweight feedback when they appreciate shared content. FeedMe introduces a novel design space within mixed-initiative social recommenders: friends who know…

Polynomial convolutions and (finite) free probability

Adam W. Marcus

math.CO · · cited 56× · arXiv ↗ · more like this ·

We introduce a finite version of free probability and show the link between recent results using polynomial convolutions and the traditional theory of free probability. One tool for accomplishing this is a seemingly new transformation that allows one to reduce computations in our new theory to computations using classically independent random variables. We then explore the idea of finite freeness and its implications. Lastly, we show applications of the new theory by deriving the finite versions of some well-known free distributions and then proving their associated limit laws directly. In the process, we gain a number of insights into the behavior of convolutions in traditional free probability that seem to get lost when the operators being convolved are no longer finite. This version contains the original preprint from 2016 as well as an extra section (Section 5.2) where we use finite…

Tweets as data

Adam Marcus, Michael S. Bernstein, Osama Badar +3 more

Communication · DSpace@MIT (Massachusetts Institute of Technology) · · cited 43× · DOI ↗ · more like this ·

Microblogs such as Twitter are a tremendous repository of user-generated content. Increasingly, we see tweets used as data sources for novel applications such as disaster mapping, brand sentiment analysis, and real-time visualizations. In each scenario, the workflow for processing tweets is ad-hoc, and a lot of unnecessary work goes into repeating common data processing patterns. We introduce TweeQL, a stream query processing language that presents a SQL-like query interface for unstructured tweets to generate structured data for downstream applications. We have built several tools on top of TweeQL, most notably TwitInfo, an event timeline generation and exploration interface that summarizes events as they are discussed on Twitter. Our demonstration will allow the audience to interact with both TweeQL and TwitInfo to convey the value of data embedded in tweets.

Ramanujan Graphs and the Solution of the Kadison-Singer Problem

Adam W. Marcus, Daniel A. Spielman, Nikhil Srivastava

math.SP · · cited 40× · arXiv ↗ · more like this ·

We survey the techniques used in our recent resolution of the Kadison-Singer problem and proof of existence of Ramanujan Graphs of every degree: mixed characteristic polynomials and the method of interlacing families of polynomials. To demonstrate the method of interlacing families of polynomials, we give a simple proof of Bourgain and Tzafriri's restricted invertibility principle in the isotropic case.

Demonstration of Qurk

Adam Marcus, Eugene Wu, David R. Karger +2 more

Computer Science Applications · · cited 40× · DOI ↗ · more like this ·

Crowdsourcing technologies such as Amazon's Mechanical Turk ("MTurk") service have exploded in popularity in recent years. These services are increasingly used for complex human-reliant data processing tasks, such as labelling a collection of images, combining two sets of images to identify people that appear in both, or extracting sentiment from a corpus of text snippets. There are several challenges in designing a workflow that filters, aggregates, sorts and joins human-generated data sources. Currently, crowdsourcing-based workflows are hand-built, resulting in increasingly complex programs. Additionally, developers must hand-optimize tradeoffs among monetary cost, accuracy, and time to completion of results. These challenges are well-suited to a declarative query interface that allows developers to describe their worflow at a high level and automatically optimizes workflow and…

The Effects of Sequence and Delay on Crowd Work

Walter S. Lasecki, Jeffrey M. Rzeszotarski, Adam Marcus +1 more

Computer Science Applications · · cited 35× · DOI ↗ · more like this ·

A common approach in crowdsourcing is to break large tasks into small microtasks so that they can be parallelized across many crowd workers and so that redundant work can be more easily compared for quality control. In practice, this can result in the microtasks being presented out of their natural order and often introduces delays between individual microtasks. In this paper, we demonstrate in a study of 338 crowd workers that non-sequential microtasks and the introduction of delays significantly decreases worker performance. We show that interruptions where a large delay occurs between two related tasks can cause up to a 102% slowdown in completion time, and interruptions where workers are asked to perform different tasks in sequence can slow down completion time by 57%. We conclude with a set of design guidelines to improve both worker performance and realized pay, and instructions…

Processing and visualizing the data in tweets

Adam Marcus, Michael S. Bernstein, Osama Badar +3 more

Information Systems · ACM SIGMOD Record · · cited 33× · DOI ↗ · more like this ·

Microblogs such as Twitter provide a valuable stream of diverse user-generated data. While the data extracted from Twitter is generally timely and accurate, the process by which developers extract structured data from the tweet stream is ad-hoc and requires reimplementation of common data manipulation primitives. In this paper, we present two systems for querying and extracting structure from Twitter-embedded data. The first, TweeQL, provides a streaming SQL-like interface to the Twitter API, making common tweet processing tasks simpler. The second, TwitInfo, shows how end-users can interact with and understand aggregated data from the tweet stream, in addition to showcasing the power of the TweeQL language. Together these systems show the richness of content that can be extracted from Twitter.

Using The Barton Libraries Dataset As An RDF benchmark

Daniel J. Abadi, Adam Marcus, Samuel Madden +1 more

Artificial Intelligence · DSpace@MIT (Massachusetts Institute of Technology) · · cited 29× · OpenAlex ↗ · more like this ·

This report describes the Barton Libraries RDF dataset and Long-well query benchmark that we use for our recent VLDB paper on Scalable Semantic Web Data Management Using Vertical Partition-ing [4]. 1. BARTON DATA The dataset used for this benchmark is taken from the publicly available Barton Libraries dataset [1]. This data is provided by the Simile Project [3], which develops tools for library data manage-ment and interoperability. The data contains records that compose an RDF-formatted dump of the MIT Libraries Barton catalog, con-verted from raw data stored in an old library format standard called MARC (Machine Readable Catalog). Because of the multiple sources the data was derived from and the diverse nature of the data that is cataloged, the structure of the data is quite irregular.

Sync kit

Edward Benson, Adam Marcus, David R. Karger +1 more

Computer Networks and Communications · DSpace@MIT (Massachusetts Institute of Technology) · · cited 24× · DOI ↗ · more like this ·

We introduce a client-server toolkit called Sync Kit that demonstrates how client-side database storage can improve the performance of data intensive websites. Sync Kit is designed to make use of the embedded relational database defined in the upcoming HTML5 standard to offload some data storage and processing from a web server onto the web browsers to which it serves content. Our toolkit provides various strategies for synchronizing relational database tables between the browser and the web server, along with a client-side template library so that portions web applications may be executed client-side. Unlike prior work in this area, Sync Kit persists both templates and data in the browser across web sessions, increasing the number of concurrent connections a server can handle by up to a factor of four versus that of a traditional server-only web stack and a factor of three versus a…

Critter

Aditya Bharadwaj, Pao Siangliulue, Adam Marcus +1 more

Information Systems · · cited 16× · DOI ↗ · more like this ·

Checklists and guidelines have played an increasingly important role in complex tasks ranging from the cockpit to the operating theater. Their role in creative tasks like design is less explored. In a needfinding study with expert web designers, we identified designers' challenges in adhering to a checklist of design guidelines. We built Critter, which addressed these challenges with three components: Dynamic Checklists that progressively disclose guideline complexity with a self-pruning hierarchical view, AutoQA to automate common quality assurance checks, and guideline-specific feedback provided by a reviewer to highlight mistakes as they appear. In an observational study, we found that the more engaged a designer was with Critter, the fewer mistakes they made in following design guidelines. Designers rated the AutoQA and contextual feedback experience highly, and provided feedback on…

Talking about data

Edward Benson, Adam Marcus, Fabian Howahl +1 more

Computer Vision and Pattern Recognition · · cited 14× · DOI ↗ · more like this ·

The web has dramatically enhanced people's ability to communicate ideas, knowledge, and opinions. But the authoring tools that most people understand, blogs and wikis, primarily guide users toward authoring text. In this work, we show that substantial gains in expressivity and communication would accrue if people could easily share richly structured information in meaningful visualizations. We then describe several extensions we have created for blogs and wikis that enable users to publish, share, and aggregate such structured information using the same workflows they apply to text. In particular, we aim to preserve those attributes that make blogs and wikis so effective: one-click access to the information, one-click publishing of content, natural authoring interfaces, and the ability to easily copy-and-paste information and visualizations from other sources.

Entropy and set cardinality inequalities for partition-determined functions, with applications to sumsets

Mokshay Madiman, Adam W. Marcus, Prasad Tetali

Discrete Mathematics and Combinatorics · Academic Radiology · · cited 12× · DOI ↗ · more like this ·

Optimum billing and collection for imaging studies is an increasingly complex task. Even when substantial efforts are devoted to eliciting the proper indication for the study, reimbursement remains low primarily because of payer delays.