arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Ben Recht

19 papers · 2002–2025

2002: 22003: 12004: 22005: 12006: 12007: 22008: 12009: 02010: 02011: 12012: 12013: 12014: 02015: 12016: 12017: 02018: 12019: 12020: 02021: 02022: 02023: 02024: 02025: 2
2002peak 2 in 20022025

Frequent co-authors

Papers

showing 1–19 of 19 RSS

Physical One-Way Functions

Ravikanth Pappu, Ben Recht, Jason Taylor +1 more

Artificial Intelligence · Science · · cited 1,992× · DOI ↗ · more like this ·

Modern cryptographic practice rests on the use of one-way functions, which are easy to evaluate but difficult to invert. Unfortunately, commonly used one-way functions are either based on unproven conjectures or have known vulnerabilities. We show that instead of relying on number theory, the mesoscopic physics of coherent transport through a disordered medium can be used to allocate and authenticate unique identifiers by physically reducing the medium's microstructure to a fixed-length string of binary digits. These physical one-way functions are inexpensive to fabricate, prohibitively difficult to duplicate, admit no compact mathematical representation, and are intrinsically tamper-resistant. We provide an authentication protocol based on the enormous address space that is a principal characteristic of physical one-way functions.

Towards a Unified Architecture for in-RDBMS Analytics

Xixuan Feng, Arun Kumar, Ben Recht +1 more

cs.DB · · cited 214× · arXiv ↗ · more like this ·

The increasing use of statistical data analysis in enterprise applications has created an arms race among database vendors to offer ever more sophisticated in-database analytics. One challenge in this race is that each new statistical technique must be implemented from scratch in the RDBMS, which leads to a lengthy and complex development process. We argue that the root cause for this overhead is the lack of a unified architecture for in-database analytics. Our main contribution in this work is to take a step towards such a unified architecture. A key benefit of our unified architecture is that performance optimizations for analytics techniques can be studied generically instead of an ad hoc, per-technique fashion. In particular, our technical contributions are theoretical and empirical studies of two key factors that we found impact performance: the order data is stored, and…

Audiopad: A Tag-Based Interface For Musical Performance

James Patten, Ben Recht, Hiroshi Ishii

Computer Vision and Pattern Recognition · Zenodo (CERN European Organization for Nuclear Research) · · cited 163× · DOI ↗ · more like this ·

We present Audiopad, an interface for musical performance that aims to combine the modularity of knob based controllers with the expressive character of multidimensional tracking interfaces. The performer's manipulations of physical pucks on a tabletop control a real-time synthesis process. The pucks are embedded with LC tags that the system tracks in two dimensions with a series of specially shaped antennae. The system projects graphical information on and around the pucks to give the performer sophisticated control over the synthesis process.

Learning Appearance Manifolds from Video

Asghar Rahimi, Ben Recht, Trevor Darrell

Computer Vision and Pattern Recognition · · cited 80× · DOI ↗ · more like this ·

The appearance of dynamic scenes is often largely governed by a latent low-dimensional dynamic process. We show how to learn a mapping from video frames to this low-dimensional representation by exploiting the temporal coherence between frames and supervision from a user. This function maps the frames of the video to a low-dimensional sequence that evolves according to Markovian dynamics. This ensures that the recovered low-dimensional sequence represents a physically meaningful process. We relate our algorithm to manifold learning, semi-supervised learning, and system identification, and demonstrate it on the tasks of tracking 3D rigid objects, deformable bodies, and articulated bodies. We also show how to use the inverse of this mapping to manipulate video.

Interaction techniques for musical performance with tabletop tangible interfaces

James Patten, Ben Recht, Hiroshi Ishii

Human-Computer Interaction · · cited 75× · DOI ↗ · more like this ·

We present a set of interaction techniques for electronic musical performance using a tabletop tangible interface. Our system, the Audiopad, tracks the positions of objects on a tabletop surface and translates their motions into commands for a musical synthesizer. We developed and refined these interaction techniques through an iterative design process, in which new interaction techniques were periodically evaluated through performances and gallery installations. Based on our experience refining the design of this system, we conclude that tabletop interfaces intended for collaborative use should use interaction techniques designed to be legible to onlookers. We also conclude that these interfaces should allow users to spatially reconfigure the objects in the interface in ways that are personally meaningful. Categories and Subject Descriptors H.5.2 [User Interfaces]: interaction styles…

Dimensionality reduction: beyond the Johnson-Lindenstrauss bound

Yair Bartal, Ben Recht, Leonard J. Schulman

Computer Graphics and Computer-Aided Design · CaltechAUTHORS (California Institute of Technology) · · cited 22× · DOI ↗ · more like this ·

Dimension reduction of metric data has become a useful technique with numerous applications. The celebrated Johnson-Lindenstrauss lemma states that any n-point subset of Euclidean space can be embedded in O(ε^(−2)log n)-dimension with (1 + ε)-distortion. This bound is known to be nearly tight.
\nIn many applications the demand that all distances should be nearly preserved is too strong. In this paper we show that indeed under natural relaxations of the goal of the embedding, an improved dimension reduction is possible where the target dimension is independent of n. Our main result can be viewed as a local dimension reduction. There are a variety of empirical situations in which small distances are meaningful and reliable, but larger ones are not. Such situations arise in source coding, image processing, computational biology, and other applications, and are the motivation for…

Learning to Transform Time Series with a Few Examples

Ali Rahimi, Ben Recht, Trevor Darrell

Signal Processing · IEEE Transactions on Pattern Analysis and Machine Intelligence · · cited 21× · DOI ↗ · more like this ·

We describe a semi-supervised regression algorithm that learns to transform one time series into another time series given examples of the transformation. This algorithm is applied to tracking, where a time series of observations from sensors is transformed to a time series describing the pose of a target. Instead of defining and implementing such transformations for each tracking task separately, our algorithm learns a memoryless transformation of time series from a few example input-output mappings. The algorithm searches for a smooth function that fits the training examples and, when applied to the input time series, produces a time series that evolves according to assumed dynamics. The learning procedure is fast and lends itself to a closed-form solution. It is closely related to nonlinear system identification and manifold learning techniques. We demonstrate our algorithm on the…

Unsupervised Regression with Applications to Nonlinear System Identification

Ali Rahimi, Ben Recht

Artificial Intelligence · The MIT Press eBooks · · cited 8× · DOI ↗ · more like this ·

We derive a cost functional for estimating the relationship between high-dimensional observations and the low-dimensional process that generated them with no input-output examples. Limiting our search to invertible observation functions confers numerous benefits, including a compact representation and no suboptimal local minima. Our approximation algorithms for optimizing this cost
\nfunctional are fast and give diagnostic bounds on the quality of their solution. Our method can be viewed as a manifold learning algorithm that utilizes a prior on the
\nlow-dimensional manifold coordinates. The benefits of taking advantage of such priors in manifold learning and searching for the inverse observation functions
\nin system identification are demonstrated empirically by learning to track moving targets from raw measurements in a sensor network setting and in an RFID tracking…

A Reliable Current Starved Inverter based Arbiter PUF Architecture for IoT Applications

Anil Kumar, Usha Kurra, Usha Rani Nelakuditi +9 more

Hardware and Architecture · International Journal of Engineering and Advanced Technology · · cited 6× · DOI ↗ · more like this ·

In the recent years, Physical Unclonable Functions(PUFs) are emerged to be one of the lightweight hardware security primitives for device authentication, identification, such as Internet of things (IoT). IoT comprises connection of multiple number of nodes (devices) for exchanging the information across different networks. PUFs can sense the minute and unavoidable process variations during the fabrication process and generates the unique number of challenge-response pairs(CRPs), which can be stored and extensively used for secure associations between smart devices in IoT. Arbiter PUFs and ring oscillator PUFs are most commonly used strong PUFs in current day scenario. The conventional Linear arbiter PUFs are suffers from low reliability and vulnerable to Machine Learning attacks. In this paper, we proposed a Current starved Inverter (CSI) based arbiter PUF which enhances the non-…

MUSICALLY EXPRESSIVE SOUND TEXTURES FROM GENERALIZED AUDIO

Ben Recht, Brian Whitman

Signal Processing · · cited 6× · OpenAlex ↗ · more like this ·

We present a method of musically expressive synthesis-by-analysis that takes advantage of recent advancements in auditory scene analysis and sound separation algorithms. Our model represents incoming audio as a sub-conceptual model using statistical decorrelation techniques that abstract away individual auditory events, leaving only the gross parameters of the sound – the “eigensound” or generalized spectral template. Using these approaches we present various optimization guidelines and musical enhancements, specifically with regards to the beat and temporal nature of the sounds, with an eye towards real-time effects and synthesis. Our model results in completely novel and pleasing sound textures that can be varied with parameter tuning of the “unmixing ” weight matrix. 1.

Bridging Prediction and Intervention Problems in Social Systems

Lydia T. Liu, Inioluwa Deborah Raji, Angela Zhou +32 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Many automated decision systems (ADS) are designed to solve prediction problems -- where the goal is to learn patterns from a sample of the population and apply them to individuals from the same population. In reality, these prediction systems operationalize holistic policy interventions in deployment. Once deployed, ADS can shape impacted population outcomes through an effective policy change in how decision-makers operate, while also being defined by past and present interactions between stakeholders and the limitations of existing organizational, as well as societal, infrastructure and context. In this work, we consider the ways in which we must shift from a prediction-focused paradigm to an intervention-oriented paradigm when considering the impact of ADS within social systems. We argue this requires a new default problem setup for ADS beyond prediction, to instead consider…

On Sampling Time and Invariance

Spencer Schutz, Charlott Vallon, Ben Recht +1 more

eess.SY · · cited 0× · arXiv ↗ · more like this ·

Invariant sets define regions of the state space where system constraints are always satisfied. The majority of numerical techniques for computing invariant sets have been developed for discrete-time systems with a fixed sampling time. Understanding how invariant sets change with sampling time is critical for designing adaptive-sampling control schemes that ensure constraint satisfaction. We introduce M-step hold control invariance, a generalization of traditional control invariance, and show its practical use to assess the link between control sampling frequency and constraint satisfaction. We robustify M-step hold control invariance against model mismatches and discretization errors, paving the way for adaptive-sampling control strategies.

On the Detection of Mixture Distributions with applications to the Most Biased Coin Problem

Kevin Jamieson, Daniel Haas, Ben Recht

cs.LG · · cited 0× · arXiv ↗ · more like this ·

This paper studies the trade-off between two different kinds of pure exploration: breadth versus depth. The most biased coin problem asks how many total coin flips are required to identify a "heavy" coin from an infinite bag containing both "heavy" coins with mean $θ_1 \in (0,1)$, and "light" coins with mean $θ_0 \in (0,θ_1)$, where heavy coins are drawn from the bag with probability $α\in (0,1/2)$. The key difficulty of this problem lies in distinguishing whether the two kinds of coins have very similar means, or whether heavy coins are just extremely rare. This problem has applications in crowdsourcing, anomaly detection, and radio spectrum search. Chandrasekaran et. al. (2014) recently introduced a solution to this problem but it required perfect knowledge of $θ_0,θ_1,α$. In contrast, we derive algorithms that are adaptive to partial or absent knowledge of the problem parameters.…

A Nash-type Dimensionality Reduction for Discrete Subsets of L2

Yair Bartal, Ben Recht, Leonard J. Schulman

Computational Theory and Mathematics · · cited 0× · OpenAlex ↗ · more like this ·

Pursuing a line of work begun by Whitney, Nash showed that every C 1 manifold of dimension d can be embedded in R 2d+2 in such a manner that the local structure at each point is preserved isometrically. We provide an analog of this result for discrete subsets of Euclidean space. For perfect preservation of infinitesimal neighborhoods we substitute near-isometric embedding of neighborhoods of bounded cardinality. There are a variety of empirical situations, abstracted to metric space tasks, in which small distances are meaningful and reliable, but larger ones are not. Such situations arise in source coding, image processing, computational biology, and other applications, and are the motivation for widely-used heuristics such as Isomap and Locally Linear Embedding. In such situations we offer the possibility of dimension reductions unobtainable with global methods, because the dimension…

Clustering with Normalized Cuts is Clustering with a Hyperplane,” Statistical Learning in Computer Vision

Ali Rahimi, Ben Recht

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

Abstract. We present a set of clustering algorithms that identify cluster boundaries by searching for a hyperplanar gap in unlabeled data sets. It turns out that the Normalized Cuts algorithm of Shi and Malik [1], originally presented as a graph-theoretic algorithm, can be interpreted as such an algorithm. Viewing Normalized Cuts under this light reveals that it pays more attention to points away from the center of the data set than those near the center of the data set. As a result, it can sometimes split long clusters and display sensitivity to outliers. We derive a variant of Normalized Cuts that assigns uniform weight to all points, eliminating the sensitivity to outliers. 1

A Feature Space View of . . .

Ali Rahimi, Ben Recht

Sociology and Political Science · · cited 0× · OpenAlex ↗ · more like this ·

The transductive SVM is a semi-supervised learning algorithm that searches for a large margin hyperplane in feature space. By withholding the training labels and adding a constraint that favors balanced clusters, it can be turned into a clustering algorithm. The Normalized Cuts clustering algorithm of Shi and Malik, although originally presented as spectral relaxation of a graph cut problem, can be interpreted as a relaxation on clustering with transductive SVMs. Using this interpretation of Normalized Cuts, we identify some of its weaknesses, and propose a correction on it.

Near-Optimal Bounds for Binary Embeddings of Arbitrary Sets

Samet Oymak, Ben Recht

cs.LG · · arXiv ↗ · more like this ·

We study embedding a subset $K$ of the unit sphere to the Hamming cube $\{-1,+1\}^m$. We characterize the tradeoff between distortion and sample complexity $m$ in terms of the Gaussian width $ω(K)$ of the set. For subspaces and several structured sets we show that Gaussian maps provide the optimal tradeoff $m\sim δ^{-2}ω^2(K)$, in particular for $δ$ distortion one needs $m\approxδ^{-2}{d}$ where $d$ is the subspace dimension. For general sets, we provide sharp characterizations which reduces to $m\approx{δ^{-4}}{ω^2(K)}$ after simplification. We provide improved results for local embedding of points that are in close proximity of each other which is related to locality sensitive hashing. We also discuss faster binary embedding where one takes advantage of an initial sketching procedure based on Fast Johnson-Lindenstauss Transform. Finally, we list several numerical observations and…

Fast methods for denoising matrix completion formulations, with applications to robust seismic data interpolation

Aleksandr Y. Aravkin, Rajiv Kumar, Hassan Mansour +2 more

stat.ML · · arXiv ↗ · more like this ·

Recent SVD-free matrix factorization formulations have enabled rank minimization for systems with millions of rows and columns, paving the way for matrix completion in extremely large-scale applications, such as seismic data interpolation. In this paper, we consider matrix completion formulations designed to hit a target data-fitting error level provided by the user, and propose an algorithm called LR-BPDN that is able to exploit factorized formulations to solve the corresponding optimization problem. Since practitioners typically have strong prior knowledge about target error level, this innovation makes it easy to apply the algorithm in practice, leaving only the factor rank to be determined. Within the established framework, we propose two extensions that are highly relevant to solving practical challenges of data interpolation. First, we propose a weighted extension that allows…