arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Joe Neeman

42 papers · 2011–2026

2011: 12012: 62013: 62014: 42015: 12016: 52017: 22018: 42019: 22020: 12021: 32022: 32023: 22024: 02025: 12026: 1
2011peak 6 in 20122026

Frequent co-authors

Papers

showing 1–25 of 42 RSS

Stochastic Block Models and Reconstruction

Elchanan Mossel, Joe Neeman, Allan Sly

math.PR · · cited 392× · arXiv ↗ · more like this ·

The planted partition model (also known as the stochastic blockmodel) is a classical cluster-exhibiting random graph model that has been extensively studied in statistics, physics, and computer science. In its simplest form, the planted partition model is a model for random graphs on $n$ nodes with two equal-sized clusters, with an between-class edge probability of $q$ and a within-class edge probability of $p$. Although most of the literature on this model has focused on the case of increasing degrees (ie.\ $pn, qn \to \infty$ as $n \to \infty$), the sparse case $p, q = O(1/n)$ is interesting both from a mathematical and an applied point of view. A striking conjecture of Decelle, Krzkala, Moore and Zdeborová based on deep, non-rigorous ideas from statistical physics gave a precise prediction for the algorithmic threshold of clustering in the sparse planted partition model. In…

Belief propagation, robust reconstruction and optimal recovery of block models

Elchanan Mossel, Joe Neeman, Allan Sly

math.PR · · cited 177× · arXiv ↗ · more like this ·

We consider the problem of reconstructing sparse symmetric block models with two blocks and connection probabilities $a/n$ and $b/n$ for inter- and intra-block edge probabilities, respectively. It was recently shown that one can do better than a random guess if and only if $(a-b)^2>2(a+b)$. Using a variant of belief propagation, we give a reconstruction algorithm that is optimal in the sense that if $(a-b)^2>C(a+b)$ for some constant $C$ then our algorithm maximizes the fraction of the nodes labeled correctly. Ours is the only algorithm proven to achieve the optimal fraction of nodes labeled correctly. Along the way, we prove some results of independent interest regarding robust reconstruction for the Ising model on regular and Poisson trees.

Preference Completion: Large-scale Collaborative Ranking from Pairwise Comparisons

Dohyung Park, Joe Neeman, Jin Zhang +2 more

stat.ML · · cited 81× · arXiv ↗ · more like this ·

In this paper we consider the collaborative ranking setting: a pool of users each provides a small number of pairwise preferences between $d$ possible items; from these we need to predict preferences of the users for items they have not yet seen. We do so by fitting a rank $r$ score matrix to the pairwise data, and provide two main contributions: (a) we show that an algorithm based on convex optimization provides good generalization guarantees once each user provides as few as $O(r\log^2 d)$ pairwise comparisons -- essentially matching the sample complexity required in the related matrix completion setting (which uses actual numerical as opposed to pairwise information), and (b) we develop a large-scale non-convex implementation, which we call AltSVM, that trains a factored form of the matrix via alternating minimization (which we show reduces to alternating SVM problems), and scales…

Robust dimension free isoperimetry in Gaussian space

Elchanan Mossel, Joe Neeman

math.PR · · cited 54× · arXiv ↗ · more like this ·

We prove the first robust dimension free isoperimetric result for the standard Gaussian measure $γ_n$ and the corresponding boundary measure $γ_n^+$ in $\mathbb {R}^n$. The main result in the theory of Gaussian isoperimetry (proven in the 1970s by Sudakov and Tsirelson, and independently by Borell) states that if $γ_n(A)=1/2$ then the surface area of $A$ is bounded by the surface area of a half-space with the same measure, $γ_n^+(A)\leq(2π)^{-1/2}$. Our results imply in particular that if $A\subset \mathbb {R}^n$ satisfies $γ_n(A)=1/2$ and $γ_n^+(A)\leq(2π)^{-1/2}+δ$ then there exists a half-space $B\subset \mathbb {R}^n$ such that $γ_n(AΔB)\leq C\smash{\log^{-1/2}}(1/δ)$ for an absolute constant $C$. Since the Gaussian isoperimetric result was established, only recently a robust version of the Gaussian isoperimetric result was obtained by Cianchi et al., who showed that $γ_n(AΔB)\le…

Testing surface area with arbitrary accuracy

Joe Neeman

math.PR · · cited 31× · arXiv ↗ · more like this ·

Recently, Kothari et al.\ gave an algorithm for testing the surface area of an arbitrary set $A \subset [0, 1]^n$. Specifically, they gave a randomized algorithm such that if $A$'s surface area is less than $S$ then the algorithm will accept with high probability, and if the algorithm accepts with high probability then there is some perturbation of $A$ with surface area at most $κ_n S$. Here, $κ_n$ is a dimension-dependent constant which is strictly larger than 1 if $n \ge 2$, and grows to $4/π$ as $n \to \infty$. We give an improved analysis of Kothari et al.'s algorithm. In doing so, we replace the constant $κ_n$ with $1 + η$ for $η> 0$ arbitrary. We also extend the algorithm to more general measures on Riemannian manifolds.

The Gaussian Double-Bubble and Multi-Bubble Conjectures

Emanuel Milman, Joe Neeman

math.DG · · cited 28× · arXiv ↗ · more like this ·

We establish the Gaussian Multi-Bubble Conjecture: the least Gaussian-weighted perimeter way to decompose $\mathbb{R}^n$ into $q$ cells of prescribed (positive) Gaussian measure when $2 \leq q \leq n+1$, is to use a "simplicial cluster", obtained from the Voronoi cells of $q$ equidistant points. Moreover, we prove that simplicial clusters are the unique isoperimetric minimizers (up to null-sets). In particular, the case $q=3$ confirms the Gaussian Double-Bubble Conjecture: the unique least Gaussian-weighted perimeter way to decompose $\mathbb{R}^n$ ($n \geq 2$) into three cells of prescribed (positive) Gaussian measure is to use a tripod-cluster, whose interfaces consist of three half-hyperplanes meeting along an $(n-2)$-dimensional plane at $120^{\circ}$ angles (forming a tripod or "Y" shape in the plane). The case $q=2$ recovers the classical Gaussian isoperimetric inequality. To…

Non-Reconstructability in the Stochastic Block Model

Joe Neeman, Praneeth Netrapalli

math.PR · · cited 26× · arXiv ↗ · more like this ·

We consider the problem of clustering (or reconstruction) in the stochastic block model, in the regime where the average degree is constant. For the case of two clusters with equal sizes, recent results by Mossel, Neeman and Sly, and by Massoulie, show that reconstructability undergoes a phase transition at the Kesten-Stigum bound of $λ_2^2 d = 1$, where $λ_2$ is the second largest eigenvalue of a related stochastic matrix and $d$ is the average degree. In this paper, we address the general case of more than two clusters and/or unbalanced cluster sizes. Our main result is a sufficient condition for clustering to be impossible, which matches the existing result for two clusters of equal sizes. A key ingredient in our result is a new connection between non-reconstructability and non-distinguishability of the block model from an Erdős-Rényi model with the same average degree. We also show…

On extracting common random bits from correlated sources on large alphabets

Siu On Chan, Elchanan Mossel, Joe Neeman

cs.IT · · cited 21× · arXiv ↗ · more like this ·

Suppose Alice and Bob receive strings $X=(X_1,...,X_n)$ and $Y=(Y_1,...,Y_n)$ each uniformly random in $[s]^n$ but so that $X$ and $Y$ are correlated . For each symbol $i$, we have that $Y_i = X_i$ with probability $1-\eps$ and otherwise $Y_i$ is chosen independently and uniformly from $[s]$. Alice and Bob wish to use their respective strings to extract a uniformly chosen common sequence from $[s]^k$ but without communicating. How well can they do? The trivial strategy of outputting the first $k$ symbols yields an agreement probability of $(1 - \eps + \eps/s)^k$. In a recent work by Bogdanov and Mossel it was shown that in the binary case where $s=2$ and $k = k(\eps)$ is large enough then it is possible to extract $k$ bits with a better agreement probability rate. In particular, it is possible to achieve agreement probability $(k\eps)^{-1/2} \cdot 2^{-k\eps/(2(1 - \eps/2))}$ using a…

Majority is stablest

Anindya De, Elchanan Mossel, Joe Neeman

Computational Theory and Mathematics · · cited 16× · DOI ↗ · more like this ·

The Majority is Stablest Theorem has numerous applications in hardness of approximation and social choice theory. We give a new proof of the Majority is Stablest Theorem by induction on the dimension of the discrete cube. Unlike the previous proof, it uses neither the "invariance principle" nor Borell's result in Gaussian space. The new proof is general enough to include all previous variants of majority is stablest such as "it ain't over until it's over" and "Majority is most predictable". Moreover, the new proof allows us to derive a proof of Majority is Stablest in a constant level of the Sum of Squares hierarchy. This implies in particular that Khot-Vishnoi instance of Max-Cut does not provide a gap instance for the Lasserre hierarchy.

The Gaussian Double-Bubble Conjecture

Emanuel Milman, Joe Neeman

math.FA · · cited 14× · arXiv ↗ · more like this ·

We establish the Gaussian Double-Bubble Conjecture: the least Gaussian-weighted perimeter way to decompose $\mathbb{R}^n$ into three cells of prescribed (positive) Gaussian measure is to use a tripod-cluster, whose interfaces consist of three half-hyperplanes meeting along an $(n-2)$-dimensional plane at $120^{\circ}$ angles (forming a tripod or "Y" shape in the plane). Moreover, we prove that tripod-clusters are the unique isoperimetric minimizers (up to null-sets).

Unique Games hardness of Quantum Max-Cut, and a conjectured vector-valued Borell's inequality

Yeongwoo Hwang, Joe Neeman, Ojas Parekh +2 more

quant-ph · · cited 7× · arXiv ↗ · more like this ·

The Gaussian noise stability of a function $f:\mathbb{R}^n \to \{-1, 1\}$ is the expected value of $f(\boldsymbol{x}) \cdot f(\boldsymbol{y})$ over $ρ$-correlated Gaussian random variables $\boldsymbol{x}$ and $\boldsymbol{y}$. Borell's inequality states that for $-1 \leq ρ\leq 0$, this is minimized by the halfspace $f(x) = \mathrm{sign}(x_1)$. In this work, we generalize this result to hold for functions $f:\mathbb{R}^n \to S^{k-1}$ which output $k$-dimensional unit vectors. Our main conjecture, which we call the $\textit{vector-valued Borell's inequality}$, asserts that the expected value of $\langle f(\boldsymbol{x}), f(\boldsymbol{y})\rangle$ is minimized by the function $f(x) = x_{\leq k} / \Vert x_{\leq k} \Vert$, where $x_{\leq k} = (x_1, \ldots, x_k)$. We give several pieces of evidence in favor of this conjecture, including a proof that it does indeed hold in the special case…

Is your function low-dimensional?

Anindya De, Elchanan Mossel, Joe Neeman

cs.CC · · cited 7× · arXiv ↗ · more like this ·

We study the problem of testing if a function depends on a small number of linear directions of its input data. We call a function $f$ a linear $k$-junta if it is completely determined by some $k$-dimensional subspace of the input space. In this paper, we study the problem of testing whether a given $n$ variable function $f : \mathbb{R}^n \to \{0,1\}$, is a linear $k$-junta or $ε$-far from all linear $k$-juntas, where the closeness is measured with respect to the Gaussian measure on $\mathbb{R}^n$. Linear $k$-juntas are a common generalization of two fundamental classes from Boolean function analysis (both of which have been studied in property testing) $\textbf{1.}$ $k$- juntas which are functions on the Boolean cube which depend on at most k of the variables and $\textbf{2.}$ intersection of $k$ halfspaces, a fundamental geometric concept class. We show that the class of linear…

The Search Problem in Mixture Models

Avik Ray, Joe Neeman, Sujay Sanghavi +1 more

stat.ML · · cited 7× · arXiv ↗ · more like this ·

We consider the task of learning the parameters of a {\em single} component of a mixture model, for the case when we are given {\em side information} about that component, we call this the "search problem" in mixture models. We would like to solve this with computational and sample complexity lower than solving the overall original problem, where one learns parameters of all components. Our main contributions are the development of a simple but general model for the notion of side information, and a corresponding simple matrix-based algorithm for solving the search problem in this general setting. We then specialize this model and algorithm to four common scenarios: Gaussian mixture models, LDA topic models, subspace clustering, and mixed linear regression. For each one of these we show that if (and only if) the side information is informative, we obtain parameter estimates with greater…

Majority is Stablest : Discrete and SoS

Anindya De, Elchanan Mossel, Joe Neeman

cs.CC · · cited 6× · arXiv ↗ · more like this ·

The Majority is Stablest Theorem has numerous applications in hardness of approximation and social choice theory. We give a new proof of the Majority is Stablest Theorem by induction on the dimension of the discrete cube. Unlike the previous proof, it uses neither the "invariance principle" nor Borell's result in Gaussian space. The new proof is general enough to include all previous variants of majority is stablest such as "it ain't over until it's over" and "Majority is most predictable". Moreover, the new proof allows us to derive a proof of Majority is Stablest in a constant level of the Sum of Squares hierarchy.This implies in particular that Khot-Vishnoi instance of Max-Cut does not provide a gap instance for the Lasserre hierarchy.

Concentration Inequalities for Sums of Markov Dependent Random Matrices

Joe Neeman, Bobby Shi, Rachel Ward

math.PR · · cited 4× · arXiv ↗ · more like this ·

We give Hoeffding and Bernstein-type concentration inequalities for the largest eigenvalue of sums of random matrices arising from a Markov chain. We consider time-dependent matrix-valued functions on a general state space, generalizing previous results that had only considered Hoeffding-type inequalities, and only for time-independent functions on a finite state space. In particular, we study a kind of noncommutative moment generating function, provide tight bounds on this object, and use a method of Garg et al. to turn this into tail bounds. Our proof proceeds spectrally, bounding the norm of a certain perturbed operator. In the process we make an interesting connection to dynamical systems and Banach space theory to prove a crucial result on the limiting behavior of our moment generating function that may be of independent interest.

The Structure of Isoperimetric Bubbles on $\mathbb{R}^n$ and $\mathbb{S}^n$

Emanuel Milman, Joe Neeman

math.DG · · cited 4× · arXiv ↗ · more like this ·

The multi-bubble isoperimetric conjecture in $n$-dimensional Euclidean and spherical spaces from the 1990's asserts that standard bubbles uniquely minimize total perimeter among all $q-1$ bubbles enclosing prescribed volume, for any $q \leq n+2$. The double-bubble conjecture on $\mathbb{R}^3$ was confirmed in 2000 by Hutchings-Morgan-Ritoré-Ros, and is nowadays fully resolved for all $n \geq 2$. The double-bubble conjecture on $\mathbb{S}^2$ and triple-bubble conjecture on $\mathbb{R}^2$ have also been resolved, but all other cases are in general open. We confirm the conjecture on $\mathbb{R}^n$ and on $\mathbb{S}^n$ for all $q \leq \min(5,n+1)$, namely: the double-bubble conjectures for $n \geq 2$, the triple-bubble conjectures for $n \geq 3$ and the quadruple-bubble conjectures for $n \geq 4$. In fact, we show that for all $q \leq n+1$, a minimizing cluster necessarily has spherical…

Moderate Deviations in Cycle Count

Joe Neeman, Charles Radin, Lorenzo Sadun

math.PR · · cited 4× · arXiv ↗ · more like this ·

We prove moderate deviations bounds for the lower tail of the number of odd cycles in a $\calG(n, m)$ random graph. We show that the probability of decreasing triangle density by $t^3$, is $\exp(-Θ(n^2 t^2))$ whenever $n^{-3/4} \ll t^3 \ll 1$, while for $k \ge 5$ we give the same estimate for the probability of decreasing the $k$-cycle density by $t^k$, but for the larger range $n^{-1} \ll t^k \ll 1$. When $m \ge \frac 12 \binom n2$, we also find the leading coefficient in the exponent. This complements results of Goldschmidt et al., who showed that for $n^{-3/2} \ll t^k \ll n^{-1}$, the probability is $\exp(-Θ(n^3 t^{2k}))$. That is, deviations of order smaller than $n^{-1}$ behave like small deviations, and deviations of order larger than $n^{-3/4}$ (for triangles) or $n^{-1}$ (for $k$-cycles with $k \ge 5$) behave like large deviations. For triangles, we conjecture that a sharp…

Robust testing of low-dimensional functions

Anindya De, Elchanan Mossel, Joe Neeman

cs.CC · · cited 4× · arXiv ↗ · more like this ·

A natural problem in high-dimensional inference is to decide if a classifier $f:\mathbb{R}^n \rightarrow \{-1,1\}$ depends on a small number of linear directions of its input data. Call a function $g: \mathbb{R}^n \rightarrow \{-1,1\}$, a linear $k$-junta if it is completely determined by some $k$-dimensional subspace of the input space. A recent work of the authors showed that linear $k$-juntas are testable. Thus there exists an algorithm to distinguish between: 1. $f: \mathbb{R}^n \rightarrow \{-1,1\}$ which is a linear $k$-junta with surface area $s$, 2. $f$ is $ε$-far from any linear $k$-junta with surface area $(1+ε)s$, where the query complexity of the algorithm is independent of the ambient dimension $n$. Following the surge of interest in noise-tolerant property testing, in this paper we prove a noise-tolerant (or robust) version of this result. Namely, we give an algorithm…

Non interactive simulation of correlated distributions is decidable

Anindya De, Elchanan Mossel, Joe Neeman

cs.CC · · cited 3× · arXiv ↗ · more like this ·

A basic problem in information theory is the following: Let $\mathbf{P} = (\mathbf{X}, \mathbf{Y})$ be an arbitrary distribution where the marginals $\mathbf{X}$ and $\mathbf{Y}$ are (potentially) correlated. Let Alice and Bob be two players where Alice gets samples $\{x_i\}_{i \ge 1}$ and Bob gets samples $\{y_i\}_{i \ge 1}$ and for all $i$, $(x_i, y_i) \sim \mathbf{P}$. What joint distributions $\mathbf{Q}$ can be simulated by Alice and Bob without any interaction? Classical works in information theory by G{á}cs-K{ö}rner and Wyner answer this question when at least one of $\mathbf{P}$ or $\mathbf{Q}$ is the distribution on $\{0,1\} \times \{0,1\}$ where each marginal is unbiased and identical. However, other than this special case, the answer to this question is understood in very few cases. Recently, Ghazi, Kamath and Sudan showed that this problem is decidable for $\mathbf{Q}$…

Standard Simplices and Pluralities are Not the Most Noise Stable

Steven Heilman, Elchanan Mossel, Joe Neeman

math.PR · · cited 3× · arXiv ↗ · more like this ·

The Standard Simplex Conjecture and the Plurality is Stablest Conjecture are two conjectures stating that certain partitions are optimal with respect to Gaussian and discrete noise stability respectively. These two conjectures are natural generalizations of the Gaussian noise stability result by Borell (1985) and the Majority is Stablest Theorem (2004). Here we show that the standard simplex is not the most stable partition in Gaussian space and that Plurality is not the most stable low influence partition in discrete space for every number of parts $k \geq 3$, for every value $ρ\neq 0$ of the noise and for every prescribed measures for the different parts as long as they are not all equal to $1/k$. Our results do not contradict the original statements of the Plurality is Stablest and Standard Simplex Conjectures in their original statements concerning partitions to sets of equal…

Nucleation during phase transitions in random networks

Joe Neeman, Charles Radin, Lorenzo Sadun

math.CO · · cited 2× · arXiv ↗ · more like this ·

We analyze the 3-parameter family of random networks which are uniform on networks with fixed number of edges, triangles, and nodes (between 33 and 66). We find precursors of phase transitions which are known to be present in the asymptotic node regime as the edge and triangle numbers are varied, and focus on one of the discontinuous ones. By use of a natural edge flip dynamics we determine nucleation barriers as a random network crosses the transition, in analogy to the process a material undergoes when frozen or melted, and characterize some of the stochastic properties of the network nucleation.

W2583499038

Anindya De, Elchanan Mossel, Joe Neeman

Computational Theory and Mathematics · Theory of Computing · · cited 2× · DOI ↗ · more like this ·

The "Majority is Stablest" Theorem has numerous applications in hardness of approximation and social choice theory. We give a new proof of the "Majority is Stablest" Theorem by induction on the dimension of the discrete cube. Unlike the previous proof, it uses neither the "invariance principle" nor Borell's result in Gaussian space. Moreover, the new proof allows us to derive a proof of "Majority is Stablest" in a constant level of the Sum of Squares hierarchy. This implies in particular that the Khot-Vishnoi instance of Max-Cut does not provide a gap instance for the Lasserre hierarchy.

Noise Stability is computable and low dimensional

Anindya De, Elchanan Mossel, Joe Neeman

math.PR · · cited 1× · arXiv ↗ · more like this ·

Questions of noise stability play an important role in hardness of approximation in computer science as well as in the theory of voting. In many applications, the goal is to find an optimizer of noise stability among all possible partitions of $\mathbb{R}^n$ for $n \geq 1$ to $k$ parts with given Gaussian measures $μ_1,\ldots,μ_k$. We call a partition $ε$-optimal, if its noise stability is optimal up to an additive $ε$. In this paper, we give an explicit, computable function $n(ε)$ such that an $ε$-optimal partition exists in $\mathbb{R}^{n(ε)}$. This result has implications for the computability of certain problems in non-interactive simulation, which are addressed in a subsequent work.