arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Alan Edelman

166 papers · 1992–2026

1992: 21993: 21994: 51995: 41996: 01997: 21998: 61999: 12000: 22001: 02002: 32003: 02004: 92005: 92006: 112007: 52008: 22009: 32010: 42011: 42012: 52013: 52014: 122015: 42016: 32017: 22018: 32019: 42020: 52021: 42022: 42023: 112024: 52025: 102026: 15
1992peak 15 in 20262026

Frequent co-authors

Papers

showing 1–25 of 166 RSS

Julia: A Fresh Approach to Numerical Computing

Jeff Bezanson, Alan Edelman, Stefan Karpinski +1 more

cs.MS · · cited 6,825× · arXiv ↗ · more like this ·

Bridging cultures that have often been distant, Julia combines expertise from the diverse fields of computer science and computational science to create a new approach to numerical computing. Julia is designed to be easy and fast. Julia questions notions generally held as "laws of nature" by practitioners of numerical computing: 1. High-level dynamic programs have to be slow. 2. One must prototype in one language and then rewrite in another language for speed or deployment, and 3. There are parts of a system for the programmer, and other parts best left untouched as they are built by the experts. We introduce the Julia programming language and its design --- a dance between specialization and abstraction. Specialization allows for custom treatment. Multiple dispatch, a technique from computer science, picks the right algorithm for the right circumstance. Abstraction, what good…

The Geometry of Algorithms with Orthogonality Constraints

Alan Edelman, T. A. Arias, Steven T. Smith

physics.comp-ph · · cited 3,074× · arXiv ↗ · more like this ·

In this paper we develop new Newton and conjugate gradient algorithms on the Grassmann and Stiefel manifolds. These manifolds represent the constraints that arise in such areas as the symmetric eigenvalue problem, nonlinear eigenvalue problems, electronic structures computations, and signal processing. In addition to the new algorithms, we show how the geometrical framework gives penetrating new insights allowing us to create, understand, and compare algorithms. The theory proposed here provides a taxonomy for numerical linear algebra algorithms that provide a top level mathematical view of previously unrelated algorithms. It is our hope that developers of new algorithms and perturbation theories will benefit from the theory, methods, and examples in this paper.

Julia: A Fast Dynamic Language for Technical Computing

Jeff Bezanson, Stefan Karpinski, Viral B. Shah +1 more

cs.PL · · cited 853× · arXiv ↗ · more like this ·

Dynamic languages have become popular for scientific computing. They are generally considered highly productive, but lacking in performance. This paper presents Julia, a new dynamic language for technical computing, designed for performance from the beginning by adapting and extending modern programming language techniques. A design based on generic functions and a rich type system simultaneously enables an expressive programming model and successful type inference, leading to good performance for a wide range of programs. This makes it possible for much of the Julia library to be written in Julia itself, while also incorporating best-of-breed C and Fortran libraries.

Matrix Models for Beta Ensembles

Ioana Dumitriu, Alan Edelman

math-ph · · cited 735× · arXiv ↗ · more like this ·

This paper constructs tridiagonal random matrix models for general ($β>0$) $β$-Hermite (Gaussian) and $β$-Laguerre (Wishart) ensembles. These generalize the well-known Gaussian and Wishart models for $β= 1,2,4$. Furthermore, in the cases of the $β$-Laguerre ensembles, we eliminate the exponent quantization present in the previously known models. We further discuss applications for the new matrix models, and present some open problems.

Random matrix theory

Alan Edelman, N. Raj Rao

Statistics and Probability · Acta Numerica · · cited 544× · DOI ↗ · more like this ·

Random matrix theory is now a big subject with applications in many disciplines of science, engineering and finance. This article is a survey specifically oriented towards the needs and interests of a numerical analyst. This survey includes some original material not found anywhere else. We include the important mathematics which is a very modern development, as well as the computational software that is transforming the theory into useful practice.

How many zeros of a random polynomial are real?

Alan Edelman, Eric Kostlan

math.CA · · cited 444× · arXiv ↗ · more like this ·

We provide an elementary geometric derivation of the Kac integral formula for the expected number of real zeros of a random polynomial with independent standard normally distributed coefficients. We show that the expected number of real zeros is simply the length of the moment curve $(1,t,\ldots,t^n)$ projected onto the surface of the unit sphere, divided by $π$. The probability density of the real zeros is proportional to how fast this curve is traced out. We then relax Kac's assumptions by considering a variety of random sums, series, and distributions, and we also illustrate such ideas as integral geometry and the Fubini-Study metric.

PetaBricks

Jason Ansel, Cy Chan, Yee Lok Wong +4 more

Hardware and Architecture · · cited 360× · DOI ↗ · more like this ·

It is often impossible to obtain a one-size-fits-all solution for high performance algorithms when considering different choices for data distributions, parallelism, transformations, and blocking. The best solution to these choices is often tightly coupled to different architectures, problem sizes, data, and available system resources. In some cases, completely different algorithms may provide the best performance. Current compiler and programming language techniques are able to change some of these parameters, but today there is no simple way for the programmer to express or the compiler to choose different algorithms to handle different parts of the data. Existing solutions normally can handle only coarse-grained, library level selections or hand coded cutoffs between base cases and recursive cases.

Sample eigenvalue based detection of high dimensional signals in white noise using relatively few samples

N. Raj Rao, Alan Edelman

math.ST · · cited 293× · arXiv ↗ · more like this ·

We present a mathematically justifiable, computationally simple, sample eigenvalue based procedure for estimating the number of high-dimensional signals in white noise using relatively few samples. The main motivation for considering a sample eigenvalue based scheme is the computational simplicity and the robustness to eigenvector modelling errors which are can adversely impact the performance of estimators that exploit information in the sample eigenvectors. There is, however, a price we pay by discarding the information in the sample eigenvectors; we highlight a fundamental asymptotic limit of sample eigenvalue based detection of weak/closely spaced high-dimensional signals from a limited sample size. This motivates our heuristic definition of the effective number of identifiable signals which is equal to the number of "signal" eigenvalues of the population covariance matrix which…

A Differentiable Programming System to Bridge Machine Learning and Scientific Computing

Mike Innes, Alan Edelman, Keno Fischer +4 more

cs.PL · · cited 226× · arXiv ↗ · more like this ·

Scientific computing is increasingly incorporating the advancements in machine learning and the ability to work with large amounts of data. At the same time, machine learning models are becoming increasingly sophisticated and exhibit many features often seen in scientific computing, stressing the capabilities of machine learning frameworks. Just as the disciplines of scientific computing and machine learning have shared common underlying infrastructure in the form of numerical linear algebra, we now have the opportunity to further share new computational infrastructure, and thus ideas, in the form of Differentiable Programming. We describe Zygote, a Differentiable Programming system that is able to take gradients of general program structures. We implement this system in the Julia programming language. Our system supports almost all language constructs (control flow, recursion…

Modeling and rendering of weathered stone

Julie Dorsey, Alan Edelman, Henrik Wann Jensen +2 more

Computer Graphics and Computer-Aided Design · · cited 224× · DOI ↗ · more like this ·

Stone is widespread in its use as a building material and artistic medium. One of its most remarkable qualities is that it changes appearance as it interacts with the environment. These changes are mainly confined to the surface but involve complex volumetric effects such as erosion and mineral dissolution. This paper presents an approach for the modeling and rendering of changes in the shape and appearance of stone.To represent stone, we introduce a slab data structure, which is a surface-aligned volume confined to a narrow region around the boundary of the stone. Our weathering model employs a simulation of the flow of moisture and the transport, dissolution, and recrystallization of minerals within the porous stone volume. In addition, this model governs the erosion of material from the surface. To render the optical effects of translucency and coloration due to the composition of…

Polynomial Roots from Companion Matrix Eigenvalues

Alan Edelman, Hironori Murakami

Computational Theory and Mathematics · Mathematics of Computation · · cited 182× · DOI ↗ · more like this ·

In classical linear algebra, the eigenvalues of a matrix are sometimes dened as the roots of the char-acteristic polynomial. An algorithm to compute the roots of a polynomial by computing the eigenvalues of the corresponding companion matrix turns the tables on the usual denition. We derive a rst order error analysis of this algorithm that sheds light on both the underlying geometry of the problem as well as the numerical error of the algorithm. Our error analysis expands on work by Van Dooren and Dewilde in that it states that the algorithm is backwards normwise stable in a sense that must be dened carefully. Regarding the stronger concept of a small componentwise backwards error, our analysis predicts a small such error on a test suite of eight random polynomials suggested by Toh and Trefethen. However, we construct examples for which a small componentwise relative backwards error is…

A Geometric Approach to Perturbation Theory of Matrices and Matrix Pencils. Part I: Versal Deformations

Alan Edelman, Erik Elmroth, Bo Kågström

Computational Theory and Mathematics · SIAM Journal on Matrix Analysis and Applications · · cited 156× · DOI ↗ · more like this ·

We derive versal deformations of the Kronecker canonical form by deriving the tangent space and orthogonal bases for the normal space to the orbits of strictly equivalent matrix pencils. These deformations reveal the local perturbation theory of matrix pencils related to the Kronecker canonical form. We also obtain a new singular value bound for the distance to the orbits of less generic pencils. The concepts, results, and their derivations are mainly expressed in the language of numerical linear algebra. We conclude with experiments and applications.

Parallel MATLAB: Doing it Right

Ron Choy, Alan Edelman

Hardware and Architecture · Proceedings of the IEEE · · cited 140× · DOI ↗ · more like this ·

MATLAB is one of the most widely used mathematical computing environments in technical computing. It is an interactive environment that provides high-performance computational routines and an easy-to-use, C-like scripting language. It started out as an interactive interface to EISPACK and LINPACK and has remained a serial program. In 1995, C. Moler of Mathworks argued that there was no market at the time for a parallel MATLAB. But times have changed and we are seeing increasing interest in developing a parallel MATLAB, from both academic and commercial sectors. In a recent survey, 27 parallel MATLAB projects have been identified. We expand upon that survey and discuss the approaches the projects have taken to parallelize MATLAB. Also, we describe innovative features in some of the parallel MATLAB projects. Then we will conclude with an idea of a "right" parallel MATLAB. Finally we will…

Language and compiler support for auto-tuning variable-accuracy algorithms

Jason Ansel, Yee Lok Wong, Cy Chan +3 more

Hardware and Architecture · DSpace@MIT (Massachusetts Institute of Technology) · · cited 112× · DOI ↗ · more like this ·

Abstract—Approximating ideal program outputs is a common technique for solving computationally difficult problems, for adhering to processing or timing constraints, and for performance optimization in situations where perfect precision is not necessary. To this end, programmers often use approximation algorithms, iterative methods, data resampling, and other heuristics. However, programming such variable accuracy algorithms presents difficult challenges since the optimal algorithms and parameters may change with different accuracy requirements and usage environments. This problem is further compounded when multiple variable accuracy algorithms are nested together due to the complex way that accuracy requirements can propagate across algorithms and because of the size of the set of allowable compositions. As a result, programmers often deal with this issue in an ad-hoc manner that can…

A Geometric Approach to Perturbation Theory of Matrices and Matrix Pencils. Part II: A Stratification-Enhanced Staircase Algorithm

Alan Edelman, Erik Elmroth, Bo Kågström

Computational Theory and Mathematics · SIAM Journal on Matrix Analysis and Applications · · cited 100× · DOI ↗ · more like this ·

Computing the Jordan form of a matrix or the Kronecker structure of a pencil is a well-known ill-posed problem. We propose that knowledge of the closure relations, i.e., the stratification, of the orbits and bundles of the various forms may be applied in the staircase algorithm. Here we discuss and complete the mathematical theory of these relationships and show how they may be applied to the staircase algorithm. This paper is a continuation of our Part I paper on versal deformations, but it may also be read independently.

MOPS: Multivariate Orthogonal Polynomials (symbolically)

Ioana Dumitriu, Alan Edelman, Gene Shuman

math-ph · · cited 98× · arXiv ↗ · more like this ·

In this paper we present a Maple library (MOPs) for computing Jack, Hermite, Laguerre, and Jacobi multivariate polynomials, as well as eigenvalue statistics for the Hermite, Laguerre, and Jacobi ensembles of Random Matrix theory. We also compute multivariate hypergeometric functions, and offer both symbolic and numerical evaluations for all these quantities. We prove that all algorithms are well-defined, analyze their complexity, and illustrate their performance in practice. Finally, we also present a few of the possible applications of this library.

The polynomial method for random matrices

N. Raj Rao, Alan Edelman

math.PR · · cited 93× · arXiv ↗ · more like this ·

We define a class of "algebraic" random matrices. These are random matrices for which the Stieltjes transform of the limiting eigenvalue distribution function is algebraic, i.e., it satisfies a (bivariate) polynomial equation. The Wigner and Wishart matrices whose limiting eigenvalue distributions are given by the semi-circle law and the Marcenko-Pastur law are special cases. Algebraicity of a random matrix sequence is shown to act as a certificate of the computability of the limiting eigenvalue density function. The limiting moments of algebraic random matrix sequences, when they exist, are shown to satisfy a finite depth linear recursion so that they may often be efficiently enumerated in closed form. In this article, we develop the mathematics of the polynomial method which allows us to describe the class of algebraic matrices by its generators and map the constructive approach we…

High-performance symbolic-numerics via multiple dispatch

Shashi Gowda, Yingbo Ma, Alessandro Cheli +4 more

cs.CL · · cited 90× · arXiv ↗ · more like this ·

As mathematical computing becomes more democratized in high-level languages, high-performance symbolic-numeric systems are necessary for domain scientists and engineers to get the best performance out of their machine without deep knowledge of code optimization. Naturally, users need different term types either to have different algebraic properties for them, or to use efficient data structures. To this end, we developed Symbolics.jl, an extendable symbolic system which uses dynamic multiple dispatch to change behavior depending on the domain needs. In this work we detail an underlying abstract term interface which allows for speed without sacrificing generality. We show that by formalizing a generic API on actions independent of implementation, we can retroactively add optimized data structures to our system without changing the pre-existing term rewriters. We showcase how this can be…

Tails of Condition Number Distributions

Alan Edelman, Brian Sutton

Statistics and Probability · SIAM Journal on Matrix Analysis and Applications · · cited 90× · DOI ↗ · more like this ·

Let $\kappa$ be the condition number of an m-by-n matrix with independent standard Gaussian entries, either real ($\beta = 1$) or complex ($\beta = 2$). The major result is the existence of a constant C (depending on m, n, and $\beta$) such that $P[\kappa > x] < C \, x^{-\beta}$ for all x. As $x \rightarrow \infty$, the bound is asymptotically tight. An analytic expression is given for the constant C, and simple estimates are given, one involving a Tracy--Widom largest eigenvalue distribution. All of the results extend beyond real and complex entries to general $\beta$.

Statistical eigen-inference from large Wishart matrices

N. Raj Rao, James A. Mingo, Roland Speicher +1 more

math.ST · · cited 78× · arXiv ↗ · more like this ·

We consider settings where the observations are drawn from a zero-mean multivariate (real or complex) normal distribution with the population covariance matrix having eigenvalues of arbitrary multiplicity. We assume that the eigenvectors of the population covariance matrix are unknown and focus on inferential procedures that are based on the sample eigenvalues alone (i.e., "eigen-inference"). Results found in the literature establish the asymptotic normality of the fluctuation in the trace of powers of the sample covariance matrix. We develop concrete algorithms for analytically computing the limiting quantities and the covariance of the fluctuations. We exploit the asymptotic normality of the trace of powers of the sample covariance matrix to develop eigenvalue-based procedures for testing and estimation. Specifically, we formulate a simple test of hypotheses for the population…

On the distribution of a scaled condition number

Alan Edelman

Statistics and Probability · Mathematics of Computation · · cited 75× · DOI ↗ · more like this ·

In this note, we give the exact distribution of a scaled condition number used by Demmel to model the probability that matrix inversion is difficult. Specifically, consider a random matrix <italic>A</italic> and the scaled condition number <inline-formula content-type="math/mathml"> <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" alttext="kappa Subscript upper D Baseline left-parenthesis upper A right-parenthesis equals double-vertical-bar upper A double-vertical-bar Subscript upper F Baseline bullet double-vertical-bar upper A Superscript negative 1 Baseline double-vertical-bar"> <mml:semantics> <mml:mrow> <mml:mrow class="MJX-TeXAtom-ORD"> <mml:msub> <mml:mi> κ </mml:mi> <mml:mi>D</mml:mi> </mml:msub> </mml:mrow> <mml:mo stretchy="false">(</mml:mo> <mml:mi>A</mml:mi> <mml:mo stretchy="false">)</mml:mo> <mml:mo>=</mml:mo> <mml:mrow class="MJX-TeXAtom-ORD"> <mml:msub>…

Eigenvalues of Hermite and Laguerre ensembles: Large Beta Asymptotics

Ioana Dumitriu, Alan Edelman

math-ph · · cited 71× · arXiv ↗ · more like this ·

In this paper we examine the zero and first order eigenvalue fluctuations for the $β$-Hermite and $β$-Laguerre ensembles, using the matrix models we described in \cite{dumitriu02}, in the limit as $β\to \infty$. We find that the fluctuations are described by Gaussians of variance $O(1/β)$, centered at the roots of a corresponding Hermite (Laguerre) polynomial. We also show that the approximation is very good, even for small values of $β$, by plotting exact level densities versus sum of Gaussians approximations.

Large Dense Numerical Linear Algebra in 1993: the Parallel Computing Influence

Alan Edelman

Computational Theory and Mathematics · The International Journal of Supercomputing Applications · · cited 54× · DOI ↗ · more like this ·

This article surveys the current state of applications of large dense numerical linear algebra and the influence of parallel computing. Furthermore, it attempts to crys tallize many important ideas that are sometimes mis understood in the rush to write fast programs.