Author

Gilbert Strang

74 papers · 1960–2026

1967peak 6 in 20022026

Frequent co-authors

Papers

showing 1–25 of 74 RSS

A Simple Mesh Generator in MATLAB

Per‐Olof Persson, Gilbert Strang

Computer Graphics and Computer-Aided Design · SIAM Review · 2004 · cited 1,548× · DOI ↗ · more like this ·

Abstract. Creating a mesh is the first step in a wide range of applications, including scientific computing and computer graphics. An unstructured simplex mesh requires a choice of meshpoints (vertex nodes) and a triangulation. We want to offer a short and simple MATLAB code, described in more detail than usual, so the reader can experiment (and add to the code) knowing the underlying principles. We find the node locations by solving for equilibrium in a truss structure (using piecewise linear force-displacement relations) and we reset the topology by the Delaunay algorithm. The geometry is described implicitly by its distance function. In addition to being much shorter and simpler than other meshing techniques, our algorithm typically produces meshes of very high quality. We discuss ways to improve the robustness and the performance, but our aim here is simplicity. Readers can download…

Wavelets and Dilation Equations: A Brief Introduction

Gilbert Strang

Computer Vision and Pattern Recognition · SIAM Review · December 1989 · cited 954× · DOI ↗ · more like this ·

Wavelets are new families of basis functions that yield the representation $f(x) = \sum {b_{jk} W(2^j x - k)} $. Their construction begins with the solution $\phi (x)$ to a dilation equation with coefficients $c_k $. Then W comes from $\phi $, and the basis comes by translation and dilation of W. It is shown in Part 1 how conditions on the $c_k $ lead to approximation properties and orthogonality properties of the wavelets. Part 2 describes the recursive algorithms (also based on the $c_k $) that decompose and reconstruct f. The object of wavelets is to localize as far as possible in both time and frequency, with efficient algorithms

The Discrete Cosine Transform

Gilbert Strang

Signal Processing · SIAM Review · 1999 · cited 786× · DOI ↗ · more like this ·

Each discrete cosine transform (DCT) uses N real basis vectors whose components are cosines. In the DCT-4, for example, the jth component of $\boldv_k$ is $\cos (j + \frac{1}{2}) (k + \frac{1}{2}) \frac{\pi}{N}$. These basis vectors are orthogonal and the transform is extremely useful in image processing. If the vector $\boldx$ gives the intensities along a row of pixels, its cosine series $\sum c_k \boldv_k$ has the coefficients $c_k=(\boldx,\boldv_k)/N$. They are quickly computed from a Fast Fourier Transform. But a direct proof of orthogonality, by calculating inner products, does not reveal how natural these cosine vectors are. We prove orthogonality in a different way. Each DCT basis contains the eigenvectors of a symmetric "second difference" matrix. By varying the boundary conditions we get the established transforms DCT-1 through DCT-4. Other combinations lead to four additional…

The application of multiwavelet filterbanks to image processing

Vasily Strela, P.N. Heller, Gilbert Strang +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · April 1999 · cited 448× · DOI ↗ · more like this ·

Multiwavelets are a new addition to the body of wavelet theory. Realizable as matrix-valued filterbanks leading to wavelet bases, multiwavelets offer simultaneous orthogonality, symmetry, and short support, which is not possible with scalar two-channel wavelet systems. After reviewing this theory, we examine the use of multiwavelets in a filterbank setting for discrete-time signal and image processing. Multiwavelets differ from scalar wavelet systems in requiring two or more input streams to the multiwavelet filterbank. We describe two methods (repeated row and approximation/deapproximation) for obtaining such a vector input stream from a one-dimensional (1-D) signal. Algorithms for symmetric extension of signals at boundaries are then developed, and naturally integrated with approximation-based preprocessing. We describe an additional algorithm for multiwavelet processing of…

A Proposal for Toeplitz Matrix Calculations

Gilbert Strang

Computational Theory and Mathematics · Studies in Applied Mathematics · April 1986 · cited 429× · DOI ↗ · more like this ·

In contrast to the usual (and successful) direct methods for Toeplitz systems Ax = b , we propose an algorithm based on the conjugate gradient method. The preconditioner is a circulant, so that all matrices have constant diagonals and all matrix‐vector multiplications use the Fast Fourier Transform. We also suggest a technique for the eigenvalue problem, where current methods are less satisfactory. If the first indications are supported by further experiment, this new approach may have useful applications—including nearly Toeplitz systems, and parallel computations.

Wavelet transforms versus Fourier transforms

Gilbert Strang

math.NA · April 1993 · cited 406× · arXiv ↗ · more like this ·

This note is a very basic introduction to wavelets. It starts with an orthogonal basis of piecewise constant functions, constructed by dilation and translation. The ``wavelet transform'' maps each $f(x)$ to its coefficients with respect to this basis. The mathematics is simple and the transform is fast (faster than the Fast Fourier Transform, which we briefly explain), but approximation by piecewise constants is poor. To improve this first wavelet, we are led to dilation equations and their unusual solutions. Higher-order wavelets are constructed, and it is surprisingly quick to compute with them --- always indirectly and recursively. We comment informally on the contest between these transforms in signal processing, especially for video and image compression (including high-definition television). So far the Fourier Transform --- or its 8 by 8 windowed version, the Discrete Cosine…

Toeplitz Equations by Conjugate Gradients with Circulant Preconditioner

Raymond H. Chan, Gilbert Strang

Computational Theory and Mathematics · SIAM Journal on Scientific and Statistical Computing · 1989 · cited 255× · DOI ↗ · more like this ·

Abstract. This paper studies the solution of symmetric positive definite Toeplitz systems Ax b by the preconditioned conjugate gradient method. The preconditioner is a circulant matrix C that copies the middle diagonals of A, and each iteration uses the Fast Fourier Transform. Convergence is governed by the eigenvalues of C-A--a Toeplitz-circulant eigenvalue problemnand it is fast if those eigenvalues are clustered. The limiting behavior of the eigenvalues is found as the dimension increases, and it is proved that they cluster around A 1. For a wide class of problems the error after q conjugate gradient steps decreases as q2. Key words. Toeplitz, circulant, conjugate gradient, Hankel

The Fundamental Theorem of Linear Algebra

Gilbert Strang

Geometry and Topology · American Mathematical Monthly · November 1993 · cited 201× · DOI ↗ · more like this ·

prior permission, you may not download an entire issue of a journal or multiple copies of articles, and you may use content in the JSTOR archive only for your personal, non-commercial use. Please contact the publisher regarding any further use of this work. Publisher contact information may be obtained at

Short wavelets and matrix dilation equations

Gilbert Strang, Vasily Strela

Computer Vision and Pattern Recognition · IEEE Transactions on Signal Processing · 1995 · cited 200× · DOI ↗ · more like this ·

Scaling functions and orthogonal wavelets are created from the coefficients of a lowpass and highpass filter (in a two-band orthogonal filter bank). For "multifilters" those coefficients are matrices. This gives a new block structure for the filter bank, and leads to multiple scaling functions and wavelets. Geronimo, Hardin, and Massopust (see J. Approx. Theory, vol.78, p.373-401, 1994) constructed two scaling functions that have extra properties not previously achieved. The functions /spl Phi//sub 1/ and /spl Phi//sub 2/ are symmetric (linear phase) and they have short support (two intervals or less), while their translates form an orthogonal family. For any single function /spl Phi/, apart from Haar's piecewise constants, those extra properties are known to be impossible. The novelty is to introduce 2/spl times/2 matrix coefficients while retaining orthogonality of the multiwavelets.…

A Neural Network Solves, Explains, and Generates University Math Problems by Program Synthesis and Few-Shot Learning at Human Level

Iddo Drori, Sarah Zhang, Reece Shuttleworth +15 more

cs.LG · December 2021 · cited 194× · arXiv ↗ · more like this ·

We demonstrate that a neural network pre-trained on text and fine-tuned on code solves mathematics course problems, explains solutions, and generates new questions at a human level. We automatically synthesize programs using few-shot learning and OpenAI's Codex transformer and execute them to solve course problems at 81% automatic accuracy. We curate a new dataset of questions from MIT's largest mathematics courses (Single Variable and Multivariable Calculus, Differential Equations, Introduction to Probability and Statistics, Linear Algebra, and Mathematics for Computer Science) and Columbia University's Computational Linear Algebra. We solve questions from a MATH dataset (on Prealgebra, Algebra, Counting and Probability, Intermediate Algebra, Number Theory, and Precalculus), the latest benchmark of advanced mathematics problems designed to assess mathematical reasoning. We randomly…

Geometric nonlinearity: potential energy, complementary energy, and the gap function

Yang Gao, Gilbert Strang

Computational Theory and Mathematics · Quarterly of Applied Mathematics · September 1989 · cited 171× · DOI ↗ · more like this ·

Dual minimum principles for displacements and stresses are well established for linear variational problems and also for nonlinear (and monotone) constitutive laws. This paper studies the problem of geometric nonlinearity. By introducing a <italic>gap function</italic> , we recover complementary variational principles in the equilibrium problems of mathematical physics. When the gap function is nonnegative those become minimum principles. The theory is based on convex analysis, and the applications made here are to nonlinear mechanics.

Orthogonal multiwavelets with vanishing moments

Gilbert Strang

Computer Vision and Pattern Recognition · Optical Engineering · July 1994 · cited 121× · DOI ↗ · more like this ·

A scaling function is the solution to a dilation equation Φ(t) = ΣckΦ(2t - k), in which the coefficients come from a low-pass filter. The coefficients in the wavelet W(t) = ΣdkΦ(2t - k) come from a high-pass filter. When these coefficients are matrices, Φ and W are vectors: there are two or more scaling functions and an equal number of wavelets. By dilation and translation of the wavelets, we have an orthogonal basis Wijk = Wi(2jt - k) for all functions of finite energy. These "multiwavelets" open new possibilities. They can be shorter, with more vanishing moments, than single wavelets. They can be symmetric, which is impossible for scalar wavelets (except for Haar's). We determine the conditions to impose on the matrix…

On factorization of M-channel paraunitary filterbanks

Xiqi Gao, Truong Q. Nguyen, Gilbert Strang

Signal Processing · IEEE Transactions on Signal Processing · July 2001 · cited 108× · DOI ↗ · more like this ·

We systematically investigate the factorization of causal finite impulse response (FIR) paraunitary filterbanks with given filter length. Based on the singular value decomposition of the coefficient matrices of the polyphase representation, a fundamental order-one factorization form is first proposed for general paraunitary systems. Then, we develop a new structure for the design and implementation of paraunitary system based on the decomposition of Hermitian unitary matrices. Within this framework, the linear-phase filterbank and pairwise mirror-image symmetry filterbank are revisited. Their structures are special cases of the proposed general structures. Compared with the existing structures, more efficient ones that only use approximately half the number of free parameters are derived. The proposed structures are complete and minimal. Although the factorization theory with or without…

Balanced Splitting and Rebalanced Splitting

Raymond L. Speth, William H. Green, Shev MacNamara +1 more

Numerical Analysis · SIAM Journal on Numerical Analysis · 2013 · cited 57× · DOI ↗ · more like this ·

Many systems of equations fit naturally in the form $du/dt = A(u) + B(u)$. We may separate convection from diffusion, $x$-derivatives from $y$-derivatives, and (especially) linear from nonlinear. We alternate between integrating operators for $dv/dt=A(v)$ and $dw/dt=B(w)$. Noncommutativity (in the simplest case, of $e^{Ah}$ and $e^{Bh}$) introduces a splitting error which persists even in the steady state. Second-order accuracy can be obtained by placing the step for $B$ between two half-steps of $A$. This splitting method is popular, and we suggest a possible improvement, especially for problems that converge to a steady state. Our idea is to adjust the splitting at each timestep to $[A(u) + c_n] + [B(u)-c_n]$. We introduce two methods, balanced splitting and rebalanced splitting, for choosing the constant $c_n$. The execution of these methods is straightforward, but the stability…

Eigenvalues of (↓2)H and convergence of the cascade algorithm

Gilbert Strang

Signal Processing · IEEE Transactions on Signal Processing · 1996 · cited 51× · DOI ↗ · more like this ·

This paper is about the eigenvalues and eigenvectors of (/spl darr/2)H. The ordinary FIR filter H is a convolution with a vector h=(h(O),...,h(N)), which is the impulse response. The operator (/spl darr/2) downsamples the output y=h*x, keeping the even-numbered components y(2n). Where H is represented by a constant-diagonal matrix, this is a Toeplitz matrix with h(k) on its kth diagonal, the odd-numbered rows are removed in (/spl darr/2)H. The result is a double shift between rows, yielding a block Toeplitz matrix with 1/spl times/2 blocks. Iteration of the filter is governed by the eigenvalues. If the transfer function H(z)=/spl Sigma/h(k)z/sup -k/ has a zero of order p at z=-1, corresponding to /spl omega/=/spl pi/, then (/spl darr/2)H has p special eigenvalues 1/2 , 1/4 ...,( 1/2 )/sup p/. We show how each additional "zero at /spl pi/" divides all eigenvalues by 2 and creates a new…

The Interplay of Ranks of Submatrices

Gilbert Strang, Tri-Dung Nguyen

Computational Theory and Mathematics · SIAM Review · 2004 · cited 50× · DOI ↗ · more like this ·

A banded invertible matrix T has a remarkable inverse. All "upper" and "lower" submatrices of T-1 have low rank (depending on the bandwidth in T). The exact rank condition is known, and it allows fast multiplication by full matrices that arise in the boundary element method. We look for the "right" proof of this property of T-1 . Ultimately it reduces to a fact that deserves to be better known: Complementary submatrices of any T and T-1 have the same nullity. The last figure in the paper (when T is tridiagonal) shows that, on and above the diagonal of T-1 , all rows are proportional.

Functions of Difference Matrices Are Toeplitz Plus Hankel

Gilbert Strang, Shev MacNamara

Computational Theory and Mathematics · SIAM Review · 2014 · cited 45× · DOI ↗ · more like this ·

When the heat equation and wave equation are approximated by $\bm{u}_t = -\bm{K} \bm{u}$ and $\bm{u}_{tt} = -\bm{K} \bm{u}$ (discrete in space), the solution operators involve $e^{-\bm{K}t}$, $\sqrt{\bm{K}}$, $\cos(\sqrt{\bm{K}}t)$, and $\mathrm{sinc}(\sqrt{\bm{K}}t)$. We compute these four matrices and find accurate approximations with a variety of boundary conditions. The second difference matrix $\bm{K}$ is Toeplitz (shift-invariant) for Dirichlet boundary conditions, but we show why $e^{\bm{-Kt}}$ also has a Hankel (anti-shift-invariant) part. Any symmetric choice of the four corner entries of $\bm{K}$ leads to Toeplitz plus Hankel in all functions $f(\bm{K})$. Overall, this article is based on diagonalizing symmetric matrices, replacing sums by integrals, and computing Fourier coefficients.

On the Kantorovich inequality

Gilbert Strang

Mathematical Physics · Proceedings of the American Mathematical Society · June 1960 · cited 39× · DOI ↗ · more like this ·

by the generalized Schwarz inequality [2, p. 262]. Now (2) follows immediately from (1) and (3), using (U*y, U*y) = (y, y). If aC is finite dimensional, the bound is attained for x U*y =u-+v, where u and v are unit eigenvectors of A corresponding to eigenvalues m and M. In the general case, the bound need not be attained; but a sequence xn= U*yn=un+vn, where !1un|1=!fVnfl, (Em+i/n Em-o) n = Un, (EM+o EM-ln)Vn = Vn ({ Ex } being the spectral resolution for A) shows on calculation that the bound is best possible.

<title>Finite element multiwavelets</title>

Vasily Strela, Gilbert Strang

Computer Vision and Pattern Recognition · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 11 Oct 1994 · cited 37× · DOI ↗ · more like this ·

Finite elements with support on two intervals span the space of piecewise polynomomials with degree 2 n - 1 and n - 1 continuous derivatives. Function values and n - 1 derivatives at each meshpoint determine these `Hermite finite elements'. The n basis functions satisfy a dilation equation with n by n matrix coefficients. Orthogonal to this scaling subspace is a wavelet subspace. It is spanned by the translates of n wavelets Wi(t), each supported on three intervals. The wavelets are orthogonal to all rescalings Wi(2jt-k), but not to translates at the same level (j equals 0). These new multiwavelets achieve 2 n vanishing moments and high regularity with symmetry and short support.

Time-varying filter banks and multiwavelets

Martin Vetterli, Gilbert Strang

Computer Vision and Pattern Recognition · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · 17 Dec 2002 · cited 33× · DOI ↗ · more like this ·

A wavelet construction by Geronimo, Hardin and Massopust uses more than one wavelet and scaling function. Strang and Strela gave a filter bank interpretation of that result, as well as a condition for moment properties of the resulting wavelets. The present authors are concerned with the regularity of the resulting iterated filter bank scheme, that is, a matrix extension of the classic result by Daubechies (1988) on iterated filters. They show in particular: (i) the relation between time-varying filter banks and multiwavelets, (ii) the construction of multiwavelets as limits of iterated time-varying filter banks, (iii) a necessary condition for the convergence of the iterated matrix product and (iv) an exploration of examples of multiwavelets as iterations of time-varying filter banks.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML"…

A study of two-channel complex-valued filterbanks and wavelets with orthogonality and symmetry properties

Xiqi Gao, Truong Q. Nguyen, Gilbert Strang

Computer Vision and Pattern Recognition · IEEE Transactions on Signal Processing · April 2002 · cited 31× · DOI ↗ · more like this ·

We investigate two-channel complex-valued filterbanks and wavelets that simultaneously have orthogonality and symmetry properties. First, the conditions for the filterbank to be orthogonal, symmetric, and regular (for generating smooth wavelets) are presented. Then, a complete and minimal lattice structure is developed, which enables a general design approach for filterbanks and wavelets with arbitrary length and arbitrary order of regularity. Finally, two integer implementation methods that preserve the perfect reconstruction property of the filterbank are proposed. Their performances are evaluated via experimental results.

Linear Algebra for Everyone

Gilbert Strang

Numerical Analysis · 26 Nov 2020 · cited 30× · OpenAlex ↗ · more like this ·

Linear algebra has become the subject to know for people in quantitative disciplines of all kinds. No longer the exclusive domain of mathematicians and engineers, it is now used everywhere there is data and everybody who works with data needs to know more. This new book from Professor Gilbert Strang, author of the acclaimed Introduction to Linear Algebra, now in its fifth edition, makes linear algebra accessible to everybody, not just those with a strong background in mathematics. It takes a more active start, beginning by finding independent columns of small matrices, leading to the key concepts of linear combinations and rank and column space. From there it passes on to the classical topics of solving linear equations, orthogonality, linear transformations and subspaces, all clearly explained with many examples and exercises. The last major topics are eigenvalues and the important…

Fast transforms: Banded matrices with banded inverses

Gilbert Strang

Computer Vision and Pattern Recognition · Proceedings of the National Academy of Sciences · 30 Jun 2010 · cited 28× · DOI ↗ · more like this ·

It is unusual for both A and A(-1) to be banded--but this can be a valuable property in applications. Block-diagonal matrices F are the simplest examples; wavelet transforms are more subtle. We show that every example can be factored into A = F(1)...F(N) where N is controlled by the bandwidths of A and A(-1) (but not by their size, so this extends to infinite matrices and leads to new matrix groups).

Approximating semigroups and the consistency of difference schemes

Gilbert Strang

Computational Theory and Mathematics · Proceedings of the American Mathematical Society · 1969 · cited 27× · DOI ↗ · more like this ·

What hypotheses on the generators Lk ensure that the corresponding semigroups etLk converge to a given semigroup etL? Assuming these are Co semigroups on a common Banach space CB, several alternative hypotheses have been proposed. We want to compare, and in fact to order, the three most important alternatives. The possibility of such an ordering is a question which was asked by Trotter [1], and appears to have remained unanswered. Convergence is given the standard interpretation: For everyf cI and T>0,

Multiwavelet filter banks for data compression

P.N. Heller, Vasily Strela, Gilbert Strang +3 more

Computer Vision and Pattern Recognition · 19 Nov 2002 · cited 26× · DOI ↗ · more like this ·

This paper investigates the emerging notion of multiwavelets in the context of multirate filter banks, and applies a multiwavelet system to image coding. Multiwavelets are of interest because their constituent filters can be simultaneously symmetric and orthogonal (this combination is impossible for 2-band PR-QMFs), and because one can obtain higher orders of approximation (more vanishing wavelet moments) for a given filter length. We develop symmetric extension methods for finite-length signals under multiwavelet filtering. Techniques are then presented for pre- and post-processing one-dimensional signals in order to effectively exploit multiwavelet structures. Finally, we employ these new tools in a transform coding system and compare their performance with Daubechies' scalar wavelets.