arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Marcos Raydan

42 papers · 1993–2026

1993: 11994: 01995: 01996: 11997: 21998: 21999: 02000: 22001: 32002: 22003: 12004: 12005: 22006: 12007: 02008: 32009: 02010: 12011: 42012: 02013: 12014: 22015: 12016: 02017: 12018: 02019: 22020: 02021: 02022: 12023: 52024: 12025: 02026: 2
1993peak 5 in 20232026

Frequent co-authors

Papers

showing 1–25 of 42 RSS

Nonmonotone Spectral Projected Gradient Methods on Convex Sets

Ernesto G. Birgin, J. M. Martı́nez, Marcos Raydan

Numerical Analysis · SIAM Journal on Optimization · · cited 1,078× · DOI ↗ · more like this ·

Abstract Nonmonotone projected gradient techniques are considered for the minimizationof differentiable functions on closed convex sets. The classical projected gradient schemes are extended to include a nonmonotone steplength strategy that is based onthe Grippo-Lampariello-Lucidi nonmonotone line search. In particular, the nonmonotone strategy is combined with the spectral gradient choice of steplength to acceleratethe convergence process. In addition to the classical projected gradient nonlinear path, the feasible spectral projected gradient is used as a search direction to avoid additionaltrial projections during the one-dimensional search process. Convergence properties and extensive numerical results are presented. Key words: Projected gradients, nonmonotone line search, large scale problems,bound constrained problems, spectral gradient method.

The Barzilai and Borwein Gradient Method for the Large Scale Unconstrained Minimization Problem

Marcos Raydan

Numerical Analysis · SIAM Journal on Optimization · · cited 786× · DOI ↗ · more like this ·

The Barzilai and Borwein gradient method for the solution of large scale unconstrained minimization problems is considered. This method requires few storage locations and very inexpensive computations. Furthermore, it does not guarantee descent in the objective function and no line search is required. Recently, the global convergence for the convex quadratic case has been established. However, for the nonquadratic case, the method needs to be incorporated in a globalization scheme. In this work, a nonmonotone line search strategy that guarantees global convergence is combined with the Barzilai and Borwein method. This strategy is based on the nonmonotone line search technique proposed by Grippo, Lampariello, and Lucidi [SIAM J. Numer. Anal., 23 (1986), pp. 707--716]. Numerical results to compare the behavior of this method with recent implementations of the conjugate gradient method are…

On the Barzilai and Borwein choice of steplength for the gradient method

Marcos Raydan

Numerical Analysis · IMA Journal of Numerical Analysis · · cited 397× · DOI ↗ · more like this ·

In a recent paper, Barzilai and Borwein presented a new choice of steplength for the gradient method. Their choice does not guarantee descent in the objective function and greatly speeds up the convergence of the method. They presented a convergence analysis of their method only in the two-dimensional quadratic case. We establish the convergence of the Barzilai and Borwein gradient method when applied to the minimization of a strictly convex quadratic function of any number of variables.

Spectral residual method without gradient information for solving large-scale nonlinear systems of equations

William La Cruz, J. M. Martı́nez, Marcos Raydan

Numerical Analysis · Mathematics of Computation · · cited 335× · DOI ↗ · more like this ·

A fully derivative-free spectral residual method for solving large-scale nonlinear systems of equations is presented. It uses in a systematic way the residual vector as a search direction, a spectral steplength that produces a nonmonotone process and a globalization strategy that allows for this nonmonotone behavior. The global convergence analysis of the combined scheme is presented. An extensive set of numerical experiments that indicate that the new combination is competitive and frequently better than well-known Newton-Krylov methods for large-scale problems is also presented.

Algorithm 813

Ernesto G. Birgin, J. M. Martı́nez, Marcos Raydan

Numerical Analysis · ACM Transactions on Mathematical Software · · cited 247× · DOI ↗ · more like this ·

Fortran 77 software implementing the SPG method is introduced. SPG is a nonmonotone projected gradient algorithm for solving large-scale convex-constrained optimization problems. It combines the classical projected gradient method with the spectral gradient choice of steplength and a nonmonotone line-search strategy. The user provides objective function and gradient values, and projections onto the feasible set. Some recent numerical tests are reported on very large location problems, indicating that SPG is substantially more efficient than existing general-purpose software on problems for which projections can be computed efficiently.

Nonmonotone Spectral Methods for Large-Scale Nonlinear Systems

William La Cruz, Marcos Raydan

Numerical Analysis · Optimization methods & software · · cited 187× · DOI ↗ · more like this ·

The spectral gradient method has proved to be effective for solving large-scale optimization problems. In this work we extend the spectral approach to solve nonlinear systems of equations. We consider a strategy based on nonmonotone line search techniques to guarantee global convergence. and discuss implementation details for solving large-scale problems. We compare the performance of our new method with recent implementations of inexact Newton schemes based on Krylov subspace inner iterative methods for the linear systems. Our numerical experiments indicate that the spectral approach for solving nonlinear systems competes favorably with well-established numerical methods.

Gradient Method with Retards and Generalizations

Ana Friedlander, J. M. Martı́nez, Brígida Molina +1 more

Numerical Analysis · SIAM Journal on Numerical Analysis · · cited 163× · DOI ↗ · more like this ·

A generalization of the steepest descent and other methods for solving a large scale symmetric positive definitive system Ax = b is presented. Given a positive integer m, the new iteration is given by $x_{k+1} = x_k - \lambda (x_{\nu(k)}) (A x_k - b)$, where $\lambda (x_{\nu(k)})$ is the steepest descent step at a previous iteration $\nu(k) \in \{k, k-1, \ldots,$ max$\{0,k-m\}\}$. The global convergence to the solution of the problem is established under a more general framework, and numerical experiments are performed that suggest that some strategies for the choice of $\nu(k)$ give rise to efficient methods for obtaining approximate solutions of the system.

Computing a Nearest Correlation Matrix with Factor Structure

Rüdiger Borsdorf, Nicholas J. Higham, Marcos Raydan

Computational Theory and Mathematics · SIAM Journal on Matrix Analysis and Applications · · cited 40× · DOI ↗ · more like this ·

An $n\times n$ correlation matrix has k factor structure if its off-diagonal agrees with that of a rank k matrix. Such correlation matrices arise, for example, in factor models of collateralized debt obligations (CDOs) and multivariate time series. We analyze the properties of these matrices and, in particular, obtain an explicit formula for the rank in the one factor case. Our main focus is on the nearness problem of finding the nearest k factor correlation matrix $C(X) = \diag(I-XX^T) + XX^T$ to a given symmetric matrix, subject to natural nonlinear constraints on the elements of the $n\times k$ matrix X, where distance is measured in the Frobenius norm. For a special one parameter case we obtain an explicit solution. For the general k factor case we obtain the gradient and Hessian of the objective function and derive an instructive result on the positive definiteness of the Hessian…

Robust Stopping Criteria for Dykstra's Algorithm

Ernesto G. Birgin, Marcos Raydan

Numerical Analysis · SIAM Journal on Scientific Computing · · cited 38× · DOI ↗ · more like this ·

Dykstra's algorithm is a suitable alternating projection scheme for solving the optimization problem of finding the closest point to one given in the intersection of a finite number of closed and convex sets. It has been recently used in a wide variety of applications. However, in practice, the commonly used stopping criteria are not robust and could stop the iterative process prematurely at a point that does not solve the optimization problem. In this work we present a counterexample to illustrate the weakness of the commonly used criteria, and then we develop robust stopping rules. Additional experimental results are shown to illustrate the advantages of this new stopping criteria, including their associated computational cost.

Dykstra's Algorithm for a Constrained Least-squares Matrix Problem

René Escalante, Marcos Raydan

Numerical Analysis · Numerical Linear Algebra with Applications · · cited 33× · DOI ↗ · more like this ·

We apply Dykstra's alternating projection algorithm to the constrained least-squares matrix problem that arises naturally in statistics and mathematical economics. In particular, we are concerned with the problem of finding the closest symmetric positive definite bounded and patterned matrix, in the Frobenius norm, to a given matrix. In this work, we state the problem as the minimization of a convex function over the intersection of a finite collection of closed and convex sets in the vector space of square matrices. We present iterative schemes that exploit the geometry of the problem, and for which we establish convergence to the unique solution. Finally, we present preliminary numberical results to illustrate the performance of the proposed iterative methods.

SPG: Software for Convex-Constrained Optimization

Ernesto G. Birgin, J. M. Martı́nez, Marcos Raydan

Numerical Analysis · · cited 29× · OpenAlex ↗ · more like this ·

Abstract Fortran 77 software implementing the SPG method is introduced.SPG is a nonmonotone projected gradient algorithm for solving largescale convex-constrained optimization problems. It combines the clas-sical projected gradient method with the spectral gradient choice of steplength and a nonmonotone line search strategy. The user providesobjective function and gradient values, and projections onto the feasible set. Implementation details are presented and the usage of thesoftware is described. Some recent numerical tests are reported on very large location problems. The main conclusion is that SPG comparesfavorably with existing software. Categories and Subject Descriptors:D.3.2 [

Computing the nearest diagonally dominant matrix

María Luz Sánchez Mendoza, Marcos Raydan, Pablo Tarazaga

Computational Theory and Mathematics · Numerical Linear Algebra with Applications · · cited 23× · DOI ↗ · more like this ·

We solve the problem of minimizing the distance from a given matrix to the set of symmetric and diagonally dominant matrices. First, we characterize the projection onto the cone of diagonally dominant matrices with positive diagonal, and then we apply Dykstra's alternating projection algorithm on this cone and on the subspace of symmetric matrices to obtain the solution. We discuss implementation details and present encouraging preliminary numerical results. Copyright © 1999 John Wiley & Sons, Ltd.

PRECONDITIONED SPECTRAL PROJECTED GRADIENT METHOD ON CONVEX SETS

LenysBello, Marcos Raydan

Numerical Analysis · 计算数学:英文版 · · cited 14× · OpenAlex ↗ · more like this ·

The spectral gradient method has proved to be effective for solving large-scale unconstrained optimization problems. It has been recently extended and combined with the projected gradient method for solving optimization problems on convex sets. This combination includes the use of nonmonotone line search techniques to preserve the fast local convergence. In this work we further extend the spectral choice of steplength to accept preconditioned directions when a good preconditioner is available. We present an algorithmthat combines the spectral projected gradient method with preconditioning strategies toincrease the local speed of convergence while keeping the global properties. We discuss implementation details for solving large-scale problems.

Primal and polar approach for computing the symmetric diagonally dominant projection

Marcos Raydan, Pablo Tarazaga

Computational Theory and Mathematics · Numerical Linear Algebra with Applications · · cited 14× · DOI ↗ · more like this ·

Abstract We solve the problem of minimizing the distance from a given matrix to the cone of symmetric and diagonally dominant matrices with positive diagonal (SDD + ). Using the extreme rays of the polar cone we project onto the supporting hyperplanes of the faces of SDD + and then, applying the cyclic Dykstra's algorithm, we solve the problem. Similarly, using the extreme rays of SDD + we characterize the projection onto the polar cone, which also allows us to obtain the projection onto SDD + by means of the orthogonal decomposition theorem for convex cones. In both cases the symmetry and the sparsity pattern of the given matrix are preserved. Preliminary numerical experiments indicate that the polar approach is a promising one. Copyright © 2002 John Wiley & Sons, Ltd.

Theoretical analysis of the Exponential Transversal Method of Lines for the diffusion equation

Abraham J. Salazar, Marcos Raydan, Antonio Campo

Modeling and Simulation · Numerical Methods for Partial Differential Equations · · cited 14× · DOI ↗ · more like this ·

A new approximate technique to solve the diffusion equation, called the Exponential Transversal Method of Lines (ETMOL), utilizes an exponential variation of the dependent variable to improve accuracy in the evaluation of the time derivative. Campo and Salazar have implemented this method in a wide range of heat/mass transfer applications and have obtained surprisingly good numerical results. In this article, we study the theoretical properties of ETMOL in depth. In particular, consistency, stability, and convergence are established within the framework of the heat/mass diffusion equation. In most practical applications, the new method presents a very reduced truncation error in time, and its different versions are proven to be unconditionally stable in the Fourier sense. Convergence of the approximate solutions have then been established. The theory is corroborated by several…

Unconstrained Optimization Techniques for the Acceleration of Alternating Projection Methods

Luis M. Hernández-Ramos, René Escalante, Marcos Raydan

Computational Theory and Mathematics · Numerical Functional Analysis and Optimization · · cited 9× · DOI ↗ · more like this ·

Abstract Alternating projection methods have been extensively used to find the closest point, to a given point, in the intersection of several given sets that belong to a Hilbert space. One of the characteristics of these schemes is the slow convergence that can be observed in practical applications. To overcome this difficulty, several techniques, based on different ideas, have been developed to accelerate their convergence. Recently, a successful acceleration scheme was developed specially for Cimmino's method when applied to the solution of large-scale saddle point problems. This specialized acceleration scheme is based on the use of the well-known conjugate gradient method for minimizing a related convex quadratic map. In this work, we extend and further analyze this optimization approach for several alternating projection methods on different scenarios. In particular, we include a…

Newton’s method and secant methods: A longstanding relationship from vectors to matrices

Marlliny Monsalve, Marcos Raydan

Numerical Analysis · Portugaliae Mathematica · · cited 7× · DOI ↗ · more like this ·

Nonlinear matrix equations arise in different scientific topics, such as applied statistics, control theory, and financial mathematics, among others. As in many other scientific areas, Newton’s method has played an important role when solving these matrix problems. Under standard assumptions, the specialized Newton methods that have been developed for specific problems exhibit local and q-quadratic convergence and require a suitable initial guess. They also require, as usual, a significant amount of computational work per iteration, that in this case involve several matrix factorizations per iterations. As expected, whenever a Newton method can be developed, a secant method can also be developed. Indeed, more recently, secant methods for solving specific nonlinear matrix problems have been developed opening a new line of research. As in previous scenarios, these specialized secant…

Nonsmooth spectral gradient methods for unconstrained optimization

Milagros Loreto, Hugo Aponte, Debora Cores +1 more

Numerical Analysis · EURO Journal on Computational Optimization · · cited 6× · DOI ↗ · more like this ·

To solve nonsmooth unconstrained minimization problems, we combine the spectral choice of step length with two well-established subdifferential-type schemes: the gradient sampling method and the simplex gradient method. We focus on the interesting case in which the objective function is continuously differentiable almost everywhere, and it is often not differentiable at minimizers. In the case of the gradient sampling method, we also present a simple differentiability test that allows us to use the exact gradient direction as frequently as possible, and to build a stochastic subdifferential direction only if the test fails. The proposed spectral gradient sampling method is combined with a monotone line search globalization strategy. On the other hand, the simplex gradient method is a direct search method that only requires function evaluations to build an approximation to the gradient…

SLiSeS: Subsampled Line Search Spectral Gradient Method for Finite Sums

Stefania Bellavia, Nataša Krejić, Nataša Krklec Jerinkić +1 more

math.OC · · cited 5× · arXiv ↗ · more like this ·

The spectral gradient method is known to be a powerful low-cost tool for solving large-scale optimization problems. In this paper, our goal is to exploit its advantages in the stochastic optimization framework, especially in the case of mini-batch subsampling that is often used in big data settings. To allow the spectral coefficient to properly explore the underlying approximate Hessian spectrum, we keep the same subsample for several iterations before subsampling again. We analyze the required algorithmic features and the conditions for almost sure convergence, and present initial numerical results that show the advantages of the proposed method.

Accurate analytical/numerical solution of the heat conduction equation

Antonio Campo, Abraham J. Salazar, Diego J. Celentano +1 more

Numerical Analysis · International Journal of Numerical Methods for Heat &amp Fluid Flow · · cited 4× · DOI ↗ · more like this ·

Purpose – The purpose of this paper is to address a novel method for solving parabolic partial differential equations (PDEs) in general, wherein the heat conduction equation constitutes an important particular case. The new method, appropriately named the Improved Transversal Method of Lines (ITMOL), is inspired in the Transversal Method of Lines (TMOL), with strong insight from the method of separation of variables. Design/methodology/approach – The essence of ITMOL revolves around an exponential variation of the dependent variable in the parabolic PDE for the evaluation of the time derivative. As will be demonstrated later, this key step is responsible for improving the accuracy of ITMOL over its predecessor TMOL. Throughout the paper, the theoretical properties of ITMOL, such as consistency, stability, convergence and accuracy are analyzed in depth. In addition, ITMOL has proven to…

Specialized Hybrid Newton Schemes for Matrix pth Roots

Braulio De Abreu, Marlliny Monsalve, Marcos Raydan

Computational Theory and Mathematics · · cited 4× · OpenAlex ↗ · more like this ·

We discuss different variants of Newton’s method for computing a pth root of a given matrix. A suitable implementation is presented for solving the Sylvester equation, that appears at every Newton’s iteration, via Kronecker products. This approach is quadratically convergent and stable, but too expensive in computational cost. In contrast we propose and analyze some specialized versions that exploit the commutation of the iterates with the given matrix. We establish convergence of all the new versions under mild assumptions on the initial guess, and stability for one of them. These versions are relatively inexpensive and can easily be combined, at the final stages, with the Newton-Kronecker implementation to avoid possible stability problems when high precision is required. Preliminary and encouraging numerical results of the hybrid schemes are presented for p = 3 and p =5 .

An augmented Lagrangian approach for cardinality constrained minimization applied to variable selection problems

Nataša Krejić, Evelin H. M. Krulikovski, Marcos Raydan

Numerical Analysis · Applied Numerical Mathematics · · cited 3× · DOI ↗ · more like this ·

To solve convex constrained minimization problems, that also include a cardinality constraint, we propose an augmented Lagrangian scheme combined with alternating projection ideas. Optimization problems that involve a a cardinality constraint are NP-hard mathematical programs and typically very hard to solve approximately. Our approach takes advantage of a recently developed and analyzed continuous formulation that relaxes the cardinality constraint. Based on that formulation, we solve a sequence of smooth convex constrained minimization problems, for which we use projected gradient-type methods. In our setting, the convex constraint region can be written as the intersection of a finite collection of convex sets that are easy and inexpensive to project. We apply our approach to a variety of over and under determined constrained linear least-squares problems, with both synthetic and real…

A hybrid direct search and projected simplex gradient method for convex constrained minimization

A. L. Custódio, Evelin H. M. Krulikovski, Marcos Raydan

Numerical Analysis · Optimization methods & software · · cited 3× · DOI ↗ · more like this ·

We propose a new Derivative-free Optimization (DFO) approach for solving convex constrained minimization problems. The feasible set is assumed to be the non-empty intersection of a finite collection of closed convex sets, such that the projection onto each of these individual convex sets is simple and inexpensive to compute. Our iterative approach alternates between steps that use Directional Direct Search (DDS), considering adequate poll directions, and a Spectral Projected Gradient (SPG) method, replacing the real gradient by a simplex gradient, under a DFO approach. In the SPG steps, if the convex feasible set is simple, then a direct projection is computed. If the feasible set is the intersection of finitely many convex simple sets, then Dykstra's alternating projection method is applied. Convergence properties are established under standard assumptions usually associated to DFO…

The max-out min-in problem: A tool for data analysis

Jorge Orestes Cerdeira, Maria João Martins, Marcos Raydan

Artificial Intelligence · Computers & Operations Research · · cited 2× · DOI ↗ · more like this ·

Consider a graph with vertex set V and non-negative weights on the edges. For every subset of vertices S, define ϕ(S) to be the sum of the weights of edges with one vertex in S and the other in V∖S, minus the sum of the weights of the edges with both vertices in S. We consider the problem of finding S⊆V for which ϕ(S) is maximized. We call this combinatorial optimization problem the max-out min-in problem (MOMIP). In this paper we (i) present a linear 0/1 formulation and a quadratic unconstrained binary optimization formulation for MOMIP; (ii) prove that the problem is NP-hard; (iii) report results of computational experiments on simulated data to compare the performances of the two models; (iv) illustrate the applicability of MOMIP for two different topics in the context of data analysis, namely in the selection of variables in exploratory data analysis and in the identification of…

Geometrical inverse preconditioning for symmetric positive definite matrices

Jean-Paul Chehab, Marcos Raydan

math.NA · · cited 2× · arXiv ↗ · more like this ·

We focus on inverse preconditioners based on minimizing $F(X) = 1-\cos(XA,I)$, where $XA$ is the preconditioned matrix and $A$ is symmetric and positive definite. We present and analyze gradient-type methods to minimize $F(X)$ on a suitable compact set. For that we use the geometrical properties of the non-polyhedral cone of symmetric and positive definite matrices, and also the special properties of $F(X)$ on the feasible set. Preliminary and encouraging numerical results are also presented in which dense and sparse approximations are included.