arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Steven Diamond

31 papers · 2002–2026

2002: 12003: 02004: 02005: 02006: 02007: 02008: 02009: 22010: 02011: 12012: 12013: 02014: 12015: 22016: 62017: 52018: 32019: 12020: 12021: 12022: 22023: 12024: 02025: 22026: 1
2002peak 6 in 20162026

Frequent co-authors

Papers

showing 1–25 of 31 RSS

CVXPY: A Python-Embedded Modeling Language for Convex Optimization

Steven Diamond, Stephen Boyd

math.OC · · cited 3,272× · arXiv ↗ · more like this ·

CVXPY is a domain-specific language for convex optimization embedded in Python. It allows the user to express convex optimization problems in a natural syntax that follows the math, rather than in the restrictive standard form required by solvers. CVXPY makes it easy to combine convex optimization with high-level features of Python such as parallelism and object-oriented design. CVXPY is available at http://www.cvxpy.org/ under the GPL license, along with documentation and examples.

Differentiable Convex Optimization Layers

Akshay Agrawal, Brandon Amos, Shane Barratt +3 more

cs.LG · · cited 963× · arXiv ↗ · more like this ·

Recent work has shown how to embed differentiable optimization problems (that is, problems whose solutions can be backpropagated through) as layers within deep learning architectures. This method provides a useful inductive bias for certain problems, but existing software for differentiable optimization layers is rigid and difficult to apply to new settings. In this paper, we propose an approach to differentiating through disciplined convex programs, a subclass of convex optimization problems used by domain-specific languages (DSLs) for convex optimization. We introduce disciplined parametrized programming, a subset of disciplined convex programming, and we show that every disciplined parametrized program can be represented as the composition of an affine map from parameters to problem data, a solver, and an affine map from the solver's solution to a solution of the original problem (a…

A Rewriting System for Convex Optimization Problems

Akshay Agrawal, Robin Verschueren, Steven Diamond +1 more

math.OC · · cited 856× · arXiv ↗ · more like this ·

We describe a modular rewriting system for translating optimization problems written in a domain-specific language to forms compatible with low-level solver interfaces. Translation is facilitated by reductions, which accept a category of problems and transform instances of that category to equivalent instances of another category. Our system proceeds in two key phases: analysis, in which we attempt to find a suitable solver for a supplied problem, and canonicalization, in which we rewrite the problem in the selected solver's standard form. We implement the described system in version 1.0 of CVXPY, a domain-specific language for mathematical and especially convex optimization. By treating reductions as first-class objects, our method makes it easy to match problems to solvers well-suited for them and to support solvers with a wide variety of standard forms.

Convex Optimization in Julia

Madeleine Udell, Karanveer Mohan, David Zeng +3 more

math.OC · · cited 181× · arXiv ↗ · more like this ·

This paper describes Convex, a convex optimization modeling framework in Julia. Convex translates problems from a user-friendly functional language into an abstract syntax tree describing the problem. This concise representation of the global structure of the problem allows Convex to infer whether the problem complies with the rules of disciplined convex programming (DCP), and to pass the problem to a suitable solver. These operations are carried out in Julia using multiple dispatch, which dramatically reduces the time required to verify DCP compliance and to parse a problem into conic form. Convex then automatically chooses an appropriate backend solver to solve the conic form problem.

Dirty Pixels: Towards End-to-End Image Processing and Perception

Steven Diamond, Vincent Sitzmann, Frank Julca-Aguilar +3 more

cs.CV · · cited 79× · arXiv ↗ · more like this ·

Real-world imaging systems acquire measurements that are degraded by noise, optical aberrations, and other imperfections that make image processing for human viewing and higher-level perception tasks challenging. Conventional cameras address this problem by compartmentalizing imaging from high-level task processing. As such, conventional imaging involves processing the RAW sensor measurements in a sequential pipeline of steps, such as demosaicking, denoising, deblurring, tone-mapping and compression. This pipeline is optimized to obtain a visually pleasing image. High-level processing, on the other hand, involves steps such as feature extraction, classification, tracking, and fusion. While this siloed design approach allows for efficient development, it also dictates compartmentalized performance metrics, without knowledge of the higher-level task of the camera system. For example…

Disciplined Multi-Convex Programming

Xinyue Shen, Steven Diamond, Madeleine Udell +2 more

math.OC · · cited 65× · arXiv ↗ · more like this ·

A multi-convex optimization problem is one in which the variables can be partitioned into sets over which the problem is convex when the other variables are fixed. Multi-convex problems are generally solved approximately using variations on alternating or cyclic minimization. Multi-convex problems arise in many applications, such as nonnegative matrix factorization, generalized low rank models, and structured control synthesis, to name just a few. In most applications to date the multi-convexity is simple to verify by hand. In this paper we study the automatic detection and verification of multi-convexity using the ideas of disciplined convex programming. We describe an implementation of our proposed method that detects and verifies multi-convexity, and then invokes one of the general solution methods.

A General System for Heuristic Solution of Convex Problems over Nonconvex Sets

Steven Diamond, Reza Takapoui, Stephen Boyd

math.OC · · cited 31× · arXiv ↗ · more like this ·

We describe general heuristics to approximately solve a wide variety of problems with convex objective and decision variables from a nonconvex set. The heuristics, which employ convex relaxations, convex restrictions, local neighbor search methods, and the alternating direction method of multipliers (ADMM), require the solution of a modest number of convex problems, and are meant to apply to general problems, without much tuning. We describe an implementation of these methods in a package called NCVX, as an extension of CVXPY, a Python package for formulating and solving convex optimization problems. We study several examples of well known nonconvex problems, and show that our general purpose heuristics are effective in finding approximate solutions to a wide variety of problems.

Ingroup identification as a moderator of racial bias in a shoot–no shoot decision task

Jared B. Kenworthy, Melisa A. Barden, Steven Diamond +1 more

Sociology and Political Science · Group Processes & Intergroup Relations · · cited 28× · DOI ↗ · more like this ·

In this experiment, group identification is examined as a potential moderator of the documented racial bias in a shoot–no shoot paradigm. Target race (Black or White) was manipulated within-subjects, and (White) participants’ strength of racial ingroup identification was employed as a continuous predictor. Using signal detection analyses, it was found that the criterion to shoot Black targets decreased as an increasing function of racial ingroup identification. This relationship held even after controlling for gender, social dominance orientation, a measure of cultural stereotyping, and the amount of contact with Blacks. Theoretical implications are discussed.

Embedded Code Generation with CVXPY

Maximilian Schaller, Goran Banjac, Steven Diamond +3 more

math.OC · · cited 22× · arXiv ↗ · more like this ·

We introduce CVXPYgen, a tool for generating custom C code, suitable for embedded applications, that solves a parametrized class of convex optimization problems. CVXPYgen is based on CVXPY, a Python-embedded domain-specific language that supports a natural syntax (that follows the mathematical description) for specifying convex optimization problems. Along with the C implementation of a custom solver, CVXPYgen creates a Python wrapper for prototyping and desktop (non-embedded) applications. We give two examples, position control of a quadcopter and back-testing a portfolio optimization model. CVXPYgen outperforms a state-of-the-art code generation tool in terms of problem size it can handle, binary code size, and solve times. CVXPYgen and the generated solvers are open-source.

Automatically Providing Action Plans Helps People Complete Tasks

Nicolas Kokkalis, Johannes Huebner, Steven Diamond +6 more

Computer Science Applications · National Conference on Artificial Intelligence · · cited 4× · OpenAlex ↗ · more like this ·

People complete tasks more quickly when they have con-crete plans, especially for open-ended, creative tasks. How-ever, people often fail to create such action plans. (How) can systems provide people with these concrete steps auto-matically? To scalably provide personalized action plans, this paper introduces and evaluates crowdsourcing and peer approaches for creating plans, and NLP techniques for reus-ing them. We evaluated the effects of action plans on differ-ent types of tasks. A between-subjects experiment found that people who received crowd-created plans completed more tasks than people asked to self-create plans and than a control group without action plans. We found that crowd-created action plans are especially effective for lingering and high-level tasks. A second experiment found that peer-provided plans led to more completed tasks than no plans. A third experiment found…

A New Architecture for Optimization Modeling Frameworks

Matt Wytock, Steven Diamond, Felix Heide +1 more

math.OC · · cited 3× · arXiv ↗ · more like this ·

We propose a new architecture for optimization modeling frameworks in which solvers are expressed as computation graphs in a framework like TensorFlow rather than as standalone programs built on a low-level linear algebra interface. Our new architecture makes it easy for modeling frameworks to support high performance computational platforms like GPUs and distributed clusters, as well as to generate solvers specialized to individual problems. Our approach is particularly well adapted to first-order and indirect optimization algorithms. We introduce cvxflow, an open-source convex optimization modeling framework in Python based on the ideas in this paper, and show that it outperforms the state of the art.

Disciplined Geometric Programming

Akshay Agrawal, Steven Diamond, Stephen Boyd

math.OC · · cited 1× · arXiv ↗ · more like this ·

We introduce log-log convex programs, which are optimization problems with positive variables that become convex when the variables, objective functions, and constraint functions are replaced with their logs, which we refer to as a log-log transformation. This class of problems generalizes traditional geometric programming and generalized geometric programming, and it includes interesting problems involving nonnegative matrices. We give examples of log-log convex functions, some well-known and some less so, and we develop an analog of disciplined convex programming, which we call disciplined geometric programming. Disciplined geometric programming is a subclass of log-log convex programming generated by a composition rule and a set of functions with known curvature under the log-log transformation. Finally, we describe an implementation of disciplined geometric programming as a…

Log-Linear Reaction Quotient Dynamics

Steven Diamond

math.OC · · cited 0× · arXiv ↗ · more like this ·

Chemical reaction networks in living cells maintain precise control over thousands of metabolites despite operating far from equilibrium under constant perturbations. While mass action kinetics accurately describe the underlying dynamics, the resulting nonlinear differential equations are difficult to analyze and control, particularly for large networks. We propose a simplified model where reaction quotients (the ratios that measure how far reactions are from equilibrium) evolve exponentially toward their equilibrium values when viewed on a logarithmic scale. This principle leads to linear dynamics in log-space, providing several key advantages: analytical solutions exist for arbitrary network topologies, thermodynamic constraints are automatically satisfied through the relationship between reaction quotients and Gibbs free energy, conservation laws decouple from reaction quotient…

An Operator Splitting Method for Large-Scale CVaR-Constrained Quadratic Programs

Eric Luxenberg, David Pérez-Piñeiro, Steven Diamond +1 more

math.OC · · cited 0× · arXiv ↗ · more like this ·

We introduce a fast and scalable method for solving quadratic programs with conditional value-at-risk (CVaR) constraints. While these problems can be formulated as standard quadratic programs, the number of variables and constraints grows linearly with the number of scenarios, making general-purpose solvers impractical for large-scale problems. Our method combines operator splitting with a specialized $O(m\log m)$ algorithm for projecting onto CVaR constraints, where $m$ is the number of scenarios. The method alternates between solving a linear system and performing parallel projections, onto CVaR constraints using our specialized algorithm and onto box constraints by simple clipping. Numerical examples from several application domains demonstrate that our method outperforms general-purpose solvers by several orders of magnitude on problems with up to millions of scenarios. Our method…

Practical Applications of Optimal Claiming of Social Security Benefits

Steven Diamond, Stephen Boyd, David A. Greenberg +2 more

Demography · Practical Applications · · cited 0× · DOI ↗ · more like this ·

In <ext-link><bold><italic>Optimal Claiming of Social Security Benefits</italic></bold></ext-link>, from the Winter 2023 issue of <bold><italic>The Journal of Retirement</italic></bold>, authors <bold>Steven Diamond</bold> of <bold>Gridmatic</bold>, <bold>Stephen Boyd</bold> and <bold>Mykel Kochenderfer</bold> of <bold>Stanford University</bold>, <bold>Andrew Ang</bold> of <bold>BlackRock</bold> and <bold>David Greenberg</bold> show that when an individual’s wealth is above a certain threshold, they should defer claiming Social Security. Using a life-cycle framework, the authors compute wealth to primary insurance amount (PIA) ratios and provide thresholds to aid in this decision-making process (the PIA is the monthly benefit one would receive at full retirement age). The authors explain how an individual’s monthly Social Security benefit payment amount is based, in part, on the age at…

Log-Linear Dynamical Systems

Steven Diamond

math.OC · · cited 0× · arXiv ↗ · more like this ·

We present log-linear dynamical systems, a dynamical system model for positive quantities. We explain the connection to linear dynamical systems and show how convex optimization can be used to identify and control log-linear dynamical systems. We illustrate system identification and control with an example from predator-prey dynamics. We conclude by discussing potential applications of the proposed model.

Network Optimization for Unified Packet and Circuit Switched Networks

Ping Yin, Steven Diamond, Bill Lin +1 more

cs.NI · · cited 0× · arXiv ↗ · more like this ·

Internet traffic continues to grow relentlessly, driven largely by increasingly high resolution video content. Although studies have shown that the majority of packets processed by Internet routers are pass-through traffic, they nonetheless have to be queued and routed at every hop in current networks, which unnecessarily adds substantial delays and processing costs. Such pass-through traffic can be better circuit-switched through the underlying optical transport network by means of pre-established circuits, which is possible in a unified packet and circuit switched network. In this paper, we propose a novel convex optimization framework based on a new destination-based multicommodity flow formulation for the allocation of circuits in such unified networks. In particular, we consider two deployment settings, one based on real-time traffic monitoring, and the other relying upon…

Matrix-Free Convex Optimization Modeling

Steven Diamond, Stephen Boyd

math.OC · · cited 0× · arXiv ↗ · more like this ·

We introduce a convex optimization modeling framework that transforms a convex optimization problem expressed in a form natural and convenient for the user into an equivalent cone program in a way that preserves fast linear transforms in the original problem. By representing linear functions in the transformation process not as matrices, but as graphs that encode composition of linear operators, we arrive at a matrix-free cone program, i.e., one whose data matrix is represented by a linear operator and its adjoint. This cone program can then be solved by a matrix-free cone solver. By combining the matrix-free modeling framework and cone solver, we obtain a general method for efficiently solving convex optimization problems involving fast linear transforms.

The Eighteenth Amendment

Steven Diamond

Political Science and International Relations · · cited 0× · OpenAlex ↗ · more like this ·

The U.S. Constitution established a federated republic in the United States, which was structured according to a separation of powers—executive, legislative, and judicial—each with its own specific duties and powers. In more than 700 entries, Encyclopedia of the United States Constitution contains all the material high school students need to understand the United States Constitution. This two-volume A-to-Z set covers the people, court cases, historical events, and terms relating to one of the most studied political documents in schools across the country. Appendix material includes the U.S. Constitution and other government documents.

The Twenty-First Amendment

Steven Diamond

Sociology and Political Science · · cited 0× · OpenAlex ↗ · more like this ·

The U.S. Constitution established a federated republic in the United States, which was structured according to a separation of powers—executive, legislative, and judicial—each with its own specific duties and powers. In more than 700 entries, Encyclopedia of the United States Constitution contains all the material high school students need to understand the United States Constitution. This two-volume A-to-Z set covers the people, court cases, historical events, and terms relating to one of the most studied political documents in schools across the country. Appendix material includes the U.S. Constitution and other government documents.

Efficiency and Benevolence: Philantropic Tax Exemption in 19th Century America

Steven Diamond

Political Science and International Relations · · cited 0× · OpenAlex ↗ · more like this ·

If "all politics is local," then no tax issue is more political than the property tax. This explains the battles that are being fought countrywide over the exemption enjoyed by nonprofit organizations. Property taxes fall on local populations, while the benefits of a charity's activities can be spread more broadly. And as property-owning charities such as hospitals, universities, and cultural institutions have transformed themselves into big businesses, the exemption has come to be viewed as a subsidy granted by government. Recently, opposition from revenue-starved local governments has mounted, in the form of frontal attacks on the charity exemption and demands for payments in lieu of taxes. This collection of essays seeks to put the debate in larger context. The editors have brought together authors from a range of disciplines to explore what we know about the property tax exemption.…

CVXPY 1.9: Recent Advances in Optimization Modeling Software

William Zhang, Parth Nobel, Aryaman Jeendgar +3 more

math.OC · · arXiv ↗ · more like this ·

CVXPY is a Python-embedded domain-specific language for convex optimization that lets users express problems in mathematical notation while the system verifies convexity and reduces valid programs to solver-ready form. This paper reports on the major advances from versions 1.1 through 1.9. These include a unified conic quadratic program (CQP) standard form for canonicalization; a stacked-slices backend that accelerates parameterized programs; first-class support for N-dimensional expressions; explicit sparsity for variables; support for multiple variable attributes; cones/atoms relevant to quantum information theory; and the introduction of disciplined nonlinear programming (DNLP). We outline the design, algorithms, and modeling consequences of these features.

Strategic Asset Allocation with Illiquid Alternatives

Eric Luxenberg, Stephen Boyd, Mykel Kochenderfer +6 more

math.OC · · arXiv ↗ · more like this ·

We address the problem of strategic asset allocation (SAA) with portfolios that include illiquid alternative asset classes. The main challenge in portfolio construction with illiquid asset classes is that we do not have direct control over our positions, as we do in liquid asset classes. Instead we can only make commitments; the position builds up over time as capital calls come in, and reduces over time as distributions occur, neither of which the investor has direct control over. The effect on positions of our commitments is subject to a delay, typically of a few years, and is also unknown or stochastic. A further challenge is the requirement that we can meet the capital calls, with very high probability, with our liquid assets. We formulate the illiquid dynamics as a random linear system, and propose a convex optimization based model predictive control (MPC) policy for allocating…

Optimal Claiming of Social Security Benefits

Steven Diamond, Stephen Boyd, David Greenberg +2 more

physics.soc-ph · · arXiv ↗ · more like this ·

Using a lifecycle framework with Epstein-Zin (1989) utility and a mixed-integer optimization approach, we compute the optimal age to claim Social Security benefits. Taking advantage of homogeneity, a sufficient statistic is the ratio of wealth to the primary insurance amount (PIA). If the investor's wealth to PIA ratio exceeds a certain threshold, individuals should defer Social Security for at least a year. The optimal threshold depends on mortality assumptions and an individual's utility preferences, but is less sensitive to capital market assumptions. The threshold wealth to PIA ratio increases from 5.5 for men and 5.2 for women at age 62 to 11.1 for men and 10.4 for women at age 69. Below the threshold wealth to PIA ratio, individuals claim Social Security to raise consumption. Above this level, investors can afford to fund consumption out of wealth for at least one year, and then…

Sub-picosecond photon-efficient 3D imaging using single-photon sensors

Felix Heide, Steven Diamond, David B. Lindell +1 more

physics.app-ph · · arXiv ↗ · more like this ·

Active 3D imaging systems have broad applications across disciplines, including biological imaging, remote sensing and robotics. Applications in these domains require fast acquisition times, high timing resolution, and high detection sensitivity. Single-photon avalanche diodes (SPADs) have emerged as one of the most promising detector technologies to achieve all of these requirements. However, these detectors are plagued by measurement distortions known as pileup, which fundamentally limit their precision. In this work, we develop a probabilistic image formation model that accurately models pileup. We devise inverse methods to efficiently and robustly estimate scene depth and reflectance from recorded photon counts using the proposed model along with statistical priors. With this algorithm, we not only demonstrate improvements to timing accuracy by more than an order of magnitude…