Fictitious play (FP) is one of the earliest and most fundamental learning procedures in games, where each agent independently chooses a best response to the empirical distribution of opponents' past actions by maximizing the expected payoff with respect to it. However, learning agents may not always be expected-utility maximizers: they may use nonlinear evaluation functionals to account for the uncertainty induced by the opponents, e.g., via risk measures. In this work, we study nonlinear fictitious play (NL-FP), in which each pure action is evaluated by a general, possibly nonlinear functional of the payoff distribution induced by the opponent's empirical belief. To analyze NL-FP, we first identify a single-crossing property (SCP) of evaluation functionals that preserves the classical geometry of FP in $2\times2$ games. Furthermore, we conduct a novel geometric analysis of the…
Multi-horizon optimal control aims to select optimal control sequences simultaneously for several possible future scenarios, ensuring consistency at the first stage. While this enables advanced model predictive control schemes that explicitly handle prediction uncertainty, solving these problems tends to be costly. We introduce FanCyqlone, a linear solver that exploits parallelism across both time steps and scenario branches. The method builds on Cyqlone to compute the contribution of each branch and combines these results through a shared root problem. We integrate FanCyqlone into QPALM to develop FanCyQPALM, a solver for multi-horizon optimal control problems with general linear stage-wise constraints. We compare its performance with state-of-the-art solvers on spring-mass and quadruped control benchmarks.
This paper studies time-inconsistent linear-quadratic mean-field games governed by stochastic evolution equations in Hilbert spaces. The time inconsistency arises through the dependence of the cost functional on the initial time, while the mean-field interaction enters through the mean of the state distribution. By employing a multiperson differential game approach, we show that the closed-loop equilibrium strategy admits an affine feedback representation characterized by an operator-valued Riccati equation and a novel coupled forward-backward equilibrium system. We establish the existence and uniqueness of mild solutions to the equilibrium system and hence the existence of a closed-loop equilibrium strategy.
We link the solvability of backward stochastic differential equations with time-augmented Brownian signature data to the solvability of a differential equation on the tensor algebra of signature coefficients. We show that in certain cases the solutions are of closed form and remain within the class of linear functionals of the signature. Lastly, we derive a closed-form solution to a pricing and hedging problem in terms of the time-augmented Brownian signature.
We investigate when metric regularity of a subdifferential mapping rules out multiple local inverse branches and therefore upgrades to strong metric regularity. Let $h:\mathbb{R}^n\to(-\infty,\infty]$ be proper, lower semicontinuous, definable, prox-regular, and subdifferentially continuous at $(\bar x,\bar v)\in\operatorname{gph}(\partial h)$. We characterize this ``upgrade'' through the second subderivative $q = \mathrm{d}^2h(\bar x|\bar v)$ of $h$. If $\partial h$ is metrically regular, then it is strongly metrically regular if and only if the set of negative curvature directions of $q$ on the unit sphere of $\operatorname{span}(\operatorname{dom}(q))$ has Euler characteristic $0$ or $2$. We also prove a simpler and directly verifiable sufficient condition: nonnegativity of $q$ on the lineality space $\operatorname{dom}(q)\cap(-\operatorname{dom}(q))$ forces a quadratic lower bound…
We study data poisoning attacks on logistic regression with $\ell_2$-regularization, where an attacker chooses the features of a fixed number of injected observations with prescribed labels to maximize the logistic loss on the clean training data. Strong convexity of the defender's problem yields an exact reformulation through its first-order optimality conditions. Using convex conjugacy of the softplus function, we replace the sigmoid relations by a single convex optimality-gap inequality and express the attacker's objective as a concave function. A change of variables makes the stationarity condition affine, leaving bounded bilinear equalities as the only nonconvex constraints. We derive finite bounds on all variables involved in these equalities, including a global bound on the coefficient norm and tighter bounds obtained by preprocessing based on convex optimization. Experiments on…
This paper proposes an adaptive constraint-sampling technique for stochastic gradient-based methods to efficiently solve constrained optimization problems with a large number of inequality constraints. The proposed constraint-sampling technique maintains a set of recently violated constraints and draws the constraint used in each iteration uniformly either from this set or from the set of all constraints. This keeps its per-iteration arithmetic overhead independent of the number of constraints. In simulations on synthetic convex optimization problems and in the synthesis of a control barrier function for the Dubins Car, the constraint-sampling technique is shown to significantly outperform uniform constraint sampling.
Accelerated transformed primal--dual (ATPD) methods are proposed for smooth convex optimization problems with affine equality constraints. The methods combine primal--dual dynamics with a transformation designed to accelerate convergence. In the strongly convex case, ATPD achieves an accelerated linear convergence rate and matches the known lower bounds on first-order oracle complexity in terms of gradient evaluations and matrix--vector products. The analysis distinguishes these two types of computational work when assessing the complexity of the method. For general convex objectives, a homotopy perturbation strategy is introduced, and an accelerated sublinear rate for the modified Lyapunov energy is proved under a uniform boundedness condition on the primal iterates at all homotopy stages. The acceleration mechanism is based on an exponentially stable ATPD flow and a modified discrete…
In this work we propose BLDS-SIMPLEX, a derivative-free direct search method for the solution of bilevel optimization with polytope constraints at the upper level. The proposed method reformulates the feasible set using barycentric coordinates and explores it using Frank-Wolfe-type directions, relying on a fixed-accuracy black-box oracle for the upper-level objective function. We analyze its convergence properties and complexity in the case of smooth reduced objective; additionally, we analyze a variant for the case of nonsmooth objectives and show its convergence to a specific kind of stationary point that we introduce as a natural generalization to the classic stationarity notions in this setting. Numerical tests on modified instances from BOLIB support the viability of our new approach.
In this paper, we develop a hierarchical control framework for nonlinear dynamical systems with safety constraints. Specifically, a low-fidelity model is introduced for trajectory planning, while a tracking controller is designed for the high-fidelity system. We first characterize the tracking error bound (TEB) using a storage function. Then, we formulate the synthesis of the tracking controller, the storage function, and the TEB as an optimization problem. Following that, we develop an offline learning approach to approximately solve the optimization problem, by incorporating behavior cloning and satisfiability modulo theories (SMT) solver. We further integrate the learned controller and the TEB into online tracking of the high-fidelity system. This framework enables the control of high-dimensional nonlinear systems with safety guarantees, while maintaining computational efficiency for…
We formulate and numerically study the problem of finding the minimum energy required to trigger a spike in a three-dimensional conductance-based excitable model. The variational formulation seeks a state trajectory that reaches the boundary of the spiking region with the least \textit{peak} cumulative work supplied through the membrane port. We approximate voltage histories by sums of real exponentials, reducing the problem to a finite-dimensional optimization. The best-found voltage waveform consists of a hyperpolarization phase followed by a depolarization phase, which seems to match the experimentally determined optimal stimulus in squid giant axons.
A method is presented for margin-inducing optimal guidance and control with application to atmospheric entry. The method induces margin in state inequality path constraints during entry while simultaneously retaining a large portion of the non-margin-inducing performance. The margin in the guidance trajectory is based on a differentiable approximation of the maximum of a continuous function. This differentiable approximation is derived from the Kreisselmeier-Steinhauser (KS) function, where the KS function is defined for a function over sampled data. The KS function is first modified into a weighted form where the data points and weights are associated with a multiple-interval Legendre-Gauss-Radau quadrature. This weighted form is then shown to be an approximation of a logarithmic integral. This smooth approximation of the maximum function is then used to formulate a margin-inducing…
We establish the first nontrivial upper bound on the number of edges of a Gomory corner polyhedron, resolving a long-standing open question. For an $n$-dimensional corner polyhedron associated with an integer lattice of determinant $δ$, the number of edges is at most $$ O\left(n6^n \cdot \bigl(1+\log_2(2δ)\bigr)^{2n-3}\right). $$ This improves the standard bound obtained by counting pairs of vertices, reducing the logarithmic exponent from $(2n-2)$ to $(2n-3)$.
This paper was inspired by a post on Twitter and by the eight months the author spent at the AASS Centre at Orebro University in 2007. This phenomenon is interesting not only to a physicist, but also to someone like me working in control theory, because of its potential relevance to stabilizing drones and similar flying machines subject to random velocity fluctuations while hovering. A chain fountain can settle without an engineered controller, yet its natural height is selected by transport and boundary forces. We ask how an ideal boundary traction force can sustain a prescribed height or motion. Within an established three-state model, we connect feedback design to force and energy balances and derive sufficient conditions for nominal tracking that preserve the model's mechanical constraints. We also bound the deviations caused by bounded pickup uncertainty. The resulting framework…
Online advertising is a central marketing lever for e-commerce retailers, yet it complicates operational planning by simultaneously stimulating product demand and increasing product returns. Motivated by the practice of a fashion retailer on Amazon, we study a retailer's joint inventory and advertising problem across multiple products over a single season, in which advertising has both direct and cross-product spillover effects on demand and returns. Using linear net-demand and return models that capture both effects, we formulate a contextual stochastic optimization model that jointly determines inventory levels and advertising decisions before the selling season. Because ad clicks are realized only after the advertising decision, the predictive covariates are partially observable and decision-dependent, and their joint distribution with the demand and return errors is unknown. We…
We propose an online method for choosing both a blood pressure target and a norepinephrine dose for an individual surgical patient. From a short record of mean arterial pressure (MAP) and norepinephrine delivery, the method fits a reduced pharmacokinetic/pharmacodynamic model and uses a local Gaussian approximation to propagate uncertainty to future MAP readings. It searches for the lowest target for which a bolus and constant infusion keep the predicted probability of at least one MAP reading below 65 mmHg after the rise phase within a prescribed limit. If no such target is found, the decision returns to the clinician. We assess calibration of the predicted minimum MAP on retrospective surgical records under the doses actually administered. In a cohort of 4,096 virtual patients, the method recommended a dose for 74 % of patients at a nominal risk of 5 %. Among the patients receiving a…
We study inequalities between symmetric functions that hold in every number of variables. First, we prove that it is undecidable whether a symmetric function with rational coefficients is nonnegative in all dimensions, answering a question posed by Acevedo, Blekherman, Debus and Riener. As a consequence, the validity of dimension-free moment criteria for entanglement in quantum information is undecidable. Second, we present a homogeneous symmetric function of degree 8 which is positive definite in every dimension but admits no sum of squares multiplier that is uniform in the number of variables. Consequently, Artin's solution of Hilbert's 17th problem and the Krivine-Stengle Positivstellensatz have no any-dimensional analog and any-dimensional Positivstellensätze asked for by Levin and Chandrasekaran cannot hold in general.
Dynamic time-to-collision (TTC) is the first contact time of a prediction flow and defines a feedback map implicitly. We study its capped value function $\VV$ for Carathéodory dynamics with bounded, measurable forcing. A self-contained argument establishes local Lipschitz continuity on the transversal collision domain. A derivative-free stopped-step Bellman equation then characterizes $\VV$ uniquely: it advances the prediction for a fixed duration or until contact and adds the elapsed time. A two-sided error bound uses only the candidate's residual along complete stopped trajectories and its error at their endpoints. Exact continuum iteration recovers $\VV$ after finitely many sweeps, including one additional sweep for initializations that violate the boundary condition. We also characterize an optional-duration infimum operator: its fixed points are the dynamic-programming…
We study optimization of an average of \(n\) functions when gradient predictions are exact except for at most \(k\) unknown components. An initial scan may miss these exceptions. For a class of smooth problems, we prove that the optimal worst-case expected number of component-gradient evaluations needed to find an approximate stationary point is \[ Θ\!\left(\min\left\{nk+\mathcal R,\frac nk\mathcal R\right\}\right), \] where \(\mathcal R\) represents the optimal cost when the exceptional components are known. Prediction evaluations are free. This bound shows that discovering even a few exceptions can cost more than one full scan and can account for most of the gradient evaluations.
Despite the remarkable progress of deep learning in image processing, variational methods remain a fundamental and actively developing framework, offering interpretability, mathematical rigor, and well-founded guarantees. In this work, we introduce a weighted second-order nonlocal total variation regularizer for image restoration, which is based on measuring gradient differences across the image domain and allows for weights that are neither smooth nor symmetric and may vanish outside a search window. We first provide a rigorous definition of the regularizer and prove that it enjoys several desirable properties under realistic assumptions on the underlying weight function. We then consider a nonlocal variant of the variational image restoration model of Chambolle and Lions, and prove the existence and uniqueness of solutions to the associated minimization problem. On the computational…
We study how to combine three One Health interventions against antimicrobial resistance: prescription-only dispensing of antibiotics to people, access to veterinary care for animals, and treatment of household sludge and manure. Each household is a Markov chain on the carriage states of its people, animals and soil, and households are linked through the community, whose prevalence feeds the acquisition rates. We prove that, as the number of households grows, the distribution of household states converges to the solution of a nonlinear mean-field equation. This system is monotone for the stochastic order, so that no intervention increases carriage anywhere, and for every constant intervention it has exactly one equilibrium, which attracts all solutions and is given by a scalar equation. For the optimal control problem we prove existence, necessary conditions, positivity of all controls…
We study an optimal control problem aimed at enhancing mixing in anisotropic electrolytes described by an instationary Stokes-Nernst-Planck-Poisson system in three space dimensions, where the anisotropy is encoded by a given director field in the diffusion and permittivity matrices. The control is the external electric potential entering through the Robin boundary condition of the Poisson equation. The cost functional combines tracking-type terms for the charge concentrations and an $L^2$-regularization of the control with a negative vorticity term that favors rotational flow. Assuming that the diffusion and permittivity matrices coincide, we first prove existence and uniqueness of weak solutions with nonnegative, essentially bounded concentrations, together with Lipschitz continuous dependence on the control. Since, through the negative vorticity term, the cost functional is no longer…
Mixed-integer programming (MIP) solver runtimes vary substantially across random seeds. Parallel replication exploits this variability but can waste computational resources when applied indiscriminately. We investigate whether information from an ordinary solve can guide this allocation decision. We formulate replication under a finite deadline, establish an exact relationship between runtime dispersion and the value of independent searches, and analyze delayed replication and imperfect allocation decisions. Using 101,615 seeded SCIP runs, we examine the association between root-LP dual degeneracy and replication value. We then introduce a non-invasive root-gated policy that preserves the original solver trajectory and launches three additional seeded processes when a root dual-degeneracy indicator reaches a fixed threshold. In a prospective two-hour experiment on 130 paired instances…
Simplified swarm optimisation (SSO) updates each variable by one draw that copies the global or personal best, keeps the current value or redraws uniformly, with probabilities $c_g$, $c_p$, $c_w$ and $c_r$. As a finite Markov chain under frozen memory, its coordinate kernel $c_w I + (1 - c_w)Π$ has an explicit stationary law and exact convergence rate $c_w^t$. The elitist chain has a geometric hitting-time bound, from a non-optimal start a fixed $c_r$ needs at least $\exp(nc_r/2)$ expected evaluations to reach a unique optimum, and a coupling under changing memories gives $O(n\log n)$ and $O(n^2)$ expected generations on OneMax and LeadingOnes for every population size with redraw share of order $1/n$ and no inertia, and within a $\log n$ factor for fixed inertia. With a frozen memory, inertia cannot speed up first entry into any set from stationary positions, though it can from others.…
This paper studies differential two-stage stochastic linear complementarity problems, in which an ordinary differential equation (ODE) is coupled with a two-stage stochastic linear complementarity problem (SLCP) under a time-dependent probability distribution. The right-hand side of the ODE involves a solution pair (here-and-now and wait-and-see decisions) of the two-stage SLCP, while the two-stage SLCP involves two functions depending on the time $t$ and the state $x(t)$ of the ODE. Under appropriate conditions, we prove that the solution function of the two-stage SLCP is Lipschitz continuous in $x(t)$ and locally $\frac{1}{2}$-Hölder continuous in $t$, and establish the existence and uniqueness of a classical solution to the differential two-stage SLCP. Moreover, we develop a discrete approximation scheme for the differential two-stage SLCP. We first use a finite-scenario partition…