arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Timo Berthold

42 papers · 2008–2026

2008: 32009: 22010: 12011: 32012: 22013: 02014: 32015: 02016: 42017: 12018: 12019: 32020: 02021: 22022: 32023: 42024: 22025: 42026: 4
2008peak 4 in 20162026

Frequent co-authors

Papers

showing 1–25 of 42 RSS

Progress in Mathematical Programming Solvers from 2001 to 2020

Thorsten Koch, Timo Berthold, Jaap Pedersen +1 more

math.OC · · cited 113× · arXiv ↗ · more like this ·

This study investigates the progress made in LP and MILP solver performance during the last two decades by comparing the solver software from the beginning of the millennium with the codes available today. On average, we found out that for solving LP/MILP, computer hardware got about 20 times faster, and the algorithms improved by a factor of about nine for LP and around 50 for MILP, which gives a total speed-up of about 180 and 1,000 times, respectively. However, these numbers have a very high variance and they considerably underestimate the progress made on the algorithmic side: many problem instances can nowadays be solved within seconds, which the old codes are not able to solve within any reasonable time.

Heuristic algorithms in global MINLP solvers

Timo Berthold

Numerical Analysis · · cited 61× · OpenAlex ↗ · more like this ·

In the literature for mixed integer programming, heuristic algorithms (particularly primal heuristics) are often considered as stand-alone procedures; in that context, heuristics are treated as an alternative to solving a problem to proven optimality. This conceals the fact that heuristic algorithms are a fundamental component of state-of-the-art global solvers for mixed integer linear programming (MIP) and mixed integer nonlinear programming (MINLP). In the present thesis, we focus on this latter aspect; we study heuristic algorithms that are tightly integrated within global MINLP solvers and analyze their impact on the overall solution process. Our contributions comprise generalizations of primal heuristics for MIP towards MINLP as well as novel ideas for MINLP primal heuristics and for heuristic algorithms to take branching decisions and to collect global information in MIP. These…

Solving Open MIP Instances with ParaSCIP on Supercomputers Using up to 80,000 Cores

Yuji Shinano, Tobias Achterberg, Timo Berthold +3 more

Computational Theory and Mathematics · · cited 36× · DOI ↗ · more like this ·

This paper describes how we solved 12 previously unsolved mixed-integer programming (MIP) instances from the MIPLIB benchmark sets. To achieve these results we used an enhanced version of ParaSCIP, setting a new record for the largest scale MIP computation: up to 80,000 cores in parallel on the Titan supercomputer. In this paper we describe the basic parallelization mechanism of ParaSCIP, improvements of the dynamic load balancing and novel techniques to exploit the power of parallelization for MIP solving. We give a detailed overview of computing times and statistics for solving open MIPLIB instances.

Mixed Integer Programming Library version 5

Thorsten Koch, Tobias Achterberg, Erling Andersen +9 more

Numerical Analysis · · cited 36× · OpenAlex ↗ · more like this ·

This paper reports on the fifth version of the Mixed Integer Programming Library. The miplib 2010 is the first miplib release that has been assembled by a large group from academia and from industry, all of whom work in integer programming. There was mutual consent that the concept of the library had to be expanded in order to fulfill the needs of the community. The new version comprises 361 instances sorted into several groups. This includes the main benchmark test set of 87 instances, which

Solving mixed integer linear and nonlinear problems using the SCIP Optimization Suite

Timo Berthold, Gerald Gamrath, Ambros Gleixner +3 more

Computer Networks and Communications · · cited 28× · OpenAlex ↗ · more like this ·

This paper introduces the SCIP Optimization Suite and discusses the capabilities of its three components: the modeling language Zimpl, the linear programming solver SoPlex, and the constraint integer programming framework SCIP. We explain how these can be used in concert to model and solve challenging mixed integer linear and nonlinear optimization problems. SCIP is currently one of the fastest non-commercial MIP and MINLP solvers. We demonstrate the usage of Zimpl, SCIP, and SoPlex by selected examples, we give an overview of available interfaces, and outline plans for future development.

Parallelization of the FICO Xpress-Optimizer

Timo Berthold, James Farmer, Stefan Heinz +1 more

Hardware and Architecture · Optimization methods & software · · cited 20× · DOI ↗ · more like this ·

Computing hardware has mostly thrashed out the physical limits for speeding up individual computing cores. Consequently, the main line of progress for new hardware is growing the number of computing cores within a single CPU. This makes the study of efficient parallelization schemes for computation-intensive algorithms more and more important. A natural precondition to achieving reasonable speedups from parallelization is maintaining a high workload of the available computational resources. At the same time, reproducibility and reliability are key requirements for software that is used in industrial applications. In this paper, we present the new parallelization concept for the state-of-the-art MIP solver FICO Xpress-Optimizer. MIP solvers like Xpress are expected to be deterministic. This inevitably results in synchronization latencies which render the goal of a satisfying workload a…

Analyzing the computational impact of MIQCP solver components

Timo Berthold, Ambros Gleixner, Stefan Heinz +1 more

Numerical Analysis · Numerical Algebra Control and Optimization · · cited 19× · DOI ↗ · more like this ·

We provide a computational study of the performance of a state-of-the-art solver for nonconvex mixed-integer quadratically constrained programs (MIQCPs). Since successful general-purpose solvers for large problem classes necessarily comprise a variety of algorithmic techniques, we focus especially on the impact of the individual solver components. The solver SCIP used for the experiments implements a branch-and-cut algorithm based on a linear relaxation to solve MIQCPs to global optimality. Our analysis is based on a set of 86~publicly available test instances.

Rounding and Propagation Heuristics for Mixed Integer Programming

Gregor Hendel, Timo Berthold, Tobias Achterberg

Artificial Intelligence · · cited 16× · OpenAlex ↗ · more like this ·

Primal heuristics are an important component of state-of-the-art codes for mixed integer programming. In this paper, we focus on primal heuristics that only employ computationally inexpensive procedures such as rounding and logical deductions (propagation). We give an overview of eight different approaches. To assess the impact of these primal heuristics on the ability to find feasible solutions, in particular early during search, we introduce a new performance measure, the primal integral. Computational experiments evaluate this and other measures on MIPLIB~2010 benchmark instances.

The optimal rounding

Timo Berthold

Numerical Analysis · · cited 15× · OpenAlex ↗ · more like this ·

This article introduces rens ,t herelaxation enforced neighborhood search, a large neighborhood search algorithm for mixed integer nonlinear programs (MINLPs). It uses a sub-MINLP to explore the set of feasible roundings of an opti- mal solution ¯ x of a linear or nonlinear relaxation. The sub-MINLP is constructed by fixing integer variables x j with ¯ x j ∈ Z and bounding the remaining integer variables to x j ∈{ � ¯x j � , �¯ x j �} . We describe two different applications of rens: as a stand- alone algorithm to compute an optimal rounding of the given starting solution and as a primal heuristic inside a complete MINLP solver. We use the former to compare different kinds of relaxations and the impact of cutting planes on the so-called round- ability of the corresponding optimal solutions. We further utilize rens to analyze the performance of three rounding heuristics implemented in…

Solving Hard MIPLIB2003 Problems with ParaSCIP on Supercomputers: An Update

Yuji Shinano, Tobias Achterberg, Timo Berthold +3 more

Hardware and Architecture · · cited 13× · DOI ↗ · more like this ·

Contemporary supercomputers can easily provide years of CPU time per wall-clock hour. One challenge of today's software development is how to harness this vast computing power in order to solve really hard mixed-integer programming instances. In 2010, two out of six open MIPLIB2003 instances could be solved by ParaSCIP in more than ten consecutive runs, restarting from checkpointing files. The contribution of this paper is threefold: For the first time, we present computational results of single runs for those two instances. Secondly, we provide improved upper and lower bounds for all of the remaining four open MIPLIB2003 instances. Finally, we explain which new developments led to these results and discuss the current progress of ParaSCIP. Experiments were conducted on HLRN II, on HLRN III, and on the Titan supercomputer, using up to 35,200 cores.

ParaSCIP: A Parallel Extension of SCIP.

Yuji Shinano, Tobias Achterberg, Timo Berthold +2 more

Computer Networks and Communications · · cited 9× · OpenAlex ↗ · more like this ·

Mixed integer programming (MIP)has become one of the most important techniques in Operations Research and Discrete Optimization. SCIP (Solving Constraint Integer Programs) is currently one of the fastest non-commercial MIP solvers. It is based on the branchandboundprocedure in which the problem is recursively split into smaller subproblems, thereby creating a so-called branching tree. We present ParaSCIP, an extension of SCIP, which realizes a parallelization on a distributed memory computing environment. ParaSCIP uses SCIP solvers as independently running processes to solve subproblems (nodes of the branching tree) locally. This makes the parallelization development independent of the SCIP development. Thus, ParaSCIP directly profits from any algorithmic progress in future versions of SCIP. Using a first implementation of ParaSCIP, we were able to solve two previously unsolved…

ParaXpress: an experimental extension of the FICO Xpress-Optimizer to solve hard MIPs on supercomputers

Yuji Shinano, Timo Berthold, Stefan Heinz

Hardware and Architecture · Optimization methods & software · · cited 8× · DOI ↗ · more like this ·

The Ubiquity Generator (UG) is a general framework for the external parallelization of mixed integer programming (MIP) solvers. In this paper, we present ParaXpress, a distributed memory parallelization of the powerful commercial MIP solver FICO Xpress. Besides sheer performance, an important feature of Xpress is that it provides an internal parallelization for shared memory systems. When aiming for a best possible performance of ParaXpress on a supercomputer, the question arises how to balance the internal Xpress parallelization and the external parallelization by UG against each other. We provide computational experiments to address this question and we show computational results for running ParaXpress on a Top500 supercomputer, using up to 43,344 cores in parallel.

Parallel Solvers for Mixed Integer Linear Programming

Ted K. Ralphs, Yuji Shinano, Timo Berthold +1 more

Numerical Analysis · · cited 8× · OpenAlex ↗ · more like this ·

In this article, we introduce parallel mixed integer linear programming (MILP) solvers. MILP solving algorithms have been improved tremendously in the last two decades. Currently, commercial MILP solvers are known as a strong optimization tool. Parallel MILP solver development has started in 1990s. However, since the improvements of solving algorithms have much impact to solve MILP problems than application of parallel computing, there were not many visible successes. With the spread of multi-core CPUs, current state-of-the-art MILP solvers have parallel implementations and researches to apply parallelism in the solving algorithm also getting popular. We summarize current existing parallel MILP solver architectures.

UNDERCOVER - a primal heuristic for MINLP based on sub-MIPs generated by set covering

Timo Berthold, Ambros Gleixner

Numerical Analysis · · cited 8× · OpenAlex ↗ · more like this ·

We present Undercover, a primal heuristic for mixed-integer nonlinear programming (MINLP). The heuristic constructs a mixed-integer linear subproblem (sub-MIP) of a given MINLP by fixing a subset of the variables. We solve a set covering problem to identify a minimal set of variables which need to be fixed in order to linearise each constraint. Subsequently, these variables are fixed to approximate values, e.g. obtained from a linear outer approximation. The resulting sub-MIP is solved by a mixed-integer linear programming solver. Each feasible solution of the sub-MIP corresponds to a feasible solution of the original problem. Although general in nature, the heuristic seems most promising for mixed-integer quadratically constrained programmes (MIQCPs). We present computational results on a general test set of MIQCPs selected from the MINLPLib.

Solving Pseudo-Boolean Problems with SCIP

Timo Berthold, Stefan Heinz, Marc E. Pfetsch

Computational Theory and Mathematics · · cited 8× · OpenAlex ↗ · more like this ·

Pseudo-Boolean problems generalize SAT problems by allowing linear constraints and a linear objective function. Different solvers, mainly having their roots in the SAT domain, have been proposed and compared, for instance, in Pseudo-Boolean evaluations. One can also formulate Pseudo-Boolean models as integer programming models. That is, Pseudo-Boolean problems lie on the border between the SAT domain and the integer programming field. In this paper, we approach Pseudo-Boolean problems from the integer programming side. We introduce the framework scip that implements constraint integer programming techniques. It integrates methods from constraint programming, integer programming, and SAT-solving: the so-lution of linear programming relaxations, propagation of linear as well as nonlinear constraints, and conflict analysis. We argue that this approach is suitable for Pseudo-Boolean…

On the computational impact of MIQCP solver components

Timo Berthold, Ambros Gleixner, Stefan Heinz +1 more

Computational Theory and Mathematics · · cited 6× · OpenAlex ↗ · more like this ·

We provide a computational study of the performance of a state-of-the-art solver for nonconvex mixed-integer quadratically constrained programs (MIQCPs). Since successful general-purpose solvers for large problem classes necessarily comprise a variety of algorithmic techniques, we focus especially on the impact of the individual solver components. The solver SCIP used for the experiments implements a branch-and-cut algorithm based on linear outer approximation to solve MIQCPs to global optimality. Our analysis is based on a set of 86 publicly available test instances.

Learning To Scale Mixed-Integer Programs

Timo Berthold, Gregor Hendel

Numerical Analysis · Proceedings of the AAAI Conference on Artificial Intelligence · · cited 5× · DOI ↗ · more like this ·

Many practical applications require the solution of numerically challenging linear programs (LPs) and mixed integer programs (MIPs). Scaling is a widely used preconditioning technique that aims at reducing the error propagation of the involved linear systems, thereby improving the numerical behavior of the dual simplex algorithm and, consequently, LP-based branch-and-bound. A reliable scaling method often makes the difference whether these problems can be solved correctly or not. In this paper, we investigate the use of machine learning to choose at the beginning of the solution process between two common scaling methods: Standard scaling and Curtis-Reid scaling. The latter often, but not always, leads to a more robust solution process, but may suffer from longer solution times. Rather than training for overall solution time, we propose to use the attention level of a MIP solution…

Conflict Analysis for MINLP

Timo Berthold, Jakob Witzig

Numerical Analysis · INFORMS journal on computing · · cited 3× · DOI ↗ · more like this ·

The generalization of mixed integer program (MIP) techniques to deal with nonlinear, potentially nonconvex, constraints has been a fruitful direction of research for computational mixed integer nonlinear programs (MINLPs) in the last decade. In this paper, we follow that path in order to extend another essential subroutine of modern MIP solvers toward the case of nonlinear optimization: the analysis of infeasible subproblems for learning additional valid constraints. To this end, we derive two different strategies, geared toward two different solution approaches. These are using local dual proofs of infeasibility for LP-based branch-and-bound and the creation of nonlinear dual proofs for NLP-based branch-and-bound, respectively. We discuss implementation details of both approaches and present an extensive computational study, showing that both techniques can significantly enhance…

Extending SCIP for solving MIQCPs

Timo Berthold, Ambros Gleixner, Stefan Heinz +3 more

Numerical Analysis · · cited 2× · OpenAlex ↗ · more like this ·

⊲ reformulation for products with binary variables ⊲ recognition of convex quadratic functions ⊲ separation for convex and nonconvex quad. constraints ⊲ domain propagation for quadratic constraints ⊲ handling of second-order-cone (SOC) constraints ⊲ local search heuristic: fix integers, solve sub-QCP locally ⊲ interfaces to GAMS, MPS, and ZIMPL Relaxation Enforced Neighborhood Search heuristic [2]: fix integer variables that take integral value in optimal solution of LP relaxation and solve remaining sub-MIQCP Nonlinear RENS Heuristic construct (and solve) sub-MIP by fixing as few nonlinear variables as possible to their value in an optimal solution of the LP or NLP relaxation Undercover Heuristic [3]

Constraint Integer Programming: Techniques and Applications

Tobias Achterberg, Timo Berthold, Stefan Heinz +2 more

Computer Networks and Communications · · cited 2× · OpenAlex ↗ · more like this ·

This article introduces constraint integer programming (CIP), which is a novel way to combine constraint programming (CP) and mixed integer programming (MIP) methodologies. CIP is a generalization of MIP that supports the notion of general constraints as in CP. This approach is supported by the CIP framework SCIP, which also integrates techniques for solving satisfiability problems. SCIP is available in source code and free for noncommercial use. We demonstrate the usefulness of CIP on three tasks. First, we ap-ply the constraint integer programming approach to pure mixed integer programs. Computational experiments show that SCIP is almost com-petitive to current state-of-the-art commercial MIP solvers. Second, we demonstrate how to use CIP techniques to compute the number of opti-mal solutions of integer programs. Third, we employ the CIP framework to solve chip design verification…

Solving MINLPs to global optimality with FICO® Xpress global

Pietro Belotti, Timo Berthold, Tristan Gally +2 more

Numerical Analysis · Optimization · · cited 1× · DOI ↗ · more like this ·

We present the architecture and central parts of the FICO Xpress Global optimization solver. In particular, we focus on how we built a global solver for the general class of mixed-integer nonlinear optimization problems by combining and extending two existing components of the FICO Xpress Solver, namely the mixed-integer linear optimization solver and the successive linear approximation-based local solver for nonlinear optimization. We give a detailed report on the performance impact of each component: presolve, cutting, branching, heuristics, and parallelization.

Exploiting Dual Degeneracy in Branching

Timo Berthold, Gerald Gamrath, Domenico Salvagnin

Computational Theory and Mathematics · · cited 1× · OpenAlex ↗ · more like this ·

Branch-and-bound methods for mixed-integer programming (MIP) are traditionally based on solving a linear programming (LP) relaxation and branching on a variable which takes a fractional value in the (single) computed relaxation optimum. In this paper, we study branching strategies for mixed-integer programs that exploit the knowledge of multiple alternative optimal solutions (a cloud ) of the current LP relaxation. These strategies naturally extend common methods like most infeasible branching, strong branching, pseudocost branching, and their hybrids, but we also propose a novel branching rule called cloud diameter branching. We show that dual degeneracy, a requirement for alternative LP optima, is present for many instances from common MIP test sets. Computational experiments show significant improvements in the quality of branching decisions as well as reduced branching effort when…

Pivoting and Line Search Heuristics

Timo Berthold, Andrea Lodi, Domenico Salvagnin

Computer Vision and Pattern Recognition · Cambridge University Press eBooks · · cited 0× · DOI ↗ · more like this ·

This chapter discusses some primal heuristics that do not necessarily belong with the mainstream methods that have been implemented in the MIP solvers but are interesting either for historical reasons (first attempts of the MIP community to devise heuristic solutions within a general MIP scheme) or because they combine many of the ingredients that are at the core of this book.

Large Neighborhood Search

Timo Berthold, Andrea Lodi, Domenico Salvagnin

Signal Processing · Cambridge University Press eBooks · · cited 0× · DOI ↗ · more like this ·

This chapter concerns the vast family of large neighborhood search primal heuristics. These are local search heuristics that generally assume the knowledge of one or more feasible MIP solutions and explore "large" neighborhoods in the attempt to improve the incumbent, i.e., the best feasible solution computed so far by the MIP algorithm. A neighborhood is large if, in general, it cannot be explored by complete enumeration, so the various techniques developed for defining those neighborhoods and exploring them are discussed.

Computational Study

Timo Berthold, Andrea Lodi, Domenico Salvagnin

Statistics and Probability · Cambridge University Press eBooks · · cited 0× · DOI ↗ · more like this ·

The computational study presented in this chapter analyzes the impact of primal heuristics from different angles. This is done by investigating in which respect primal heuristics have an impact on the performance of a MIP solver, with respect to multiple performance measures.