arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Nicholas Smallbone

27 papers · 2009–2026

2009: 22010: 02011: 12012: 22013: 02014: 22015: 02016: 32017: 12018: 32019: 42020: 12021: 42022: 02023: 02024: 22025: 12026: 1
2009peak 4 in 20192026

Frequent co-authors

Papers

showing 1–25 of 27 RSS

Encoding Monomorphic and Polymorphic Types

Jasmin Christian Blanchette, Sascha Böhme, Andrei Popescu +1 more

cs.LO · · cited 73× · arXiv ↗ · more like this ·

Many automatic theorem provers are restricted to untyped logics, and existing translations from typed logics are bulky or unsound. Recent research proposes monotonicity as a means to remove some clutter when translating monomorphic to untyped first-order logic. Here we pursue this approach systematically, analysing formally a variety of encodings that further improve on efficiency while retaining soundness and completeness. We extend the approach to rank-1 polymorphism and present alternative schemes that lighten the translation of polymorphic symbols based on the novel notion of "cover". The new encodings are implemented in Isabelle/HOL as part of the Sledgehammer tool. We include informal proofs of soundness and correctness, and have formalised the monomorphic part of this work in Isabelle/HOL. Our evaluation finds the new encodings vastly superior to previous schemes.

Finding race conditions in Erlang with QuickCheck and PULSE

Koen Claessen, Michał H. Pałka, Nicholas Smallbone +4 more

Software · Chalmers Research (Chalmers University of Technology) · · cited 66× · DOI ↗ · more like this ·

We address the problem of testing and debugging concurrent, distributed Erlang applications. In concurrent programs, race conditions are a common class of bugs and are very hard to find in practice. Traditional unit testing is normally unable to help finding all race conditions, because their occurrence depends so much on timing. Therefore, race conditions are often found during system testing, where due to the vast amount of code under test, it is often hard to diagnose the error resulting from race conditions. We present three tools (QuickCheck, PULSE, and a visualizer) that in combination can be used to test and debug concurrent programs in unit testing with a much better possibility of detecting race conditions. We evaluate our method on an industrial concurrent case study and illustrate how we find and analyze the race conditions.

Quick specifications for the busy programmer

Nicholas Smallbone, Moa Johansson, Koen Claessen +1 more

Artificial Intelligence · Journal of Functional Programming · · cited 28× · DOI ↗ · more like this ·

Abstract QuickSpec is a theory exploration system which tests a Haskell program to find equational properties of it, automatically. The equations can be used to help understand the program, or as lemmas to help prove the program correct. QuickSpec is largely automatic: the user just supplies the functions to be tested and QuickCheck data generators. Previous theory exploration systems, including earlier versions of QuickSpec itself, scaled poorly. This paper describes a new architecture for theory exploration with which we can find vastly more complex laws than before, and much faster. We demonstrate theory exploration in QuickSpec on problems both from functional programming and mathematics.

Using Valued Booleans to Find Simpler Counterexamples in Random Testing of Cyber-Physical Systems

Koen Claessen, Nicholas Smallbone, Johan Lidén Eddeland +2 more

Software · IFAC-PapersOnLine · · cited 21× · DOI ↗ · more like this ·

We propose a new logic of valued Booleans for writing properties which are not just true or false but compute how severely they are falsified. The logic is reminiscent of STL or MTL but gives the tester control over what severity means in the particular problem domain. We use this logic to simplify failing test inputs in the context of random testing of cyber-physical systems and show that it improves the quality of counterexamples found. The logic of valued Booleans might also be used as an alternative to the standard robust semantics of STL formulas in optimization-based approaches to falsification.

Find more bugs with QuickCheck!

John Hughes, Ulf Norell, Nicholas Smallbone +1 more

Software · Chalmers Publication Library (Chalmers University of Technology) · · cited 16× · DOI ↗ · more like this ·

Random testing is increasingly popular and successful, but tends to spend most time rediscovering the "most probable bugs" again and again, reducing the value of long test runs on buggy software. We present a new automated method to adapt random test case generation so that already-discovered bugs are avoided, and further test effort can be devoted to searching for new bugs instead. We evaluate our method primarily against RANDOOP-style testing, in three different settings---our method avoids rediscovering bugs more successfully than RANDOOP and in some cases finds bugs that RANDOOP did not find at all.

HipSpec: Automating Inductive Proofs of Program Properties.

Koen Claessen, Moa Johansson, Dan Rosén +1 more

Computational Theory and Mathematics · · cited 14× · OpenAlex ↗ · more like this ·

We present ongoing work on HipSpec, a system for automatically deriving and proving properties about functional programs. HipSpec uses a combination of theory exploration, counter-example testing and inductive theorem proving to automatically generate a set of equational theorems about recursive functions in a program, which are later used as a background theory for proving stated properties about a program. Initial experiments are encouraging; our initial HipSpec prototype already compares favourably to other, similar systems. 1

Twee: An Equational Theorem Prover

Nicholas Smallbone

Artificial Intelligence · Lecture notes in computer science · · cited 11× · DOI ↗ · more like this ·

Abstract Twee is an automated theorem prover for equational logic. It implements unfailing Knuth-Bendix completion with ground joinability testing and a connectedness-based redundancy criterion. It came second in the UEQ division of CASC-J10, solving some problems that no other system solved. This paper describes Twee’s design and implementation.

Enhancing Temporal Logic Falsification with Specification Transformation and Valued Booleans

Johan Lidén Eddeland, Koen Claessen, Nicholas Smallbone +3 more

eess.SY · · cited 9× · arXiv ↗ · more like this ·

Cyber-Physical Systems (CPSs) are systems with both physical and software components, for example cars and industrial robots. Since these systems exhibit both discrete and continuous dynamics, they are complex and it is thus difficult to verify that they behave as expected. Falsification of temporal logic properties is an approach to find counterexamples to CPSs by means of simulation. In this paper, we propose two additions to enhance the capability of falsification and make it more viable in a large-scale industrial setting. The first addition is a framework for transforming specifications from a signal-based model into Signal Temporal Logic. The second addition is the use of Valued Booleans and an additive robust semantics in the falsification process. We evaluate the performance of the additive robust semantics on a set of benchmark models, and we can see that which semantics are…

Testing Cyber–Physical Systems Using a Line-Search Falsification Method

Zahra Ramezani, Koen Claessen, Nicholas Smallbone +2 more

Software · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · · cited 8× · DOI ↗ · more like this ·

Cyber-physical systems (CPSs) are complex and exhibit both continuous and discrete dynamics, hence it is difficult to guarantee that they satisfy given specifications, i.e., the properties that must be fulfilled by the system. Falsification of temporal logic properties is a testing approach that searches for counterexamples of a given specification that can be used to increase the confidence that a CPS does fulfill its specifications. Falsification can be done using random search methods or optimization methods, both of which have their own benefits and drawbacks. This article introduces two methods that exploit randomness to different degrees: 1) the optimization-free Hybrid-Corner-Random (HCR) and 2) the direct-search method Line-Search Falsification (LSF). HCR combines randomly chosen parameter values with extreme parameter values, which performs surprisingly well on benchmark…

Template-based Theory Exploration: Discovering Properties of Functional Programs by Testing

Sólrún Halla Einarsdóttir, Nicholas Smallbone, Moa Johansson

Artificial Intelligence · Chalmers Research (Chalmers University of Technology) · · cited 6× · DOI ↗ · more like this ·

We present RoughSpec, a template-based extension of the theory exploration tool QuickSpec. QuickSpec uses testing to automatically discover equational properties about functions in a Haskell program. These properties can help the user understand the program or be used as a source of possible lemmas in proofs of the program’s correctness. In RoughSpec, the user supplies templates, which describe families of laws such as associativity and distributivity, and we only consider properties that match the templates. This restriction limits the search space and ensures that only relevant properties are discovered. In this way, we sacrifice broad search for more direction towards desirable property patterns, which makes theory exploration tractable and scalable. We also combine RoughSpec with QuickSpec, using QuickSpec to perform a complete search for smaller term sizes, while using templates…

Lemma Discovery and Strategies for Automated Induction

Sólrún Halla Einarsdóttir, Márton Hajdú, Moa Johansson +2 more

Artificial Intelligence · Lecture notes in computer science · · cited 3× · DOI ↗ · more like this ·

Abstract We investigate how the automated inductive proof capabilities of the first-order prover Vampire can be improved by adding lemmas conjectured by the QuickSpec theory exploration system and by training strategy schedules specialized for inductive proofs. We find that adding lemmas improves performance (measured in number of proofs found for benchmark problems) by $$40\%$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:mn>40</mml:mn> <mml:mo>%</mml:mo> </mml:mrow> </mml:math> compared to Vampire’s plain structural induction as baseline. Strategy training alone increases the number of proofs found by $$130\%$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:mn>130</mml:mn> <mml:mo>%</mml:mo> </mml:mrow> </mml:math> , and the two methods in combination provide an increase of $$183\%$$ <mml:math…

Evaluating Two Semantics for Falsification using an Autonomous Driving Example

Zahra Ramezani, Nicholas Smallbone, Martin Fabian +1 more

Computational Theory and Mathematics · Chalmers Research (Chalmers University of Technology) · · cited 3× · DOI ↗ · more like this ·

We consider the falsification of temporal logic properties as a method to test complex systems, such as autonomous systems. Since these systems are often safety-critical, it is important to assess whether they fulfill given specifications or not. An adaptive cruise controller for an autonomous car is considered where the closed-loop model has unknown parameters and an important problem is to find parameter combinations for which given specification are broken. We assume that the closed-loop system can be simulated with the known given parameters, no other information is available to the testing framework. The specification, such as, the ability to avoid collisions, is expressed using Signal Temporal Logic (STL). In general, systems consist of a large number of parameters, and it is not possible or feasible to explicitly enumerate all combinations of the parameters. Thus, an…

Understanding formal specifications through good examples

Alex Gerdes, John Hughes, Nicholas Smallbone +3 more

Information Systems · Explore Bristol Research · · cited 3× · DOI ↗ · more like this ·

Formal specifications of software applications are hard to understand, even for domain experts. Because a formal specification is abstract, reading it does not immediately convey the expected behaviour of the software. Carefully chosen examples of the software’s behaviour, on the other hand, are concrete and easy to understand—but poorly-chosen examples are more confusing than helpful. In order to understand formal specifications, software developers need good examples.

Hipster: Integrating Theory Exploration in a Proof Assistant

Moa Johansson, Dan Rosen, Nicholas Smallbone +1 more

cs.LO · · cited 3× · arXiv ↗ · more like this ·

This paper describes Hipster, a system integrating theory exploration with the proof assistant Isabelle/HOL. Theory exploration is a technique for automatically discovering new interesting lemmas in a given theory development. Hipster can be used in two main modes. The first is exploratory mode, used for automatically generating basic lemmas about a given set of datatypes and functions in a new theory development. The second is proof mode, used in a particular proof attempt, trying to discover the missing lemmas which would allow the current goal to be proved. Hipster's proof mode complements and boosts existing proof automation techniques that rely on automatically selecting existing lemmas, by inventing new lemmas that need induction to be proved. We show example uses of both modes.

Conjectures, Tests and Proofs: An Overview of Theory Exploration

Moa Johansson, Nicholas Smallbone

cs.LO · · cited 2× · arXiv ↗ · more like this ·

A key component of mathematical reasoning is the ability to formulate interesting conjectures about a problem domain at hand. In this paper, we give a brief overview of a theory exploration system called QuickSpec, which is able to automatically discover interesting conjectures about a given set of functions. QuickSpec works by interleaving term generation with random testing to form candidate conjectures. This is made tractable by starting from small sizes and ensuring that only terms that are irreducible with respect to already discovered conjectures are considered. QuickSpec has been successfully applied to generate lemmas for automated inductive theorem proving as well as to generate specifications of functional programs. We give an overview of typical use-cases of QuickSpec, as well as demonstrating how to easily connect it to a theorem prover of the user's choice.

QuickerCheck: Implementing and Evaluating a Parallel Run-Time for QuickCheck

Robert Krook, Nicholas Smallbone, Bo Joel Svensson +1 more

cs.PL · · cited 1× · arXiv ↗ · more like this ·

This paper introduces a new parallel run-time for QuickCheck, a Haskell library and EDSL for specifying and randomly testing properties of programs. The new run-time can run multiple tests for a single property in parallel, using the available cores. Moreover, if a counterexample is found, the run-time can also shrink the test case in parallel, implementing a parallel search for a locally minimal counterexample. Our experimental results show a 3--9$\times$ speed-up for testing QuickCheck properties on a variety of heavy-weight benchmark problems. We also evaluate two different shrinking strategies; deterministic shrinking, which guarantees to produce the same minimal test case as standard sequential shrinking, and greedy shrinking, which does not have this guarantee but still produces a locally minimal test case, and is faster in practice.

Applying Valued Booleans in Testing of Cyber-Physical Systems

Koen Claessen, Nicholas Smallbone, Johan Lidén Eddeland +3 more

Software · Chalmers Research (Chalmers University of Technology) · · cited 1× · DOI ↗ · more like this ·

In software testing, as in cyber-physical systems testing, test suites are traditionally developed by hand. In this work we consider one framework for putting the computer in charge of the testing instead: constrained random test case generation as supported by the tool QuickCheck. This is implemented by the use of Valued Booleans (VBools). VBools naturally allow for an extension of QuickCheck into cyber-physical systems, which is useful particularly since QuickCheck can perform shrinking of test cases. Shrinking is a technique to make test cases simpler while preserving failure.

Compiling Linear Logic using Continuations

Jean-Philippe Bernardy, Dan Rosén, Nicholas Smallbone

Artificial Intelligence · Chalmers Publication Library (Chalmers University of Technology) · · cited 1× · OpenAlex ↗ · more like this ·

As System F is the logical foundation of functional programming, it has\nlong been expected that Classical Linear Logic (CLL) is the logical\nfoundation of concurrent programming. In particular, thanks to an\ninvolutive negation, its language of propositions correspond to protocols.\nThis means that CLL provides the principles to integrate concurrency into\nfunctional programming languages.\n\nAiming towards this integration, we translate the concurrency features of\nCLL into continuations, essentially via a negation-model of CLL into System\nF. Practically, the translation can be used to embed CLL programs into\nfunctional languages such as Haskell. We explain the properties of the\ninterface between the two languages. In particular, using an example, we\nillustrate how the par (⅋) operator can solve practical functional\nprogramming problems.\n

Lemmanaid: Neuro-Symbolic Lemma Conjecturing

Yousef Alhessi, Sólrún Halla Einarsdóttir, George Granberry +4 more

cs.AI · · cited 0× · arXiv ↗ · more like this ·

Mathematicians and computer scientists are increasingly leveraging proof assistants to formalize and check complex proofs, a task that demands substantial expertise. Can we lower the bar by automating the conjecturing of helpful, interesting and novel lemmas? We present the first neuro-symbolic lemma conjecturing tool, LEMMANAID, designed to discover conjectures by drawing analogies between mathematical theories. LEMMANAID uses a fine-tuned LLM to generate lemma templates that describe the shape of a lemma, and symbolic methods to fill in the details. We compare LEMMANAID against the same LLM fine-tuned to generate lemmas directly, as well as a fully symbolic conjecturing method. On test sets from Isabelle's HOL library and Archive of Formal Proofs (AFP), LEMMANAID consistently outperforms both neural and symbolic methods. Using DeepSeek-coder-6.7B as a backend, LEMMANAID discovers 50%…

Falsifying Cyber-Physical Systems -- a Hybrid Optimization-Free and an Optimization-Based Line-Search Approach

Zahra Ramezani, Koen Claessen, Nicholas Smallbone +2 more

Computational Theory and Mathematics · · cited 0× · DOI ↗ · more like this ·

Cyber-physical systems (CPSs) are complex and exhibit both continuous and discrete dynamics, hence it is difficult to guarantee that they satisfy given specifications, i.e., the properties that must be fulfilled by the system. Falsification of temporal logic properties is a testing approach that searches for counterexamples of a given specification, which can be used to increase the confidence that a CPS does fulfill its specifications. Falsification can be done using random search methods or optimization methods. In this paper, a method based on combining random parameters together with considering extreme combinations of parameter values is proposed. Evaluation results on benchmark problems show that this method performs well on many of the problems. Optimization methods are needed when optimization-free methods do not perform well in falsification. The efficiency of the falsification…

Safety at speed: in-place array algorithms from pure functional programs by safely re-using storage

Markus Aronsson, Koen Claessen, Mary Sheeran +1 more

Hardware and Architecture · Chalmers Research (Chalmers University of Technology) · · cited 0× · DOI ↗ · more like this ·

We present a purely functional array programming language that offers safe, purely functional and crash-free in-place array transformations. The language supports high-level abstractions for pure and efficient array computations that fully support equational reasoning. We show how to execute selected parts of these computations safely in-place, with the compiler guaranteeing that in-place execution does not change the computation’s result. Correctness is ensured by using an off-the-shelf-theorem prover to discharge safety conditions. Our main contribution is the idea of virtual copies for expressing re-use of arrays, and techniques for verifying their safety, which allow a pure language to include in-place transformations without weakening its transparency or reasoning power.

Inferring Morphological Rules from Small Examples using 0/1 Linear Programming

Ann Lillieström, Koen Claessen, Nicholas Smallbone

Artificial Intelligence · DSpace repository (University of Tartu) · · cited 0× · OpenAlex ↗ · more like this ·

We show how to express the problem of finding an optimal morpheme segmentation from a set of labelled words as a 0/1 linear programming problem, and how to build on this to analyse a language’s morphology. The result is an automatic method for segmentation and labelling that works well even when there is very little training data available.

Conjectures for cheap! QuickSpec 2, a fast theory exploration tool

Nicholas Smallbone, Moa Johansson

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

QuickSpec finds algebraic properties of functional programs by testing. It is largely automatic: the user just supplies the functions to be tested and QuickCheck data generators. Earlier versions of QuickSpec scaled poorly; this paper describes a new design which is able to find vastly more complex laws than before. We demonstrate QuickSpec on problems which were out of reach until now, including Hughes’s pretty-printing library and Henderson’s functional geometry combinators. Categories and Subject Descriptors D.2.5 [Testing and Debug-

Monotonicity or how to encode polymorphic types safely and efficiently

Jasmin Christian Blanchette, Sascha Böhme, Nicholas Smallbone

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

Most automatic theorem provers are restricted to untyped or monomorphic logics, and existing translations from polymorphic logics are either bulky or unsound. Recent research shows how to exploit monotonicity to encode ground types efficiently: monotonic types can be safely erased, while nonmonotonic types must generally be encoded. We extend this work to rank-1 polymorphism and show how to eliminate even more clutter by also erasing most occurrences of nonmonotonic types, without sacrificing soundness or completeness. The new encodings are implemented in the Sledgehammer tool for Isabelle/HOL. Our evaluation finds them considerably superior to previous schemes.