arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Stephen Muggleton

121 papers · 1987–2025

1987: 11988: 11989: 01990: 21991: 21992: 41993: 01994: 101995: 31996: 31997: 21998: 21999: 32000: 82001: 22002: 22003: 32004: 02005: 02006: 32007: 72008: 92009: 12010: 32011: 22012: 12013: 52014: 42015: 102016: 42017: 02018: 42019: 32020: 52021: 52022: 12023: 22024: 32025: 1
1987peak 10 in 19942025

Frequent co-authors

Papers

showing 1–25 of 121 RSS

Efficient Induction of Logic Programs

Stephen Muggleton, Cheng Feng

Computational Theory and Mathematics · Algorithmic Learning Theory · · cited 657× · OpenAlex ↗ · more like this ·

Abstract A new research area, Inductive Logic Programming, is presently emerging. While inheriting various positive characteristics of the parent subjects of Logic Programming and Machine Learning, it is hoped that the new area will overcome many of the limitations of its forebears. The background to present developments within this area is discussed and various goals and aspirations for the increasing body of researchers are identified. Inductive Logic Programming needs to be based on sound principles from both Logic and Statistics. On the side of statistical justification ofhypotheses we discuss the possible relationship be-tween Algorithmic Complexity theory and Probably-Approximately-Correct (PAC) Learning. In terms of logic we provide a unifying framework for Muggleton and Buntine's Inverse Resolution (IR) and Plotkin's Relative Least General Generali-sation…

Structure-activity relationships derived by machine learning: the use of atoms and their bond connectivities to predict mutagenicity by inductive logic programming.

Ross D. King, Stephen Muggleton, Ashwin Srinivasan +1 more

Computational Theory and Mathematics · Proceedings of the National Academy of Sciences · · cited 232× · DOI ↗ · more like this ·

We present a general approach to forming structure-activity relationships (SARs). This approach is based on representing chemical structure by atoms and their bond connectivities in combination with the inductive logic programming (ILP) algorithm PROGOL. Existing SAR methods describe chemical structure by using attributes which are general properties of an object. It is not possible to map chemical structure directly to attribute-based descriptions, as such descriptions have no internal organization. A more natural and general way to describe chemical structure is to use a relational description, where the internal construction of the description maps that of the object described. Our atom and bond connectivities representation is a relational description. ILP algorithms can form SARs with relational descriptions. We have tested the relational approach by investigating the SARs of 230…

Drug design by machine learning: the use of inductive logic programming to model the structure-activity relationships of trimethoprim analogues binding to dihydrofolate reductase.

Ross D. King, Stephen Muggleton, Richard A. Lewis +1 more

Computational Theory and Mathematics · Proceedings of the National Academy of Sciences · · cited 221× · DOI ↗ · more like this ·

The machine learning program GOLEM from the field of inductive logic programming was applied to the drug design problem of modeling structure-activity relationships. The training data for the program were 44 trimethoprim analogues and their observed inhibition of Escherichia coli dihydrofolate reductase. A further 11 compounds were used as unseen test data. GOLEM obtained rules that were statistically more accurate on the training data and also better on the test data than a Hansch linear regression model. Importantly machine learning yields understandable rules that characterized the chemistry of favored inhibitors in terms of polarity, flexibility, and hydrogen-bonding character. These rules agree with the stereochemistry of the interaction observed crystallographically.

Applications of inductive logic programming

Ivan Bratko, Stephen Muggleton

Artificial Intelligence · Communications of the ACM · · cited 166× · DOI ↗ · more like this ·

Techniques of machine learning have been successfully applied to various problems [1, 12]. Most of these applications rely on attribute-based learning, exemplified by the induction of decision trees as in the program C4.5 [20]. Broadly speaking, attribute-based learning also includes such approaches to learning as neural networks and nearest neighbor techniques. The advantages of attribute-based learning are: relative simplicity, efficiency, and existence of effective techniques for handling noisy data. However, attribute-based learning is limited to non-relational descriptions of objects in the sense that the learned descriptions do not specify relations among the objects' parts. Attribute-based learning thus has two strong limitations: the background knowledge can be expressed in rather limited form, and the lack of relations makes the concept description language inappropriate for…

Duce, an oracle-based approach to constructive induction

Stephen Muggleton

Artificial Intelligence · International Joint Conference on Artificial Intelligence · · cited 130× · OpenAlex ↗ · more like this ·

Duce 1 is a Machine Learning system which suggests high-level domain features to the user (or oracle on the basis of a set of example object descriptions. Six transformation operators are used to successively compress the given examples by generalisation and feature construction. In this paper Duce is illustrated by way of its construction of a simple animal taxonomy and a hierarchical parity checker. However, Duce's main achievement has been the restructuring of a substantial expert system for deciding whether positions within the chess endgame of King-and-Pawn-on-a7 v. Kingand -Rook (KPa7KR) are won-for-white or not. The new concepts suggested by Duce for the chess expert system hierarchy were found to be meaningful by the chess expert Ivan Bratko. An existing manually created KPa7KR solution, which was the basis of a recent PhD thesis [ 20 ] , is compared to the structure…

ILP turns 20

Stephen Muggleton, Luc De Raedt, David Poole +4 more

Artificial Intelligence · Machine Learning · · cited 128× · DOI ↗ · more like this ·

Inductive Logic Programming (ILP) is an area of Machine Learning which has now reached its twentieth year. Using the analogy of a human biography this paper recalls the development of the subject from its infancy through childhood and teenage years. We show how in each phase ILP has been characterised by an attempt to extend theory and implementations in tandem with the development of novel and challenging real-world applications. Lastly, by projection we suggest directions for research which will help the subject coming of age.

PAC-learnability of determinate logic programs

Sašo Džeroski, Stephen Muggleton, Stuart Russell

Artificial Intelligence · · cited 122× · DOI ↗ · more like this ·

The field of Inductive Logic Programming (ILP) is concerned with inducing logic programs from examples in the presence of background knowledge. This paper defines the ILP problem, and describes the various syntactic restrictions that are commonly used for learning first-order representations. We then derive some positive results concerning the learnability of these restricted classes of logic programs, by reduction to a standard propositional learning problem. More specifically, k-clause predicate definitions consisting of determinate, function-free, non-recursve Horn clauses with variables of bounded depth are polynomially learnable under simple distributions. Similarly, recursive k-clause definitions are polynomially learnable under simple distributions if we allow existential and membership queries about the target concept.

The predictive toxicology evaluation challenge

Ashwin Srinivasan, Ross D. King, Stephen Muggleton +1 more

Computational Theory and Mathematics · International Journal of Biological Macromolecules · · cited 113× · DOI ↗ · more like this ·

The paper optimized the parameters of microwave freeze drying (MFD) of crude Ginkgo biloba protein (CPG) using response surface methodology (RSM) based on the analysis of its proximate composition. The results showed that coefficients of determination, R(2) values for drying time and protein solubility were greater than 0.9500. The drying time and protein solubility of CPG varied curvilinearly with increase of microwave power and pre-freeze temperature, and drying time varied linearly with material thickness. The optimum MFD condition was microwave power of 408-421 W, material thickness of 15 mm and pre-freeze temperature of -20°C to -21°C, respectively.

Ultra-Strong Machine Learning: comprehensibility of programs learned with ILP

Stephen Muggleton, Ute Schmid, Christina Zeller +2 more

Artificial Intelligence · Machine Learning · · cited 107× · DOI ↗ · more like this ·

During the 1980s Michie defined Machine Learning in terms of two orthogonal axes of performance: predictive accuracy and comprehensibility of generated hypotheses. Since predictive accuracy was readily measurable and comprehensibility not so, later definitions in the 1990s, such as Mitchell’s, tended to use a one-dimensional approach to Machine Learning based solely on predictive accuracy, ultimately favouring statistical over symbolic Machine Learning approaches. In this paper we provide a definition of comprehensibility of hypotheses which can be estimated using human participant trials. We present two sets of experiments testing human comprehensibility of logic programs. In the first experiment we test human comprehensibility with and without predicate invention. Results indicate comprehensibility is affected not only by the complexity of the presented program but also by the…

Inductive logic programming at 30

Andrew Cropper, Sebastijan Dumančić, Richard Evans +1 more

cs.AI · · cited 106× · arXiv ↗ · more like this ·

Inductive logic programming (ILP) is a form of logic-based machine learning. The goal is to induce a hypothesis (a logic program) that generalises given training examples. As ILP turns 30, we review the last decade of research. We focus on (i) new meta-level search methods, (ii) techniques for learning recursive programs, (iii) new approaches for predicate invention, and (iv) the use of different technologies. We conclude by discussing current limitations of ILP and directions for future research.

Learning Stochastic Logic Programs

Stephen Muggleton

Artificial Intelligence · KTH Publication Database DiVA (KTH Royal Institute of Technology) · · cited 104× · OpenAlex ↗ · more like this ·

Stochastic Logic Programs (SLPs) have been shown to be a generalisation of Hidden Markov Models (HMMs), stochastic context-free grammars, and directed Bayes' nets. A stochastic logic program consists of a set of labelled clauses p:C where p is in the interval [0,1] and C is a first-order range-restricted definite clause. This paper summarises the syntax, distributional semantics and proof techniques for SLPs and then discusses how a standard Inductive Logic Programming (ILP) system, Progol, has been modied to support learning of SLPs. The resulting system 1) nds an SLP with uniform probability labels on each definition and near-maximal Bayes posterior probability and then 2) alters the probability labels to further increase the posterior probability. Stage 1) is implemented within CProgol4.5, which differs from previous versions of Progol by allowing user-defined evaluation…

Scientific knowledge discovery using inductive logic programming

Stephen Muggleton

Artificial Intelligence · Communications of the ACM · · cited 80× · DOI ↗ · more like this ·

This paper is an overview of scientific knowledge discovery tasks carried out using Inductive Logic Programming (ILP). The results reviewed have been published in some of the top general science journals, and as such are among the strongest examples of semi-automated scientific discovery in the Artificial Intelligence literature. Space restrictions do not permit this paper to cover other discovery areas of ILP. These include the discovery of linguistic features in natural language data and the discovery of patterns in traffic data. 1 Introduction The pharmaceutical industry is increasingly overwhelmed by large-volume-data. This is generated both internally as a side-effect of screening tests and combinatorial chemistry, as well as externally from sources such as the human genome project. On the other hand the industry is predominantly knowledge-driven. For instance, knowledge is…

Inductive logic programming

Stephen Muggleton

Artificial Intelligence · ACM SIGART Bulletin · · cited 70× · DOI ↗ · more like this ·

Inductive Logic Programming (ILP) is a research area which investigates the construction of first-order definite clause theories from examples and background knowledge. ILP systems have been applied successfully in a number of real-world domains. These include the learning of structure-activity rules for drug design, finite-element mesh design rules, rules for primary-secondary prediction of protein structure and fault diagnosis rules for satellites. There is a well established tradition of learning-in-the-limit results in ILP. Recently some results within Valiant's PAC-learning framework have also been demonstrated for ILP systems. In this paper it is argued that algorithms can be directly derived from the formal specifications of ILP. This provides a common basis for Inverse Resolution, Explanation-Based Learning, Abduction and Relative Least General Generalisation. A new…

Abductive Knowledge Induction From Raw Data

Wang-Zhou Dai, Stephen H. Muggleton

cs.AI · · cited 63× · arXiv ↗ · more like this ·

For many reasoning-heavy tasks involving raw inputs, it is challenging to design an appropriate end-to-end learning pipeline. Neuro-Symbolic Learning, divide the process into sub-symbolic perception and symbolic reasoning, trying to utilise data-driven machine learning and knowledge-driven reasoning simultaneously. However, they suffer from the exponential computational complexity within the interface between these two components, where the sub-symbolic learning model lacks direct supervision, and the symbolic model lacks accurate input facts. Hence, most of them assume the existence of a strong symbolic knowledge base and only learn the perception model while avoiding a crucial problem: where does the knowledge come from? In this paper, we present Abductive Meta-Interpretive Learning ($Meta_{Abd}$) that unites abduction and induction to learn neural networks and induce logic theories…

Non-monotonic Learning

Michael Bain, Stephen Muggleton

Education · Machine intelligence · · cited 60× · DOI ↗ · more like this ·

Abstract This paper addresses methods of specializing first-order theories within the context of incremental learning systems. We demonstrate the short comings of existing first-order incremental learning systems with regard to their specialization mechanisms. We prove that these shortcomings are fundamental to the use of classical logic. In particular, minimal ‘correcting’ specializations are not always obtainable within this frame work. We propose instead the adoption of a specialization scheme based on an existing non-monotonic logic formalism.

Bias reformulation for one-shot function induction

Dianhuan Lin, Eyal Dechter, Kevin Ellis +2 more

Artificial Intelligence · DSpace@MIT (Massachusetts Institute of Technology) · · cited 50× · OpenAlex ↗ · more like this ·

Abstract. In recent years predicate invention has been under-explored as a bias reformulation mechanism within Inductive Logic Programming due to difficulties in formulating efficient search mech-anisms. However, recent papers on a new approach called Meta-Interpretive Learning have demonstrated that both predicate inven-tion and learning recursive predicates can be efficiently implemented for various fragments of definite clause logic using a form of abduc-tion within a meta-interpreter. This paper explores the effect of bias reformulation produced by Meta-Interpretive Learning on a series of Program Induction tasks involving string transformations. These tasks have real-world applications in the use of spreadsheet tech-nology. The existing implementation of program induction in Mi-crosoft’s FlashFill (part of Excel 2013) already has strong perfor-mance on this problem, and performs…

Bayesian inductive logic programming

Stephen Muggleton

Artificial Intelligence · · cited 48× · DOI ↗ · more like this ·

Inductive Logic Programming (ILP) involves the construction of first-order definite clause theories from examples and background knowledge. Unlike both traditional Machine Learning and Computational Learning Theory, ILP is based on lock-step development of Theory, Implementations and Applications. ILP systems have successful applications in the learning of structure-activity rules for drug design, semantic grammars rules, finite element mesh design rules and rules for prediction of protein structure and mutagenic molecules. The strong applications in ILP can be contrasted with relatively weak PAC-learning results (even highly restricted forms of logic programs are known to be prediction-hard). It has been recently argued that the mismatch is due to distributional assumptions made in application domains. These assumptions can be modelled as a Bayesian prior probability representing…

Scaffold Hopping in Drug Discovery Using Inductive Logic Programming

Kazuhisa Tsunoyama, Ata Amini, Michael J.E. Sternberg +1 more

Computational Theory and Mathematics · Journal of Chemical Information and Modeling · · cited 43× · DOI ↗ · more like this ·

In chemoinformatics, searching for compounds which are structurally diverse and share a biological activity is called scaffold hopping. Scaffold hopping is important since it can be used to obtain alternative structures when the compound under development has unexpected side-effects. Pharmaceutical companies use scaffold hopping when they wish to circumvent prior patents for targets of interest. We propose a new method for scaffold hopping using inductive logic programming (ILP). ILP uses the observed spatial relationships between pharmacophore types in pretested active and inactive compounds and learns human-readable rules describing the diverse structures of active compounds. The ILP-based scaffold hopping method is compared to two previous algorithms (chemically advanced template search, CATS, and CATS3D) on 10 data sets with diverse scaffolds. The comparison shows that the ILP-based…

A Novel Logic-Based Approach for Quantitative Toxicology Prediction

Ata Amini, Stephen Muggleton, Huma Lodhi +1 more

Computational Theory and Mathematics · Journal of Chemical Information and Modeling · · cited 43× · DOI ↗ · more like this ·

There is a pressing need for accurate in silico methods to predict the toxicity of molecules that are being introduced into the environment or are being developed into new pharmaceuticals. Predictive toxicology is in the realm of structure activity relationships (SAR), and many approaches have been used to derive such SAR. Previous work has shown that inductive logic programming (ILP) is a powerful approach that circumvents several major difficulties, such as molecular superposition, faced by some other SAR methods. The ILP approach reasons with chemical substructures within a relational framework and yields chemically understandable rules. Here, we report a general new approach, support vector inductive logic programming (SVILP), which extends the essentially qualitative ILP-based SAR to quantitative modeling. First, ILP is used to learn rules, the predictions of which are then used…

Learning higher-order logic programs through abstraction and invention

Andrew Cropper, Stephen Muggleton

Information Systems · Oxford University Research Archive (ORA) (University of Oxford) · · cited 41× · OpenAlex ↗ · more like this ·

Many tasks in AI require the design of complex programs and representations, whether for programming robots, designing game-playing programs, or conducting textual or visual transformations. This paper explores a novel inductive logic programming approach to learn such programs from examples. To reduce the complexity of the learned programs, and thus the search for such a program, we introduce higher-order operations involving an alternation of Abstraction and Invention. Abstractions are described using logic program definitions containing higher-order predicate variables. Inventions involve the construction of definitions for the predicate variables used in the Abstractions. The use of Abstractions extends the Meta-Interpretive Learning framework and is supported by the use of a user-extendable set of higher-order operators, such as map, until, and ifthenelse. Using these operators…

Structure Activity Relationships (SAR) and Pharmacophore Discovery Using Inductive Logic Programming (ILP)

Michael J.E. Sternberg, Stephen Muggleton

Computational Theory and Mathematics · QSAR & Combinatorial Science · · cited 37× · DOI ↗ · more like this ·

Abstract The application of Inductive Logic Programming (ILP), a form of machine learning, to derive structure activity relationships (SAR) and to discover pharmacophores is reported. The ILP approach was initially applied to model 1D SARs in terms of the attributes of the molecules. Subsequently 2D ILP SARs were developed describing chemical connectivity. Finally ILP has been used to model 3D SARs in which the conformation of the pharmacophore can be described. ILP has advantages over many other widely used methods as it can reason with relations and hence discover chemical substructures and 3D features without these aspects having been explicitly encoded prior to learning. In particular, there is no requirement for a structural superposition. Additionally, the results of ILP provide chemical descriptions that can readily be understood by a medicinal chemist. In several trials…

A Strategy for Constructing New Predicates in First-Order Logic.

Stephen Muggleton

Artificial Intelligence · · cited 37× · OpenAlex ↗ · more like this ·

There is increasing interest within the Machine Learning community in systems which automatically reformulate their problem representation by defining and constructing new predicates. A previous paper discussed such a system, called CIGOL, and gave a derivation for the mechanism of inverting individual steps in first order resolution proofs. In this paper we describe an enhancement to CIGOL's learning strategy which strongly constrains the formation of new concepts and hypotheses. The new strategy is based on results from algorithmic information theory. Using these results it is possible to compute the probability that the simplifications produced by adopting new concepts or hypotheses are not based on chance regularities within the examples. This can be derived from the amount of information compression produced by replacing the examples with the hypothesised concepts.…

Beneficial and Harmful Explanatory Machine Learning

Lun Ai, Stephen H. Muggleton, Céline Hocquette +2 more

cs.AI · · cited 36× · arXiv ↗ · more like this ·

Given the recent successes of Deep Learning in AI there has been increased interest in the role and need for explanations in machine learned theories. A distinct notion in this context is that of Michie's definition of Ultra-Strong Machine Learning (USML). USML is demonstrated by a measurable increase in human performance of a task following provision to the human of a symbolic machine learned theory for task performance. A recent paper demonstrates the beneficial effect of a machine learned logic theory for a classification task, yet no existing work to our knowledge has examined the potential harmfulness of machine's involvement for human comprehension during learning. This paper investigates the explanatory effects of a machine learned theory in the context of simple two person games and proposes a framework for identifying the harmfulness of machine explanations based on the…

Application of machine learning to structural molecular biology

Michael J.E. Sternberg, Ross D. King, Richard A. Lewis +1 more

Computational Theory and Mathematics · Philosophical Transactions of the Royal Society B Biological Sciences · · cited 36× · DOI ↗ · more like this ·

A technique of machine learning, inductive logic programming implemented in the program GOLEM, has been applied to three problems in structural molecular biology. These problems are: the prediction of protein secondary structure; the identification of rules governing the arrangement of beta-sheets strands in the tertiary folding of proteins; and the modelling of a quantitative structure activity relationship (QSAR) of a series of drugs. For secondary structure prediction and the QSAR, GOLEM yielded predictions comparable with contemporary approaches including neural networks. Rules for beta-strand arrangement are derived and it is planned to contrast their accuracy with those obtained by human inspection. In all three studies GOLEM discovered rules that provided insight into the stereochemistry of the system. We conclude machine learning used together with human intervention will…