arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Lee Spector

162 papers · 1980–2026

1980: 11981: 01982: 01983: 01984: 01985: 01986: 01987: 01988: 01989: 11990: 21991: 01992: 11993: 01994: 51995: 11996: 61997: 41998: 11999: 12000: 32001: 62002: 52003: 32004: 22005: 72006: 32007: 52008: 102009: 12010: 32011: 62012: 72013: 42014: 62015: 72016: 62017: 72018: 62019: 52020: 62021: 22022: 72023: 112024: 82025: 22026: 1
1980peak 11 in 20232026

Frequent co-authors

Papers

showing 1–25 of 162 RSS

Ontology-based Web agents

Sean Luke, Lee Spector, David Rager +1 more

Artificial Intelligence · · cited 204× · DOI ↗ · more like this ·

This paper describes SHOE, a set of Simple HTML Ontology Extensions which allow World-Wide Web authors to annotate their pages with semantic knowledge such as "I am a graduate student" or "This person is my graduate advisor". These annotations are expressed in terms of ontological knowledge which can be generated by using or extending standard ontologies available on the Web. This makes it possible to ask Web agent queries such as "Find me all graduate students in Maryland who are working on a project funded by DoD initiative 123-4567", instead of simplistic keyword searches enabled by current search engines. We have also developed a web-crawling agent, Expos e, which interns SHOE knowledge from web documents, making these kinds queries a reality. Introduction Imagine that you are searching the World-Wide Web for the home pages of a…

Solving Uncompromising Problems With Lexicase Selection

Thomas Helmuth, Lee Spector, James Matheson

Artificial Intelligence · IEEE Transactions on Evolutionary Computation · · cited 189× · DOI ↗ · more like this ·

We describe a broad class of problems, called “uncompromising problems,” which are characterized by the requirement that solutions must perform optimally on each of many test cases. Many of the problems that have long motivated genetic programming research, including the automation of many traditional programming tasks, are uncompromising. We describe and analyze the recently proposed “lexicase” parent selection algorithm and show that it can facilitate the solution of uncompromising problems by genetic programming. Unlike most traditional parent selection techniques, lexicase selection does not base selection on a fitness value that is aggregated over all test cases; rather, it considers test cases one at a time in random order. We present results comparing lexicase selection to more traditional parent selection methods, including standard tournament selection and implicit fitness…

General Program Synthesis Benchmark Suite

Thomas Helmuth, Lee Spector

Artificial Intelligence · · cited 170× · DOI ↗ · more like this ·

Recent interest in the development and use of non-trivial benchmark problems for genetic programming research has highlighted the scarcity of general program synthesis (also called "traditional programming") benchmark problems. We present a suite of 29 general program synthesis benchmark problems systematically selected from sources of introductory computer science programming problems. This suite is suitable for experiments with any program synthesis system driven by input/output examples. We present results from illustrative experiments using our reference implementation of the problems in the PushGP genetic programming system. The results show that the problems in the suite vary in difficulty and can be useful for assessing the capabilities of a program synthesis system.

Epsilon-Lexicase Selection for Regression

William La Cava, Lee Spector, Kourosh Danai

cs.NE · · cited 168× · arXiv ↗ · more like this ·

Lexicase selection is a parent selection method that considers test cases separately, rather than in aggregate, when performing parent selection. It performs well in discrete error spaces but not on the continuous-valued problems that compose most system identification tasks. In this paper, we develop a new form of lexicase selection for symbolic regression, named epsilon-lexicase selection, that redefines the pass condition for individuals on each test case in a more effective way. We run a series of experiments on real-world and synthetic problems with several treatments of epsilon and quantify how epsilon affects parent selection and model performance. epsilon-lexicase selection is shown to be effective for regression, producing better fit models compared to other techniques such as tournament selection and age-fitness Pareto optimization. We demonstrate that epsilon can be adapted…

Assessment of problem modality by differential performance of lexicase selection in genetic programming

Lee Spector

Artificial Intelligence · · cited 158× · DOI ↗ · more like this ·

Many potential target problems for genetic programming are modal in the sense that qualitatively different modes of response are required for inputs from different regions of the problem's domain. This paper presents a new approach to solving modal problems with genetic programming, using a simple and novel parent selection method called lexicase selection. It then shows how the differential performance of genetic programming with and without lexicase selection can be used to provide a measure of problem modality, and it argues that defining such a measure in this way is not as methodologically problematic as it may initially appear. The modality measure is illustrated through the analysis of genetic programming runs on a simple modal symbolic regression problem. This is a preliminary report that is intended in part to stimulate discussion on the significance of modal problems, methods…

The Push3 execution stack and the evolution of control

Lee Spector, Jon Klein, Maarten Keijzer

Artificial Intelligence · · cited 158× · DOI ↗ · more like this ·

The Push programming language was developed for use in genetic and evolutionary computation systems, as the representation within which evolving programs are expressed. It has been used in the production of several significant results, including results that were awarded a gold medal in the Human Competitive Results competition at GECCO-2004. One of Push's attractive features in this context is its transparent support for the expression and evolution of modular architectures and complex control structures, achieved through explicit code self-manipulation. The latest version of Push, Push3, enhances this feature by permitting explicit manipulation of an execution stack that contains the expressions that are queued for execution in the interpreter. This paper provides a brief introduction to Push and to execution stack manipulation in Push3. It then presents a series of examples in which…

Finding a better-than-classical quantum AND/OR algorithm using genetic programming

Lee Spector, Howard Barnum, H. J. Bernstein +1 more

Artificial Intelligence · · cited 119× · DOI ↗ · more like this ·

This paper documents the discovery of a new, better-than-classical quantum algorithm for the depth-two AND/OR tree problem. We describe the genetic programming system that was constructed specifically for this work, the quantum computer simulator that is used to evaluate the fitness of evolving quantum algorithms, and the newly discovered algorithm.

A Comparison of Crossover and Mutation in Genetic Programming

Sean Luke, Lee Spector

Artificial Intelligence · · cited 91× · OpenAlex ↗ · more like this ·

In [Luke and Spector 1997] we presented a comprehensive suite of data comparing GP crossover and point mutation over four domains and a wide range of parameter settings. Unfortunately, the results were marred by statistical flaws. This revision of the study eliminates these flaws, with three times as much the data as the original experiments had. Our results again show that crossover does have some advantage over mutation given the right parameter settings (primarily larger population sizes), though the difference between the two surprisingly small. Further, the results are complex, suggesting that the big picture is more complicated than is commonly believed. 1

A Probabilistic and Multi-Objective Analysis of Lexicase Selection and ε-Lexicase Selection

William La Cava, Thomas Helmuth, Lee Spector +1 more

Artificial Intelligence · Evolutionary Computation · · cited 87× · DOI ↗ · more like this ·

Lexicase selection is a parent selection method that considers training cases individually, rather than in aggregate, when performing parent selection. Whereas previous work has demonstrated the ability of lexicase selection to solve difficult problems in program synthesis and symbolic regression, the central goal of this article is to develop the theoretical underpinnings that explain its performance. To this end, we derive an analytical formula that gives the expected probabilities of selection under lexicase selection, given a population and its behavior. In addition, we expand upon the relation of lexicase selection to many-objective optimization methods to describe the behavior of lexicase selection, which is to select individuals on the boundaries of Pareto fronts in high-dimensional space. We show analytically why lexicase selection performs more poorly for certain sizes of…

Autoconstructive Evolution: Push, PushGP, and Pushpop

Lee Spector

Artificial Intelligence · · cited 81× · OpenAlex ↗ · more like this ·

This paper is a preliminary report on autoconstructive evolution, a framework for evolutionary computation in which the machinery of reproduction and diversification (and thereby the machinery of evolution) evolves within the individuals of an evolving population of problem solvers. Autoconstructive evolution is illustrated with Pushpop, an evolving population of programs expressed in the Push programming language. The Push programming language can also be used in a more traditional genetic programming framework and may have unique benefits when so employed; the PushGP system, which uses traditional genetic programming techniques to evolve Push programs, is also described.

Genetic programming

Wolfgang Banzhaf, J. R. Koza, Conor Ryan +2 more

Artificial Intelligence · IEEE Intelligent Systems and their Applications · · cited 74× · DOI ↗ · more like this ·

The paper presents essays on genetic programming which involve topics such as: the artificial evolution of computer code, human-competitive machine intelligence by means of genetic programming, GP as automatic programming, GP application, the evolution of arbitrary computational processes and the art of genetic programming.

Ontology-Based Knowledge Discovery on the World-Wide Web

Sean Luke, Lee Spector, David Rager

Information Systems · · cited 73× · OpenAlex ↗ · more like this ·

This paper describes SHOE, a set of Simple HTML Ontology Extensions. SHOE allows World-Wide Web authors to annotate their pages with ontology-based knowledge about page contents. We present examples showing how the use of SHOE can support a new generation of knowledge-based search and knowledge discovery tools that operate on the World-Wide Web. Introduction Imagine that you are searching the World-Wide Web for the home pages of a Mr. and Mrs. Cook, whom you met at a conference last year. You don't remember their first names, but you do recall that both work for an employer associated with the massive ARPA funding initiative 123-4567. This would certainly be sufficient information to find these people given a reasonably structured knowledge base containing all of the relevant facts. At first this also seems like enough information to find their home pages by searching the…

Probit Analysis and Economic Education

Lee Spector, Michael J. Mazzeo

Education · The Journal of Economic Education · · cited 73× · DOI ↗ · more like this ·

Spector and Mazzeo assert that ordinary least squares regression analysis has been misused by many economics education researchers. They explain that OLS is inappropriate for the analysis of discrete dependent variables, and they suggest the use of probit analysis instead. They then show how probit analysis can be employed in an economics education research project and compare the results of this approach with the results obtained by using OLS. (Those who want to know more about probit analysis might be interested in a new book, Carlos Daganzo's Multinomial Probit: The Theory and Its Application to Demand Forecasting, published in 1979 by Academic Press, Inc. Also see the bibliography provided by Spector and Mazzeo.)

Program synthesis using uniform mutation by addition and deletion

Thomas Helmuth, Nicholas Freitag McPhee, Lee Spector

Artificial Intelligence · Proceedings of the Genetic and Evolutionary Computation Conference · · cited 63× · DOI ↗ · more like this ·

Most genetic programming systems use mutation and crossover operators to create child programs from selected parent programs. Typically the mutation operator will replace a randomly chosen subprogram in the parent with a new, randomly generated subprogram. In systems with linear genomes, a uniform mutation operator can be used that has some probability of replacing any particular gene with a new, randomly chosen gene. In this paper, we present a new uniform mutation operator called Uniform Mutation by Addition and Deletion (UMAD), which first adds genes with some probability before or after every existing gene, and then deletes random genes from the resulting genome. In UMAD it is not necessary that the new genes replace old genes, as the additions and deletions can occur in different locations. We find that UMAD, with relatively high rates of addition and deletion, results in…

Genetic programming for finite algebras

Lee Spector, David M. Clark, Ian Lindsay +2 more

Artificial Intelligence · · cited 61× · DOI ↗ · more like this ·

We describe the application of genetic programming (GP) to a problem in pure mathematics, in the study of finite algebras. We document the production of human-competitive results in the discovery of particular algebraic terms, namely discriminator, Pixley, majority and Mal'cev terms, showing that GP can exceed the performance of every prior method of finding these terms in either time or size by several orders of magnitude. Our terms were produced using the ECJ and PushGP genetic programming systems in a variety of configurations. We compare the results of GP to those of exhaustive search, random search, and algebraic methods.

Improving generalization of evolved programs through automatic simplification

Thomas Helmuth, Nicholas Freitag McPhee, Edward Pantridge +1 more

Artificial Intelligence · Proceedings of the Genetic and Evolutionary Computation Conference · · cited 59× · DOI ↗ · more like this ·

Programs evolved by genetic programming unfortunately often do not generalize to unseen data. Reliable synthesis of programs that generalize to unseen data is therefore an important open problem. We present evidence that smaller programs evolved using the PushGP system tend to generalize better over a range of program synthesis problems. Like in many genetic programming systems, programs evolved by PushGP usually have pieces that can be removed without changing the behavior of the program. We describe methods for automatically simplifying evolved programs to make them smaller and potentially improve their generalization. We present five simplification methods and analyze their strengths and weaknesses on a suite of general program synthesis benchmark problems. All of our methods use a straightforward hill-climbing procedure to remove pieces of a program while ensuring that the resulting…

Genetic Programming for Reward Function Search

Scott Niekum, Andrew G. Barto, Lee Spector

Artificial Intelligence · IEEE Transactions on Autonomous Mental Development · · cited 56× · DOI ↗ · more like this ·

Reward functions in reinforcement learning have largely been assumed given as part of the problem being solved by the agent. However, the psychological notion of intrinsic motivation has recently inspired inquiry into whether there exist alternate reward functions that enable an agent to learn a task more easily than the natural task-based reward function allows. This paper presents a genetic programming algorithm to search for alternate reward functions that improve agent learning performance. We present experiments that show the superiority of these reward functions, demonstrate the possible scalability of our method, and define three classes of problems where reward function search might be particularly useful: distributions of environments, nonstationary environments, and problems with short agent lifetimes.

Group size, individual role differentiation and effectiveness of cooperation in a homogeneous group of hunters

Ramón Escobedo, Cristina Muro, Lee Spector +1 more

Sociology and Political Science · Journal of The Royal Society Interface · · cited 52× · DOI ↗ · more like this ·

The emergence of cooperation in wolf-pack hunting is studied using a simple, homogeneous, particle-based computational model. Wolves and prey are modelled as particles that interact through attractive and repulsive forces. Realistic patterns of wolf aggregation readily emerge in numerical simulations, even though the model includes no explicit wolf-wolf attractive forces, showing that the form of cooperation needed for wolf-pack hunting can take place even among strangers. Simulations are used to obtain the stationary states and equilibria of the wolves and prey system and to characterize their stability. Different geometric configurations for different pack sizes arise. In small packs, the stable configuration is a regular polygon centred on the prey, while in large packs, individual behavioural differentiation occurs and induces the emergence of complex behavioural patterns between…

Size control via size fair genetic operators in the PushGP genetic programming system

Raphael Crawford-Marks, Lee Spector

Artificial Intelligence · Genetic and Evolutionary Computation Conference · · cited 50× · OpenAlex ↗ · more like this ·

The growth of program size during evolution (code “bloat”) is a well-documented and well-studied problem in genetic programming. This paper examines the use of “size fair ” genetic operators to combat code bloat in the PushGP genetic programming system. Size fair operators are compared to naive operators and to operators that use “node selection” as described by Koza. The effects of the operator choices are assessed in runs on symbolic regression, parity and multiplexor problems (2,700 runs in total). The results show that the size fair operators control bloat well while producing unusually parsimonious solutions. The computational effort required to find a solution using size fair operators is about equal to, or slightly better than, the effort required using the comparison operators. 1

Quantum circuits for OR and AND of ORs

Howard Barnum, H. J. Bernstein, Lee Spector

Artificial Intelligence · Journal of Physics A Mathematical and General · · cited 50× · DOI ↗ · more like this ·

We give the first quantum circuit, derived with the aid of genetic programming, for computing $f(0)$ OR $f(1)$ more reliably than is classically possible with a single evaluation of the function. OR therefore joins XOR (i.e. parity, $f(0) \oplus f(1)$) to give the full set of logical connectives (up to relabeling of inputs and outputs) for which there is quantum speedup.

Criticism, culture, and the automatic generation of artworks

Lee Spector, Adam Alpern

Computer Vision and Pattern Recognition · National Conference on Artificial Intelligence · · cited 49× · OpenAlex ↗ · more like this ·

Researchers wishing to create computational systems that themselves generate artworks face two interacting challenges. The first is that the standards by which artistic output is judged are notoriously difficult to quantify. The larger AI community is currently involved in a rich internal dialogue on methodological issues, standards, and rigor, and hence murkiness with regard to the assessment of output must be faced squarely. The second challenge is that any artwork exists within an extraordinarily rich cultural and historical context, and it is rare that an artist who is ignorant of this context will produce acceptable works. In this paper we assert that these considerations argue for case-based AI/Art systems that take critical criteria as parameters. We describe an example system that produces new bebop jazz melodies from a case-base of melodies, using genetic programming techniques…

Test Scrambling and Student Performance

Stephan F. Gohmann, Lee Spector

Education · The Journal of Economic Education · · cited 43× · DOI ↗ · more like this ·

During the past several years, as budgets have become tighter, many colleges have increased the size of the typical principles of economics class. Lecture classes of more than one hundred students have become common, and many instructors who formerly used essay exams have switched to more easily graded multiple-choice exams. Such a change troubles many faculty members because of the increased potential for cheating. One method of counteracting this potential is to use multiple forms of the same exam. Typically, a professor creates one form of the exam and then asks a secretary to create another form by rearranging the questions. This procedure produces one content-ordered exam that matches the order in which the material was presented in class and one exam that has a scrambled order. Students may perform better on a content-ordered exam because they have less test anxiety. They may also…

Lexicase selection in Learning Classifier Systems

Sneha Aenugu, Lee Spector

cs.NE · · cited 42× · arXiv ↗ · more like this ·

The lexicase parent selection method selects parents by considering performance on individual data points in random order instead of using a fitness function based on an aggregated data accuracy. While the method has demonstrated promise in genetic programming and more recently in genetic algorithms, its applications in other forms of evolutionary machine learning have not been explored. In this paper, we investigate the use of lexicase parent selection in Learning Classifier Systems (LCS) and study its effect on classification problems in a supervised setting. We further introduce a new variant of lexicase selection, called batch-lexicase selection, which allows for the tuning of selection pressure. We compare the two lexicase selection methods with tournament and fitness proportionate selection methods on binary classification problems. We show that batch-lexicase selection results in…

Genetic programming and AI planning systems

Lee Spector

Artificial Intelligence · National Conference on Artificial Intelligence · · cited 42× · OpenAlex ↗ · more like this ·

Genetic programming (GP) is an automatic programming technique that has recently been applied to a wide range of problems including blocks-world planning. This paper describes a series of illustrative experiments in which GP techniques are applied to traditional blocks-world planning problems. We discuss genetic planning in the context of traditional AI planning systems, and comment on the costs and benefits to be expected from further work.