arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Jonathan Rowe

107 papers · 1974–2026

1974: 11975: 01976: 01977: 01978: 01979: 01980: 01981: 01982: 01983: 01984: 01985: 01986: 01987: 01988: 01989: 01990: 01991: 01992: 01993: 01994: 01995: 01996: 01997: 01998: 01999: 02000: 12001: 52002: 62003: 32004: 52005: 32006: 42007: 02008: 82009: 32010: 42011: 32012: 52013: 62014: 32015: 52016: 42017: 42018: 12019: 42020: 52021: 82022: 12023: 62024: 62025: 22026: 1
1974peak 8 in 20082026

Frequent co-authors

Papers

showing 1–25 of 107 RSS

Detecting and Addressing Frustration in a Serious Game for Military Training

Jeanine A. DeFalco, Jonathan Rowe, Luc Paquette +5 more

Artificial Intelligence · International Journal of Artificial Intelligence in Education · · cited 110× · DOI ↗ · more like this ·

Tutoring systems that are sensitive to affect show considerable promise for enhancing student learning experiences. Creating successful affective responses requires considerable effort both to detect student affect and to design appropriate responses to affect. Recent work has suggested that affect detection is more effective when both physical sensors and interaction logs are used, and that context-sensitive design of affective feedback is necessary to enhance engagement and improve learning. In this paper, we provide a comprehensive report on a multi-part study that integrates detection, validation, and intervention into a unified approach. This paper examines the creation of both sensor-based and interaction-based detectors of student affect, producing successful detectors of student affect. In addition, it reports results from an investigation of motivational feedback messages…

Particle Swarm Optimization and Fitness Sharing to solve Multi-Objective Optimization Problems

M. Salazar‐Lechuga, Jonathan E. Rowe

Computational Theory and Mathematics · · cited 80× · DOI ↗ · more like this ·

The particle swarm optimization algorithm has been shown to be a competitive heuristic to solve multi-objective optimization problems. Also, fitness sharing concepts have shown to be significant when used by multi-objective optimization methods. In this paper we introduce an algorithm that makes use of these two main concepts, particle swarm optimization and fitness sharing to tackle multi-objective optimization problems.

Serious Games Get Smart: Intelligent Game‐Based Learning Environments

James C. Lester, Eun Young Ha, Seung Y. Lee +3 more

Artificial Intelligence · AI Magazine · · cited 73× · DOI ↗ · more like this ·

Intelligent game‐based learning environments integrate commercial game technologies with AI methods from intelligent tutoring systems and intelligent narrative technologies. This article introduces the Crystal Island intelligent game‐based learning environment, which has been under development in the authors' laboratory for the past seven years. After presenting Crystal Island, the principal technical problems of intelligent game‐based learning environments are discussed: narrative‐centered tutorial planning, student affect recognition, student knowledge modeling, and student goal recognition. Solutions to these problems are illustrated with research conducted with the Crystal Island learning environment

SceneCraft: Automating Interactive Narrative Scene Generation in Digital Games with Large Language Models

Vikram Kumaran, Jonathan Rowe, Bradford Mott +1 more

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · · cited 65× · DOI ↗ · more like this ·

Creating engaging interactive story-based experiences dynamically responding to individual player choices poses significant challenges for narrative-centered games. Recent advances in pre-trained large language models (LLMs) have the potential to revolutionize procedural content generation for narrative-centered games. Historically, interactive narrative generation has specified pivotal events in the storyline, often utilizing planning-based approaches toward achieving narrative coherence and maintaining the story arc. However, manual authorship is typically used to create detail and variety in non-player character (NPC) interaction to specify and instantiate plot events. This paper proposes SCENECRAFT, a narrative scene generation framework that automates NPC interaction crucial to unfolding plot events. SCENECRAFT interprets natural language instructions about scene objectives, NPC…

Modeling User Knowledge with Dynamic Bayesian Networks in Interactive Narrative Environments

Jonathan Rowe, James Lester

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · · cited 60× · DOI ↗ · more like this ·

Recent years have seen a growing interest in interactive narrative systems that dynamically adapt story experiences in response to users’ actions, preferences, and goals. However, relatively little empirical work has investigated runtime models of user knowledge for informing interactive narrative adaptations. User knowledge about plot scenarios, story environments, and interaction strategies is critical in a range of interactive narrative contexts, such as mystery and detective genre stories, as well as narrative scenarios for education and training. This paper proposes a dynamic Bayesian network approach for modeling user knowledge in interactive narrative environments. A preliminary version of the model has been implemented for the Crystal Island interactive narrative-centered learning environment. Results from an initial empirical evaluation suggest several future directions for the…

Off-Task Behavior in Narrative-Centered Learning Environments

Jonathan Rowe, Scott McQuiggan, Jennifer L. Robison +1 more

Artificial Intelligence · Frontiers in artificial intelligence and applications · · cited 59× · DOI ↗ · more like this ·

Recent years have seen increasing interest in narrative-centered learning environments. However, the same qualities that make them engaging can also introduce seductive details that invite off-task behavior. This paper examines off-task behavior in the CRYSTAL ISLAND narrative-centered learning environment. Results from an empirical study examining the relationships between student test performance, individual differences, and off-task behavior are presented. The study found negative correlations between off-task behavior and test performance, as well as significant gender effects on the total amount of off-task behavior. Initial conclusions from a path analysis conducted on students' action sequences are also presented.

Goal Recognition with Markov Logic Networks for Player-Adaptive Games

Eun Young Ha, Jonathan E. Rowe, Bradford Mott +1 more

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence · · cited 55× · DOI ↗ · more like this ·

Goal recognition in digital games involves inferring players’ goals from observed sequences of low-level player actions. Goal recognition models support player-adaptive digital games, which dynamically augment game events in response to player choices for a range of applications, including entertainment, training, and education. However, digital games pose significant challenges for goal recognition, such as exploratory actions and ill-defined goals. This paper presents a goal recognition framework based on Markov logic networks (MLNs). The model’s parameters are directly learned from a corpus that was collected from player interactions with a non-linear educational game. An empirical evaluation demonstrates that the MLN goal recognition framework accurately predicts players’ goals in a game environment with exploratory actions and ill-defined goals.

Player goal recognition in open-world digital games with long short-term memory networks

Wookhee Min, Bradford Mott, Jonathan Rowe +2 more

Artificial Intelligence · International Joint Conference on Artificial Intelligence · · cited 54× · OpenAlex ↗ · more like this ·

Recent years have seen a growing interest in player modeling for digital games. Goal recognition, which aims to accurately recognize players' goals from observations of low-level player actions, is a key problem in player modeling. However, player goal recognition poses significant challenges because of the inherent complexity and uncertainty pervading gameplay. In this paper, we formulate player goal recognition as a sequence labeling task and introduce a goal recognition framework based on long short-term memory (LSTM) networks. Results show that LSTM-based goal recognition is significantly more accurate than previous state-of-the-art methods, including n-gram encoded feedforward neural networks pre-trained with stacked denoising autoencoders, as well as Markov logic network-based models. Because of increased goal recognition accuracy and the elimination of labor-intensive feature…

Enhancing Student Models in Game-based Learning with Facial Expression Recognition

Robert G. Sawyer, Andy Smith, Jonathan Rowe +2 more

Artificial Intelligence · · cited 53× · DOI ↗ · more like this ·

Recent years have seen a growing recognition of the role that affect plays in learning. Because game-based learning environments elicit a wide range of student affective states, affect-enhanced student modeling for game-based learning holds considerable promise. This paper introduces an affect-enhanced student modeling framework that leverages facial expression tracking for game-based learning. The affect-enhanced student modeling framework was used to generate predictive models of student learning and student engagement for students who interacted with CRYSTAL ISLAND, a game-based learning environment for microbiology education. Findings from the study reveal that the affect-enhanced student models significantly outperform baseline predictive student models that utilize the same gameplay traces but do not use facial expression tracking. The study also found that models based on…

Deep Learning-Based Goal Recognition in Open-Ended Digital Games

Wookhee Min, Eun Young Ha, Jonathan Rowe +2 more

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · · cited 52× · DOI ↗ · more like this ·

While many open-ended digital games feature non-linear storylines and multiple solution paths, it is challenging for game developers to create effective game experiences in these settings due to the freedom given to the player. To address these challenges, goal recognition, a computational player-modeling task, has been investigated to enable digital games to dynamically predict players’ goals. This paper presents a goal recognition framework based on stacked denoising autoencoders, a variant of deep learning. The learned goal recognition models, which are trained from a corpus of player interactions, not only offer improved performance, but also offer the substantial advantage of eliminating the need for labor-intensive feature engineering. An evaluation demonstrates that the deep learning-based goal recognition framework significantly outperforms the previous state-of-the-art goal…

Interactive Narrative Personalization with Deep Reinforcement Learning

Pengcheng Wang, Jonathan Rowe, Wookhee Min +2 more

Artificial Intelligence · · cited 50× · DOI ↗ · more like this ·

Data-driven techniques for interactive narrative generation are the subject of growing interest. Reinforcement learning (RL) offers significant potential for devising data-driven interactive narrative generators that tailor players’ story experiences by inducing policies from player interaction logs. A key open question in RL-based interactive narrative generation is how to model complex player interaction patterns to learn effective policies. In this paper we present a deep RL-based interactive narrative generation framework that leverages synthetic data produced by a bipartite simulated player model. Specifically, the framework involves training a set of Q-networks to control adaptable narrative event sequences with long short-term memory network-based simulated players. We investigate the deep RL framework’s performance with an educational interactive narrative, Crystal Island.…

The choice of the offspring population size in the (1,λ) EA

Jonathan E. Rowe, Dirk Sudholt

Artificial Intelligence · University of Birmingham Research Portal (University of Birmingham) · · cited 47× · DOI ↗ · more like this ·

We extend the theory of non-elitist evolutionary algorithms (EAs) by considering the offspring population size in the (1,λ) EA. We establish a sharp threshold at λ = log{\frac{e}{e-1}} n ≈5 log10 n between exponential and polynomial running times on OneMax. For any smaller value, the (1,λ) EA needs exponential time on every function that has only one global optimum. We also consider arbitrary unimodal functions and show that the threshold can shift towards larger offspring population sizes. Finally, we investigate the relationship between the offspring population size and arbitrary mutation rates on OneMax. We get sharp thresholds for λ that decrease with the mutation rate. This illustrates the balance between selection and mutation.

Predictive Student Modeling in Game-Based Learning Environments with Word Embedding Representations of Reflection

Michael Geden, Andrew Emerson, Dan Carpenter +3 more

Artificial Intelligence · International Journal of Artificial Intelligence in Education · · cited 46× · DOI ↗ · more like this ·

Game-based learning environments are designed to provide effective and engaging learning experiences for students. Predictive student models use trace data extracted from students’ in-game learning behaviors to unobtrusively generate early assessments of student knowledge and skills, equipping game-based learning environments with the capacity to anticipate student outcomes and proactively deliver adaptive scaffolding or notify instructors. Reflection is a key component of self-regulated learning, and it is critical in effective learning. However, there is currently limited work exploring the utility of reflection for inducing accurate predictive student models. This article presents a predictive student modeling framework that leverages natural language responses to in-game reflection prompts to predict student learning outcomes in a game-based learning environment for middle school…

Focused no free lunch theorems

Darrell Whitley, Jonathan E. Rowe

Artificial Intelligence · University of Birmingham Research Portal (University of Birmingham) · · cited 45× · DOI ↗ · more like this ·

Proofs and empirical evidence are presented which show that a subset of algorithms can have identical performance over a subset of functions, even when the subset of functions is not closed under permutation. We refer to these as focused sets. In some cases focused sets correspond to the orbit of a permutation group; in other cases, the focused sets must be computed heuristically. In the smallest case, two algorithms can have identical performance over just two functions in a focused set. These results particularly exploit the case where search is limited to m steps, where m is significantly smaller than the size of the search space.

Group Properties of Crossover and Mutation

Jonathan E. Rowe, Michael D. Vose, Alden H. Wright

Computational Theory and Mathematics · Evolutionary Computation · · cited 45× · DOI ↗ · more like this ·

It is supposed that the finite search space omega has certain symmetries that can be described in terms of a group of permutations acting upon it. If crossover and mutation respect these symmetries, then these operators can be described in terms of a mixing matrix and a group of permutation matrices. Conditions under which certain subsets of omega are invariant under crossover are investigated, leading to a generalization of the term schema. Finally, it is sometimes possible for the group acting on omega to induce a group structure on omega itself.

Properties of Gray and Binary Representations

Jonathan E. Rowe, Darrell Whitley, Laura Barbulescu +1 more

Artificial Intelligence · Evolutionary Computation · · cited 44× · DOI ↗ · more like this ·

Representations are formalized as encodings that map the search space to the vertex set of a graph. We define the notion of bit equivalent encodings and show that for such encodings the corresponding Walsh coefficients are also conserved. We focus on Gray codes as particular types of encoding and present a review of properties related to the use of Gray codes. Gray codes are widely used in conjunction with genetic algorithms and bit-climbing algorithms for parameter optimization problems. We present new convergence proofs for a special class of unimodal functions; the proofs show that a steepest ascent bit climber using any reflected Gray code representation reaches the global optimum in a number of steps that is linear with respect to the encoding size. There are in fact many different Gray codes. Shifting is defined as a mechanism for dynamically switching from one Gray code…

Unbiased black box search algorithms

Jonathan E. Rowe, Michael D. Vose

Artificial Intelligence · University of Birmingham Research Portal (University of Birmingham) · · cited 43× · DOI ↗ · more like this ·

We formalize the concept of an unbiased black box algorithm, which generalises the idea previously introduced by Lehre and Witt. Our formalization of bias relates to the symmetry group of the problem class under consideration, establishing a connection with previous work on No Free Lunch. Our definition is motivated and justified by a series of results, including the outcome that given a biased algorithm, there exists a corresponding unbiased algorithm with the same expected behaviour (over the problem class) and equal or better worst-case performance. For the case of evolutionary algorithms, it is already known how to construct unbiased mutation and crossover operators, and we summarise those results.

Run-Time Analysis of Population-Based Evolutionary Algorithm in Noisy Environments

Adam Prügel‐Bennett, Jonathan E. Rowe, Jonathan Shapiro

Artificial Intelligence · Research Explorer (The University of Manchester) · · cited 40× · DOI ↗ · more like this ·

This paper analyses a generational evolutionary algorithm using only selection and uniform crossover. With a probability arbitrarily close to one the evolutionary algorithm is shown to solve onemax in O(n log2(n)) function evaluations using a population of size c,n, log(n). We then show that this algorithm can solve onemax with noise variance n again in O(n log2(n)) function evaluations.

The benefits and limitations of voting mechanisms in evolutionary optimisation

Jonathan E. Rowe, N.A. Aishwaryaprajna

Artificial Intelligence · University of Birmingham Research Portal (University of Birmingham) · · cited 39× · DOI ↗ · more like this ·

We study the use of voting mechanisms in populations, and introduce a new Voting algorithm which can solve ONEMAX and JUMP in O(n log n), even for gaps as large as O(n). More significantly, the algorithm solves ONEMAX with added posterior noise in O(n log n), when the variance of the noise distribution is σ2 = O(n) and in O(σ2 log n) when the noise variance is greater than this. We assume only that the noise distribution has finite mean and variance and (for the larger noise case) that it is unimodal. We also examine the performance on arbitrary linear and monotonic functions. The Voting algorithm fails on LEADINGSONES but we give a variant which can solve the problem in O(n log n). We empirically study the use of voting in population based algorithms (UMDA, PCEA and cGA) and show that this can be effective for large population sizes.

Sensor-Free or Sensor-Full: A Comparison of Data Modalities in Multi-Channel Affect Detection.

Luc Paquette, Jonathan Rowe, Ryan S. Baker +6 more

Artificial Intelligence · · cited 35× · OpenAlex ↗ · more like this ·

Computational models that automatically detect learners’ affective states are powerful tools for investigating the interplay of affect and learning. Over the past decade, affect detectors—which recognize learners’ affective states at run-time using behavior logs and sensor data—have advanced substantially across a range of K-12 and postsecondary education settings. Machine learningbased affect detectors can be developed to utilize several types of data, including software logs, video/audio recordings, tutorial dialogues, and physical sensors. However, there has been limited research on how different data modalities combine and complement one another, particularly across different contexts, domains, and populations. In this paper, we describe work using the Generalized Intelligent Framework for Tutoring (GIFT) to build multi-channel affect detection models for a serious game on tactical…

Considering Alternate Futures to Classify Off-Task Behavior as Emotion Self-Regulation: A Supervised Learning Approach

Jennifer Sabourin, Jonathan Rowe, Bradford Mott +1 more

Computer Science Applications · Zenodo (CERN European Organization for Nuclear Research) · · cited 29× · DOI ↗ · more like this ·

Over the past decade, there has been growing interest in real-time assessment of student engagement and motivation during interactions with educational software. Detecting symptoms of disengagement, such as offtask behavior, has shown considerable promise for understanding students' motivational characteristics during learning. In this paper, we investigate the affective role of off-task behavior by analyzing data from student interactions with CRYSTAL ISLAND, a narrative-centered learning environment for middle school microbiology. We observe that off-task behavior is associated with reduced student learning, but preliminary analyses of students' affective transitions suggest that off-task behavior may also serve a productive role for some students coping with negative affective states such as frustration. Empirical findings imply that some students may use off-task behavior as a…

A framework for narrative adaptation in interactive story-based learning environments

Jonathan Rowe, Lucy R. Shores, Bradford Mott +1 more

Sociology and Political Science · · cited 25× · DOI ↗ · more like this ·

A key functionality provided by interactive narrative systems is narrative adaptation: augmenting story experiences in response to users' actions, and tailoring story elements to individual users' preferences and needs. However, the task of interactive narrative adaptation is not yet well defined. There is little consensus about the key features of a general model for narrative adaptation, which results in a limited ability to draw comparisons between alternate solutions. This paper aims to synthesize a diverse range of approaches to narrative adaptation, as well as related experience management techniques from intelligent tutoring systems, in order to devise a framework for more clearly conceptualizing the general task of interactive narrative adaptation. The framework has three components: plot adaptation, discourse adaptation, and user tailoring. The conceptual framework is…

Optimizing Player Experience in Interactive Narrative Planning: A Modular Reinforcement Learning Approach

Jonathan Rowe, Bradford Mott, James C. Lester

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · · cited 24× · DOI ↗ · more like this ·

Recent years have witnessed growing interest in data-driven approaches to interactive narrative planning and drama management. Reinforcement learning techniques show particular promise because they can automatically induce and refine models for tailoring game events by optimizing reward functions that explicitly encode interactive narrative experiences’ quality. Due to the inherently subjective nature of interactive narrative experience, designing effective reward functions is challenging. In this paper, we investigate the impacts of alternate formulations of reward in a reinforcement learning-based interactive narrative planner for the Crystal Island game environment. We formalize interactive narrative planning as a modular reinforcement-learning (MRL) problem. By decomposing interactive narrative planning into multiple independent sub-problems, MRL enables efficient induction of…

A Supervised Learning Framework for Modeling Director Agent Strategies in Educational Interactive Narrative

Seung Y. Lee, Jonathan Rowe, Bradford Mott +1 more

Artificial Intelligence · IEEE Transactions on Computational Intelligence and AI in Games · · cited 23× · DOI ↗ · more like this ·

Computational models of interactive narrative offer significant potential for creating educational game experiences that are procedurally tailored to individual players and support learning. A key challenge posed by interactive narrative is devising effective director agent models that dynamically sequence story events according to players' actions and needs. In this paper, we describe a supervised machine-learning framework to model director agent strategies in an educational interactive narrative Crystal Island. Findings from two studies with human participants are reported. The first study utilized a Wizard-of-Oz paradigm where human “wizards” directed participants through Crystal Island's mystery storyline by dynamically controlling narrative events in the game environment. Interaction logs yielded training data for machine learning the conditional probabilities of a dynamic…

A schema theory analysis of mutation size biases in genetic programming with linear representations

Nicholas Freitag McPhee, Riccardo Poli, Jonathan E. Rowe

Artificial Intelligence · OpenGrey (Institut de l'Information Scientifique et Technique) · · cited 23× · DOI ↗ · more like this ·

Understanding operator bias in evolutionary computation is important because it is possible for the operator's biases to work against the intended biases induced by the fitness function. Developments in genetic programming (GP) schema theory can be used to better understand the biases induced by the standard subtree crossover when GP is applied to variable-length linear structures. In this paper, we use the schema theory to better understand the biases induced on linear structures by two common GP subtree mutation operators: FULL and GROW mutation. In both cases, we find that the operators do have quite specific biases and typically strongly oversample shorter strings.