arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Sam Snodgrass

34 papers · 2013–2024

2013: 22014: 32015: 12016: 52017: 82018: 22019: 52020: 42021: 02022: 12023: 12024: 2
2013peak 8 in 20172024

Frequent co-authors

Papers

showing 1–25 of 34 RSS

Procedural Content Generation via Machine Learning (PCGML)

Adam Summerville, Sam Snodgrass, Matthew Guzdial +5 more

cs.AI · · cited 474× · arXiv ↗ · more like this ·

This survey explores Procedural Content Generation via Machine Learning (PCGML), defined as the generation of game content using machine learning models trained on existing content. As the importance of PCG for game development increases, researchers explore new avenues for generating high-quality content with or without human involvement; this paper addresses the relatively new paradigm of using machine learning (in contrast with search-based, solver-based, and constructive methods). We focus on what is most often considered functional game content such as platformer levels, game maps, interactive fiction stories, and cards in collectible card games, as opposed to cosmetic content such as sprites and sound effects. In addition to using PCG for autonomous generation, co-creativity, mixed-initiative design, and compression, PCGML is suited for repair, critique, and content analysis…

Deep Learning for Procedural Content Generation

Jialin Liu, Sam Snodgrass, Ahmed Khalifa +3 more

cs.AI · · cited 190× · arXiv ↗ · more like this ·

Procedural content generation in video games has a long history. Existing procedural content generation methods, such as search-based, solver-based, rule-based and grammar-based methods have been applied to various content types such as levels, maps, character models, and textures. A research field centered on content generation in games has existed for more than a decade. More recently, deep learning has powered a remarkable range of inventions in content production, which are applicable to games. While some cutting-edge deep learning methods are applied on their own, others are applied in combination with more traditional methods, or in an interactive setting. This article surveys the various deep learning methods that have been applied to generate game content directly or indirectly, discusses deep learning methods that could be used for content generation purposes but are rarely…

The VGLC: The Video Game Level Corpus

Adam James Summerville, Sam Snodgrass, Michael Mateas +1 more

cs.HC · · cited 137× · arXiv ↗ · more like this ·

Levels are a key component of many different video games, and a large body of work has been produced on how to procedurally generate game levels. Recently, Machine Learning techniques have been applied to video game level generation towards the purpose of automatically generating levels that have the properties of the training corpus. Towards that end we have made available a corpora of video game levels in an easy to parse format ideal for different machine learning and other game AI research purposes.

Learning to Generate Video Game Maps Using Markov Models

Sam Snodgrass, Santiago Ontañón

Artificial Intelligence · IEEE Transactions on Computational Intelligence and AI in Games · · cited 75× · DOI ↗ · more like this ·

Procedural content generation has become a popular research topic in recent years. However, most content generation systems are specialized to a single game. We are interested in methods that can generate content for a wide variety of games without a game-specific algorithm design. Statistical approaches are a promising avenue for such generators and, more specifically, map generators. In this paper, we explore Markov models as a means of modeling and generating content for multiple domains. We apply our Markov models to Super Mario Bros., Loderunner , and Kid Icarus in order to determine how well our models perform in terms of the playability of the content generated, the expressive ranges of the models, and the effects of training data on those expressive ranges.

Is My Game OK Dr. Scratch?

Giovanni Maria Troiano, Sam Snodgrass, Erinç Argımak +6 more

Computer Science Applications · · cited 49× · DOI ↗ · more like this ·

Computational thinking (CT) is key to digital literacy and helps develop problem-solving skills, which are fundamental in modern school. As game design shows potential for teaching CT, metrics like Dr. Scratch emerge that help scholars systematically assess the CT of student-designed games, particularly with Scratch. Compared to other CT metrics, Dr. Scratch scores the CT of Scratch projects automatically and can be used to describe CT development. However, previous research using Dr. Scratch summatively assessed CT, but did not look at CT development. We use Dr. Scratch to assess the CT development of Scratch games designed by 8th-grade students in STEM curricula. We show how CT proficiency in student-designed games develops differently in each CT dimension, where parallelism, synchronization, and logic develop proficiently, while developing abstraction seems hard. We discuss insights…

Controllable procedural content generation via constrained multi-dimensional Markov chain sampling

Sam Snodgrass, Santiago Ontañón

Computer Vision and Pattern Recognition · International Joint Conference on Artificial Intelligence · · cited 39× · OpenAlex ↗ · more like this ·

Statistical models, such as Markov chains, have recently started to be studied for the purpose of Procedural Content Generation (PCG). A major problem with this approach is controlling the sampling process in order to obtain output satisfying some desired constraints. In this paper we present three approaches to constraining the content generated using multi-dimensional Markov chains: (1) a generate and test approach that simply resamples the content until the desired constraints are satisfied, (2) an approach that finds and resamples parts of the generated content that violate the constraints, and (3) an incremental method that checks for constraint violations during sampling. We test our approaches by generating maps for two classic video games, Super Mario Bros. and Kid Icarus.

Understanding mario

Adam Summerville, Julian R. H. Mariño, Sam Snodgrass +2 more

Artificial Intelligence · · cited 37× · DOI ↗ · more like this ·

Evaluating the output of content generators is still one of the key open research challenges in Procedural Content Generation (PCG). This paper presents a collection of metrics for evaluating the quality of platform game levels, and analyzes how well these metrics are able to capture the human-perceived difficulty, visual aesthetics and enjoyment of these levels. We show empirically, in the context of Infinite Mario Bros (IMB), that some of the proposed metrics yield correlation values with human ratings that are near empirical upper bounds derived from a human inter-rater agreement study. We also show that a simple linear regression model using a subset of our metrics as input features is able to substantially outperform a previous approach that uses a neural network for predicting human-perceived difficulty, visual aesthetics, and enjoyment in IMB levels.

A Hierarchical MdMC Approach to 2D Video Game Map Generation

Sam Snodgrass, Santiago Ontañón

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · · cited 29× · DOI ↗ · more like this ·

In this paper we describe a hierarchical method for procedurally generating 2D game maps using multi-dimensional Markov chains (MdMCs). Our method takes a collection of 2D game maps, breaks them into small chunks and performs clustering to find a set of chunks that correspond to high-level structures (high-level tiles) in the training maps. This set of high-level tiles is then used to re-represent the training maps, and to fit two sets of MdMC models: a high-level model captures the distribution of high-level tiles in the map, and a set of low-level models capture the internal structure of each high-level tile. These two sets of models can then be used to hierarchically generate new maps. We test our approach using two classic games, Super Mario Bros. and Loderunner, and compare the results against other existing map generators.

Exploring Level Blending across Platformers via Paths and Affordances

Anurag Sarkar, Adam Summerville, Sam Snodgrass +2 more

cs.LG · · cited 27× · arXiv ↗ · more like this ·

Techniques for procedural content generation via machine learning (PCGML) have been shown to be useful for generating novel game content. While used primarily for producing new content in the style of the game domain used for training, recent works have increasingly started to explore methods for discovering and generating content in novel domains via techniques such as level blending and domain transfer. In this paper, we build on these works and introduce a new PCGML approach for producing novel game content spanning multiple domains. We use a new affordance and path vocabulary to encode data from six different platformer games and train variational autoencoders on this data, enabling us to capture the latent level space spanning all the domains and generate new content with varying proportions of the different domains.

Multi-Domain Level Generation and Blending with Sketches via Example-Driven BSP and Variational Autoencoders

Sam Snodgrass, Anurag Sarkar

cs.LG · · cited 26× · arXiv ↗ · more like this ·

Procedural content generation via machine learning (PCGML) has demonstrated its usefulness as a content and game creation approach, and has been shown to be able to support human creativity. An important facet of creativity is combinational creativity or the recombination, adaptation, and reuse of ideas and concepts between and across domains. In this paper, we present a PCGML approach for level generation that is able to recombine, adapt, and reuse structural patterns from several domains to approximate unseen domains. We extend prior work involving example-driven Binary Space Partitioning for recombining and reusing patterns in multiple domains, and incorporate Variational Autoencoders (VAEs) for generating unseen structures. We evaluate our approach by blending across $7$ domains and subsets of those domains. We show that our approach is able to blend domains together while retaining…

An Approach to Domain Transfer in Procedural Content Generation of Two-Dimensional Videogame Levels

Sam Snodgrass, Santiago Ontañón

Computer Vision and Pattern Recognition · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · · cited 19× · DOI ↗ · more like this ·

Statistical models, such as Markov Chains, have been recently studied in the context of procedural content generation (PCG). These models can capture statistical regularities of a set of training data and use them to sample new content. However, these techniques assume the existence of sufficient training data with which to train the models. In this paper we study the setting in which we might not have enough training data from the target domain, but we have ample training data from another, similar domain. We propose an algorithm to discover a mapping between domains, so that out-of-domain training data can be used to train the statistical model. Specifically, we apply this to two-dimensional level generation, and experiment with three classic video games: Super Mario Bros., Kid Icarus and Kid Kool.

Generating Maps Using Markov Chains

Sam Snodgrass, Santiago Ontañón

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · · cited 19× · DOI ↗ · more like this ·

In this paper we outline a method of procedurally generating maps using Markov Chains. Our method attempts to learn what makes a "good" map from a set of given human-authored maps, and then uses those learned patterns to generate new maps. We present an empirical evaluation using the game "Super Mario Bros.," showing encouraging results.

Procedural level generation using multi-layer level representations with MdMCs

Sam Snodgrass, Santiago Ontañón

Hardware and Architecture · · cited 18× · DOI ↗ · more like this ·

The use of statistical and machine learning approaches, such as Markov chains, for procedural content generation (PCG) has been growing in recent years in the field of Game AI. However, many of these level generation approaches account for only the structural properties of the levels. We developed multi-layered representations of levels, where each layer is designed to capture distinct gameplay information. Specifically, we experiment with representing levels using three layers: a structural layer that captures the object placements in the level, a player path layer that captures the path of an agent through the level, and a height layer that captures sections of the level as various height groups. We test our approach by generating levels for Super Mario Bros. with a multi-dimensional Markov chain approach. We compare the levels sampled with our multi-layered representation with those…

A Hierarchical Approach to Generating Maps Using Markov Chains

Sam Snodgrass, Santiago Ontañón

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · · cited 17× · DOI ↗ · more like this ·

In this paper we describe a hierarchical method for procedurallygenerating maps using Markov chains. Ourmethod takes as input a collection of human-authoredtwo-dimensional maps, and splits them into high-leveltiles which capture large structures. Markov chains arethen learned from those maps to capture the structure ofboth the high-level tiles, as well as the low-level tiles.Then, the learned Markov chains are used to generatenew maps by first generating the high-level structure ofthe map using high-level tiles, and then generating thelow-level layout of the map. We validate our approachusing the game Super Mario Bros., by evaluating thequality of maps produced using different configurationsfor training and generation.

Like PEAS in PoDS

Sam Snodgrass, Omid Mohaddesi, Jack Hart +3 more

Sociology and Political Science · · cited 15× · DOI ↗ · more like this ·

Personalization has been explored in the context of games in many forms (e.g., dynamic difficulty adjustment, affective video games, adaptive systems, experience-driven PCG, etc.). The majority of techniques used in these fields have relied on data-driven or manual methods for identifying game components to modify for personalization. We propose a theoretical framework for identifying and categorizing low-level components of games that can be personalized. In this paper we first perform a review of game design frameworks and personalization approaches. We then systematically identify the aspects of games which have been utilized for personalization and which components have been identified in game design frameworks as building blocks of games. We synthesize the identified components into categories of game elements. We then propose PEAS, a theoretical framework for personalization…

Exploratory Automated Analysis of Structural Features of Interactive Narrative

Nathan Partlan, Elín Carstensdóttir, Sam Snodgrass +4 more

Sociology and Political Science · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · · cited 15× · DOI ↗ · more like this ·

Analysis of interactive narrative is a complex undertaking, requiring understanding of the narrative's design, its affordances, and its impact on players. Analysis is often performed by an expert, but this is expensive and difficult for complex interactive narratives. Automated analysis of structure, the organization of interaction elements, could help augment an expert's analysis. For this purpose we developed a model consisting of a set of metrics to analyze interactive narrative structure, enabled by a novel multi-graph representation. We implemented this model for an interactive scenario authoring tool called StudyCrafter and analyzed 20 student-designed scenarios. We show that the model illuminates the structures and groupings of the scenarios. This work provides insight for manual analysis of attributes of interactive narratives and a starting point for automated design assistance.

Levels from Sketches with Example-Driven Binary Space Partition

Sam Snodgrass

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · · cited 10× · DOI ↗ · more like this ·

Procedural content generation via machine learning (PCGML) has been demonstrating its usefulness as a content and game creation approach, and has been shown to be able to support human creativity. In this paper we present an example-driven adaptation of a classic PCG approach, binary space partition (BSP), that takes a structural template or sketch of a level and fills in the details from examples. We show that this example-driven adaptation can generate a diverse set of levels from a single structural template. We evaluate the levels generated in terms of difference between paths through the levels, amount of the level copied from the examples, and other common PCG level evaluation metrics. Furthermore, we compare this method to a Markov chain approach and show that our BSP approach matches the training level distribution better while generating a greater range of interesting features.

Evaluation of an automatically-constructed graph-based representation for interactive narrative

Nathan Partlan, Elín Carstensdóttir, Erica Kleinman +6 more

Sociology and Political Science · · cited 10× · DOI ↗ · more like this ·

Interactivity and player experience are inextricably entwined with the creation of compelling narratives for interactive digital media. Narrative shapes and buttresses many such experiences, and therefore designers must construct compelling narrative arcs while carefully considering the effects of interaction on both the story and the player. As the narrative becomes more structurally complex, due to choice-based branching and other player actions, designers need to employ commensurately capable models and visualizations to keep track of that growing complexity. However, previous models of interactive narrative have failed to fully capture interactive elements with automated, operationalized visualizations. In this paper, we describe an algorithm for automated construction of a framework-driven, graph-based representation of interactive narrative. This representation more fully and…

Studying the Effects of Training Data on Machine Learning-Based Procedural Content Generation

Sam Snodgrass, Adam Summerville, Santiago Ontañón

Computer Vision and Pattern Recognition · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · · cited 10× · DOI ↗ · more like this ·

The exploration of Procedural Content Generation via Machine Learning (PCGML) has been growing in recent years. However, while the number of PCGML techniques and methods for evaluating PCG techniques have been increasing, little work has been done in determining how the quality and quantity of the training data provided to these techniques effects the models or the output. Therefore, little is known about how much training data would actually be needed to deploy certain PCGML techniques in practice. In this paper we explore this question by studying the quality and diversity of the output of two well-known PCGML techniques (multi-dimensional Markov chains and Long Short-term Memory Recurrent Neural Networks) in generating Super Mario Bros. levels while varying the amount and quality of the training data.

Procedural Content Generation via Knowledge Transformation (PCG-KT)

Anurag Sarkar, Matthew Guzdial, Sam Snodgrass +3 more

cs.AI · · cited 8× · arXiv ↗ · more like this ·

We introduce the concept of Procedural Content Generation via Knowledge Transformation (PCG-KT), a new lens and framework for characterizing PCG methods and approaches in which content generation is enabled by the process of knowledge transformation -- transforming knowledge derived from one domain in order to apply it in another. Our work is motivated by a substantial number of recent PCG works that focus on generating novel content via repurposing derived knowledge. Such works have involved, for example, performing transfer learning on models trained on one game's content to adapt to another game's content, as well as recombining different generative distributions to blend the content of two or more games. Such approaches arose in part due to limitations in PCG via Machine Learning (PCGML) such as producing generative models for games lacking training data and generating content for…

Towards a generalized player model through the PEAS framework

Sam Snodgrass, Omid Mohaddesi, Casper Harteveld

Artificial Intelligence · · cited 8× · DOI ↗ · more like this ·

This paper presents steps towards a generalized player model built around an external personalization and design framework. The external framework, the Player, Environment, Agents, System (PEAS) framework, resulted from a broad scope review of the personalization, player modeling, and game design literature. Leveraging this framework allows us to define a mapping from existing player and personality models to a uniform representation of player preferences over game components. We present our pipeline for developing a generalized player model from these existing models, how to translate and blend them, and finally how to use the blended model for recommending and personalizing games. We follow up the presentation of our pipeline with an extended example to highlight how two existing player modeling approaches can be combined into a singular model, and how that blended model can be used.

“Rather Solve the Problem from Scratch”: Gamesploring Human-Machine Collaboration for Optimizing the Debris Collection Problem

Aybike Ulusan, Uttkarsh Narayan, Sam Snodgrass +2 more

Computer Science Applications · · cited 5× · DOI ↗ · more like this ·

Optimizing operations on critical infrastructure networks is key to reducing the impact of disruptive events. In this paper, we explore the potential of having humans and algorithms work together to address this difficult task. For this purpose, we use a gamified experiment to build and assess this potential in the context of the debris collection problem (i.e., “gamesploring”). We developed a digital game where players can request the help of the computer while facing a multi-objective problem of assigning contractors to road segments for clearing debris in a disaster area. Through a within-subjects experimental study, we assessed how players optimized under various circumstances (e.g., initial solution vs. from scratch) compared to the computer on its own. The results are both surprising as well as insightful: they suggest that human-machine collaboration is indeed beneficial but also…

Player movement models for platformer game level generation

Sam Snodgrass, Santiago Ontañón

Artificial Intelligence · International Joint Conference on Artificial Intelligence · · cited 4× · OpenAlex ↗ · more like this ·

The use of statistical and machine learning approaches, such as Markov chains, for procedural content generation (PCG) has been growing in recent years in the field of Game AI. However, there has been little work in learning to generate content, specifically levels, accounting for player movement within those levels. We are interested in extracting player models automatically from play traces and using those learned models, paired with a machine learning-based generator to create levels that allow the same types of movements observed in the play traces. We test our approach by generating levels for Super Mario Bros. We compare our results against the original levels, a previous constrained sampling approach, and a previous approach that learned a combined player and level model.

Not All the Same: Understanding and Informing Similarity Estimation in Tile-Based Video Games

Sebastian Berns, Vanessa Volz, Laurissa Tokarchuk +2 more

cs.HC · · cited 2× · arXiv ↗ · more like this ·

Similarity estimation is essential for many game AI applications, from the procedural generation of distinct assets to automated exploration with game-playing agents. While similarity metrics often substitute human evaluation, their alignment with our judgement is unclear. Consequently, the result of their application can fail human expectations, leading to e.g. unappreciated content or unbelievable agent behaviour. We alleviate this gap through a multi-factorial study of two tile-based games in two representations, where participants (N=456) judged the similarity of level triplets. Based on this data, we construct domain-specific perceptual spaces, encoding similarity-relevant attributes. We compare 12 metrics to these spaces and evaluate their approximation quality through several quantitative lenses. Moreover, we conduct a qualitative labelling study to identify the features…

Capturing Local and Global Patterns in Procedural Content Generation via Machine Learning

Vanessa Volz, Niels Justesen, Sam Snodgrass +5 more

cs.AI · · cited 2× · arXiv ↗ · more like this ·

Recent procedural content generation via machine learning (PCGML) methods allow learning from existing content to produce similar content automatically. While these approaches are able to generate content for different games (e.g. Super Mario Bros., DOOM, Zelda, and Kid Icarus), it is an open questions how well these approaches can capture large-scale visual patterns such as symmetry. In this paper, we propose match-three games as a domain to test PCGML algorithms regarding their ability to generate suitable patterns. We demonstrate that popular algorithm such as Generative Adversarial Networks struggle in this domain and propose adaptations to improve their performance. In particular we augment the neighborhood of a Markov Random Fields approach to not only take local but also symmetric positional information into account. We conduct several empirical tests including a user study that…