arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Nancy Fulda

31 papers · 2003–2026

2003: 32004: 02005: 12006: 12007: 12008: 02009: 02010: 02011: 02012: 02013: 02014: 02015: 02016: 12017: 12018: 22019: 12020: 62021: 22022: 52023: 32024: 12025: 12026: 2
2003peak 6 in 20202026

Frequent co-authors

Papers

showing 1–25 of 31 RSS

Out of One, Many: Using Language Models to Simulate Human Samples

Lisa P. Argyle, Ethan C. Busby, Nancy Fulda +3 more

cs.LG · · cited 1,425× · arXiv ↗ · more like this ·

We propose and explore the possibility that language models can be studied as effective proxies for specific human sub-populations in social science research. Practical and research applications of artificial intelligence tools have sometimes been limited by problematic biases (such as racism or sexism), which are often treated as uniform properties of the models. We show that the "algorithmic bias" within one such tool -- the GPT-3 language model -- is instead both fine-grained and demographically correlated, meaning that proper conditioning will cause it to accurately emulate response distributions from a wide variety of human subgroups. We term this property "algorithmic fidelity" and explore its extent in GPT-3. We create "silicon samples" by conditioning the model on thousands of socio-demographic backstories from real human participants in multiple large surveys conducted in the…

An Information-theoretic Approach to Prompt Engineering Without Ground Truth Labels

Taylor Sorensen, Joshua Robinson, Christopher Michael Rytting +6 more

cs.CL · · cited 159× · arXiv ↗ · more like this ·

Pre-trained language models derive substantial linguistic and factual knowledge from the massive corpora on which they are trained, and prompt engineering seeks to align these models to specific tasks. Unfortunately, existing prompt engineering methods require significant amounts of labeled data, access to model parameters, or both. We introduce a new method for selecting prompt templates \textit{without labeled examples} and \textit{without direct access to the model}. Specifically, over a set of candidate templates, we choose the template that maximizes the mutual information between the input and the corresponding model output. Across 8 datasets representing 7 distinct NLP tasks, we show that when a template has high mutual information, it also has high accuracy on the task. On the largest model, selecting prompts with our method gets 90\% of the way from the average prompt accuracy…

What can you do with a rock? Affordance extraction via word embeddings

Nancy Fulda, Daniel Ricks, Ben Murdoch +1 more

cs.AI · · cited 83× · arXiv ↗ · more like this ·

Autonomous agents must often detect affordances: the set of behaviors enabled by a situation. Affordance detection is particularly helpful in domains with large action spaces, allowing the agent to prune its search space by avoiding futile behaviors. This paper presents a method for affordance extraction via word embeddings trained on a Wikipedia corpus. The resulting word vectors are treated as a common knowledge database which can be queried using linear algebra. We apply this method to a reinforcement learning agent in a text-only environment and show that affordance-based action selection improves performance most of the time. Our method increases the computational complexity of each learning step but significantly reduces the total number of steps needed. In addition, the agent's action selections begin to resemble those a human would choose.

Personalized Quest and Dialogue Generation in Role-Playing Games: A Knowledge Graph- and Language Model-based Approach

Trevor Ashby, Braden K Webb, Gregory Knapp +2 more

Artificial Intelligence · · cited 60× · DOI ↗ · more like this ·

Procedural content generation (PCG) in video games offers unprecedented opportunities for customization and user engagement. Working within the specialized context of role-playing games (RPGs), we introduce a novel framework for quest and dialogue generation that places the player at the core of the generative process. Drawing on a hand-crafted knowledge base, our method grounds generated content with in-game context while simultaneously employing a large-scale language model to create fluent, unique, accompanying dialogue. Through human evaluation, we confirm that quests generated using this method can approach the performance of hand-crafted quests in terms of fluency, coherence, novelty, and creativity; demonstrate the enhancement to the player experience provided by greater dynamism; and provide a novel, automated metric for the relevance between quest and dialogue. We view our…

Predicting and preventing coordination problems in cooperative Q-learning systems

Nancy Fulda, Dan Ventura

Artificial Intelligence · International Joint Conference on Artificial Intelligence · · cited 46× · OpenAlex ↗ · more like this ·

We present a conceptual framework for creating Q-learning-based algorithms that converge to optimal equilibria in cooperative multiagent settings. This framework includes a set of conditions that are sufficient to guarantee optimal system performance. We demonstrate the efficacy of the framework by using it to analyze several well-known multi-agent learning algorithms and conclude by employing it as a design tool to construct a simple, novel multi-agent learning algorithm.

Enhanced Story Comprehension for Large Language Models through Dynamic Document-Based Knowledge Graphs

Berkeley R Andrus, Yeganeh Nasiri, Shilong Cui +2 more

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence · · cited 28× · DOI ↗ · more like this ·

Large transformer-based language models have achieved incredible success at various tasks which require narrative comprehension, including story completion, answering questions about stories, and generating stories ex nihilo. However, due to the limitations of finite context windows, these language models struggle to produce or understand stories longer than several thousand tokens. In order to mitigate the document length limitations that come with finite context windows, we introduce a novel architecture that augments story processing with an external dynamic knowledge graph. In contrast to static commonsense knowledge graphs which hold information about the real world, these dynamic knowledge graphs reflect facts extracted from the story being processed. Our architecture uses these knowledge graphs to create information-rich prompts which better facilitate story comprehension than…

Towards Coding Social Science Datasets with Language Models

Christopher Michael Rytting, Taylor Sorensen, Lisa Argyle +4 more

cs.AI · · cited 24× · arXiv ↗ · more like this ·

Researchers often rely on humans to code (label, annotate, etc.) large sets of texts. This kind of human coding forms an important part of social science research, yet the coding process is both resource intensive and highly variable from application to application. In some cases, efforts to automate this process have achieved human-level accuracies, but to achieve this, these attempts frequently rely on thousands of hand-labeled training examples, which makes them inapplicable to small-scale research studies and costly for large ones. Recent advances in a specific kind of artificial intelligence tool - language models (LMs) - provide a solution to this problem. Work in computer science makes it clear that LMs are able to classify text, without the cost (in financial terms and human effort) of alternative methods. To demonstrate the possibilities of LMs in this area of political…

Can Humor Prediction Datasets be used for Humor Generation? Humorous Headline Generation via Style Transfer

Orion Weller, Nancy Fulda, Kevin Seppi

Computer Vision and Pattern Recognition · · cited 14× · DOI ↗ · more like this ·

Understanding and identifying humor has been increasingly popular, as seen by the number of datasets created to study humor. However, one area of humor research, humor generation, has remained a difficult task, with machine generated jokes failing to match humancreated humor. As many humor prediction datasets claim to aid in generative tasks, we examine whether these claims are true. We focus our experiments on the most popular dataset, included in the 2020 SemEval's Task 7, and teach our model to take normal text and "translate" it into humorous text. We evaluate our model compared to humorous human generated headlines, finding that our model is preferred equally in A/B testing with the human edited versions, a strong success for humor generation, and is preferred over an intelligent random baseline 72% of the time. We also show that our model is assumed to be human written comparable…

A Tale of Two Cultures: Comparing Interpersonal Information Disclosure Norms on Twitter

Mainack Mondal, Anju Punuru, Tyng-Wen Scott Cheng +11 more

cs.HC · · cited 5× · arXiv ↗ · more like this ·

We present an exploration of cultural norms surrounding online disclosure of information about one's interpersonal relationships (such as information about family members, colleagues, friends, or lovers) on Twitter. The literature identifies the cultural dimension of individualism versus collectivism as being a major determinant of offline communication differences in terms of emotion, topic, and content disclosed. We decided to study whether such differences also occur online in context of Twitter when comparing tweets posted in an individualistic (U.S.) versus a collectivist (India) society. We collected more than 2 million tweets posted in the U.S. and India over a 3 month period which contain interpersonal relationship keywords. A card-sort study was used to develop this culturally-sensitive saturated taxonomy of keywords that represent interpersonal relationships (e.g., ma, mom…

Threat, Explore, Barter, Puzzle: A Semantically-Informed Algorithm for Extracting Interaction Modes.

Nancy Fulda, Daniel Ricks, Ben Murdoch +1 more

Computer Vision and Pattern Recognition · National Conference on Artificial Intelligence · · cited 5× · OpenAlex ↗ · more like this ·

In the world of online gaming, not all actions are created equal. For example, when a player's character is confronted with a closed door, it would not make much sense to brandish a weapon, apply a healing potion, or attempt to barter. A more reasonable response would be to either open or unlock the door. The term interaction mode embodies the idea that many potential actions are neither useful nor applicable in a given situation. This paper presents a AEGIM, an algorithm for the automated extraction of game interaction modes via a semantic embedding space. AEGIM uses an image captioning system in conjunction with a semantic vector space model to create a gestalt representation of in-game screenshots, thus enabling it to detect the interaction mode evoked by the game.

Dynamic Joint Action Perception for Q-Learning Agents.

Nancy Fulda, Dan Ventura

Artificial Intelligence · ScholarsArchive (Brigham Young University) · · cited 5× · OpenAlex ↗ · more like this ·

Q-learning is a reinforcement learning algorithm that learns expected utilities for state-action transitions through successive interactions with the environment. The algorithm's simplicity as well as its convergence properties have made it a popular algorithm for study. However, its non-parametric representation of utilities limits its effectiveness in environments with large amounts of perceptual input. For example, in multiagent systems, each agent may need to consider the action selections of its counterparts in order to learn effective behaviors. This creates a joint action space which grows exponentially with the number of agents in the system. In such situations, the Q-learning algorithm quickly becomes intractable. This paper presents a new algorithm, Dynamic Joint Action Perception, which addresses this problem by allowing each agent to dynamically perceive only those joint…

Immersive Gameplay via Improved Natural Language Understanding

Berkeley R Andrus, Nancy Fulda

Artificial Intelligence · · cited 3× · DOI ↗ · more like this ·

Many first-person shooters feature non-player characters (NPCs) that work alongside the player. Interfacing with these NPCs can add unnecessary complication to a game and steepen the learning curve for new players. Recent improvements in automated voice recognition and language representation have set the stage for more immersive methods of interfacing with NPCs through player speech. In this paper, we present several promising methods of classifying user utterances to extract predefined commands from unstructured speech. This framework facilitates a more flexible interface than has been used in past speech-controlled games. We also show how our methods effectively leverage small sets of example data to outperform existing industrial utterance classification systems.

Data-adaptive Transfer Learning for Translation: A Case Study in Haitian and Jamaican

Nathaniel R. Robinson, Cameron J. Hogan, Nancy Fulda +1 more

cs.CL · · cited 2× · arXiv ↗ · more like this ·

Multilingual transfer techniques often improve low-resource machine translation (MT). Many of these techniques are applied without considering data characteristics. We show in the context of Haitian-to-English translation that transfer effectiveness is correlated with amount of training data and relationships between knowledge-sharing languages. Our experiments suggest that for some languages beyond a threshold of authentic data, back-translation augmentation methods are counterproductive, while cross-lingual transfer from a sufficiently related language is preferred. We complement this finding by contributing a rule-based French-Haitian orthographic and syntactic engine and a novel method for phonological embedding. When used with multilingual techniques, orthographic transformation makes statistically significant improvements over conventional methods. And in very low-resource…

Text Classifications Learned from Language Model Hidden Layers

Nathaniel Robinson, Zachary C. Brown, Timothy Sitze +1 more

Artificial Intelligence · · cited 2× · DOI ↗ · more like this ·

Advancements in machine learning methods have yielded powerful natural language generation models. However, in general, these models have drawn concern for being both uninterpretable and uncontrollable. Model interpretability and control have become important topics of interest among researchers. We explore a variety of machine learning methods to classify the hidden states of language models. This classification enables model interpretation at a deep semantic level and is a necessary part of recently proposed model control methods. We show further that the use of language model hidden layers as text representations in classification tasks may be more reliable in some applications than more standard text representations.

Improved Word Representations Via Summed Target and Context Embeddings

Nancy Fulda, Nathaniel Robinson

Artificial Intelligence · · cited 2× · DOI ↗ · more like this ·

Neural embedding models are often described as having an `embedding layer', or a set of network activations that can be extracted from the model in order to obtain word or sentence representations. In this paper, we show via a modification of the well-known word2vec algorithm that relevant semantic information is contained throughout the entirety of the network, not just in the commonly-extracted hidden layer. This extra information can be extracted by summing embeddings from both the input and output weight matrices of a skip-gram model. Word embeddings generated via this method exhibit strong semantic structure, and are able to outperform traditionally extracted word2vec embeddings in a number of analogy tasks.

Incremental policy learning: an equilibrium selection algorithm for reinforcement learning agents with common interests

Nancy Fulda, Dan Ventura

Artificial Intelligence · ScholarsArchive (Brigham Young University) · · cited 2× · DOI ↗ · more like this ·

We present an equilibrium selection algorithm for reinforcement learning agents that incrementally adjusts the probability of executing each action based on the desirability of the outcome obtained in the last time step. The algorithm assumes that at least one coordination equilibrium exists and requires that the agents have a heuristic for determining whether or not the equilibrium was obtained. In deterministic environments with one or more strict coordination equilibria, the algorithm learns to play an optimal equilibrium as long as the heuristic is accurate. Empirical data demonstrate that the algorithm is also effective in stochastic environments and is able to learn good joint policies when the heuristic's parameters are estimated during learning, rather than known in advance.

Task-dependent Optimal Weight Combinations for Static Embeddings

Nathaniel D. Robinson, Nathaniel Carlson, David R. Mortensen +3 more

Artificial Intelligence · Northern European Journal of Language Technology · · cited 1× · DOI ↗ · more like this ·

A variety of NLP applications use word2vec skip-gram, GloVe, and fastText word embeddings. These models learn two sets of embedding vectors, but most practitioners use only one of them, or alternately an unweighted sum of both. This is the first study to systematically explore a range of linear combinations between the first and second embedding sets. We evaluate these combinations on a set of six NLP benchmarks including IR, POS-tagging, and sentence similarity. We show that the default embedding combinations are often suboptimal and demonstrate 1.0-8.0% improvements. Notably, GloVe’s default unweighted sum is its least effective combination across tasks. We provide a theoretical basis for weighting one set of embeddings more than the other according to the algorithm and task. We apply our findings to improve accuracy in applications of cross-lingual alignment and navigational…

Towards Neural Programming Interfaces

Zachary C. Brown, Nathaniel Robinson, David Wingate +1 more

cs.CL · · cited 1× · arXiv ↗ · more like this ·

It is notoriously difficult to control the behavior of artificial neural networks such as generative neural language models. We recast the problem of controlling natural language generation as that of learning to interface with a pretrained language model, just as Application Programming Interfaces (APIs) control the behavior of programs by altering hyperparameters. In this new paradigm, a specialized neural network (called a Neural Programming Interface or NPI) learns to interface with a pretrained language model by manipulating the hidden activations of the pretrained model to produce desired outputs. Importantly, no permanent changes are made to the weights of the original model, allowing us to re-purpose pretrained models for new tasks without overwriting any aspect of the language model. We also contribute a new data set construction algorithm and GAN-inspired loss function that…

Semantically Aligned Sentence-Level Embeddings for Agent Autonomy and Natural Language Understanding

Nancy Fulda

Artificial Intelligence · ScholarsArchive (Brigham Young University) · · cited 1× · OpenAlex ↗ · more like this ·

Many applications of neural linguistic models rely on their use as pre-trained features for downstream tasks such as dialog modeling, machine translation, and question answering. This work presents an alternate paradigm: Rather than treating linguistic embeddings as input features, we treat them as common sense knowledge repositories that can be queried using simple mathematical operations within the embedding space, without the need for additional training. Because current state-of-the-art embedding models were not optimized for this purpose, this work presents a novel embedding model designed and trained specifically for the purpose of "reasoning in the linguistic domain".Our model jointly represents single words, multi-word phrases, and complex sentences in a unified embedding space. To facilitate common-sense reasoning beyond straightforward semantic associations, the embeddings…

Embedding Grammars

David Wingate, William Myers, Nancy Fulda +1 more

cs.CL · · cited 1× · arXiv ↗ · more like this ·

Classic grammars and regular expressions can be used for a variety of purposes, including parsing, intent detection, and matching. However, the comparisons are performed at a structural level, with constituent elements (words or characters) matched exactly. Recent advances in word embeddings show that semantically related words share common features in a vector-space representation, suggesting the possibility of a hybrid grammar and word embedding. In this paper, we blend the structure of standard context-free grammars with the semantic generalization capabilities of word embeddings to create hybrid semantic grammars. These semantic grammars generalize the specific terminals used by the programmer to other words and phrases with related meanings, allowing the construction of compact grammars that match an entire region of the vector space rather than matching specific elements.

Neuron-Level Language Tag Injection Improves Zero-Shot Translation Performance

Jay Orten, Ammon Shurtz, Nancy Fulda +1 more

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

Language tagging, a method whereby source and target inputs are prefixed with a unique language token, has become the de facto standard for conditioning Multilingual Neural Machine Translation (MNMT) models on specific language directions.This conditioning can manifest effective zero-shot translation abilities in MT models at scale for many languages.Expanding on previous work, we propose a novel method of language tagging for MNMT, injection, in which the embedded representation of a language token is concatenated to the input of every linear layer.We explore a variety of different tagging methods, with and without injection, showing that injection improves zeroshot translation performance with up to a 2+ BLEU score point gain for certain language directions in our dataset.

You Are What You Read: The Effect of Corpus and Training Task on Semantic Absorption in Recurrent Neural Architectures

Nancy Fulda

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

Recurrent neural networks are able to capture semantic meaning within the geometry of the resultant embedding space, but the impact of training corpus and training curriculum on the structure of the learned representations remains poorly understood. This paper sheds some light on the mystery by comparing the performance of a simple recurrent model on three training tasks and two strongly divergent training corpora. The learned representations are compared on tasks including the Semantic Textual Similarity Benchmark, the Stanford Natural Language Inference Corpus, and Google’s Analogical Reasoning Test Set. Results show that context-based training produces the strongest semantic alignment within the embedding space, with reconstruction loss as an interesting close second. Pairwise comparisons of models trained on different corpora show that the choice of corpus also has powerful effects…

Getting it Right the Fourth Time: Goal-driven Behavior Using Vector Space Models

Nancy Fulda, Benjamin Murdoch, Daniel Ricks

Information Systems · · cited 0× · DOI ↗ · more like this ·

This paper presents a method for imbuing agents with high-level domain knowledge via short command phrases given by a human designer. These command phrases, or goals, are provided at design time and describe the behaviors a human deems necessary in order to succeed at the current task. At run time, each goal is converted into a vector representation and is used to guide the agent’s exploration in a text-based environment. At each time step, the agent selects behaviors which it believes are relevant to its current objective, thus reducing the search space and increasing obtained rewards. We show that task-specific goals improve performance in a majority of virtual worlds, and discuss the potential for more general applications.

Learning a Rendezvous Task with Dynamic Joint Action Perception

Byu Scholarsarchive, Nancy Fulda, Dan A. Ventura +2 more

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

Abstract—Groups of reinforcement learning agents inter-acting in a common environment often fail to learn optimal behaviors. Poor performance is particularly common in en-vironments where agents must coordinate with each other to receive rewards and where failed coordination attempts are penalized. This paper studies the effectiveness of the Dynamic Joint Action Perception (DJAP) algorithm on a grid-world rendezvous task with this characteristic. The effects of learning rate, exploration strategy, and training time on algorithm effectiveness are discussed. An analysis of the types of tasks for which DJAP learning is appropriate is also presented. I.

Learning a Rendezvous Task with Dynamic Joint Action Perception

Nancy Fulda, Dan Ventura

Artificial Intelligence · The 2006 IEEE International Joint Conference on Neural Network Proceedings · · cited 0× · DOI ↗ · more like this ·

Groups of reinforcement learning agents interacting in a common environment often fail to learn optimal behaviors. Poor performance is particularly common in environments where agents must coordinate with each other to receive rewards and where failed coordination attempts are penalized. This paper studies the effectiveness of the dynamic joint action perception (DJAP) algorithm on a grid-world rendezvous task with this characteristic. The effects of learning rate, exploration strategy, and training time on algorithm effectiveness are discussed. An analysis of the types of tasks for which DJAP learning is appropriate is also presented.