arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Maria Heitmeier

8 papers · 2021–2025

2021: 12022: 32023: 12024: 12025: 2
2021peak 3 in 20222025

Frequent co-authors

Papers

showing 1–8 of 8 RSS

How trial-to-trial learning shapes mappings in the mental lexicon: Modelling Lexical Decision with Linear Discriminative Learning

Maria Heitmeier, Yu-Ying Chuang, R. Harald Baayen

cs.CL · · cited 5× · arXiv ↗ · more like this ·

Trial-to-trial effects have been found in a number of studies, indicating that processing a stimulus influences responses in subsequent trials. A special case are priming effects which have been modelled successfully with error-driven learning (Marsolek, 2008), implying that participants are continuously learning during experiments. This study investigates whether trial-to-trial learning can be detected in an unprimed lexical decision experiment. We used the Discriminative Lexicon Model (DLM; Baayen et al., 2019), a model of the mental lexicon with meaning representations from distributional semantics, which models error-driven incremental learning with the Widrow-Hoff rule. We used data from the British Lexicon Project (BLP; Keuleers et al., 2012) and simulated the lexical decision experiment with the DLM on a trial-by-trial basis for each subject individually. Then, reaction times…

Modeling morphology with Linear Discriminative Learning: considerations and design choices

Maria Heitmeier, Yu-Ying Chuang, R. Harald Baayen

cs.CL · · cited 5× · arXiv ↗ · more like this ·

This study addresses a series of methodological questions that arise when modeling inflectional morphology with Linear Discriminative Learning. Taking the semi-productive German noun system as example, we illustrate how decisions made about the representation of form and meaning influence model performance. We clarify that for modeling frequency effects in learning, it is essential to make use of incremental learning rather than the endstate of learning. We also discuss how the model can be set up to approximate the learning of inflected words in context. In addition, we illustrate how in this approach the wug task can be modeled in considerable detail. In general, the model provides an excellent memory for known words, but appropriately shows more limited performance for unseen data, in line with the semi-productivity of German noun inflection and generalization performance of native…

Morpho-phonology is not independent of semantics

Ingo Plag, Maria Heitmeier, Frank Domahs

Artificial Intelligence · The Mental Lexicon · · cited 0× · DOI ↗ · more like this ·

Abstract Morpho-phonological alternations in inflectional paradigms are commonly analyzed as purely formal phenomena, in which the mapping of phonological structure and morpho-syntactic categories is organized without recourse to semantic properties of the words involved. The present paper explores the role of semantics using the Discriminative Lexicon approach ( Baayen, et al. 2019 ). The test case explored in this paper is German nominal number, a system involving complex morpho-phonological variation (e.g. Köpcke et al., 2021 ; Heitmeier et al., 2021 ; Plag et al., 2024 ; McCurdy, 2024 ). Using word2vec vectors as semantic representations, and triphones as form representations, we created two-layer linear discriminative learning (LDL) networks that map form representations directly onto semantic representations (modeling comprehension), and semantic representations onto form…

Is deeper always better? Replacing linear mappings with deep learning networks in the Discriminative Lexicon Model

Maria Heitmeier, Valeria Schmidt, Hendrik P. A. Lensch +1 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

Recently, deep learning models have increasingly been used in cognitive modelling of language. This study asks whether deep learning can help us to better understand the learning problem that needs to be solved by speakers, above and beyond linear methods. We utilise the Discriminative Lexicon Model introduced by Baayen and colleagues, which models comprehension and production with mappings between numeric form and meaning vectors. While so far, these mappings have been linear (Linear Discriminative Learning, LDL), in the present study we replace them with deep dense neural networks (Deep Discriminative Learning, DDL). We find that DDL affords more accurate mappings for large and diverse datasets from English and Dutch, but not necessarily for Estonian and Taiwan Mandarin. DDL outperforms LDL in particular for words with pseudo-morphological structure such as chol+er. Applied to average…

An experimental and computational study of an Estonian single-person word naming

Kaidi Lõo, Arvi Tavast, Maria Heitmeier +1 more

cs.CL · · arXiv ↗ · more like this ·

This study investigates lexical processing in Estonian. A large-scale single-subject experiment is reported that combines the word naming task with eye-tracking. Five response variables (first fixation duration, total fixation duration, number of fixations, word naming latency, and spoken word duration) are analyzed with the generalized additive model. Of central interest is the question of whether measures for lexical processing generated by a computational model of the mental lexicon (the Discriminative Lexicon Model, DLM) are predictive for these response variables, and how they compare to classical predictors such as word frequency, neighborhood size, and inflectional paradigm size. Computational models were implemented both with linear and deep mappings. Central findings are, first, that DLM-based measures are powerful predictors for lexical processing, second, that DLM-measures…

Frequency effects in Linear Discriminative Learning

Maria Heitmeier, Yu-Ying Chuang, Seth D. Axen +1 more

cs.CL · · arXiv ↗ · more like this ·

Word frequency is a strong predictor in most lexical processing tasks. Thus, any model of word recognition needs to account for how word frequency effects arise. The Discriminative Lexicon Model (DLM; Baayen et al., 2018a, 2019) models lexical processing with linear mappings between words' forms and their meanings. So far, the mappings can either be obtained incrementally via error-driven learning, a computationally expensive process able to capture frequency effects, or in an efficient, but frequency-agnostic solution modelling the theoretical endstate of learning (EL) where all words are learned optimally. In this study we show how an efficient, yet frequency-informed mapping between form and meaning can be obtained (Frequency-informed learning; FIL). We find that FIL well approximates an incremental solution while being computationally much cheaper. FIL shows a relatively low type-…

Language with Vision: a Study on Grounded Word and Sentence Embeddings

Hassan Shahmohammadi, Maria Heitmeier, Elnaz Shafaei-Bajestan +2 more

cs.CL · · arXiv ↗ · more like this ·

Grounding language in vision is an active field of research seeking to construct cognitively plausible word and sentence representations by incorporating perceptual knowledge from vision into text-based representations. Despite many attempts at language grounding, achieving an optimal equilibrium between textual representations of the language and our embodied experiences remains an open field. Some common concerns are the following. Is visual grounding advantageous for abstract words, or is its effectiveness restricted to concrete words? What is the optimal way of bridging the gap between text and vision? To what extent is perceptual knowledge from images advantageous for acquiring high-quality embeddings? Leveraging the current advances in machine learning and natural language processing, the present study addresses these questions by proposing a simple yet very effective…

How direct is the link between words and images?

Hassan Shahmohammadi, Maria Heitmeier, Elnaz Shafaei-Bajestan +2 more

cs.CL · · arXiv ↗ · more like this ·

Current word embedding models despite their success, still suffer from their lack of grounding in the real world. In this line of research, Gunther et al. 2022 proposed a behavioral experiment to investigate the relationship between words and images. In their setup, participants were presented with a target noun and a pair of images, one chosen by their model and another chosen randomly. Participants were asked to select the image that best matched the target noun. In most cases, participants preferred the image selected by the model. Gunther et al., therefore, concluded the possibility of a direct link between words and embodied experience. We took their experiment as a point of departure and addressed the following questions. 1. Apart from utilizing visually embodied simulation of given images, what other strategies might subjects have used to solve this task? To what extent does this…