arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Timo Bechger

13 papers · 2001–2023

2001: 12002: 02003: 02004: 02005: 12006: 02007: 02008: 02009: 12010: 02011: 02012: 02013: 02014: 02015: 12016: 12017: 12018: 12019: 02020: 22021: 22022: 12023: 1
2001peak 2 in 20202023

Frequent co-authors

Papers

showing 1–13 of 13 RSS

What can we learn from Plausible Values?

Maarten Marsman, Gunter Maris, Timo Bechger +1 more

Statistics and Probability · Psychometrika · · cited 66× · DOI ↗ · more like this ·

In this paper, we show that the marginal distribution of plausible values is a consistent estimator of the true latent variable distribution, and, furthermore, that convergence is monotone in an embedding in which the number of items tends to infinity. We use this result to clarify some of the misconceptions that exist about plausible values, and also show how they can be used in the analyses of educational surveys.

On Interpreting the Model Parameters for the Three Parameter Logistic Model

Gunter Maris, Timo Bechger

Artificial Intelligence · Measurement Interdisciplinary Research and Perspectives · · cited 49× · DOI ↗ · more like this ·

This paper addresses two problems relating to the interpretability of the model parameters in the three parameter logistic model. First, it is shown that if the values of the discrimination parameters are all the same, the remaining parameters are nonidentifiable in a nontrivial way that involves not only ability and item difficulty, but also the guessing parameters. Second, a situation is considered where different researchers analyze the same test with different instances of the three parameter logistic model. One researcher reaches the conclusion that students guess, whereas the other one concludes that students do not guess. Both examples illustrate the many-one relation between statistical models and the probability distributions they imply, which is the overarching topic of this paper.

A Gibbs Sampler for the (Extended) Marginal Rasch Model

Gunter Maris, Timo Bechger, Ernesto San Martı́n

Statistics and Probability · Psychometrika · · cited 19× · DOI ↗ · more like this ·

In their seminal work on characterizing the manifest probabilities of latent trait models, Cressie and Holland give a theoretically important characterization of the marginal Rasch model. Because their representation of the marginal Rasch model does not involve any latent trait, nor any specific distribution of a latent trait, it opens up the possibility for constructing a Markov chain - Monte Carlo method for Bayesian inference for the marginal Rasch model that does not rely on data augmentation. Such an approach would be highly efficient as its computational cost does not depend on the number of respondents, which makes it suitable for large-scale educational measurement. In this paper, such an approach will be developed and its operating characteristics illustrated with simulated data.

Identifiability of Nonlinear Logistic Test Models

Timo Bechger, Norman D. Verhelst, Huub H. F. M. Verstralen

Information Systems · Psychometrika · · cited 15× · DOI ↗ · more like this ·

The linear logistic test model (LLTM) specifies the item parameters as a weighted sum of basic parameters. The LLTM is a special case of a more general nonlinear logistic test model (NLTM) where the weights are partially unknown. This paper is about the identifiability of the NLTM. Sufficient and necessary conditions for global identifiability are presented for a NLTM where the weights are linear functions, while conditions for local identifiability are shown to require a model with less restrictions. It is also discussed how these conditions are checked using an algorithm due to Bekker, Merckens, and Wansbeek (1994). Several illustrations are given.

A Rasch Model and Rating System for Continuous Responses Collected in Large-Scale Learning Systems

Benjamin Deonovic, Maria Bolsinova, Timo Bechger +1 more

Artificial Intelligence · Frontiers in Psychology · · cited 13× · DOI ↗ · more like this ·

An extension to a rating system for tracking the evolution of parameters over time using continuous variables is introduced. The proposed rating system assumes a distribution for the continuous responses, which is agnostic to the origin of the continuous scores and thus can be used for applications as varied as continuous scores obtained from language testing to scores derived from accuracy and response time from elementary arithmetic learning systems. Large-scale, high-stakes, online, anywhere anytime learning and testing inherently comes with a number of unique problems that require new psychometric solutions. These include (1) the cold start problem, (2) problem of change, and (3) the problem of personalization and adaptation. We outline how our proposed method addresses each of these problems. Three simulations are carried out to demonstrate the utility of the proposed rating system.

Turning Simulation into Estimation: Generalized Exchange Algorithms for Exponential Family Models

Maarten Marsman, Gunter Maris, Timo Bechger +1 more

Statistics and Probability · PLoS ONE · · cited 12× · DOI ↗ · more like this ·

The Single Variable Exchange algorithm is based on a simple idea; any model that can be simulated can be estimated by producing draws from the posterior distribution. We build on this simple idea by framing the Exchange algorithm as a mixture of Metropolis transition kernels and propose strategies that automatically select the more efficient transition kernels. In this manner we achieve significant improvements in convergence rate and autocorrelation of the Markov chain without relying on more than being able to simulate from the model. Our focus will be on statistical models in the Exponential Family and use two simple models from educational measurement to illustrate the contribution.

Boltzmann Machines as Multidimensional Item Response Theory Models

Gunter Maris, Timo Bechger

Artificial Intelligence · PsyArXiv (OSF Preprints) · · cited 4× · DOI ↗ · more like this ·

We show that Boltzmann machines can formally be represented as multidimensional item response theory models. This relationship inspired a new learning principle and new ways to regularize Boltzmann machines to make them more interpretable. The core results carry over to a broader class of models including Gaussian-Bernoulli restricted Boltzmann machines.

dexter: An R Package to Manage and Analyze Test Data

Ivailo Partchev, Jesse Koops, Timo Bechger +2 more

Artificial Intelligence · Psych · · cited 2× · DOI ↗ · more like this ·

In this study, we present a package for R that is intended as a professional tool for the management and analysis of data from educational tests and useful both in high-stakes assessment programs and survey research. Focused on psychometric models based on the sum score as the scoring rule and having sufficient statistics for their parameters, dexter fully exploits the many theoretical and practical advantages of this choice: lack of unnecessary assumptions, stable and fast estimation, and powerful and sensible diagnostic techniques. It includes an easy to use data management system tailored to the structure of test data and compatible with the current paradigm of tidy data. Companion packages currently include a graphical user interface and support for multi-stage testing.

Composition Algorithms For Conditional Distributions

Maarten Marsman, Timo Bechger, Gunter Maris

Education · UvA-DARE (University of Amsterdam) · · cited 2× · DOI ↗ · more like this ·

This chapter is about two recently published algorithms that can be used to sample from conditional distributions. We show how the efficiency of the algorithms can be improved when a sample is required from many conditional distributions. Using real-data examples from educational measurement, we show how the algorithms can be used to sample from intractable full-conditional distributions of the person and item parameters in an application of the Gibbs sampler.

The Ising on the Tree: The Master Model for Learning, Assessment, and Navigation

Benjamin Deonovic, Timo Bechger, Gunter Maris

Computer Science Applications · PsyArXiv (OSF Preprints) · · cited 2× · DOI ↗ · more like this ·

Learning and assessment are intrinsically linked. However, the research, tools, and statistical models used within the two fields differ greatly. This has created a disconnect: The goals and missions of educational institutions are codified in the language and ideas of learning, but evaluated, monitored, and administered with the tools of assessment. We propose a novel statistical model, the Master model, capable of being the engine behind a modern learning and assessment system. The Master model combines three key concepts from the assessment and learning literature from the past century: A learning model should be multidimensional and hierarchical and should incorporate learning progressions. The Master model is a multidimensional latent variable model, more specifically a latent class model, that not only ranks learners from best to worst but also provides detailed diagnostic…

An Asymptotically Efficient Metropolis-Hastings Sampler for Bayesian Inference in Large-Scale Educational Measuremen

Timo Bechger, Gunter Maris, Maarten Marsman

stat.CO · · cited 2× · arXiv ↗ · more like this ·

This paper discusses a Metropolis-Hastings algorithm developed by \citeA{MarsmanIsing}. The algorithm is derived from first principles, and it is proven that the algorithm becomes more efficient with more data and meets the growing demands of large scale educational measurement.

Bayesian Inference in Large-Scale Computational Psychometrics

Gunter Maris, Timo Bechger, Maarten Marsman

Statistics and Probability · Methodology of educational measurement and assessment · · cited 1× · DOI ↗ · more like this ·

This chapter provides an introduction to Bayesian inference using Markov Chain Monte Carlo (MCMC) methods. We focus on two popular MCMC methods: Metropolis-Hastings and the Gibbs sampler. A Metropolis-Hastings algorithm developed by Marsman et al. (Sci Rep 5:9050, 1–7, 2015) will be used to illustrate how MCMC can be done for a wide range of models in computational statistics.

An Introduction to the DA-T Gibbs Sampler for the Two-Parameter Logistic (2PL) Model and Beyond

Gunter Maris, Timo Bechger

Statistics and Probability · DOAJ (DOAJ: Directory of Open Access Journals) · · cited 1× · OpenAlex ↗ · more like this ·

"The DA-T Gibbs sampler is proposed by Maris and Maris (2002) as aBayesian estimation method for a wide variety of Item Response Theory(IRT) models. The present paper provides an expository account of the DATGibbs sampler for the 2PL model. However, the scope is not limited tothe 2PL model. It is demonstrated how the DA-T Gibbs sampler for the 2PLmay be used to build, quite easily, Gibbs samplers for other IRT models.Furthermore, the paper contains a novel, intuitive derivation of the Gibbssampler and could be read for a graduate course on sampling."