arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Alexander Robitzsch

81 papers · 2007–2026

2007: 12008: 02009: 22010: 02011: 32012: 22013: 12014: 32015: 22016: 62017: 22018: 02019: 22020: 92021: 72022: 102023: 112024: 72025: 112026: 2
2007peak 11 in 20232026

Frequent co-authors

Papers

showing 1–25 of 81 RSS

Doubly-Latent Models of School Contextual Effects: Integrating Multilevel and Structural Equation Approaches to Control Measurement and Sampling Error

Herbert W. Marsh, Oliver Lüdtke, Alexander Robitzsch +4 more

Education · Multivariate Behavioral Research · · cited 473× · DOI ↗ · more like this ·

This article is a methodological-substantive synergy. Methodologically, we demonstrate latent-variable contextual models that integrate structural equation models (with multiple indicators) and multilevel models. These models simultaneously control for and unconfound measurement error due to sampling of items at the individual (L1) and group (L2) levels and sampling error due the sampling of persons in the aggregation of L1 characteristics to form L2 constructs. We consider a set of models that are latent or manifest in relation to sampling items (measurement error) and sampling of persons (sampling error) and discuss when different models might be most useful. We demonstrate the flexibility of these 4 core models by extending them to include random slopes, latent (single-level or cross-level) interactions, and latent quadratic effects. Substantively we use these models to test the…

A 2 × 2 taxonomy of multilevel latent contextual models: Accuracy–bias trade-offs in full and partial error correction models.

Oliver Lüdtke, Herbert W. Marsh, Alexander Robitzsch +1 more

Statistics and Probability · Psychological Methods · · cited 273× · DOI ↗ · more like this ·

In multilevel modeling, group-level variables (L2) for assessing contextual effects are frequently generated by aggregating variables from a lower level (L1). A major problem of contextual analyses in the social sciences is that there is no error-free measurement of constructs. In the present article, 2 types of error occurring in multilevel data when estimating contextual effects are distinguished: unreliability that is due to measurement error and unreliability that is due to sampling error. The fact that studies may or may not correct for these 2 types of error can be translated into a 2 × 2 taxonomy of multilevel latent contextual models comprising 4 approaches: an uncorrected approach, partial correction approaches correcting for either measurement or sampling error (but not both), and a full correction approach that adjusts for both sources of error. It is shown mathematically and…

Multiple Imputation of Missing Data for Multilevel Models

Simon Grund, Oliver Lüdtke, Alexander Robitzsch

Statistics and Probability · Organizational Research Methods · · cited 220× · DOI ↗ · more like this ·

Multiple imputation (MI) is one of the principled methods for dealing with missing data. In addition, multilevel models have become a standard tool for analyzing the nested data structures that result when lower level units (e.g., employees) are nested within higher level collectives (e.g., work groups). When applying MI to multilevel data, it is important that the imputation model takes the multilevel structure into account. In the present paper, based on theoretical arguments and computer simulations, we provide guidance using MI in the context of several classes of multilevel models, including models with random intercepts, random slopes, cross-level interactions (CLIs), and missing data in categorical and group-level variables. Our findings suggest that, oftentimes, several approaches to MI provide an effective treatment of missing data in multilevel research. Yet we also note that…

Multiple imputation of missing data in multilevel designs: A comparison of different strategies.

Oliver Lüdtke, Alexander Robitzsch, Simon Grund

Statistics and Probability · Psychological Methods · · cited 174× · DOI ↗ · more like this ·

Multiple imputation is a widely recommended means of addressing the problem of missing data in psychological research. An often-neglected requirement of this approach is that the imputation model used to generate the imputed values must be at least as general as the analysis model. For multilevel designs in which lower level units (e.g., students) are nested within higher level units (e.g., classrooms), this means that the multilevel structure must be taken into account in the imputation model. In the present article, we compare different strategies for multiply imputing incomplete multilevel data using mathematical derivations and computer simulations. We show that ignoring the multilevel structure in the imputation may lead to substantial negative bias in estimates of intraclass correlations as well as biased estimates of regression coefficients in multilevel models. We also…

Multiple imputation of multilevel missing data: An introduction to the R package pan

Simon Grund, Oliver Lüdtke, Alexander Robitzsch

stat.CO · · cited 160× · arXiv ↗ · more like this ·

The treatment of missing data can be difficult in multilevel research because state-of-the-art procedures such as multiple imputation (MI) may require advanced statistical knowledge or a high degree of familiarity with certain statistical software. In the missing data literature, pan has been recommended for MI of multilevel data. In this article, we provide an introduction to MI of multilevel missing data using the R package pan, and we discuss its possibilities and limitations in accommodating typical questions in multilevel research. In order to make pan more accessible to applied researchers, we make use of the mitml package, which provides a user-friendly interface to the pan package and several tools for managing and analyzing multiply imputed data sets. We illustrate the use of pan and mitml with two empirical examples that represent common applications of multilevel models, and…

Multiple Imputation of Multilevel Missing Data

Simon Grund, Oliver Lüdtke, Alexander Robitzsch

Statistics and Probability · SAGE Open · · cited 139× · DOI ↗ · more like this ·

The treatment of missing data can be difficult in multilevel research because state-of-the-art procedures such as multiple imputation (MI) may require advanced statistical knowledge or a high degree of familiarity with certain statistical software. In the missing data literature, pan has been recommended for MI of multilevel data. In this article, we provide an introduction to MI of multilevel missing data using the R package pan, and we discuss its possibilities and limitations in accommodating typical questions in multilevel research. To make pan more accessible to applied researchers, we make use of the mitml package, which provides a user-friendly interface to the pan package and several tools for managing and analyzing multiply imputed data sets. We illustrate the use of pan and mitml with two empirical examples that represent common applications of multilevel models, and we…

Difficulties in solving context-based PISA mathematics tasks: An analysis of students’ errors

Ariyadi Wijaya, Marja van den Heuvel‐Panhuizen, Michiel Doorman +1 more

Education · The Mathematics Enthusiast · · cited 132× · DOI ↗ · more like this ·

The intention of this study was to clarify students’ difficulties in solving context-based mathematics tasks as used in the Programme for International Student Assessment (PISA). The study was carried out with 362 Indonesian ninth- and tenth-grade students. In the study we used 34 released PISA mathematics tasks including three task types: reproduction, connection, and reflection. Students’ difficulties were identified by using Newman’s error categories, which were connected to the modeling process described by Blum and Leiss and to the PISA stages of mathematization, including (1) comprehending a task, (2) transforming the task into a mathematical problem, (3) processing mathematical procedures, and (4) interpreting or encoding the solution in terms of the real situation. Our data analysis revealed that students made most mistakes in the first two stages of the solution process. Out of…

Effects of reading picture books on kindergartners’ mathematics performance

Marja van den Heuvel‐Panhuizen, Ιλιάδα Ηλία, Alexander Robitzsch

Statistics and Probability · Educational Psychology · · cited 127× · DOI ↗ · more like this ·

This article describes a field experiment with a pretest–posttest control group design which investigated the potential of reading picture books to children for supporting their mathematical understanding. The study involved 384 children from 18 kindergarten classes in 18 schools in the Netherlands. During three months, the children in the nine experimental classes were read picture books. Data analysis revealed that, when controlled for relevant covariates, the picture book reading programme had a positive effect (d = .13) on kindergartners’ mathematics performance as measured by a project test containing items on number, measurement and geometry. Compared to the increase from pretest to posttest in the control group, the increase in the experimental group was 22% larger. No significant differential intervention effects were found between subgroups based on kindergarten year, age, home…

A Comparison of Different Approaches for Estimating Cross-Lagged Effects from a Causal Inference Perspective

Oliver Lüdtke, Alexander Robitzsch

Statistics and Probability · Structural Equation Modeling A Multidisciplinary Journal · · cited 126× · DOI ↗ · more like this ·

This article compares different approaches for estimating cross-lagged effects with a cross-lagged panel design under a causal inference perspective. We distinguish between models that rely on no unmeasured confounding (i.e., observed covariates are sufficient to remove confounding) and latent variable-type models (e.g., random intercept cross-lagged panel model) that use parametric assumptions to adjust for unmeasured time-invariant confounding by including additional latent variables. Simulation studies confirm that the cross-lagged panel model provides biased estimates of the cross-lagged effect in the presence of unmeasured confounding. However, the simulations also show that the latent variable-type approaches strongly depend on the specific parametric assumptions, and produce biased estimates under different data-generating scenarios. Finally, we discuss the role of the…

Complementary and competing factor analytic approaches for the investigation of measurement invariance

Andrea Hildebrandt, Oliver Wilhelm, Alexander Robitzsch

Computer Networks and Communications · University of Zagreb University Computing Centre (SRCE) · · cited 93× · OpenAlex ↗ · more like this ·

The scientist is usually looking for invariance whether he knows it or not.Whenever he discovers a functional relationship his next question follows naturally: under what conditions does it hold?"(Stevens, 1951) As pointed out in the quotation by Stevens (1951), the issue of invariance is a highly relevant topic in scientific measurement.Concepts of invariance and the development of methods to determine whether or not specific aspects of equivalence are hold for a given measurement instrument have a long history in psychometrics and can be traced back to Thorndike (1904) and Thurstone (1925Thurstone ( , 1947;; see Engelhard, 1992 for a historical review).There is a bifocal perspective on the concept of invariance in psychometrics, that Thurstone emphasized and that was later immersed by Rasch (1961).One perspective is that of sample invariance of a measure and the other perspective is…

On the Performance of Bayesian Approaches in Small Samples: A Comment on Smid, McNeish, Miocevic, and van de Schoot (2020)

Steffen Zitzmann, Oliver Lüdtke, Alexander Robitzsch +1 more

Statistics and Probability · Structural Equation Modeling A Multidisciplinary Journal · · cited 73× · DOI ↗ · more like this ·

This journal recently published a systematic review of simulation studies on the performance of Bayesian approaches for estimating latent variable models in small samples. The authors of this review highlighted that Bayesian approaches can perform poorly (i.e., by exhibiting bias) when the prior distributions are not thoughtfully constructed on the basis of previous knowledge. In this comment, we question whether the bias is the most important criterion when the sample size is small. We argue that the variability is more important and should therefore not be ignored. Moreover, because one of the most important selling points of Bayesian approaches was not addressed in the article, we argue that although somewhat biased, Bayesian approaches allow for more accurate estimates (i.e., a smaller mean squared error) than Maximum Likelihood (ML) in small samples, and we show one such approach…

Regression models involving nonlinear effects with missing data: A sequential modeling approach using Bayesian estimation.

Oliver Lüdtke, Alexander Robitzsch, Stephen G. West

Statistics and Probability · Psychological Methods · · cited 59× · DOI ↗ · more like this ·

When estimating multiple regression models with incomplete predictor variables, it is necessary to specify a joint distribution for the predictor variables. A convenient assumption is that this distribution is a joint normal distribution, the default in many statistical software packages. This distribution will in general be misspecified if the predictors with missing data have nonlinear effects (e.g., x2) or are included in interaction terms (e.g., x·z). In the present article, we discuss a sequential modeling approach that can be applied to decompose the joint distribution of the variables into 2 parts: (a) a part that is due to the model of interest and (b) a part that is due to the model for the incomplete predictors. We demonstrate how the sequential modeling approach can be used to implement a multiple imputation strategy based on Bayesian estimation techniques that can…

Pooling ANOVA Results From Multiply Imputed Datasets

Simon Grund, Oliver Lüdtke, Alexander Robitzsch

Statistics and Probability · Methodology · · cited 59× · DOI ↗ · more like this ·

Abstract. The analysis of variance (ANOVA) is frequently used to examine whether a number of groups differ on a variable of interest. The global hypothesis test of the ANOVA can be reformulated as a regression model in which all group differences are simultaneously tested against zero. Multiple imputation offers reliable and effective treatment of missing data; however, recommendations differ with regard to what procedures are suitable for pooling ANOVA results from multiply imputed datasets. In this article, we compared several procedures (known as D 1 , D 2 , and D 3 ) using Monte Carlo simulations. Even though previous recommendations have advocated that D 2 should be avoided in favor of D 1 or D 3 , our results suggest that all procedures provide a suitable test of the ANOVA’s global null hypothesis in many plausible research scenarios. In more extreme settings, D 1 was most…

A Bayesian Approach for Estimating Multilevel Latent Contextual Models

Steffen Zitzmann, Oliver Lüdtke, Alexander Robitzsch +1 more

Statistics and Probability · Structural Equation Modeling A Multidisciplinary Journal · · cited 58× · DOI ↗ · more like this ·

In many applications of multilevel modeling, group-level (L2) variables for assessing group-level effects are generated by aggregating variables from a lower level (L1). However, the observed group mean might not be a reliable measure of the unobserved true group mean. In this article, we propose a Bayesian approach for estimating a multilevel latent contextual model that corrects for measurement error and sampling error (i.e., sampling only a small number of L1 units from a L2 unit) when estimating group-level effects of aggregated L1 variables. Two simulation studies were conducted to compare the Bayesian approach with the maximum likelihood approach implemented in Mplus. The Bayesian approach showed fewer estimation problems (e.g., inadmissible solutions) and more accurate estimates of the group-level effect than the maximum likelihood approach under problematic conditions (i.e.…

Effects of mathematics computer games on special education students' multiplicative reasoning ability

Marjoke Bakker, Marja van den Heuvel‐Panhuizen, Alexander Robitzsch

Statistics and Probability · British Journal of Educational Technology · · cited 50× · DOI ↗ · more like this ·

Abstract This study examined the effects of a teacher‐delivered intervention with online mathematics mini‐games on special education students' multiplicative reasoning ability (multiplication and division). The games involved declarative, procedural, as well as conceptual knowledge of multiplicative relations, and were accompanied with teacher‐led lessons and class discussions. A pretest–posttest control‐group design was employed, with 81 students from five schools for special primary education (three experimental schools and two control schools). The intervention consisted of two 10‐week game periods in which a total of 16 mini‐games were offered as part of the regular educational program for multiplicative reasoning. The control group students played non‐multiplicative mini‐games; for multiplicative reasoning, they followed their regular educational program without mini‐games. In both…

Multiple imputation of missing data in multilevel models with the R package mdmb: a flexible sequential modeling approach

Simon Grund, Oliver Lüdtke, Alexander Robitzsch

Statistics and Probability · Behavior Research Methods · · cited 49× · DOI ↗ · more like this ·

Multilevel models often include nonlinear effects, such as random slopes or interaction effects. The estimation of these models can be difficult when the underlying variables contain missing data. Although several methods for handling missing data such as multiple imputation (MI) can be used with multilevel data, conventional methods for multilevel MI often do not properly take the nonlinear associations between the variables into account. In the present paper, we propose a sequential modeling approach based on Bayesian estimation techniques that can be used to handle missing data in a variety of multilevel models that involve nonlinear effects. The main idea of this approach is to decompose the joint distribution of the data into several parts that correspond to the outcome and explanatory variables in the intended analysis, thus generating imputations in a manner that is compatible…

Cognitive Diagnosis Models in R: A didactic

Asish George, Alexander Robitzsch

Artificial Intelligence · The Quantitative Methods for Psychology · · cited 43× · DOI ↗ · more like this ·

Cognitive diagnosis models (CDMs) are a class of discrete latent variable models which may be used to estimate the possession of attributes underlying a global ability or attitude. The present article explains the basics of CDMs to researchers not acquainted with this family of models. Two worked out examples show how to apply a CDM using the R package CDM.

Special education students’ use of indirect addition in solving subtraction problems up to 100—A proof of the didactical potential of an ignored procedure

Marjolijn Peltenburg, Marja van den Heuvel‐Panhuizen, Alexander Robitzsch

Statistics and Probability · Educational Studies in Mathematics · · cited 43× · DOI ↗ · more like this ·

In this study, we examined special education students’ use of indirect addition (subtraction by adding on) for solving two-digit subtraction problems. Fifty-six students (8- to 12-year-olds), with a mathematical level of end grade 2, participated in the study. They were given a computer-based test on subtraction with different types of problems. Although most students had not been taught indirect addition for solving subtraction problems, they frequently applied this procedure spontaneously. The item characteristics were the main prompt for using indirect addition. Context problems that reflect an adding-on situation and problems that have a small difference between the minuend and subtrahend most strongly elicited the use of the indirect addition procedure. Moreover, indirect addition was identified as a highly successful procedure for special education students, and the best predictor…

ANCOVA versus Change Score for the Analysis of Two-Wave Data

Oliver Lüdtke, Alexander Robitzsch

Statistics and Probability · The Journal of Experimental Education · · cited 36× · DOI ↗ · more like this ·

There is a longstanding debate on whether the analysis of covariance (ANCOVA) or the change score approach is more appropriate when analyzing non-experimental longitudinal data. In this article, we use a structural modeling perspective to clarify that the ANCOVA approach is based on the assumption that all relevant covariates are measured (i.e., covariates are sufficient to remove confounding) and provides biased estimates of the treatment effect in the presence of unmeasured confounding variables. By contrast, the change score approach offers the option of controlling for unobserved confounders but relies on strong assumptions about the effects of these unobserved confounders and does not allow for dynamic causal relationships (i.e., pretest affects treatment variable). Furthermore, we discuss four issues that received less attention in previous research: (1) the inclusion of…

Multiple Imputation of Missing Data at Level 2: A Comparison of Fully Conditional and Joint Modeling in Multilevel Designs

Simon Grund, Oliver Lüdtke, Alexander Robitzsch

Statistics and Probability · Journal of Educational and Behavioral Statistics · · cited 35× · DOI ↗ · more like this ·

Multiple imputation (MI) can be used to address missing data at Level 2 in multilevel research. In this article, we compare joint modeling (JM) and the fully conditional specification (FCS) of MI as well as different strategies for including auxiliary variables at Level 1 using either their manifest or their latent cluster means. We show with theoretical arguments and computer simulations that (a) an FCS approach that uses latent cluster means is comparable to JM and (b) using manifest cluster means provides similar results except in relatively extreme cases with unbalanced data. We outline a computational procedure for including latent cluster means in an FCS approach using plausible values and provide an example using data from the Programme for International Student Assessment 2012 study.

Alleviating estimation problems in small sample structural equation modeling—A comparison of constrained maximum likelihood, Bayesian estimation, and fixed reliability approaches.

Esther Ulitzsch, Oliver Lüdtke, Alexander Robitzsch

Artificial Intelligence · Psychological Methods · · cited 30× · DOI ↗ · more like this ·

Small sample structural equation modeling (SEM) may exhibit serious estimation problems, such as failure to converge, inadmissible solutions, and unstable parameter estimates. A vast literature has compared the performance of different solutions for small sample SEM in contrast to unconstrained maximum likelihood (ML) estimation. Less is known, however, on the gains and pitfalls of different solutions in contrast to each other. Focusing on three current solutions-constrained ML, Bayesian methods using Markov chain Monte Carlo techniques, and fixed reliability single indicator (SI) approaches-we bridge this gap. When doing so, we evaluate the potential and boundaries of different parameterizations, constraints, and weakly informative prior distributions for improving the quality of the estimation procedure and stabilizing parameter estimates. The performance of all approaches is compared…

On the Treatment of Missing Data in Background Questionnaires in Educational Large-Scale Assessments: An Evaluation of Different Procedures

Simon Grund, Oliver Lüdtke, Alexander Robitzsch

Statistics and Probability · Journal of Educational and Behavioral Statistics · · cited 30× · DOI ↗ · more like this ·

Large-scale assessments (LSAs) use Mislevy’s “plausible value” (PV) approach to relate student proficiency to noncognitive variables administered in a background questionnaire. This method requires background variables to be completely observed, a requirement that is seldom fulfilled. In this article, we evaluate and compare the properties of methods used in current practice for dealing with missing data in background variables in educational LSAs, which rely on the missing indicator method (MIM), with other methods based on multiple imputation. In this context, we present a fully conditional specification (FCS) approach that allows for a joint treatment of PVs and missing data. Using theoretical arguments and two simulation studies, we illustrate under what conditions the MIM provides biased or unbiased estimates of population parameters and provide evidence that methods such as FCS…

A Comparison of Penalized Maximum Likelihood Estimation and Markov Chain Monte Carlo Techniques for Estimating Confirmatory Factor Analysis Models With Small Sample Sizes

Oliver Lüdtke, Esther Ulitzsch, Alexander Robitzsch

Statistics and Probability · Frontiers in Psychology · · cited 29× · DOI ↗ · more like this ·

With small to modest sample sizes and complex models, maximum likelihood (ML) estimation of confirmatory factor analysis (CFA) models can show serious estimation problems such as non-convergence or parameter estimates outside the admissible parameter space. In this article, we distinguish different Bayesian estimators that can be used to stabilize the parameter estimates of a CFA: the mode of the joint posterior distribution that is obtained from penalized maximum likelihood (PML) estimation, and the mean (EAP), median (Med), or mode (MAP) of the marginal posterior distribution that are calculated by using Markov Chain Monte Carlo (MCMC) methods. In two simulation studies, we evaluated the performance of the Bayesian estimators from a frequentist point of view. The results show that the EAP produced more accurate estimates of the latent correlation in many conditions and outperformed…

Analysis of Interactions and Nonlinear Effects with Missing Data: A Factored Regression Modeling Approach Using Maximum Likelihood Estimation

Oliver Lüdtke, Alexander Robitzsch, Stephen G. West

Statistics and Probability · Multivariate Behavioral Research · · cited 23× · DOI ↗ · more like this ·

When estimating multiple regression models with incomplete predictor variables, it is necessary to specify a joint distribution for the predictor variables. A convenient assumption is that this distribution is a multivariate normal distribution, which is also the default in many statistical software packages. This distribution will in general be misspecified if predictors with missing data have nonlinear effects (e.g., x2) or are included in interaction terms (e.g., x·z). In the present article, we introduce a factored regression modeling approach for estimating regression models with missing data that is based on maximum likelihood estimation. In this approach, the model likelihood is factorized into a part that is due to the model of interest and a part that is due to the model for the incomplete predictors. In three simulation studies, we showed that the factored regression modeling…

Why Ordinal Variables Can (Almost) Always be Treated as Continuous Variables: Clarifying Assumptions of Robust Continuous and Ordinal Factor Analysis Estimation Methods

Alexander Robitzsch

Computer Networks and Communications · PsyArXiv (OSF Preprints) · · cited 21× · DOI ↗ · more like this ·

The analysis of factor structures is one of the most critical psychometric applications. Frequently, variables (i.e., items or indicators) resulting from questionnaires using ordinal items with 2 to 7 categories are used. There are plenty of articles that recommend treating ordinal variables in a factor analysis by default as ordinal and not as continuous imposing a multivariate normal distribution assumption. In this article, we critically reflect that the reasoning behind such suggestions is flawed. In our view, findings from simulation studies cannot tell about the right modeling strategy of ordinal variables in factor analysis. Moreover, it is argued that ordinal factor models impose a normality assumption for underlying continuous variables, which might also often be false in empirical applications. However, researchers seldom opt for these much-needed, more flexible modeling…