Author

Hein Putter

96 papers · 1996–2026

1996peak 13 in 20242026

Frequent co-authors

Papers

showing 1–25 of 96 RSS

Tutorial in biostatistics: competing risks and multi‐state models

Hein Putter, Marta Fiocco, Ronald B. Geskus

Statistics and Probability · Statistics in Medicine · 10 Oct 2006 · cited 2,400× · DOI ↗ · more like this ·

Standard survival data measure the time span from some time origin until the occurrence of one type of event. If several types of events occur, a model describing progression to each of these competing risks is needed. Multi-state models generalize competing risks models by also describing transitions to intermediate events. Methods to analyze such models have been developed over the last two decades. Fortunately, most of the analyzes can be performed within the standard statistical packages, but may require some extra effort with respect to data preparation and programming. This tutorial aims to review statistical methods for the analysis of competing risks and multi-state models. Although some conceptual issues are covered, the emphasis is on practical issues like data preparation, estimation of the effect of covariates, and estimation of cumulative incidence functions and state and…

mstate: AnRPackage for the Analysis of Competing Risks and Multi-State Models

Liesbeth C. de Wreede, Marta Fiocco, Hein Putter

Statistics and Probability · Journal of Statistical Software · 2011 · cited 470× · DOI ↗ · more like this ·

Multi-state models are a very useful tool to answer a wide range of questions in survival analysis that cannot, or only in a more complicated way, be answered by classical models. They are suitable for both biomedical and other applications in which time-to-event variables are analyzed. However, they are still not frequently applied. So far, an important reason for this has been the lack of available software. To overcome this problem, we have developed the mstate package in R for the analysis of multi-state models. The package covers all steps of the analysis of multi-state models, from model building and data preparation to estimation and graphical representation of the results. It can be applied to non- and semi-parametric (Cox) models. The package is also suitable for competing risks models, as they are a special category of multi-state models. This article offers guidelines…

A tutorial on frailty models

Theodor A. Balan, Hein Putter

Demography · Statistical Methods in Medical Research · 28 May 2020 · cited 259× · DOI ↗ · more like this ·

The hazard function plays a central role in survival analysis. In a homogeneous population, the distribution of the time to event, described by the hazard, is the same for each individual. Heterogeneity in the distributions can be accounted for by including covariates in a model for the hazard, for instance a proportional hazards model. In this model, individuals with the same value of the covariates will have the same distribution. It is natural to think that not all covariates that are thought to influence the distribution of the survival outcome are included in the model. This implies that there is unobserved heterogeneity; individuals with the same value of the covariates may have different distributions. One way of accounting for this unobserved heterogeneity is to include random effects in the model. In the context of hazard models for time to event outcomes, such random effects…

Dynamic predicting by landmarking as an alternative for multi-state modeling: an application to acute lymphoid leukemia data

Hans C. van Houwelingen, Hein Putter

Statistics and Probability · Lifetime Data Analysis · 2 Oct 2008 · cited 125× · DOI ↗ · more like this ·

This paper considers the problem of obtaining a dynamic prediction for 5-year failure free survival after bone marrow transplantation in ALL patients using data from the EBMT, the European Group for Blood and Marrow Transplantation. The paper compares the new landmark methodology as developed by the first author and the established multi-state modeling as described in a recent Tutorial in Biostatistics in Statistics in Medicine by the second author and colleagues. As expected the two approaches give similar results. The landmark methodology does not need complex modeling and leads to easy prediction rules. On the other hand, it does not give the insight in the biological processes as obtained for the multi-state model.

Estimation and Prediction in a Multi-State Model for Breast Cancer

Hein Putter, Jos A. van der Hage, Geertruida H. de Bock +2 more

Computational Theory and Mathematics · Biometrical Journal · 19 May 2006 · cited 121× · DOI ↗ · more like this ·

An important aim in clinical studies in oncology is to study how treatment and prognostic factors influence the course of disease of a patient. Typically in these trials, besides overall survival, also other endpoints such as locoregional recurrence or distant metastasis are of interest. Most commonly in these situations, Cox regression models are applied for each of these endpoints separately or to composite endpoints such as disease-free survival. These approaches however fail to give insight into what happens to a patient after a first event. We re-analyzed data of 2795 patients from a breast cancer trial (EORTC 10854) by applying a multi-state model, with local recurrence, distant metastasis, and both local recurrence and distant metastasis as transient states and death as absorbing state. We used an approach where the clock is reset on entry of a new state. The influence of…

Prediction meets causal inference: the role of treatment in clinical prediction models

Nan van Geloven, Sonja Swanson, Chava Ramspek +7 more

stat.ME · 15 Apr 2020 · cited 114× · arXiv ↗ · more like this ·

In this paper we study approaches for dealing with treatment when developing a clinical prediction model. Analogous to the estimand framework recently proposed by the European Medicines Agency for clinical trials, we propose a `predictimand' framework of different questions that may be of interest when predicting risk in relation to treatment started after baseline. We provide a formal definition of the estimands matching these questions, give examples of settings in which each is useful and discuss appropriate estimators including their assumptions. We illustrate the impact of the predictimand choice in a dataset of patients with end-stage kidney disease. We argue that clearly defining the estimand is equally important in prediction research as in causal inference.

Understanding Landmarking and Its Relation with Time-Dependent Cox Regression

Hein Putter, Hans C. van Houwelingen

Statistics and Probability · Statistics in Biosciences · 11 Jul 2016 · cited 107× · DOI ↗ · more like this ·

Time-dependent Cox regression and landmarking are the two most commonly used approaches for the analysis of time-dependent covariates in time-to-event data. The estimated effect of the time-dependent covariate in a landmarking analysis is based on the value of the time-dependent covariate at the landmark time point, after which the time-dependent covariate may change value. In this note we derive expressions for the (time-varying) regression coefficient of the time-dependent covariate in the landmark analysis, in terms of the regression coefficient and baseline hazard of the time-dependent Cox regression. These relations are illustrated using simulation studies and using the Stanford heart transplant data.

Validation of prediction models in the presence of competing risks: a guide through modern methods

Nan van Geloven, Daniele Giardiello, Edouard F. Bonneville +9 more

Statistics and Probability · BMJ · 24 May 2022 · cited 104× · DOI ↗ · more like this ·

Thorough validation is pivotal for any prediction model before it can be advocated for use in medical practice. For time-to-event outcomes such as breast cancer recurrence, death from other causes is a competing risk. Model performance measures must account for such competing events. In this article, we present a comprehensive yet accessible overview of performance measures for this competing event setting, including the calculation and interpretation of statistical measures for calibration, discrimination, overall prediction error, and clinical usefulness by decision curve analysis. All methods are illustrated for patients with breast cancer, with publicly available data and R code.

mstate: An R Package for the Analysis of Competing Risks and Multi-State Models

Liesbeth C. de Wreede, Marta Fiocco, Hein Putter

Artificial Intelligence · RePEc: Research Papers in Economics · 2011 · cited 71× · OpenAlex ↗ · more like this ·

Multi-state models are a very useful tool to answer a wide range of questions in survival analysis that cannot, or only in a more complicated way, be answered by classical models. They are suitable for both biomedical and other applications in which time-to-event variables are analyzed. However, they are still not frequently applied. So far, an important reason for this has been the lack of available software. To overcome this problem, we have developed the mstate package in R for the analysis of multi-state models. The package covers all steps of the analysis of multi-state models, from model building and data preparation to estimation and graphical representation of the results. It can be applied to non- and semi-parametric (Cox) models. The package is also suitable for competing risks models, as they are a special category of multi-state models. This article offers guidelines for the…

Non-parametric estimation of transition probabilities in non-Markov multi-state models: The landmark Aalen–Johansen estimator

Hein Putter, Cristian Spitoni

Statistics and Probability · Statistical Methods in Medical Research · 20 Oct 2016 · cited 69× · DOI ↗ · more like this ·

The topic non-parametric estimation of transition probabilities in non-Markov multi-state models has seen a remarkable surge of activity recently. Two recent papers have used the idea of subsampling in this context. The first paper, by de Uña Álvarez and Meira-Machado, uses a procedure based on (differences between) Kaplan-Meier estimators derived from a subset of the data consisting of all subjects observed to be in the given state at the given time. The second, by Titman, derived estimators of transition probabilities that are consistent in general non-Markov multi-state models. Here, we show that the same idea of subsampling, used in both these papers, combined with the Aalen-Johansen estimate of the state occupation probabilities derived from that subset, can also be used to obtain a relatively simple and intuitive procedure which we term landmark Aalen-Johansen. We show that the…

Stat Methods Med Res

Loïc Ferrer, Hein Putter, Cécile Proust‐Lima

Statistics and Probability · HAL (Le Centre pour la Communication Scientifique Directe) · 2019 · cited 68× · DOI ↗ · more like this ·

After the diagnosis of a disease, one major objective is to predict cumulative probabilities of events such as clinical relapse or death from the individual information collected up to a prediction time, usually including biomarker repeated measurements. Several competing estimators have been proposed, mainly from two approaches: joint modelling and landmarking. These approaches differ by the information used, the model assumptions and the complexity of the computational procedures. This paper aims to review the two approaches, precisely define the derived estimators of dynamic predictions and compare their performances notably in case of misspecification. The ultimate goal is to provide key elements for the use of individual dynamic predictions in clinical practice. Prediction of two competing causes of prostate cancer progression from the history of prostate-specific antigen is used…

Dynamic prediction by landmarking in competing risks

Mioara Alina Nicolaie, Hans C. van Houwelingen, Theo M. de Witte +1 more

Statistics and Probability · Statistics in Medicine · 22 Oct 2012 · cited 63× · DOI ↗ · more like this ·

We propose an extension of the landmark model for ordinary survival data as a new approach to the problem of dynamic prediction in competing risks with time-dependent covariates. We fix a set of landmark time points tLM within the follow-up interval. For each of these landmark time points tLM , we create a landmark data set by selecting individuals at risk at tLM ; we fix the value of the time-dependent covariate in each landmark data set at tLM . We assume Cox proportional hazard models for the cause-specific hazards and consider smoothing the (possibly) time-dependent effect of the covariate for the different landmark data sets. Fitting this model is possible within the standard statistical software. We illustrate the features of the landmark modelling on a real data set on bone marrow transplantation.

Reduced‐rank proportional hazards regression and simulation‐based prediction for multi‐state models

Marta Fiocco, Hein Putter, Hans C. van Houwelingen

Statistics and Probability · Statistics in Medicine · 21 Apr 2008 · cited 57× · DOI ↗ · more like this ·

In this paper we address two issues arising in multi-state models with covariates. The first issue deals with how to obtain parsimony in the modeling of the effect of covariates. The standard way of incorporating covariates in multi-state models is by considering the transitions as separate building blocks, and modeling the effect of covariates for each transition separately, usually through a proportional hazards model for the transition hazard. This typically leads to a large number of regression coefficients to be estimated, and there is a real danger of over-fitting, especially when transitions with few events are present. We extend the reduced-rank ideas, proposed earlier in the context of competing risks, to multi-state models, in order to deal with this issue. The second issue addressed in this paper was motivated by the wish to obtain standard errors of the regression…

Peer instruction improves comprehension and transfer of physiological concepts: a randomized comparison with self-explanation

Marjolein Versteeg, Floris M. van Blankenstein, Hein Putter +1 more

Education · Advances in Health Sciences Education · 20 Oct 2018 · cited 54× · DOI ↗ · more like this ·

Comprehension of physiology is essential for development of clinical reasoning. However, medical students often struggle to understand physiological concepts. Interactive learning through Peer instruction (PI) is known to stimulate students' comprehension, but its relative efficacy and working mechanisms remain to be elucidated. In this study, we investigated if and how PI could optimize comprehension of physiological concepts and transfer relative to Self-explanation (SE) which is considered a lower-order type of overt learning. First-year medical students (n = 317) were randomly assigned to either PI or SE in a pre-post test design, followed by a set of near and far transfer questions. In both PI and SE groups post-test scores were significantly improved (p < 0.0001) with PI outperforming SE (+ 35% vs. + 23%, p = 0.006). Interestingly, a substantial number of students with initial…

On the relation between the cause‐specific hazard and the subdistribution rate for competing risks data: The Fine–Gray model revisited

Hein Putter, Martin Schumacher, Hans C. van Houwelingen

Statistics and Probability · Biometrical Journal · 4 Mar 2020 · cited 50× · DOI ↗ · more like this ·

The Fine-Gray proportional subdistribution hazards model has been puzzling many people since its introduction. The main reason for the uneasy feeling is that the approach considers individuals still at risk for an event of cause 1 after they fell victim to the competing risk of cause 2. The subdistribution hazard and the extended risk sets, where subjects who failed of the competing risk remain in the risk set, are generally perceived as unnatural . One could say it is somewhat of a riddle why the Fine-Gray approach yields valid inference. To take away these uneasy feelings, we explore the link between the Fine-Gray and cause-specific approaches in more detail. We introduce the reduction factor as representing the proportion of subjects in the Fine-Gray risk set that has not yet experienced a competing event. In the presence of covariates, the dependence of the reduction factor on a…

Vertical modeling: A pattern mixture approach for competing risks modeling

Mioara Alina Nicolaie, Hans C. van Houwelingen, Hein Putter

Statistics and Probability · Statistics in Medicine · 22 Jan 2010 · cited 47× · DOI ↗ · more like this ·

We study an alternative approach for estimation in the competing risks framework, called vertical modeling. It is motivated by a decomposition of the joint distribution of time and cause of failure. The two elements of this decomposition are (1) the time of failure and (2) the cause of failure condition on time of failure. Both elements of the model are based on observable quantities, namely the total hazard and the relative cause-specific hazards. The model can be implemented using the standard software. The relative cause-specific hazards are flexibly estimated using multinomial logistic regression and smoothing splines. We show estimates of cumulative incidences from vertical modeling to be more efficient statistically than those obtained from the standard nonparametric model. We illustrate our methods using data of 8966 leukemia patients from the European Group for Blood and Marrow…

Frailties in multi-state models: Are they identifiable? Do we need them?

Hein Putter, Hans C. van Houwelingen

Statistics and Probability · Statistical Methods in Medical Research · 23 Nov 2011 · cited 44× · DOI ↗ · more like this ·

The inclusion of latent frailties in survival models can serve two purposes: (1) the modelling of dependence in clustered data, (2) explaining lack of fit of univariate survival models, like deviation from the proportional hazards assumption. Multi-state models are somewhere between univariate data and clustered data. Frailty models can help in understanding the dependence in sequential transitions (like in clustered data) and can be useful in explaining some strange phenomena in the effect of covariates in competing risks models (like in univariate data). The (im)possibilities of frailty models will be exemplified on a data set of breast cancer patients with death as absorbing state and local recurrence and distant metastasis as intermediate events.

Meta‐analysis of pairs of survival curves under heterogeneity: A Poisson correlated gamma‐frailty approach

Marta Fiocco, Hein Putter, Hans C. van Houwelingen

Statistics and Probability · Statistics in Medicine · 6 Nov 2009 · cited 42× · DOI ↗ · more like this ·

We address the problem of meta-analysis of pairs of survival curves under heterogeneity. Starting point for the meta-analysis is a set of studies, each comparing the same two treatments, containing information about multiple survival outcomes. Under heterogeneity, we model the number of events using an extension of the Poisson correlated gamma-frailty model with serial within-arm and positive between-arm correlations. The parameters of the models are estimated following a two-stage estimation procedure. In the first stage the underlying hazards and between-study variance are estimated using the marginals, while a second stage is used to estimate both within-arm and between-arm correlations. The methodology is illustrated with an observational study on breast cancer.

Dynamic Pseudo-Observations: A Robust Approach to Dynamic Prediction in Competing Risks

Mioara Alina Nicolaie, Hans C. van Houwelingen, Theo M. de Witte +1 more

Statistics and Probability · Biometrics · 19 Jul 2013 · cited 40× · DOI ↗ · more like this ·

In this article, we propose a new approach to the problem of dynamic prediction of survival data in the presence of competing risks as an extension of the landmark model for ordinary survival data. The key feature of our method is the introduction of dynamic pseudo-observations constructed from the prediction probabilities at different landmark prediction times. They specifically address the issue of estimating covariate effects directly on the cumulative incidence scale in competing risks. A flexible generalized linear model based on these dynamic pseudo-observations and a generalized estimation equations approach to estimate the baseline and covariate effects will result in the desired dynamic predictions and robust standard errors. Our approach has a number of attractive features. It focuses directly on the prediction probabilities of interest, avoiding in this way complex modeling…

General tests of the Markov property in multi-state models

Andrew Titman, Hein Putter

Demography · Biostatistics · 9 Jul 2020 · cited 38× · DOI ↗ · more like this ·

Multi-state models for event history analysis most commonly assume the process is Markov. This article considers tests of the Markov assumption that are applicable to general multi-state models. Two approaches using existing methodology are considered; a simple method based on including time of entry into each state as a covariate in Cox models for the transition intensities and a method involving detecting a shared frailty through a stratified Commenges-Andersen test. In addition, using the principle that under a Markov process the future rate of transitions of the process at times $t > s$ should not be influenced by the state occupied at time $s$, a new class of general tests is developed by considering summaries from families of log-rank statistics where patients are grouped by the state occupied at varying initial time $s$. An extended form of the test applicable to models that are…

Regression models for expected length of stay

Mia Klinten Grand, Hein Putter

Statistics and Probability · Statistics in Medicine · 26 Oct 2015 · cited 35× · DOI ↗ · more like this ·

In multi-state models, the expected length of stay (ELOS) in a state is not a straightforward object to relate to covariates, and the traditional approach has instead been to construct regression models for the transition intensities and calculate ELOS from these. The disadvantage of this approach is that the effect of covariates on the intensities is not easily translated into the effect on ELOS, and it typically relies on the Markov assumption. We propose to use pseudo-observations to construct regression models for ELOS, thereby allowing a direct interpretation of covariate effects while at the same time avoiding the Markov assumption. For this approach, all we need is a non-parametric consistent estimator for ELOS. For every subject (and for every state of interest), a pseudo-observation is constructed, and they are then used as outcome variables in the regression model. We…

Landmarking 2.0: Bridging the gap between joint models and landmarking

Hein Putter, Hans C. van Houwelingen

stat.ME · 30 Mar 2021 · cited 30× · arXiv ↗ · more like this ·

The problem of dynamic prediction with time-dependent covariates, given by biomarkers, repeatedly measured over time, has received much attention over the last decades. Two contrasting approaches have become in widespread use. The first is joint modelling, which attempts to jointly model the longitudinal markers and the event time. The second is landmarking, a more pragmatic approach that avoids modelling the marker process. Landmarking has been shown to be less efficient than correctly specified joint models in simulation studies, when data are generated from the joint model. When the mean model is misspecified, however, simulation has shown that joint models may be inferior to landmarking. The objective of this paper is to develop methods that improve the predictive accuracy of landmarking, while retaining its relative simplicity and robustness. We start by fitting a working…

Resampling: consistency of substitution estimators

Hein Putter, W. R. van Zwet

Statistics and Probability · The Annals of Statistics · December 1996 · cited 30× · DOI ↗ · more like this ·

On the basis of N i.i.d. random variables with a common unknown distribution P we wish to estimate a functional $\tau_N(P)$. An obvious and very general approach to this problem is to find an estimator $\hat{P}_N$ of P first, and then construct a so-called substitution estimator $\tau_N (\hat{P}_N)$ of $\tau_N(P)$. In this paper we investigate how to choose the estimator $\hat{P}_N$ so that the substitution estimator $\tau_N (\hat{P}_N)$ will be consistent. Although our setup covers a broad class of estimation problems, the main substitution estimator we have in mind is a general version of the bootstrap where resampling is done from an estimated distribution $\hat{P}_N$. We do not focus in advance on a particular estimator $\hat{P}_N$, such as, for example, the empirical distribution, but try to indicate which resampling distribution should be used in a particular situation. The…

Reduced rank proportional hazards model for competing risks

Marta Fiocco, Hein Putter, Hans C. van Houwelingen

Statistics and Probability · Biostatistics · 14 Apr 2005 · cited 29× · DOI ↗ · more like this ·

Competing events concerning individual subjects are of interest in many medical studies. For example, leukemia-free patients surviving a bone marrow transplant are at risk of developing acute or chronic graft-versus-host disease, or they might develop infections. In this situation, competing risks models provide a natural framework to describe the disease. When incorporating covariates influencing the transition intensities, an obvious approach is to use Cox's proportional hazards model for each of the transitions separately. A practical problem then is how to deal with the abundance of regression parameters. Our objective is to describe the competing risks model in fewer parameters, both in order to avoid imprecise estimation in transitions with rare events and in order to facilitate interpretation of these estimates. Suppose that the regression parameters are gathered into a p x K…

Transplant as a competing risk in the analysis of dialysis patients

Nan van Geloven, Saskia le Cessie, Friedo W. Dekker +1 more

Statistics and Probability · Nephrology Dialysis Transplantation · 30 Jan 2017 · cited 28× · DOI ↗ · more like this ·

Time-to-event analyses are frequently used in nephrology research, for instance, when recording time to death or time to peritonitis in dialysis patients. Many papers have pointed out the important issue of competing events (or competing risks) in such analyses. For example, when studying one particular cause of death it can be noted that patients also die from other causes. Such competing events preclude the event of interest from occurring and thereby complicate the statistical analysis. The Kaplan-Meier approach to calculating the cumulative probability of the event of interest yields invalid results in the presence of competing risks, thus the alternative cumulative incidence competing risk (CICR) approach has become the standard. However, when kidney transplant is the competing event that prevents observing the outcome of interest, CICR may not always be the matter of interest. We…