arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Roman Parzer

5 papers · 2023–2025

2023: 22024: 22025: 1
2023peak 2 in 20232025

Frequent co-authors

Papers

showing 1–5 of 5 RSS

Sparse Data-Driven Random Projection in Regression for High-Dimensional Data

Roman Parzer, Peter Filzmoser, Laura Vana-Gür

stat.ME · · cited 1× · arXiv ↗ · more like this ·

We examine the linear regression problem in a challenging high-dimensional setting with correlated predictors where the vector of coefficients can vary from sparse to dense. In this setting, we propose a combination of probabilistic variable screening with random projection tools as a viable approach. More specifically, we introduce a new data-driven random projection tailored to the problem at hand and derive a theoretical bound on the gain in expected prediction error over conventional random projections. The variables to enter the projection are screened by accounting for predictor correlation. To reduce the dependence on fine-tuning choices, we aggregate over an ensemble of linear models. A thresholding parameter is introduced to obtain a higher degree of sparsity. Both this parameter and the number of models in the ensemble can be chosen by cross-validation. In extensive…

Structured time‐dependent inverse regression (STIR)

Minsun Song, Efstathia Bura, Roman Parzer +1 more

Statistics and Probability · Statistics in Medicine · · cited 1× · DOI ↗ · more like this ·

We propose and study structured time-dependent inverse regression (STIR), a novel sufficient dimension reduction model, to analyze longitudinally measured, correlated biomarkers in relation to an outcome. The time structure is accommodated in an inverse regression model for the markers that can be applied both to equally and unequally spaced time points for each sample. The inverse regression structure also naturally accommodates retrospectively sampled markers, that is, markers measured in case-control studies. We estimate the corresponding linear combinations of the markers, the reduction, using least squares. We show that under additional distributional assumptions the reduction contains sufficient information about the outcome. In extensive simulations the STIR linear combinations perform well in predictive models based on samples of realistic size. A Wald-type test for association…

Random projections and dimensionality reduction in high-dimensional statistical learning

Roman Parzer

Statistics and Probability · reposiTUm (TU Wien) · · cited 0× · DOI ↗ · more like this ·

This thesis is concerned with the development of tools for the analysis of high-dimensional data, with a focus on different robustness aspects in high-dimensional statistical learning. The recent advances in technology have allowed more and more quantities to be tracked and stored, which has lead to a huge increase in the amount of data, making available datasets more complex and larger than ever, both in dimension (number of variables p) and size (number of observations n). Since many classical statistical methods do not consider the arising practical and computational limitations, there is a need for new methods specifically designed with these problems in mind. One specific problem setting is to predict a response variable of interest Y using a large set of p available predictor variables X using some regression function g with Y=g(X,u) and an unknown error term u. Furthermore, we…

spar: Sparse Projected Averaged Regression in R

Roman Parzer, Laura Vana-Gür, Peter Filzmoser

stat.CO · · cited 0× · arXiv ↗ · more like this ·

Package spar for R builds ensembles of predictive generalized linear models with high-dimensional predictors. It employs an algorithm utilizing variable screening and random projection tools to efficiently handle the computational challenges associated with large sets of predictors. The package is designed with a strong focus on extensibility. Screening and random projection techniques are implemented as S3 classes with user-friendly constructor functions, enabling users to easily integrate and develop new procedures. This design enhances the package's adaptability and makes it a powerful tool for a variety of high-dimensional applications.

Data-Driven Random Projection and Screening for High-Dimensional Generalized Linear Models

Roman Parzer, Peter Filzmoser, Laura Vana-Gür

stat.ME · · cited 0× · arXiv ↗ · more like this ·

We address the challenge of correlated predictors in high-dimensional GLMs, where regression coefficients range from sparse to dense, by proposing a data-driven random projection method. This is particularly relevant for applications where the number of predictors is (much) larger than the number of observations and the underlying structure -- whether sparse or dense -- is unknown. We achieve this by using ridge-type estimates for variable screening and random projection to incorporate information about the response-predictor relationship when performing dimensionality reduction. We demonstrate that a ridge estimator with a small penalty is effective for random projection and screening, but the penalty value must be carefully selected. Unlike in linear regression, where penalties approaching zero work well, this approach leads to overfitting in non-Gaussian families. Instead, we…