Author

Axel Munk

162 papers · 1993–2026

1993peak 12 in 20152026

Frequent co-authors

Papers

showing 1–25 of 162 RSS

Multiscale Change-Point Inference

Klaus Frick, Axel Munk, Hannes Sieling

stat.ME · January 2013 · cited 373× · arXiv ↗ · more like this ·

We introduce a new estimator SMUCE (simultaneous multiscale change-point estimator) for the change-point problem in exponential family regression. An unknown step function is estimated by minimizing the number of change-points over the acceptance region of a multiscale test at a level α. The probability of overestimating the true number of change-points K is controlled by the asymptotic null distribution of the multiscale test statistic. Further, we derive exponential bounds for the probability of underestimating K. By balancing these quantities, αwill be chosen such that the probability of correctly estimating K is maximized. All results are even non-asymptotic for the normal case. Based on the aforementioned bounds, we construct asymptotically honest confidence sets for the unknown step function and its change-points. At the same time, we obtain exponential bounds for estimating the…

Convergence Rates of General Regularization Methods for Statistical Inverse Problems and Applications

Nicolai Bissantz, Thorsten Hohage, Axel Munk +1 more

Mathematical Physics · SIAM Journal on Numerical Analysis · 2007 · cited 230× · DOI ↗ · more like this ·

Previously, the convergence analysis for linear statistical inverse problems has mainly focused on spectral cut-off and Tikhonov-type estimators. Spectral cut-off estimators achieve minimax rates for a broad range of smoothness classes and operators, but their practical usefulness is limited by the fact that they require a complete spectral decomposition of the operator. Tikhonov estimators are simpler to compute but still involve the inversion of an operator and achieve minimax rates only in restricted smoothness classes. In this paper we introduce a unifying technique to study the mean square error of a large class of regularization methods (spectral methods) including the aforementioned estimators as well as many iterative methods, such as $\nu$-methods and the Landweber iteration. The latter estimators converge at the same rate as spectral cut-off but require only matrix-vector…

Consistencies and rates of convergence of jump-penalized least squares estimators

Leif Boysen, Angela Kempe, Volkmar Liebscher +2 more

math.ST · 27 Feb 2009 · cited 190× · arXiv ↗ · more like this ·

We study the asymptotics for jump-penalized least squares regression aiming at approximating a regression function by piecewise constant functions. Besides conventional consistency and convergence rates of the estimates in $L^2([0,1))$ our results cover other metrics like Skorokhod metric on the space of càdlàg functions and uniform metrics on $C([0,1])$. We will show that these estimators are in an adaptive sense rate optimal over certain classes of "approximation spaces." Special cases are the class of functions of bounded variation (piecewise) Hölder continuous functions of order $0<α\le1$ and the class of step functions with a finite but arbitrary number of jumps. In the latter setting, we will also deduce the rates known from change-point analysis for detecting the jumps. Finally, the issue of fully automatic selection of the smoothing parameter is addressed.

Inference for Empirical Wasserstein Distances on Finite Spaces

Max Sommerfeld, Axel Munk

stat.ME · October 2016 · cited 187× · arXiv ↗ · more like this ·

The Wasserstein distance is an attractive tool for data analysis but statistical inference is hindered by the lack of distributional limits. To overcome this obstacle, for probability measures supported on finitely many points, we derive the asymptotic distribution of empirical Wasserstein distances as the optimal value of a linear program with random objective function. This facilitates statistical inference (e.g. confidence intervals for sample based Wasserstein distances) in large generality. Our proof is based on directional Hadamard differentiability. Failure of the classical bootstrap and alternatives are discussed. The utility of the distributional results is illustrated on two data sets.

INTRINSIC SHAPE ANALYSIS: GEODESIC PCA FOR RIEMANNIAN MANIFOLDS MODULO ISOMETRIC LIE GROUP ACTIONS

Stephan Huckemann, Thomas Hotzand, Axel Munk +1 more

Geometry and Topology · GoeScholar The Publication Server of the Georg-August-Universität Göttingen (Georg-August-Universität Göttingen) · 2007 · cited 139× · OpenAlex ↗ · more like this ·

In this paper, we illustrate a new approach for applying classical statistical\nmethods to multivariate non-linear data. In two examples occurring in the statistical\nstudy of shape of three dimensional geometrical objects, we illustrate that\nthe current methods of PCA by linear Euclidean approximation are unsuitable\nif such data in non-linear spaces fall into regions of high curvature, or if they\nhave a large spread. In the following we give an overview of the background of\nrelevant previous work, and an introduction to the building blocks of our work.

Testing Heteroscedasticity In Nonparametric Regression

Holger Dette, Axel Munk

Statistics and Probability · Journal of the Royal Statistical Society Series B (Statistical Methodology) · November 1998 · cited 125× · DOI ↗ · more like this ·

Summary The importance of being able to detect heteroscedasticity in regression is widely recognized because efficient inference for the regression function requires that heteroscedasticity is taken into account. In this paper a simple consistent test for heteroscedasticity is proposed in a nonparametric regression set-up. The test is based on an estimator for the best L 2-approximation of the variance function by a constant. Under mild assumptions asymptotic normality of the corresponding test statistic is established even under arbitrary fixed alternatives. Confidence intervals are obtained for a corresponding measure of heteroscedasticity. The finite sample performance and robustness of these procedures are investigated in a simulation study and Box-type corrections are suggested for small sample sizes.

Seeded Binary Segmentation: A general methodology for fast and optimal change point detection

Solt Kovács, Housen Li, Peter Bühlmann +1 more

stat.ME · 16 Feb 2020 · cited 120× · arXiv ↗ · more like this ·

In recent years, there has been an increasing demand on efficient algorithms for large scale change point detection problems. To this end, we propose seeded binary segmentation, an approach relying on a deterministic construction of background intervals, called seeded intervals, in which single change points are searched. The final selection of change points based on the candidates from seeded intervals can be done in various ways, adapted to the problem at hand. Thus, seeded binary segmentation is easy to adapt to a wide range of change point detection problems, let that be univariate, multivariate or even high-dimensional. We consider the univariate Gaussian change in mean setup in detail. For this specific case we show that seeded binary segmentation leads to a near-linear time approach (i.e. linear up to a logarithmic factor) independent of the underlying number of change points.…

Nonparametric Validation of Similar Distributions and Assessment of Goodness of Fit

Axel Munk, Claudia Czado

Statistics and Probability · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1998 · cited 108× · DOI ↗ · more like this ·

Summary In this paper the problem of assessing the similarity of two cumulative distribution functions F and G is considered. An asymptotic test based on an α-trimmed version of Mallows distance Γα(F, G) between F and G is suggested, thus demonstrating the similarity of F and G within a preassigned Γα(F, G) neighbourhood at a controlled type I error rate. The test proposed is applied to the validation of goodness of fit and for the nonparametric assessment of bioequivalence. It is shown that Γα(F, G) can be interpreted as average and population equivalence. Our approach is illustrated by various examples.

On Difference-Based Variance Estimation in Nonparametric Regression When the Covariate is High Dimensional

Axel Munk, Nicolai Bissantz, Thorsten Wagner +1 more

Statistics and Probability · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 13 Dec 2004 · cited 92× · DOI ↗ · more like this ·

Summary We consider the problem of estimating the noise variance in homoscedastic nonparametric regression models. For low dimensional covariates t ∈ ℝd, d=1, 2, difference-based estimators have been investigated in a series of papers. For a given length of such an estimator, difference schemes which minimize the asymptotic mean-squared error can be computed for d=1 and d=2. However, from numerical studies it is known that for finite sample sizes the performance of these estimators may be deficient owing to a large finite sample bias. We provide theoretical support for these findings. In particular, we show that with increasing dimension d this becomes more drastic. If d⩾4, these estimators even fail to be consistent. A different class of estimators is discussed which allow better control of the bias and remain consistent when d⩾4. These estimators are compared numerically with…

Identifiability of Finite Mixtures of Elliptical Distributions

Hajo Holzmann, Axel Munk, Tilmann Gneiting

Artificial Intelligence · Scandinavian Journal of Statistics · 17 Mar 2006 · cited 91× · DOI ↗ · more like this ·

Abstract. We present general results on the identifiability of finite mixtures of elliptical distributions under conditions on the characteristic generators or density generators. Examples include the multivariate t ‐distribution, symmetric stable laws, exponential power and Kotz distributions. In each case, the shape parameter is allowed to vary in the mixture, in addition to the location vector and the scatter matrix. Furthermore, we discuss the identifiability of finite mixtures of elliptical densities with generators that correspond to scale mixtures of normal distributions.

Consistency and rates of convergence of nonlinear Tikhonov regularization with random noise

Nicolai Bissantz, Thorsten Hohage, Axel Munk

Mathematical Physics · Inverse Problems · 25 Sep 2004 · cited 88× · DOI ↗ · more like this ·

We consider nonlinear inverse problems described by operator equations F(a) = u. Here a is an element of a Hilbert space H which we want to estimate, and u is an L2-function. The given data consist of measurements of u at n points, perturbed by random noise. We construct an estimator for a by a combination of a local polynomial estimator and a nonlinear Tikhonov regularization and establish consistency in the sense that the mean integrated square error (MISE) tends to 0 as n → ∞ under reasonable assumptions. Moreover, if a satisfies a source condition, we prove convergence rates for the MISE of , as well as almost surely. Further, it is shown that a cross-validated parameter selection yields a fully data-driven consistent method for the reconstruction of a. Finally, the feasibility of our algorithm is investigated in a numerical study for a groundwater filtration problem and an inverse…

Security Considerations in Minutiae-Based Fuzzy Vaults

Benjamin Tams, Preda Mihăilescu, Axel Munk

Signal Processing · IEEE Transactions on Information Forensics and Security · 14 Jan 2015 · cited 86× · DOI ↗ · more like this ·

The fuzzy vault scheme is a cryptographic primitive that can be used to protect human fingerprint templates where stored. Analyses for most implementations account for brute-force security only. There are, however, other risks that have to be consider, such as false-accept attacks, record multiplicity attacks, and information leakage from auxiliary data, such as alignment parameters. In fact, the existing work lacks analyses of these weaknesses and are even susceptible to a variety of them. In view of these vulnerabilities, we redesign a minutiae-based fuzzy vault implementation preventing an adversary from running attacks via record multiplicity. Furthermore, we propose a mechanism for robust absolute fingerprint prealignment. In combination, we obtain a fingerprint-based fuzzy vault that resists known record multiplicity attacks and that does not leak information about the protected…

An unbiased test for the bioequivalence problem

Lawrence D. Brown, J. T. Gene Hwang, Axel Munk

Statistics and Probability · The Annals of Statistics · December 1997 · cited 84× · DOI ↗ · more like this ·

It is shown that the standard two one-sided tests procedure for bioequivalence is a biased test. Better tests exist. In this paper, an unbiased $\alpha$-level test and other tests which are uniformly more powerful than the two one-sided tests procedure are constructed. Its power can be noticeably larger than that of the $\alpha$-level two one-sided tests procedure.

FDR-Control in Multiscale Change-point Segmentation

Housen Li, Axel Munk, Hannes Sieling

math.ST · December 2014 · cited 80× · arXiv ↗ · more like this ·

Fast multiple change-point segmentation methods, which additionally provide faithful statistical statements on the number, locations and sizes of the segments, have recently received great attention. In this paper, we propose a multiscale segmentation method, FDRSeg, which controls the false discovery rate (FDR) in the sense that the number of false jumps is bounded linearly by the number of true jumps. In this way, it adapts the detection power to the number of true jumps. We prove a non-asymptotic upper bound for its FDR in a Gaussian setting, which allows to calibrate the only parameter of FDRSeg properly. Change-point locations, as well as the signal, are shown to be estimated in a uniform sense at optimal minimax convergence rates up to a log-factor. The latter is w.r.t. $L^p$-risk, $p \ge 1$, over classes of step functions with bounded jump sizes and either bounded, or possibly…

Nonparametric comparison of several regression functions: exact and asymptotic theory

Holger Dette, Axel Munk

Statistics and Probability · The Annals of Statistics · December 1998 · cited 80× · DOI ↗ · more like this ·

A new test is proposed for the comparison of two regression curves $f$ and $g$. We prove an asymptotic normal law under fixed alternatives which can be applied for power calculations, for constructing confidence regions and for testing precise hypotheses of a weighted $L_2$ distance between $f$ and $g$ . In particular, the problem of nonequal sample sizes is treated, which is related to a peculiar formula of the area between two step functions. These results are extended in various directions, such as the comparison of $k$ regression functions or the optimal allocation of the sample sizes when the total sample size is fixed. The proposed pivot statistic is not based on a nonparametric estimator of the regression curves and therefore does not require the specification of any smoothing parameter.

Validation of linear regression models

Holger Dette, Axel Munk

Statistics and Probability · The Annals of Statistics · April 1998 · cited 78× · DOI ↗ · more like this ·

A new test is proposed in order to verify that a regression function, say $g$, has a prescribed (linear) parametric form. This procedure is based on the large sample behavior of an empirical $L^2$-distance between $g$ and the subspace $U$ spanned by the regression functions to be verified. The asymptotic distribution of the test statistic is shown to be normal with parameters depending only on the variance of the observations and the $L^2$-distance between the regression function $g$ and the model space $U$. Based on this result, a test is proposed for the hypothesis that "$g$ is not in a preassigned $L^2$-neighborhood of $U$," whichallows the "verification" of the model $U$ at a controlled type I error rate. The suggested procedure is very easy to apply because of its asymptotic normal law and the simple form of the test statistic. In particular, it does not require nonparametric…

Global Models for the Orientation Field of Fingerprints: An Approach Based on Quadratic Differentials

Stephan Huckemann, Thomas Hotz, Axel Munk

Signal Processing · IEEE Transactions on Pattern Analysis and Machine Intelligence · 24 Jul 2008 · cited 77× · DOI ↗ · more like this ·

Quadratic differentials naturally define analytic orientation fields on planar surfaces. We propose to model orientation fields of fingerprints by specifying quadratic differentials. Models for all fingerprint classes such as arches, loops and whorls are laid out. These models are parametrised by few, geometrically interpretable parameters which are invariant under Euclidean motions. We demonstrate their ability in adapting to given, observed orientation fields, and we compare them to existing models using the fingerprint images of the NIST Special Database 4. We also illustrate that these model allow for extrapolation into unobserved regions. This goes beyond the scope of earlier models for the orientation field as those are restricted to the observed planar fingerprint region. Within the framework of quadratic differentials we are able to verify analytically Penrose's formula for the…

Non-Parametric Confidence Bands in Deconvolution Density Estimation

Nicolai Bissantz, Lutz Dümbgen, Hajo Holzmann +1 more

Statistics and Probability · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 22 May 2007 · cited 76× · DOI ↗ · more like this ·

Summary Uniform confidence bands for densities f via non-parametric kernel estimates were first constructed by Bickel and Rosenblatt. In this paper this is extended to confidence bands in the deconvolution problem g=f*ψ for an ordinary smooth error density ψ. Under certain regularity conditions, we obtain asymptotic uniform confidence bands based on the asymptotic distribution of the maximal deviation (L∞-distance) between a deconvolution kernel estimator f^ and f. Further consistency of the simple non-parametric bootstrap is proved. For our theoretical developments the bias is simply corrected by choosing an undersmoothing bandwidth. For practical purposes we propose a new data-driven bandwidth selector that is based on heuristic arguments, which aims at minimizing the L∞-distance between f^ and f. Although not constructed explicitly to undersmooth the estimator, a simulation study…

Iteratively Regularized Gauss–Newton Method for Nonlinear Inverse Problems with Random Noise

Frank Bauer, Thorsten Hohage, Axel Munk

Mathematical Physics · SIAM Journal on Numerical Analysis · 2009 · cited 73× · DOI ↗ · more like this ·

We study the convergence of regularized Newton methods applied to nonlinear operator equations in Hilbert spaces if the data are perturbed by random noise. It is shown that the expected square error is bounded by a constant times the minimax rates of the corresponding linearized problem if the stopping index is chosen using a priori knowledge of the smoothness of the solution. For unknown smoothness the stopping index can be chosen adaptively based on Lepski's balancing principle. For this stopping rule we establish an oracle inequality, which implies order optimal rates for deterministic errors, and optimal rates up to a logarithmic factor for random noise. The performance and the statistical properties of the proposed method are illustrated by Monte Carlo simulations.

Empirical Regularized Optimal Transport: Statistical Theory and Applications

Marcel Klatt, Carla Tameling, Axel Munk

math.ST · October 2018 · cited 69× · arXiv ↗ · more like this ·

We derive limit distributions for certain empirical regularized optimal transport distances between probability distributions supported on a finite metric space and show consistency of the (naive) bootstrap. In particular, we prove that the empirical regularized transport plan itself asymptotically follows a Gaussian law. The theory includes the Boltzmann-Shannon entropy regularization and hence a limit law for the widely applied Sinkhorn divergence. Our approach is based on an application of the implicit function theorem to necessary and sufficient optimality conditions for the regularized transport problem. The asymptotic results are investigated in Monte Carlo simulations. We further discuss computational and statistical applications, e.g. confidence bands for colocalization analysis of protein interaction networks based on regularized optimal transport.

Robust Orientation Field Estimation and Extrapolation Using Semilocal Line Sensors

Carsten Gottschlich, Preda Mihăilescu, Axel Munk

Signal Processing · IEEE Transactions on Information Forensics and Security · 30 Sep 2009 · cited 69× · DOI ↗ · more like this ·

<para xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> Orientation field (OF) estimation is a crucial preprocessing step in fingerprint image processing. In this paper, we present a novel method for OF estimation that uses traced ridge and valley lines. This approach provides robustness against disturbances caused, e.g., by scars, contamination, moisture, or dryness of the finger. It considers pieces of flow information from a larger region and makes good use of fingerprint inherent properties like continuity of ridge flow perpendicular to the flow. The performance of the line-sensor method is compared with the gradients-based method and a multiscale directional operator. Its robustness is tested in experiments with simulated scar noise which is drawn on top of good quality fingerprint images from the FVC2000 and FVC2002 databases. Finally, the…

Optimal Transport: Fast Probabilistic Approximation with Exact Solvers

Max Sommerfeld, Jörn Schrieber, Yoav Zemel +1 more

stat.CO · February 2018 · cited 64× · arXiv ↗ · more like this ·

We propose a simple subsampling scheme for fast randomized approximate computation of optimal transport distances. This scheme operates on a random subset of the full data and can use any exact algorithm as a black-box back-end, including state-of-the-art solvers and entropically penalized versions. It is based on averaging the exact distances between empirical measures generated from independent samples from the original measures and can easily be tuned towards higher accuracy or shorter computation times. To this end, we give non-asymptotic deviation bounds for its accuracy in the case of discrete optimal transport problems. In particular, we show that in many important instances, including images (2D-histograms), the approximation error is independent of the size of the full problem. We present numerical experiments that demonstrate that a very good approximation in typical…

Convergence Analysis of Generalized Iteratively Reweighted Least Squares Algorithms on Convex Function Spaces

Nicolai Bissantz, Lutz Dümbgen, Axel Munk +1 more

Statistics and Probability · SIAM Journal on Optimization · 2009 · cited 59× · DOI ↗ · more like this ·

The computation of robust regression estimates often relies on minimization of a convex functional on a convex set. In this paper we discuss a general technique for a large class of convex functionals to compute the minimizers iteratively, which is closely related to majorization-minimization algorithms. Our approach is based on a quadratic approximation of the functional to be minimized and includes the iteratively reweighted least squares algorithm as a special case. We prove convergence on convex function spaces for general coercive and convex functionals F and derive geometric convergence in certain unconstrained settings. The algorithm is applied to total variation (TV) penalized quantile regression and is compared with a step size corrected Newton–Raphson algorithm. It is found that typically in the first steps the iteratively reweighted least squares algorithm performs…

Multiscale Methods for Shape Constraints in Deconvolution: Confidence Statements for Qualitative Features

Johannes Schmidt-Hieber, Axel Munk, Lutz Duembgen

math.ST · July 2011 · cited 55× · arXiv ↗ · more like this ·

We derive multiscale statistics for deconvolution in order to detect qualitative features of the unknown density. An important example covered within this framework is to test for local monotonicity on all scales simultaneously. We investigate the moderately ill-posed setting, where the Fourier transform of the error density in the deconvolution model is of polynomial decay. For multiscale testing, we consider a calibration, motivated by the modulus of continuity of Brownian motion. We investigate the performance of our results from both the theoretical and simulation based point of view. A major consequence of our work is that the detection of qualitative features of a density in a deconvolution problem is a doable task although the minimax rates for pointwise estimation are very slow.

The assessment of non‐inferiority in a gold standard design with censored, exponentially distributed endpoints

Matthias Mielke, Axel Munk, Alexander Schacht

Statistics and Probability · Statistics in Medicine · 23 Jun 2008 · cited 52× · DOI ↗ · more like this ·

The objective of this paper is to develop statistical methodology for non-inferiority hypotheses to censored, exponentially distributed time to event endpoints. Motivated by a recent clinical trial in depression, we consider a gold standard design where a test group is compared with an active reference and with a placebo group. The test problem is formulated in terms of a retention of effect hypothesis. Thus, the proposed Wald-type test procedure assures that the effect of the test group is better than a pre-specified proportion Delta of the treatment effect of the reference group compared with the placebo group. A sample size allocation rule to achieve optimal power is presented, which only depends on the pre-specified Delta and the probabilities for the occurrence of censoring. In addition, a pretest is presented for either the reference or the test group to ensure assay sensitivity…