Author

Michael Neumann

232 papers · 1976–2026

1976peak 14 in 19982026

Frequent co-authors

Papers

showing 1–25 of 232 RSS

Attentive Convolutional Neural Network based Speech Emotion Recognition: A Study on the Impact of Input Features, Signal Length, and Acted Speech

Michael Neumann, Ngoc Thang Vu

cs.CL · 2 Jun 2017 · cited 237× · arXiv ↗ · more like this ·

Speech emotion recognition is an important and challenging task in the realm of human-computer interaction. Prior work proposed a variety of models and feature sets for training a system. In this work, we conduct extensive experiments using an attentive convolutional neural network with multi-view learning objective function. We compare system performance using different lengths of the input signal, different types of acoustic features and different types of emotion speech (improvised/scripted). Our experimental results on the Interactive Emotional Motion Capture (IEMOCAP) database reveal that the recognition performance strongly depends on the type of speech data independent of the choice of input features. Furthermore, we achieved state-of-the-art results on the improvised speech data of IEMOCAP.

Absolute regularity and ergodicity of Poisson count processes

Michael H. Neumann

math.ST · 5 Jan 2012 · cited 172× · arXiv ↗ · more like this ·

We consider a class of observation-driven Poisson count processes where the current value of the accompanying intensity process depends on previous values of both processes. We show under a contractive condition that the bivariate process has a unique stationary distribution and that a stationary version of the count process is absolutely regular. Moreover, since the intensities can be written as measurable functionals of the count variables, we conclude that the bivariate process is ergodic. As an important application of these results, we show how a test method previously used in the case of independent Poisson data can be used in the case of Poisson count processes.

Wavelet thresholding in anisotropic function classes and application to adaptive estimation of evolutionary spectra

Michael H. Neumann, Rainer von Sachs

Computer Vision and Pattern Recognition · The Annals of Statistics · February 1997 · cited 152× · DOI ↗ · more like this ·

We derive minimax rates for estimation in anisotropic smoothness classes. These rates are attained by a coordinatewise thresholded wavelet estimator based on a tensor product basis with separate scale parameter for every dimension. It is shown that this basis is superior to its one-scale multiresolution analog, if different degrees of smoothness in different directions are present. As an important application we introduce a new adaptive waveletestimator of the time-dependent spectrum of a locally stationary time series. Using this model which was recently developed by Dahlhaus, we show that the resulting estimator attains nearly the rate, which is optimal in Gaussian white noise, simultaneously over a wide range of smoothness classes. Moreover, by our new approach we overcome the difficulty of how to choose the right amount of smoothing, that is, how to adapt to the appropriate…

On the effect of estimating the error density in nonparametric deconvolution

Michael H. Neumann, Ola Hössjer

Statistics and Probability · Journal of nonparametric statistics · 1997 · cited 139× · DOI ↗ · more like this ·

It is quite common in the statistical literature on nonparametric deconvolution to assume that the error density is perfectly known. Since this seems to be unrealistic in many practical applications, we study the effect of estimating the unknown error density. We derive minimax rates of convergence and propose a modification of the usual kernel-based estimation scheme, which takes the uncertainty about the error density into account. A simulation study quantifies the possible gains by this new method in finite sample situations.

Effect of dimensionality on the Nelder–Mead simplex method

Lixing Han, Michael Neumann

Numerical Analysis · Optimization methods & software · 7 Dec 2004 · cited 127× · DOI ↗ · more like this ·

Abstract The effect of dimensionality on the widely used Nelder–Mead simplex method for unconstrained optimization is investigated. It is shown that by using the quadratic function f(x)=x T x, the Nelder–Mead simplex method deteriorates as the dimension increases. Keywords: Nelder–Mead methodSimplexEffect of dimensionalityConvergenceOptimization Acknowledgements We are very grateful to the referees for their insightful and constructive comments and suggestions, which helped us to improve the content and presentation of the paper. We also thank David Byatt for providing us his thesis. Lixing Han's research was supported in part by a UM-Flint 2002 summer research fellowship. The work of this Michael Neumann was supported in part by NSF Grant No. DMS9973247.

Simultaneous bootstrap confidence bands in nonparametric regression

Michael H. Neumann, Jörg Polzehl

Statistics and Probability · Journal of nonparametric statistics · 1998 · cited 96× · DOI ↗ · more like this ·

In the present paper we construct asymptotic confidence bands in non-parametric regression. Our assumptions cover unequal variances of the observations and nonuni-form, possibly considerably clustered design. The confidence band is based on an undersmoothed local polynomial estimator. An appropriate quantile is obtained via the wild bootstrap. We derive certain rates (in the sample size n) for the error in coverage probability, which improves on existing results for methods that rely on the asymptotic distribution of the maximum of some Gaussian process. We propose a practicable rule for a data-dependent choice of the band-width. A small simulation study illustrates the possible gains by our approach over alternative frequently used methods.

Characteristic vertices of weighted trees via perron values

Steve Kirkland, Michael Neumann, Bryan L. Shader

Geometry and Topology · Linear and Multilinear Algebra · 1996 · cited 94× · DOI ↗ · more like this ·

We consider a weighted tree T with algebraic connectivity μ, and characteristic vertex v. We show that μ and its associated eigenvectors can be described in terms of the Perron value and vector of a nonnegative matrix which can be computed from the branches of T at v. The machinery of Perron-Frobenius theory can then be used to characterize Type I and Type II trees in terms of these Perron values, and to show that if we construct a weighted tree by taking two weighted trees and identifying a vertex of one with a vertex of the other, then any characteristic vertex of the new tree lies on the path joining the characteristic vertices of the two old trees.

Exact Risk Analysis of Wavelet Regression

J. S. Marron, Süleyman Adak, Iain M. Johnstone +2 more

Computer Vision and Pattern Recognition · Journal of Computational and Graphical Statistics · September 1998 · cited 79× · DOI ↗ · more like this ·

Abstract Wavelets have motivated development of a host of new ideas in nonparametric regression smoothing. Here we apply the too] of exact risk analysis, to understand the small sample behavior of wavelet estimators, and thus to check directly the conclusions suggested by asymptotics. Comparisons between some wavelet bases, and also between hard and soft thresholding, are given from several viewpoints. Our results provide insight as to why the viewpoints and conclusions of Donoho and Johnstone differ from those of Hall and Patil.

SPECTRAL DENSITY ESTIMATION VIA NONLINEAR WAVELET METHODS FOR STATIONARY NON‐GAUSSIAN TIME SERIES

Michael H. Neumann

Computer Vision and Pattern Recognition · Journal of Time Series Analysis · November 1996 · cited 77× · DOI ↗ · more like this ·

Abstract. In the present paper we consider nonlinear wavelet estimators of the spectral density f of a zero mean, not necessarily Gaussian, stochastic process, which is stationary in the wide sense. It is known in the case of Gaussian regression that these estimators outperform traditional linear methods if the degree of smoothness of the regression function varies considerably over the interval of interest. Such methods are based on a nonlinear treatment of empirical coefficients that arise from an orthonormal series expansion according to a wavelet basis. The main goal of this paper is to transfer these methods to spectral density estimation. This is done by showing the asymptotic normality of certain empirical coefficients based on the tapered periodogram. Using these results we can show the risk equivalence to the Gaussian case for monotone estimators based on such empirical…

Regression-type inference in nonparametric autoregression

Jens‐Peter Kreiß, Michael H. Neumann

Statistics and Probability · The Annals of Statistics · August 1998 · cited 76× · DOI ↗ · more like this ·

We derive a strong approximation of a local polynomial estimator LPE in nonparametric autoregression by an (LPE) in a corresponding nonparametric regression model. This generally suggests the application of regression-typical tools for statistical inference in nonparametric autoregressive models. It provides an important simplification for the boot-strap method to be used: It is enough to mimic the structure of a nonparametric regression model rather than to imitate the more complicated process structure in the autoregressive case. As an example we consider a simple wild bootstrap, which is used for the construction of simultaneous confidence bands and nonparametric supremum-type tests.

Bootstrapping Neural Networks

Jürgen Franke, Michael H. Neumann

Artificial Intelligence · Neural Computation · August 2000 · cited 69× · DOI ↗ · more like this ·

Knowledge about the distribution of a statistical estimator is important for various purposes, such as the construction of confidence intervals for model parameters or the determination of critical values of tests. A widely used method to estimate this distribution is the so-called boot-strap, which is based on an imitation of the probabilistic structure of the data-generating process on the basis of the information provided by a given set of random observations. In this article we investigate this classical method in the context of artificial neural networks used for estimating a mapping from input to output space. We establish consistency results for bootstrap estimates of the distribution of parameter estimates.

Distances in Weighted Trees and Group Inverse of Laplacian Matrices

Stephen Kirkland, Michael Neumann, Bryan L. Shader

Geometry and Topology · SIAM Journal on Matrix Analysis and Applications · October 1997 · cited 61× · DOI ↗ · more like this ·

In this paper we find formulas for group inverses of Laplacians of weighted trees. We then develop a relationship between entries of the group inverse and various distance functions on trees. In particular, we show that the maximal and minimal entries on the diagonal of the group inverse correspond to certain pendant vertices of the tree and to a centroid of the tree, respectively. We also give a characterization for the group inverses of the Laplacian of an unweighted tree to be an M-matrix.

On nonsingular trees and a reciprocal eigenvalue property

Sasmita Barik, Michael Neumann, Sukanta Pati

Geometry and Topology · Linear and Multilinear Algebra · 22 Jun 2006 · cited 59× · DOI ↗ · more like this ·

Let G be a simple connected graph. Let A(G) be the adjacency matrix of G. We give a combinatorial description of A(G)−1 of a bipartite graph G with a unique perfect matching. As a corollary, we obtain the combinatorial description of the inverse of a nonsingular tree. A graph is said to have property (R) if is an eigenvalue of G whenever λ is an eigenvalue of G. Further, if λ and have the same multiplicity, for each eigenvalue λ then it is said to have the property (SR). We characterize all trees with property (R) and show that it is exactly the class of all trees with property (SR). The class of trees with property (R) is also identical to the class of corona trees, namely, the trees which can be obtained from other trees by adding pendants to all vertices. Other equivalent conditions for a tree to have property (R) are also given.

Nonlinear Wavelet Estimation of Time-Varying Autoregressive Processes

Rainer Dahlhaus, Michael H. Neumann, Rainer von Sachs

Computer Vision and Pattern Recognition · heiDOK (Heidelberg University) · 2016 · cited 56× · DOI ↗ · more like this ·

. We consider nonparametric estimation of the parameter functions a i (\\Delta) , i = 1; : : : ; p , of a time-varying autoregressive process. Choosing an orthonormal wavelet basis representation of the functions a i , the empirical wavelet coefficients are derived from the time series data as the solution of a least squares minimization problem. In order to allow the a i to be functions of inhomogeneous regularity, we apply nonlinear thresholding to the empirical coefficients and obtain locally smoothed estimates of the a i . We show that the resulting estimators attain the usual minimax L 2 -rates up to a logarithmic factor, simultaneously in a large scale of Besov classes. The finite--sample behaviour of our procedure is demonstrated by application to two typical simulated examples. 1991 Mathematics Subject Classification. Primary 62M10; secondary 62F10 Key words and phrases.…

Algebraic connectivity of weighted trees under perturbation

Steve Kirkland, Michael Neumann

Geometry and Topology · Linear and Multilinear Algebra · 1997 · cited 54× · DOI ↗ · more like this ·

We investigate how the algebraic connectivity of a weighted tree behaves when the tree is perturbed by removing one of its branches and replacing it with another. This leads to a number of results, for example the facts that replacing a branch in an unweighted tree by a star on the same number of vertices will not decrease the algebraic connectivity, while replacing a certain branch by a path on the same number of vertices will not increase the algebraic connectivity. We also discuss how the arrangement of the weights on the edges of a tree affects the algebraic connectivity, and we produce a lower bound on the algebraic connectivity of any unweighted graph in terms of the diameter and the number of vertices. Throughout, our techniques exploit a connection between the algebraic connectivity of a weighted tree and certain positive matrices associated with the tree.

An exponential inequality under weak dependence

Raoul S. Kallabis, Michael H. Neumann

Statistics and Probability · Bernoulli · April 2006 · cited 51× · DOI ↗ · more like this ·

Doukhan and Louhichi introduced a covariance-based concept of weak dependence which is more general than classical mixing concepts. We prove a Bernstein-type inequality under this condition which is similar to the well-known inequality in the independent case. We apply this tool to derive asymptotic properties of penalized least-squares estimators in Barron's classes.

Bootstrap tests for simple structures in nonparametric time series regression

Jens‐Peter Kreiß, Michael H. Neumann, Qiwei Yao

Statistics and Probability · Statistics and Its Interface · 2008 · cited 48× · DOI ↗ · more like this ·

This paper concerns statistical tests for simple structures such as parametric models, lower order models and additivity in a general nonparametric autoregression setting. We propose to use a modified L 2 -distance between the nonparametric estimator of regression function and its counterpart under null hypothesis as our test statistic which delimits the contribution from areas where data are sparse. The asymptotic properties of the test statistic are established, which indicates the test statistic is asymptotically equivalent to a quadratic form of innovations. A regression type resampling scheme (i.e. wild bootstrap) is adapted to estimate the distribution of this quadratic form. Further, we have shown that asymptotically this bootstrap distribution is indeed the distribution of the test statistics under null hypothesis. The proposed methodology has been illustrated by both simulation…

Fully Data-Driven Nonparametric Variance Estimators

Michael H. Neumann

Statistics and Probability · Statistics · 1994 · cited 47× · DOI ↗ · more like this ·

We consider the problem of estimating the unknown variance function υ in a nonparametric regression model. As a basis for our estimators we take estimated residuals which are based on a kernel estimator of the mean vector. Then we form with these residuals a kernel estimator of υ. Main emphasis is on a data-driven choice of the bandwidths involved in the procedure. It is shown that the risk of this estimator attains the uniform convergence rate in Sobolev classes for υ under weak smoothness assumptions on the mean. Moreover, we prove that there is asymptotically no loss due to the estimation of the mean.

Convergence of infinite products of matrices and inner-outer iteration schemes

L. Elsner, Rafael Bru, Michael Neumann

Computational Theory and Mathematics · Publikationen an der Universität Bielefeld (Universität Bielefeld) · 1994 · cited 46× · OpenAlex ↗ · more like this ·

We develop conditions under which a product Q1=0 Ti of matrices chosen from a possibly innite set of matricesS =fTjjj2 Jg converges. We obtain the following conditions which are sucient for the convergence of the product: There exists a vector norm such that all matrices in S are nonexpansive with respect to this norm and there exists a subsequencefikg 1=0 of the sequence of the nonnegative integers such that the corresponding sequence of operators Tik 1=0 converges to an operator which is paracontracting with respect to this norm. We deduce the continuity of the limit of the product of matrices as a function of the sequencesfikg1=0 . But more importantly, we apply our results to the question of the convergence of inner{outer iteration schemes for solving singular consistent linear systems of equations, where the outer splitting is regular and the inner splitting is weak regular.

Proper Splittings of Rectangular Matrices

Abraham Berman, Michael Neumann

Computational Theory and Mathematics · SIAM Journal on Applied Mathematics · September 1976 · cited 46× · DOI ↗ · more like this ·

Proper splittings $A = M - N$ of a rectangular matrix A of ${\poeratorname{rank}}r$ are characterized in terms of splittings $A_{11} = M_{11} - N_{11} $, where $A_{11} $ is a nonsingular submatrix of A of order r. It is shown that $\rho ( {M^\dag N} ) = \rho ( {M_{11}^{ - 1} \,N_{11} } )$. Conditions for $M^\dag N$ to converge are given, including monotonicity type conditions under regularity assumptions.

Agile Methods in Higher Education: Adapting and Using eduScrum with Real World Projects

Michael Neumann, Lars Baumann

cs.SE · 23 Jun 2021 · cited 40× · arXiv ↗ · more like this ·

This Innovative Practice Full Paper presents our learnings of the process to perform a Master of Science class with eduScrum integrating real world problems as projects. We prepared, performed, and evaluated an agile educational concept for the new Master of Science program Digital Transformation organized and provided by the department of business computing at the University of Applied Sciences and Arts - Hochschule Hannover in Germany. The course deals with innovative methodologies of agile project management and is attended by 25 students. We performed the class due the summer term in 2019 and 2020 as a teaching pair. The eduScrum method has been used in different educational contexts, including higher education. During the approach preparation, we decided to use challenges, problems, or questions from the industry. Thus, we acquired four companies and prepared in coordination with…

Strong approximation of density estimators from weakly dependent observations by density estimators from independent observations

Michael H. Neumann

Statistics and Probability · The Annals of Statistics · October 1998 · cited 39× · DOI ↗ · more like this ·

We derive an approximation of a density estimator based on weakly dependent random vectors by a density estimator built from independent random vectors. We construct, on a sufficiently rich probability space, such a pairing of the random variables of both experiments that the set of observations $X_1,\ldots,X_n}$ from the time series model is nearly the same as the set of observations $Y_1,\ldots,Y_n}$ from the i.i.d. model. With a high probability, all sets of the form $({X_1,\ldots,X_n}\\Delta{Y_1,\ldots,Y_n})\bigcap([a_1,b_1]\times\ldots\times[a_d,b_d])$ contain no more than $O({[n^1/2 \prod(b_i-a_i)]+ 1} \log(n))$ elements, respectively. Although this does not imply very much for parametric problems, it has important implications in nonparametric statistics. It yields a strong approximation of a kernel estimator of the stationary density by a kernel density estimator in the i.i.d.…

Properties of the nonparametric autoregressive bootstrap

Jürgen Franke, J.‐P. KREISS, Enno Mammen +1 more

Statistics and Probability · Journal of Time Series Analysis · September 2002 · cited 36× · DOI ↗ · more like this ·

For nonparametric autoregression, we investigate a model based bootstrap procedure (`autoregressive bootstrap') that mimics the complete dependence structure of the original time series. We give consistency results for uniform bootstrap confidence bands of the autoregression function based on kernel estimates of the autoregression function. This result is achieved by global strong approximations of the kernel estimates for the resample and for the original sample. Furthermore, it is obtained that the autoregressive bootstrap also yields asymptotically correct approximations for distributions of parametric statistics, for which regression‐type bootstrap‐techniques like the wild bootstrap do not work. For this purpose, we prove geometric ergodicity and absolute regularity of the nonparametric autoregressive bootstrap process. We propose some particular estimators of the autoregression…

MULTIVARIATE WAVELET THRESHOLDING IN ANISOTROPIC FUNCTION SPACES

Michael H. Neumann

Computer Vision and Pattern Recognition · 2000 · cited 36× · OpenAlex ↗ · more like this ·

It is well known that multivariate curve estimation under standard (isotropic) smoothness conditions suffers from the curse of dimensionality. This is reflected by rates of convergence that deteriorate seriously in standard asymp- totic settings. Better rates of convergence than those corresponding to isotropic smoothness priors are possible if the curve to be estimated has different smoothness properties in different directions and the estimation scheme is capable of making use of a lower complexity in some of the directions. We consider typical cases of anisotropic smoothness classes and explore how appropriate wavelet estimators can exploit such restrictions on the curve that require an adaptation to different smooth- ness properties in different directions. It turns out that nonlinear thresholding with an anisotropic multivariate wavelet basis leads to optimal rates of convergence…

Optimal Change‐point Estimation in Inverse Problems

Michael H. Neumann

Statistics and Probability · Scandinavian Journal of Statistics · December 1997 · cited 36× · DOI ↗ · more like this ·

We develop a method of estimating a change‐point of an otherwise smooth function in the case of indirect noisy observations. As two paradigms we consider deconvolution and non‐parametric errors‐in‐variables regression. In a similar manner to well‐established methods for estimating change‐points in non‐parametric regression, we look essentially at the difference of one‐sided kernel estimators. Because of the indirect nature of the observations we employ deconvoluting kernels. We obtain an estimate of the change‐point by the extremal point of the differences between these two‐sided kernel estimators. We derive rates of convergence for this estimator. They depend on the degree of ill‐posedness of the problem, which derives from the smoothness of the error density. Analysing the Hellinger modulus of continuity of the problem we show that these rates are minimax