Author

Athanasios Kottas

58 papers · 2000–2025

2000peak 5 in 20092025

Frequent co-authors

Papers

showing 1–25 of 58 RSS

Bayesian Semiparametric Median Regression Modeling

Artificial Intelligence · Journal of the American Statistical Association · December 2001 · cited 202× · DOI ↗ · more like this ·

AbstractMedian regression models become an attractive alternative to mean regression models when employing flexible families of distributions for the errors. Classical approaches are typically algorithmic with desirable properties emerging asymptotically. However, nonparametric error models may be most attractive in the case of smaller sample sizes where parametric specifications are difficult to justify. Hence, a Bayesian approach, enabling exact inference given the observed data, may be appealing. In this context there is little Bayesian work. We develop two fully Bayesian modeling approaches, employing mixture models, for the errors in a median regression model. The associated families of error distributions allow for increased variability, skewness, and flexible tail behavior. The first family is semiparametric with extra variability captured nonparametrically through mixing and…

Bayesian Semiparametric Modelling in Quantile Regression

Athanasios Kottas, Milovan Krnjajić

Artificial Intelligence · Scandinavian Journal of Statistics · 13 Feb 2009 · cited 149× · DOI ↗ · more like this ·

Abstract. We propose a Bayesian semiparametric methodology for quantile regression modelling. In particular, working with parametric quantile regression functions, we develop Dirichlet process mixture models for the error distribution in an additive quantile regression formulation. The proposed non‐parametric prior probability models allow the shape of the error density to adapt to the data and thus provide more reliable predictive inference than models based on parametric error distributions. We consider extensions to quantile regression for data sets that include censored observations. Moreover, we employ dependent Dirichlet processes to develop quantile regression models that allow the error distribution to change non‐parametrically with the covariates. Posterior inference is implemented using Markov chain Monte Carlo methods. We assess and compare the performance of our models using…

A Computational Approach for Full Nonparametric Bayesian Inference Under Dirichlet Process Mixture Models

Alan E. Gelfand, Athanasios Kottas

Artificial Intelligence · Journal of Computational and Graphical Statistics · June 2002 · cited 134× · DOI ↗ · more like this ·

Widely used parametric generalized linear models are, unfortunately, a somewhat limited class of specifications. Nonparametric aspects are often introduced to enrich this class, resulting in semiparametric models. Focusing on single or k-sample problems, many classical nonparametric approaches are limited to hypothesis testing. Those that allow estimation are limited to certain functionals of the underlying distributions. Moreover, the associated inference often relies upon asymptotics when nonparametric specifications are often most appealing for smaller sample sizes. Bayesian nonparametric approaches avoid asymptotics but have, to date, been limited in the range of inference. Working with Dirichlet process priors, we overcome the limitations of existing simulation-based model fitting approaches which yield inference that is confined to posterior moments of linear functionals of the…

A Bayesian Nonparametric Approach to Inference for Quantile Regression

Matthew A. Taddy, Athanasios Kottas

Artificial Intelligence · Journal of Business and Economic Statistics · 3 Oct 2009 · cited 115× · DOI ↗ · more like this ·

We develop a Bayesian method for nonparametric model–based quantile regression. The approach involves flexible Dirichlet process mixture models for the joint distribution of the response and the covariates, with posterior inference for different quantile curves emerging from the conditional response distribution given the covariates. An extension to allow for partially observed responses leads to a novel Tobit quantile regression framework. We use simulated data sets and two data examples from the literature to illustrate the capacity of the model to uncover nonlinearities in quantile regression curves, as well as nonstandard features in the response distribution.

Nonparametric Bayesian Modeling for Multivariate Ordinal Data

Athanasios Kottas, Peter Müller, Fernando A. Quintana

Artificial Intelligence · Journal of Computational and Graphical Statistics · 31 Aug 2005 · cited 110× · DOI ↗ · more like this ·

This article proposes a probability model for k-dimensional ordinal outcomes, that is, it considers inference for data recorded in k-dimensional contingency tables with ordinal factors. The proposed approach is based on full posterior inference, assuming a flexible underlying prior probability model for the contingency table cell probabilities. We use a variation of the traditional multivariate probit model, with latent scores that determine the observed data. In our model, a mixture of normals prior replaces the usual single multivariate normal model for the latent variables. By augmenting the prior model to a mixture of normals we generalize inference in two important ways. First, we allow for varying local dependence structure across the contingency table. Second, inference in ordinal multivariate probit models is plagued by problems related to the choice and resampling of cutoffs…

Bayesian Semiparametric Regression for Median Residual Life

Alan E. Gelfand, Athanasios Kottas

Artificial Intelligence · Scandinavian Journal of Statistics · 23 Oct 2003 · cited 63× · DOI ↗ · more like this ·

Abstract. With survival data there is often interest not only in the survival time distribution but also in the residual survival time distribution. In fact, regression models to explain residual survival time might be desired. Building upon recent work of Kottas & Gelfand [ J. Amer. Statist. Assoc. 96 (2001) 1458], we formulate a semiparametric median residual life regression model induced by a semiparametric accelerated failure time regression model. We utilize a Bayesian approach which allows full and exact inference. Classical work essentially ignores covariates and is either based upon parametric assumptions or is limited to asymptotic inference in non‐parametric settings. No regression modelling of median residual life appears to exist. The Bayesian modelling is developed through Dirichlet process mixing. The models are fitted using Gibbs sampling. Residual life inference is…

Bayesian Nonparametric Modeling for Multivariate Ordinal Regression

Maria DeYoreo, Athanasios Kottas

stat.ME · August 2014 · cited 62× · arXiv ↗ · more like this ·

Univariate or multivariate ordinal responses are often assumed to arise from a latent continuous parametric distribution, with covariate effects which enter linearly. We introduce a Bayesian nonparametric modeling approach for univariate and multivariate ordinal regression, which is based on mixture modeling for the joint distribution of latent responses and covariates. The modeling framework enables highly flexible inference for ordinal regression relationships, avoiding assumptions of linearity or additivity in the covariate effects. In standard parametric ordinal regression models, computational challenges arise from identifiability constraints and estimation of parameters requiring nonstandard inferential techniques. A key feature of the nonparametric model is that it achieves inferential flexibility, while avoiding these difficulties. In particular, we establish full support of the…

Modeling Disease Incidence Data with Spatial and Spatio Temporal Dirichlet Process Mixtures

Athanasios Kottas, Jason A. Duan, Alan E. Gelfand

Artificial Intelligence · Biometrical Journal · 9 Oct 2007 · cited 50× · DOI ↗ · more like this ·

Disease incidence or mortality data are typically available as rates or counts for specified regions, collected over time. We propose Bayesian nonparametric spatial modeling approaches to analyze such data. We develop a hierarchical specification using spatial random effects modeled with a Dirichlet process prior. The Dirichlet process is centered around a multivariate normal distribution. This latter distribution arises from a log-Gaussian process model that provides a latent incidence rate surface, followed by block averaging to the areal units determined by the regions in the study. With regard to the resulting posterior predictive inference, the modeling approach is shown to be equivalent to an approach based on block averaging of a spatial Dirichlet process to obtain a prior probability model for the finite dimensional distribution of the spatial random effects. We introduce a…

Spatial modeling for risk assessment of extreme values from environmental time series: a Bayesian nonparametric approach

Athanasios Kottas, Ziwei Wang, Abel Rodríguez

Artificial Intelligence · Environmetrics · 25 Oct 2012 · cited 37× · DOI ↗ · more like this ·

We propose an approach to modeling and risk assessment for extremes of environmental processes evolving over time and recorded at a number of spatial locations. We follow an extension of the point process approach to analysis of extremes under which the times of exceedances over a given threshold are assumed to arise from a non‐homogeneous Poisson process. To achieve flexible shapes and temporal heterogeneity for the intensity of extremes at any particular spatial location, we utilize a logit‐normal mixture model for the corresponding Poisson process density. A spatial Dirichlet process prior for the mixing distributions completes the nonparametric spatio‐temporal model formulation. We discuss methods for posterior simulation, using Markov chain Monte Carlo techniques, and develop inference for spatial interpolation of risk assessment quantities for high‐level exceedances of the…

Modeling for seasonal marked point processes: An analysis of evolving hurricane occurrences

Sai Xiao, Athanasios Kottas, Bruno Sansó

stat.AP · June 2015 · cited 32× · arXiv ↗ · more like this ·

Seasonal point processes refer to stochastic models for random events which are only observed in a given season. We develop nonparametric Bayesian methodology to study the dynamic evolution of a seasonal marked point process intensity. We assume the point process is a nonhomogeneous Poisson process and propose a nonparametric mixture of beta densities to model dynamically evolving temporal Poisson process intensities. Dependence structure is built through a dependent Dirichlet process prior for the seasonally-varying mixing distributions. We extend the nonparametric model to incorporate time-varying marks, resulting in flexible inference for both the seasonal point process intensity and for the conditional mark distribution. The motivating application involves the analysis of hurricane landfalls with reported damages along the U.S. Gulf and Atlantic coasts from 1900 to 2010. We focus on…

Modelling Stochastic Order in the Analysis of Receiver Operating Characteristic Data: Bayesian Non-Parametric Approaches

Timothy Hanson, Athanasios Kottas, Adam J. Branscum

Artificial Intelligence · Journal of the Royal Statistical Society Series C (Applied Statistics) · 22 Feb 2008 · cited 32× · DOI ↗ · more like this ·

Summary The evaluation of the performance of a continuous diagnostic measure is a commonly encountered task in medical research. We develop Bayesian non-parametric models that use Dirichlet process mixtures and mixtures of Polya trees for the analysis of continuous serologic data. The modelling approach differs from traditional approaches to the analysis of receiver operating characteristic curve data in that it incorporates a stochastic ordering constraint for the distributions of serologic values for the infected and non-infected populations. Biologically such a constraint is virtually always feasible because serologic values from infected individuals tend to be higher than those for non-infected individuals. The models proposed provide data-driven inferences for the infected and non-infected population distributions, and for the receiver operating characteristic curve and…

Markov switching Dirichlet process mixture regression

Athanasios Kottas, Matthew A. Taddy

Artificial Intelligence · Bayesian Analysis · 28 Nov 2009 · cited 29× · DOI ↗ · more like this ·

Markov switching models can be used to study heterogeneous populations that are observed over time. This paper explores modeling the group characteristics nonparametrically, under both homogeneous and nonhomogeneous Markov switching for group probabilities. The model formulation involves a finite mixture of conditionally independent Dirichlet process mixtures, with a Markov chain defining the mixing distribution. The proposed methodology focuses on settings where the number of subpopulations is small and can be assumed to be known, and flexible modeling is required for group regressions. We develop Dirichlet process mixture prior probability models for the joint distribution of individual group responses and covariates. The implied conditional distribution of the response given the covariates is then used for inference. The modeling framework allows for both non-linearities in the…

A Nonparametric Bayesian Modeling Approach for Cytogenetic Dosimetry

Athanasios Kottas, Márcia D. Branco, Alan E. Gelfand

Statistics and Probability · Biometrics · September 2002 · cited 26× · DOI ↗ · more like this ·

In cytogenetic dosimetry, samples of cell cultures are exposed to a range of doses of a given agent. In each sample at each dose level, some measure of cell disability is recorded. The objective is to develop models that explain cell response to dose. Such models can be used to predict response at unobserved doses. More important, such models can provide inference for unknown exposure doses given the observed responses. Typically, cell disability is viewed as a Poisson count, but in the present work, a more appropriate response is a categorical classification. In the literature, modeling in this case is very limited. What exists is purely parametric. We propose a fully Bayesian nonparametric approach to this problem. We offer comparison with a parametric model through a simulation study and the analysis of a real dataset modeling blood cultures exposed to radiation where classification…

A Fully Nonparametric Modelling Approach to Binary Regression

Maria DeYoreo, Athanasios Kottas

stat.ME · April 2014 · cited 25× · arXiv ↗ · more like this ·

We propose a general nonparametric Bayesian framework for binary regression, which is built from modeling for the joint response-covariate distribution. The observed binary responses are assumed to arise from underlying continuous random variables through discretization, and we model the joint distribution of these latent responses and the covariates using a Dirichlet process mixture of multivariate normals. We show that the kernel of the induced mixture model for the observed data is identifiable upon a restriction on the latent variables. To allow for appropriate dependence structure while facilitating identifiability, we use a square-root-free Cholesky decomposition of the covariance matrix in the normal mixture kernel. In addition to allowing for the necessary restriction, this modeling strategy provides substantial simplifications in implementation of Markov chain Monte Carlo…

Modeling for Dynamic Ordinal Regression Relationships: An Application to Estimating Maturity of Rockfish in California

Maria DeYoreo, Athanasios Kottas

stat.AP · 5 Jul 2015 · cited 21× · arXiv ↗ · more like this ·

We develop a Bayesian nonparametric framework for modeling ordinal regression relationships which evolve in discrete time. The motivating application involves a key problem in fisheries research on estimating dynamically evolving relationships between age, length and maturity, the latter recorded on an ordinal scale. The methodology builds from nonparametric mixture modeling for the joint stochastic mechanism of covariates and latent continuous responses. This approach yields highly flexible inference for ordinal regression functions while at the same time avoiding the computational challenges of parametric models. A novel dependent Dirichlet process prior for time-dependent mixing distributions extends the model to the dynamic setting. The methodology is used for a detailed study of relationships between maturity, age, and length for Chilipepper rockfish, using data collected over 15…

A fully nonparametric modeling approach to binary regression

Maria DeYoreo, Athanasios Kottas

Artificial Intelligence · eScholarship (California Digital Library) · 2015 · cited 19× · OpenAlex ↗ · more like this ·

A New Family of Error Distributions for Bayesian Quantile Regression

Yifei Yan, Athanasios Kottas

stat.ME · January 2017 · cited 18× · arXiv ↗ · more like this ·

We propose a new family of error distributions for model-based quantile regression, which is constructed through a structured mixture of normal distributions. The construction enables fixing specific percentiles of the distribution while, at the same time, allowing for varying mode, skewness and tail behavior. It thus overcomes the severe limitation of the asymmetric Laplace distribution -- the most commonly used error model for parametric quantile regression -- for which the skewness of the error density is fully specified when a particular percentile is fixed. We develop a Bayesian formulation for the proposed quantile regression model, including conditional lasso regularized quantile regression based on a hierarchical Laplace prior for the regression coefficients, and a Tobit quantile regression model. Posterior inference is implemented via Markov Chain Monte Carlo methods. The…

Bayesian Spectral Modeling for Multiple Time Series

Annalisa Cadonna, Athanasios Kottas, Raquel Prado

Signal Processing · Journal of the American Statistical Association · 11 Sep 2018 · cited 17× · DOI ↗ · more like this ·

We develop a novel Bayesian modeling approach to spectral density estimation for multiple time series. The log-periodogram distribution for each series is modeled as a mixture of Gaussian distributions with frequency-dependent weights and mean functions. The implied model for the log-spectral density is a mixture of linear mean functions with frequency-dependent weights. The mixture weights are built through successive differences of a logit-normal distribution function with frequency-dependent parameters. Building from the construction for a single spectral density, we develop a hierarchical extension for multiple time series. Specifically, we set the mean functions to be common to all spectral densities and make the weights specific to the time series through the parameters of the logit-normal distribution. In addition to accommodating flexible spectral density shapes, a practically…

A Bayesian Nonparametric Modeling Framework for Developmental Toxicity Studies

Kassandra Fronczyk, Athanasios Kottas

Artificial Intelligence · Journal of the American Statistical Association · 14 Aug 2013 · cited 14× · DOI ↗ · more like this ·

We develop a Bayesian nonparametric mixture modeling framework for replicated count responses in dose-response settings. We explore this methodology for modeling and risk assessment in developmental toxicity studies, where the primary objective is to determine the relationship between the level of exposure to a toxic chemical and the probability of a physiological or biochemical response, or death. Data from these experiments typically involve features that cannot be captured by standard parametric approaches. To provide flexibility in the functional form of both the response distribution and the probability of positive response, the proposed mixture model is built from a dependent Dirichlet process prior, with the dependence of the mixing distributions governed by the dose level. The methodology is tested with a simulation study, which involves also comparison with semiparametric…

A Bayesian approach to the analysis of quantal bioassay studies using nonparametric mixture models

Kassandra Fronczyk, Athanasios Kottas

Artificial Intelligence · Biometrics · 19 Dec 2013 · cited 10× · DOI ↗ · more like this ·

We develop a Bayesian nonparametric mixture modeling framework for quantal bioassay settings. The approach is built upon modeling dose-dependent response distributions. We adopt a structured nonparametric prior mixture model, which induces a monotonicity restriction for the dose-response curve. Particular emphasis is placed on the key risk assessment goal of calibration for the dose level that corresponds to a specified response. The proposed methodology yields flexible inference for the dose-response relationship as well as for other inferential objectives, as illustrated with two data sets from the literature.

Bayesian semiparametric modeling and inference with mixtures of symmetric distributions

Athanasios Kottas, Gilbert W. Fellingham

Artificial Intelligence · Statistics and Computing · 30 Oct 2010 · cited 10× · DOI ↗ · more like this ·

We propose a semiparametric modeling approach for mixtures of symmetric distributions. The mixture model is built from a common symmetric density with different components arising through different location parameters. This structure ensures identifiability for mixture components, which is a key feature of the model as it allows applications to settings where primary interest is inference for the subpopulations comprising the mixture. We focus on the two-component mixture setting and develop a Bayesian model using parametric priors for the location parameters and for the mixture proportion, and a nonparametric prior probability model, based on Dirichlet process mixtures, for the random symmetric density. We present an approach to inference using Markov chain Monte Carlo posterior simulation. The performance of the model is studied with a simulation experiment and through analysis of a…

Bayesian Nonparametric Modeling for Comparison of Single‐Neuron Firing Intensities

Athanasios Kottas, Sam Behseta

Artificial Intelligence · Biometrics · 7 May 2009 · cited 10× · DOI ↗ · more like this ·

We propose a fully inferential model-based approach to the problem of comparing the firing patterns of a neuron recorded under two distinct experimental conditions. The methodology is based on nonhomogeneous Poisson process models for the firing times of each condition with flexible nonparametric mixture prior models for the corresponding intensity functions. We demonstrate posterior inferences from a global analysis, which may be used to compare the two conditions over the entire experimental time window, as well as from a pointwise analysis at selected time points to detect local deviations of firing patterns from one condition to another. We apply our method on two neurons recorded from the primary motor cortex area of a monkey's brain while performing a sequence of reaching tasks.

Nonparametric Bayesian Modeling and Estimation for Renewal Processes

Sai Xiao, Athanasios Kottas, Bruno Sansó +1 more

Artificial Intelligence · Technometrics · 14 Nov 2019 · cited 7× · DOI ↗ · more like this ·

ABSTRACT We propose a flexible approach to modeling for renewal processes. The model is built from a structured mixture of Erlang densities for the renewal process inter-arrival density. The Erlang mixture components have a common scale parameter, and the mixture weights are defined through an underlying distribution function modeled nonparametrically with a Dirichlet process (DP) prior. This model specification enables nonstandard shapes for the inter-arrival time density, including heavy tailed and multimodal densities. Moreover, the choice of the DP centering distribution controls clustering or declustering patterns for the point process, which can therefore be encouraged in the prior specification. Using the analytically available Laplace transforms of the relevant functions, we study the renewal function and the directly related K function, which can be used to infer about…

Bayesian semiparametric modeling for stochastic precedence, with applications in epidemiology and survival analysis

Athanasios Kottas

Artificial Intelligence · Lifetime Data Analysis · 26 Mar 2010 · cited 7× · DOI ↗ · more like this ·

We propose a prior probability model for two distributions that are ordered according to a stochastic precedence constraint, a weaker restriction than the more commonly utilized stochastic order constraint. The modeling approach is based on structured Dirichlet process mixtures of normal distributions. Full inference for functionals of the stochastic precedence constrained mixture distributions is obtained through a Markov chain Monte Carlo posterior simulation method. A motivating application involves study of the discriminatory ability of continuous diagnostic tests in epidemiologic research. Here, stochastic precedence provides a natural restriction for the distributions of test scores corresponding to the non-infected and infected groups. Inference under the model is illustrated with data from a diagnostic test for Johne's disease in dairy cattle. We also apply the methodology to…

Statistical Equivalent Models for Computer Simulators with an Application to the Random Waypoint Mobility Model

Kumar Viswanath, Katia Obraczka, Athanasios Kottas +1 more

Computer Networks and Communications · SIMULATION · February 2007 · cited 6× · DOI ↗ · more like this ·

Statistical Equivalent Models, or SEMs, have recently been proposed as a general approach to study computer simulators. By fitting a statistical model to the simulator's output, SEMs provide an efficient way to quickly explore the simulator's result. In this paper, we develop a SEM for random waypoint mobility, one of the most widely used mobility models employed by network simulators in the evaluation of communication protocols for wireless multi-hop ad hoc networks (MANETs). We chose the random waypoint mobility model as a case study of SEMs due to recent results pointing out some serious drawbacks of the model (e.g., [1]). In particular, these studies show that, under the random waypoint mobility regime, average node speed tends to zero in steady state. They also show that average node speed varies considerably from the expected average value for the time scales under consideration…