arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Kejun He

32 papers · 2005–2026

2005: 12006: 02007: 02008: 02009: 02010: 02011: 02012: 02013: 02014: 02015: 02016: 12017: 12018: 12019: 12020: 32021: 22022: 72023: 52024: 42025: 32026: 3
2005peak 7 in 20222026

Frequent co-authors

Papers

showing 1–25 of 32 RSS

LinDA: linear models for differential abundance analysis of microbiome compositional data

Huijuan Zhou, Kejun He, Jun Chen +1 more

stat.ME · · cited 356× · arXiv ↗ · more like this ·

Differential abundance analysis is at the core of statistical analysis of microbiome data. The compositional nature of microbiome sequencing data makes false positive control challenging. Here, we show that the compositional effects can be addressed by a simple, yet highly flexible and scalable, approach. The proposed method, LinDA, only requires fitting linear regression models on the centered log-ratio transformed data, and correcting the bias due to compositional effects. We show that LinDA enjoys asymptotic FDR control and can be extended to mixed-effect models for correlated microbiome data. Using simulations and real examples, we demonstrate the effectiveness of LinDA.

Broadcasted Nonparametric Tensor Regression

Ya Zhou, Raymond K. W. Wong, Kejun He

stat.ME · · cited 20× · arXiv ↗ · more like this ·

We propose a novel use of a broadcasting operation, which distributes univariate functions to all entries of the tensor covariate, to model the nonlinearity in tensor regression nonparametrically. A penalized estimation and the corresponding algorithm are proposed. Our theoretical investigation, which allows the dimensions of the tensor covariate to diverge, indicates that the proposed estimation yields a desirable convergence rate. We also provide a minimax lower bound, which characterizes the optimality of the proposed estimator for a wide range of scenarios. Numerical experiments are conducted to confirm the theoretical findings, and they show that the proposed model has advantages over its existing linear counterparts.

Functional Bayesian Networks for Discovering Causality from Multivariate Functional Data

Fangting Zhou, Kejun He, Kunbo Wang +2 more

stat.ME · · cited 15× · arXiv ↗ · more like this ·

Multivariate functional data arise in a wide range of applications. One fundamental task is to understand the causal relationships among these functional objects of interest, which has not yet been fully explored. In this article, we develop a novel Bayesian network model for multivariate functional data where the conditional independence and causal structure are both encoded by a directed acyclic graph. Specifically, we allow the functional objects to deviate from Gaussian process, which is adopted by most existing functional data analysis models. The more reasonable non-Gaussian assumption is the key for unique causal structure identification even when the functions are measured with noises. A fully Bayesian framework is designed to infer the functional Bayesian network model with natural uncertainty quantification through posterior summaries. Simulation studies and real data examples…

CP Degeneracy in Tensor Regression

Ya Zhou, Raymond K. W. Wong, Kejun He

stat.ML · · cited 8× · arXiv ↗ · more like this ·

Tensor linear regression is an important and useful tool for analyzing tensor data. To deal with high dimensionality, CANDECOMP/PARAFAC (CP) low-rank constraints are often imposed on the coefficient tensor parameter in the (penalized) $M$-estimation. However, we show that the corresponding optimization may not be attainable, and when this happens, the estimator is not well-defined. This is closely related to a phenomenon, called CP degeneracy, in low-rank tensor approximation problems. In this article, we provide useful results of CP degeneracy in tensor regression problems. In addition, we provide a general penalized strategy as a solution to overcome CP degeneracy. The asymptotic properties of the resulting estimation are also studied. Numerical experiments are conducted to illustrate our findings.

Plant resources of national protection grade I in Guangdong province

Kejun He, Yide Li

Education · Redai yaredai zhiwu xuebao · · cited 7× · OpenAlex ↗ · more like this ·

Based on the list of wild plant species of national importance issued in 1999(first part)and the recorded data,there are 9 taxa of national protection grade I distributed in Guangdong Province,viz.Cacys taiwaniana,Cycas fairylakea,Ginkgo biloba,Glyptostrobus pensilis,Mussaenda anomala,Primulina tabacum,Sinia rhodoleuca,Taxus wallichiana var.mairei and Bretschneidera sinensis.A survey of the 9 taxa was made during 1998 to 2001,with complementary investigation afterwards.According to IUCN red list 2001 categories and criteria,Cacys taiwaniana,Glyptostrobus pensilis and Mussaenda anomala are extinct in the wild(EW).Ginkgo biloba is critically endangered(CR).Bretschneidera sinensis,Sinia rhodoleuca,Primulina tabacum and Cycas fairylakea are endangered(EN).Taxus wallichiana var.mairei is nearly threatened(NT).Conservation strategies of the 9 taxa are suggested.

Causal Discovery with Heterogeneous Observational Data

Fangting Zhou, Kejun He, Yang Ni

stat.ME · · cited 5× · arXiv ↗ · more like this ·

We consider the problem of causal discovery (structure learning) from heterogeneous observational data. Most existing methods assume a homogeneous sampling scheme, which leads to misleading conclusions when violated in many applications. To this end, we propose a novel approach that exploits data heterogeneity to infer possibly cyclic causal structures from causally insufficient systems. The core idea is to model the direct causal effects as functions of exogenous covariates that properly explain data heterogeneity. We investigate structure identifiability properties of the proposed model. Structure learning is carried out in a fully Bayesian fashion, which provides natural uncertainty quantification. We demonstrate its utility through extensive simulations and a real-world application.

Bayesian Nonlinear Tensor Regression with Functional Fused Elastic Net Prior

Shuoli Chen, Kejun He, Shiyuan He +2 more

stat.ME · · cited 4× · arXiv ↗ · more like this ·

Tensor regression methods have been widely used to predict a scalar response from covariates in the form of a multiway array. In many applications, the regions of tensor covariates used for prediction are often spatially connected with unknown shapes and discontinuous jumps on the boundaries. Moreover, the relationship between the response and the tensor covariates can be nonlinear. In this article, we develop a nonlinear Bayesian tensor additive regression model to accommodate such spatial structure. A functional fused elastic net prior is proposed over the additive component functions to comprehensively model the nonlinearity and spatial smoothness, detect the discontinuous jumps, and simultaneously identify the active regions. The great flexibility and interpretability of the proposed method against the alternatives are demonstrated by a simulation study and an analysis on facial…

Reduced-rank clustered coefficient regression for addressing multicollinearity in heterogeneous coefficient estimation

Yan Zhong, Kejun He, Gefei Li

Statistics and Probability · Biometrics · · cited 3× · DOI ↗ · more like this ·

Clustered coefficient regression (CCR) extends the classical regression model by allowing regression coefficients varying across observations and forming clusters of observations. It has become an increasingly useful tool for modeling the heterogeneous relationship between the predictor and response variables. A typical issue of existing CCR methods is that the estimation and clustering results can be unstable in the presence of multicollinearity. To address the instability issue, this paper introduces a low-rank structure of the CCR coefficient matrix and proposes a penalized non-convex optimization problem with an adaptive group fusion-type penalty tailor-made for this structure. An iterative algorithm is developed to solve this non-convex optimization problem with guaranteed convergence. An upper bound for the coefficient estimation error is also obtained to show the statistical…

Joint Mirror Procedure: Controlling False Discovery Rate for Identifying Simultaneous Signals

Linsui Deng, Kejun He, Xianyang Zhang

stat.ME · · cited 2× · arXiv ↗ · more like this ·

In many applications, the process of identifying a specific feature of interest often involves testing multiple hypotheses for their joint statistical significance. Examples include mediation analysis which simultaneously examines the existence of the exposure-mediator and the mediator-outcome effects, and replicability analysis aiming to identify simultaneous signals that exhibit statistical significance across multiple independent experiments. In this study, we present a new approach called joint mirror (JM) procedure that effectively detects such features while maintaining false discovery rate (FDR) control in finite samples. The JM procedure employs an iterative method that gradually shrinks the rejection region based on progressively revealed information until a conservative estimate of the false discovery proportion (FDP) is below the target FDR level. Additionally, we introduce a…

Individualized Causal Discovery with Latent Trajectory Embedded Bayesian Networks

Fangting Zhou, Kejun He, Yang Ni

Artificial Intelligence · Biometrics · · cited 2× · DOI ↗ · more like this ·

Bayesian networks have been widely used to generate causal hypotheses from multivariate data. Despite their popularity, the vast majority of existing causal discovery approaches make the strong assumption of a (partially) homogeneous sampling scheme. However, such assumption can be seriously violated, causing significant biases when the underlying population is inherently heterogeneous. To this end, we propose a novel causal Bayesian network model, termed BN-LTE, that embeds heterogeneous samples onto a low-dimensional manifold and builds Bayesian networks conditional on the embedding. This new framework allows for more precise network inference by improving the estimation resolution from the population level to the observation level. Moreover, while causal Bayesian networks are in general not identifiable with purely observational, cross-sectional data due to Markov equivalence, with…

An improved tensor regression model via location smoothing

Ya Zhou, Kejun He

Computational Mathematics · Stat · · cited 2× · DOI ↗ · more like this ·

Many applications of regression study the predictors with complex forms such as tensors. Besides low dimensional assumption, the effects of predictors with a tensor structure typically show clustered or smooth phenomena in the sense that adjacent elements have a similar effect on the response. To simultaneously incorporate the low‐rank and smoothness in tensor regression, we generalize the CANDECOMP/PARAFAC (CP) decomposition to a smooth version and propose a novel regression model based on the smoothed decomposition. The asymptotic theory of the proposed method is studied, which shows a faster rate of convergence than the one without incorporating the smoothness. The experiments on both synthetic and real data confirm that the proposed method has advantages over the alternative especially when the sample size is small.

Asymptotic properties of adaptive group Lasso for sparse reduced rank regression

Kejun He, Jianhua Z. Huang

math.ST · · cited 2× · arXiv ↗ · more like this ·

This paper studies the asymptotic properties of the penalized least squares estimator using an adaptive group Lasso penalty for the reduced rank regression. The group Lasso penalty is defined in the way that the regression coefficients corresponding to each predictor are treated as one group. It is shown that under certain regularity conditions, the estimator can achieve the minimax optimal rate of convergence. Moreover, the variable selection consistency can also be achieved, that is, the relevant predictors can be identified with probability approaching one. In the asymptotic theory, the number of response variables, the number of predictors, and the rank number are allowed to grow to infinity with the sample size.

Tree-based additive noise directed acyclic graphical models for nonlinear causal discovery with interactions

Fangting Zhou, Kejun He, Yang Ni

Artificial Intelligence · Biometrics · · cited 1× · DOI ↗ · more like this ·

Directed acyclic graphical models with additive noises are essential in nonlinear causal discovery and have numerous applications in various domains, such as social science and systems biology. Most such models further assume that structural causal functions are additive to ensure causal identifiability and computational feasibility, which may be too restrictive in the presence of causal interactions. Some methods consider general nonlinear causal functions represented by, for example, Gaussian processes and neural networks, to accommodate interactions. However, they are either computationally intensive or lack interpretability. We propose a highly interpretable and computationally feasible approach using trees to incorporate interactions in nonlinear causal discovery, termed tree-based additive noise models. The nature of the tree construction leads to piecewise constant causal…

Penalized spline estimation of principal components for sparse functional data: rates of convergence

Shiyuan He, Jianhua Z. Huang, Kejun He

math.ST · · cited 1× · arXiv ↗ · more like this ·

This paper gives a comprehensive treatment of the convergence rates of penalized spline estimators for simultaneously estimating several leading principal component functions, when the functional data is sparsely observed. The penalized spline estimators are defined as the solution of a penalized empirical risk minimization problem, where the loss function belongs to a general class of loss functions motivated by the matrix Bregman divergence, and the penalty term is the integrated squared derivative. The theory reveals that the asymptotic behavior of penalized spline estimators depends on the interesting interplay between several factors, i.e., the smoothness of the unknown functions, the spline degree, the spline knot number, the penalty order, and the penalty parameter. The theory also classifies the asymptotic behavior into seven scenarios and characterizes whether and how the…

Minorize–maximize algorithm for the generalized odds rate model for clustered current status data

Tong Wang, Kejun He, Wei Ma +2 more

Statistics and Probability · Canadian Journal of Statistics · · cited 1× · DOI ↗ · more like this ·

Abstract Current status data are widely used in epidemiology and public health, where the only observable information is the random inspection time and the event status at inspection. This article presents a unified methodology to analyze such complex data subject to clustering. Given the random clustering effect, the time to event is assumed to follow a semiparametric generalized odds rate (GOR) model. The nonparametric component of the GOR model is approximated via penalized splines, with a set of knot points that increase with the sample size. The within‐subject correlation is accounted for by a random (frailty) effect. For estimation, a novel MM algorithm is developed that allows the separation of the parametric and nonparametric components of the model. This separation makes the problem conducive to applying the Newton–Raphson algorithm that quickly returns the roots. The work is…

Improved Estimation of High-dimensional Additive Models Using Subspace Learning

Shiyuan He, Kejun He, Jianhua Z. Huang

Statistics and Probability · Journal of Computational and Graphical Statistics · · cited 1× · DOI ↗ · more like this ·

Additive models have been widely used as a flexible nonparametric regression method that can overcome the curse of dimensionality. Using sparsity-inducing penalty for variable selection, several methods are developed for fitting additive models when the number of predictors is very large, sometimes even larger than the sample size. However, despite good asymptotic properties, the finite sample performance of these methods may deteriorate considerably when the number of relevant predictors becomes moderately large. This article proposes a new method that reduces the number of unknown functions to be nonparametrically estimated through learning a predictive subspace representation shared by the additive component functions. The subspace learning is integrated with sparsity-inducing penalization in a penalized least squares formulation and an efficient algorithm is developed for…

A Model‐Adaptive Test for Parametric Single‐Index Time Series Models

Qiang Xia, Kejun He, Cuizhen Niu

Statistics and Probability · Journal of Time Series Analysis · · cited 1× · DOI ↗ · more like this ·

In this paper, based on certain residual‐marked empirical processes, we study the model test to validate the composite structure with a given link function for parametric single‐index time series models. To extend an existing directional test that avoids the curse of dimensionality to an omnibus test, a model‐adaptive dimension‐reduction test procedure is proposed. Moreover, to fully utilize the dimension‐reduction structure under the null hypothesis, the test is designed for adapting both the null and alternative hypotheses, which can improve the power for a more general alternative. Simulation results and a real data example show that the proposed method can perform effectively in checking parametric single‐index time series models.

Beyond Straightness: Non-Crossing Flow Matching via Quantile AlignTree Coupling

Junyi Lin, Mengyu Li, Jingxuan Hu +2 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

The performance of Flow Matching largely depends on the quality of the coupling between the source and target distributions. However, independent coupling often leads to path crossings and local velocity ambiguity, while OT-based couplings typically incur high construction costs. To address this challenge, we propose Quantile AlignTree Flow Matching (QAT-FM), an efficient structured coupling strategy that constructs a hierarchical coupling between a Gaussian prior and the target data distribution via a quantile-aligned tree structure. QAT-FM constructs the coupling in $\mathcal{O}(Nd\log N)$ time and supports per-pair source sampling with $\mathcal{O}(d)$ complexity, enabling scalable training for large-scale high-dimensional generative tasks. Theoretically, we prove that the QAT coupling satisfies marginal consistency, induces non-crossing linear interpolation paths, and consistently…

From Past To Path: Masked History Learning for Next-Item Prediction in Generative Recommendation

KaiWen Wei, Kejun He, Xiaomian Kang +7 more

cs.IR · · cited 0× · arXiv ↗ · more like this ·

Generative recommendation, which directly generates item identifiers, has emerged as a promising paradigm for recommendation systems. However, its potential is fundamentally constrained by the reliance on purely autoregressive training. This approach focuses solely on predicting the next item while ignoring the rich internal structure of a user's interaction history, thus failing to grasp the underlying intent. To address this limitation, we propose Masked History Learning (MHL), a novel training framework that shifts the objective from simple next-step prediction to deep comprehension of history. MHL augments the standard autoregressive objective with an auxiliary task of reconstructing masked historical items, compelling the model to understand ``why'' an item path is formed from the user's past behaviors, rather than just ``what'' item comes next. We introduce two key contributions…

An adaptive subsampling method for large-sample feature screening

Xiaxue Ouyang, Kejun He, Cheng Meng

stat.ML · · cited 0× · arXiv ↗ · more like this ·

We consider the sure independence screening (SIS) method, a standard feature screening approach that aims to eliminate non-informative features in ultrahigh-dimensional datasets. Although effective, SIS incurs a computational cost of order $O(np)$ for a predictor matrix of size $n\times p$, which can be prohibitively expensive when both n and p are considerable. Motivated by the multi-armed bandit (MAB) problem, we propose a more computationally efficient feature screening algorithm that reduces the cost to $O(\sqrt{n}p)$. The core idea is to progressively increase the subsample size and eliminate variables with small empirical marginal Pearson correlations, thereby avoiding unnecessary computation on unpromising features. We develop a new interpretable statistical theoretical analysis that characterizes how the subsample size affects screening accuracy, thereby revealing the balance…

Asymptotically faster estimation of high‐dimensional additive models using subspace learning

Kejun He, Shiyuan He, Jianhua Z. Huang

Statistics and Probability · Scandinavian Journal of Statistics · · cited 0× · DOI ↗ · more like this ·

Abstract As a commonly used nonparametric model to overcome the curse of dimensionality, the additive model continually attracts attentions of researchers. Our recent work (He et al., 2022) proposed to reduce the number of unknown functions to be estimated through learning an adaptive subspace shared by the additive component functions. Equipped with an efficient algorithm, our proposed reduced additive model outperforms the state‐of‐the‐art alternatives in numerical studies. However, the asymptotic properties of the proposed estimators have not been explored and the empirical findings are short of theoretical explanation. In this work, we fill in the theoretical gap by showing the resulting estimator has faster convergence rate than the estimation without subspace learning; and this is true even when the reduced additive model is only an approximation, provided that the subspace…

Multi-way overlapping clustering by Bayesian tensor decomposition

Zhuofan Wang, Fangting Zhou, Kejun He +1 more

Computational Mathematics · Statistics and Its Interface · · cited 0× · DOI ↗ · more like this ·

The development of modern sequencing technologies provides great opportunities to measure gene expression of multiple tissues from different individuals. The three-way variation across genes, tissues, and individuals makes statistical inference a challenging task. In this paper, we propose a Bayesian multi-way clustering approach to cluster genes, tissues, and individuals simultaneously. The proposed model adaptively trichotomizes the observed data into three latent categories and uses a Bayesian hierarchical construction to further decompose the latent variables into lower-dimensional features, which can be interpreted as overlapping clusters. With a Bayesian nonparametric prior, i.e., the Indian buffet process, our method determines the cluster number automatically. The utility of our approach is demonstrated through simulation studies and an application to the Genotype-Tissue…

Principal Component Analysis of Two-dimensional Functional Data with Serial Correlation

Shirun Shen, Huiya Zhou, Kejun He +1 more

stat.ME · · cited 0× · arXiv ↗ · more like this ·

In this paper, we propose a novel model to analyze serially correlated two-dimensional functional data observed sparsely and irregularly on a domain which may not be a rectangle. Our approach employs a mixed effects model that specifies the principal component functions as bivariate splines on triangulations and the principal component scores as random effects which follow an auto-regressive model. We apply the thin-plate penalty for regularizing the bivariate function estimation and develop an effective EM algorithm along with Kalman filter and smoother for calculating the penalized likelihood estimates of the parameters. Our approach was applied on simulated datasets and on Texas monthly average temperature data from January year 1915 to December year 2014.

Multivariate Varying-coefficient Models via Tensor Decomposition

Fengyu Zhang, Ya Zhou, Kejun He +1 more

Computational Mathematics · Statistica Sinica · · cited 0× · DOI ↗ · more like this ·

Multivariate varying-coefficient models (MVCM) are popular statistical tools for analyzing the relationship between multiple responses and covariates. Nevertheless, estimating large numbers of coefficient functions is challenging, especially with a limited amount of samples. In this work, we propose a reduceddimension model based on the Tucker decomposition, which unifies several existing models. In addition, sparse predictor effects, in the sense that only a few predictors are related to the responses, are exploited to achieve an interpretable model and sufficiently reduce the number of unknown functions to be estimated.

Efficient Estimation of Mixture Cure Frailty Model for Clustered Current Status Data

Tong Wang, Kejun He, Wei Ma +2 more

stat.ME · · cited 0× · arXiv ↗ · more like this ·

Current status data abounds in the field of epidemiology and public health, where the only observable data for a subject is the random inspection time and the event status at inspection. Motivated by such a current status data from a periodontal study where data are inherently clustered, we propose a unified methodology to analyze such complex data. We allow the time-to-event to follow the semiparametric GOR model with a cure fraction, and develop a unified estimation scheme powered by the EM algorithm. The within-subject correlation is accounted for by a random (frailty) effect, and the non-parametric component of the GOR model is approximated via penalized splines, with a set of knot points that increases with the sample size. Proposed methodology is accompanied by a rigorous asymptotic theory, and the related semiparametric efficiency. The finite sample performance of our model…