arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Hui

7,994 papers · 1970–2024

1970: 11971: 01972: 01973: 21974: 01975: 11976: 01977: 11978: 21979: 01980: 11981: 21982: 31983: 31984: 21985: 21986: 51987: 41988: 81989: 81990: 61991: 81992: 81993: 161994: 171995: 241996: 341997: 361998: 451999: 842000: 892001: 1032002: 2452003: 1922004: 2122005: 2322006: 2572007: 2882008: 2962009: 3682010: 5702011: 5552012: 6812013: 6992014: 7332015: 7902016: 4992017: 5042018: 3372019: 12020: 32021: 52022: 92023: 22024: 1
1970peak 790 in 20152024

Frequent co-authors

Papers

showing 1–25 of 7,994 RSS

Nearly unbiased variable selection under minimax concave penalty

Cun-Hui Zhang

math.ST · · cited 4,087× · arXiv ↗ · more like this ·

We propose MC+, a fast, continuous, nearly unbiased and accurate method of penalized variable selection in high-dimensional linear regression. The LASSO is fast and continuous, but biased. The bias of the LASSO may prevent consistent variable selection. Subset selection is unbiased but computationally costly. The MC+ has two elements: a minimax concave penalty (MCP) and a penalized linear unbiased selection (PLUS) algorithm. The MCP provides the convexity of the penalized loss in sparse regions to the greatest extent given certain thresholds for variable selection and unbiasedness. The PLUS computes multiple exact local minimizers of a possibly nonconvex penalized loss function in a certain main branch of the graph of critical points of the penalized loss. Its output is a continuous piecewise linear path encompassing from the origin for infinite penalty to a least squares solution for…

Multi-class AdaBoost

Trevor Hastie, Saharon Rosset, Ji Zhu +1 more

Artificial Intelligence · Statistics and Its Interface · · cited 1,882× · DOI ↗ · more like this ·

Boosting has been a very successful technique for solving the two-class classification problem. In going from two-class to multi-class classification, most algorithms have been restricted to reducing the multi-class classification problem to multiple two-class problems. In this paper, we develop a new algorithm that directly extends the AdaBoost algorithm to the multi-class case without reducing it to multiple two-class problems. We show that the proposed multi-class AdaBoost algorithm is equivalent to a forward stagewise additive modeling algorithm that minimizes a novel exponential loss for multi-class classification. Furthermore, we show that the exponential loss is a member of a class of Fisher-consistent loss functions for multi-class classification. As shown in the paper, the new algorithm is extremely easy to implement and is highly competitive in terms of misclassification error…

DailyDialog: A Manually Labelled Multi-turn Dialogue Dataset

Yanran Li, Hui Su, Xiaoyu Shen +3 more

cs.CL · · cited 1,587× · arXiv ↗ · more like this ·

We develop a high-quality multi-turn dialog dataset, DailyDialog, which is intriguing in several aspects. The language is human-written and less noisy. The dialogues in the dataset reflect our daily communication way and cover various topics about our daily life. We also manually label the developed dataset with communication intention and emotion information. Then, we evaluate existing approaches on DailyDialog dataset and hope it benefit the research field of dialog systems.

A case for end system multicast

Yang-hua Chu, Sanjay Rao, S. Seshan +1 more

Computer Networks and Communications · IEEE Journal on Selected Areas in Communications · · cited 1,521× · DOI ↗ · more like this ·

The conventional wisdom has been that Internet protocol (IP) is the natural protocol layer for implementing multicast related functionality. However, more than a decade after its initial proposal, IP multicast is still plagued with concerns pertaining to scalability, network management, deployment, and support for higher layer functionality such as error, flow, and congestion control. We explore an alternative architecture that we term end system multicast, where end systems implement all multicast related functionality including membership management and packet replication. This shifting of multicast support from routers to end systems has the potential to address most problems associated with IP multicast. However, the key concern is the performance penalty associated with such a model. In particular, end system multicast introduces duplicate packets on physical links and incurs…

Satellite-Based Entanglement Distribution Over 1200 kilometers

Juan Yin, Yuan Cao, Yu-Huai Li +31 more

quant-ph · · cited 1,456× · arXiv ↗ · more like this ·

Long-distance entanglement distribution is essential both for foundational tests of quantum physics and scalable quantum networks. Owing to channel loss, however, the previously achieved distance was limited to ~100 km. Here, we demonstrate satellite-based distribution of entangled photon pairs to two locations separated by 1203 km on the Earth, through satellite-to-ground two-downlink with a sum of length varies from 1600 km to 2400 km. We observe a survival of two-photon entanglement and a violation of Bell inequality by 2.37+/-0.09 under strict Einstein locality conditions. The obtained effective link efficiency at 1200 km in this work is over 12 orders of magnitude higher than the direct bidirectional transmission of the two photons through the best commercial telecommunication fibers with a loss of 0.16 dB/km.

One-step sparse estimates in nonconcave penalized likelihood models

Hui Zou, Runze Li

math.ST · · cited 1,299× · arXiv ↗ · more like this ·

Fan and Li propose a family of variable selection methods via penalized likelihood using concave penalty functions. The nonconcave penalized likelihood estimators enjoy the oracle properties, but maximizing the penalized likelihood function is computationally challenging, because the objective function is nondifferentiable and nonconcave. In this article, we propose a new unified algorithm based on the local linear approximation (LLA) for maximizing the penalized likelihood for a broad class of concave penalty functions. Convergence and other theoretical properties of the LLA algorithm are established. A distinguished feature of the LLA algorithm is that at each LLA step, the LLA estimator can naturally adopt a sparse representation. Thus, we suggest using the one-step LLA estimator from the LLA algorithm as the final estimates. Statistically, we show that if the regularization…

Confidence Intervals for Low-Dimensional Parameters in High-Dimensional Linear Models

Cun-Hui Zhang, Stephanie S. Zhang

stat.ME · · cited 1,178× · arXiv ↗ · more like this ·

The purpose of this paper is to propose methodologies for statistical inference of low-dimensional parameters with high-dimensional data. We focus on constructing confidence intervals for individual coefficients and linear combinations of several of them in a linear regression model, although our ideas are applicable in a much broad context. The theoretical results presented here provide sufficient conditions for the asymptotic normality of the proposed estimators along with a consistent estimator for their finite-dimensional covariance matrices. These sufficient conditions allow the number of variables to far exceed the sample size. The simulation results presented here demonstrate the accuracy of the coverage probability of the proposed confidence intervals, strongly supporting the theoretical results.

AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baseline

Hui Bu, Jiayu Du, Xingyu Na +2 more

cs.CL · · cited 1,112× · arXiv ↗ · more like this ·

An open-source Mandarin speech corpus called AISHELL-1 is released. It is by far the largest corpus which is suitable for conducting the speech recognition research and building speech recognition systems for Mandarin. The recording procedure, including audio capturing devices and environments are presented in details. The preparation of the related resources, including transcriptions and lexicon are described. The corpus is released with a Kaldi recipe. Experimental results implies that the quality of audio recordings and transcriptions are promising.

On the "degrees of freedom" of the lasso

Hui Zou, Trevor Hastie, Robert Tibshirani

math.ST · · cited 1,088× · arXiv ↗ · more like this ·

We study the effective degrees of freedom of the lasso in the framework of Stein's unbiased risk estimation (SURE). We show that the number of nonzero coefficients is an unbiased estimate for the degrees of freedom of the lasso--a conclusion that requires no special assumption on the predictors. In addition, the unbiased estimator is shown to be asymptotically consistent. With these results on hand, various model selection criteria--$C_p$, AIC and BIC--are available, which, along with the LARS algorithm, provide a principled and efficient approach to obtaining the optimal lasso fit with the computational effort of a single ordinary least-squares fit.

WF/sup 2/Q: worst-case fair weighted fair queueing

J.C.R. Bennett, Hui Zhang

Computer Networks and Communications · · cited 1,084× · DOI ↗ · more like this ·

The generalized processor sharing (GPS) discipline is proven to have two desirable properties: (a) it can provide an end-to-end bounded-delay service to a session whose traffic is constrained by a leaky bucket; (b) it can ensure fair allocation of bandwidth among all back logged sessions regardless of whether or not their traffic is constrained. The former property is the basis for supporting guaranteed service traffic while the later property is important for supporting best-effort service traffic. Since GPS uses an idealized fluid model which cannot be realized in the real world, various packet approximation algorithms of the GPS have been proposed. Among these, weighted fair queueing (WFQ) also known as packet generalized processor sharing (PGPS) has been considered to be the best one in terms of accuracy. In particular, it has been proven that the delay bound provided by WFQ is…

Adversarial Attack on Graph Structured Data

Hanjun Dai, Hui Li, Tian Tian +4 more

cs.LG · · cited 911× · arXiv ↗ · more like this ·

Deep learning on graph structures has shown exciting results in various applications. However, few attentions have been paid to the robustness of such models, in contrast to numerous research work for image or text adversarial attack and defense. In this paper, we focus on the adversarial attacks that fool the model by modifying the combinatorial structure of data. We first propose a reinforcement learning based attack method that learns the generalizable attack policy, while only requiring prediction labels from the target classifier. Also, variants of genetic algorithms and gradient methods are presented in the scenario where prediction confidence or gradients are available. We use both synthetic and real-world data to show that, a family of Graph Neural Network models are vulnerable to these attacks, in both graph-level and node-level classification tasks. We also show such attacks…

The sparsity and bias of the Lasso selection in high-dimensional linear regression

Cun-Hui Zhang, Jian Huang

math.ST · · cited 903× · arXiv ↗ · more like this ·

Meinshausen and Buhlmann [Ann. Statist. 34 (2006) 1436--1462] showed that, for neighborhood selection in Gaussian graphical models, under a neighborhood stability condition, the LASSO is consistent, even when the number of variables is of greater order than the sample size. Zhao and Yu [(2006) J. Machine Learning Research 7 2541--2567] formalized the neighborhood stability condition in the context of linear regression as a strong irrepresentable condition. That paper showed that under this condition, the LASSO selects exactly the set of nonzero regression coefficients, provided that these coefficients are bounded away from zero at a certain rate. In this paper, the regression coefficients outside an ideal model are assumed to be small, but not necessarily zero. Under a sparse Riesz condition on the correlation of design variables, we prove that the LASSO selects a model of the correct…

Experimental Comparison of Representation Methods and Distance Measures for Time Series Data

Xiaoyue Wang, Hui Ding, Goce Trajcevski +2 more

cs.AI · · cited 898× · arXiv ↗ · more like this ·

The previous decade has brought a remarkable increase of the interest in applications that deal with querying and mining of time series data. Many of the research efforts in this context have focused on introducing new representation methods for dimensionality reduction or novel similarity measures for the underlying data. In the vast majority of cases, each individual work introducing a particular method has made specific claims and, aside from the occasional theoretical justifications, provided quantitative experimental observations. However, for the most part, the comparative aspects of these experiments were too narrowly focused on demonstrating the benefits of the proposed methods over some of the previously introduced ones. In order to provide a comprehensive validation, we conducted an extensive experimental study re-implementing eight different time series representations and…

Fast and Accurate Single Image Super-Resolution via Information Distillation Network

Zheng Hui, Xiumei Wang, Xinbo Gao

cs.CV · · cited 893× · arXiv ↗ · more like this ·

Recently, deep convolutional neural networks (CNNs) have been demonstrated remarkable progress on single image super-resolution. However, as the depth and width of the networks increase, CNN-based super-resolution methods have been faced with the challenges of computational complexity and memory consumption in practice. In order to solve the above questions, we propose a deep but compact convolutional network to directly reconstruct the high resolution image from the original low resolution image. In general, the proposed model consists of three parts, which are feature extraction block, stacked information distillation blocks and reconstruction block respectively. By combining an enhancement unit with a compression unit into a distillation block, the local long and short-path features can be effectively extracted. Specifically, the proposed enhancement unit mixes together two different…

Twister

Jaliya Ekanayake, Hui Li, Bingjing Zhang +4 more

Hardware and Architecture · · cited 777× · DOI ↗ · more like this ·

MapReduce programming model has simplified the implementation of many data parallel applications. The simplicity of the programming model and the quality of services provided by many implementations of MapReduce attract a lot of enthusiasm among distributed computing communities. From the years of experience in applying MapReduce to various scientific applications we identified a set of extensions to the programming model and improvements to its architecture that will expand the applicability of MapReduce to more classes of applications. In this paper, we present the programming model and the architecture of Twister an enhanced MapReduce runtime that supports iterative MapReduce computations efficiently. We also show performance comparisons of Twister with other similar runtimes such as Hadoop and DryadLINQ for large scale data parallel applications.

LiteFlowNet: A Lightweight Convolutional Neural Network for Optical Flow Estimation

Tak-Wai Hui, Xiaoou Tang, Chen Change Loy

cs.CV · · cited 774× · arXiv ↗ · more like this ·

FlowNet2, the state-of-the-art convolutional neural network (CNN) for optical flow estimation, requires over 160M parameters to achieve accurate flow estimation. In this paper we present an alternative network that outperforms FlowNet2 on the challenging Sintel final pass and KITTI benchmarks, while being 30 times smaller in the model size and 1.36 times faster in the running speed. This is made possible by drilling down to architectural details that might have been missed in the current frameworks: (1) We present a more effective flow inference approach at each pyramid level through a lightweight cascaded network. It not only improves flow estimation accuracy through early correction, but also permits seamless incorporation of descriptor matching in our network. (2) We present a novel flow regularization layer to ameliorate the issue of outliers and vague flow boundaries by using a…

Novel Precursors for Boron Nanotubes: The Competition of Two-Center and Three-Center Bonding in Boron Sheets

Hui Tang, Sohrab Ismail-Beigi

cond-mat.mtrl-sci · · cited 677× · arXiv ↗ · more like this ·

We present a new class of boron sheets, composed of triangular and hexagonal motifs, that are more stable than structures considered to date and thus are likely to be the precursors of boron nanotubes. We describe a simple and clear picture of electronic bonding in boron sheets and highlight the importance of three-center bonding and its competition with two-center bonding, which can also explain the stability of recently discovered boron fullerenes. Our findings call for reconsideration of the literature on boron sheets, nanotubes, and clusters.

Measurement device independent quantum key distribution over 404 km optical fibre

Hua-Lei Yin, Teng-Yun Chen, Zong-Wen Yu +16 more

quant-ph · · cited 658× · arXiv ↗ · more like this ·

Quantum key distribution (QKD) can provide unconditional secure communication between two distant parties. Although the significance of QKD is undisputed, its feasibility has been questioned because of certain limitations in the practical application of real-life QKD systems. It is a common belief the lack of perfect single-photon source and the existence of detection loss will handicap the feasibility of QKD by creating security loopholes and distance limitations. The measurement device independent QKD (MDIQKD) with decoy-state method removes the security threats from both the imperfect single-photon source and the detection loss. Lengthening the distance and improving the key rate of QKD with such a superior method is thus the central issue in the practical application of QKD. Here, we report the results of MDIQKD over 404 km of ultralow-loss optical fibre and 311 km of standard…

Data mining for direct marketing: problems and solutions

Charles X. Ling, LI Cheng-hui

Artificial Intelligence · Knowledge Discovery and Data Mining · · cited 653× · OpenAlex ↗ · more like this ·

Direct marketing is a process of identifying likely buyers of certain products and promoting the products accordingly. It is increasingly used by banks, insurance companies, and the retail industry. Data mining can provide an effective tool for direct marketing. During data mining, several specific problems arise. For example, the class distribution is extremely imbalanced (the response rate is about 1~), the predictive accuracy is no longer suitable for evaluating learning methods, and the number of examples can be too large. In this paper, we discuss methods of coping with these problems based on our experience on direct-marketing projects using data mining. 1

Haar wavelet method for solving lumped and distributed-parameter systems

C.F. Chen, Chun‐Hui Hsiao

Computer Vision and Pattern Recognition · IEE Proceedings - Control Theory and Applications · · cited 646× · DOI ↗ · more like this ·

An operational matrix of integration based on Haar wavelets is established, and a procedure for applying the matrix to analyse lumped and distributed-parameters dynamic systems is formulated. The technique can be interpreted from the incremental and multiresolution viewpoint. Crude as well as accurate solutions can be obtained by changing the parameter m; in the mean time, the main features of the solution are preserved. Several nontrivial examples are included for demonstrating the fast, flexible and convenient capabilities of the new method.

Particle Swarm Optimization With an Aging Leader and Challengers

Wei–Neng Chen, Jun Zhang, Ying Lin +5 more

Artificial Intelligence · IEEE Transactions on Evolutionary Computation · · cited 630× · DOI ↗ · more like this ·

In nature, almost every organism ages and has a limited lifespan. Aging has been explored by biologists to be an important mechanism for maintaining diversity. In a social animal colony, aging makes the old leader of the colony become weak, providing opportunities for the other individuals to challenge the leadership position. Inspired by this natural phenomenon, this paper transplants the aging mechanism to particle swarm optimization (PSO) and proposes a PSO with an aging leader and challengers (ALC-PSO). ALC-PSO is designed to overcome the problem of premature convergence without significantly impairing the fast-converging feature of PSO. It is characterized by assigning the leader of the swarm with a growing age and a lifespan, and allowing the other individuals to challenge the leadership when the leader becomes aged. The lifespan of the leader is adaptively tuned according to the…

Composite quantile regression and the oracle Model Selection Theory

Hui Zou, Ming Yuan

math.ST · · cited 621× · arXiv ↗ · more like this ·

Coefficient estimation and variable selection in multiple linear regression is routinely done in the (penalized) least squares (LS) framework. The concept of model selection oracle introduced by Fan and Li [J. Amer. Statist. Assoc. 96 (2001) 1348--1360] characterizes the optimal behavior of a model selection procedure. However, the least-squares oracle theory breaks down if the error variance is infinite. In the current paper we propose a new regression method called composite quantile regression (CQR). We show that the oracle model selection theory using the CQR oracle works beautifully even when the error variance is infinite. We develop a new oracular procedure to achieve the optimal properties of the CQR oracle. When the error variance is finite, CQR still enjoys great advantages in terms of estimation efficiency. We show that the relative efficiency of CQR compared to the least…

Quantum Illumination with Gaussian States

Si-Hui Tan, Baris I. Erkmen, Vittorio Giovannetti +5 more

quant-ph · · cited 587× · arXiv ↗ · more like this ·

An optical transmitter irradiates a target region containing a bright thermal-noise bath in which a low-reflectivity object might be embedded. The light received from this region is used to decide whether the object is present or absent. The performance achieved using a coherent-state transmitter is compared with that of a quantum illumination transmitter, i.e., one that employs the signal beam obtained from spontaneous parametric downconversion (SPDC). By making the optimum joint measurement on the light received from the target region together with the retained SPDC idler beam, the quantum illumination system realizes a 6 dB advantage in error probability exponent over the optimum reception coherent-state system. This advantage accrues despite there being no entanglement between the light collected from the target region and the retained idler beam.

Addendum: Regularization and Variable Selection Via the Elastic Net

Hui Zou, Trevor Hastie

Statistics and Probability · Journal of the Royal Statistical Society Series B (Statistical Methodology) · · cited 585× · DOI ↗ · more like this ·

[J. R. Statist. Soc. B, 67 (2005), 301–320] We missed an important reference in Section 3.4. In page 309 we stated that ‘ … which is based on the recently proposed algorithm LARS of Efron et al. (2004). They proved that, starting from zero, the lasso solution paths grow piecewise linearly in a predictable way. They proposed a new algorithm called LARS to solve the entire lasso solution path efficiently by using the same order of computations as a single OLS fit….’ The following sentence should have been included. The piecewise linearity of the lasso solution path was first proved by Osborne et al. (2000), who also described an efficient algorithm for calculating the complete lasso solution path.

Scaled Sparse Linear Regression

Tingni Sun, Cun-Hui Zhang

stat.ML · · cited 539× · arXiv ↗ · more like this ·

Scaled sparse linear regression jointly estimates the regression coefficients and noise level in a linear model. It chooses an equilibrium with a sparse regression method by iteratively estimating the noise level via the mean residual square and scaling the penalty in proportion to the estimated noise level. The iterative algorithm costs little beyond the computation of a path or grid of the sparse regression estimator for penalty levels above a proper threshold. For the scaled lasso, the algorithm is a gradient descent in a convex minimization of a penalized joint loss function for the regression coefficients and noise level. Under mild regularity conditions, we prove that the scaled lasso simultaneously yields an estimator for the noise level and an estimated coefficient vector satisfying certain oracle inequalities for prediction, the estimation of the noise level and the regression…