arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Yaming Yu

59 papers · 1993–2021

1993: 11994: 01995: 01996: 01997: 01998: 01999: 02000: 02001: 02002: 02003: 32004: 12005: 02006: 12007: 12008: 42009: 162010: 72011: 92012: 42013: 22014: 12015: 12016: 42017: 12018: 12019: 12020: 02021: 1
1993peak 16 in 20092021

Frequent co-authors

Papers

showing 1–25 of 59 RSS

To Center or Not to Center: That Is Not the Question—An Ancillarity–Sufficiency Interweaving Strategy (ASIS) for Boosting MCMC Efficiency

Yaming Yu, Xiao‐Li Meng

Statistics and Probability · Journal of Computational and Graphical Statistics · · cited 206× · DOI ↗ · more like this ·

For a broad class of multilevel models, there exist two well-known competing parameterizations, the centered parameterization (CP) and the non-centered parameterization (NCP), for effective MCMC implementation. Much literature has been devoted to the questions of when to use which and how to compromise between them via partial CP/NCP. This article introduces an alternative strategy for boosting MCMC efficiency via simply interweaving—but not alternating—the two parameterizations. This strategy has the surprising property that failure of both the CP and NCP chains to converge geometrically does not prevent the interweaving algorithm from doing so. It achieves this seemingly magical property by taking advantage of the discordance of the two parameterizations, namely, the sufficiency of CP and the ancillarity of NCP, to substantially reduce the Markovian dependence, especially when the…

Analysis of the convergence properties of topology preserving neural networks

Z.-P. Lo, Yaming Yu, B. Bavarian

Artificial Intelligence · IEEE Transactions on Neural Networks · · cited 83× · DOI ↗ · more like this ·

The authors provide a rigorous treatment of the convergence of the topology preserving neural networks proposed by Kohonen for the one-dimensional case. The approach extends the original work by Kohonen on the convergence properties of such networks in several respects. First, the authors investigate the convergence of the neuron weights directly as compared to Kohonen's treatment of the dynamic behavior of the expectation values of the weights. Second, the problem is formulated for a more general case of selecting the neighborhood amplitude of interaction rather than the uniform amplitude. Third, the proof of convergence is based on the well-known Gladyshev theorem which uses Lyapunov's function method. The authors provide a step-by-step constructive proof which establishes the asymptotic convergence to a unique solution. This proof also provides the relation between the boundary…

Stochastic Ordering of Exponential Family Distributions and Their Mixtures

Yaming Yu

math.ST · · cited 47× · arXiv ↗ · more like this ·

We investigate stochastic comparisons between exponential family distributions and their mixtures with respect to the usual stochastic order, the hazard rate order, the reversed hazard rate order, and the likelihood ratio order. A general theorem based on the notion of relative log-concavity is shown to unify various specific results for the Poisson, binomial, negative binomial, and gamma distributions in recent literature. By expressing a convolution of gamma distributions with arbitrary scale and shape parameters as a scale mixture of gamma distributions, we obtain comparison theorems concerning such convolutions that generalize some known results. Analogous results on convolutions of negative binomial distributions are also discussed.

On the Entropy of Compound Distributions on Nonnegative Integers

Yaming Yu

Statistics and Probability · IEEE Transactions on Information Theory · · cited 37× · DOI ↗ · more like this ·

Some entropy comparison results are presented concerning compound distributions on nonnegative integers. The main result shows that, under a log-concavity assumption, two compound distributions are ordered in terms of Shannon entropy if both the ldquonumbers of claimsrdquo and the ldquoclaim sizesrdquo are ordered accordingly in the convex order. Several maximum/minimum entropy theorems follow as a consequence. Most importantly, two recent results of Johnson (2008) on maximum entropy characterizations of compound Poisson and compound binomial distributions are proved under fewer assumptions and with simpler arguments.

On the Maximum Entropy Properties of the Binomial Distribution

Yaming Yu

Statistics and Probability · IEEE Transactions on Information Theory · · cited 26× · DOI ↗ · more like this ·

<para xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> It is shown that the <emphasis><formula formulatype="inline"><tex>${\hbox{Binomial}}(n, p)$</tex></formula></emphasis> distribution maximizes the entropy in the class of ultra-log-concave distributions of order <emphasis><formula formulatype="inline"> <tex>$n$</tex></formula></emphasis> with fixed mean <emphasis><formula formulatype="inline"> <tex>$np$</tex></formula></emphasis>. This result, which extends a theorem of Shepp and Olkin (1981), is analogous to that of Johnson (2007), who considers the Poisson case. The proof constructs a Markov chain whose limiting distribution is <emphasis><formula formulatype="inline"><tex>${\hbox{Binomial}}(n, p)$</tex> </formula></emphasis> and shows that the entropy never decreases along the iterations of this Markov chain. </para>

More Forbidden Minors for Wye-Delta-Wye Reducibility

Yaming Yu

Computational Theory and Mathematics · The Electronic Journal of Combinatorics · · cited 25× · DOI ↗ · more like this ·

A graph is $Y\Delta Y$ reducible if it can be reduced to isolated vertices by a sequence of series-parallel reductions and $Y\Delta Y$ transformations. It is still an open problem to characterize $Y\Delta Y$ reducible graphs in terms of a finite set of forbidden minors. We obtain a characterization of such forbidden minors that can be written as clique $k$-sums for $k=1, 2, 3$. As a result we show constructively that the total number of forbidden minors is more than 68 billion up to isomorphism.

Some stochastic inequalities for weighted sums

Yaming Yu

math.PR · · cited 23× · arXiv ↗ · more like this ·

We compare weighted sums of i.i.d. positive random variables according to the usual stochastic order. The main inequalities are derived using majorization techniques under certain log-concavity assumptions. Specifically, let $Y_i$ be i.i.d. random variables on $\mathbf{R}_+$. Assuming that $\log Y_i$ has a log-concave density, we show that $\sum a_iY_i$ is stochastically smaller than $\sum b_iY_i$, if $(\log a_1,...,\log a_n)$ is majorized by $(\log b_1,...,\log b_n)$. On the other hand, assuming that $Y_i^p$ has a log-concave density for some $p>1$, we show that $\sum a_iY_i$ is stochastically larger than $\sum b_iY_i$, if $(a_1^q,...,a_n^q)$ is majorized by $(b_1^q,...,b_n^q)$, where $p^{-1}+q^{-1}=1$. These unify several stochastic ordering results for specific distributions. In particular, a conjecture of Hitczenko [Sankhyā A 60 (1998) 171--175] on Weibull variables is proved.…

Concavity of entropy under thinning

Yaming Yu, Oliver Johnson

cs.IT · · cited 21× · arXiv ↗ · more like this ·

Building on the recent work of Johnson (2007) and Yu (2008), we prove that entropy is a concave function with respect to the thinning operation T_a. That is, if X and Y are independent random variables on Z_+ with ultra-log-concave probability mass functions, then H(T_a X+T_{1-a} Y)>= a H(X)+(1-a)H(Y), 0 <= a <= 1, where H denotes the discrete entropy. This is a discrete analogue of the inequality (h denotes the differential entropy) h(sqrt(a) X + sqrt{1-a} Y)>= a h(X)+(1-a) h(Y), 0 <= a <= 1, which holds for continuous X and Y with finite variances and is equivalent to Shannon's entropy power inequality. As a consequence we establish a special case of a conjecture of Shepp and Olkin (1981).

Monotonically Overrelaxed EM Algorithms

Yaming Yu

Artificial Intelligence · Journal of Computational and Graphical Statistics · · cited 16× · DOI ↗ · more like this ·

We explore the idea of overrelaxation for accelerating the expectation-maximization (EM) algorithm, focusing on preserving its simplicity and monotonic convergence properties. It is shown that in many cases, a trivial modification in the M-step results in an algorithm that maintains monotonic increase in the log-likelihood, but can have an appreciably faster convergence rate, especially when EM is very slow. The method is applicable to more general fixed point algorithms. Its simplicity and effectiveness are illustrated with several statistical problems, including probit regression, least absolute deviations regression, Poisson inverse problems, and finite mixtures. This article has supplemental materials available online.

Online Adaptive Topic Focused Tweet Acquisition

Mehdi Sadri, Sharad Mehrotra, Yaming Yu

Information Systems · · cited 13× · DOI ↗ · more like this ·

Twitter provides a public streaming API that is strictly limited, making it difficult to simultaneously achieve good coverage and relevance when monitoring tweets for a specific topic of interest. In this paper, we address the tweet acquisition challenge to enhance monitoring of tweets based on the client/application needs in an online adaptive manner such that the quality and quantity of the results improves over time. We propose a Tweet Acquisition System (TAS), that iteratively selects phrases to track based on an explore-exploit strategy. Our experimental studies show that TAS significantly improves recall of relevant tweets and the performance improves when the topics are more specific.

Geometric inequalities

Yaming Yu

Geometry and Topology · WORLD SCIENTIFIC eBooks · · cited 12× · DOI ↗ · more like this ·

In this paper it is shown that the Hilbert inequality for double series can be improved by introducing a weight function of the form, where n ∈ N .A similar result for the Hilbert integral inequality is also given.As applications, some sharp results of Hardy-Littlewood's theorem and Widder's theorem are obtained.

Derivation of learning vector quantization algorithms

Z.-P. Lo, Yaming Yu, B. Bavarian

Artificial Intelligence · · cited 10× · DOI ↗ · more like this ·

A formal derivation of three learning rules for the adaptation of the synaptic weight vectors of neurons representing the prototype vectors of the class distribution in a classifier is presented. A decision surface function and a set of adaptation algorithms for adjusting this surface which are derived by using the gradient-descent approach to minimize the classification error are derived. This also provides a formal analysis of the Kohonen learning vector quantization (LVQ1 and LVQ2) algorithms. In particular, it is shown that to minimize the classification error, one of the learning equations in the LVQ1 algorithm is not required. An application of the learning algorithms for designing a neural network classifier is presented. The performance of the classifier was tested and compared to the K-NN decision rule for the Iris real data set.< <ETX…

Forbidden minors for wye‐delta‐wye reducibility

Yaming Yu

Computational Theory and Mathematics · Journal of Graph Theory · · cited 9× · DOI ↗ · more like this ·

Abstract A graph is Y Δ Y reducible if it can be reduced to a single vertex by a sequence of series‐parallel reductions and Y Δ Y transformations. The class of Y Δ Y reducible graphs is minor closed. We found a large number of minor minimal Y Δ Y irreducible graphs: a family of 57578 31‐edge graphs and another 40‐edge graph. It is still an open problem to characterize Y Δ Y reducible graphs in terms of a finite set of forbidden minors. © 2004 Wiley Periodicals, Inc. J Graph Theory 47: 317–321, 2004

A natural derivative on [0,n] and a binomial Poincaré inequality

Erwan Hillion, Oliver Johnson, Yaming Yu

math.PR · · cited 7× · arXiv ↗ · more like this ·

We consider probability measures supported on a finite discrete interval $[0,n]$. We introduce a new finitedifference operator $\nabla_n$, defined as a linear combination of left and right finite differences. We show that this operator $\nabla_n$ plays a key role in a new Poincaré (spectral gap) inequality with respect to binomial weights, with the orthogonal Krawtchouk polynomials acting as eigenfunctions of the relevant operator. We briefly discuss the relationship of this operator to the problem of optimal transport of probability measures.

0 Concave Renewal Functions Do Not Imply DFR Inter-Renewal Times

Yaming Yu

Statistics and Probability · · cited 6× · OpenAlex ↗ · more like this ·

Brown (1980), (1981) proved that the renewal function is concave if the interrenewal distribution is DFR (decreasing failure rate), and conjectured the converse. This note settles Brown's conjecture with a class of counterexamples. We also give a short proof of Shanthikumar's (1988) result that the DFR property is closed under geometric compounding.

Algorithmic Searches for Optimal Designs

Abhyuday Mandal, Weng Kee Wong, Yaming Yu

Computational Theory and Mathematics · · cited 5× · DOI ↗ · more like this ·

Research in optimal experimental design has a long history and dates back as early as 1918 in a seminal paper by Smith (1918) and probably earlier. This chapter discusses algorithms for finding an optimal design given a statistical model defined on a given design space. We discuss background and the need for algorithms to find an optimal design for various situations. There are different types of algorithms available in the literature, and even for the same design problem, the researcher usually has several algorithms to choose from to find an optimal design. There are also algorithms that use specialized methods to find an optimal design for a very specific application. For example, Syed et al. (2011) used a mathematical programming technique to search for a D-optimal design using cyclotomic cosets. The literature on algorithms to find an optimal design for a statistical model is…

Concave Renewal Functions Do Not Imply DFR Inter-Renewal Times

Yaming Yu

math.PR · · cited 5× · arXiv ↗ · more like this ·

Brown (1980, 1981) proved that the renewal function is concave if the inter-renewal distribution is DFR (decreasing failure rate), and conjectured the converse. This note settles Brown's conjecture with a class of counter-examples. We also give a short proof of Shanthikumar's (1988) result that the DFR property is closed under geometric compounding.

On the inclusion probabilities in some unequal probability sampling plans without replacement

Yaming Yu

math.ST · · cited 5× · arXiv ↗ · more like this ·

Comparison results are obtained for the inclusion probabilities in some unequal probability sampling plans without replacement. For either successive sampling or Hájek's rejective sampling, the larger the sample size, the more uniform the inclusion probabilities in the sense of majorization. In particular, the inclusion probabilities are more uniform than the drawing probabilities. For the same sample size, and given the same set of drawing probabilities, the inclusion probabilities are more uniform for rejective sampling than for successive sampling. This last result confirms a conjecture of Hájek (Sampling from a Finite Population (1981) Dekker). Results are also presented in terms of the Kullback--Leibler divergence, showing that the inclusion probabilities for successive sampling are more proportional to the drawing probabilities.

Two theorems for the Kohonen mapping neural network

Z.-P. Lo, Yaming Yu, B. Bavarian

Artificial Intelligence · · cited 5× · DOI ↗ · more like this ·

The authors provide a rigorous treatment of the convergence of the topology preserving neural network which was first proposed by Kohonen. The problem is formulated for a more general case of selecting the neighborhood amplitude of interaction rather than the uniform amplitude. The proof of convergence is based on the well-known Gladyshev theorem which uses Lyapunov's function method. This proof also provides the relation between the boundary neurons weight vectors and the number of neurons in the network.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

On Stochastic Comparisons of Order Statistics from Heterogeneous Exponential Samples

Yaming Yu

math.ST · · cited 4× · arXiv ↗ · more like this ·

We show that the $k$th order statistic from a heterogeneous sample of $n\geq k$ exponential random variables is larger than that from a homogeneous exponential sample in the sense of star ordering, as conjectured by Xu and Balakrishnan (2012). As a consequence, we establish hazard rate ordering for order statistics between heterogeneous and homogeneous exponential samples, resolving an open problem of Pǎltǎnea (2008). Extensions to general spacings are also presented.

TQEL

Abdulrahman Alsaudi, Yasser Altowim, Sharad Mehrotra +1 more

Signal Processing · Proceedings of the VLDB Endowment · · cited 3× · DOI ↗ · more like this ·

Social media analysis over blogs (such as tweets) often requires determining top-k mentions of a certain category (e.g., movies) in a collection (e.g., tweets collected over a given day). Such queries require entity linking (EL) function to be executed that is often expensive. We propose TQEL, a framework that minimizes the joint cost of EL calls and top-k query processing. The paper presents two variants - TQEL-exact and TQEL-approximate that retrieve the exact / approximate top-k results. TQEL-approximate, using a weaker stopping condition, achieves significantly improved performance (with the fraction of the cost of TQEL-exact) while providing strong probabilistic guarantees (over 2 orders of magnitude lower EL calls with 95% confidence threshold compared to TQEL-exact). TQEL-exact itself is orders of magnitude better compared to a naive approach that calls EL functions on the entire…

The Shape of the Noncentral Chi-square Density

Yaming Yu

math.ST · · cited 3× · arXiv ↗ · more like this ·

A noncentral chi-square density is log-concave if the degree of freedom is nu>=2. We complement this known result by showing that, for each 0<nu<2, there exists lambda_nu>0 such that the chi-square with nu degrees of freedom and noncentrality parameter lambda has a decreasing density if lambda <= lambda_nu, and is bi-modal otherwise. The critical lambda_nu is characterized by an equation involving a ratio of modified Bessel functions. When an interior mode exists we derive precise bounds on its location.