arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Mathematics · Applied Mathematics

Any Discrimination Rule Can Have an Arbitrarily Bad Probability of Error for Finite Sample Size

Luc Devroye

· IEEE Transactions on Pattern Analysis and Machine Intelligence

See on the map

Abstract

Consider the basic discrimination problem based on a sample of size n drawn from the distribution of (X, Y) on the Borel sets of R <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">d</sup> x {0, 1}. If 0 ⩽ R*. < ½ is a given number, and ø <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</sub> → 0 is an arbitrary positive sequence, then for any discrimination rule one can find a distribution for (X, Y), not depending upon n, with Bayes probability of error R* such that the probability of error (R <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</sub> ) of the discrimination rule is larger than R* + ø <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</sub> for infinitely many n. We give a formal proof of this result, which is a generalization of a result by Cover [1]. Furthermore, sup all distributions of (X, Y) with R* = 0 R <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</sub> ⩾ ½. Thus, any attempt to find a nontrivial distribution-free upper bound for R <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</sub> will fail, and any results on the rate of convergence of R <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</sub> to R* must use assumptions about the distribution of (X, Y).

Cited by 1

1 paper in the index cites this.

The cited-by list is still filling in while reference lists are collected.

More like this