arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Mathematics · math.ST

Complexity regularization via localized random penalties

Gabor Lugosi, Marten Wegkamp

· Annals of Statistics 2004, Vol. 32, No. 4, 1679-1697

See on the map

Abstract

In this article, model selection via penalized empirical loss minimization in nonparametric classification problems is studied. Data-dependent penalties are constructed, which are based on estimates of the complexity of a small subclass of each model class, containing only those functions with small empirical loss. The penalties are novel since those considered in the literature are typically based on the entire model class. Oracle inequalities using these penalties are established, and the advantage of the new penalties over those based on the complexity of the whole model class is demonstrated.

References 10

10 of 29 references are in the index.

Cited by 2

2 papers in the index cite this (Semantic Scholar counts 83 in total).

The cited-by list is still filling in while reference lists are collected.

More like this