arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Mathematics · Statistics and Probability

ARTICLE Complexity of Penalized Likelihood Estimation

Xiaoming Huo A, Jie Chen B

See on the map

Abstract

We show that for a class of penalty functions, finding the global optimizer in the penalized least squares estimation is equivalent to the ‘exact cover by 3-sets ’ problem, which belongs to a class of NP-hard problems. The NP-hardness result is then extended to the cases of penalized least absolute deviations regression and a special class of penalized support vector machines. We discuss its implication in statistics. To the best of our knowledge, this is the first formal documentation on the complexity of this type of problems. Keywords: NP-hardness; regularization; penalized likelihood estimator; penalized least squares estimates; penalized least absolute deviations regression; penalized support vector machines AMS Subject Classification: 62-04; 68Q25 1.

More like this