Mathematics · Statistics and Probability
ARTICLE Complexity of Penalized Likelihood Estimation
See on the mapAbstract
We show that for a class of penalty functions, finding the global optimizer in the penalized least squares estimation is equivalent to the ‘exact cover by 3-sets ’ problem, which belongs to a class of NP-hard problems. The NP-hardness result is then extended to the cases of penalized least absolute deviations regression and a special class of penalized support vector machines. We discuss its implication in statistics. To the best of our knowledge, this is the first formal documentation on the complexity of this type of problems. Keywords: NP-hardness; regularization; penalized likelihood estimator; penalized least squares estimates; penalized least absolute deviations regression; penalized support vector machines AMS Subject Classification: 62-04; 68Q25 1.