Ensemble of a subset of kNN classifiers
Asma Gul, Aris Perperoglou, Zardad Khan +4 more
Combining multiple classifiers, known as ensemble methods, can give substantial improvement in prediction performance of learning algorithms especially in the presence of non-informative features in the data sets. We propose an ensemble of subset of k NN classifiers, ES k NN, for classification task in two steps. Firstly, we choose classifiers based upon their individual performance using the out-of-sample accuracy. The selected classifiers are then combined sequentially starting from the best model and assessed for collective performance on a validation data set. We use bench mark data sets with their original and some added non-informative features for the evaluation of our method. The results are compared with usual k NN, bagged k NN, random k NN, multiple feature subset method, random forest and support vector machines. Our experimental comparisons on benchmark classification…