Computer Science · Computer Vision and Pattern Recognition
Subsetting as an Approach to Distributed Learning.
See on the mapAbstract
This paper discusses one approach to the scaling problem of machine learning (Chan and Stolfo 1995) namely the decomposition of large datasets into smaller subsets so that the learning task on each subset is greatly reduced in comparison to the learning task for the whole dataset. A previous study (Catlett 1992) has examined this approach and concluded that classifiers learned on a subset of available data were significantly less accurate that classifiers learned on training sets entire. We examine a different set of properties from those looked at by Catlett, focusing on the agreement between classifiers learned on subsets of a data set. Our intention is to use the information from the learning process and about the data set to iteratively construct improved subsets which improve the classification performance of classifiers learned on them with a view to distributing the learning process over a number of processors and thus reduce overall learning time. We propose methods which can be used to this and discuss the prospect of their development into a distributed knowledge discovery scheme. Introduction