Ant System-based Feature Set Partitioning Algorithm for Classifier Ensemble Construction

Husin, Abdullah (2016) Ant System-based Feature Set Partitioning Algorithm for Classifier Ensemble Construction. International Journal of Soft Computing, 11 (3). pp. 176-184. ISSN 1816-9503

Text 176-184.pdf Download (374kB)

Abstract

Ensemble method is considered as a new direction in pattern classification. Accuracy and diversity in a set of classifiers are two important things to be considered in constructing classifier ensemble. Several approaches have been proposed to construct the classifier ensemble. All of these approaches attempt to generate diversity in the ensemble. However, classifier ensemble construction still remains a problem because there is no standard guideline in constructing a set of accurate and diverse classifiers. In this study, Ant System-based feature set partitioning algorithm for classifier ensemble construction is proposed. The Ant System algorithm is used to form an optimal feature set partition of the original training set, which represents the number of classifiers. Experiments were carried out to construct several homogeneous classifier ensembles using nearest mean classifier, naïve Bayes classifier, k-nearest neighbor, and linear discriminant analysis as base classifier and majority voting technique as combiner. Experimental results on several datasets from University of California, Irvine, have shown that the proposed algorithm has successfully constructed better classifier ensembles.

Actions (login required)

View Item