Ant Colony Optimization for Feature Subset Selection

Authors: Ahmed Al-Ani

Abstract:

The Ant Colony Optimization (ACO) is a metaheuristic inspired by the behavior of real ants in their search for the shortest paths to food sources. It has recently attracted a lot of attention and has been successfully applied to a number of different optimization problems. Due to the importance of the feature selection problem and the potential of ACO, this paper presents a novel method that utilizes the ACO algorithm to implement a feature subset search procedure. Initial results obtained using the classification of speech segments are very promising.

Keywords: Ant Colony Optimization, ant systems, feature selection, pattern recognition.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1075110

References:

[1] A.L. Blum and P. "Langley. Selection of relevant features and examples in machine learning". Artificial Intelligence, 97:245-271, 1997.
[2] M.A. Hall. Correlation-based feature selection for machine learning. PhD thesis, The University of Waikato, 1999.
[3] R. Kohavi. Wrappers for performance enhancement and oblivious decision graphs. PhD thesis, Stanford University, 1995.
[4] J. Kittler. "Feature set search algorithms". In C. H. Chen, editor, Pattern Recognition and Signal Processing. Sijhoff and Noordhoff, the Netherlands, 1978.
[5] P. Pudil, J. Novovicova, and J. Kittler. "Floating search methods in feature selection". Pattern Recognition Letters, 15:1119-1125, 1994.
[6] P.M. Narendra and K. Fukunaga. "A branh and bound algorithm for feature subset selection". IEEE Transactions on Computers, C-26: 917- 922, 1977.
[7] J. Yang and V. Honavar, "Feature subset selection using a genetic algorithm," IEEE Transactions on Intelligent Systems, 13: 44-49, 1998.
[8] M. Gletsos, S.G. Mougiakakou, G.K. Matsopoulos, K.S. Nikita, A.S. Nikita, and D. Kelekis. "A Computer-Aided Diagnostic System to Characterize CT Focal Liver Lesions: Design and Optimization of a Neural Network Classifier" IEEE Transactions on Information Technology in Biomedicine, 7: 153-162, 2003.
[9] M. Dorigo, V. Maniezzo, and A. Colorni. "Ant System: Optimization by a colony of cooperating agents". IEEE Transactions on Systems, Man, and Cybernetics - Part B, 26:29-41, 1996.
[10] T. St├╝tzle and M. Dorigo. "The Ant Colony Optimization Metaheuristic: Algorithms, Applications, and Advances". In F. Glover and G. Kochenberger, editors, Handbook of Metaheuristics, Kluwer Academic Publishers, Norwell, MA, 2002.
[11] G. Di Caro and M. Dorigo. "AntNet: Distributed stigmergetic control for communications networks". Journal of Artificial Intelligence Research, 9:317-365, 1998.
[12] R.S. Parpinelli; H.S. Lopes; A.A. Freitas, "Data mining with an ant colony optimization algorithm", IEEE Transactions on Evolutionary Computation, 6: 321 - 332 2002.
[13] R. Montemanni, L.M. Gambardella, A.E. Rizzoli and A.V. Donati. "A new algorithm for a Dynamic Vehicle Routing Problem based on Ant Colony System". Proceedings of ODYSSEUS 2003, 27-30, 2003.
[14] A. Al-Ani, M. Deriche and J. Chebil. "A new mutual information based measure for feature selection", Intelligent Data Analysis, 7: 43-57, 2003.