A Multi-Objective Evolutionary Algorithm of Neural Network for Medical Diseases Problems

Authors: Sultan Noman Qasem

Abstract:

This paper presents an evolutionary algorithm for solving multi-objective optimization problems-based artificial neural network (ANN). The multi-objective evolutionary algorithm used in this study is genetic algorithm while ANN used is radial basis function network (RBFN). The proposed algorithm named memetic elitist Pareto non-dominated sorting genetic algorithm-based RBFN (MEPGAN). The proposed algorithm is implemented on medical diseases problems. The experimental results indicate that the proposed algorithm is viable, and provides an effective means to design multi-objective RBFNs with good generalization capability and compact network structure. This study shows that MEPGAN generates RBFNs coming with an appropriate balance between accuracy and simplicity, comparing to the other algorithms found in literature.

Keywords: Radial basis function network, Hybrid learning, Multi-objective optimization, Genetic algorithm.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1099138

References:

[1] C.M. Bishop, Neural networks for pattern recognition. Oxford, U.K.: Oxford Univ., Press, 1995.
[2] D. Broomhead, D. Lowe, "Multivariable functional interpolation and adaptive networks," Complex Systems, vol. 2, pp. 321–355, 1988.
[3] H.A. Abbass, "An evolutionary artificial neural networks approach for breast cancer diagnosis", Artificial Intelligence in Medicine, vol. 25, no. 3,pp. 265–281, 2002.
[4] H.A. Abbass, "Speed up backpropagation using multi-objective evolutionary algorithms," Neural Computation, vol. 15, no. 11,pp. 2705–2726, 2003.
[5] J.C. Caballero, F.J. Martínez, C. Hervás, P.A. Gutiérrez, "Sensitivity versus accuracy in multiclass problems using memetic Pareto evolutionary neural networks,"IEEE Transactions on Neural Networks, vol. 21, no. 5, pp. 750–770, 2010.
[6] R.A. Teixeira, A.P. Braga, R.R. Saldanha, R.H.C. Takahashi, "Improving generalization of MLPs with multi-objective optimization," Neurocomputing, vol. 35, pp. 189–194, 2000.
[7] I. Kokshenev, A.P. Braga, "A multi-objective approach to RBF network learning," Neurocomputing, vol. 71, no. 7–9 , pp. 1203–1209, 2008.
[8] I. Kokshenev, A. P. Braga, "An efficient multi-objective learning algorithm for RBF neural network,"Neurocomputing, vol. 73, no. 16– 18), pp. 2799–2808, 2010.
[9] N. Kondo, T. Hatanaka, K. Uosaki, "Pattern classification by evolutionary RBF networks ensemble based on multi-objective optimization," International Joint Conference on Neural Networks, pp. 2919–2925, 2006.
[10] G.G. Yen, Multi-objective evolutionary algorithm for radial basis function neural network design. Springer-Verlag, vol. 16, 2006.
[11] V. Lefort, C. Knibbe, G. Beslon, J. Favrel, Simultaneous optimization of weights and structure of an RBF neural network. Springer-Verlag, LNCS, vol. 3871, pp. 49–60, 2006.
[12] J. González, I. Rojas, H. Pomares, J. Ortega, RBF neural networks, multi-objective optimization and time series forecasting. Springer- Verlag, LNCS, vol. 2084, pp. 498–505, 2001.
[13] N. Kondo, T. Hatanaka, K. Uosaki, "Non linear dynamic system identification based on multi-objectively selected RBF networks," Proceedings of the IEEE Symposium on Computational Intelligence in Multi-criteria Decision Making, pp. 112–127, 2007.
[14] P.M. Ferreira, A.E. Ruano, C.M. Fonseca, "Evolutionary multi-objective design of radial basis function networks for greenhouse environmental control," Proceedings of the 16th IFAC World Congress, 2005.
[15] S.N. Qasem, S.M. Shamsuddin, "Radial basis function network based on time variant multi-objective particle swarm optimization for medical diseases diagnosis," Applied Soft Computing, vol. 11, no. 1, pp. 1427– 1438, 2011.
[16] J.H. Holland, Adaptation in Natural and Artificial Systems. University of Michigan Press, 1975.
[17] K. Deb, A. Pratap, S. Agarwal, T. Meyarivan, "A fast and elitist multi objective genetic algorithm: NSGA-II,"IEEE Transactions on Evolutionary Computation, vol. 6, no. 2, pp. 182-197, 2002.
[18] K. Deb, R.B. Agrawal, "Simulated binary crossover for continuous search space," Complex System, vol. 9, pp. 115–148, 1995.
[19] A. Asuncion, D. Newman, UCI machine learning repository, URL (http://www.ics.uci.edu/~mlearn/MLRepository.html), 2007.
[20] Y. Jin, B. Sendhoff, "Pareto-based multi-objective machine learning: an overview and case studies," IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews, vol. 38, no. 3, pp. 397– 415, 2008.
[21] C. Goh, E. Teoh, K.C. Tan, "Hybrid multi-objective evolutionary design for artificial neural networks," IEEE Transactions on Neural Networks, vol. 19, no. 9, pp. 1531-1548, 2008.
[22] W. Cai, S. Chen, D. Zhang, "A multi-objective simultaneous learning framework for clustering and classification," IEEE Transactions on Neural Networks, vol. 21, no. 2, pp. 185–200, 2010.
[23] M.-L. Antonie, O.R. Zaiane, R.C. Holte, "Learning to use a learned model: a two stage approach to classification," Proceedings of 6th International Conference of Data Mining, pp. 33–42, 2006.