SVM Based Model as an Optimal Classifier for the Classification of Sonar Signals

Authors: Suresh S. Salankar, Balasaheb M. Patre

Abstract:

Research into the problem of classification of sonar signals has been taken up as a challenging task for the neural networks. This paper investigates the design of an optimal classifier using a Multi layer Perceptron Neural Network (MLP NN) and Support Vector Machines (SVM). Results obtained using sonar data sets suggest that SVM classifier perform well in comparison with well-known MLP NN classifier. An average classification accuracy of 91.974% is achieved with SVM classifier and 90.3609% with MLP NN classifier, on the test instances. The area under the Receiver Operating Characteristics (ROC) curve for the proposed SVM classifier on test data set is found as 0.981183, which is very close to unity and this clearly confirms the excellent quality of the proposed classifier. The SVM classifier employed in this paper is implemented using kernel Adatron algorithm is seen to be robust and relatively insensitive to the parameter initialization in comparison to MLP NN.

Keywords: Classification, MLP NN, backpropagation algorithm, SVM, Receiver Operating Characteristics.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1330881

References:

[1] R. P. Lippmann. "An introduction to computing with neural nets," IEEE ASSP Magazine, pp. 4-22, April 1987.
[2] H.L. Roitblat, W.W.L. Au, P.E. Nachtigall, R. Shizumura and G. Moons, "Sonar recognition of targets embedded in sediments," Neural Networks, Vol. 8, No. 7/8, pp. 1263-1273, 1995.
[3] J.A. Simmons, P.A. Saillant, J.M. Wotton, T. Haresign, M.J. Ferragamo and C.F. Moss, "Composition of biosonar images for target recognition by echolocating bats," Neural Networks, Vol. 8, No. 7/8, pp. 1239-1261, 1995.
[4] W.W.L. Au, "Comparision of sonar discrimination- dolphin and artificial neural network," The Journal of the Acoustical Society of America, Vol. 95, No. 5, Part 1, pp. 2728-2735, May 1994.
[5] E. Alpaydin, "Multiple networks for function learning," Proceedings of IEEE International Conference on Neural Networks, San Francisco, pp. 9-14, March 1993.
[6] W.W.L. Au, L.N. Andersen, A.R. Rasmussen, H.L. Roitblat and P.E. Nachtigall, "Neural Network modeling of a dolphin-s sonar discrimination capabilities," The Journal of the Acoustical Society of America, Vol. 98, No. 1, pp. 43-50, July 1995.
[7] R. P. Gorman and T. J. Sejnowski, "Analysis of Hidden Units in a Layered Network Trained to Classify Sonar Targets" in Neural Networks, Vol. 1, pp. 75-89, 1988.
[8] R. P. Gorman and T. J. Sejnowski, "Learned classification of sonar targets using a massively parallel network," IEEE Transactions on Acoustic, Speech and Signal Processing, Vol. 36, No. 7, pp. 1135-1140, July 1998.
[9] Vapnik, V. N., The Nature of Statistical Learning Theory. New York: Springer-Verlag 1995.
[10] Hornik K. M., Stinchcombe M., and White H. (1989). "Multilayer Feedforward Networks Are Universal Approximators," Neural Networks, vol.2 no. (5), pp. 359-66.
[11] Boser, H., Guyon, I. M., & Vapnik, V. N., 1992. A training algorithm for optimal margin classifiers. In Haussler, D., Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory 144-152. Pittsburgh, PA: ACM Press.
[12] Cristianini, N. and Shawe-Taylor, J., 2000. An Introduction to Support Vector Machines and other Kernel-based Learning Methods. Cambridge, UK: Cambridge University Press.
[13] S. Haykin, 1994. Neural Networks: A Comprehensive Foundation, McMillan, New York.
[14] T. Friess, N. Cristianini and C. Campbell, "The Kernel-Adatron: A fast and simple learning procedure for support vector machines," Proceedings of the 15th International Conference in Machine Learning, pp. 188-196, 1998.
[15] Alim, O.A.; Hashem, H.F.; "Automatic recognition of the sonar signals using neural network," Proceedings of International Conference on Information, Communications and Signal Processing, ICICS1997, 9-12 Sept. 1997, vol.2, pp.740 - 744.
[16] Freiss T., Support Vector Neural Networks: The Kernel Adatron with Bias and Soft Margin, Uniiversity of Sheffield Technical Report, 1998.
[17] Andersen, L.N.; Au, W.; Larsen, J.; Hansen, L.K.; "Sonar discrimination of cylinders from different angles using neural networks," Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP '99, Volume 2, 15-19 March 1999, vol.2 pp.1121 - 1124.
[18] Jose C. Principe, Neil R. Euliano, and W. Curt Lefebvre, Neural and Adaptive Systems: Fundamentals Through Simulations, John Wiley & Sons, Inc., 2000.
[19] Ming Hsuan Yang and Narendra Ahuja, "A geometric approach to train support vector machines," Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, CVPR 2000, Hilton Head Island, Vol. 1, pp. 430-437, June 2000.
[20] Dai H.K., Jing Peng, and Heisterkamp Douglas R. "LDA/SVM driven nearest neighbour classification," IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, Vol. 1, pp. 158-163, 2001.
[21] Ward, M.K.; Stevenson, M.; "Sonar signal detection and classification using artificial neural networks," Electrical and Computer Engineering, 2000, Canadian Conference on 7-10 March, 2000, Volume 2, pp.717 - 721.