Hierarchical Clustering Analysis with SOM Networks

Authors: Diego Ordonez, Carlos Dafonte, Minia Manteiga, Bernardino Arcayy

Abstract:

This work presents a neural network model for the clustering analysis of data based on Self Organizing Maps (SOM). The model evolves during the training stage towards a hierarchical structure according to the input requirements. The hierarchical structure symbolizes a specialization tool that provides refinements of the classification process. The structure behaves like a single map with different resolutions depending on the region to analyze. The benefits and performance of the algorithm are discussed in application to the Iris dataset, a classical example for pattern recognition.

Keywords: Neural networks, Self-organizing feature maps, Hierarchicalsystems, Pattern clustering methods.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1332726

References:

[1] M. Endo, M. Ueno, T. Tanabe, "A Clustering Method Using Hierarchical Self-Organizing Maps", Journal of VLSI Signal Processing, vol. 32, pp. 105-118, 2002.
[2] J. Lampinen, E. Oja, "Clustering Properties of Hierarchical Self- Organizing Maps", Journal of Mathematical Imaging and vision, vol 2, pp 261-272, 1992.
[3] P.N. Suganthan, "Pattern Classification Using Multiple Hierarchical Overlapped Self-Organising Maps", Pattern Recognition, vol. 34, pp. 2173- 2179, 2001.
[4] S.B. Cho, "Neural Network Classifiers for Recognising Totally Unconstrained Handwritten Numerals", IEEE Trans. Neural Networks, vol. 8(1), pp. 43-53, 1997.
[5] S.P. Luttrell, "Image Compression Using a Multilayer Neural Network", Pattern Recognition Letters. vol. 10, pp. 1-7, 1989.
[6] A. Forti, G.L. Foresti, "Growing Hierarchical Tree SOM: An Unsupervised Neural Network with Dynamic Topology", vol. 19, pp 1568-1580, 2006.
[7] T. Kohonen, E. Oja, O. Simula, A. Visa and J. Kangas, "Engineering applications of the self-organizing map", Proceedings of the IEEE, vol. 84(10), pp. 1358-84, October 1996.
[8] T. Kohonen, "Self-organization and associative memory", Springer-Verlag New York, Inc, New York, 1989.
[9] T. Kohonen, "Analysis of a simple self-organizing process", Biological Cybernetics, vol. 44, pp. 135-140, July 1982.
[10] T. Kohonen, "Self Organizing Maps", Springer, Berlin, 1995 (Third, Extended Edition 2001).
[11] J.C. Bezdek, "Pattern Recognition with Fuzzy Objective Function Algorithms", Kluwer Academic Publishers, Norwell, MA, USA 1981.
[12] J.C. Dunn, "A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters", Cybernetics and Systems. vol. 3, pp. 32-57, 1973.
[13] P. Koikkalainen and E. Oja, "Self-organizing hierarchical feature maps", International Joint Conference on Neural Networks, vol. II, pp. 279-285, Piscataway, NJ 1990.
[14] P. Koikkalainen, "Progress with the tree-structured self-organizing map". Proceedings of ECAI-94, 11th European Conference on Artificial Intelligence, pp. 211-215, New York 1994
[15] L.A. Zadeh, "Fuzzy Sets", Information and Control, vol. 8, pp. 338-353, 1965.
[16] R.A. Fisher, "The use of multiple measurements in taxonomic problems", Annual Eugenics, vol. 7, pp. 179-188, 1936.
[17] R.O. Duda and P.E. Hart, "Pattern Classification and Scene Analysis", John Wiley and Sons, 1973.
[18] H. Demuth and M. Beale, "Neural Network Toolbox: For use with MATLAB: User-s Guide", The Mathworks, 1993.