Pattern Classification of Back-Propagation Algorithm Using Exclusive Connecting Network

Authors: Insung Jung, Gi-Nam Wang

Abstract:

The objective of this paper is to a design of pattern classification model based on the back-propagation (BP) algorithm for decision support system. Standard BP model has done full connection of each node in the layers from input to output layers. Therefore, it takes a lot of computing time and iteration computing for good performance and less accepted error rate when we are doing some pattern generation or training the network. However, this model is using exclusive connection in between hidden layer nodes and output nodes. The advantage of this model is less number of iteration and better performance compare with standard back-propagation model. We simulated some cases of classification data and different setting of network factors (e.g. hidden layer number and nodes, number of classification and iteration). During our simulation, we found that most of simulations cases were satisfied by BP based using exclusive connection network model compared to standard BP. We expect that this algorithm can be available to identification of user face, analysis of data, mapping data in between environment data and information.

Keywords: Neural network, Back-propagation, classification.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1071960

References:

[1] F. Rosenblatt, "A Probabilistic Model for Information Storage and Organization in the Brain," Cornell Aeronautical Laboratory, vol. 65, pp. 386-108, 1958.
[2] R. H. Rosenblatt, "The Atlantic species of the blennioid fish genus", 1960.
[3] M. Minsky, & Papert, S., "Perceptrons: An Introduction to Computational Geometry," The MIT Press, pp. 3, 26, 31, 33, (1969).
[4] D. E. Rumelhart, Hinton, G. E., & Williams, R. J. , " Learning representations by backpropagating errors," Nature, vol. 323, pp. 533-536, 1986.
[5] P. J. Werbos, "Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences," Unpublished doctoral dissertation Harvard University., 1976.
[6] D. B. Parker, "Learning-Logic (Tech. Rep. Nos. TR{47)." 1985.
[7] Y. L. Cun, "Une procedure d'apprentissage pour reseau a seuil assymetrique," Proceedings of Cognitiva, vol. 85, pp. 599-604.
[8] Richard P. Lippmann,:" An introduction to computing with neural network", IEEE ASSP magazine, 1987, pp. 4-22.