Locating Center Points for Radial Basis Function Networks Using Instance Reduction Techniques

Authors: Rana Yousef, Khalil el Hindi

Abstract:

The behavior of Radial Basis Function (RBF) Networks greatly depends on how the center points of the basis functions are selected. In this work we investigate the use of instance reduction techniques, originally developed to reduce the storage requirements of instance based learners, for this purpose. Five Instance-Based Reduction Techniques were used to determine the set of center points, and RBF networks were trained using these sets of centers. The performance of the RBF networks is studied in terms of classification accuracy and training time. The results obtained were compared with two Radial Basis Function Networks: RBF networks that use all instances of the training set as center points (RBF-ALL) and Probabilistic Neural Networks (PNN). The former achieves high classification accuracies and the latter requires smaller training time. Results showed that RBF networks trained using sets of centers located by noise-filtering techniques (ALLKNN and ENN) rather than pure reduction techniques produce the best results in terms of classification accuracy. The results show that these networks require smaller training time than that of RBF-ALL and higher classification accuracy than that of PNN. Thus, using ALLKNN and ENN to select center points gives better combination of classification accuracy and training time. Our experiments also show that using the reduced sets to train the networks is beneficial especially in the presence of noise in the original training sets.

Keywords: Radial basis function networks, Instance-based reduction, PNN.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1057249

References:

[1] Bors, A.G. (2001). Introduction of the Radial Basis Function (RBF) Networks. Online Symposium for Electronics Engineers, 1(1), 1 - 7.
[2] Ghosh, J. and Nag, A., (2002). Knowledge enhancement and reuse with radial basis function networks, IJCNN '02. Proceedings of the 2002 International Joint Conference on Neural Networks, Vol. 2, 1322 -1327
[3] Mitchell, T. (1997). Machine Learning. New York: McGraw-Hill
[4] Wasserman, P.D. (1993). Advanced Methods in Neural Computing, New York: Van Nostrand Reinhold, 35-55.
[5] Wilson, D. and Martinez, T., (2000). Reduction Techniques for Instance- Based Learning Algorithms, Machine Learning, 38(3), 257-286.