Approximate Bounded Knowledge Extraction Using Type-I Fuzzy Logic

Authors: Syed Muhammad Aqil Burney, Tahseen Ahmed Jilani, C. Ardil

Abstract:

Using neural network we try to model the unknown function f for given input-output data pairs. The connection strength of each neuron is updated through learning. Repeated simulations of crisp neural network produce different values of weight factors that are directly affected by the change of different parameters. We propose the idea that for each neuron in the network, we can obtain quasi-fuzzy weight sets (QFWS) using repeated simulation of the crisp neural network. Such type of fuzzy weight functions may be applied where we have multivariate crisp input that needs to be adjusted after iterative learning, like claim amount distribution analysis. As real data is subjected to noise and uncertainty, therefore, QFWS may be helpful in the simplification of such complex problems. Secondly, these QFWS provide good initial solution for training of fuzzy neural networks with reduced computational complexity.

Keywords: Crisp neural networks, fuzzy systems, extraction of logical rules, quasi-fuzzy numbers.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1059964

References:

[1] Aqil Burney S.M., Jilani A. Tahseen and Cemal Ardil, "A comparative study of first and second order training algorithms for artificial neural networks", Int. Journal of Computational Intelligence, vol. 1, no.3, 2004, pp. 218-224.
[2] Aqil Burney S.M., Jilani A. Tahseen and Cemal Ardil, "Levenberg- Marquardt algorithm for Karachi Stock Exchange share rates forecasting", Int. J. of Computational Intelligence, vol. 1, no. 2, 2004, pp 168-173.
[3] Aqil Burney S.M., Jilani A. Tahseen, "Time Series forecasting using artificial neural network methods for Karachi Stock Exchange", A Project in the Dept. of Computer Science, University of Karachi. 2002.
[4] F. Scarselli and A. C. Tosi, "Universal approximation using feedforward neural networks: A survey of some existing methods, and some new results," Neural Networks, vol. 11, no. 1, 1998, pp. 15-37.
[5] G. Castellano and A.M. Fanelli, "Fuzzy inference and rule extraction using a neural network", Neural Network World Journal, vol. 3, 2000, pp. 361-371.
[6] H. Ishibuchi and M. Nii, "Numerical analysis of the learning of fuzzified neural networks from if-then rules," Fuzzy Sets Syst., vol. 120, no. 2, 2001, pp. 281-307.
[7] H. Ishibuchi, Fujioka, and Tanaka, (1993), "Neural networks that learn from fuzzy If-then rules", IEEE Transactions on Fuzzy Systems, vol. 1. no. 2. 1993.
[8] J. Dunyak and D. Wunsch, "Training fuzzy numbers neural networks with alpha-cut refinement," in Proc. IEEE Int. Conf. System, Man, Cybernetics, vol. 1, 1997, pp. 189-194.
[9] J. J. Buckley and Y. Hayashi, "Neural networks for fuzzy systems," Fuzzy Sets and Systems 1995, pp. 265-276.
[10] Jang, Sun and Mizutani, Neuro-fuzzy logic and Soft Computing; A computational approach to learning and machine intelligence. New York: Practice-Hall, 2003, Chap. 2-4
[11] Jerry M. Mendel, Uncertainly Rule-Based Fuzzy Logic Systems. Introduction and new Directions. New York: Prentice Hall PTR, NJ.2001, chapter 1-7.
[12] L. A. Zadeh, "The concept of linguistic variable and its applications to approximate reasoning", Parts I,II,III, Information Sciences, 8(1975) 199-251; 8(1975) 301-357; 9(1975) 43-80. 30.
[13] L. A. Zadeh, "Outline of a new approach to the analysis of complex systems and decision processes", IEEE Trans. Systems, Man and Cybernetics, 1973, vol. 3, pp. 28-44.
[14] Mir F. Atiya, Suzan M. El-Shoura, Samir I. Shaken, "A comparison between neural network forecasting techniques- case study: river flow forecasting". IEEE Trans. on Neural Networks. Vol. 10, No. 2. 1999.
[15] M. Bishop, Neural networks for pattern recognition. United Kingdom: Clarendon Press, 1995, chapter 5-7.
[16] Nauck and R. Kruse, "Designing neuro-fuzzy systems through backpropagation", in Fuzzy Modeling: Paradigms and Practice, Kluwer, Boston, 1996. pp. 203-228.
[17] Nauck, Detlef and Kruse, Rudolf, "Designing neuro-fuzzy systems through backpropagation", In Witold Pedryz, editor, Fuzzy Modeling: Paradigms and Practice, 1996. pp. 203-228, Kluwer, Boston.
[18] Nilesh N. Karnik, Jerry M. Mendel and Qilian Liang, "Type-2 Fuzzy Logic Systems", IEEE Trans. Fuzzy Syst., 1999, vol. 15, no. 3,pp. 643- 658.
[19] P. Eklund, J. Forsstrom, A. Holm, M. Nystrom, and G. Selen, "Rule generation as an alternative to knowledge acquisition: A systems architecture for medical informatics", Fuzzy Sets and Systems, vol. 66 1994, pp. 195-205.
[20] P. Eklund, "Network size versus preprocessing, Fuzzy Sets, Neural Networks and Soft Computing" (Van Nostrand, New York, 1994, pp. 250-264.
[21] Puha, P. K. H. Daohua Ming, "Parallel nonlinear optimization techniques for training neural networks.", IEEE Trans. on Neural Networks, vol. 14, no. 6, 2003, pp 1460-1468.
[22] Puyin Liu and Hongxing, "Efficient learning algorithms for three-layer regular feedforward fuzzy neural networks", IEEE Trans. Fuzzy Syst., vol. 15, no. 3, 2004, pp. 545-558.
[23] S. Mitra and Y. Hayashi, "Neuro-fuzzy rule generation: Survey in soft computing framework," IEEE Trans. Neural Networks., vol. 11, no. 3, 2000, pp. 748-768.
[24] S. M. Chen, "A weighted fuzzy reasoning algorithm for medical diagnosis", Decision Support Systems, vol. 11, 1994, pp.37-43.
[25] Sungwoo Park and Taisook Han, "Iterative Inversion of Fuzzified Neural Networks", IEEE Trans. Fuzzy Syst., vol. 8, no. 3, 2000, pp. 266- 280.
[26] T. Takagi and M. Sugeno, "Fuzzy identification of systems and its applications to modeling and control", IEEE Trans. Syst. Man Cybernet., 1985, pp. 116-132.
[27] Włodzisław Duch," Uncertainty of Data, Fuzzy Membership Functions, and Multilayer Perceptrons", IEEE, Trans. on Neural Network, vol. 16, no.1, 2005.
[28] Xinghu Zhang, Chang-Chieh Hang, Shaohua Tan and -Pei Zhuang Wang," The Min-Max Function Differentiation and Training of Fuzzy Neural Networks", IEEE Trans, Neural Networks, vol. 7. no. 5, 1996, pp. 1139-1149.
[29] Y. Hayashi, J. J. Buckley, and E. Czogala, "Fuzzy neural network with fuzzy signals and weight, "in Proc. Int. Joint Conf. Neural Networks, vol. 2, Baltimore, MD, pp. 1992, pp. 696-701.