A New High Speed Neural Model for Fast Character Recognition Using Cross Correlation and Matrix Decomposition

Authors: Hazem M. El-Bakry

Abstract:

Neural processors have shown good results for detecting a certain character in a given input matrix. In this paper, a new idead to speed up the operation of neural processors for character detection is presented. Such processors are designed based on cross correlation in the frequency domain between the input matrix and the weights of neural networks. This approach is developed to reduce the computation steps required by these faster neural networks for the searching process. The principle of divide and conquer strategy is applied through image decomposition. Each image is divided into small in size sub-images and then each one is tested separately by using a single faster neural processor. Furthermore, faster character detection is obtained by using parallel processing techniques to test the resulting sub-images at the same time using the same number of faster neural networks. In contrast to using only faster neural processors, the speed up ratio is increased with the size of the input image when using faster neural processors and image decomposition. Moreover, the problem of local subimage normalization in the frequency domain is solved. The effect of image normalization on the speed up ratio of character detection is discussed. Simulation results show that local subimage normalization through weight normalization is faster than subimage normalization in the spatial domain. The overall speed up ratio of the detection process is increased as the normalization of weights is done off line.

Keywords: Fast Character Detection, Neural Processors, Cross Correlation, Image Normalization, Parallel Processing.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1076974

References:

[1] R. Klette, and Zamperon, Handbook of image processing operators, John Wiley & Sonsltd, 1996.
[2] H. A. Rowley, S. Baluja, and T. Kanade, " Neural Network - Based Face Detection," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 20, No. 1, pp. 23-38, 1998.
[3] H. Schneiderman and T. Kanade, "Probabilistic modeling of local appearance and spatial relationships for object recognition, " In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 45-51, SantaBarbara, CA, 1998.
[4] R. Feraud, O. Bernier, J. E. Viallet, and M. Collobert, "A Fast and Accurate Face Detector for Indexation of Face Images," Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, Grenoble, France, 28-30 March, 2000.
[5] Y. Zhu, S. Schwartz, and M. Orchard, "Fast Face Detection Using Subspace Discriminate Wavelet Features," Proc. of IEEE Computer Society International Conference on Computer Vision and Pattern Recognition (CVPR'00), South Carolina, June 13 - 15, 2000, Vol.1, pp. 1636-1643.
[6] H. M. El-Bakry, "Automatic Human Face Recognition Using Modular Neural Networks," Machine Graphics & Vision Journal (MG&V), Vol. 10, No. 1, 2001, pp. 47-73.
[7] S. Srisuk and W. Kurutach, "A New Robust Face Detection in Color Images," Proc. of IEEE Computer Society International Conference on Automatic Face and Gesture Recognition, Washington D.C., USA, May 20-21, 2002, pp. 306-311.
[8] H. M. El-Bakry, "Face detection using fast neural networks and image decomposition," Neurocomputing Journal, Vol. 48, 2002, pp. 1039- 1046.
[9] H. M. El-Bakry, "Human Iris Detection Using Fast Cooperative Modular Neural Networks and Image Decomposition," Machine Graphics & Vision Journal (MG&V), Vol. 11, No. 4, 2002, pp. 498-512.
[10] Hazem M. El-Bakry, and Qiangfu Zhao, "Fast Object/Face Detection Using Neural Networks and Fast Fourier Transform," International Journal of Signal Processing, Vol.1, No.3, pp. 182-187, 2004.
[11] Hazem M. El-Bakry, and Qiangfu Zhao, "A Modified Cross Correlation in the Frequency Domain for Fast Pattern Detection Using Neural Networks," International Journal of Signal Processing, Vol.1, No.3, pp. 188-194, 2004.
[12] Hazem M. El-Bakry, and Qiangfu Zhao, "Face Detection Using Fast Neural Processors and Image Decomposition," International Journal of Computational Intelligence, Vol.1, No.4, pp. 313-316, 2004.
[13] Hazem M. El-Bakry, and Qiangfu Zhao, "Fast Complex Valued Time Delay Neural Networks," International Journal of Computational Intelligence, Vol.2, No.1, pp. 16-26, 2005.
[14] Hazem M. El-Bakry, and Qiangfu Zhao, "A Fast Neural Algorithm for Serial Code Detection in a Stream of Sequential Data," International Journal of Information Technology, Vol.2, No.1, pp. 71-90, 2005.
[15] H. M. El-Bakry, and Q. Zhao, "Speeding-up Normalized Neural Networks For Face/Object Detection," Machine Graphics & Vision Journal (MG&V), Vol. 14, No.1, 2005, pp. 29-59.
[16] H. M. El-Bakry, and Q. Zhao, "Fast Pattern Detection using Normalized Neural Networks and Cross Correlation in the Frequency Domain," EURASIP Journal on Applied Signal Processing,. Special Issue on Advances in Intelligent Vision Systems: Methods and ApplicationsÔÇö Part I, Vol. 2005, No. 13, 1 August 2005, pp. 2054-2060.
[17] S. Ben-Yacoub, B. Fasel, and J. Luettin, "Fast Face Detection using MLP and FFT," Proc. of the Second International Conference on Audio and Video-based Biometric Person Authentication (AVBPA'99), 1999.
[18] B. Fasel, "Fast Multi-Scale Face Detection," IDIAP-Com 98-04, 1998.
[19] S. Ben-Yacoub, "Fast Object Detection using MLP and FFT," IDIAP-RR 11, IDIAP, 1997.
[20] James W. Cooley and John W. Tukey, "An algorithm for the machine calculation of complex Fourier series," Math. Comput. 19, 297-301 (1965).
[21] J. P. Lewis, "Fast Normalized Cross Csorrelation", Available from:
[22] H. M. El-Bakry, "Comments on Using MLP and FFT for Fast Object/Face Detection," Proc. of IEEE IJCNN-03, Portland, Oregon, pp. 1284-1288, July, 20-24, 2003.
[23] H. M. El-Bakry, and H. Stoyan, "Fast Neural Networks for Object/Face Detection," Proc. of the 30th Anniversary SOFSEM Conference on Current Trends in Theory and Practice of Computer Science, 24-30 January, 2004, Hotel VZ MERIN, Czech Republic.
[24] H. M. El-Bakry, and H. Stoyan, "Fast Neural Networks for Sub-Matrix (Object/Face) Detection," Proc. of IEEE International Symposium on Circuits and Systems, Vancouver, Canada, 23-26 May, 2004.
[25] H. M. El-Bakry, "Fast Sub-Image Detection Using Neural Networks and Cross Correlation in Frequency Domain," Proc. of IS 2004: 14th Annual Canadian Conference on Intelligent Systems, Ottawa, Ontario, 6-8 June, 2004.
[26] H. M. El-Bakry, and H. Stoyan, "Fast Neural Networks for Code Detection in a Stream of Sequential Data," Proc. of CIC 2004 International Conference on Communications in Computing, Las Vegas, Nevada, USA, 21-24 June, 2004.
[27] H. M. El-Bakry, "Fast Neural Networks for Object/Face Detection," Proc. of 5th International Symposium on Soft Computing for Industry with Applications of Financial Engineering, June 28 - July 4, 2004, Sevilla, Andalucia, Spain.
[28] H. M. El-Bakry, and H. Stoyan, "A Fast Searching Algorithm for Sub- Image (Object/Face) Detection Using Neural Networks," Proc. of the 8th World Multi-Conference on Systemics, Cybernetics and Informatics, 18- 21 July, 2004, Orlando, USA.
[29] H. M. El-Bakry, and H. Stoyan, "Fast Neural Networks for Code Detection in Sequential Data Using Neural Networks for Communication Applications," Proc. of the First International Conference on Cybernetics and Information Technologies, Systems and Applications: CITSA 2004, 21-25 July, 2004. Orlando, Florida, USA, Vol. IV, pp. 150-153.
[30] H. M. El-bakry, M. A. Abo-elsoud, and M. S. Kamel, "Fast Modular Neural Networks for Human Face Detection," Proc. of IEEE-INNSENNS International Joint Conference on Neural Networks, Como, Italy, Vol. III, pp. 320-324, 24-27 July, 2000.
[31] H. M. El-bakry, "Fast Iris Detection using Cooperative Modular Neural Nets," Proc. of the 6th International Conference on Soft Computing, 1-4 Oct., 2000, Japan.
[32] H. M. El-Bakry, "Automatic Human Face Recognition Using Modular Neural Networks," Machine Graphics & Vision Journal (MG&V), Vol. 10, No. 1, 2001, pp. 47-73.
[33] H. M. El-bakry, "Fast Iris Detection Using Cooperative Modular Neural Networks," Proc. of the 5th International Conference on Artificial Neural Nets and Genetic Algorithms, pp. 201-204, 22-25 April, 2001, Prague, Czech Republic.
[34] H. M. El-bakry, "Fast Iris Detection Using Neural Nets," Proc. of the 14th Canadian Conference on Electrical and Computer Engineering, pp.1409-1415, 13-16 May, 2001, Canada.
[35] H. M. El-bakry, "Human Iris Detection Using Fast Cooperative Modular Neural Nets," Proc. of INNS-IEEE International Joint Conference on Neural Networks, pp. 577-582, 14-19 July, 2001, Washington, DC, USA.
[36] H. M. El-bakry, "Human Iris Detection for Information Security Using Fast Neural Nets," Proc. of the 5th World Multi-Conference on Systemics, Cybernetics and Informatics, 22-25 July, 2001, Orlando, Florida, USA.
[37] H. M. El-bakry, "Human Iris Detection for Personal Identification Using Fast Modular Neural Nets," Proc. of the 2001 International Conference on Mathematics and Engineering Techniques in Medicine and Biological Sciences, pp. 112-118, 25-28 July, 2001, Monte Carlo Resort, Las Vegas, Nevada, USA.
[38] H. M. El-bakry, "Human Face Detection Using Fast Neural Networks and Image Decomposition," Proc. the fifth International Conference on Knowledge-Based Intelligent Information & Engineering Systems, 6-8 September 2001, Osaka-kyoiku University, Kashiwara City, Japan, pp. 1330-1334.
[39] H. M. El-Bakry, "Fast Iris Detection for Personal Verification Using Modular Neural Networks," Proc. of the International Conference on Computational Intelligence, 1-3 Oct., 2001, Dortmund, Germany, pp.- 269-283.
[40] H. M. El-bakry, "Fast Cooperative Modular Neural Nets for Human Face Detection," Proc. of IEEE International Conference on Image Processing, 7-10 Oct., 2001, Thessaloniki, Greece.
[41] H. M. El-Bakry, "Fast Face Detection Using Neural Networks and Image Decomposition," Proc. of the 6th International Computer Science Conference, Active Media Technology, Dec. 18-20, 2001, Hong Kong - China, pp. 205-215, 2001.
[42] H. M. El-Bakry, "Face Detection Using Fast Neural Networks and Image Decomposition," Proc. of INNS-IEEE International Joint Conference on Neural Networks, 14-19 May, 2002, Honolulu, Hawaii, USA.