Multimodal Biometric System Based on Near- Infra-Red Dorsal Hand Geometry and Fingerprints for Single and Whole Hands

Authors: Mohamed K. Shahin, Ahmed M. Badawi, Mohamed E. M. Rasmy

Abstract:

Prior research evidenced that unimodal biometric systems have several tradeoffs like noisy data, intra-class variations, restricted degrees of freedom, non-universality, spoof attacks, and unacceptable error rates. In order for the biometric system to be more secure and to provide high performance accuracy, more than one form of biometrics are required. Hence, the need arise for multimodal biometrics using combinations of different biometric modalities. This paper introduces a multimodal biometric system (MMBS) based on fusion of whole dorsal hand geometry and fingerprints that acquires right and left (Rt/Lt) near-infra-red (NIR) dorsal hand geometry (HG) shape and (Rt/Lt) index and ring fingerprints (FP). Database of 100 volunteers were acquired using the designed prototype. The acquired images were found to have good quality for all features and patterns extraction to all modalities. HG features based on the hand shape anatomical landmarks were extracted. Robust and fast algorithms for FP minutia points feature extraction and matching were used. Feature vectors that belong to similar biometric traits were fused using feature fusion methodologies. Scores obtained from different biometric trait matchers were fused using the Min-Max transformation-based score fusion technique. Final normalized scores were merged using the sum of scores method to obtain a single decision about the personal identity based on multiple independent sources. High individuality of the fused traits and user acceptability of the designed system along with its experimental high performance biometric measures showed that this MMBS can be considered for med-high security levels biometric identification purposes.

Keywords: Unimodal, Multi-Modal, Biometric System, NIR Imaging, Dorsal Hand Geometry, Fingerprint, Whole Hands, Feature Extraction, Feature Fusion, Score Fusion

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1083669

References:

[1] S. Pankanti, S. Prabhakar, and A. K. Jain, "On the individuality of fingerprints," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, pp. 1010-1025, 2002.
[2] A. K. Jain, A. Ross, and S. Prabhakar, "An introduction to biometric recognition," IEEE Transactions on Circuits and Systems for Video Technology, Special Issue on Image- and Video-Based Biometrics, vol. 14, pp. 4-21, January 2004.
[3] M. Golfarelli, D. Maio, and D. Maltoni, "On the error-reject tradeoff in biometric verification systems," IEEE Trans. on Pattern Anal. and Mach. Intell., vol. 19, pp. 786-796, July 1997.
[4] A. Ross and A. K. Jain, "Multimodal biometrics: An overview," Proc. of 12th European Signal Processing Conference (EUSIPCO), Vienna, Austria, pp. 1221-1224, September 2004.
[5] J. Cui, J. P. Li, and X. J. Lu, "Study on multi-Biometric feature fusion and recognition model," Proc. of International Conference on Apperceiving Computing and Intelligence Analysis (ICACIA), Chengdu, China, pp. 66-69, 2009.
[6] A. K. Jain, "Biometric recognition: Overview and recent advances," Progress in Pattern Recognition, Image Analysis and Applications, pp. 13-19, 2007.
[7] D. Maltoni, D. Maio, A. K. Jain, and S. Prabhakar, "Handbook of fingerprint recognition," Springer-Verlag, 2003.
[8] V. M. Mane and D. V. Jadhav, "Review of multimodal biometrics: Applications, challenges and research areas," Int. Journal of Biometrics and Bioinformatics (IJBB), vol. 3, 2009.
[9] M. M. Monwar and M. L. Gavrilova, "Multimodal biometric system using rank-level fusion approach," IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics), vol. 39, pp. 867-878, 2009.
[10] A. Ross and A. K. Jain, "Information fusion in biometrics," Pattern Recognition Letters, vol. 24, pp. 2115-2125, Sep. 2003.
[11] A. Ross, K. Nandakumar, and A. K. Jain, "Handbook of multibiometrics," New York: Springer-Verlag, 2006.
[12] M. F. Zanuy, J. F. Aguilar, J. O. Garcia, and J. G. Rodriguez, "Multimodal biometric databases: An overview," Conference Report, IEEE 39th International Carnahan Conf. on Security Technology, Las Palmas de Gran Canary, Spain, October 2005.
[13] K. W. Bowyer, K. I. Chang, P. Yan, P. J. Flynn, E. Hansley, and S. Sarkar, "Multi-modal biometrics: An overview," 2nd Workshop on Multi-Modal User Authentication, France., 2006.
[14] A. K. Jain and A. Ross, "Fingerprint mosaicking," IEEE International Conference on Acoustics, Speech, and Signal Processing, Orlando, USA, vol. 4, pp. 4064-4067, 2002.
[15] T. Kinnunen, V. Hautamaki, and P. Franti, "Fusion of spectral feature sets for accurate speaker identification," Proc. of 9th Conf. Speech Comput., Russia, pp. 361-365, 2004.
[16] A. Kumar, D. C. M. Wong, H. C. Shen, and A. K. Jain, "Personal verification using palmprint and hand geometry biometric," in Audio- and Video-Based Biometric Person Authentication. vol. 2688, ed: Springer Berlin Heidelberg, 2003, pp. 668-678.
[17] A. Kumar and D. Zhang, "Combining fingerprint, palmprint and hand-shape for user authentication," Proc. of International Conference of Pattern Recognition (ICPR), pp. 549-552, 2006.
[18] A. Kumar and D. Zhang, "Personal recognition using hand shape and texture," IEEE Trans. on Image Processing, vol. 15, pp. 2454- 2461, August 2006.
[19] K. Nandakumar, A. K. Jain, and A. Ross, "Fusion in Multibiometric identification systems: What about the missing data?" Proc. of the 3rd IAPR/IEEE International Conference on Biometrics (ICB), Alghero, Italy, June 2009.
[20] K. Nandakumar, A. Ross, and A. K. Jain, "Incorporating ancillary information in multibiometric systems," Handbook of Biometrics. New York: Springer-Verlag, pp. 335-355, 2007.
[21] N. Poh and S. Bengio, "How do correlation and variance of baseexperts affect fusion in biometric authentication tasks?," IEEE Transactions on Signal Processing, vol. 53, pp. 4384-4396, 2005.
[22] S. Ribaric and I. Fratric, "Experimental evaluation of matchingscore normalization techniques on different multimodal biometric systems," IEEE MELECON, Malaga, Spain, 2006.
[23] A. Ross and R. Govindarajan, "Feature level fusion using hand and face biometrics," Proc. of SPIE Conference on Biometric Technology for Human Identification II, Orlando, USA, vol. 5779, pp. 196-204, 2005.
[24] R. K. Rowe, U. Uludag, M. Demirkus, S. Parthasaradhi, and A. K. Jain, "A multispectral whole-hand biometric authentication system," Proc. of Biometric Symposium, Biometric Consortium Conference, Baltimore, September 2007.
[25] B. Schouten and B. Jacobs, "Biometrics and their use in epassports," Image and Vision Computing, vol. 27, pp. 305-312, February 2009.
[26] M. K. Shahin, A. M. Badawi, and M. E. Rasmy, "A multimodal hand vein, hand geometry, and fingerprint prototype design for high security biometrics," Proc. of 4th IEEE Cairo Int. Biomedical Engineering Conf. (CIBEC2008), Egypt, Dec. 2008.
[27] T. Sim, S. Zhang, R. Janakiraman, and S. Kumar, "Continuous verification using multimodal biometrics," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, pp. 687-700, 2007.
[28] R. Snelick, U. Uludag, A. Mink, M. Indovina, and A. K. Jain, "Large-scale evaluation of multimodal biometric authentication using state-of-the-art systems," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, pp. 450-455, 2005.
[29] K. A. Toh, "Error-rate based biometrics fusion," S.W. Lee and S.Z. Li (Eds): ICB 2007, LNCS, Springer-Verlag Berlin/Heidelberg, vol. 4642, pp. 191-200, 2007.
[30] X. Y. Wei, D. Xu, and C. W. Ngo, "Multibiometrics based on palmprint and hand geometry," Proc. of 4th International Conf. on Computer and Information Science (ICIS-05), 2005.
[31] X. Wu, K. Wang, F. Zhang, and D. Zhang, "Fusion of phase and orientation information for palmprint authentication," Proc. of Int. Conf. on Image Processing (ICIP), September 2005.
[32] L. Q. Zhu and S. Y. Zhang, "Multimodal biometric identification system based on finger geometry, knuckle print, and palm print," Pattern Recog. Letters, On-Line, June 2010.
[33] J. Ortega-Garcia, J. Fierrez-Aguilar, D. Simon, J. Gonzalez- Rodriguez, M. Faundez, V. Espinosa, A. Satue, I. Hernaez, J. J. Igarza, C. Vivaracho, D. Escudero, and Q. I. Moro, "MCYT baseline corpus: A bimodal biometric database," IEE Proc. on Vision, Image and Signal Proc., Special Issue on Biometrics on the Internet, vol. 150, pp. 395-401, December, 2003.
[34] M. K. Shahin, A. M. Badawi, and M. S. Kamel, "Biometric authentication using fast correlation of hand vein patterns," Proc. of 3rd IEEE Cairo International Biomedical Engineering Conference (CIBEC06), Cairo, Egypt, December 2006.
[35] M. K. Shahin, A. M. Badawi, and M. S. Kamel, "Biometric authentication using fast correlation of near infrared hand vein patterns," International Journal of Biological and Life Sciences, vol. 2, pp. 141-148, 2007.
[36] J. Egan, "Signal detection theory and ROC analysis," Academic Press, New York, 1975.
[37] http://www.securityfocus.com/news/6717, Accessed June 2006.
[38] H. Chen, H. Valizadegan, C. Jackson, S. Soltysiak, and A. K. Jain, "Fake hands: Spoofing hand geometry systems," Biometric Consortium, Washington DC, September 2005.
[39] N. Abd-El-Rahman, "A prototype of automatic hand geometry verification system," Master Thesis, Cairo University, Faculty of Engineering, Systems and Biomedical Dept., 2002.
[40] M. K. Shahin, A. M. Badawi, and M. S. kamel, "On-line, low-cost and PC-based fingerprint verification system based on solid-state capacitance sensor," Proc. of IEEE International Conference on Industrial Electronics, Technology and Automation (IETA2001),Cairo Egypt, December 2001.
[41] http://www.veridicom.com/, Accessed January 2005.
[42] http://www.elexol.com/, Accessed April 2006.
[43] A. Badawi and M. Kamel, "Freestyle hand geometry verification system," Proc. of 46th IEEE Midwest Symposium on circuits and systems, 2003.
[44] A. M. Badawi, S. A. El-Naggar, and M. S. Kamel, "Freestyle nonguided true-anatomical biometrics: A fusion of hand geometry and texture features," Proc. of 3rd IEEE Cairo Int. Biomedical Engineering Conf. (CIBEC2006), Cairo, Eygpt, December 2006.
[45] S. El-Naggar, "Freestyle hand biometric system based on geometry and texture features," Master Thesis, Cairo Univ., Faculty of Engineering, Systems and Biomedical Dept., 2005.
[46] A. M. Badawi and M. K. Shahin, "Frequency domain spectral hand vein patterns authentication," Proc. of 3rd IEEE Cairo Int. Biomedical Engineering Conf. (CIBEC2006), Egypt, December 2006.
[47] M. K. Shahin, "Hand vein based biometric verification system," Master Thesis, Cairo University, Faculty of Engineering, Systems and Biomedical Dept., 2005.
[48] S. Chikkerur, "Online fingerprint verification system," Master Thesis, the State University of New York at Buffalo, 2005.
[49] C. I. Watson, M. D. Garris, E. Tabassi, C. L. Wilson, R. M. McCabe, S. Janet, and K. Ko, "User's guide to NIST biometric image software (NBIS)," Technical Report National Institute of Standards and Technology, 2008.
[50] S. Chikkerur, A. N. Cartwright, and V. Govindaraju, "K-plet and coupled BFS: A graph based fingerprint representation and matching algorithm," International Conference on Biometrics (ICB), pp. 309-315, 2006.
[51] A. K. Jain, A. Ross, and S. Pankanti, "A prototype Hand geometrybased verification system," Proc. of 2nd International Conference on Audio- and Video-based Biometric Person Authentication, Washington D.C., pp. 166-171, March 1999.
[52] "The Facial Recognition Technology (FERET) Database," http://www.itl.nist.gov/iad/humanid/feret/feret_master.html, 2004.