Color View Synthesis for Animated Depth Security X-ray Imaging

Authors: O. Abusaeeda, J. P. O Evans, D. Downes

Abstract:

We demonstrate the synthesis of intermediary views within a sequence of color encoded, materials discriminating, X-ray images that exhibit animated depth in a visual display. During the image acquisition process, the requirement for a linear X-ray detector array is replaced by synthetic image. Scale Invariant Feature Transform, SIFT, in combination with material segmented morphing is employed to produce synthetic imagery. A quantitative analysis of the feature matching performance of the SIFT is presented along with a comparative study of the synthetic imagery. We show that the total number of matches produced by SIFT reduces as the angular separation between the generating views increases. This effect is accompanied by an increase in the total number of synthetic pixel errors. The trends observed are obtained from 15 different luggage items. This programme of research is in collaboration with the UK Home Office and the US Dept. of Homeland Security.

Keywords: X-ray, kinetic depth, view synthesis, KDE

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1078713

References:

[1] J.P.O. Evans, "Stereoscopic imaging using folded linear dual-energy X-ray detectors," Institute of Physics (IOP) Journal Meas. Sc. & Tech, vol. 13, no. 9, pp. 1388-1397, 2002.
[2] J.P.O. Evans, M. Robinson, and S.X. Godber, "A new stereoscopic X-ray imaging technique using a single X-ray source: theoretical analysis," Non-Destructive Testing and Evaluation Int. (NDT&E), vol. 29, no. 1, pp. 27-35, 1996.
[3] J.P.O. Evans, and M. Robinson, "Design of a stereoscopic X-ray imaging system using a single X-ray source," Non-Destructive Testing and Evaluation Int. (NDT&E), vol. 33, no. 5, pp. 325-332, 2000.
[4] J.P.O. Evans and H. W. Hon, "Dynamic stereoscopic X-ray imaging," J. of NDT&E, vol. 35, no. 5, pp. 337-345, 2002.
[5] J.P.O. Evans, Y. Liu and J. W. Chan, "Depth from motion 3D X-ray imaging for security screening," in IEE ICDP, pp. 5-8, 2005.
[6] J.P.O. Evans, Y. Liu, J. W. Chan, and D. Downes, "View synthesis for depth from motion 3D X-ray imaging," Pattern Recognit. Lett, vol. 27, no. 15, pp. 1863-1873, 2006.
[7] D.G. Lowe, "Distinctive image features from scale-invariant keypoints," International Journal of Computer Vision, vol. 60, no. 2, pp. 91-110, 2004.
[8] H. Moravec, "Rover visual obstacle avoidance," International Joint Conference on Artificial Intelligence Vancouver, Canada, pp. 785-790, 1981.
[9] C. Harris, "Geometry from visual motion," Active vision, MIT Press, pp. 263- 284, 1993.
[10] Z. Zhang, R. Deriche, O.Faugeras, and Q.T. Luong, "A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry," Artificial Intelligence, vol. 78, no 1-2, pp. 87-119, 1995.
[11] K. Mikolajczyk, and C. Schmid, "An affine invariant interest point detector," European Conference on Computer Vision, pp. 128-142, 2002.
[12] M. Brown, and D.G. Lowe, "Invariant features from interest point groups," British Machine Vision Conference, Cardiff, Wales, Citeseer, pp. 656-665, 2002.
[13] Y. Ke, and R. Sukthankar, "PCA-SIFT: A more distinctive representation for local image descriptors," Conference on Computer Vision and Pattern Recognition, Washington, USA, pp. 511-517, 2004.
[14] L. Juan, and O. Gwon, "A Comparison of SIFT, PCA-SIFT and SURF," International Journal of Image Processing (IJIP), vol. 3, no. 4, pp. 143-152, 2009.
[15] H. Bay, T. Tuytelaars, and L. Van Gool, "Speeded-up robust features (SURF)," Computer Vision and Image Understanding, vol. 110, no. 3, pp. 346-359, 2008.
[16] Z. Feng, B.Yang, Y.Chen, Y. Zheng, and T. Xu, "Features extraction from hand images based on new detection operators," Pattern Recognition, vol. 44, no. 5, pp. 1089-1105, 2010.
[17] J. W. Chan O. Abusaeeda, J.P.O. Evans, D. Downes, X. Wang and L.Yong, "Feasibility of SIFT to Synthesise KDEX Imagery for Aviation Luggage Security Screening," IET The Crime and Security Conference: Imaging for Crime Detection and Prevention, ISBN 978-1-84919-207-1, 2009.
[18] S. Seitz, and C. Dyer, "View morphing," the 23rd annual conference on Computer graphics and interactive techniques ACM SIGGRAPH, pp. 21-30 1996.
[19] E. Shechtman, A. Rav-Acha, M. Irani, and S.M. Seitz, "Regenerative morphing," IEEE computer society conferene on Computer Vision and Pattern Recognition, San Francisco, CA, USA, pp. 1-8, 2010.
[20] B. Zitova, and J. Flusser, "Image registration methods: a survey," Image Vision Comput, vol. 21, no. 11, pp. 977-1000, 2003.
[21] C.A.Glasbey, and K.V. Mardia, "A review of image-warping methods," Journal of applied statistics, vol. 25, no. 2, pp. 155-172, 1998.
[22] G. Wolberg, "Image morphing: a survey," The Visual Computer, vol. 14, no. 8, pp. 360-372, 1998.
[23] Z. Zhang, L. Wang, B. Guo, and H.Y. Shum, "Feature-based light field morphing," ACM Transactions on Graphics, vol. 21, no. 3, pp. 457-464, 2002.
[24] R. Manning, and C. Dyer, "Interpolating view and scene motion by dynamic view morphing," Proc. CVPR, pp. 388-394, 1999.
[25] J.P.O. Evans, Y. Liu and J. W. Chan, "Depth from motion 3D X-ray imaging for security screening," Conference, in IEE ICDP, pp. 5-8, 2005.
[26] Wang T. W. and Evans J. P. O., "Stereoscopic dual-energy x-ray imaging for target materials identification", Conference, in IEE Proceedings Vision Image Processing, Vol. 150, no. 2, pp. 122-130, April 2003.
[27] J. Gomes, L. Darsa, B. Costa, and L. Velho, "Warping and Morphing of Graphical Objects," Morgan Kaufmann, San Francisco, Calif., (1998).
[28] Z. Zhang, L. Wang, B. Guo, and H.Y. Shum, "Feature-based light field morphing," ACM Transactions on Graphics,Vol. 21, no. 3, pp. 457-464, 2002.