Smart Side View Mirror Camera for Real Time System

Authors: Nunziata Ivana Guarneri, Arcangelo Bruna, Giuseppe Spampinato, Antonio Buemi

Abstract:

In the last decade, automotive companies have invested a lot in terms of innovation about many aspects regarding the automatic driver assistance systems. One innovation regards the usage of a smart camera placed on the car’s side mirror for monitoring the back and lateral road situation. A common road scenario is the overtaking of the preceding car and, in this case, a brief distraction or a loss of concentration can lead the driver to undertake this action, even if there is an already overtaking vehicle, leading to serious accidents. A valid support for a secure drive can be a smart camera system, which is able to automatically analyze the road scenario and consequentially to warn the driver when another vehicle is overtaking. This paper describes a method for monitoring the side view of a vehicle by using camera optical flow motion vectors. The proposed solution detects the presence of incoming vehicles, assesses their distance from the host car, and warns the driver through different levels of alert according to the estimated distance. Due to the low complexity and computational cost, the proposed system ensures real time performances.

Keywords: Camera calibration, ego motion, kalman filters, object tracking, real time systems.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1317314

References:

[1] Ismail, M. B., Muqeet, M. A., Malik, M. F. and Khan, A. K. 2014. "Intersection Cross Traffic Warning System for Vehicle Collision Avoidance”. In International Journal of Advanced Research in Electrical, Electronics and Instrumentation Engineering (Vol. 3, Issue 11, November 2014).
[2] Aung, T. and Zaw, M. H. 2014.” Video Based Lane Departure Warning System”. In International Conference on Advances in Engineering and Technology, Singapore, March 29-30, 2014.
[3] Zhou, Y., Xu, R., Hu, X. F. and Ye, Q. T. 2008. “A Lane Departure Warning System Based on Virtual Lane Boundary”. In Journal of Information Science and Engineering (24, 293-305, 2008).
[4] Ramesh, S., Ranjan, R., Mukherjee, R. and Chaudhuri, S. 2012. “Vehicle Collision Avoidance System Using Wireless Sensor Networks”. In International Journal of Soft Computing and Engineering. (2231-2307, Volume-2, Issue-5, November 2012).
[5] Choudhary, A., Moon, Y. and Nawkhare, R. 2015. “Design and Implementation of Wireless Security System in Vehicle”. In International Journal of Innovative Research in Computer and Communication Engineering. (Vol. 3, Issue 7, July 2015).
[6] Hafner, M. R., Cunningham, D., Caminiti, L. and Del Vecchio, D. 2011. “Automated Vehicle-to-Vehicle Collision Avoidance at Intersections”. In Proc. of ITS World Congress.
[7] Sotelo, M. A., Barriga, J., Fernández, D., Parra, I., Naranjo, J. E., Marrón, M. and Gavilán, M. 2007. “Vision-based Blind Spot Detection using Optical Flow”. In EUROCAST 2007 (vol. 4739, pp. 1113–1118. Springer, Heidelberg 2007).
[8] Wu, B. F., Kao, C. C., Li, Y. F. and Tsai, M. Y. 2012. “A Real-Time Embedded Blind Spot Safety Assistance System”. In International Journal of Vehicular Technology (Volume 2012, Article ID 506235, 15 pages). doi: http://doi.acm.org/10.1155/2012/506235.
[9] Scharfenberger, C., Chakraborty, S. and Farber, G.2012. “Robust image processing for an omnidirectional camera-based smart car door”. In ACM Transactions on Embedded Computing Systems (New York, USA, December, 2012). Volume 11 Issue 4, Article No. 87. doi= http://doi.acm.org/ 10.1145/2362336.2362354.
[10] Gandhi, T. and Trivedi, M. M. 2004. “Motion Based Vehicle Surround Analysis Using an Omni-Directional Camera”. In IEEE Intelligent Vehicles Symposium (Parma, Italy, June 14-17, 2004).
[11] Paulo, C. and Correia, P. 2003. “Automatic detection and classification of traffic signs”. Proc. 8th Int. Workshop Image Anal. Multimedia Interactive Services (Santorini, 6-8 June, 2007), doi=http://dx.doi.org/10.1109/WIAMIS.2007.24.
[12] Gavrila, D. M. and Munder, D. M. 2003. “Multi-cue Pedestrian Detection and Tracking from a Moving Vehicle”. In International Journal of Computer (73(1), 41–59, 2007) doi= http://doi.acm.org/ 10.1007/s11263-006-9038-7.
[13] Sivakumar, R. and Mangalam, H. 2014.” RADAR Based Vehicle Collision Avoidance System used in Four Wheeler”. In International Journal of Scientific & Engineering Research (International Journal of Scientific & Engineering Research).
[14] Händel, P., Yao, Y., Unkuri, N. and Skog, I. 2009. “Far Infrared Camera Platform and Experiments for Moose Early Warning”. In JSAE Trans, (vol. 40, no. 1, 2009).
[15] Saboune, J., Arezoomand, M., Martel, L. and Laganiere, R. “A Visual Blind-spot Monitoring System for Safe Lane Changes”. In Image Analysis and Processing – ICIAP, 2011. (2011, pp. 1-10. s).
[16] Din-Chang Tseng, Member, IACSIT, Chang-Tao Hsu, and Wei-Shen Chen. “Blind-Spot Vehicle Detection Using Motion and Static”. In International Journal of Machine Learning and Computing (Vol. 4, No. 6, December 2014).
[17] Chen, C.-T.and Chen, Y.-S. “Real-time approaching vehicle detection in blind-spot area”. In 12th International IEEE Conference on Intelligent Transportation Systems. (pp. 1-6, 2009).
[18] Garcia, F., Cerri, P., Broggi, A., de laEscalera, A. and Armingo, J. M. Data Fusion for Overtaking Vehicle Detection based on Radar and Optical Flow. In Intelligent Vehicles Symposium. (Alcalá de Henares, Spain, June 3-7, 2012).
[19] Xiqun, L. 2012. “A New Efficient Vanishing Point Detection From A Single Image”. In IEEE International Conference on Acoustics, Speech and Signal Processing, (25-30 March, pp. 901-904, 2012).
[20] Kong, H., Audibert, J.-Y.and Ponce, J. 2009. ”Vanishing point detection for road detection”. In CVPR, (pp. 96–103 2009).
[21] DE102014209137 “Method and Apparatus for Calibrating a Camera System in a Motor Vehicle” 2015.
[22] US5777690 A “Device and Method for Detection of Moving Obstacles” 1998.
[23] Spampinato, G., Bruna, A., Curti, S. and D’Alto, V. “Advanced Low Cost Clustering System”. In 6th International Conference on Image Processing Theory, Tools and Applications (IPTA) 2016.