Video-Based Tracking of Laparoscopic Instruments Using an Orthogonal Webcams System

Authors: Fernando Pérez, Humberto Sossa, Rigoberto Martínez, Daniel Lorias, Arturo Minor

Abstract:

This paper presents a system for tracking the movement of laparoscopic instruments which is based on an orthogonal system of webcams and video image processing. The movements are captured with two webcams placed orthogonally inside of the physical trainer. On the image, the instruments were detected by using color markers placed on the distal tip of each instrument. The 3D position of the tip of the instrument within the work space was obtained by linear triangulation method. Preliminary results showed linearity and repeatability in the motion tracking with a resolution of 0.616 mm in each axis; the accuracy of the system showed a 3D instrument positioning error of 1.009 ± 0.101 mm. This tool is a portable and low-cost alternative to traditional tracking devices and a trustable method for the objective evaluation of the surgeon’s surgical skills.

Keywords: Laparoscopic Surgery, Orthogonal Vision, Tracking Instruments, Triangulation.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1086517

References:

[1] E. M. Ritter, D. J. Scott, “Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery,”. Surg Innov., vol. 14 pp. 107–112, 2007.
[2] M. C. Vassiliou, G. A. Ghitulescu, L. S. Feldman, D. Stanbridge, K. Lef-fondré, H. H. Sigman, G. M. Fried, “The MISTELS program to measure technical skills in laparoscopic surgery,” Surg Endosc, vol. 20, pp. 744–747, 2006.
[3] A. M. Martinez, D. L. Espinoza, “Novel laparoscopic home trainer,” Surg Laparosc Endosc Percutan Tech, vol. 17, pp. 300–302, 2007.
[4] A. M. Martinez, A. C. Kalach, D. L. Espinoza, “Millimetric laparoscopic surgery training on a physical trainer using rats,” Surg Endosc., vol. 22, pp. 246–249, 2008.
[5] A. Maciel, Y. Liu, W. Ahn, T. P. Singh, W De S. Dunnican, “Development of the VBLaST: a virtual basic laparoscopic skill trainer,” Int J Med Robot. vol. 4, pp. 131–8, 2008.
[6] K. R. Van Sickle, D. A. McClusky, A. G. Gallagher, C. D. Smith, “Construct validation of the ProMIS simulator using a novel laparoscopic suturing task,” Surg Endosc. vol. 19, pp. 1227–1231, 2005.
[7] B. F. Allen, F. Kasper, G. Nataneli, E. Dutson, P. Faloutsos, “Visual tracking of laparoscopic instruments in standard training environments,” Stud Health Technol Inform, vol. 163, pp. 11–17, 2011.
[8] I. Oropesa, P. Sánchez-González, M. K. Chmarra, P. Lamata, A. Fernández, J. A. Sánchez-Margallo, F. W. Jansen, J. Dankelman, F. M. Sánchez-Margallo, E. J. Gómez, “EVA: Laparoscopic Instrument Tracking Based on Endoscopic Video Analysis for Psychomotor Skills Assessment,” Surg Endosc, vol. 27, pp. 1029–39, 2013.
[9] Z. Y. Zhang, “A flexible new technique for camera calibration,” IEEE Transactions On Pattern Analysis and Machine Intelligence. vol. 22 Ed- 11, pp. 1330–1334, 2000.
[10] G. Q. Wei, K. Arbter, G. Hirzinger, “Automatic tracking of laparoscopic instruments by color coding,” Proceedings First Int. Joint Conf. CVRMed-MRCAS'97, Grenoble, France, Mrch 20–22, 1997, Springer Verlag: Lecture Notes in Computer Science, 1997.
[11] R. J. Prokop, A. P. Reeves, “A survey of moment-based techniques for unoccluded object representation and recognition,” CVGIP: Graphical Models and Image Processing, vol. 54, pp. 438–460, 1992.
[12] R. Van den Boomgard, R. Van Balen, “Methods for Fast Morphological Image Transforms Using Bitmapped Images,” CVGIP: Graphical Models and Image Processing, vol. 54, pp. 254–258, 1992.
[13] R. Hartley, R. Gupta, T. Chang, “Stereo from uncalibrated cameras,” in Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, pp. 761–764, 1992.
[14] S. Cotin, N. Stylopoulos, M. P. Ottensmeyer, P. Neumann, D. W. Rattner, S. L. Dawson, “Metrics for laparoscopic skills trainers: The weakest link!, ” In: T. Dohi and R. Kikinis (Eds.): MICCAI 2002. LNCS, vol. 2488, pp. 35–43. Springer, Heidelberg, 2002.