Design and Application of Surgical Navigation System Based on Visual Technology

doi:10.16182/j.issn1004731x.joss.201709020

Abstract

Abstract: A navigation system based on vision was designed to solve the problem of using complex equipment to assist the real-time tracking of surgical instruments because of low registration of 3D in the existing surgical navigation system. Face point cloud was reconstructed in the patient's space by using the sinusoidal structured light; From rough to precise registration, patient space and model space were made by using facial feature; The three dimensional coordinates of the marker points on surgical instruments was restored by using continuous corner detection algorithm, binocular stereo vision principle and Kalman filter algorithm to obtain accurate position of surgical instruments. The experiments show that the surgical navigation system based on vision can achieve the requirements of accurate, stable, real-time tracking of surgical instruments.

Key words: surgical navigation system, space registration, sinusoidal structured light, Kalman filter

CLC Number:

TP391

Lan Kun, Zhang Yan, Shen Xukun. Design and Application of Surgical Navigation System Based on Visual Technology[J]. Journal of System Simulation, 2017, 29(9): 2025-2035.

References

[1] Chen D, Tan J, Chaudhary V, et al.Automatic fiducial localization in brain images[J]. International Journal of Computer Assisted Radiology and Surgery (S1861-6410), 2006, 1(6): 45-47.
[2] Wang M Y, Maurer Jr C R, Fitzpatrick J M, et al. An automatic technique for finding and localizing externally attached markers in CT and MR volume images of the head[J]. Biomedical Engineering (S0018-9294), IEEE Transactions on, 1996, 43(6): 627-637.
[3] Nakamoto M, Sato Y, Miyamoto M, et al.3D ultrasound system using a magneto-optic hybrid tracker for augmented reality visualization in laparoscopic liver surgery[M]// Medical Image Computing and Computer-Assisted Intervention—MICCAI 2002. Germany: Springer Berlin Heidelberg, 2002, 2489: 148-155.
[4] 陈晓冬, 杜承阳, 朱晓田. 一种用于介入式内窥手术的多传感融合定位方法[J]. 中国激光, 2014, 41(12): 1-5.
(Chen Xiaodong, Du Chengyang, Zhu Xiaotian, et al.A sensing-fusion tracking method for inversion endoscope surgery[J]. Chinese J. Lasers, 2014, 41(12): 1-5.)
[5] Ren H, Kazanzides P.Investigation of attitude tracking using an integrated inertial and magnetic navigation system for handheld surgical instruments[J]. Mechatronics (S0957-4158), IEEE/ASME Transactions on, 2012, 17(2): 210-217.
[6] Stoll J, Ren H, Dupont P E.Passive markers for tracking surgical instruments in real-time 3-D ultrasound imaging[J]. Medical Imaging (S0278-0062), IEEE Transactions on, 2012, 31(3): 563-575.
[7] Yamaguchi I, Zhang T.Phase-shifting digital holography[J]. Optics letters (S0146-9592), 1997, 22(16): 1268-1270.
[8] J M Huntley, H O Saldner.Temporal phase-unwrapping algorithm for automated interferogram analysis[J]. Applied Optics (S1559-128X), 1993, 32(17): 3047-3052.
[9] 马颂德, 张正友. 计算机视觉: 计算理论与算法基础[M]. 北京: 科学出版社, 1998.
(Ma Songde, Zhang Zhengyou.Computer Vision: Computational Theory and Algorithm Basis [M]. Beijing, China: Science Press, 1998.
[10] 张宏. 基于双目立体视觉的三维重建技术研究 [D]. 武汉: 华中科技大学, 2007.
(Zhang Hong.Research on 3D Reconstruction Technology Based on Binocular Stereo Vision [D]. Wuhan, China: Huazhong University of Science and Technology, 2007.)
[11] Trajkovic M, Hedley M.Fast corner detection[J]. Image and Vision Computing (S0262-8856), 1998, 16(2): 75-87.
[12] Harris C, Stephens M.A combined corner and edge detector[C]// Proceedings of the 4th Alvey Vision Conference. Manchester, UK, UK: 1988: 147-151.
[13] 高纯玲. 基于双目立体视觉的手术器械跟踪定位研究[D]. 武汉: 华中科技大学, 2008.
(Gao Chunling.Research on Tracking and Positioning of Surgical Instruments Based on Binocular Stereo Vision [D]. Wuhan, China: Huazhong University of Science and Technology, 2008.)
[14] Gary Bradski, Adrian Kaehler.学习OpenCV(中文版) [M]. 于仕琪, 刘瑞祯. 北京: 清华大学出版社, 2009: 452-457.
(Gary Bradski, Adrian Kaehler.Learning OpenCV: Computer Vision with the OpenCV Library [M]. Yu Shiqi, Liu Ruizhen. Beijing, China: Tsinghua University Press, 2009: 452-457.
[15] 臧晓蕾, 齐国清. 基于卡尔曼滤波器的船用雷达运动目标跟踪算法研究及性能分析 [D]. 大连: 大连海事大学, 2011.
(Zang Xiaolei, Qi Guoqing.Performance Analysis on Tracking Algorithm of Marine Radar Moving Target Based on Kalman Filter [D]. Dalian, China: Dalian Maritime University, 2011.)