一种基于视觉的手术导航系统设计与实现

doi:10.16182/j.issn1004731x.joss.201709020

系统仿真学报 ›› 2017, Vol. 29 ›› Issue (9): 2025-2035.doi: 10.16182/j.issn1004731x.joss.201709020

一种基于视觉的手术导航系统设计与实现

兰坤^1,2, 张岩², 沈旭昆²

1.长治医学院,长治 046000;
2.北京航空航天大学虚拟现实技术与系统国家重点实验室,北京 100191

收稿日期:2017-05-11 发布日期:2020-06-02
作者简介:兰坤(1977-),女,山西,硕士,副教授,研究方向为医用计算机技术;张岩(1990-),男,山西,硕士,研究方向为虚拟现实。
基金资助:
国家863计划 (2013AA013803)

Design and Application of Surgical Navigation System Based on Visual Technology

Lan Kun^1,2, Zhang Yan², Shen Xukun²

1. Changzhi Medical College, Changzhi 046000, China;
2. The State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, China

Received:2017-05-11 Published:2020-06-02

摘要/Abstract

摘要： 针对现有手术导航系统中存在不同三维空间注册精度低、需要额外复杂设备辅助完成手术器械实时跟踪的问题,设计并实现一种基于视觉的手术导航系统。利用正弦结构光重建病人空间面部点云;利用人脸面部特征进行病人空间与模型空间由粗到精的空间注册;利用分步角点检测算法和双目立体视觉原理恢复手术器械上标记点的三维坐标,并利用卡尔曼滤波获取手术器械精确的位置与姿态。实验表明,基于视觉的手术导航系统能够实现准确、稳定、实时的手术器械跟踪要求。

关键词: 手术导航系统, 空间注册, 正弦结构光, 卡尔曼滤波

Abstract: A navigation system based on vision was designed to solve the problem of using complex equipment to assist the real-time tracking of surgical instruments because of low registration of 3D in the existing surgical navigation system. Face point cloud was reconstructed in the patient's space by using the sinusoidal structured light; From rough to precise registration, patient space and model space were made by using facial feature; The three dimensional coordinates of the marker points on surgical instruments was restored by using continuous corner detection algorithm, binocular stereo vision principle and Kalman filter algorithm to obtain accurate position of surgical instruments. The experiments show that the surgical navigation system based on vision can achieve the requirements of accurate, stable, real-time tracking of surgical instruments.

Key words: surgical navigation system, space registration, sinusoidal structured light, Kalman filter

中图分类号:

TP391

兰坤, 张岩, 沈旭昆. 一种基于视觉的手术导航系统设计与实现[J]. 系统仿真学报, 2017, 29(9): 2025-2035.

Lan Kun, Zhang Yan, Shen Xukun. Design and Application of Surgical Navigation System Based on Visual Technology[J]. Journal of System Simulation, 2017, 29(9): 2025-2035.

参考文献

[1] Chen D, Tan J, Chaudhary V, et al.Automatic fiducial localization in brain images[J]. International Journal of Computer Assisted Radiology and Surgery (S1861-6410), 2006, 1(6): 45-47.
[2] Wang M Y, Maurer Jr C R, Fitzpatrick J M, et al. An automatic technique for finding and localizing externally attached markers in CT and MR volume images of the head[J]. Biomedical Engineering (S0018-9294), IEEE Transactions on, 1996, 43(6): 627-637.
[3] Nakamoto M, Sato Y, Miyamoto M, et al.3D ultrasound system using a magneto-optic hybrid tracker for augmented reality visualization in laparoscopic liver surgery[M]// Medical Image Computing and Computer-Assisted Intervention—MICCAI 2002. Germany: Springer Berlin Heidelberg, 2002, 2489: 148-155.
[4] 陈晓冬, 杜承阳, 朱晓田. 一种用于介入式内窥手术的多传感融合定位方法[J]. 中国激光, 2014, 41(12): 1-5.
(Chen Xiaodong, Du Chengyang, Zhu Xiaotian, et al.A sensing-fusion tracking method for inversion endoscope surgery[J]. Chinese J. Lasers, 2014, 41(12): 1-5.)
[5] Ren H, Kazanzides P.Investigation of attitude tracking using an integrated inertial and magnetic navigation system for handheld surgical instruments[J]. Mechatronics (S0957-4158), IEEE/ASME Transactions on, 2012, 17(2): 210-217.
[6] Stoll J, Ren H, Dupont P E.Passive markers for tracking surgical instruments in real-time 3-D ultrasound imaging[J]. Medical Imaging (S0278-0062), IEEE Transactions on, 2012, 31(3): 563-575.
[7] Yamaguchi I, Zhang T.Phase-shifting digital holography[J]. Optics letters (S0146-9592), 1997, 22(16): 1268-1270.
[8] J M Huntley, H O Saldner.Temporal phase-unwrapping algorithm for automated interferogram analysis[J]. Applied Optics (S1559-128X), 1993, 32(17): 3047-3052.
[9] 马颂德, 张正友. 计算机视觉: 计算理论与算法基础[M]. 北京: 科学出版社, 1998.
(Ma Songde, Zhang Zhengyou.Computer Vision: Computational Theory and Algorithm Basis [M]. Beijing, China: Science Press, 1998.
[10] 张宏. 基于双目立体视觉的三维重建技术研究 [D]. 武汉: 华中科技大学, 2007.
(Zhang Hong.Research on 3D Reconstruction Technology Based on Binocular Stereo Vision [D]. Wuhan, China: Huazhong University of Science and Technology, 2007.)
[11] Trajkovic M, Hedley M.Fast corner detection[J]. Image and Vision Computing (S0262-8856), 1998, 16(2): 75-87.
[12] Harris C, Stephens M.A combined corner and edge detector[C]// Proceedings of the 4th Alvey Vision Conference. Manchester, UK, UK: 1988: 147-151.
[13] 高纯玲. 基于双目立体视觉的手术器械跟踪定位研究[D]. 武汉: 华中科技大学, 2008.
(Gao Chunling.Research on Tracking and Positioning of Surgical Instruments Based on Binocular Stereo Vision [D]. Wuhan, China: Huazhong University of Science and Technology, 2008.)
[14] Gary Bradski, Adrian Kaehler.学习OpenCV(中文版) [M]. 于仕琪, 刘瑞祯. 北京: 清华大学出版社, 2009: 452-457.
(Gary Bradski, Adrian Kaehler.Learning OpenCV: Computer Vision with the OpenCV Library [M]. Yu Shiqi, Liu Ruizhen. Beijing, China: Tsinghua University Press, 2009: 452-457.
[15] 臧晓蕾, 齐国清. 基于卡尔曼滤波器的船用雷达运动目标跟踪算法研究及性能分析 [D]. 大连: 大连海事大学, 2011.
(Zang Xiaolei, Qi Guoqing.Performance Analysis on Tracking Algorithm of Marine Radar Moving Target Based on Kalman Filter [D]. Dalian, China: Dalian Maritime University, 2011.)

一种基于视觉的手术导航系统设计与实现

Design and Application of Surgical Navigation System Based on Visual Technology

PDF (PC)

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	王志伟, 胡继宗, 王风杰, 黄杰. 基于非线性观测器的导航过程仿真研究[J]. 系统仿真学报, 2022, 34(5): 1127-1139.
[2]	马立新, 朱勇杰, 季乐延. 神经网络优化的无感永磁同步电机控制系统[J]. 系统仿真学报, 2021, 33(3): 622-630.
[3]	王一静, 苏中, 李擎, 李磊. 地下空间单兵定位零速修正算法仿真研究[J]. 系统仿真学报, 2021, 33(11): 2545-2551.
[4]	王可, 刘立刚, 周斌, 卜智勇. 基于SINS/GNSS/轮速的列车组合导航算法研究[J]. 系统仿真学报, 2021, 33(1): 189-195.
[5]	李琪, 王向东, 李华. 基于双Kinect传感器的三维人体姿态跟踪方法[J]. 系统仿真学报, 2020, 32(8): 1446-1454.
[6]	翟志强, 许进亮, 袁皓, 周永明, 赵龙飞, 王世谦. 自适应巡航系统车辆跟驰控制策略仿真[J]. 系统仿真学报, 2020, 32(5): 885-891.
[7]	张良, 郝凯锋. 基于RSSI变化序列的MAC地址与目标匹配方法[J]. 系统仿真学报, 2020, 32(1): 113-121.
[8]	杨洋, 李擎. UWB与SINS融合的行人导航方法[J]. 系统仿真学报, 2019, 31(12): 2636-2642.
[9]	王海璐, 苏中, 刘宁, 刘洪, 付国栋. 双天线GNSS辅助MINS导航方法研究[J]. 系统仿真学报, 2019, 31(11): 2434-2441.
[10]	沈笑云, 申金星, 张思远, 焦卫东. 基于混合滤波的ADS-B实时监视漏点处理[J]. 系统仿真学报, 2018, 30(9): 3457-3463.
[11]	林浩申, 杨晓君, 何兵. 空间目标模糊平方根容积卡尔曼滤波定位算法[J]. 系统仿真学报, 2018, 30(4): 1361-1368.
[12]	咸云浩, 张恒德, 谢永华, 杨乐. 多元逐步回归与卡尔曼滤波法在霾预报中应用[J]. 系统仿真学报, 2018, 30(4): 1482-1489.
[13]	李大中, 邬峰. 一种风电机组非奇异快速终端滑模MPPT控制方法[J]. 系统仿真学报, 2018, 30(3): 1109-1117.
[14]	朱军, 李香君, 付融冰, 吴宇航, 田淼. 双重遗忘卡尔曼滤波PMLSM无位置传感控制研究[J]. 系统仿真学报, 2018, 30(2): 672-678.
[15]	谷志丹, 李擎, 赵辉. 行人自主导航定位的多级滤波方法[J]. 系统仿真学报, 2018, 30(12): 4727-4732.