基于相机标定的全景图拼接方法研究

doi:10.16182/j.issn1004731x.joss.201705024

系统仿真学报 ›› 2017, Vol. 29 ›› Issue (5): 1112-1119.doi: 10.16182/j.issn1004731x.joss.201705024

基于相机标定的全景图拼接方法研究

马嘉琳¹, 张锦明^1,2,*, 孙卫新¹

1.信息工程大学地理空间信息学院,河南郑州 450052;
2.中国科学院遥感与数字地球研究所,北京 100081

收稿日期:2016-01-19 修回日期:2016-03-22 出版日期:2017-05-08 发布日期:2020-06-03
作者简介:马嘉琳(1990-),女,甘肃武威,硕士生,研究方向为虚拟地理环境。
基金资助:
国家自然科学基金(41371383),空间信息智能感知与服务深圳市重点实验室（深圳大学）开放基金资助项目(201501)

Research on Panoramic Image Mosaic Method Based on Camera Calibration

Ma Jialin¹, Zhang Jinming^1,2,*, Sun Weixin¹

1. Institute of Geospatial Information, Information Engineering University, Zhengzhou 450052, China;
2. Institute of Remote Sensing and Digital Earth Chinese Academy of Sciences, Beijing 100081, China

Received:2016-01-19 Revised:2016-03-22 Online:2017-05-08 Published:2020-06-03

摘要/Abstract

摘要： 提出了一种基于相机标定的全景图拼接方法,对待拼接图像进行几何畸变矫正与旋转变换处理,提高图像配准的精度与全景图的拼接质量。通过相机线性标定得到单应矩阵,分离单应矩阵的内外参数。利用内参数,计算图像的径向畸变,矫正图像的几何畸变;利用外参数,将待拼接的序列图像转化在同一世界坐标系下;利用图像的同名像点实现图像的快速精确配准,实现全景图的高质量拼接。实验结果表明,使用该方法可以获得较高的拼接精度,拼接过程直观且不会发生误匹配。

关键词: 全景图, 相机标定, 图像拼接, 图像矫正, 图像配准

Abstract: A panoramic mosaic method was proposed based on camera calibration, geometric distortion correction and rotation transformation processing was done for stitching image, in order to improve the accuracy of image registration and panorama stitching quality. The homography was acquired by calculating the camera linear calibration, and the inside and outside parameters of the homography were separated. The radial distortion of the image was calculated by the inside parameters, and the image geometric distortion was corrected; a sequence of images was transformed in the same world coordinates using the external parameters; image registration was achieved accurately though the same name point of a sequence of images, and the high quality of the panoramic image stitching was achieved. Experiment verifies that this method effectively reduces the large amount of calculation in panorama stitching, process of stitching accuracy is higher, intuitive, and matching error will not occur.

Key words: panorama, camera calibration, image stitching, image correction, image registration

中图分类号:

P208

马嘉琳, 张锦明, 孙卫新. 基于相机标定的全景图拼接方法研究[J]. 系统仿真学报, 2017, 29(5): 1112-1119.

Ma Jialin, Zhang Jinming, Sun Weixin. Research on Panoramic Image Mosaic Method Based on Camera Calibration[J]. Journal of System Simulation, 2017, 29(5): 1112-1119.

参考文献

[1] 马颂德, 张正友. 计算机视觉——计算理论与算法基础 [M]. 北京: 科学出版社, 1997.
(Ma Song-de, Zhang Zheng-you.Computer Vision-Calculation theory and algorithm [M]. Beijing, China: Science Press, 1997.)
[2] Chen S E.Quicktime VR: An image-based approach to virtual environment navigation[C]// Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques. USA: ACM, 1995: 29-38.
[3] Seo S, Jeong S, Lee S.Efficient homography estimation method for panorama[C]// Frontiers of Computer Vision,(FCV), 2013 19th Korea-Japan Joint Workshop on. USA: IEEE, 2013: 209-212.
[4] Bo G, Cao J, Zhou Z, et al.A robust image registration algorithm used for panoramic image mosaic[C]// Image Analysis and Signal Processing (IASP), 2012 International Conference on. USA: IEEE, 2012: 1-4.
[5] 薛峰, 张佑生, 江巨浪, 等. 基于最大梯度和灰度相关的两步全景图拼接算法[J]. 系统仿真学报, 2006, 17(12): 2965-2968.
(XUE Feng, ZHANG You-sheng, JIANG Ju-lang, et al.Two-Pass Mosaic Algorithm of Panoramic Image Using Maximum Grads and Intensity Correlation[J]. Journal of System Simulation, 2006, 17(12): 2965-2968.)
[6] 张金玲, 孙汉旭, 贾庆轩, 等. 基于相机标定的图像拼接算法[J]. 中北大学学报(自然科学版), 2009, 29(6): 575-579.
(ZHANG Jin-ling, SUN Han-xu, JIA Qing- xuan, et al. Image Mosaic Algorithm Based on Camera Calibration[J]. Journal of North University of China (natural science edition), 2009, 29(6): 575-579.)
[7] 邹北骥, 阮鹏, 向遥, 等. 一种精确匹配的全景图自动拼接算法[J]. 计算机工程与科学, 2010, 32(8): 60-63.
(ZOU Bei-ji, RUAN Peng, XIANG Yao, et al.An Automatic Panoramic Images Mosaic Algorithm with Precise Matching[J]. Computer Engineering and Science, 2010, 32(8): 60-63.)
[8] 肖诗勤, 杨关良, 范顺昌. 一种基于特征的全景图拼接算法研究[J]. 舰船电子工程, 2010, 29(11): 119-120.
(XIAO Shi-qin, YANG Guan-liang, FAN Shun-chang.Research on Panorama Mosaics Based on Feature[J]. Ship Electronic Engineering, 2010, 29(11): 119-120.)
[9] 刘晓敏, 祝勇, 沈博, 等. 一种基于相机标定的图像配准方法[J]. 计算机系统应用, 2014, 23(3): 127-131.
(LIU Xiao-Min, ZHU Yong, SHEN Bo, et al.Method of Image Registration Based on Camera Calibration[J]. Computer Systems & Applications, 2014, 23(3): 127-131.)
[10] Brown D C.Decentering distortion of lenses[J]. Photogrammetric Engineering and Remote Sensing (S0099-1112), 1966, 32(3): 444-462.
[11] Fryer J G, Brown D C.Lens distortion for close-range photogrammetry[J]. Photogrammetric Engineering and Remote Sensing (S0099-1112), 1986, 52(1):51-58.
[12] Zhang Weibo, Li Jianxun, Zhang Zhi.Performance evaluation approach for image mosaicking algorithm[C]// Chinese 2013 25th Control and Decision Conference (CCDC), Guiyang, China. USA: IEEE, 2013: 3786-3791.
[13] Zhang Z.A flexible new technique for camera calibration[J]. Transactions on pattern Analysis and Machine Intelligence, IEEE (S0162-8828), 2000, 22(11): 1330-1334.
[14] Zhang Z.Flexible camera calibration by viewing a plane from unknown orientations[C]// Computer Vision, 1999. The Proceedings of the Seventh IEEE International Conference on. USA: IEEE, 1999: 666-673.
[15] Weng J, Cohen P, Herniou M.Camera calibration with distortion models and accuracy evaluation[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence (S0162-8828), 1992, 14(10): 965-980.
[16] 杨必武, 郭晓松. 摄像机镜头非线性畸变校正方法综述[J]. 中国图象图形学报(A辑), 2005, 10(3): 269-274.
(YANG Bi-wu, GUO Xiao-song.Overview of Nonlinear Distortion Correction of Camera Lens[J]. Journal of Image and Graphics(Album A), 2005, 10(3): 269-274.)
[17] 葛宝臻, 李晓洁, 邱实. 基于共面点直接线性变换的摄像机畸变校正[J]. 中国激光, 2010, 37(2):488-494.
(GE Bao-zhen, LI Xiao-jie, QIU Shi.Camera Lens Distortion Correction Based on Coplanar Point Direct Liner Transformation[J]. Chinese Journal of Lasers, 2010, 37(2):488-494.)
[18] 孔斌, 方廷健. 一种简单而精确的径向畸变标定方法[J]. 中国图象图形学报(A辑), 2004, 9(4): 429-434.
KONG Bin, FANG Ting-jian.A Simple and Precise Method for Radial Distortion Calibration[J]. Journal of Image and Graphics(Album A), 2004, 9(4): 429-434.
[19] Zhang Z, Matsushita Y, Ma Y.Camera calibration with lens distortion from low-rank textures[C]// Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on. USA: IEEE, 2011: 2321-2328.
[20] 陈勇, 刘文宋, 刘善伟, 等. 一种基于Harris与RANSAC算法的图像拼接软件研发[J]. 测绘与空间地理信息, 2014: 97-99.
(CEHN Yong, LIU Wen-song, LIU Shan-wei, et al.An Image Mosaics Software Based on Harris and RANSAC Algorithm[J]. Geomatics & Spatial Information Technology, 2014: 97-99.)
[21] 李鹏程, 曾毓敏, 张梦. 基于改进Harris的图像拼接算法[J]. 南京师范大学学报(工程技术版), 2014, 14(1): 70-75.
(LI Peng-cheng, ZENG Yu-min, Zhang Meng.Improved Image Mosaic Algorithm Based on Harris Corner[J]. Journal of NanJing Normal University (Engineering and technology edition), 2014, 14(1): 70-75.)

基于相机标定的全景图拼接方法研究

Research on Panoramic Image Mosaic Method Based on Camera Calibration

PDF (PC)

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 7

编辑推荐

Metrics

本文评价

[1]	李浩翔, 陈纯毅, 胡小娟, 刘云彪, 邢琦玮. 虚拟场景全景立体画面生成与视口渲染算法[J]. 系统仿真学报, 2022, 34(4): 777-787.
[2]	张贵阳, 薛牧遥, 朱子健, 霍炬. 基于多适应值全参数自主变异粒子群的立体相机标定[J]. 系统仿真学报, 2020, 32(12): 2461-2468.
[3]	顾菊平, 程天宇, 华亮, 王建平, 赵剑, 曹涌. 面向脊柱生物建模的图像分割与配准研究综述[J]. 系统仿真学报, 2019, 31(2): 167-173.
[4]	王素琴, 施文豪, 李兆歆, 毛天露. 无人机航拍视频中的车辆检测方法[J]. 系统仿真学报, 2018, 30(7): 2776-2786.
[5]	赵毅力, 徐丹, 钱文华, 张雁. 基于种子区域增长的快速图像融合[J]. 系统仿真学报, 2016, 28(9): 1985-1989.
[6]	马跃龙, 赵勇, 曹雪峰. 一种基于单目SLAM的无人机序列图像拼接方法[J]. 系统仿真学报, 2016, 28(10): 2349-2355.
[7]	权巍, 王颖, 王艳春, 王旭阳, 朱云瑞. 基于多曝光的高动态范围全景图像合成[J]. 系统仿真学报, 2015, 27(10): 2531-2537.