Research on Panoramic Image Mosaic Method Based on Camera Calibration

doi:10.16182/j.issn1004731x.joss.201705024

Abstract

Abstract: A panoramic mosaic method was proposed based on camera calibration, geometric distortion correction and rotation transformation processing was done for stitching image, in order to improve the accuracy of image registration and panorama stitching quality. The homography was acquired by calculating the camera linear calibration, and the inside and outside parameters of the homography were separated. The radial distortion of the image was calculated by the inside parameters, and the image geometric distortion was corrected; a sequence of images was transformed in the same world coordinates using the external parameters; image registration was achieved accurately though the same name point of a sequence of images, and the high quality of the panoramic image stitching was achieved. Experiment verifies that this method effectively reduces the large amount of calculation in panorama stitching, process of stitching accuracy is higher, intuitive, and matching error will not occur.

Key words: panorama, camera calibration, image stitching, image correction, image registration

CLC Number:

P208

Ma Jialin, Zhang Jinming, Sun Weixin. Research on Panoramic Image Mosaic Method Based on Camera Calibration[J]. Journal of System Simulation, 2017, 29(5): 1112-1119.

References

[1] 马颂德, 张正友. 计算机视觉——计算理论与算法基础 [M]. 北京: 科学出版社, 1997.
(Ma Song-de, Zhang Zheng-you.Computer Vision-Calculation theory and algorithm [M]. Beijing, China: Science Press, 1997.)
[2] Chen S E.Quicktime VR: An image-based approach to virtual environment navigation[C]// Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques. USA: ACM, 1995: 29-38.
[3] Seo S, Jeong S, Lee S.Efficient homography estimation method for panorama[C]// Frontiers of Computer Vision,(FCV), 2013 19th Korea-Japan Joint Workshop on. USA: IEEE, 2013: 209-212.
[4] Bo G, Cao J, Zhou Z, et al.A robust image registration algorithm used for panoramic image mosaic[C]// Image Analysis and Signal Processing (IASP), 2012 International Conference on. USA: IEEE, 2012: 1-4.
[5] 薛峰, 张佑生, 江巨浪, 等. 基于最大梯度和灰度相关的两步全景图拼接算法[J]. 系统仿真学报, 2006, 17(12): 2965-2968.
(XUE Feng, ZHANG You-sheng, JIANG Ju-lang, et al.Two-Pass Mosaic Algorithm of Panoramic Image Using Maximum Grads and Intensity Correlation[J]. Journal of System Simulation, 2006, 17(12): 2965-2968.)
[6] 张金玲, 孙汉旭, 贾庆轩, 等. 基于相机标定的图像拼接算法[J]. 中北大学学报(自然科学版), 2009, 29(6): 575-579.
(ZHANG Jin-ling, SUN Han-xu, JIA Qing- xuan, et al. Image Mosaic Algorithm Based on Camera Calibration[J]. Journal of North University of China (natural science edition), 2009, 29(6): 575-579.)
[7] 邹北骥, 阮鹏, 向遥, 等. 一种精确匹配的全景图自动拼接算法[J]. 计算机工程与科学, 2010, 32(8): 60-63.
(ZOU Bei-ji, RUAN Peng, XIANG Yao, et al.An Automatic Panoramic Images Mosaic Algorithm with Precise Matching[J]. Computer Engineering and Science, 2010, 32(8): 60-63.)
[8] 肖诗勤, 杨关良, 范顺昌. 一种基于特征的全景图拼接算法研究[J]. 舰船电子工程, 2010, 29(11): 119-120.
(XIAO Shi-qin, YANG Guan-liang, FAN Shun-chang.Research on Panorama Mosaics Based on Feature[J]. Ship Electronic Engineering, 2010, 29(11): 119-120.)
[9] 刘晓敏, 祝勇, 沈博, 等. 一种基于相机标定的图像配准方法[J]. 计算机系统应用, 2014, 23(3): 127-131.
(LIU Xiao-Min, ZHU Yong, SHEN Bo, et al.Method of Image Registration Based on Camera Calibration[J]. Computer Systems & Applications, 2014, 23(3): 127-131.)
[10] Brown D C.Decentering distortion of lenses[J]. Photogrammetric Engineering and Remote Sensing (S0099-1112), 1966, 32(3): 444-462.
[11] Fryer J G, Brown D C.Lens distortion for close-range photogrammetry[J]. Photogrammetric Engineering and Remote Sensing (S0099-1112), 1986, 52(1):51-58.
[12] Zhang Weibo, Li Jianxun, Zhang Zhi.Performance evaluation approach for image mosaicking algorithm[C]// Chinese 2013 25th Control and Decision Conference (CCDC), Guiyang, China. USA: IEEE, 2013: 3786-3791.
[13] Zhang Z.A flexible new technique for camera calibration[J]. Transactions on pattern Analysis and Machine Intelligence, IEEE (S0162-8828), 2000, 22(11): 1330-1334.
[14] Zhang Z.Flexible camera calibration by viewing a plane from unknown orientations[C]// Computer Vision, 1999. The Proceedings of the Seventh IEEE International Conference on. USA: IEEE, 1999: 666-673.
[15] Weng J, Cohen P, Herniou M.Camera calibration with distortion models and accuracy evaluation[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence (S0162-8828), 1992, 14(10): 965-980.
[16] 杨必武, 郭晓松. 摄像机镜头非线性畸变校正方法综述[J]. 中国图象图形学报(A辑), 2005, 10(3): 269-274.
(YANG Bi-wu, GUO Xiao-song.Overview of Nonlinear Distortion Correction of Camera Lens[J]. Journal of Image and Graphics(Album A), 2005, 10(3): 269-274.)
[17] 葛宝臻, 李晓洁, 邱实. 基于共面点直接线性变换的摄像机畸变校正[J]. 中国激光, 2010, 37(2):488-494.
(GE Bao-zhen, LI Xiao-jie, QIU Shi.Camera Lens Distortion Correction Based on Coplanar Point Direct Liner Transformation[J]. Chinese Journal of Lasers, 2010, 37(2):488-494.)
[18] 孔斌, 方廷健. 一种简单而精确的径向畸变标定方法[J]. 中国图象图形学报(A辑), 2004, 9(4): 429-434.
KONG Bin, FANG Ting-jian.A Simple and Precise Method for Radial Distortion Calibration[J]. Journal of Image and Graphics(Album A), 2004, 9(4): 429-434.
[19] Zhang Z, Matsushita Y, Ma Y.Camera calibration with lens distortion from low-rank textures[C]// Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on. USA: IEEE, 2011: 2321-2328.
[20] 陈勇, 刘文宋, 刘善伟, 等. 一种基于Harris与RANSAC算法的图像拼接软件研发[J]. 测绘与空间地理信息, 2014: 97-99.
(CEHN Yong, LIU Wen-song, LIU Shan-wei, et al.An Image Mosaics Software Based on Harris and RANSAC Algorithm[J]. Geomatics & Spatial Information Technology, 2014: 97-99.)
[21] 李鹏程, 曾毓敏, 张梦. 基于改进Harris的图像拼接算法[J]. 南京师范大学学报(工程技术版), 2014, 14(1): 70-75.
(LI Peng-cheng, ZENG Yu-min, Zhang Meng.Improved Image Mosaic Algorithm Based on Harris Corner[J]. Journal of NanJing Normal University (Engineering and technology edition), 2014, 14(1): 70-75.)