An Extended Image Features Based Uncalibrated Visual Servoing Method

doi:10.16182/j.issn1004731x.joss.23-1593

Abstract

Abstract:

Aiming at the traditional uncalibrated visual servo relying on the estimation of image Jacobi matrix and the coupling of the motion of each degree of freedom of the camera, on the basis of image-based uncalibrated visual servo, an extended image features based uncalibrated visual servo method is proposed. By analyzing the relationship between image features and camera frames change in the visual servoing process, the visual servoing process in the image space is decomposed into four basic processes: translation, stretching, rotation and scaling; by analyzing the changing of image features in the visual servoing process, extended image features are used to complement the meaning of traditional image features, image center coordinates, relative length of a straight line, distance between two points, and direction angle are selected to correspond to the motion of each degree of freedom of the camera, and the robot's motion is directly controlled by the error of the image features, which realizes a completely decoupled visual servo that does not depend on the image Jacobian matrix. Comparative simulation experiments on CoppeliaSim platform show that compared with the traditional calibrated visual servoing, the method proposed in this study reduces the image position error, the camera position error, and orientation error by 88%, 94%, and 93% of respectively. The effectiveness of the algorithm is verified using physical experiments.

Key words: robot, uncalibrated visual servoing, extended image feature, feature selection, motion decoupling

CLC Number:

TP242.6

Zhang Shuzhen, Cheng Yukun, Liu Yangbo, Zha Fusheng. An Extended Image Features Based Uncalibrated Visual Servoing Method[J]. Journal of System Simulation, 2025, 37(5): 1210-1221.

Figures/Tables 14

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Fig. 5

Fig. 6

Fig. 7

Table 1

Five visual servo task definitions

任务	初始位姿	期望位姿
1	(0, 0, 0, 0, 0, -1/6 $π$ )	(0, 0, 0, 0, 0, 0 )
2	(0, 0, -1.5, 0, 0, -2/9 $π$ )
3	(-0.08, -0.06, -0.2, 0, 0, -1/6 $π$ )
4	(-0.03, -0.1, -0.2, -1/36 $π$ , -1/9 $π$ , -1/6 $π$ )
5	(-0.2, 0.03, -0.2, 1/24 $π$ , 3/20 $π$ , -1/6 $π$ )

Table 1

Table 2

Fig. 8

Fig. 9

Fig. 10

Fig. 11

Fig. 12

References 15

1	Chaumette Francois, Hutchinson Seth. Visual Servo Control. I. Basic Approaches[J]. IEEE Robotics & Automation Magazine, 2006, 13(4): 82-90.
2	陶波, 龚泽宇, 丁汉. 机器人无标定视觉伺服控制研究进展[J]. 力学学报, 2016, 48(4): 767-783.
	Tao Bo, Gong Zeyu, Ding Han. Survey on Uncalibrated Robot Visual Servoing Control[J]. Chinese Journal of Theoretical and Applied Mechanics, 2016, 48(4): 767-783.
3	Piepmeier J A, McMurray G V, Lipkin H. Uncalibrated Dynamic Visual Servoing[J]. IEEE Transactions on Robotics and Automation, 2004, 20(1): 143-147.
4	Liu Yunhui, Wang Hesheng, Wang Chengyou, et al. Uncalibrated Visual Servoing of Robots Using a Depth-independent Interaction Matrix[J]. IEEE Transactions on Robotics, 2006, 22(4): 804-817.
5	Chaumette François. Potential Problems of Unstability and Divergence in Image-based and Position-based Visual Servoing[C]//1999 European Control Conference (ECC). Piscataway: IEEE, 1999: 4549-4554.
6	马树军, 金铁铮, 王英蕾, 等. 一种无标定视觉伺服系统的快速跟踪策略[J]. 东北大学学报(自然科学版), 2020, 41(3): 355-360.
	Ma Shujun, Jin Tiezheng, Wang Yinglei, et al. A Fast Tracking Strategy for Uncalibrated Visual Servo System[J]. Journal of Northeastern University(Natural Science), 2020, 41(3): 355-360.
7	贾庆轩, 段嘉琪, 陈钢. 机器人在轨装配无标定视觉伺服对准方法[J]. 航空学报, 2021, 42(6): 617-626.
	Jia Qingxuan, Duan Jiaqi, Chen Gang. Uncalibrated Visual Servo of Space Robots Performing on-orbit Assembly Alignment Task[J]. Acta Aeronautica et Astronautica Sinica, 2021, 42(6): 617-626.
8	Li Tao, Yu Jinpeng, Qiu Quan, et al. Hybrid Uncalibrated Visual Servoing Control of Harvesting Robots with RGB-D Cameras[J]. IEEE Transactions on Industrial Electronics, 2023, 70(3): 2729-2738.
9	梁喜凤, 彭明, 路杰, 等. 基于自适应无迹卡尔曼滤波的采摘机械手视觉伺服控制方法[J]. 农业工程学报, 2019, 35(19): 230-237.
	Liang Xifeng, Peng Ming, Lu Jie, et al. Servo Control Method of Picking Manipulator Based on Adaptive Traceless Kalman Filter[J]. Transactions of the Chinese Society of Agricultural Engineering, 2019, 35(19): 230-237.
10	Gong Zeyu, Tao Bo, Yang Hua, et al. An Uncalibrated Visual Servo Method Based on Projective Homography[J]. IEEE Transactions on Automation Science and Engineering, 2018, 15(2): 806-817.
11	叶国强, 李伟光, 万好. 结合学习特征的图像矩视觉伺服方法[J]. 华南理工大学学报(自然科学版), 2017, 45(2): 99-107.
	Ye Guoqiang, Li Weiguang, Wan Hao. Image Moment-based Visual Servoing Method with Learning Features[J]. Journal of South China University of Technology(Natural Science Edition), 2017, 45(2): 99-107.
12	Zubair Arif, Fu Yili, Sohail Amjad, et al. Markerless Visual Servoing Using Virtual Face Tag and Image Moment Invariants[C]//2022 4th International Conference on Robotics and Computer Vision (ICRCV). Piscataway: IEEE, 2022: 123-128.
13	Cong V D. Visual Servoing Control of 4-DOF Palletizing Robotic Arm for Vision Based Sorting Robot System[J]. International Journal on Interactive Design and Manufacturing (IJIDeM), 2023, 17(2): 717-728.
14	Cong V D, Hanh L D. A New Decoupled Control Law for Image-based Visual Servoing Control of Robot Manipulators[J]. International Journal of Intelligent Robotics and Applications, 2022, 6(3): 576-585.
15	Wu Dongjie, Zhong Xungao, Zhang Xiaoli, et al. Uncalibrated Image-based Visual Servoing Based on Joint Space and Image moment[C]//2018 37th Chinese Control Conference (CCC). Piscataway: IEEE, 2018: 5391-5397.

算法	误差类型	任务1	任务2	任务3	任务4	任务5
IBVS	图像误差/像素	0.000 7	0.004 1	0.003 7	0.007 8	0.009 2
	相机位置误差/mm	0.307 7	1.434 1	1.077 8	3.762 0	4.917 0
	相机姿态误差/(°)	0.002 9	0.013 6	0.007 0	0.029 9	0.042 2
	轨迹长度/mm	5.152 9	152.716 7	238.004 7	267.610 8	322.033 7
E_IBUVS	图像误差/像素	0.000 0	0.000 0	0.000 0	0.000 0	0.001 1
	相机位置误差/mm	0.094 7	0.072 6	0.093 4	0.078 4	0.056 1
	相机姿态误差/(°)	0.000 7	0.000 4	0.000 9	0.000 8	0.002 8
	轨迹长度/mm	1.739 4	151.400 4	240.297 5	240.477 0	306.464 1

[1]	Ni Peilong, Mao Pengjun, Wang Ning, Yang Mengjie. Robot Path Planning Based on Improved A-DDQN Algorithm [J]. Journal of System Simulation, 2025, 37(9): 2420-2430.
[2]	Zhang Kaixiang, Mao Jianlin, Wang Niya, Xu Zhihao. Multi-robot Hierarchical Collaborative k-robust Path Planning for Path Interference [J]. Journal of System Simulation, 2025, 37(8): 2074-2088.
[3]	Chen Tao, Liu Jianxuan, Wang Lizhong, Zou Xiangjun, Li Xiaojuan. Research on Non-singular Fast Integral Terminal Sliding Mode Trajectory Tracking Control of Six-axis Robotic Arm [J]. Journal of System Simulation, 2025, 37(8): 2115-2123.
[4]	Liu Yongkui, Yang Kang, Tuo Benben, Pan Yaduo, Wang Xinyu, Wang Yihan, Gong Yongqian, Zhang Lin, Wang Lihui, Lin Tingyu, Zi Bin, Li Yuan, You Wei, Xu Xun. Digital Twinned Industrial Robot: Conceptual Framework, Key Technologies, and Case Study [J]. Journal of System Simulation, 2025, 37(7): 1723-1752.
[5]	Ye Chen, Shao Peng, Zhang Shaoping, Li Wenting, Zhou Tengming. Enhanced Artificial Gorilla Algorithm for Mobile Robot Path Planning [J]. Journal of System Simulation, 2025, 37(6): 1474-1485.
[6]	Cheng Chong, Wang Lixia, Duan Songtao, Xiong Xiaoguang, Ge Xianjun. Research on Obstacle Avoidance of Substation Robot Based on Spatiotemporal Networks [J]. Journal of System Simulation, 2025, 37(6): 1522-1530.
[7]	Zhang Yan, Li Binghua, Huo Tao, Liu Rong. Research on Robot Dynamic Obstacle Avoidance Method Based on Improved A* and Dynamic Window Algorithm [J]. Journal of System Simulation, 2025, 37(6): 1555-1564.
[8]	Zhou Xiaohui, Li Yanqiang, Wang Yong, Zhao Decai, Yang Xiaoyao. Robot Path Planning Based on Ant Colony Algorithm with Dual Heuristic Information [J]. Journal of System Simulation, 2025, 37(5): 1280-1289.
[9]	Yu Die, Bao Baizhong, Si Yan, Duan Jian, Zhan Xiaobin, Shi Tielin. Mobile Robot Path Planning Based on Search-step Optimized A* Algorithm [J]. Journal of System Simulation, 2025, 37(4): 1041-1050.
[10]	Li Min, Zhang Sen, Zeng Xiangguang, Wang Gang, Zhang Tongwei, Xie Dijie, Ren Wenzhe, Zhang Tao. Trajectory Planning of Quadruped Robot Over Obstacle with Single Leg Based on Deep Reinforcement Learning [J]. Journal of System Simulation, 2025, 37(4): 895-909.
[11]	He Zhigang, Li Dayan, Wang Niya, Mao Jianlin, Wang Ning. A Multi-robot Collaborative Path Planning Algorithm with Chain Working Mode [J]. Journal of System Simulation, 2025, 37(4): 953-967.
[12]	Lin Guijuan, Li Zihan, Wang Yu. Research on Improved A* Algorithm Path Planning Based on Global Key Point Extraction [J]. Journal of System Simulation, 2025, 37(3): 667-678.
[13]	Fang Guoqiang, Chang Haitao, Liu Xing, Liu Zhengxiong, Huang Panfeng. Research on Task Planning Methods for Space Robot Assisted Operation [J]. Journal of System Simulation, 2025, 37(2): 325-334.
[14]	Xu Qiang, Xu Jianlei, Hu Yanhai, Chen Haihui, Zhang Xing, Xing Zhaohui. Trajectory Optimization of Robotic Arm Based on Improved Simulated Annealing Genetic Algorithm [J]. Journal of System Simulation, 2025, 37(2): 404-412.
[15]	Li Jiongyi, Li Qiang, Zhang Xinwen, Htet Zin Myo, Cai Yongbin. Improved Bidirectional A* Quadratic Path Planning Algorithm for Mobile Robots [J]. Journal of System Simulation, 2025, 37(2): 498-507.