基于半实物仿真的采摘机器人视觉定位研究

doi:10.16182/j.issn1004731x.joss.201708013

系统仿真学报 ›› 2017, Vol. 29 ›› Issue (8): 1736-1747.doi: 10.16182/j.issn1004731x.joss.201708013

基于半实物仿真的采摘机器人视觉定位研究

陈科尹^1,2, 邹湘军^3*, 彭红星³, 梁海英⁴, 胡元闯⁴

1. 贺州学院信息与通信工程学院,广西贺州 542899;
2. 农业部南京农业机械化研究所,江苏南京 210014;
3. 华南农业大学南方农业机械与装备关键技术省部共建教育部重点实验室,广东广州 510642;
4. 贺州学院数学与计算机学院,广西贺州 542899

收稿日期:2016-09-09 发布日期:2020-06-01
作者简介:陈科尹(1982-),男,广东雷州,博士,讲师,研究方向为农业机器人、机器视觉及仿生智能。
基金资助:
国家自然科学基金(31571568),广西自然科学青年基金(2015GXNSFBA139264),广西高校科学技术研究(KY2015YB304)

Research on Picking Robot Vision Localization Based on Semi-physical Simulation

Chen Keyin^1,2, Zou Xiangjun^3*, Peng Hongxing³, Liang Haiying⁴, Hu Yuanchuang⁴

1. School of Information and Communication Engineering, Hezhou University, Hezhou 542899, China;
2. Nanjing Institute of Agricultural Mechanization, Ministry of Agriculture, Nanjing 210014, China;
3. Key Lab of Key Technology of South Agricultural Machine and Equipment Ministry of Education, South China Agricultural University, Guangzhou 510642, China;
4. School of Mathematics and Computer Science, Hezhou University, Hezhou 542899, China

Received:2016-09-09 Published:2020-06-01

摘要/Abstract

摘要： 针对基于实物采摘机器人的视觉定位的准确度、稳定性以及试验验证易出错、周期长、不易于室内进行等问题,结合采摘机器人视觉定位机理和机器人运动学,提出了一种基于半实物仿真技术的采摘机器人视觉定位研究方法。该方法采用虚拟采摘机器人代替实物机器人,在虚拟仿真环境下对水果目标采摘点进行定位研究,即视觉定位半实物仿真。试验结果表明：在视觉定位半实物仿真环境下,水果目标定位的平均绝对误差和相对误差分别仅约为2.89 mm和0.43%,满足实际视觉定位精度的要求,从而验证了该仿真方法的有效性和可行性。

关键词: 采摘机器人, 视觉定位, 机器人运动学, 半实物仿真

Abstract: Aiming at the problems of accuracy and stability of the vision localization based on physical picking robot, which were easy to make mistakes, long cycle, and not easy to be carried out indoors, a picking robot vision localization method based on the semi-physical simulation technology was proposed combining with the robot vision localization mechanism and robot kinematics. This method adopted the virtual picking robot to instead of the physical robot, and studied the vision localization of the fruit target in the virtual simulated environment, which was as the vision localization based on semi-physical simulation. The test results show that: the average absolute error and relative error of the target fruit are only about 2.89 mm and 0.43% in the vision localization simulated environment, which is in line with the accuracy requirements of the actual vision localization, so the effectiveness and feasibility of this simulation method are validated.

Key words: the picking robot, vision localization, robot kinematics, semi-physical simulation

中图分类号:

TP391.9

陈科尹, 邹湘军, 彭红星, 梁海英, 胡元闯. 基于半实物仿真的采摘机器人视觉定位研究[J]. 系统仿真学报, 2017, 29(8): 1736-1747.

Chen Keyin, Zou Xiangjun, Peng Hongxing, Liang Haiying, Hu Yuanchuang. Research on Picking Robot Vision Localization Based on Semi-physical Simulation[J]. Journal of System Simulation, 2017, 29(8): 1736-1747.

参考文献

[1] Du X, Liang B, Xu W, et al.A semi-physical simulation system for binocular vision guided rendezvous[C]// Control Automation Robotics & Vision (ICARCV), 2012 12th International Conference on. USA: IEEE, 2012: 853-858.
[2] Xu D, Zhang L, Ma S, et al.Design of Semi Physical Simulation Platform for Autonomous Underwater Vehicle[C]// Applied Mechanics and Materials. Trans Tech Publications. Switzerland: Trans Tech Publications Inc, 2013: 1155-1161.
[3] 甘永, 毛宇峰, 万磊, 等. 水下机器人半实物运动仿真系统的设计[J]. 系统仿真学报, 2006, 18(7): 2026-2029.
(Gan Yong, Mao Yufeng, Wan Lei, et al.Design of Semi Physical Motion Simulation System of Underwater Vehicle[J]. Journal of System Simulation (S1004-731X), 2006, 18(7): 2026-2029.)
[4] 郑为, 邹启明, 倪文玺. 水下无人潜航器避障与导航仿真系统设计与应用[J]. 系统仿真学报, 2016, 28(1): 91-98.
(Zheng Wei, Zou Qiming, Ni Wenxi.Design and Application of Underwater Unmanned Vehicle Simulation System for Navigation and Obstacle Avoidance[J]. Journal of System Simulation (S1004-731X), 2016, 28(1): 91-98.)
[5] Bazzano F, Gentilini F, Lamberti F, et al.Immersive Virtual Reality-Based Simulation to Support the Design of Natural Human-Robot Interfaces for Service Robotic Applications [C]// International Conference on Augmented Reality, Virtual Reality and Computer Graphics. Germany: Springer International Publishing, 2016: 33-51.
[6] 江金龙, 张文栓, 董通, 等. 多机器人半实物仿真系统的研究与实现[J]. 计算机仿真, 2009, 26(4): 200-203, 252.(Jiang Jinlong, Zhang Wenshuan, Dong Tong, et al. Research and Implementation of Multi-robot Semi-hard-ware Simulation System [J]. Computer Simulation, 2009, 26(4): 200-203, 252.)
[7] Yang Y, Song Y, Pan H, et al.Visual servo simulation of EAST articulated maintenance arm robot[J]. Fusion Engineering and Design (S0920-3796), 2016, 104: 28-33.
[8] 潘峰, 薛定宇, 徐心和. 基于dSPACE半实物仿真技术的伺服控制研究与应用[J]. 系统仿真学报, 2004, 16(5): 936-939.
(Pan Feng, Xue Dingyu, Xu Xinhe.The Research and Application of dSPACE-based Hardware-In-The-Loop Simulation Technique in Servo Control[J]. Journal of Systems Simulation (S1004-731X), 2004, 16(5): 936-939.)
[9] Wang Z, Gong L, Chen Q, et al.Rapid Developing the Simulation and Control Systems for a Multifunctional Autonomous Agricultural Robot with ROS [C]// International Conference on Intelligent Robotics and Applications. Germany: Springer International Publishing, 2016: 26-39.
[10] Zou X J, Zou H X, Lu J.Virtual Manipulator-Based Binocular Stereo Vision Positioning System and Errors Modelling[J]. Machine Vision and Applications (S0932-8092), 2012, 23(1): 43-63.
[11] 邹湘军, 罗锡文, 卢俊, 等. 虚拟环境下农业移动机器人行为及其仿真建模[J]. 系统仿真学报, 2006, 18(增2): 551-562.
(Zou Xiangjun, Luo Xiwen, Lu Jun, et al.Modeling for Behavior and Simulation of Agriculture Mobile Robot in Virtual Environment[J]. Journal of System Simulation (S1004-731X), 2006, 18(S2): 551-562.)
[12] 苑严伟. 数字农业典型智能化装备虚拟仿真技术研究 [D]. 北京: 中国农业机械化科学研究院, 2010.
(Yuan Yan Wei.Study on Virtual Simulation Technology of Special Intelligent Agricultural Equipment in Digital Agriculture [D]. Beijing, China: Chinese Academy of Agricultural Mechanization Sciences, 2010.)
[13] Divya K A, Roshna K I, Mathai S.Shadow detection and removal by object-wise segmentation[C]// 2015 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC). USA: IEEE, 2015: 1-4.
[14] Achanta R, Hemami S, Estrada F, et al.frequency-tuned salient region detection[C]// IEEE International Conference on Computer Vision and Pattern Recognition, Miami, USA. USA: IEEE, 2009: 1597-1604.
[15] 陈科尹, 邹湘军, 熊俊涛, 等. 基于视觉显著性改进的水果图像模糊聚类分割算法[J]. 农业工程学报, 2013, 29(6): 157-165.
(Chen Keyin, Zou Xiangjun, Xiong Juntao, et al.Improved fruit fuzzy clustering image segmentation algorithm based on visual saliency[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2013, 29(6): 157-165.)
[16] Tippetts B, Lee D J, Lillywhite K, et al.Review of stereo vision algorithms and their suitability for resource-limited systems[J]. Journal of Real-Time Image Processing (S1861-8200), 2016, 11(1): 5-25.
[17] 项荣, 应义斌, 蒋焕煜, 等. 基于双目立体视觉的番茄定位[J]. 农业工程学报, 2012, 28(5): 161-167.
(Xiang Rong, Ying Yibin, Jiang Huanyu, et al.Localization of tomatoes based on binocular stereo vision[J]. Transactions of the Chinese Society of Agricultural Engineering, 2012, 28(5): 161-167.)
[18] 鲍官军, 荀一, 戚利勇, 等. 机器视觉在黄瓜采摘机器人中的应用研究[J]. 浙江工业大学学报, 2010, 38(1): 114-118.
(Bao Guanjun, Xun Yi, Qi Liyong, et al.Research on the application of machine vision in cucumber picking robots[J]. Journal of Zhejiang University of Technology, 2010, 38(1): 114-118.)

基于半实物仿真的采摘机器人视觉定位研究

Research on Picking Robot Vision Localization Based on Semi-physical Simulation

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	卢柏宏, 赵建军, 刘戈三. 电影虚拟摄影半实物仿真的研究与实现[J]. 系统仿真学报, 2021, 33(8): 1938-1946.
[2]	严爱军, 夏恒, 刘溪芷. 城市生活垃圾焚烧过程监控半实物仿真平台研发[J]. 系统仿真学报, 2021, 33(6): 1427-1435.
[3]	蒋泽睿, 杨立军, 李俊, 焦晓龙, 郑航. 自动跟踪口腔手术灯的运动学分析与仿真[J]. 系统仿真学报, 2021, 33(12): 2864-2879.
[4]	任福深, 孙雅琪, 胡庆, 李兆亮, 孙鹏宇, 范玉坤. 基于Unity3D的水下机器人半实物仿真系统[J]. 系统仿真学报, 2020, 32(8): 1546-1555.
[5]	吴爱华, 赵不贿, 茅靖峰, 申海群, 张旭东. 基于快速控制原型的风力发电半实物仿真系统[J]. 系统仿真学报, 2020, 32(3): 482-491.
[6]	张翔, 刘梦焱, 张鹏, 朱克炜, 闫小东. 一种激光驾束制导武器半实物仿真系统构建及试验方法[J]. 系统仿真学报, 2020, 32(11): 2192-2198.
[7]	王林鹏, 王超磊, 戴玉婷. 转台外置的空馈式低频寻的制导半实物仿真研究[J]. 系统仿真学报, 2020, 32(1): 69-77.
[8]	黄瑞松, 李海凤, 刘金, 孔文华. 飞行器半实物仿真技术现状与发展趋势分析[J]. 系统仿真学报, 2019, 31(9): 1763-1774.
[9]	田传艳, 胡军照, 刘继奎, 杨黔龙. 一种低成本的半实物飞行仿真系统[J]. 系统仿真学报, 2019, 31(6): 1123-1127.
[10]	张卿, 李易洁. 激光主动成像制导半实物仿真方法研究[J]. 系统仿真学报, 2019, 31(2): 299-305.
[11]	耿化品, 佟佳慧, 马洪涛. 飞行器半实物仿真系统不确定性度量方法研究[J]. 系统仿真学报, 2019, 31(12): 2671-2677.
[12]	范若楠, 蒋继军, 孙乃葳. 水声成像半实物仿真系统设计与实现[J]. 系统仿真学报, 2019, 31(12): 2768-2774.
[13]	李景, 韩健, 张卿. 多飞行器协同制导仿真技术研究[J]. 系统仿真学报, 2019, 31(12): 2775-2780.
[14]	唐善军, 宋敏敏, 王碧云, 张宇. 基于MOS电阻阵半实物仿真的红外场景生成技术[J]. 系统仿真学报, 2018, 30(4): 1319-1327.
[15]	刘柏廷, 王晓雷, 王超磊, 陶渝辉, 杨召伟. 基于多散射中心模拟的导弹连射半实物仿真方法[J]. 系统仿真学报, 2018, 30(12): 4732-4737.