基于数字孪生的果园虚拟交互系统构建

doi:10.16182/j.issn1004731x.joss.23-0317

系统仿真学报 ›› 2024, Vol. 36 ›› Issue (6): 1493-1508.doi: 10.16182/j.issn1004731x.joss.23-0317

• 论文 • 上一篇

基于数字孪生的果园虚拟交互系统构建

王红军¹(), 林俊强¹, 邹湘军¹^,², 张坡³, 周铭轩¹, 邹伟锐¹, 唐昀超⁴(), 罗陆锋⁵

^1.华南农业大学工程学院, 广东广州 510642
^2.佛山市中科农业机器人与智慧农业创新研究院, 广东佛山 528200
^3.广东工贸职业技术学院计算机与信息工程学院, 广东广州 510510
^4.仲恺农业工程学院城乡建设学院, 广东广州 510225
^5.佛山大学机电工程与自动化学院, 广东佛山 528200

收稿日期:2023-03-21 修回日期:2023-08-17 出版日期:2024-06-28 发布日期:2024-06-19
通讯作者: 唐昀超 E-mail:xtwhj@scau.edu.cn;ryan.twain@zhku.edu.cn
第一作者简介:王红军(1966-)，女，教授，博士，研究方向为智能设计与虚拟设计、农业机器人。E-mail：xtwhj@scau.edu.cn
基金资助:
国家自然科学基金面上项目(32372001);广东省农业农村厅项目(2019KJ139);广东省基础与应用基础研究(2022A1515140013);采摘机器人关键技术研究与数字孪生平台构建项目(2022ZDZX3056)

Construction of a Virtual Interactive System for Orchards Based on Digital Twin

Wang Hongjun¹(), Lin Junqiang¹, Zou Xiangjun¹^,², Zhang Po³, Zhou Mingxuan¹, Zou Weirui¹, Tang Yunchao⁴(), Luo Lufeng⁵

^1.College of Engineering, South China Agricultural University, Guangzhou 510642, China
^2.Foshan -Zhongke Innovation Research Institute of Intelligent Agriculture and Robotics, Foshan 528200, China
^3.College of Computer & Information Engineering, Guangdong Polytechnic of Industry and Commerce, Guangzhou 510510, China
^4.College of Urban and Rural Construction, Zhongkai University of Agriculture and Engineering, Guangzhou 510225, China
^5.School of Mechatronic Engineering and Automation, Foshan University, Foshan 528200, China

Received:2023-03-21 Revised:2023-08-17 Online:2024-06-28 Published:2024-06-19
Contact: Tang Yunchao E-mail:xtwhj@scau.edu.cn;ryan.twain@zhku.edu.cn

摘要/Abstract

摘要：

针对果园种植管理系统存在可视性低、实时性差、适应性弱和交互方式单一的问题，提出一种面向种植管理过程的果园数字孪生系统六维模型。从管理要素实体建模、管理过程动态建模、管理系统仿真建模和管理策略优化建模4个方面论述了系统模型构建理论与技术体系。以六维模型为基础，理论与技术体系为支撑，设计了基于数字孪生的果园虚拟交互系统架构，并对系统开发过程的关键技术进行了阐述。借助Unity3D仿真平台搭建了果园虚拟交互系统，实现对果园的三维可视化监测。实验结果表明：该系统在农业物联网平台数据共享基础上，通过数据驱动、三维展示、人机交互、重构事件和智能决策方面提升了果园种植管理系统监测能力，为建设智慧果园提供参考。

关键词: 数字孪生, 果园种植管理, 农业物联网, 虚拟现实, 深度强化学习

Abstract:

Aiming at the low visibility, poor real-time, weak adaptability and single interaction mode in orchard planting management system, a six-dimensional model of orchard digital twin system for planting management process is proposed. The system model construction theory and technology system is discussed from four aspects, entity modeling of management elements, dynamic modeling of management process, simulation modeling of management system and optimization modeling of management strategy. Based on the six-dimensional model, supported by the theory and technology system, the virtual interactive system architecture of the orchard based on the digital twin is designed, and the key technologies of the system development process are standard. With the Unity3D simulation platform, the orchard virtual interactive system is built to realize the three-dimensional visualization monitoring of the orchard. The experimental results show that the system improves the monitoring ability of orchard plantation management system through data-driven, 3D display, human-computer interaction, reconstructed events and intelligent decision-making on the basis of data sharing on the platform of internet of things in agriculture, which provides a reference for the construction of smart orchard.

Key words: DT, orchard planting management, internet of things in agriculture, VR, DRL

中图分类号:

TP242

王红军,林俊强,邹湘军等 . 基于数字孪生的果园虚拟交互系统构建[J]. 系统仿真学报, 2024, 36(6): 1493-1508.

Wang Hongjun,Lin Junqiang,Zou Xiangjun,et al . Construction of a Virtual Interactive System for Orchards Based on Digital Twin[J]. Journal of System Simulation, 2024, 36(6): 1493-1508.

图/表 16

图1

图2

图3

图4

图5

图6

图7

图8

表1

图9

图10

图11

图12

图13

图14

图15

参考文献 25

1	邹湘军, 孙健, 何汉武, 等. 虚拟现实技术的演变发展与展望[J]. 系统仿真学报, 2004, 16(9): 1905-1909.
	Zou Xiangjun, Sun Jian, He Hanwu, et al. The Development and Prospects of Virtual Reality[J]. Journal of System Simulation, 2004, 16(9): 1905-1909.
2	Tang Yunchao, Chen Mingyou, Wang Chenglin, et al. Recognition and Localization Methods for Vision-based Fruit Picking Robots: A Review[J]. Frontiers in Plant Science, 2020, 11: 510.
3	Tang Yunchao, Zhou Hao, Wang Hongjun, et al. Fruit Detection and Positioning Technology for a Camellia Oleifera C. Abel Orchard Based on Improved YOLOv4-tiny Model and Binocular Stereo Vision[J]. Expert Systems with Applications, 2023, 211: 118573.
4	顾生浩, 卢宪菊, 王勇健, 等. 数字孪生系统在农业生产中的应用探讨[J]. 中国农业科技导报, 2021, 23(10): 82-89.
	Gu Shenghao, Lu Xianju, Wang Yongjian, et al. Application of Agricultural Digital Twin System in Crop Production System[J]. Journal of Agricultural Science and Technology, 2021, 23(10): 82-89.
5	Tao Fei, Qi Qinglin. Make More Digital Twins[J]. Nature, 2019, 573(7775): 490-491.
6	Grieves M, Vickers J. Digital Twin: Mitigating Unpredictable, Undesirable Emergent Behavior in Complex Systems[M]//Kahlen F J, Flumerfelt S, Alves A. Transdisciplinary Perspectives on Complex Systems: New Findings and Approaches. Cham: Springer International Publishing, 2017: 85-113.
7	陶飞, 刘蔚然, 刘检华, 等. 数字孪生及其应用探索[J]. 计算机集成制造系统, 2018, 24(1): 1-18.
	Tao Fei, Liu Weiran, Liu Jianhua, et al. Digital Twin and Its Potential Application Exploration[J]. Computer Integrated Manufacturing Systems, 2018, 24(1): 1-18.
8	陶飞, 马昕, 戚庆林, 等. 数字孪生连接交互理论与关键技术[J]. 计算机集成制造系统, 2023, 29(1): 1-10.
	Tao Fei, Ma Xin, Qi Qinglin, et al. Theory and Key Technologies of Digital Twin Connection and Interaction[J]. Computer Integrated Manufacturing Systems, 2023, 29(1): 1-10.
9	Wang Baicun, Zheng Pai, Yin Yue, et al. Toward Human-centric Smart Manufacturing: A Human-cyber-physical Systems (HCPS) Perspective[J]. Journal of Manufacturing Systems, 2022, 63: 471-490.
10	Lee J, Bagheri B, Kao H A. A Cyber-physical Systems Architecture for Industry 4.0-based Manufacturing Systems[J]. Manufacturing Letters, 2015, 3: 18-23.
11	Jiang J R. An Improved Cyber-physical Systems Architecture for Industry 4.0 Smart Factories[J]. Advances in Mechanical Engineering, 2018, 10(6): 1-15.
12	Alam K M, El Saddik A. C2PS: A Digital Twin Architecture Reference Model for the Cloud-based Cyber-physical Systems[J]. IEEE Access, 2017, 5: 2050-2062.
13	Wang Ziran, Gupta R, Han K, et al. Mobility Digital Twin: Concept, Architecture, Case Study, and Future Challenges[J]. IEEE Internet of Things Journal, 2022, 9(18): 17452-17467.
14	周成, 孙恺庭, 李江, 等. 基于数字孪生的车间三维可视化监控系统[J]. 计算机集成制造系统, 2022, 28(3): 758-768.
	Zhou Cheng, Sun Kaiting, Li Jiang, et al. Workshop 3D Visual Monitoring System Based on Digital Twin[J]. Computer Integrated Manufacturing Systems, 2022, 28(3): 758-768.
15	赵浩然, 刘检华, 熊辉, 等. 面向数字孪生车间的三维可视化实时监控方法[J]. 计算机集成制造系统, 2019, 25(6): 1432-1443.
	Zhao Haoran, Liu Jianhua, Xiong Hui, et al. 3D Visualization Real-time Monitoring Method for Digital Twin Workshop[J]. Computer Integrated Manufacturing Systems, 2019, 25(6): 1432-1443.
16	Hemming Silke, Feije de Zwart, Elings Anne, et al. Cherry Tomato Production in Intelligent Greenhouses-sensors and AI for Control of Climate, Irrigation, Crop Yield, and Quality[J]. Sensors, 2020, 20(22): 6430.
17	Daniel Anthony Howard, Ma Zheng, Jesper Mazanti Aaslyng, et al. Data Architecture for Digital Twin of Commercial Greenhouse Production[C]//2020 RIVF International Conference on Computing and Communication Technologies (RIVF). Piscataway, NJ, USA: IEEE, 2020: 1-7.
18	Melesse Tsega Y, Bollo Matteo, Valentina Di Pasquale, et al. Machine Learning-based Digital Twin for Monitoring Fruit Quality Evolution[J]. Procedia Computer Science, 2022, 200: 13-20.
19	Zhang Qinglei, Yang Zhiwei, Duan Jianguo, et al. Three-dimensional Visualization Interactive System for Digital Twin Workshop[J]. Journal of Southeast University(English Edition), 2021, 37(2): 137-152.
20	李浩, 刘根, 文笑雨, 等. 面向人机交互的数字孪生系统工业安全控制体系与关键技术[J]. 计算机集成制造系统, 2021, 27(2): 374-389.
	Li Hao, Liu Gen, Wen Xiaoyu, et al. Industrial Safety Control System and Key Technologies of Digital Twin System Oriented to Human-machine Interaction[J]. Computer Integrated Manufacturing Systems, 2021, 27(2): 374-389.
21	Lin Junqiang, Zhang Po, Li Chengen, et al. APF-DPPO: An Automatic Driving Policy Learning Method Based on the Artificial Potential Field Method to Optimize the Reward Function[J]. Machines, 2022, 10(7): 533.
22	罗陆锋, 邹湘军, 刘天湖, 等. 大数据量虚拟景观的三维模型优化与漫游[J]. 系统仿真学报, 2009, 21(6): 1654-1657.
	Luo Lufeng, Zou Xiangjun, Liu Tianhu, et al. 3D Model Optimization and Navigation of Large-scale Virtual Landscape[J]. Journal of System Simulation, 2009, 21(6): 1654-1657.
23	林俊强, 王红军, 邹湘军, 等. 基于DPPO的移动采摘机器人避障路径规划及仿真[J]. 系统仿真学报, 2023, 35(8): 1692-1704.
	Lin Junqiang, Wang Hongjun, Zou Xiangjun, et al. Obstacle Avoidance Path Planning and Simulation of Mobile Picking Robot Based on DPPO[J]. Journal of System Simulation, 2023, 35(8): 1692-1704.
24	董力中. 荔枝果园智能监测关键技术研究[D]. 广州: 华南农业大学, 2020.
	Dong Lizhong. Research on Key Technologies of Litchi Orchard Intelligent Monitoring[D]. Guangzhou: South China Agricultural University, 2020.
25	陶飞, 刘蔚然, 张萌, 等. 数字孪生五维模型及十大领域应用[J]. 计算机集成制造系统, 2019, 25(1): 1-18.
	Tao Fei, Liu Weiran, Zhang Meng, et al. Five-dimension Digital Twin Model and Its Ten Applications[J]. Computer Integrated Manufacturing Systems, 2019, 25(1): 1-18.

[1]	王远, 徐琳, 宫小泽, 张永亮, 王永利. 基于梯度的深度强化学习解释方法[J]. 系统仿真学报, 2024, 36(5): 1130-1140.
[2]	梁宏涛, 孔翎超, 刘国柱, 董文轩, 刘香怡. 融合数字孪生的风电机组故障检测ASL-CatBoost方法[J]. 系统仿真学报, 2024, 36(4): 873-887.
[3]	胡阳, 王蔚然, 房方, 宋子秋, 许昱涵, 刘吉臻. 风电机组运行动态数字孪生建模及半物理仿真[J]. 系统仿真学报, 2024, 36(3): 636-648.
[4]	秦保新, 张羽霄, 吴思锐, 曹卫冲, 李湛. 基于改进D3QN的煤炭码头卸车排产智能优化方法[J]. 系统仿真学报, 2024, 36(3): 770-781.
[5]	赵莹莹, 董普森, 朱天晨, 李凡, 苏运, 邰振赢, 孙庆赟, 凡航. 面向电网拓扑调度仿真的采样效率优化方法研究[J]. 系统仿真学报, 2024, 36(2): 283-295.
[6]	王鑫鹏, 傅汇乔, 邓归洲, 唐开强, 陈春林, 留沧海. 基于DRL和自由步态的六足机器人运动规划研究[J]. 系统仿真学报, 2024, 36(2): 373-384.
[7]	潘海南, 陈柏良, 黄开宏, 任君凯, 程创, 卢惠民, 张辉. 基于深度强化学习的履带机器人摆臂控制方法[J]. 系统仿真学报, 2024, 36(2): 405-414.
[8]	阴艳超, 冯嘉胜, 易斌, 李旺, 尹庆文. 面向流程制造的数字孪生车间可视化监控系统研究[J]. 系统仿真学报, 2024, 36(1): 120-130.
[9]	赵彦博, 蔡远利, 胡怀中. 基于递推子空间的机组数字孪生模型预测精度优化方法[J]. 系统仿真学报, 2024, 36(1): 195-202.
[10]	钟竞辉, 林育钿, 李稳强, 蔡文桐. 基于数字孪生的机场人群智慧管控技术[J]. 系统仿真学报, 2024, 36(1): 27-38.
[11]	安靖, 司光亚, 张雷. 基于深度强化学习的立体投送策略优化方法研究[J]. 系统仿真学报, 2024, 36(1): 39-49.
[12]	袁标, 黄友锐, 徐善永, 荣雪. 光纤二次套塑车间数字孪生系统的构建与应用[J]. 系统仿真学报, 2023, 35(9): 2011-2022.
[13]	林俊强, 王红军, 邹湘军, 张坡, 李承恩, 周益鹏, 姚书杰. 基于DPPO的移动采摘机器人避障路径规划及仿真[J]. 系统仿真学报, 2023, 35(8): 1692-1704.
[14]	刘家义, 王刚, 付强, 郭相科, 王思远. 基于分配策略优化算法的智能防空任务分配[J]. 系统仿真学报, 2023, 35(8): 1705-1716.
[15]	杨来义, 毕敬, 苑海涛. 基于SAC算法的移动机器人智能路径规划[J]. 系统仿真学报, 2023, 35(8): 1726-1736.

基于数字孪生的果园虚拟交互系统构建

Construction of a Virtual Interactive System for Orchards Based on Digital Twin

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

图/表 16

参考文献 25

相关文章 15

编辑推荐

Metrics

本文评价