Journal of System Simulation ›› 2024, Vol. 36 ›› Issue (12): 2971-2983.doi: 10.16182/j.issn1004731x.joss.23-1233
• Papers • Previous Articles
Miao Tianyue, Wang Lu, He Jiaxiao, Xie Nenggang
Received:
2023-10-12
Revised:
2023-11-12
Online:
2024-12-20
Published:
2024-12-20
Contact:
Wang Lu
CLC Number:
Miao Tianyue, Wang Lu, He Jiaxiao, Xie Nenggang. Research on Digital Twin Simulation Method of Industrial Robot Integrated with Reinforcement Learning[J]. Journal of System Simulation, 2024, 36(12): 2971-2983.
1 | Bajic Bojana, Rikalovic Aleksandar, Suzic Nikola, et al. Industry 4.0 Implementation Challenges and Opportunities: A Managerial Perspective[J]. IEEE Systems Journal, 2021, 15(1): 546-559. |
2 | 徐健, 刘高峰, 赵一剑, 等. 装配机器人的数字孪生虚实同步及抓取方法[J/OL]. 系统仿真学报. (2023-09-15) [2023-09-20]. . |
Xu Jian, Liu Gaofeng, Zhao Yijian, et al. Virtual and Real Synchronization and Grasping Method of Digital Twin for Assembly Robot[J/OL]. Journal of System Simulation. (2023-09-15) [2023-09-20]. . | |
3 | 张霖, 陆涵. 从建模仿真看数字孪生[J]. 系统仿真学报, 2021, 33(5): 995-1007. |
Zhang Lin, Lu Han. Discussing Digital Twin from of Modeling and Simulation[J]. Journal of System Simulation, 2021, 33(5): 995-1007. | |
4 | 张冰, 李欣, 万欣欣. 从数字孪生到数字工程建模仿真迈入新时代[J]. 系统仿真学报, 2019, 31(3): 369-376. |
Zhang Bing, Li Xin, Wan Xinxin. From Digital Twin to Digital Engineering Modeling and Simulation Entering a New Era[J]. Journal of System Simulation, 2019, 31(3): 369-376. | |
5 | 赵浩然, 刘检华, 熊辉, 等. 面向数字孪生车间的三维可视化实时监控方法[J]. 计算机集成制造系统, 2019, 25(6): 1432-1443. |
Zhao Haoran, Liu Jianhua, Xiong Hui, et al. 3D Visualization Real-time Monitoring Method for Digital Twin Workshop[J]. Computer Integrated Manufacturing Systems, 2019, 25(6): 1432-1443. | |
6 | 王栎淇, 范维, 陈传军, 等. 基于实时数据驱动的车间输送线数字孪生系统研究与实现[J]. 制造业自动化, 2023, 45(8): 171-177. |
Wang Liqi, Fan Wei, Chen Chuanjun, et al. Research and Implementation of Digital Twin System of Workshop Conveyor Line Based on Real-time Data[J]. Manufacturing Automation, 2023, 45(8): 171-177. | |
7 | 杜莹莹, 罗映, 彭义兵, 等. 基于数字孪生的工业机器人三维可视化监控[J]. 计算机集成制造系统, 2023, 29(6): 2130-2138. |
Du Yingying, Luo Ying, Peng Yibing, et al. 3D Visual Monitoring System of Industrial Robot Based on Digital Twin[J]. Computer Integrated Manufacturing Systems, 2023, 29(6): 2130-2138. | |
8 | 陈玉娇, 曾诗雨, 和红杰, 等. 工业机器人码垛数字孪生系统的研究与实现[J]. 计算机集成制造系统, 2023, 29(6): 1930-1940. |
Chen Yujiao, Zeng Shiyu, He Hongjie, et al. Research and Implementation of Digital Twin System for Industrial Robot Palletizing[J]. Computer Integrated Manufacturing Systems, 2023, 29(6): 1930-1940. | |
9 | 魏新宇, 李玮, 郭志伟, 等. 炭块表面清理数字孪生机器人及其运动控制[J]. 计算机集成制造系统, 2023, 29(6): 1950-1964. |
Wei Xinyu, Li Wei, Guo Zhiwei, et al. Digital Twin Robot and Its Motion Control for Surface Cleaning of Carbon Block[J]. Computer Integrated Manufacturing Systems, 2023, 29(6): 1950-1964. | |
10 | Garg Gaurav, Kuts Vladimir, Anbarjafari Gholamreza. Digital Twin for FANUC Robots: Industrial Robot Programming and Simulation Using Virtual Reality[J]. Sustainability, 2021, 13(18): 10336. |
11 | 陶飞, 张辰源, 戚庆林, 等. 数字孪生成熟度模型[J]. 计算机集成制造系统, 2022, 28(5): 1267-1281. |
Tao Fei, Zhang Chenyuan, Qi Qinglin, et al. Digital Twin Maturity Model[J]. Computer Integrated Manufacturing Systems, 2022, 28(5): 1267-1281. | |
12 | 阴艳超, 冯嘉胜, 易斌, 等. 面向流程制造的数字孪生车间可视化监控系统研究[J]. 系统仿真学报, 2024, 36(1): 120-130. |
Yin Yanchao, Feng Jiasheng, Yi Bin, et al. Visual Monitoring System of Digital Twin Workshop for Process Manufacturing[J]. Journal of System Simulation, 2024, 36(1): 120-130. | |
13 | 刘贝贝, 袁亮, 孔庆博, 等. 6自由度工业机器人运动轨迹优化方法研究[J]. 组合机床与自动化加工技术, 2020(2): 11-15. |
Liu Beibei, Yuan Liang, Kong Qingbo, et al. Research on Motion Trajectory Optimization Method of 6-DOF Industrial Robot[J]. Modular Machine Tool & Automatic Manufacturing Technique, 2020(2): 11-15. | |
14 | Craig J J. 机器人学导论[M]. 贠超, 译. 北京: 机械工业出版社, 2006: 1-94. |
Craig J J. Introduction to Robotics Mechanics and Control[M]. Translated by Yun Chao. Beijing: China Machine Press, 2006: 1-94. | |
15 | Liu Chuzhao, Gao Junyao, Bi Yuanzhen, et al. A Multitasking-oriented Robot Arm Motion Planning Scheme Based on Deep Reinforcement Learning and Twin Synchro-control[J]. Sensors, 2020, 20(12): 3515. |
16 | Xie Jiexin, Shao Zhenzhou, Li Yue, et al. Deep Reinforcement Learning with Optimized Reward Functions for Robotic Trajectory Planning[J]. IEEE Access, 2019, 7: 105669-105679. |
17 | 马天, 席润韬, 吕佳豪, 等. 基于深度强化学习的移动机器人三维路径规划方法[J]. 计算机应用, 2024, 44(7): 2055-2064. |
Ma Tian, Xi Runtao, Jiahao Lü, et al. Mobile Robot 3D Space Path Planning Method Based on Deep Reinforcement Learning[J]. Journal of Computer Applications, 2024, 44(7): 2055-2064. |
[1] | Zhao Baiting, Shi Jianguo, Jia Xiaofen. Research on Digital Twin System of Rockshaft Hoist [J]. Journal of System Simulation, 2024, 36(9): 2054-2064. |
[2] | Li Dongxue, Liu Yan, Shen Boyao, Jing Yongteng, Ma Qiang, Liu Ran. Carbon Footprint Analysis and Low-carbon Optimization Method Simulation Study of Power Transformer Based on Digital Twin Technology [J]. Journal of System Simulation, 2024, 36(9): 2075-2085. |
[3] | Xu Jian, Liu Gaofeng, Zhao Yijian, Zheng Zili, Yan Huanying. The Synchronous Grasping Method of Virtual-real Assembly Robot Based on Digital Twin [J]. Journal of System Simulation, 2024, 36(9): 2181-2192. |
[4] | Cao Yu, Li Jie, Wang Fang, Liu Zhixiang, Wang Xueliang. Digital Twin Method of Stress Field of Deep Submersible Spherical Shell Based on Simulation Database [J]. Journal of System Simulation, 2024, 36(8): 1764-1779. |
[5] | Lei Zhen, Liu Yuhua, Ding Kai, Chen Haoxiang, Li Dongwei. Digital Twin-Driven Structural Thermal Deformation Compensation System for Radio Telescopes [J]. Journal of System Simulation, 2024, 36(8): 1869-1883. |
[6] | Ren Qiankun, Xiong Xinli, Liu Jingju, Yao Qian. Reserach on Digital Twins Technology in Cyberspace Security [J]. Journal of System Simulation, 2024, 36(8): 1944-1957. |
[7] | Sun Yifeng, Li Zhi, Wu Jiang, Wang Yubin. Research on Learnable Wargame Agent Driven by Battle Scheme [J]. Journal of System Simulation, 2024, 36(7): 1525-1535. |
[8] | Li Ying, Gao Lan, Zhu Zhisong. Digital Twin Modeling and Control of Robots for Intelligent Manufacturing Scenarios [J]. Journal of System Simulation, 2024, 36(7): 1536-1545. |
[9] | Jiang Quan, Wei Jingxuan. Real-time Scheduling Method for Dynamic Flexible Job Shop Scheduling [J]. Journal of System Simulation, 2024, 36(7): 1609-1620. |
[10] | Gong Xue, Peng Pengfei, Rong Li, Zheng Yalian, Jiang Jun. Task Analysis Methods Based on Deep Reinforcement Learning [J]. Journal of System Simulation, 2024, 36(7): 1670-1681. |
[11] | Dang Hongjie, Yu Wenguang, Yang Huahui. Digital Application of Equipment System Test and Evaluation Based on Digital Twin and Parallel Experiment Theory [J]. Journal of System Simulation, 2024, 36(7): 1729-1736. |
[12] | Liang Hongtao, Kong Lingchao, Liu Guozhu, Dong Wenxuan, Liu Xiangyi. ASL-CatBoost Method for Wind Turbine Fault Detection Integrated with Digital Twin [J]. Journal of System Simulation, 2024, 36(4): 873-887. |
[13] | Hu Yang, Wang Weiran, Fang Fang, Song Ziqiu, Xu Yuhan, Liu Jizhen. Dynamic Digital Twin Modelling and Semi-Physical Simulation of Wind Turbine Operation [J]. Journal of System Simulation, 2024, 36(3): 636-648. |
[14] | Qin Baoxin, Zhang Yuxiao, Wu Sirui, Cao Weichong, Li Zhan. Intelligent Optimization of Coal Terminal Unloading Scheduling Based on Improved D3QN Algorithm [J]. Journal of System Simulation, 2024, 36(3): 770-781. |
[15] | Zhao Yingying, Dong Pusen, Zhu Tianchen, Li Fan, Su Yun, Tai Zhenying, Sun Qingyun, Fan Hang. Efficiency Optimization Method for Data Sampling in Power Grid Topology Scheduling Simulation [J]. Journal of System Simulation, 2024, 36(2): 283-295. |
Viewed | ||||||
Full text |
|
|||||
Abstract |
|
|||||