Journal of System Simulation ›› 2024, Vol. 36 ›› Issue (12): 2971-2983.doi: 10.16182/j.issn1004731x.joss.23-1233
• Papers • Previous Articles Next Articles
Miao Tianyue, Wang Lu, He Jiaxiao, Xie Nenggang
Received:2023-10-12
Revised:2023-11-12
Online:2024-12-20
Published:2024-12-20
Contact:
Wang Lu
CLC Number:
Miao Tianyue, Wang Lu, He Jiaxiao, Xie Nenggang. Research on Digital Twin Simulation Method of Industrial Robot Integrated with Reinforcement Learning[J]. Journal of System Simulation, 2024, 36(12): 2971-2983.
| 1 | Bajic Bojana, Rikalovic Aleksandar, Suzic Nikola, et al. Industry 4.0 Implementation Challenges and Opportunities: A Managerial Perspective[J]. IEEE Systems Journal, 2021, 15(1): 546-559. |
| 2 | 徐健, 刘高峰, 赵一剑, 等. 装配机器人的数字孪生虚实同步及抓取方法[J/OL]. 系统仿真学报. (2023-09-15) [2023-09-20]. . |
| Xu Jian, Liu Gaofeng, Zhao Yijian, et al. Virtual and Real Synchronization and Grasping Method of Digital Twin for Assembly Robot[J/OL]. Journal of System Simulation. (2023-09-15) [2023-09-20]. . | |
| 3 | 张霖, 陆涵. 从建模仿真看数字孪生[J]. 系统仿真学报, 2021, 33(5): 995-1007. |
| Zhang Lin, Lu Han. Discussing Digital Twin from of Modeling and Simulation[J]. Journal of System Simulation, 2021, 33(5): 995-1007. | |
| 4 | 张冰, 李欣, 万欣欣. 从数字孪生到数字工程建模仿真迈入新时代[J]. 系统仿真学报, 2019, 31(3): 369-376. |
| Zhang Bing, Li Xin, Wan Xinxin. From Digital Twin to Digital Engineering Modeling and Simulation Entering a New Era[J]. Journal of System Simulation, 2019, 31(3): 369-376. | |
| 5 | 赵浩然, 刘检华, 熊辉, 等. 面向数字孪生车间的三维可视化实时监控方法[J]. 计算机集成制造系统, 2019, 25(6): 1432-1443. |
| Zhao Haoran, Liu Jianhua, Xiong Hui, et al. 3D Visualization Real-time Monitoring Method for Digital Twin Workshop[J]. Computer Integrated Manufacturing Systems, 2019, 25(6): 1432-1443. | |
| 6 | 王栎淇, 范维, 陈传军, 等. 基于实时数据驱动的车间输送线数字孪生系统研究与实现[J]. 制造业自动化, 2023, 45(8): 171-177. |
| Wang Liqi, Fan Wei, Chen Chuanjun, et al. Research and Implementation of Digital Twin System of Workshop Conveyor Line Based on Real-time Data[J]. Manufacturing Automation, 2023, 45(8): 171-177. | |
| 7 | 杜莹莹, 罗映, 彭义兵, 等. 基于数字孪生的工业机器人三维可视化监控[J]. 计算机集成制造系统, 2023, 29(6): 2130-2138. |
| Du Yingying, Luo Ying, Peng Yibing, et al. 3D Visual Monitoring System of Industrial Robot Based on Digital Twin[J]. Computer Integrated Manufacturing Systems, 2023, 29(6): 2130-2138. | |
| 8 | 陈玉娇, 曾诗雨, 和红杰, 等. 工业机器人码垛数字孪生系统的研究与实现[J]. 计算机集成制造系统, 2023, 29(6): 1930-1940. |
| Chen Yujiao, Zeng Shiyu, He Hongjie, et al. Research and Implementation of Digital Twin System for Industrial Robot Palletizing[J]. Computer Integrated Manufacturing Systems, 2023, 29(6): 1930-1940. | |
| 9 | 魏新宇, 李玮, 郭志伟, 等. 炭块表面清理数字孪生机器人及其运动控制[J]. 计算机集成制造系统, 2023, 29(6): 1950-1964. |
| Wei Xinyu, Li Wei, Guo Zhiwei, et al. Digital Twin Robot and Its Motion Control for Surface Cleaning of Carbon Block[J]. Computer Integrated Manufacturing Systems, 2023, 29(6): 1950-1964. | |
| 10 | Garg Gaurav, Kuts Vladimir, Anbarjafari Gholamreza. Digital Twin for FANUC Robots: Industrial Robot Programming and Simulation Using Virtual Reality[J]. Sustainability, 2021, 13(18): 10336. |
| 11 | 陶飞, 张辰源, 戚庆林, 等. 数字孪生成熟度模型[J]. 计算机集成制造系统, 2022, 28(5): 1267-1281. |
| Tao Fei, Zhang Chenyuan, Qi Qinglin, et al. Digital Twin Maturity Model[J]. Computer Integrated Manufacturing Systems, 2022, 28(5): 1267-1281. | |
| 12 | 阴艳超, 冯嘉胜, 易斌, 等. 面向流程制造的数字孪生车间可视化监控系统研究[J]. 系统仿真学报, 2024, 36(1): 120-130. |
| Yin Yanchao, Feng Jiasheng, Yi Bin, et al. Visual Monitoring System of Digital Twin Workshop for Process Manufacturing[J]. Journal of System Simulation, 2024, 36(1): 120-130. | |
| 13 | 刘贝贝, 袁亮, 孔庆博, 等. 6自由度工业机器人运动轨迹优化方法研究[J]. 组合机床与自动化加工技术, 2020(2): 11-15. |
| Liu Beibei, Yuan Liang, Kong Qingbo, et al. Research on Motion Trajectory Optimization Method of 6-DOF Industrial Robot[J]. Modular Machine Tool & Automatic Manufacturing Technique, 2020(2): 11-15. | |
| 14 | Craig J J. 机器人学导论[M]. 贠超, 译. 北京: 机械工业出版社, 2006: 1-94. |
| Craig J J. Introduction to Robotics Mechanics and Control[M]. Translated by Yun Chao. Beijing: China Machine Press, 2006: 1-94. | |
| 15 | Liu Chuzhao, Gao Junyao, Bi Yuanzhen, et al. A Multitasking-oriented Robot Arm Motion Planning Scheme Based on Deep Reinforcement Learning and Twin Synchro-control[J]. Sensors, 2020, 20(12): 3515. |
| 16 | Xie Jiexin, Shao Zhenzhou, Li Yue, et al. Deep Reinforcement Learning with Optimized Reward Functions for Robotic Trajectory Planning[J]. IEEE Access, 2019, 7: 105669-105679. |
| 17 | 马天, 席润韬, 吕佳豪, 等. 基于深度强化学习的移动机器人三维路径规划方法[J]. 计算机应用, 2024, 44(7): 2055-2064. |
| Ma Tian, Xi Runtao, Jiahao Lü, et al. Mobile Robot 3D Space Path Planning Method Based on Deep Reinforcement Learning[J]. Journal of Computer Applications, 2024, 44(7): 2055-2064. |
| [1] | Jiang Ming, He Tao. Solving the Vehicle Routing Problem Based on Deep Reinforcement Learning [J]. Journal of System Simulation, 2025, 37(9): 2177-2187. |
| [2] | Lu Houjun, Zhu Yifei, Rong Yanping, Zhang Wanghui. Digital Twin Modeling Method for Bulk Cargo Stacks Based on 2D LiDAR [J]. Journal of System Simulation, 2025, 37(9): 2269-2286. |
| [3] | Ni Peilong, Mao Pengjun, Wang Ning, Yang Mengjie. Robot Path Planning Based on Improved A-DDQN Algorithm [J]. Journal of System Simulation, 2025, 37(9): 2420-2430. |
| [4] | Liu Yongkui, Yang Kang, Tuo Benben, Pan Yaduo, Wang Xinyu, Wang Yihan, Gong Yongqian, Zhang Lin, Wang Lihui, Lin Tingyu, Zi Bin, Li Yuan, You Wei, Xu Xun. Digital Twinned Industrial Robot: Conceptual Framework, Key Technologies, and Case Study [J]. Journal of System Simulation, 2025, 37(7): 1723-1752. |
| [5] | Chen Zhen, Wu Zhuoyi, Zhang Lin. Research on Policy Representation in Deep Reinforcement Learning [J]. Journal of System Simulation, 2025, 37(7): 1753-1769. |
| [6] | Liu Tao, Li Hanxi, Yin Yong, Liu Jialun. Research Review of Intelligent Navigation Simulation Technology and Its Applications [J]. Journal of System Simulation, 2025, 37(7): 1684-1709. |
| [7] | Chen Qinghua, Liang Zuoyou, Guan Weijuan, Ji Jiadong, Liu Ping. Construction Method of Digital Twin System for High-low Temperature Test Chamber [J]. Journal of System Simulation, 2025, 37(6): 1400-1411. |
| [8] | Gu Xueqiang, Luo Junren, Zhou Yanzhong, Zhang Wanpeng. Survey on Large Language Agent Technologies for Intelligent Game Theoretic Decision-making [J]. Journal of System Simulation, 2025, 37(5): 1142-1157. |
| [9] | Zhang Wenjia, Zhang Heming. Research on Grey-box Modeling Method of Digital Twins for Cantilever Structure [J]. Journal of System Simulation, 2025, 37(5): 1158-1168. |
| [10] | Wu Guohua, Zeng Jiaheng, Wang Dezhi, Zheng Long, Zou Wei. A Quadrotor Trajectory Tracking Control Method Based on Deep Reinforcement Learning [J]. Journal of System Simulation, 2025, 37(5): 1169-1187. |
| [11] | Xu Ming, Li Jinye, Zuo Dongyu, Zhang Jing. Signal Timing Optimization via Reinforcement Learning with Traffic Flow Prediction [J]. Journal of System Simulation, 2025, 37(4): 1051-1062. |
| [12] | Zhang Huimai, Hu Xiaoya, Zhou Chunjie. Digital Twin Framework for the Generation and Optimization of Security Policies for TSN Industrial Control Systems [J]. Journal of System Simulation, 2025, 37(4): 861-874. |
| [13] | Wang Xin, Cui Chenggang, Wang Xiangxiang, Zhu Ping. Research on Economic Dispatching Strategy of CHP Units Based on SRL [J]. Journal of System Simulation, 2025, 37(4): 968-981. |
| [14] | Zhang Lei, Zhang Xuechao, Wang Chao, Bo Xianglei. An Intelligent Ambulance Regulation Model Based on Online Reinforcement Learning Algorithm [J]. Journal of System Simulation, 2025, 37(3): 584-594. |
| [15] | Jiang Lun, Wang Dajiang, Sun Wenlei, Bao Shenghui, Liu Han, Chang Saike. Research on Transformer Fault Diagnosis Method Based on Digital Twin [J]. Journal of System Simulation, 2025, 37(3): 775-790. |
| Viewed | ||||||
|
Full text |
|
|||||
|
Abstract |
|
|||||