Journal of System Simulation ›› 2024, Vol. 36 ›› Issue (12): 2971-2983.doi: 10.16182/j.issn1004731x.joss.23-1233

• Papers • Previous Articles    

Research on Digital Twin Simulation Method of Industrial Robot Integrated with Reinforcement Learning

Miao Tianyue, Wang Lu, He Jiaxiao, Xie Nenggang   

  1. School of Mechanical Engineering, Anhui University of Technology, Maanshan 243032, China
  • Received:2023-10-12 Revised:2023-11-12 Online:2024-12-20 Published:2024-12-20
  • Contact: Wang Lu

Abstract:

In response to the lack of comprehensive functionality and limited application scenarios in the current field of industrial robot digital twin systems, which results in low versatility, a method for constructing a digital twin system for industrial robots with high versatility is proposed. A four-dimensional system architecture for the digital twin is designed, and the components and functions of the four-dimensional system are analyzed, based on the system level planning of the four-dimensional system, the concept of integrating reinforcement learning into the virtual replacement of real concept is defined. By constructing a multi-attribute virtual model and using TCP communication protocol to build a data communication system for virtual-real data interaction, combined with robot forward and inverse kinematic analysis, the virtual-real mapping and control functions are achieved. A reinforcement learning virtual scene is constructed, using a virtual robot model to replace the physical robot for reinforcement learning training, to achieve automatic path planning functionality. The experimental results verify the feasibility and reliability of the developed digital twin system, providing a new solution for further enriching the functionality of industrial robot digital twin systems.

Key words: digital twin, industrial robots, reinforcement learning, four-dimensional model, virtual-real mapping

CLC Number: