Journal of System Simulation ›› 2023, Vol. 35 ›› Issue (8): 1737-1747.doi: 10.16182/j.issn1004731x.joss.22-0434
•
Lü Nan1(
), Qibing Wang1, Jiawei Lu1, Juntong Chen2, Gang Xiao1()
Received:2022-04-29
Revised:2022-07-14
Online:2023-08-25
Published:2023-08-15
Lü Nan, Qibing Wang, Jiawei Lu, Juntong Chen, Gang Xiao. Monitoring Method Research on Passenger Behavior on Escalator Based on Digital Twin[J]. Journal of System Simulation, 2023, 35(8): 1737-1747.
Fig. 1
Four-dimensional model of digital twin escalator passenger behavior monitoring system
Fig. 2
Construction of escalator virtual scene
Fig. 3
OpenPose frame
Fig. 4
2D vector field of attitude key points
Fig. 5
Flow chart of human posture recognition and monitoring system
Fig. 6
I-OpenPose framework fusion diagram
Fig. 7
COCO dataset human key point annotation
Fig. 8
Data enhancement in digital twin virtual environment
Fig. 9
Virtual character behavior construction process in digital twin
Fig. 10
Virtual human behavior of human pose classification results
Table 1
Response time of each part of monitoring system s
| 姿态安全等级 | 监测系统 | 虚拟人物 | 停止 |
|---|---|---|---|
| 安全 | 0.877 | 1.675 | 无 |
| 警告 | 0.875 | 1.686 | 无 |
| 危险 | 0.871 | 1.619 | 1.235 |
Fig. 11
I-OpenPose pose recognition results
Table 2
Comparison of attitude recognition effect of bottom-up method
| 模型 | AP | AP 50 | AP 75 | AP M | AP L |
|---|---|---|---|---|---|
| METU[ | 70.5 | 87.7 | 77.2 | 66.1 | 77.3 |
| OpenPose[ | 61.8 | 84.9 | 67.5 | 57.1 | 68.2 |
| I-OpenPose | 65.4 | 89.7 | 73.3 | 61.5 | 74.7 |
Fig. 12
Attitude recognition results for occlusion and overlap
Fig. 13
Attitude recognition results of background color aliasing
Fig. 14
Passenger behavior monitoring interface
Table 3
Human body posture recognition results
| 图像数量 | 人体数量 | 部位 | 正确率/% | 平均耗时/ms |
|---|---|---|---|---|
| 500 | 1 656 | 头部 | 91.4 | 37.4 |
| 肩部 | 87.6 | |||
| 膝部 | 70.8 |
Table 4
Accuracy of SVM classification verification
| 姿态安全 等级 | 姿态分类 | 分类 正确率/% | 平均耗时/ms |
|---|---|---|---|
| 安全 | 直立 | 93.6 | 0.344 |
| 警告 | 弯腰 | 94.6 | 0.357 |
| 前倾 | 91.8 | 0.349 | |
| 后仰 | 91.2 | 0.347 | |
| 危险 | 跌倒 | 98.4 | 0.351 |
Fig. 15
Actual image data to validate the classifier
| 1 |
|
| 2 |
李欣, 刘秀, 万欣欣. 数字孪生应用及安全发展综述[J]. 系统仿真学报, 2019, 31(3): 385-392.
|
|
|
|
| 3 |
|
| 4 |
肖通, 江海凡, 丁国富, 等. 五轴磨床数字孪生建模与监控研究[J]. 系统仿真学报, 2021, 33(12): 2880-2890.
|
|
|
|
| 5 |
|
| 6 |
|
| 7 |
何慧霞, 魏桂英, 武森, 等. 智能制造评价理论研究现状及未来展望[J]. 中国工程科学, 2022, 24(2): 56-63.
|
|
|
|
| 8 |
耿艺宁, 刘帅师, 刘泰廷, 等. 基于计算机视觉的行人检测技术综述[J]. 计算机应用, 2021, 41(增1): 43-50.
|
|
|
|
| 9 |
袁庆曙, 王若楠, 潘志庚, 等. 空间增强现实中的人机交互技术综述[J]. 计算机辅助设计与图形学学报, 2021, 33(3): 321-332.
|
|
|
|
| 10 |
|
| 11 |
|
| 12 |
宋学官, 何西旺, 李昆鹏, 等. 人体骨骼数字孪生的构建方法及应用[J]. 机械工程学报, 2022, 58(18): 218-228.
|
|
|
|
| 13 |
|
| 14 |
|
| 15 |
中华人民共和国国家质量监督检验检疫总局, 中国国家标准化管理委员会. 自动扶梯和自动人行道的制造与安装安全规范: GB 16899-2011 [S]. 北京: 中国标准出版社, 2011: 76.
|
|
General Administration of Quality Supervision, Inspection and Quarantine of the People's Republic of China, Standardization Administration of China. Safety Rules for the Construction and Installation of Escalators and Moving Walks: GB 16899-2011 [S]. Beijing: Standards Press of China, 2011: 76.
|
|
| 16 |
陶飞, 刘蔚然, 张萌, 等. 数字孪生五维模型及十大领域应用[J]. 计算机集成制造系统, 2019, 25(1): 1-18.
|
|
|
|
| 17 |
金绍勋, 黄继小, 赵志刚, 等. 基于Socket服务器的Zynq平台微型高光谱仪实时视频预览系统[J]. 仪表技术与传感器, 2021(1): 38-42.
|
|
|
|
| 18 |
|
| 19 |
周开伟, 钱雪忠, 周世兵. 一种改进的多分类孪生支持向量机[J]. 计算机应用与软件, 2022, 39(4): 269-274, 299.
|
|
|
|
| 20 |
梁华刚, 温晓倩, 梁丹丹, 等. 多级卷积特征金字塔的细粒度食物图片识别[J]. 中国图象图形学报, 2019, 24(6): 870-881.
|
|
|
|
| 21 |
|
| [1] | Han Lu, Lin Zhang, Kunyu Wang, Zejun Huang, Hongbo Cheng, Jin Cui. A Framework on Equipment Digital Twin Credibility Assessment [J]. Journal of System Simulation, 2023, 35(7): 1455-1471. |
| [2] | Jian Xu, Xin Song, Xiuping Liu, Bo Chen, Huanying Yan. Modeling and System Realization of Assembly Robot Based on Digital Twin [J]. Journal of System Simulation, 2023, 35(7): 1497-1507. |
| [3] | Ze Dong, Wei Jiang, Xiaoyan Wang, Lei Liu. Application of Digital Twin in Digital Transformation of Thermal Power Units [J]. Journal of System Simulation, 2023, 35(6): 1144-1156. |
| [4] | Shun Yao, Zhongzhi Hu, Wenyu Cao, Jiali Yang. Research and Development of Immersive Aero-engine Scene Simulation System [J]. Journal of System Simulation, 2023, 35(6): 1395-1404. |
| [5] | Hongbin Liu, Zhiqiang Shen, Yize Wang, Ming Qiu, Wenrong Lin. Application of Digital Twin Model in Grinding of Bearing Rings [J]. Journal of System Simulation, 2023, 35(3): 557-567. |
| [6] | Fan Yang, Ping Ma, Wei Li, Ming Yang. Research on Digital Twin Credibility Assessment Process and Index [J]. Journal of System Simulation, 2023, 35(2): 350-358. |
| [7] | Bohu Li, Xudong Chai, Lin Zhang, Duzheng Qing, Guoqiang Shi, Tingyu Lin, Liqin Guo, Chen Yang, Mu Gu, Zhengxuan Jia, Hui Gong, Zhen Tang. New Embedded Simulation Technology for Smart Internet of Things [J]. Journal of System Simulation, 2022, 34(3): 419-441. |
| [8] | Dinghui Wu, Tongrui Zhang, Xiuli Zhang. Job Shop Rescheduling Under Recessive Disturbance Based on Digital Twin [J]. Journal of System Simulation, 2022, 34(3): 573-583. |
| [9] | Bisheng He, Peng Chen, Hongxiang Zhang, Gongyuan Lu, Chunhui Zhang. Real-time Scheduling Method for Railway Passenger Station Operations Based on Digital Twin [J]. Journal of System Simulation, 2022, 34(10): 2130-2141. |
| [10] | Shu Liang, Zhang Jie, Yang Yanfang, Yang Miao, Wu Ziran. Dynamic Control of Twin-workshop Model of Circuit Breaker Considering Takt Time Constraints [J]. Journal of System Simulation, 2021, 33(6): 1277-1287. |
| [11] | Liu Yu, Xie Qiang. Technical Characteristics of Digital Twins and Application Prospects in the Field of Flight Testing [J]. Journal of System Simulation, 2021, 33(6): 1364-1373. |
| [12] | Zhang Lin, Lu Han. Discussing Digital Twin from of Modeling and Simulation [J]. Journal of System Simulation, 2021, 33(5): 995-1007. |
| [13] | Wu Zhaohui, Liu Zhenzheng, Shi Ke, Wang Liang, Liang Xiaojie. Review on the Construction and Application of Digital Twins in Transportation Scenes [J]. Journal of System Simulation, 2021, 33(2): 295-305. |
| [14] | Xiao Tong, Jiang Haifan, Ding Guofu, Jiang Lei, Ma Shuwen. Research on Digital Twin-based Modeling and Monitoring of Five-axis Grinder [J]. Journal of System Simulation, 2021, 33(12): 2880-2890. |
| [15] | Wang Junfeng, Zhang Yufan, Shao Yaoqi, Li Shiqi. Research on Simulation Data Mapping for Production Performance Digital Twin [J]. Journal of System Simulation, 2021, 33(10): 2470-2477. |
| Viewed | ||||||
|
Full text |
|
|||||
|
Abstract |
|
|||||
http://www.china-simulation.com
