Parallel Live Performance Simulation Based on a Multidimensional Hierarchy and Application

doi:10.16182/j.issn1004731x.joss.21-0271E

Abstract

Abstract:

A parallel simulation method is proposed for modern live performance. By decomposing the live performance process from the top down, this method assists creators in delivering stage design and control with time and space constraints, which is unattainable for traditional live performances. A multi-layer constraint hierarchy is constructed to apply parallel simulation to art performances. The live performance procedure is continuously optimized by leveraging the circulation of data between virtual and physical stages. The parallel simulation method for stage space has been applied to a digital TV stage for ten years. The experiments show that parallel live performance simulation based on a multidimensional hierarchy can effectively assist with the whole live performance process and promote live performance efficiency.

Key words: parallel simulation, modern live performance, multi-layer constraint hierarchy, whole process

CLC Number:

TP391.9

Jingsi Yang, Tianyu Huang, Gangyi Ding, Lijie Li, Peng Li. Parallel Live Performance Simulation Based on a Multidimensional Hierarchy and Application[J]. Journal of System Simulation, 2022, 34(8): 1750-1761.

Figures/Tables 14

Fig. 1

Fig. 2

Fig. 3

Table 1

Fig. 4

Fig. 5

Fig. 6

Fig. 7

Fig. 8

Fig. 9

Fig. 10

Fig. 11

Fig. 12

Fig. 13

References 27

1	Wang F Y. Shadow Systems: a New Concept for Nested and Embedded Simulation for Intelligent Systems[R]. Tucson, Arizona State, USA: University of Arizona, 1994.
2	Wang K F, Gou C, Zheng N N, et al. Parallel Vision for Perception and Understanding of Complex Scenes: Methods, Framework, and Perspectives[J]. Artificial Intelligence Review(S0269-2821), 2017, 48(3): 299-329.
3	Wang F Y, Tang S. Artiﬁcial Societies for Integrated and Sustainable Development of Metropolitan Systems[J]. IEEE Intelligent Systems(S1541-1672), 2004, 19(4): 82-87.
4	Wang F Y. Parallel Control and Management for Intelligent Transportation Systems: Concepts, Architectures, and Applications[J]. IEEE Transactions on Intelligent Transportation Systems(S1524-9050), 2010, 11(3):630-638.
5	Grieves M. PLM-Beyond Lean Manufacturing[J]. Manufacturing Engineering(S0361-0853), 2003, 130(3): 23-25.
6	Glaessgen E, Stargel D. The Digital Twin Paradigm for Future NASA and US Air Force Vehicles[C]// 53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference 20th AIAA/ASME/AHS Adaptive Structures Conference 14th AIAA; 2012 Apr 23-26. Honolulu, HI, USA. Reston: American Institute of Aeronautics and Astronautics, 2012: 1818.
7	Grieves M, Vickers J. Transdisciplinary Perspectives on Complex Systems[M]. Berlin, Germany: Springer Verlag, 2017: 85-113.
8	Grieves M. Mitigating Systems Complexity & Unintended Systems Emergent Behaviors through NASA's Digital Twin Strategy[C]//PI Congress Dusseldorf Research Gate. 2015: 2-25.
9	Schroeder G, Steinmetz C, Pereira C E, et al. Visualizing the Digital Twin using Web Services and Augmented Reality[C]//14th International Conference on Industrial Informatics (INDIN). Poitiers, France: IEEE, 2016: 522-527.
10	Tao F, Cheng J, Qi Q, et al. Digital Twin-Driven Product Design, Manufacturing and Service with Big Data[J]. The International Journal of Advanced Manufacturing Technology (S0268-3768), 2018, 94: 3563-3576.
11	Tao F, Zhang M, Liu Y, et al. Digital Twin Driven Prognostics and Health Management for Complex Equipment[J]. CIRP Annals(S0007-8506), 2018, 67(1): 169-172.
12	Alam K M, Saddik A E. C2ps: A Digital Twin Architecture Reference Model for the Cloud-Based Cyber-Physical Systems[J]. IEEE Access(S2169-3536), 2017, 5: 2050-2062.
13	Tavares P, Joao A S, Costa P, et al. Flexible Work Cell Simulator Using Digital Twin Methodology for Highly Complex Systems in Industry 4.0[C]//Iberian Robotics Conference. 2017: 541-552.
14	Graessler I, Poehler A. Integration of a Digital Twin as human Representation in a Scheduling Procedure of a Cyber-Physical Production System[C]//2017 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), 2017: 289-293. doi: 10.1109/IEEM.2017.8289898 .
15	He Y, Guo J, Zheng X. From Surveillance to Digital Twin: Challenges and Recent Advances of Signal Processing for Industrial Internet of Things[J]. IEEE Signal Processing Magazine(S1053-5888), 2018, 35(5): 120-129.
16	Tuegel E J, Ingraffea A R, Eason T G, et al. Reengineering Aircraft Structural Life Prediction Using a Digital Twin[J]. International Journal of Aerospace Engineering(S1687-5966), 2011: 154798.
17	Tao F, Zhang M, Nee A. Digital Twin Driven Smart Manufacturing[M]. Amsterdam, Netherlands: Elsevier, 2019: 257-269.
18	Iglesias D, Bunting P, Esquembri S, et al. Digital Twin Applications for the JET Divertor[J]. Fusion Engineering & Design(S0920-3796), 2017, 125: 71-76.
19	Sderberg R, Wrmefjord K, Carlson J S, et al. Toward a Digital Twin for Real-Time Geometry Assurance in Individualized Production[J]. Cirp Annals Manufacturing Technology(S0007-8506), 2017, 66(1): 134-140.
20	Brenner B, Hummel V. Digital Twin as Enabler for an Innovative Digital Shopfloor Management System in the ESB Logistics Learning Factory at Reutlingen-University[J]. Procedia Manufacturing(S2351-9789), 2017, 9: 198-205.
21	Geris L, Lambrechts T, Aurélie C, et al. The Future is Digital: In Silico Tissue Engineering[J]. Current Opinion in Biomedical Engineering(S2468-4511), 2018, 6: 92-98.
22	Brosinsky C, Westermann D, Krebs R. Recent and Prospective Developments in Power System Control Centers: Adapting the Digital Twin Technology for Application in Power System Control Centers[C]// 2018 IEEE International Energy Conference (Energycon). 2018: 1-6.
23	Yun S, Park J H, Kim W T. Data-Centric Middleware Based Digital Twin Platform for Dependable Cyber-Physical Systems[C]// 2017 Ninth International Conference on Ubiquitous and Future Networks (ICUFN). 2017: 922-926.
24	Prifling B, Neumann M, Hlushkou D, et al. Generating Digital Twins of Mesoporous Silica by Graph-Based Stochastic Microstructure Modeling[J]. Computational Materials Science(S0927-0256), 2021, 187(9): 109934.
25	Yan S, Ding G Y, Li H, et al. Enhancing Audience Engagement in Performing Arts Through an Adaptive Virtual Environment with a Brain-Computer Interface[C]// 21st International Conference on Intelligent User Interfaces (IUI'16). New York: Association for Computing Machinery, 2016: 306-316.
26	Yan S, Ding G, Li H, et al. Exploring Audience Response in Performing Arts with a Brain-Adaptive Digital Performance System[J]. The ACM Transactions on Interactive Intelligent Systems(S2160-6455), 2017, 7(4): 1-28.
27	Jones C B. Systematic Software Development Using VDM[M]. Prentice Hall International (UK) Ltd., GBR, 1986.

Layer	Symbol	Example	Structure
Condition	Cons	Programs	condition-name; condition-component; condition-behavior
Behavior	Bs	Order of scene changing	behavior-name; behavior-component; behavior-sequence
Sequence	Ses	Data changing between two scenes	sequence-name; start-time; end-time; state
State	Sts	Location and mapping texture	state-name; state-info
Component	Coms	Stage blocks	component-name; component-state

[1]	Yanqiang Di, Ting Li, Shaochong Feng, Qiongyao Liu, Jianhong Lü, Zhijia Chen, Yang Zhang, Pengfei Cao. Parallel Simulation System of Equipment Precision Maintenance Based on Cloud-Edge-End Architecture [J]. Journal of System Simulation, 2022, 34(09): 1909-1919.
[2]	Lin Zhongwei, Li Xiuhe, Yao Yiping, Shen Yang, Dai Shaoqi, Shi Qianqian. Research on Simulation Object Interfaces Oriented to Plug-in-play Pattern [J]. Journal of System Simulation, 2021, 33(9): 2202-2214.
[3]	Qu Hongchun, Yao Xianhui, Yin Li. Parallel Computing of Multi-Agent System in Spatially-Explicit Modeling and Simulation [J]. Journal of System Simulation, 2020, 32(3): 446-454.
[4]	Wang Qin, Ma Zhaocan, Li Hongliang, Zhang Linbo, Lu Benzhuo. Parallel Finite Element Simulations on Radiation Damage Effects of Lateral PNP BJTs [J]. Journal of System Simulation, 2020, 32(12): 2376-2382.
[5]	Tan Yaxin, Luo Jianhua, Fan Rui, Dong Zhiming. A Parallel Simulation Method for Combat organization and Implementation [J]. Journal of System Simulation, 2019, 31(11): 2350-2355.
[6]	Ge Chenglong, Zhu Yuanchang, Di Yanqiang, Hu Zhiwei, Dong Zhihua. Equipment RUL Prediction Oriented Parallel Simulation Framework [J]. Journal of System Simulation, 2018, 30(6): 2216-2224.
[7]	Zhai Yanlong, Jia Nana, Zhang Xinyu, Yang Kai, Qing Duzheng. Topology-aware Dynamic Load-balancing of Conservative Simulation [J]. Journal of System Simulation, 2015, 27(9): 2008-2014.
[8]	Chen Hongyong, Fan Xuanhua, Wang Keying, Fang Ye, Xiao Shifu. Research on Dynamic Characteristics of Hypersonic Vehicle Based on Large Scale Parallel Simulation [J]. Journal of System Simulation, 2015, 27(8): 1715-1720.
[9]	Sun Xuegong, Gong Chunye. Research on Parallel Simulation of Hypersonic Vehicles [J]. Journal of System Simulation, 2015, 27(5): 948-958.