虚实融合的探究式实验系统研究

doi:10.16182/j.issn1004731x.joss.21-0847

摘要/Abstract

摘要：

随着个性化教育理念的多元化发展，以着重自主探究、实践能力培养，基于形成性评价的探究式教学受到关注。面向探究式教学的需求，提出了满足探究式学习理论的虚实融合实验系统框架，并以化学实验为例开发了虚实融合系统和交互套件。通过物理传感将用户行为、交互套件、交互界面等多模态信息融合，与真实空间的数字图形孪生系统绑定，并通过流体模拟和高精度图形渲染生成实验现象，回馈给交互界面。同时，通过数据模型与行为可视化将用户的学习状态进程综合信息，实时反馈给教师，从而辅助教师根据学生状态进行探究引导，形成有意义的探究式教学。

关键词: 虚实融合, 探究式学习, 物理仿真, 用户行为可视化

Abstract:

With the increasing interest in personalized and self-motivated education, emphasizing active learning and practical experiences, inquiry-based learning (IBL) is attracting interest in education. Considering the requirement for inquiry-based education, a framework of full process inquiry-based learning environment in the real-virtual worlds is designed. As an example, a mixed-reality chemical experiment system is developed. The metadata including user behavior data, interactive suite status and interactive interface status is collected through physical sensing. By mapping real-world status to the virtual world avatar, virtual experiments are simulated with computational dynamic solvers and real-time rendering. The generated images are sent back to the real world with the portable display. In the meantime, through data modeling and behavior visualization, the user behavior, study status, and process information are visualized to the inspectors facilitating teachers' instruction and forming a meaningful inquiry-based teaching.

Key words: virtual-reality fusion, inquiry-based learning, physics-based simulation, user behavior visualization

中图分类号:

TP391.9

朱永宁, 楼泽如, 吴天翔, 王建民. 虚实融合的探究式实验系统研究[J]. 系统仿真学报, 2023, 35(1): 82-94.

Yongning Zhu, Zeru Lou, Tianxiang Wu, Jianmin Wang. Research on System of Virtual-Reality Fusion and Inquiry-Based Learning[J]. Journal of System Simulation, 2023, 35(1): 82-94.

图/表 14

图1

图2

图3

图4

图5

图6

图7

表1

图8

图9

图10

图11

图12

图13

参考文献 36

1	郑金洲. 基于新课程的课堂教学改革[M]. 福州: 福建教育出版社, 2003.
	Zheng Jinzhou. Classroom Teaching Reform Based on New Curriculum[M]. Fuzhou: Fujian Education Press, 2003.
2	"科学探究性学习的理论与实验研究"课题组. 探究式学习: 含义、特征及核心要素[J]. 教育研究, 2001, 4(12): 52-56.
	"Theoretical and Experimental Research on Scientific Inquiry Learning". Inquiry Learning: Meaning, Characteristics and Core Elements[J]. Educational Research, 2001, 4(12): 52-56.
3	张昌恒. 初高中化学实验现状调研与建议[J]. 化学教与学, 2018, 4(5): 76-78.
	Zhang Changheng. Investigation and Suggestions on the Current Situation of Chemistry Experiment in Junior and Senior High Schools[J]. Chemistry Teaching and Learning, 2018, 4(5): 76-78
4	Abdi A. The Effect of Inquiry-Based Learning Method on Students' Academic Achievement in Science Course[J]. Universal Journal of Educational Research (S2332-3205), 2014, 2(1): 37-41.
5	张翼. 新课程标准条件下中学化学探究式教学模式探析[J]. 绵阳师范学院学报, 2011, 30(5): 137-141.
	Zhang Yi. On Inquiry Model of Teaching Chemistry in Middle Schools under New Curriculum Standard[J]. Journal of Mianyang Normal University, 2011, 30(5): 137-141.
6	Hmelo-Silver C E, Duncan R G, Chinn C A. Scaffolding and Achievement in Problem-Based and Inquiry Learning: A Response to Kirschner, Sweller, and Clark(2006)[J]. Educational Psychologist (S1532-6985), 2007, 42(2): 99-107.
7	Pedaste M, Mäeots M, Siiman L A, et al. Phases of Inquiry-Based Learning: Definitions and the Inquiry Cycle[J]. Educational Research Review (S1747-938X), 2015, 14: 47-61.
8	Lin F C, Chen C M, Wang W F. Learning Process Analysis Based on Sequential Pattern Mining and Lag Sequential Analysis in a Web-Based Inquiry Science Environment[C]// Iiai International Congress on Advanced Applied Informatics. IEEE Computer Society, 2017: 655-660.
9	Joolingen W, Jong T D, Dimitrakopoulou A. Issues in Computer Supported Inquiry Learning in Science[J]. Journal of Computer Assisted Learning (S1365-2729), 2007, 23(2): 111-119.
10	Nelson B C, Ketelhut D J. Scientific Inquiry in Educational Multi-user Virtual Environments[J]. Educational Psychology Review (S1573-336X), 2007, 19(3): 265-283.
11	Graesser A C, Lu S, Jackson G T, et al. AutoTutor: A Tutor with Dialogue in Natural Language[J]. Behavior Research Methods, Instruments, & Computers (S1554-3528), 2004, 36(2): 180-192.
12	Hovardas T, Pedaste M, Zacharia Z, et al. Model-based Inquiry in Computer-Supported Learning Environments: The Case of Go-lab[M].Cyber-physical Laboratories in Engineering and Science Education. Springer, Cham, 2018: 241-268.
13	Fleck S, Simon G, Bastien J M C. AIBLE: An Inquiry-based Augmented Reality Environment for Teaching Astronomical Phenomena[C]// 2014 IEEE International Symposium on Mixed and Augmented Reality-Media, Art, Social Science, Humanities and Design (ISMAR-MASH'D). 2014: 65-66
14	张剑平, 许玮, 杨进中, 等. 虚实融合学习环境: 概念、特征与应用[J]. 远程教育杂志, 2013, 31(3): 3-9.
	Zhang Jianping, Xu Wei, Yang Jinzhong, et al. Learning Environment of Virtual-Actual Fusion: Concept, Characteristics and Its Applications[J]. Journal of Distance Education, 2013, 31(3): 3-9.
15	Kang S, Norooz L, Oguamanam V, et al. SharedPhys: Live Physiological Sensing, Whole-Body Interaction, and Large-Screen Visualizations to Support Shared Inquiry Experiences[C]// The 15th International Conference. New York, 2016: 275-287.
16	Callaghan V, Gardner M, Horan B, et al. A Mixed Reality Teaching and Learning Environment[C]// Hybrid Learning and Education. Berlin Heidelberg: Springer, 2008: 54-65.
17	Walz J T. Transformative Organizations: A Global Perspective[J]. Leadership & Organization Development Journal (S0413-7739), 2007, 28(1): 96-97.
18	Mateu J, Lasala M J, Alamán X. Developing Mixed Reality Educational Applications: The Virtual Touch Toolkit[J]. Sensors (S1424-8220), 2015, 15(9): 21760-21784.
19	赵瑞斌, 范文翔, 杨现民, 等. 具身型混合现实学习环境(EMRLE)的构建与学习活动设计[J]. 远程教育杂志, 2020, 38(5): 44-51.
	Zhao Ruibin, Fan Wenxiang, Yang Xianmin, et al. The Construction and Learning Activities Design of Embodied Mixed-Reality Learning Environments[J]. Journal of Distance Education, 2020, 38(5): 44-51.
20	Salman E, Besevli C, Gksun T, et al. Exploring Projection Based Mixed Reality with Tangibles for Nonsymbolic Preschool Math Education[C]// Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction. New York: ACM Press, 2019: 205-212.
21	Lindgren R, Tscholl M, Wang S, et al. Enhancing Learning and Engagement through Embodied Interaction within a Mixed Reality Simulation[J]. Computers in Education (S0360-1315), 2016(95): 174-187.
22	Zhang Z. A Flexible New Technique for Camera Calibration[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence (S0162-8828), 2000, 22(11): 1330-1334.
23	Gingold R A, Monaghan J J. Smoothed Particle Hydrodynamics: Theory and Application to Non-spherical Stars[J]. Monthly Notice of Royal Astronomical Society(S0035-8711), 1977, 181: 375-389.
24	Müller M, Charypar D, Gross M H. Particle-based Fluid Simulation for Interactive Applications[C]// SCA '03: 2003 ACM SIGGRAPH/ Eurographics Symposium on Computer Animation. 2003: 154-159.
25	Macklin M, Müller, Matthias. Position based Fluids[J]. ACM Transactions on Graphics (S0730-0301), 2013, 32(4): 1-12.
26	Yu J, Wojtan C, Turk G, et al. Explicit Mesh Surfaces for Particle Based Fluids[J]. Computer Graphics Forum(S0167-7055), 2012, 31(2pt4): 815-824.
27	Haines E, Hoffman N, Pesce A, et al. Real-Time Rendering[M]. 4th Edition. A K Peters/CRC Press, 2018.
28	Crane K, Llamas I, Tariq S. Real-Time Simulation and Rendering of 3d Fluids[R]. GPU Gems, 2007.
29	Tomasi C, Manduchi R. Bilateral filtering for gray and Color Images[C]// Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271). 1998: 839-846.
30	Majercik Z. The Schlick Fresnel Approximation[M]// In: Marrs A, Shirley P, Wald I. (eds) Ray Tracing Gems II. Apress, Berkeley, CA, 2021.
31	Hong J M, Shinar T, Kang M, et al. On Boundary Condition Capturing for Multiphase Interfaces[J]. Journal of Scientific Computing (S1573-7691), 2007, 31(1/2): 99-125.
32	Bridson R, Houriham J, Nordenstam M. Curl-noise for Procedural Fluid Flow[J]. ACM Transactions on Graphics (ToG) (S0730-0301), 2007, 26(3): 46-50.
33	FedkiwR, StamJ, JensenH W. Visual Simulation of Smoke[C]// Computer Graphics, ACM Siggraph Proceedings, 2001: 15-22.
34	樽本徹也. 用户体验与可用性测试[M]. 北京: 人民邮电出版社, 2015.
	Cheye Taroto. User Experience and Usability Testing [M]. Beijing: People's Posts and Telecommunications Press, 2015.
35	Tullis T S, Stetson J N. A Comparison of Questionnaires for Assessing Website Usability[C]// Usability Professional Association Conference. 2004: 1-12.
36	Bangor A, Kortum P, Miller J. Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale[J]. Journal of Usability Studies (S1931-3357), 2009, 4(3): 114-123.

[1]	孙奕飞, 蔡亮亮, 周颐, 周忠. MRMark：面向三维视频融合的机器性能评测方法[J]. 系统仿真学报, 2020, 32(7): 1375-1384.
[2]	沈景凤, 李初蕾, 武殿梁, 张佳欣. 航空发动机半物理仿真试车系统的设计研究[J]. 系统仿真学报, 2020, 32(5): 808-816.
[3]	杜渐, 张兴, 赵宏鸣, 高阳, 曹强, 张新兰. 激光散射回波微多普勒效应物理仿真方法研究[J]. 系统仿真学报, 2019, 31(8): 1469-1476.
[4]	周颐, 孟明, 吴威, 周忠. 基于视频模型的虚拟现实视频融合系统[J]. 系统仿真学报, 2018, 30(7): 2550-2557.
[5]	余亦豪, 谭冲, 周忠, 吴威. 虚实融合的实景视频WebGIS系统[J]. 系统仿真学报, 2018, 30(7): 2568-2575.
[6]	余长贵, 熊洪睿, 田凯, 李春涛. 地面在线飞行仿真系统设计[J]. 系统仿真学报, 2018, 30(2): 513-520.
[7]	黄伟健, 丁建完, 陈立平, 周昭远. 面向半物理仿真的陈述式模型转换方法研究[J]. 系统仿真学报, 2015, 27(7): 1468-1473.
[8]	权巍, 王颖, 王艳春, 王旭阳, 朱云瑞. 基于多曝光的高动态范围全景图像合成[J]. 系统仿真学报, 2015, 27(10): 2531-2537.