基于Unity3D的ASD儿童认知教育系统设计与实现

doi:10.16182/j.issn1004731x.joss.17-0279

系统仿真学报 ›› 2019, Vol. 31 ›› Issue (5): 893-900.doi: 10.16182/j.issn1004731x.joss.17-0279

基于Unity3D的ASD儿童认知教育系统设计与实现

谷学静¹, 张凯峰¹, 郭宇承², 王志良³

1.华北理工大学电气工程学院,河北唐山 063210;
2.华北理工大学机械工程学院,河北唐山 063210;
3.北京科技大学计算机与通信工程学院,北京 100083

收稿日期:2017-06-12 修回日期:2017-09-06 出版日期:2019-05-08 发布日期:2019-11-20
作者简介:谷学静(1972-),女,河北,博士,教授,研究方向为虚拟现实及人机交互。
基金资助:
国家自然科学基金(61432004),国家重点研发计划(2016YFB1001404),河北省自然科学基金(F2017209120)

Design and Implementation of ASD Children’s Cognitive Education System Based on Unity3D

Gu Xuejing¹, Zhang Kaifeng¹, Guo Yucheng², Wang Zhiliang³

1. College of Electrical Engineering, North China University of Science and Technology, Tangshan 063210, China;
2. College of Mechanical Engineering, North China University of Science and Technology, Tangshan 063210, China;
3. School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China

Received:2017-06-12 Revised:2017-09-06 Online:2019-05-08 Published:2019-11-20

摘要/Abstract

摘要： ASD(Autism Spectrum Disorder )即孤独症谱系障碍,是广义上的孤独症。ASD儿童普遍存在认知障碍。为了提高ASD儿童的认知能力,促进ASD儿童的认知泛化,设计并实现了基于Unity3D的ASD儿童认知教育系统。使用unity3D内置的物理引擎模拟重力、浮力和碰撞等效果,构建了符合真实世界物理规律的游戏环境;利用Agent技术和状态机实现了虚拟场景的表现与控制;通过拍照和人脸检测技术实现了表情模拟认知训练。初步测试表明,该系统符合ASD儿童的认知特点,为ASD儿童认知辅助教育训练提供了一种新的设计方法。

关键词: 物理引擎, 人脸检测, 交互技术, ASD, Unity3D

Abstract: ASD (autism spectrum disorder) is a broad sense of autism. In order to improve cognitive deficits of children with ASD, promote cognitive generalization in ASD children, an education system was designed using Unity3D. The built-in physical engine of Unity3D was used to create a game environment which conformed to the physical laws of the real world by simulating the effects of gravity, buoyancy and collision. The Agent technology and state machine were used to realize the representation and control of virtual scene. Camera and face detection technology were used to realize facial imitative cognitive training. The preliminary test showed that the system was suitable for ASD children's cognitive characteristics, and provided a new design method for ASD children's cognitive education.

Key words: physical engine, face detection, interactive technology, ASD, Unity3D

中图分类号:

TP391.9

谷学静, 张凯峰, 郭宇承, 王志良. 基于Unity3D的ASD儿童认知教育系统设计与实现[J]. 系统仿真学报, 2019, 31(5): 893-900.

Gu Xuejing, Zhang Kaifeng, Guo Yucheng, Wang Zhiliang. Design and Implementation of ASD Children’s Cognitive Education System Based on Unity3D[J]. Journal of System Simulation, 2019, 31(5): 893-900.

参考文献

[1] Christensen D L, Baio J, Braun K V, et al.Prevalence and Characteristics of Autism Spectrum Disorder Among Children Aged 8 Years - Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2012[J]. Morbidity & Mortality Weekly Report Surveillance Summaries (S1545-8636), 2014, 63(2): 1.
[2] 中国新闻网. 研究显示中国儿童自闭症患病率为千分之七 [EB/OL]. [2017-04-02]. http://www.chinanews. com/sh/2017/04-02/8190203.shtml.
[3] 李洪华, 单玲, 杜琳, 等. 儿童孤独症谱系障碍的治疗研究进展[J]. 中国当代儿科杂志, 2015, 17(8): 886-892.
Li Honghua, Shan Ling, Du Lin, et al.Research advances in the management of autism spectrum disorders in children[J]. Chinese journal of contemporary pediatrics, 2015, 17(8): 886-892.
[4] 童芳. 自闭症儿童App的情感化设计——以公益App《触》为例[J]. 创意与设计, 2016(4): 83-88.
Tong Fang.The Emotional Design of App for Autistic Children Using Nonprofit App Touch as an Example[J]. Creation & Design, 2016(4): 83-88.
[5] Beaumont R, Sofronoff K.A multi-component social skills intervention for children with Asperger syndrome: The Junior Detective Training Program[J]. Journal of Child Psychology and Psychiatry (S1469-7610), 2008, 49(7): 743-753.
[6] Sue F W, Alexandra P, Juliet S B, et al.A trial of an iPad™intervention targeting social communication skills in children with autism[J]. Autism (S1461-7005), 2016, 20(7): 771-782.
[7] Aliee Z S, Jomhari N, Rezaei R, et al.The Effectiveness of Managing Split Attention among Autistic Children Using Computer Based Intervention[J]. Turkish Online Journal of Educational Technology (S2146-7242), 2013, 12(2): 281-302.
[8] Rajendran G.Virtual environments and autism: a developmental psychopathological approach[J]. Journal of Computer Assisted Learning (S1365-2729), 2013, 29(4): 334-347.
[9] 黄智雄. 孤独症谱系障碍儿童对生物运动感知的初步探讨 [D]. 天津: 南开大学, 2013.
Huang Zhixiong.The Preliminary Study ofBiological Motion Perception in Children with Autism Spectrum Disorders [D]. Tianjin: Nankai University, 2013.
[10] 杨观. 基于Unity的游戏逻辑引擎的设计与实现[D]. 哈尔滨: 哈尔滨工业大学, 2015.
Yang Guan.Design and Implementation of Game Logic Engine Based on Unity [D]. Harbin: Harbin Institute of Technology, 2015.
[11] 王蓉, 侯鹏鹏, 曾昭龙. 基于OpenCV的人脸检测与跟踪方法实现[J]. 科学技术与工程, 2014, 14(24): 115-118.
Wang Rong, Hou Pengpeng, Zeng Zhaolong.The Application of Face Detection and Tracking Method Based on OpenCV[J]. Science Technology and Engineering, 2014, 14(24): 115-118.
[12] 龙伶敏. 基于Adaboost的人脸检测方法及眼睛定位算法研究[D]. 成都: 电子科技大学, 2008.
Long Lingmin.Face detection method and eye location algorithm based on Adaboost [D]. Chengdu: University of Electronic Science and Technology of China, 2008.

[1]	陆承, 靳学胜. 基于Steam VR的交互仿真水枪灭火训练系统设计[J]. 系统仿真学报, 2022, 34(6): 1312-1319.
[2]	敖邦乾, 杨莎, 令狐金卿, 叶振环. 基于级联神经网络疲劳驾驶检测系统设计[J]. 系统仿真学报, 2022, 34(2): 323-333.
[3]	侯守明, 葛倩, 刘彦彦. 基于MAR的非物质文化遗产数字化保护系统研究[J]. 系统仿真学报, 2021, 33(6): 1334-1341.
[4]	李承恩, 邹湘军, 曾泽钦, 何建华, 李慧, 黄钊丰. 基于虚拟碰撞体的弧齿锥齿轮网格实体构建算法[J]. 系统仿真学报, 2021, 33(4): 837-844.
[5]	徐劲力, 周铮. 基于HoloLens的有限元分析变形结果可视化研究[J]. 系统仿真学报, 2021, 33(1): 109-117.
[6]	任福深, 孙雅琪, 胡庆, 李兆亮, 孙鹏宇, 范玉坤. 基于Unity3D的水下机器人半实物仿真系统[J]. 系统仿真学报, 2020, 32(8): 1546-1555.
[7]	文国军, 夏雨, 王玉丹, 胡自飞, 吴丹. 基于Unity3D的水平定向钻机虚拟实训系统设计[J]. 系统仿真学报, 2020, 32(5): 801-807.
[8]	孙小添, 肖伯祥, 刘正东. 群体演出活动服装虚拟仿真系统设计与实现[J]. 系统仿真学报, 2020, 32(11): 2282-2287.
[9]	张志利, 王超, 龙勇, 王韶迪. 基于移动增强现实的双机协同仿真[J]. 系统仿真学报, 2019, 31(4): 608-617.
[10]	纪显俐, 丁宇龙, 杨双华. 智能沙盘地理教学演示系统[J]. 系统仿真学报, 2019, 31(12): 2816-2828.
[11]	张波, 孙俊, 商蕾, 徐弘基, 杨诚. 基于HMD的船舶虚拟消防训练系统设计及实现[J]. 系统仿真学报, 2019, 31(1): 43-52.
[12]	张晓曦, 尹勇, 梁民仓. 蛟龙号下潜及水下作业过程的交互仿真开发[J]. 系统仿真学报, 2018, 30(7): 2715-2721.
[13]	程伯文, 郑一力, 黄青青, 刘晋浩. 基于Unity3D的林木联合采育机虚拟训练系统研究[J]. 系统仿真学报, 2018, 30(4): 1310-1318.
[14]	王大虎, 陈侠, 高会争. 虚拟现实技术在PLC燃气锅炉培训系统中的应用[J]. 系统仿真学报, 2017, 29(12): 3010-3015.
[15]	何高奇, 郁明强, 蒋正清, 卢兴见. 基于VR火灾逃生游戏的应急行为评估系统[J]. 系统仿真学报, 2017, 29(11): 2796-2804.

基于Unity3D的ASD儿童认知教育系统设计与实现

Design and Implementation of ASD Children’s Cognitive Education System Based on Unity3D

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价