Design and Implementation of ASD Children’s Cognitive Education System Based on Unity3D

doi:10.16182/j.issn1004731x.joss.17-0279

Abstract

Abstract: ASD (autism spectrum disorder) is a broad sense of autism. In order to improve cognitive deficits of children with ASD, promote cognitive generalization in ASD children, an education system was designed using Unity3D. The built-in physical engine of Unity3D was used to create a game environment which conformed to the physical laws of the real world by simulating the effects of gravity, buoyancy and collision. The Agent technology and state machine were used to realize the representation and control of virtual scene. Camera and face detection technology were used to realize facial imitative cognitive training. The preliminary test showed that the system was suitable for ASD children's cognitive characteristics, and provided a new design method for ASD children's cognitive education.

Key words: physical engine, face detection, interactive technology, ASD, Unity3D

CLC Number:

TP391.9

Gu Xuejing, Zhang Kaifeng, Guo Yucheng, Wang Zhiliang. Design and Implementation of ASD Children’s Cognitive Education System Based on Unity3D[J]. Journal of System Simulation, 2019, 31(5): 893-900.

References

[1] Christensen D L, Baio J, Braun K V, et al.Prevalence and Characteristics of Autism Spectrum Disorder Among Children Aged 8 Years - Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2012[J]. Morbidity & Mortality Weekly Report Surveillance Summaries (S1545-8636), 2014, 63(2): 1.
[2] 中国新闻网. 研究显示中国儿童自闭症患病率为千分之七 [EB/OL]. [2017-04-02]. http://www.chinanews. com/sh/2017/04-02/8190203.shtml.
[3] 李洪华, 单玲, 杜琳, 等. 儿童孤独症谱系障碍的治疗研究进展[J]. 中国当代儿科杂志, 2015, 17(8): 886-892.
Li Honghua, Shan Ling, Du Lin, et al.Research advances in the management of autism spectrum disorders in children[J]. Chinese journal of contemporary pediatrics, 2015, 17(8): 886-892.
[4] 童芳. 自闭症儿童App的情感化设计——以公益App《触》为例[J]. 创意与设计, 2016(4): 83-88.
Tong Fang.The Emotional Design of App for Autistic Children Using Nonprofit App Touch as an Example[J]. Creation & Design, 2016(4): 83-88.
[5] Beaumont R, Sofronoff K.A multi-component social skills intervention for children with Asperger syndrome: The Junior Detective Training Program[J]. Journal of Child Psychology and Psychiatry (S1469-7610), 2008, 49(7): 743-753.
[6] Sue F W, Alexandra P, Juliet S B, et al.A trial of an iPad™intervention targeting social communication skills in children with autism[J]. Autism (S1461-7005), 2016, 20(7): 771-782.
[7] Aliee Z S, Jomhari N, Rezaei R, et al.The Effectiveness of Managing Split Attention among Autistic Children Using Computer Based Intervention[J]. Turkish Online Journal of Educational Technology (S2146-7242), 2013, 12(2): 281-302.
[8] Rajendran G.Virtual environments and autism: a developmental psychopathological approach[J]. Journal of Computer Assisted Learning (S1365-2729), 2013, 29(4): 334-347.
[9] 黄智雄. 孤独症谱系障碍儿童对生物运动感知的初步探讨 [D]. 天津: 南开大学, 2013.
Huang Zhixiong.The Preliminary Study ofBiological Motion Perception in Children with Autism Spectrum Disorders [D]. Tianjin: Nankai University, 2013.
[10] 杨观. 基于Unity的游戏逻辑引擎的设计与实现[D]. 哈尔滨: 哈尔滨工业大学, 2015.
Yang Guan.Design and Implementation of Game Logic Engine Based on Unity [D]. Harbin: Harbin Institute of Technology, 2015.
[11] 王蓉, 侯鹏鹏, 曾昭龙. 基于OpenCV的人脸检测与跟踪方法实现[J]. 科学技术与工程, 2014, 14(24): 115-118.
Wang Rong, Hou Pengpeng, Zeng Zhaolong.The Application of Face Detection and Tracking Method Based on OpenCV[J]. Science Technology and Engineering, 2014, 14(24): 115-118.
[12] 龙伶敏. 基于Adaboost的人脸检测方法及眼睛定位算法研究[D]. 成都: 电子科技大学, 2008.
Long Lingmin.Face detection method and eye location algorithm based on Adaboost [D]. Chengdu: University of Electronic Science and Technology of China, 2008.

[1]	Cheng Lu, Xuesheng Jin. Design of Interactive Simulated Water Gun Fire Fighting Training System Based on Steam VR [J]. Journal of System Simulation, 2022, 34(6): 1312-1319.
[2]	Bangqian Ao, Sha Yang, Jinqing Linghu, zhenhuan Ye. Design of Fatigue Driving Detection System Based on Cascaded Neural Network [J]. Journal of System Simulation, 2022, 34(2): 323-333.
[3]	Hou Shouming, Ge Qian, Liu Yanyan. Research on Digital Protection System of Intangible Cultural Heritage Based on Mobile Augmented Reality Technology [J]. Journal of System Simulation, 2021, 33(6): 1334-1341.
[4]	Li Cheng'en, Zou Xiangjun, Zeng Zeqin, He Jianhua, Li Hui, Huang Zhaofeng. Mesh Solid Construction Algorithm of Spiral Bevel Gear Based on Virtual Collision Body [J]. Journal of System Simulation, 2021, 33(4): 837-844.
[5]	Xu Jinli, Zhou Zheng. Visualization of Finite Element Analysis Deformation Results Based on HoloLens [J]. Journal of System Simulation, 2021, 33(1): 109-117.
[6]	Ren Fushen, Sun Yaqi, Hu Qing, Li Zhaoliang, Sun Pengyu, Fan Yukun. Hardware-in-the-Loop Simulation System for Underwater Vehicle Based on Unity3D [J]. Journal of System Simulation, 2020, 32(8): 1546-1555.
[7]	Wen Guojun, Xia Yu, Wang Yudan, Hu Zifei, Wu Dan. Design of Virtual Training System for Horizontally Oriented Drill Based on Unity3D [J]. Journal of System Simulation, 2020, 32(5): 801-807.
[8]	Sun Xiaotian, Xiao Boxiang, Liu Zhengdong. Design and Implementation of Cloth Virtual Simulation System for Group Performance [J]. Journal of System Simulation, 2020, 32(11): 2282-2287.
[9]	Zhang Zhili, Wang Chao, Long Yong, Wang Shaodi. Two-machine Co-simulation Based on Mobile Augmented Reality [J]. Journal of System Simulation, 2019, 31(4): 608-617.
[10]	Ji Xianli, Ding Yulong, Yang Shuanghua. Intelligent Sandbox for Geography Teaching [J]. Journal of System Simulation, 2019, 31(12): 2816-2828.
[11]	Zhang Bo, Sun Jun, Shang Lei, Xu Hongji, Yang Cheng. Design and Realization of Ship Virtual Fire Training System Based on HMD [J]. Journal of System Simulation, 2019, 31(1): 43-52.
[12]	Zhang Xiaoxi, Yin Yong, Liang Mincang. Development of Interactive Simulation of Dive and Underwater Operation Process of Jiaolong [J]. Journal of System Simulation, 2018, 30(7): 2715-2721.
[13]	Cheng Bowen, Zheng Yili, Huang Qingqing, Liu Jinhao. Forestry Felling & Cultivation Machine Virtual Training System Based on Unity3D [J]. Journal of System Simulation, 2018, 30(4): 1310-1318.
[14]	Wang Dahu, Chen Xia, Gao Huizheng. Application of Virtual Reality in PLC Gas-fired Boiler Training System [J]. Journal of System Simulation, 2017, 29(12): 3010-3015.
[15]	He Gaoqi, Yu Mingqiang, Jiang Zhengqing, Lu Xingjian. Emergency Behavior Assessment System Based on VR Fire Escape Game [J]. Journal of System Simulation, 2017, 29(11): 2796-2804.