Rehabilitation Training System of VR-based Speech Apraxia

doi:10.16182/j.issn1004731x.joss.19-FZ0334

Abstract

Abstract: Aiming at the problem that the enthusiasm of active training in patients with traditional speech apraxia rehabilitation is gradually weakened, a virtual reality-based rehabilitation training system for speech apraxia is designed. The system simulates the 26 monosyllabic pronunciation mouths shapes made by virtual human in Chinese and uses it for the learning module. It is proposed to identify 26 monosyllabic words by using the isolated word speech recognition algorithm, which improves the accuracy of speech recognition. The system includes a training module and a scene module for assisting the patient's pronunciation rehabilitation training. The evaluation results show that the virtual human articulation process in the system can realistically simulate the movement of real articulation organs, which plays a positive role in improving the patients' language ability.

Key words: Virtual reality, Speech Aphasia, Virtual mouth animation, Speech recognition of isolated word

CLC Number:

TP391.9

Jiao Huanhuan, Pan Zhigeng, Xu Shuchang, Yuan Qingshu. Rehabilitation Training System of VR-based Speech Apraxia[J]. Journal of System Simulation, 2019, 31(11): 2344-2349.

References

[1] 汪洁. 运动性失语症口语表达障碍的语言治疗[J]. 现代康复, 2001(19): 20-22.
Wang Jie.Speech therapy for motor aphasia with speech disorders[J]. Modern Rehabilitation, 2001(19): 20-22.
[2] 王芹, 陶静, 刘斐雯, 等. 失用症的分类及治疗研究现状[J]. 实用医学杂志, 2016, 32(5): 689-692.
Wang Qin, Tao Jing, Liu Feiwei, et al.Classification and treatment of apraxia[J]. Journal of Practical Medicine, 2016, 32(5): 689-692.
[3] 潘翠兰, 毛韶丽. 言语失用症康复训练报告[J]. 现代康复, 2000(6): 851.
Pan Cuilan, Mao Shaoli.A report on rehabilitation training for speech apraxia[J]. Modern Rehabilitation, 2000(6): 851.
[4] Ogourtsova T, Archambault P, Lamontagne A.Post-stroke unilateral spatial neglect: virtual reality-based navigation and detection tasks reveal lateralized and non-lateralized deficits in tasks of varying perceptual and cognitive demands[J]. J Neuroeng Rehabil (S1743-0003), 2018, 15(1): 34.
[5] Maier M, Banuelos N, Ballester B, et al.Conjunctive rehabilitation of multiple cognitive domains for chronic stroke patients in virtual reality[C]. International Conference on Rehabilitation Robotics. New Jersey: IEEE, 2017: 947-952.
[6] 王辉, 吴吉生. 虚拟现实训练对认知障碍的脑卒中偏瘫患者的影响[J]. 中国康复, 2017, 32(4): 299-301.
Wang hui, Wu Jisheng. Effect of virtual reality training on lower extremity function and ADL in hemiplegics with cognitive impairment after stroke[J]. China Rehabilitation, 2017, 32(4): 299-301.
[7] 刘婷婷, 刘箴, 钱平安, 等. 虚拟现实在特殊人群康复中的应用研究[J]. 系统仿真学报, 2018, 30(9): 3229-3237.
Liu Tingting, Liu Zhen, Qian Pingan, et al.Application of virtual reality in rehabilitation of special populations[J]. Journal of System Simulation, 2018, 30(9): 3229-3237.
[8] 祝路, 吴春凤, 叶卉. 综合康复护理在脑卒中后言语障碍患者中的应用效果观察[J]. 中国医学创新, 2019, 16(12): 80-83.
Zhu Lu, Wu Chunfeng, Ye Hui.Application effect of comprehensive rehabilitation nursing in patients with post-stroke speech impairment[J]. Chinese Medical Innovation, 2019, 16(12): 80-83.
[9] 孙咏虹, 吴冰洁. 丰富康复训练与神经可塑性[J]. 中国康复理论与实践, 2010, 16(7): 635-637.
Sun Yonghong, Wu Bingjie.To enrich rehabilitation training and neuroplasticity[J]. Rehabilitation Theory and Practice in China, 2010, 16(7): 635-637.
[10] 王进嘉, 张喆. 虚拟现实技术在医疗领域应用的发展建议[J]. 电信网技术, 2017(2): 14-18.
Wang Jinjia, Zhang Zhe.Development suggestions on application of virtual reality technology in the medical field[J]. Telecommunication Network Technology, 2017(2): 14-18.
[11] Miller P.Learning with a missing sense: what can we learn from the interaction of a deaf child with a turtle[J]. American Annals of the Deaf(S0002-726X), 2009, 154(1): 71-82.
[12] Eden S.Virtual intervention to improve storytelling ability among deaf and hard of hearing children[J]. European Journal of Special Needs Education (S0885-6257), 2014, 29(3): 370-386.
[13] 杨雪, 雷江华. 听障儿童基于虚拟现实技术的干预研究[J]. 昆明学院学报, 2019, 41(2): 39-44.
Yang Xue, Lei Jianghua.A review of virtual reality research into interventions for children with hearing impairment[J]. Journal of Kunming University, 2019, 41(2): 39-44.
[14] Rathinavelu A, Thiagarajan H, Rajkumar A.Three dimensional articulator model for speech acquisition by children with hearing loss[C]. Proceedings of 4th International Conference on Universal Access in Human Computer Interaction. Berlin: Springer, 2007, 4554: 786-794.
[15] Rathinavelu A, Yuvaraj G.Data visualization model for speech articulators[C]. Proceedings of AICERA. New Jersey: IEEE, 2011: 155-159.
[16] Bälter O, Engwall O, Öster A M, et al.Wizard of Oz test of ARTUR: a computer-based speech training system with articulation correction[C]. Proceedings of 7th International ACM SIGACCESS Conference on Computers and Accessibility. New York: ACM, 2005: 36-43.
[17] Moccozet L, Laurent N.Dirichlet free-form deformations and their application to hand simulation[C]. Proceedings of the Computer Animation. New Jersey: IEEE, 1997: 93-102.
[18] Adams J. Direct X.高级动画制作[M]. 刘刚译. 重庆: 重庆大学出社, 2005.
Adams J.Direct X. Advanced animation[M]. Liu Gang, Trans. Chongqing: Press of Chongqing University, 2005.
[19] 周炳良, 邓立新, 洪民江. 一种新的基于DTW的孤立词语音识别算法[J]. 计算机技术与发展, 2018, 28(4): 127-131.
Zhou Bingliang, Deng Lixin, Hong Minjiang.A novel isolated word algorithm of speech recognition based on DTW[J]. Conputer Technology and Development, 2018, 28(4): 127-131.