基于HMM和RNN的无人机语音控制方案与仿真研究

doi:10.16182/j.issn1004731x.joss.18-0167

系统仿真学报 ›› 2020, Vol. 32 ›› Issue (3): 464-471.doi: 10.16182/j.issn1004731x.joss.18-0167

• 仿真模型/系统置信度评估技术 • 上一篇下一篇

基于HMM和RNN的无人机语音控制方案与仿真研究

周楠, 艾剑良

复旦大学航空航天系,上海 200433

收稿日期:2018-03-24 修回日期:2018-09-12 出版日期:2020-03-18 发布日期:2020-03-25
作者简介:周楠(1991-),男,江西鹰潭,博士生,研究方向为飞行控制与飞行仿真技术;艾剑良(1965-),男,江西临川,博士,教授,博导,研究方向为飞行力学与飞行控制及飞行仿真技术。

Speech Control Scheme Design and Simulation for UAV Based on HMM and RNN

Zhou Nan, Ai Jianliang

Department of Aeronautics and Astronautics, Fudan University, Shanghai 200433, China

Received:2018-03-24 Revised:2018-09-12 Online:2020-03-18 Published:2020-03-25

摘要/Abstract

摘要： 为简化无人机操作,避免误操作,设计了一套基于隐马尔可夫模型(Hidden Markov Model,HMM)和循环神经网络(Recurrent Neural Networks,RNN)的无人机语音控制方案。该方案采用HMM识别无人机语音指令;同时采用RNN对多套无人机操作指令串进行训练,并对当前时刻指令进行预测,通过计算二者的相关性判断是否执行。仿真结果表明,该方案对HMM识别错误指令的辨别率达到61.90%,使整体错误率降至1.43%,表明该方案具有较为优异的性能。

关键词: 无人机, 语音控制, 隐马尔可夫模型, 循环神经网络

Abstract: In order to simplify the operation and avoid the misoperation of UAVs, Based on Hidden Markov Model and Recurrent Neural Networks, a speech control scheme for UAVs is designed. In this scheme, HMM is used to train and recognize the speech command samples of UAVs. HMM is used to pick out the error commands, RNN is used to train the sets of UAVs commands, and the next command based on the training result is predicted. It is determined whether to execute or not by calculating the correlation between commands recognized by HMM and predicted by RNN. The simulation results show the recognition rate of wrong command is as high as 61.90%, and the overall error rate is down to 1.43%. All show the excellent performance of this scheme.

Key words: UAVs(Unmanned Aerial Vehicles), speech control, HMM(Hidden Markov Model), RNN(Recurrent Neural Networks)

中图分类号:

TN912.34

周楠, 艾剑良. 基于HMM和RNN的无人机语音控制方案与仿真研究[J]. 系统仿真学报, 2020, 32(3): 464-471.

Zhou Nan, Ai Jianliang. Speech Control Scheme Design and Simulation for UAV Based on HMM and RNN[J]. Journal of System Simulation, 2020, 32(3): 464-471.

参考文献

[1] 何湘智. 语音控制的应用研究[D]. 长沙: 国防科技大学, 2002: 1-4.
He Xiangzhi.Application Research of Speech Control [D]. Changsha: National University of Defense Technology, 2002: 1-4.
[2] Williamson D T, Draper M H, Calhoun G L.Commercial Speech Recognition Technology in the Military Domain: Results of Two Recent Research Efforts[J]. International Journal of Speech Technology (S1381-2416), 2005, 8(1): 9-16.
[3] Maza I, Caballero F, Molina R, et al.Multimodal Interface Technologies for UAV Ground Control Stations[J]. Journal of Intelligent and Robotic Systems (S0921-0296), 2010, 57(1/4): 371-391.
[4] 王冲. 无人机语音指令控制系统技术研究[D]. 南京: 南京航空航天大学, 2012: 10-30.
Wang Chong.Research of Speech Recognition in UAV Ground Control System[D]. Nanjing: Nanjing University of Aeronautics and Astronautics, 2012: 10-30.
[5] 应捷, 韩旭. 基于安卓语音识别的无人机控制系统[J]. 软件导刊, 2017, 16(5): 54-56.
Ying Jie, Han Xu.UAV Control System based on Android Speech Recognition[J]. Software Guide, 2017, 16(5): 54-56.
[6] 黎亚雄, 张坚强, 潘登, 等. 基于RNN-RBM语言模型的语音识别研究[J]. 计算机研究与发展, 2014, 51(9): 1936-1944.
Li Yaxiong, Zhang Jianqiang, Pan Deng, et al.A Study of Speech Recognition Based on RNN-RBM Language Model[J]. Journal of Computer Research and Development, 2014, 51(9): 1936-1944.
[7] Chow V.Predicting Auction Price of Vehicle License Plate with Deep Recurrent Neural Network[J/OL]. arXiv preprint, arXiv: 1701.08711.
[8] Khosravi A, Koury R N N, Machado L, et al. Prediction of Wind Speed and Wind Direction Using Artificial Neural Network, Support Vector Regression and Adaptive Neuro-Fuzzy Inference System[J]. Sustainable Energy Technologies and Assessments (S2213-1388), 2018, 25: 146.
[9] Buyurgan E M.Development of Artificial Neural Network Models for Hydrologic Prediction in an Agricultural Watershed[D]. USA: University of Arkansas, 2007.
[10] Hernandez V, Rezzoug N, Gorce P, et al.Wheelchair Propulsion: Force Orientation and Amplitude Prediction with Recurrent Neural Network[J]. Journal of Biomechanics (S0021-9290), 2018(78): 166-171.
[11] 赵力. 语音信号处理[M]. 北京: 机械工业出版社, 2009: 32-85.
Zhao Li.Voice Signal Processing[M]. Beijing: China Machine Press, 2009: 32-85.
[12] 张志刚. 基于神经网络/HMM的语音识别算法的研究[D]. 武汉: 武汉理工大学, 2006: 6-11.
Zhang Zhigang.Research of Algorithm in Identifying the Speech Recognition Based on Neural Networks and HMM[D]. Wuhan: Wuhan University of Technology, 2006: 6-11.
[13] 刘晓明, 覃胜, 刘宗行, 等. 语音端点检测的仿真研究[J]. 系统仿真学报, 2005, 17(8): 1974-1976.
Liu Xiaoming, Qin Sheng, Liu Zongxing, et al.Simulation of Speech End Point Detection[J]. Journal of System Simulation, 2005, 17(8): 1974-1976.
[14] 张舸, 张鹏远, 潘接林, 等. 基于递归神经网络的语音识别快速解码算法[J]. 电子与信息学报, 2017, 39(4): 930-937.
Zhang Ge, Zhang Pengyuan, Pan Jielin, et al.Fast Decoding Algorithm for Automatic Speech Recognition Based on Recurrent Neural Networks[J]. Journal of Electronics & Information Technology, 2017, 39(4): 930-937.
[15] 黄智颖. RNN-BLSTM声学模型的说话人自适应方法研究[D]. 合肥: 中国科学技术大学, 2017: 1-14.
Huang Zhiying.Research on Speaker Adaptive Method of RNN-BLSTM Acoustic Model[D]. Hefei: University of Science and Technology of China, 2017: 1-14.
[16] 贾殊凯. 基于RNN的手写轨迹序列生成与分类系统的设计与实现[D]. 哈尔滨: 哈尔滨工业大学, 2016: 1-5.
Jia Shukai.Design and Implementation of Handwritten Tracing Sequence Generation and Classification System Based on RNN[D]. Harbin: Harbin Institute of Technology, 2016: 1-5.

基于HMM和RNN的无人机语音控制方案与仿真研究

Speech Control Scheme Design and Simulation for UAV Based on HMM and RNN

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	陈麒, 崔昊杨. 基于改进鸽群层级的无人机集群视觉巡检模型[J]. 系统仿真学报, 2022, 34(6): 1275-1285.
[2]	张森, 张孟炎, 邵敬平, 普杰信. 基于随机策略搜索的多机三维路径规划方法[J]. 系统仿真学报, 2022, 34(6): 1286-1295.
[3]	何俊, 洪孙焱, 周义方, 申时凯, 邹目权. 基于HMM的多维数据下扶贫对象状态预测[J]. 系统仿真学报, 2022, 34(5): 1118-1126.
[4]	叶澍, 吉晓东, 李文华. 全双工无人机中继系统物理层安全性能研究[J]. 系统仿真学报, 2022, 34(4): 788-796.
[5]	曾思劼, 晏良, 段晓君. 基于PCE方法的无人机轨迹规划与分析[J]. 系统仿真学报, 2022, 34(1): 145-152.
[6]	王宁, 代冀阳, 应进, 李叶鼎, 鲁亮亮. 基于自适应扩展势场的多无人机航迹规划仿真[J]. 系统仿真学报, 2021, 33(9): 2147-2156.
[7]	王泊涵, 吴婷钰, 李文浩, 黄达, 金博, 杨峰, 周爱民, 王祥丰. 基于多智能体强化学习的大规模无人机集群对抗[J]. 系统仿真学报, 2021, 33(8): 1739-1753.
[8]	赵柱, 王毅, 樊芮锋, 李丽亚, 祁蒙. 基于多主体NetLogo平台的反无人机OODA体系对抗建模[J]. 系统仿真学报, 2021, 33(8): 1791-1800.
[9]	李向阳, 张志利, 张宁, 桂毅, 李嘉. 局部信息联通的多无人机协同控制过程仿真研究[J]. 系统仿真学报, 2021, 33(7): 1501-1513.
[10]	魏瑞轩, 吴子沉. 无人机集群实时任务分配方法研究[J]. 系统仿真学报, 2021, 33(7): 1574-1581.
[11]	陈瑜洲, 李原, 王庆林, 张卿, 张津源. 无人机可见光侦察载荷视景仿真平台[J]. 系统仿真学报, 2021, 33(4): 910-917.
[12]	段婷, 王维平, 朱一凡, 王涛, 黄美根. 基于区块链智能合约的UAV集群访问控制机制[J]. 系统仿真学报, 2021, 33(11): 2656-2662.
[13]	叶帅, 蒋国平, 周映江, 刘尚. 基于事件触发的多无人机固定时间编队控制[J]. 系统仿真学报, 2021, 33(10): 2420-2431.
[14]	涂建刚, 徐成, 汪辉, 沈增辉. 无人机等效模拟高空侦察设备光学成像方法[J]. 系统仿真学报, 2021, 33(10): 2511-2517.
[15]	周楠, 王亮, 艾剑良. 基于反步法的矢量推力旋翼机建模及仿真研究[J]. 系统仿真学报, 2020, 32(6): 1117-1125.