Gesture Recognition Method Based on Multi-feature Fusion

doi:10.16182/j.issn1004731x.joss.17-0089

Abstract

Abstract: Aiming at the specific application requirements of command gesture for flight deck, a gesture recognition method based on multi-feature fusion is proposed. The 3D trajectory feature vector and hand sparse representation are established from two aspects of the trajectory and posture based on the visual information collected by depth camera. On the one hand, the gesture is recognized through normalization resampling and alignment based on the trajectory feature. On the other hand, the gesture is recognized through sparse representation alignment based on the HOG feature. The recognition results are fused effectively. The experimental results indicate that our methods greatly enhance accuracy, and have better robustness.

Key words: flight deck, gesture recognition, depth information, sparse representation, feature fusion

CLC Number:

TP391

Wang Yuanming, Zhang Jun, Qin Yuanhui, Chai Xiujuan. Gesture Recognition Method Based on Multi-feature Fusion[J]. Journal of System Simulation, 2019, 31(2): 346-352.

References

[1] 胡容兵, 谢君, 傅冰. 飞行甲板安全评价指标体系研究[J]. 海军工程大学学报, 2013, 25(6): 93-98.
Hu Rongbing, Xie Jun, Fu Bing.Analysis of Safety Evaluation Index System of Flight Deck[J]. Journal of Naval University of Engineering, 2013, 25(6): 93-98.
[2] Mohammadreza Asghari Oskoei, Huosheng Hu.Myoelectric Control Systems-A survey[J]. Biomedical Signal Process & Control (S1004-1699), 2007, 2(4): 275-294.
[3] 胡琼, 秦磊, 黄庆明. 基于视觉的人体动作识别综述[J]. 计算机学报, 2013, 36(12): 2512-2524.
Hu Qiong, Qin Lei, Huang Qingming.A Survey on Visual Human Action Recognition[J]. Chinese Journal of Computers, 2013, 36(12): 2512-2524.
[4] Carlsson S, Sullivan J.Action Recognition by Shape Matching to Key Frames[C]// European Conference on Computer Vision(ECCV). Copenhagen, Denmark:IEEE, 2002: 263-270.
[5] Wang Xiaogang, Tieu K, Grimson E.Learning Semantic Scene Models by Trajectory Analysis[C]// Proc of the 9th Europen Conference on Computer Vision. Berlin: Springer, 2006: 110-123.
[6] Shotton J, Fitzgibbon A, Sharp T, et al.Real-time Human Pose Recognition in Parts from A Single Depth Image[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. USA: Colorado Springs, 2011: 1297-1304.
[7] Jiang Zhuo-Lin, Lin Zhe, Davis L S.Recognizing human actions by learning and matching shape-motion prototype trees[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence (S1062-8828), 2012, 34(3): 533-547.
[8] 刘鑫辰, 傅慧源, 马华东. 基于RGB-D摄像头的实时手指跟踪与手势识别[J]. 计算机学报, 2014, 41(10): 50-61.
Liu Xinchen, Fu Huiyuan, Ma Huadong.Real-time Fingertip Tracking and Gesture Recognition Using RGB-D Camera[J]. Computer Science, 2014, 41(10): 50-61.
[9] Shi Qinfeng, Wang Li, Cheng Li, et al.Human action segmentation and recognition using discriminative semi-Markov Models[J]. International Journal of Computer Vision (S0920-5691), 2011, 93(1): 22-32.
[10] 陶丽君, 李翠华, 张希婧, 等. 基于Kinect传感器深度信息的动态手势识别[J]. 厦门大学学报(自然科学版), 2013, 52(4): 493-497.
Tao Lijun, Li Cuihua, Zhang Xijing, et al.Dynamic Gesture Recognition Based on Kinect Depth Data[J]. Journal of Xiamen University(Natural Science), 2013, 52(4): 493-497.
[11] Datal N, Triggs B.Histograms of oriented grdients for human detection[C]// Proceedings of Conference on Computer Vision and Pattern Recognition, Montbonnot, France: IEEE, 2005: 886-893.
[12] 张汉灵, 李红英, 周敏. 融合多特征和压缩感知的手势识别[J]. 湖南大学学报(自然科学版), 2013, 40(3): 87-92.
Zhang Hanling, Li Hongying, Zhou Min.Hand Posture Recognition Based on Multi-feature and Compressive Sensing[J]. Journal of Hunan University (Natural Sciences), 2013, 40(3): 87-92.

[1]	Cao Jianfang, Cui Hongyan, Zhang Zibang, Zhao Aidi. Ancient Mural Classification Based on Transfer Learning and Low-Level Features [J]. Journal of System Simulation, 2021, 33(5): 1095-1103.
[2]	Xu Sheng, Feng Wenyu, Liu Zhicheng, Tu Xintao, Fei Minrui, Zhang Kun. Research on Accurate Gesture Recognition Algorithm in Complex Environment Based on Machine Vision [J]. Journal of System Simulation, 2021, 33(10): 2460-2469.
[3]	Song Xiaorui, Zou Ling, Wu Lingda, Xu Wanpeng. Hyperspectral Image Anomaly Detection Based on Background Reconstruction [J]. Journal of System Simulation, 2020, 32(7): 1287-1293.
[4]	Wang Xin, Zhang Chunyan, Ning Chen. Spatiotemporal Saliency Detection of Infrared Videos Based on Gestalt-guided Optimization [J]. Journal of System Simulation, 2020, 32(6): 1021-1031.
[5]	Xue Yanping, Wang Xuesong, Wu Zhongke, Wang Xingce, Zhou Mingquan. Application of Myo Gesture Recognition Method in Ancient Building Roaming System [J]. Journal of System Simulation, 2019, 31(9): 1907-1915.
[6]	Jiang Hua, Zhang Liang. Human Re-identification Based on Part Segmentation [J]. Journal of System Simulation, 2019, 31(6): 1085-1091.
[7]	Liu Wang, Sun Jinyu, Ma Shiwei. A Temporal Action Detection Algorithm Based on Spatio-Temporal Feature Pyramid Network [J]. Journal of System Simulation, 2019, 31(11): 2382-2387.
[8]	Wang Shimin, Ye Jihua, Wang Mingwen, Zuo Jiali, Liu Changhong. Saliency Feature Extraction Method Based on Multi-scale Region Covariance [J]. Journal of System Simulation, 2018, 30(7): 2767-2775.
[9]	Ma Nan, Shi Xiangbin, Dai Qin, Liu cuiwei, Liu Fang. A Method of Key Frame Extraction for Music and Dance Video [J]. Journal of System Simulation, 2018, 30(7): 2801-2807.
[10]	Li Ming, Peng Xiujiao, Wang Yan. Facial Expression Recognition Based on Improved Dictionary Learning and Sparse Representation [J]. Journal of System Simulation, 2018, 30(1): 28-36.
[11]	Niu Weihua, Liang Guishu, Zhao Peng. Fault Diagnosis Model of Circuit Breaker Based on Sparse Representation and M-ELM [J]. Journal of System Simulation, 2017, 29(11): 2828-2839.
[12]	Wang Shimin, Ye Jihua, Cheng Bailiang, Wang Mingwen. Improved Itti Visual Saliency Detection Based on Multi-scale Tensor Space [J]. Journal of System Simulation, 2016, 28(9): 2138-2145.
[13]	Ye Jihua, Lan Qingping, Liu Changhong, Wang Shimin. Embedded Face Recognition Combined Mutual Information with Log-Gabor Feature [J]. Journal of System Simulation, 2016, 28(9): 2214-2219.
[14]	Cai Zhiwei, Wu Shuyan, Song Junfeng. Study on Hand Gesture Recognition and Portfolio Optimization Model Based on SVM [J]. Journal of System Simulation, 2016, 28(8): 1812-1817.
[15]	Yang Huixian, Liu Zhao, Liu Yang, Liu Fan, He Dilong. Object Tracking Method Based on Superpixel and Local Sparse Representation [J]. Journal of System Simulation, 2016, 28(5): 1017-1030.