基于认知理论的手势跟踪交互模型研究

doi:10.16182/j.issn1004731x.joss.201810011

系统仿真学报 ›› 2018, Vol. 30 ›› Issue (10): 3681-3690.doi: 10.16182/j.issn1004731x.joss.201810011

基于认知理论的手势跟踪交互模型研究

张少白, 张腾

南京邮电大学计算机学院,江苏南京 210046

收稿日期:2016-03-15 修回日期:2016-08-09 出版日期:2018-10-10 发布日期:2019-01-04
作者简介:张少白(1953-),男,河北定县,博士,教授,研究方向为智能系统与模式识别;张腾(1990-),女,江苏宿迁,硕士,研究方向为智能系统与模式识别。
基金资助:
国家自然科学基金(61271334, 61373065)

Research on Interaction Model of Hand Tracking Based on Cognitive Theory

Zhang Shaobai, Zhang Teng

Computer Department, Nanjing University of Posts and Telecommunications, Nanjing 210046, China

Received:2016-03-15 Revised:2016-08-09 Online:2018-10-10 Published:2019-01-04

摘要/Abstract

摘要： 针对VITE(vector integration to end point)模型在手臂移动和抓取过程中存在的物体大小、方位、距离扰动等问题,研究如何将手臂移动、抓握孔径和手掌朝向3个基本组件受干扰的数量减少到最少。依据认知心理学,针对操作型3D手势跟踪认知模型的特点,提出一种用于指示当前抓取状态并能触发三个基本组件工作启停的分治模型。当将该模型耦合至VITE模型后,能更好地模拟手臂移动和抓取过程中所表征的相关动力学特征,并在构建视觉通道相互独立的手臂移动和手指预成型及手掌朝向等仿真模块时,更具智能性。仿真结果表明,提出的模型在抗扰动性能上较之其它模型具有更好的性能。

关键词: 人工智能, 神经网络, 认知理论, VITE模型

Abstract: This paper aims to solve the problems in a vector integration to endpoint (VITE) model of human reaching and grasping under perturbations of object size, distance and orientation. We discuss how to reduce the numbers of disturbances of three main kinds of components: hand/wrist transport, grip aperture and hand orientation. Based on the achievements of cognitive psychology, and a tracking and cognitive model for operational 3D gestures, this paper proposes a new divide-and-conquer model that is used for indicating current grasping status and to trigger three main kinds of methods of when to start or stop working. The model is similar to a token ring network classifier. When coupled with the VITE model, the resulting model simulates the dynamic characteristic of human reaching and grasping. This provides more intelligence when building hand/wrist transport models and hand orientation control simulation modules with mutually independent visual channels. An analysis of simulation results shows that the proposed model is advantageous because of its perturbation rejection.

Key words: artificial intelligence, neural network, cognitive theory, VITE mode

中图分类号:

TP183

张少白, 张腾. 基于认知理论的手势跟踪交互模型研究[J]. 系统仿真学报, 2018, 30(10): 3681-3690.

Zhang Shaobai, Zhang Teng. Research on Interaction Model of Hand Tracking Based on Cognitive Theory[J]. Journal of System Simulation, 2018, 30(10): 3681-3690.

参考文献

[1] Jeannerod M.The timing of natural prehension movements[J]. Journal of Motor Behavior (S0022-2895), 1984, 16(3): 235-54.
[2] Hoff B.Models of Trajectory Formation and Temporal Interaction of Reach and Grasp[J]. Journal of Motor Behavior (S0022-2895), 1993, 25(3):175-192.
[3] Haggard P, Wing A.Coordinated responses following mechanical perturbation of the arm during prehension[J]. Experimental Brain Research (S0014-4819), 1995, 102(3): 483-494.
[4] Ulloa A, Bullock D.A neural network simulating human reach-grasp coordination by continuous updating of vector positioning commands[J]. Neural Networks (S0893-6080), 2003, 16: 1141-1160.
[5] Bullock D, Grossberg S, Guenther F H.A self-organizing neural model of motor equivalent reaching and tool use by a multijoint arm[J]. Journal of Cognitive Neuroscience (S0898-929X), 1993, 5(4): 408-435.
[6] Vilaplana J M, Coronado J L.A neural network model for coordination of hand gesture during reach to grasp[J]. Neural Networks (S0893-6080), 2006, 19(1): 12-30.
[7] Gentili R J, Oh H, Molina J, et al.Cortical network modeling for inverse kinematic computation of an anthropomorphic finger[C]// International Conference of the IEEE Engineering in Medicine & Biology Society. PubMed. USA: IEEE, 2010: 8251-8254.
[8] Jr V S C, Meyer J, Makris N, et al. MRI-Based Topographic Parcellation of Human Neocortex: An Anatomically Specified Method with Estimate of Reliability[J]. Journal of Cognitive Neuroscience (S0898-929X), 2009, 8(6): 566-587.
[9] Rhodes B J, Bullock D, Verwey W B, et al.Learning and production of movement sequences: behavioral, neurophysiological, and modeling perspectives[J]. Human Movement Science (S0167-9457), 2004, 23(5):699-746.
[10] Bullock D, Grossberg S.Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation[J]. Psychological Review (S0033-295X), 1988, 95(1): 49-90.
[11] Bullock D, Grossberg S, Guenther F.A self-organizing neural model of motor equivalent reaching and tool use by a multijoint arm[J]. Journal of Cognitive Neuroscience (S0898-929X), 1993, 5(4): 408-435.
[12] Bullock D, Bongers R M, Lankhorst M, et al.A vector-integration -to -endpoint model for performance of viapoint movements[J]. Neural Networks (S0893-6080), 1999, 12(1): 1-29.
[13] 张廷芳. 基于认知行为模型的语义手势识别算法与应用研究 [D]. 济南: 济南大学, 2014.
Zhang Tingfang.Semantic Gesture Recognition Based on Cognitive Behavior Model Algorithm and Application Research [D]. Jinan, China: University of Jinan, 2014
[14] Douglas Martin.Cognitive Psychology[M]. USA: John Wiley & Sons, Inc., 2002.
[15] 冯志全, 杨波, 徐涛, 等. 基于自然手势跟踪的直接操作型三维人机交互范式[J]. 计算机学报, 2014, 37(6): 1309-1323.
Feng Z Q, Yang B, Xu T, et al.3D direct human-computer interface paradigm based on free hand tracking[J]. Chinese Journal of Computers (S0254-4164), 2014, 37(6): 1309-1323.
[16] Ulloa A, Bullock D.A neural network simulating human reach grasp coordination by continuous updating of vector positioning commands[J]. Neural Networks (S0893-6080), 2003, 16(8): 1141-1160.
[17] Zhang Shao-bai, Cheng Wei-qing, Cheng Xie-feng.An application of cerebellar control model for prehension movements[J]. Neural Computing & Application (S0941-0643), 2014, 24(5): 1059-1066.
[18] 张少白, 阮晓钢. 仿生机械臂的小脑控制模型和仿真[J]. 电子学报, 2007, 35(5): 991-995.
Zhang Shao-bai, Ruan Xiao-gang.Cerebellar control model and simulation of biomimetic manipulator[J]. Acta Electronica Sinica (S0372-2112), 2007, 35(5): 991-995.
[19] Zhang S, Zhang Z, Zhou N.A new control model for the temporal coordination of arm transport and hand preshape applying to two-dimensional space[J]. Neurocomputing (S0925-2312), 2015, 168(C): 588-598.

基于认知理论的手势跟踪交互模型研究

Research on Interaction Model of Hand Tracking Based on Cognitive Theory

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	张森, 张孟炎, 邵敬平, 普杰信. 基于随机策略搜索的多机三维路径规划方法[J]. 系统仿真学报, 2022, 34(6): 1286-1295.
[2]	张立峰, 王会忍. 基于卷积神经网络及有限元仿真的电容层析成像图像重建[J]. 系统仿真学报, 2022, 34(4): 712-718.
[3]	康旭, 张晓峰. 基于生成对抗神经网络的雷达遥感数据增广方法[J]. 系统仿真学报, 2022, 34(4): 920-927.
[4]	周思锦, 陈棣成, 涂耿, 姜大志. 基于个性化和记忆机制的多模态情感计算模型[J]. 系统仿真学报, 2022, 34(4): 745-758.
[5]	孙晓安, 栾小丽, 刘飞. 基于智能优化灰色模型的电子固废预测[J]. 系统仿真学报, 2022, 34(3): 536-542.
[6]	魏娟, 游磊, 郭阳勇, 唐志海. 基于小波神经网络的多楼层疏散模型[J]. 系统仿真学报, 2022, 34(2): 269-277.
[7]	敖邦乾, 杨莎, 令狐金卿, 叶振环. 基于级联神经网络疲劳驾驶检测系统设计[J]. 系统仿真学报, 2022, 34(2): 323-333.
[8]	唐宇波, 沈弼龙, 师磊, 易星. 下一代兵棋系统模型引擎设计问题研究[J]. 系统仿真学报, 2021, 33(9): 2025-2036.
[9]	魏腾飞, 潘庭龙. 基于改进PSO优化LSTM网络的短期电力负荷预测[J]. 系统仿真学报, 2021, 33(8): 1866-1874.
[10]	赵瑛, 陆耀, 张健, 梁启弟, 龙炜. 基于深度神经网络的多视角人体动作识别[J]. 系统仿真学报, 2021, 33(5): 1019-1030.
[11]	刘晓琳, 吴竟祎. 飞机舵机电液加载系统控制补偿器设计与仿真[J]. 系统仿真学报, 2021, 33(5): 1031-1038.
[12]	于广宇, 董学平, 王祥民, 甘敏. 弹性网下基于LSTM的分解炉出口温度预测[J]. 系统仿真学报, 2021, 33(5): 1078-1085.
[13]	方群, 陈绪凯, 何昕, 祝玉军, 刘毅杨, 方阳阳, 李贺举. 基于SWIPT无线协作网络的中继选择算法研究[J]. 系统仿真学报, 2021, 33(4): 801-808.
[14]	仝卫国, 庞雪纯, 朱赓宏. 基于卷积神经网络的气液两相流流型识别方法[J]. 系统仿真学报, 2021, 33(4): 883-891.
[15]	冯新扬, 邵超. 跨卷积网络特征融合的SAR图像目标识别[J]. 系统仿真学报, 2021, 33(3): 554-561.