Research on Interaction Model of Hand Tracking Based on Cognitive Theory

doi:10.16182/j.issn1004731x.joss.201810011

Abstract

Abstract: This paper aims to solve the problems in a vector integration to endpoint (VITE) model of human reaching and grasping under perturbations of object size, distance and orientation. We discuss how to reduce the numbers of disturbances of three main kinds of components: hand/wrist transport, grip aperture and hand orientation. Based on the achievements of cognitive psychology, and a tracking and cognitive model for operational 3D gestures, this paper proposes a new divide-and-conquer model that is used for indicating current grasping status and to trigger three main kinds of methods of when to start or stop working. The model is similar to a token ring network classifier. When coupled with the VITE model, the resulting model simulates the dynamic characteristic of human reaching and grasping. This provides more intelligence when building hand/wrist transport models and hand orientation control simulation modules with mutually independent visual channels. An analysis of simulation results shows that the proposed model is advantageous because of its perturbation rejection.

Key words: artificial intelligence, neural network, cognitive theory, VITE mode

CLC Number:

TP183

Zhang Shaobai, Zhang Teng. Research on Interaction Model of Hand Tracking Based on Cognitive Theory[J]. Journal of System Simulation, 2018, 30(10): 3681-3690.

References

[1] Jeannerod M.The timing of natural prehension movements[J]. Journal of Motor Behavior (S0022-2895), 1984, 16(3): 235-54.
[2] Hoff B.Models of Trajectory Formation and Temporal Interaction of Reach and Grasp[J]. Journal of Motor Behavior (S0022-2895), 1993, 25(3):175-192.
[3] Haggard P, Wing A.Coordinated responses following mechanical perturbation of the arm during prehension[J]. Experimental Brain Research (S0014-4819), 1995, 102(3): 483-494.
[4] Ulloa A, Bullock D.A neural network simulating human reach-grasp coordination by continuous updating of vector positioning commands[J]. Neural Networks (S0893-6080), 2003, 16: 1141-1160.
[5] Bullock D, Grossberg S, Guenther F H.A self-organizing neural model of motor equivalent reaching and tool use by a multijoint arm[J]. Journal of Cognitive Neuroscience (S0898-929X), 1993, 5(4): 408-435.
[6] Vilaplana J M, Coronado J L.A neural network model for coordination of hand gesture during reach to grasp[J]. Neural Networks (S0893-6080), 2006, 19(1): 12-30.
[7] Gentili R J, Oh H, Molina J, et al.Cortical network modeling for inverse kinematic computation of an anthropomorphic finger[C]// International Conference of the IEEE Engineering in Medicine & Biology Society. PubMed. USA: IEEE, 2010: 8251-8254.
[8] Jr V S C, Meyer J, Makris N, et al. MRI-Based Topographic Parcellation of Human Neocortex: An Anatomically Specified Method with Estimate of Reliability[J]. Journal of Cognitive Neuroscience (S0898-929X), 2009, 8(6): 566-587.
[9] Rhodes B J, Bullock D, Verwey W B, et al.Learning and production of movement sequences: behavioral, neurophysiological, and modeling perspectives[J]. Human Movement Science (S0167-9457), 2004, 23(5):699-746.
[10] Bullock D, Grossberg S.Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation[J]. Psychological Review (S0033-295X), 1988, 95(1): 49-90.
[11] Bullock D, Grossberg S, Guenther F.A self-organizing neural model of motor equivalent reaching and tool use by a multijoint arm[J]. Journal of Cognitive Neuroscience (S0898-929X), 1993, 5(4): 408-435.
[12] Bullock D, Bongers R M, Lankhorst M, et al.A vector-integration -to -endpoint model for performance of viapoint movements[J]. Neural Networks (S0893-6080), 1999, 12(1): 1-29.
[13] 张廷芳. 基于认知行为模型的语义手势识别算法与应用研究 [D]. 济南: 济南大学, 2014.
Zhang Tingfang.Semantic Gesture Recognition Based on Cognitive Behavior Model Algorithm and Application Research [D]. Jinan, China: University of Jinan, 2014
[14] Douglas Martin.Cognitive Psychology[M]. USA: John Wiley & Sons, Inc., 2002.
[15] 冯志全, 杨波, 徐涛, 等. 基于自然手势跟踪的直接操作型三维人机交互范式[J]. 计算机学报, 2014, 37(6): 1309-1323.
Feng Z Q, Yang B, Xu T, et al.3D direct human-computer interface paradigm based on free hand tracking[J]. Chinese Journal of Computers (S0254-4164), 2014, 37(6): 1309-1323.
[16] Ulloa A, Bullock D.A neural network simulating human reach grasp coordination by continuous updating of vector positioning commands[J]. Neural Networks (S0893-6080), 2003, 16(8): 1141-1160.
[17] Zhang Shao-bai, Cheng Wei-qing, Cheng Xie-feng.An application of cerebellar control model for prehension movements[J]. Neural Computing & Application (S0941-0643), 2014, 24(5): 1059-1066.
[18] 张少白, 阮晓钢. 仿生机械臂的小脑控制模型和仿真[J]. 电子学报, 2007, 35(5): 991-995.
Zhang Shao-bai, Ruan Xiao-gang.Cerebellar control model and simulation of biomimetic manipulator[J]. Acta Electronica Sinica (S0372-2112), 2007, 35(5): 991-995.
[19] Zhang S, Zhang Z, Zhou N.A new control model for the temporal coordination of arm transport and hand preshape applying to two-dimensional space[J]. Neurocomputing (S0925-2312), 2015, 168(C): 588-598.