一种模拟基底神经节机理的自主认知模型

doi:10.16182/j.issn1004731x.joss.201802008

系统仿真学报 ›› 2018, Vol. 30 ›› Issue (2): 427-434.doi: 10.16182/j.issn1004731x.joss.201802008

一种模拟基底神经节机理的自主认知模型

李宗帅¹, 陈静²

1.中国民航大学电子信息与自动化学院,天津 300300;
2.天津职业技术师范大学信息技术工程学院,天津 300222

收稿日期:2016-05-11 出版日期:2018-02-08 发布日期:2019-01-02
作者简介:李宗帅(1982-),男,山东德州,硕士,讲师,研究方向为人工智能、自动化、自动控制。
基金资助:
国家自然科学基金(61403282), 天津市高等学校科技发展基金(20130807)

An Autonomous Cognitive Model Simulating Basal Ganglia Mechanism

Li Zongshuai¹, Chen Jing²

1.School of electronic information and automation, Civil Aviation University of China, Tianjin 300300, China;
2.School of information technology engineering, Tianjin University of Technology and Education, Tianjin 300222, China

Received:2016-05-11 Online:2018-02-08 Published:2019-01-02

摘要/Abstract

摘要： 针对智能体自主认知问题,采用适者生存WTA学习机制,利用基底神经节中的皮质-纹状体突触修饰机理,基于操作学习原理提出了基底神经节的自主认知模型,该模型适用于有限行为的认知学习,应用该仿生学习模型对Skinner的鸽子实验进行了模拟,模拟了Skinner鸽的渐进自适应学习过程,仿真结果表明本文所提出的行为认知模型是有效的。将该认知模型用于自平衡机器人的自主平衡学习中,在未知机器人数学模型的前提下通过模型中的操作学习达到自平衡学习的目的,为智能体仿生认知模型的研究提供了参考。

关键词: 操作学习模型, 基底神经节, 认知模型, 机器鸽, 自平衡机器人

Abstract: Aiming at autonomous cognition problem, applying the winner-takes-all(WTA) learning mechanism, using cortical-striatal synaptic modification principle in basal ganglia, as well as based on the operant conditioning reflex theory, the basal ganglia autonomous cognitive model is established, which is suitable for the cognitive learning with limited actions. Skinner's pigeons experiment was simulated by applying this bionic learning model, which showes a gradual process of adaptive learning. The simulation results reflect that the proposed cognitive model is effective and can be used in the balance learning for a self-balancing robot. In the premise of unknown robot mathematical model, the purpose of self-balancing learning is achieved through the operant learning in the proposed model. This research provides a reference for agent's bionic cognitive model.

Key words: operant learning model, basal ganglia, cognitive model, robotic pigeon, self-balancing robot

中图分类号:

TP181

李宗帅, 陈静. 一种模拟基底神经节机理的自主认知模型[J]. 系统仿真学报, 2018, 30(2): 427-434.

Li Zongshuai, Chen Jing. An Autonomous Cognitive Model Simulating Basal Ganglia Mechanism[J]. Journal of System Simulation, 2018, 30(2): 427-434.

参考文献 13

[1]	Bruce E R, James M G, Jacques J V.Machine operant conditioning[C]// Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 1988: 1500-1501.
[2]	Zalama E, Gaudiano P, Coronado J L.Obstacle avoidance by means of an operant conditioning model[C]// International Workshop on Artificial Neural Networks Malaga-Torremolinos, Spain, 1995, 930: 471-477.
[3]	Gaudiano P, Chang C.Adaptive obstacle avoidance with a neural network for operant conditioning: Experiments with real robots[C]// IEEE International Symposium on Computational Intelligence in Robotics and Automation, Monterey, 1997: 13-187.
[4]	Björn Brembs, brembs.net:Research on Learning, Memory and Evolution [EB/OL]. http://brembs.net/.2014.
[5]	Björn Brembs.Spontaneous decisions and operant conditioning in fruit flies[J]. Behavioural Processes (S0376-6357), 2011, 87(1): 157-164.
[6]	Zalama E, Gomez J, Paul M, et al.Adaptive behavior navigation of a mobile robot[J]. IEEE Transactions on Systems, Man, and Cybernetics, Part A - Systems and Humans, 2002, 32(1): 160-169.
[7]	Itoh K, Miwa H, Matsumoto M, et al.Behavior model of humanoid robots based on operant conditioning[C]// IEEE/RAS International Conference on Humanoid Robots. Piscataway, NJ, USA: IEEE, 2005: 220-225.
[8]	Tadahiro T, Tetsuo S.Incremental acquisition of behaviors and signs based on a reinforcement learning schemata model and a spike timing-dependent plasticity network[J]. Advanced Robotics, 2007, 21: 1177-1199.
[9]	蔡建羡, 阮晓钢. 基于遗传算法的Skinner操作条件反射学习模型[J]. 系统工程与电子技术, 2011, 33(6): 1370-1376.Cai J X, Ruan X G. Skinner operant conditioning learning model based on genetic algorithm[J]. System Engineering and Electronics, 2011, 33(6): 1370-1376.
[10]	任红格, 史涛, 张瑞成. 基于操作条件反射机制的感觉运动系统认知模型的建立[J]. 机器人, 2012, 34(3): 292-298.Ren H G, Shi T, Zhang R C. Foundation of the sensorimotor system cognitive model with operant conditioning mechanism[J]. Robot, 2012, 34(3): 292-298.
[11]	徐冰, 刘肖健. 基于动机模型的自主性虚拟人行为选择研究[J]. 计算机应用与软件, 2012, 29(4): 71-74.Xu B, Liu X J. Research on motivation model based behavior selection of autonomous virtual human[J]. Computer application and software, 2012, 29(4): 71-74.
[12]	J John O'Doherty, Peter Dayan, et al. Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning[J]. Science (S0036-8075). 2004, 304(5669): 452-454.
[13]	Ruan X, Chen J, Yu N.Thalamic cooperation between the cerebellum and basal ganglia with a new tropism-based action-dependent heuristic dynamic programming method[J]. Neurocomputing (S0925-2312), 2012, 93: 27-40.

一种模拟基底神经节机理的自主认知模型

An Autonomous Cognitive Model Simulating Basal Ganglia Mechanism

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献 13

相关文章 2

编辑推荐

Metrics

本文评价

[1]	陈静. 柔性机器人多层启发式动态规划平衡认知研究[J]. 系统仿真学报, 2018, 30(1): 147-155.
[2]	赵国生, 张楠, 王健. 基于高阶多型π演算的可生存系统认知模型研究[J]. 系统仿真学报, 2016, 28(2): 275-282.