Behavior Recognition Combining Regional Optical Flow Features and Temporal Templates

Abstract

Abstract: A method was proposed to recognize human behavior, which combined the wavelet moments of temporal templates and the speed feature by optical flow. The wavelet moments are not only rotation, translation and scale invariance, but also have the multi-scale characteristics of wavelet. The shape feature of the motion history image and motion energy image can be described. To simple motions, it's effectively, but it can't present the speed information. Regional optical flow was calculated to describe the direction and amplitude features of motion by Lucas-Kanade algorithm. It could make up shortcomings of wavelet moment without speed information. Being combined two ways of describing the motion and based on the Weizmann Database, experiment results verify the proposed method effectiveness.

Key words: human behavior recognition, temporal templates, wavelet moment, calculation of optical flow

CLC Number:

TP391

Wang Manyi, Song Yaling, Li Yu, Zhang Liang. Behavior Recognition Combining Regional Optical Flow Features and Temporal Templates[J]. Journal of System Simulation, 2015, 27(5): 1146-1151.

References

[1] Bobick A, Davis J.The recognition of human movement using temporal templates[J]. IEEE Trans. On Pattern Analysis and Machine Intelligence (S0162-8838), 2001, 23(3): 257-267.
[2] Lan Chao, Coenen F, Zhang Bai-ling. Driving posture recognition by joint application of motion history image and pyramid histogram of oriented gradients [C]//2013 International Conference on Mechatronics and Semiconductor Materials (S1022-6680), 2014, 846-847: 1102-1105.
[3] Liu Jianyi, Zhang Nanning.Gait history image: A novel temporal template for gait recognition[C]// Proceedings of IEEE International Conference on Multimedia and Expo. USA: IEEE, 2007: 663-666.
[4] 陈实, 高有行. 一种轮廓变化图像小波矩的步态识别[J]. 西安交通大学学报, 2009, 4(1): 90-93.
[5] Tian Yingli, Liu Qingshan, et al. Recognizing expressions from face and body gesture by temporal normalized motion and appearance features[J]. Image and Vision Computing (S2160-7508), 2013, 31(2): 175-185.
[6] Timotius I, Setyawan I. Hand gesture recognition based on motion history images for a simple human-computer interaction system [C]// Proceedings of International Conference on Graphic and Image Processing, Singapore. USA: SPIE, 2012: 87684M-87684M-5.
[7] 吴艳平, 崔宇, 胡士强. 基于运动图像序列的异常行为检测[J]. 计算机应用研究, 2010, 27(7): 2741-2744.
[8] Hiba H, Sreela S.Detection of abnormal behavior in dynamic crowded gatherings[C]// Proceedings of Applied Imagery Pattern Recognition Workshop: Sensing for Control and Augmentation, Washington DC, USA. USA: IEEE, 2013: 1-6.
[9] Lee Jun, Park J, Seo Y.Emergency detection based on motion history image and AdaBoost for an intelligent surveillance system[M]// Information Technology Convergence. The Netherlands: Springer, 2013: 881-888.
[10] Ahad M, Tan J, Kim H.Motion history image: its variants and applications[J]. Machine Vision and Applications (S1432-1769), 2012, 23(2): 255-281.
[11] Ahad M, Tan J, Kim H, et al. Action recognition by employing combined directional motion history and energy images[C]// Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, San Francisco, CA, USA. USA: IEEE, 2010: 73-78.
[12] Gupta R, Jain A, Rana S.A novel method to represent repetitive and overwriting activities in motion history images[C]// Proceedings of International Conference on Communications and Signal Processing, Melmaruvathur, India. USA: IEEE, 2013: 556-560.
[13] Dan M, Toshitaka M, Koji K, et al. Human motion analysis under actual sports game situations: sequential multi-decay motion history image matching[C]// Proceedings of International Conference on Computer Vision Theory and Applications. Portugal: INSTICC, 2013: 229-236.

[1]	Zhijie Li, Haoqi Shi, Changhua Li, Jie Zhang. Image Center Layout Optimization Method Based on Improved Genetic Algorithm [J]. Journal of System Simulation, 2022, 34(6): 1173-1184.
[2]	Miaojia Lu, Chengyuan Huang, Jing Teng. Multi-agent Simulation for Online Fresh Food Autonomous Delivery [J]. Journal of System Simulation, 2022, 34(6): 1185-1195.
[3]	Bin Chen, Yue Liu, Yalei Yang. Airport Flight Transit Support Time Collaborative Planning Modeling Based on STN [J]. Journal of System Simulation, 2022, 34(6): 1196-1207.
[4]	Xinyu Dou, Xiaohui Chen, Dequn Liang, Bin Lin. A High Spectral-efficiency Maritime Very-High-Frequency Communication Technology and Simulation [J]. Journal of System Simulation, 2022, 34(6): 1208-1218.
[5]	Shaomi Duan, Huilong Luo, Haipeng Liu. A Hybrid Algorithm Based on Seeker Optimization Algorithm and Salp Swarm Algorithm for PID Parameters Optimization [J]. Journal of System Simulation, 2022, 34(6): 1230-1246.
[6]	Kai Yang, Chunyi Chen, Xiaojuan Hu, Haiyang Yu. Denoising Algorithm Based on Multi-feature Non-local Mean Filtering for Monte Carlo Rendered Images [J]. Journal of System Simulation, 2022, 34(6): 1259-1266.
[7]	Peipei Zhou, Xinglin Hou. An Unsupervised Deep Neural Network for Image Fusion [J]. Journal of System Simulation, 2022, 34(6): 1267-1274.
[8]	Qi Chen, Haoyang Cui. Visual inspection model of UAV cluster based on improved pigeon flock hierarchy [J]. Journal of System Simulation, 2022, 34(6): 1275-1285.
[9]	Muqing Wang, Lei Zhang, Xiumin Fan, Xiaomeng Luo, Wenmin Zhu. Simulation Method of Virtual Human Pose Optimization Based On VR Peripherals [J]. Journal of System Simulation, 2022, 34(6): 1296-1303.
[10]	Peng Cheng, Wenzhu Zhang, Shuhan Xie, Zixuan Yang. Research and Simulation of Internet of Vehicles Task Offloading Based on Mobile Edge Computing [J]. Journal of System Simulation, 2022, 34(6): 1304-1311.
[11]	Cheng Lu, Xuesheng Jin. Design of Interactive Simulated Water Gun Fire Fighting Training System Based on Steam VR [J]. Journal of System Simulation, 2022, 34(6): 1312-1319.
[12]	Hongnai Gao, Lijiang Fu, Qian Xia, Ya Guo. Application of Observability in Performance Evaluation of Photosynthesis Model [J]. Journal of System Simulation, 2022, 34(6): 1330-1342.
[13]	Lingjia Ni, Xiaoxia Huang, Hongga Li, Zibo Zhang. Research on Fire Emergency Evacuation Simulation Based on Cooperative Deep Reinforcement Learning [J]. Journal of System Simulation, 2022, 34(6): 1353-1366.
[14]	Yiling Sun, Yi Chen, Guihua Shan, Xiaoxing Li. Multi-person Interactive Globe System Based on AR Technology [J]. Journal of System Simulation, 2022, 34(6): 1367-1374.
[15]	Dun Meng, Zhuo Hu, Huajun Zhang. Simulation of Multi-layer Ship Evacuation System Based on Improved A* Algorithm [J]. Journal of System Simulation, 2022, 34(6): 1375-1382.