Behavior Recognition Combining Regional Optical Flow Features and Temporal Templates

Abstract

Abstract: A method was proposed to recognize human behavior, which combined the wavelet moments of temporal templates and the speed feature by optical flow. The wavelet moments are not only rotation, translation and scale invariance, but also have the multi-scale characteristics of wavelet. The shape feature of the motion history image and motion energy image can be described. To simple motions, it's effectively, but it can't present the speed information. Regional optical flow was calculated to describe the direction and amplitude features of motion by Lucas-Kanade algorithm. It could make up shortcomings of wavelet moment without speed information. Being combined two ways of describing the motion and based on the Weizmann Database, experiment results verify the proposed method effectiveness.

Key words: human behavior recognition, temporal templates, wavelet moment, calculation of optical flow

CLC Number:

TP391

Wang Manyi, Song Yaling, Li Yu, Zhang Liang. Behavior Recognition Combining Regional Optical Flow Features and Temporal Templates[J]. Journal of System Simulation, 2015, 27(5): 1146-1151.

References

[1] Bobick A, Davis J.The recognition of human movement using temporal templates[J]. IEEE Trans. On Pattern Analysis and Machine Intelligence (S0162-8838), 2001, 23(3): 257-267.
[2] Lan Chao, Coenen F, Zhang Bai-ling. Driving posture recognition by joint application of motion history image and pyramid histogram of oriented gradients [C]//2013 International Conference on Mechatronics and Semiconductor Materials (S1022-6680), 2014, 846-847: 1102-1105.
[3] Liu Jianyi, Zhang Nanning.Gait history image: A novel temporal template for gait recognition[C]// Proceedings of IEEE International Conference on Multimedia and Expo. USA: IEEE, 2007: 663-666.
[4] 陈实, 高有行. 一种轮廓变化图像小波矩的步态识别[J]. 西安交通大学学报, 2009, 4(1): 90-93.
[5] Tian Yingli, Liu Qingshan, et al. Recognizing expressions from face and body gesture by temporal normalized motion and appearance features[J]. Image and Vision Computing (S2160-7508), 2013, 31(2): 175-185.
[6] Timotius I, Setyawan I. Hand gesture recognition based on motion history images for a simple human-computer interaction system [C]// Proceedings of International Conference on Graphic and Image Processing, Singapore. USA: SPIE, 2012: 87684M-87684M-5.
[7] 吴艳平, 崔宇, 胡士强. 基于运动图像序列的异常行为检测[J]. 计算机应用研究, 2010, 27(7): 2741-2744.
[8] Hiba H, Sreela S.Detection of abnormal behavior in dynamic crowded gatherings[C]// Proceedings of Applied Imagery Pattern Recognition Workshop: Sensing for Control and Augmentation, Washington DC, USA. USA: IEEE, 2013: 1-6.
[9] Lee Jun, Park J, Seo Y.Emergency detection based on motion history image and AdaBoost for an intelligent surveillance system[M]// Information Technology Convergence. The Netherlands: Springer, 2013: 881-888.
[10] Ahad M, Tan J, Kim H.Motion history image: its variants and applications[J]. Machine Vision and Applications (S1432-1769), 2012, 23(2): 255-281.
[11] Ahad M, Tan J, Kim H, et al. Action recognition by employing combined directional motion history and energy images[C]// Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, San Francisco, CA, USA. USA: IEEE, 2010: 73-78.
[12] Gupta R, Jain A, Rana S.A novel method to represent repetitive and overwriting activities in motion history images[C]// Proceedings of International Conference on Communications and Signal Processing, Melmaruvathur, India. USA: IEEE, 2013: 556-560.
[13] Dan M, Toshitaka M, Koji K, et al. Human motion analysis under actual sports game situations: sequential multi-decay motion history image matching[C]// Proceedings of International Conference on Computer Vision Theory and Applications. Portugal: INSTICC, 2013: 229-236.

[1]	Dong Zhiming, Hu Zhongqi, Dai Haoran, Gao Jiancheng. An Automated Generation Method for Combat Simulation Scenarios Based on Large Language Models [J]. Journal of System Simulation, 2026, 38(5): 1129-1145.
[2]	Li Xiaonan, Chao Tao, Ma Ping, Yang Ming, Wang Yuxuan. Robust Identification of Black-box Nonlinear SSM Using Expectation-maximization [J]. Journal of System Simulation, 2026, 38(5): 1146-1158.
[3]	Liu Yingang, Ma Ming, Zhang Ronghua. Dynamic Task Planning for Wargaming Based on Large Language Models [J]. Journal of System Simulation, 2026, 38(5): 1187-1204.
[4]	Su Hongjia, Zhang Cheng, Liu Fei. SoS Effectiveness Evaluation Method Based on Fuzzy Functional Dependency Network Analysis [J]. Journal of System Simulation, 2026, 38(5): 1224-1238.
[5]	Mei Huawei, Yang Penghui, Yu Yang. Ultra-short-term Photovoltaic Power Prediction Based on Improved PatchTST Considering Data Drift [J]. Journal of System Simulation, 2026, 38(5): 1239-1254.
[6]	Li Quan, Su Peng, Wan Haiying, Zhang Chengxi, He Zhijian, Ni Yiyang, Zhao Zhonggai, Liu Fei. Modeling of Penicillin Fermentation Process Based on a Multi-stage LHS-EPRCC Method [J]. Journal of System Simulation, 2026, 38(5): 1255-1276.
[7]	Zhou Zicong, Zeng Junjie, Hu Yue, Zhu Zhengqiu, Yin Quanjun. Multi-agent Reinforcement Learning Method for Wargame Simulation Based on Suboptimal Demonstration Guidance [J]. Journal of System Simulation, 2026, 38(5): 1277-1289.
[8]	Shi Min, Guo Shisheng, Wang Suqin, Li Zhaoxin, Zhu Dengming. Annotation-free 6-DoF Grasp Detection Method Integrating Physical and Geometric Priors [J]. Journal of System Simulation, 2026, 38(5): 1290-1302.
[9]	Jiang Yanji, Xiao Xingyi, Dong Hao, Yu Miao, Huang Jinshan, Liu Daqian, Fei Bowen. Detection Method for 3D Lanes Based on Graph Relationship Optimization Integrating Point and Lane Features [J]. Journal of System Simulation, 2026, 38(5): 1303-1319.
[10]	Zhang Xin, Zhang Ping, Zhang Chen, Liu Wei, Han Boyang. Research on Calculation Model of Excavation Resistance Under Heterogeneous Soil Conditions [J]. Journal of System Simulation, 2026, 38(5): 1320-1332.
[11]	Tao Ye, Tang Jinhui, Zhou Chen, Wang Chong. Research on Completion Method for Trajectory Based on Image Representation and Collaborative Feature Perception [J]. Journal of System Simulation, 2026, 38(5): 1333-1349.
[12]	Wang Wei, Liu Dong, Cui Xinhao, Li Bo, Xiao Yiyong, Ren Yi. Multi-level Digital Model of Dynamic Earned Value Management for Complex Engineering Projects and Its Applications [J]. Journal of System Simulation, 2026, 38(5): 1350-1364.
[13]	Peng Lijun, Su Tingqi, Liu Peijin, He Lin, Zhou Xiewu, Zhang Minxin. Detection Method for Laboratory PPE Compliance Wearing Based on Human Key Points [J]. Journal of System Simulation, 2026, 38(5): 1365-1382.
[14]	Teng Jing, Tong Wencong, Zhang Zhongjie, Yao Xing, Li Junxian. Automatic Speed Guidance Method and Simulation Evaluation for Trams at Intersections [J]. Journal of System Simulation, 2026, 38(5): 1426-1439.
[15]	Fan Shuanghao, He Fang, Zhao Jianwei, Hu Haojie, Zhu Fengchao, Li Xiangyang. Hyperspectral Anomaly Detection Algorithm Based on Window Reconstruction and Collaborative Representation [J]. Journal of System Simulation, 2026, 38(5): 1440-1452.