Journal of System Simulation ›› 2020, Vol. 32 ›› Issue (7): 1322-1330.doi: 10.16182/j.issn1004731x.joss.19-VR0470

Previous Articles     Next Articles

Learning Expression Recognition Based On Image Sequence

Wang Suqin1, Zhang Feng1, Gao Yudou2, Shi Min1   

  1. 1. School of Control and Computer Engineering, North China Electric Power University, Beijing 102206, China;
    2. Information center of Yunnan Power Grid Co., Ltd, Kunming 650200, China
  • Received:2019-08-30 Revised:2019-12-12 Online:2020-07-25 Published:2020-07-15

Abstract: By recognizing the facial expressions, the emotional state of learner can be judged and their learning effect can be analyzed. Due to the persistence and timing of facial expressions, the sequence of facial images is adopted as the object of facial expression recognition. The Long Short Term Memory Network (LSTM) and VGGNet are combined into a VGGNET-LSTM model. On this basis, facial expression recognition is carried out, which significantly improves the accuracy of recognition. Based on the transfer learning method, VGGNet is transferred to the learning expression data set after being pre-trained through the basic expression data set CK+ and avoids the defect of insufficient data in the learning expression data set and solves the problem of overfitting the model.

Key words: expression recognition, academic emotion, image sequence, transfer learning

CLC Number: