MMNet: Muscle motion-guided network for micro-expression recognition

TL;DR

This paper introduces MMNet, a novel micro-expression recognition framework that emphasizes muscle motion patterns using attention and position calibration modules, significantly improving accuracy over existing methods.

Contribution

The paper proposes a muscle motion-guided network with a continuous attention block and a position calibration module, enhancing subtle facial motion modeling for better micro-expression recognition.

Findings

Outperforms state-of-the-art methods on three datasets

Effectively models local muscle motion patterns

Improves recognition accuracy significantly

Abstract

Facial micro-expressions (MEs) are involuntary facial motions revealing peoples real feelings and play an important role in the early intervention of mental illness, the national security, and many human-computer interaction systems. However, existing micro-expression datasets are limited and usually pose some challenges for training good classifiers. To model the subtle facial muscle motions, we propose a robust micro-expression recognition (MER) framework, namely muscle motion-guided network (MMNet). Specifically, a continuous attention (CA) block is introduced to focus on modeling local subtle muscle motion patterns with little identity information, which is different from most previous methods that directly extract features from complete video frames with much identity information. Besides, we design a position calibration (PC) module based on the vision transformer. By adding the position embeddings of the face generated by PC module at the end of the two branches, the PC module can help to add position information to facial muscle motion pattern features for the MER. Extensive experiments on three public micro-expression datasets demonstrate that our approach outperforms state-of-the-art methods by a large margin.