Recognizing hidden emotions from difference image using mean local mapped pattern

Recent progress in computer vision has pushed the limit of facial recognition from human identification to micro-expressions (MEs). However, the visual analysis of MEs is still a very challenging task because of the short occurrence and insignificant intensity of the underlying signals. To date, the...

Full description

Saved in:
Bibliographic Details
Main Authors: Goh, Kam Meng, Sheikh, Usman Ullah, Maul, Tomás H.
Format: Article
Published: Springer New York LLC 2019
Subjects:
Online Access:http://eprints.utm.my/id/eprint/89015/
http://dx.doi.org/10.1007/s11042-019-7385-y
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.utm.89015
record_format eprints
spelling my.utm.890152021-01-26T08:39:09Z http://eprints.utm.my/id/eprint/89015/ Recognizing hidden emotions from difference image using mean local mapped pattern Goh, Kam Meng Sheikh, Usman Ullah Maul, Tomás H. TK Electrical engineering. Electronics Nuclear engineering Recent progress in computer vision has pushed the limit of facial recognition from human identification to micro-expressions (MEs). However, the visual analysis of MEs is still a very challenging task because of the short occurrence and insignificant intensity of the underlying signals. To date, the accuracy of recognizing hidden emotions from frames using conventional methods is still far from reaching saturation. To address this, we have proposed a new ME recognition approach based on Mean Local Mapped Pattern (M-LMP) as a texture feature, which outperforms other state-of-the art features in terms of accuracy due to its capability of capturing small pixel transitions. Inspired by previous work, we applied M-LMP to the difference image computed from an onset frame and an apex frame, where the former represents the frame with neutral emotion and the latter consists of the frame with the largest ME intensity. The extracted local features were classified using support vector machine (SVM) and K nearest neighbourhood (KNN) classifiers. The validation of the proposed approach was performed on the CASME II and CAS(ME)2 datasets, and the results were compared with other similar state-of-the-art approaches. Comprehensive experiments were conducted using various parameters to show the robustness of our approach in the imbalanced and small dataset. Springer New York LLC 2019-08 Article PeerReviewed Goh, Kam Meng and Sheikh, Usman Ullah and Maul, Tomás H. (2019) Recognizing hidden emotions from difference image using mean local mapped pattern. Multimedia Tools and Applications, 78 (15). pp. 21485-21520. ISSN 1380-7501 http://dx.doi.org/10.1007/s11042-019-7385-y
institution Universiti Teknologi Malaysia
building UTM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Teknologi Malaysia
content_source UTM Institutional Repository
url_provider http://eprints.utm.my/
topic TK Electrical engineering. Electronics Nuclear engineering
spellingShingle TK Electrical engineering. Electronics Nuclear engineering
Goh, Kam Meng
Sheikh, Usman Ullah
Maul, Tomás H.
Recognizing hidden emotions from difference image using mean local mapped pattern
description Recent progress in computer vision has pushed the limit of facial recognition from human identification to micro-expressions (MEs). However, the visual analysis of MEs is still a very challenging task because of the short occurrence and insignificant intensity of the underlying signals. To date, the accuracy of recognizing hidden emotions from frames using conventional methods is still far from reaching saturation. To address this, we have proposed a new ME recognition approach based on Mean Local Mapped Pattern (M-LMP) as a texture feature, which outperforms other state-of-the art features in terms of accuracy due to its capability of capturing small pixel transitions. Inspired by previous work, we applied M-LMP to the difference image computed from an onset frame and an apex frame, where the former represents the frame with neutral emotion and the latter consists of the frame with the largest ME intensity. The extracted local features were classified using support vector machine (SVM) and K nearest neighbourhood (KNN) classifiers. The validation of the proposed approach was performed on the CASME II and CAS(ME)2 datasets, and the results were compared with other similar state-of-the-art approaches. Comprehensive experiments were conducted using various parameters to show the robustness of our approach in the imbalanced and small dataset.
format Article
author Goh, Kam Meng
Sheikh, Usman Ullah
Maul, Tomás H.
author_facet Goh, Kam Meng
Sheikh, Usman Ullah
Maul, Tomás H.
author_sort Goh, Kam Meng
title Recognizing hidden emotions from difference image using mean local mapped pattern
title_short Recognizing hidden emotions from difference image using mean local mapped pattern
title_full Recognizing hidden emotions from difference image using mean local mapped pattern
title_fullStr Recognizing hidden emotions from difference image using mean local mapped pattern
title_full_unstemmed Recognizing hidden emotions from difference image using mean local mapped pattern
title_sort recognizing hidden emotions from difference image using mean local mapped pattern
publisher Springer New York LLC
publishDate 2019
url http://eprints.utm.my/id/eprint/89015/
http://dx.doi.org/10.1007/s11042-019-7385-y
_version_ 1690370957432061952
score 13.211869