Development of video-based emotion recognition system using transfer learning

Due to the complexity of its system and the numerous advantages of its implementation, video emotion identification is a popular area of study today. There have been multiple ways implemented. In this project, emotion recognition in videos will be performed using deep learning. The model will includ...

Full description

Saved in:
Bibliographic Details
Main Authors: Gunawan, Teddy Surya, Muktaruddin, Muhammad Nuruddin, Kartiwi, Mira, Ahmad, Yasser Asrul, Rosahdi, Tina Dewi, Ulfiah, Ulfiah
Format: Conference or Workshop Item
Language:English
English
Published: IEEE 2022
Subjects:
Online Access:http://irep.iium.edu.my/101865/7/101865_Development%20of%20Video-based%20Emotion%20Recognition%20System%20using%20Transfer%20Learning.pdf
http://irep.iium.edu.my/101865/13/101865_Development%20of%20Video-Based%20Emotion%20Recognition%20System%20using%20Transfer%20Learning_Scopus.pdf
http://irep.iium.edu.my/101865/
https://icsima.ieeemy-ims.org/22/program-schedule/
https://doi.org/10.1109/ICSIMA55652.2022.9928867
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Due to the complexity of its system and the numerous advantages of its implementation, video emotion identification is a popular area of study today. There have been multiple ways implemented. In this project, emotion recognition in videos will be performed using deep learning. The model will include initialization, feature extraction, emotion categorization, and prediction. LeNet and AlexNet, two distinct neural networks, are used to extract features and classify emotions. There will be some parameter tuning to determine if it enhances the employed architecture’s performance, including optimizers and batch size. Each architecture for deep learning will generate a final forecast of four fundamental emotions: disgust, happiness, sadness, and surprise. AlexNet’s performance is enhanced by the SGD optimizer, whereas RMSprop improves LeNet’s performance. Results showed that AlexNet with SGD optimizer provides 93.00% recognition accuracy.