Facial expression recognition for human-computer interaction

This project proposes the development of a robust Facial Expression Recognition (FER) system integrated within a chatbot framework, aimed at assisting individuals in recognizing and interpreting their emotional states more effectively. The system employs a deep learning-based approach, specifical...

Full description

Saved in:
Bibliographic Details
Main Author: Tey, Yong Sheng
Format: Final Year Project / Dissertation / Thesis
Published: 2025
Subjects:
Online Access:http://eprints.utar.edu.my/7239/1/fyp_CS_2025_TYS.pdf
http://eprints.utar.edu.my/7239/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1854094494871322624
author Tey, Yong Sheng
author_facet Tey, Yong Sheng
author_sort Tey, Yong Sheng
building UTAR Library
collection Institutional Repository
content_provider Universiti Tunku Abdul Rahman
content_source UTAR Institutional Repository
continent Asia
country Malaysia
description This project proposes the development of a robust Facial Expression Recognition (FER) system integrated within a chatbot framework, aimed at assisting individuals in recognizing and interpreting their emotional states more effectively. The system employs a deep learning-based approach, specifically utilizing the EfficientNet architecture, to improve the accuracy and reliability of emotion detection. It integrates advanced Convolutional Neural Network (CNN) techniques with preprocessing strategies to address variations in lighting conditions, patient demographics, and facial occlusions, thereby ensuring consistent performance across diverse clinical environments. Furthermore, the system delivers real-time feedback and personalized guidance based on the detected emotions, fostering more empathetic and patient-centered care. To achieve efficient real-time processing on resource-constrained medical devices, the model incorporates optimization techniques such as pruning, quantization, and lightweight CNN architectures. At the end, this project successfully trained a robust Facial Expression Recognition (FER) model with approximately 73% accuracy, integrated it with a chatbot system, and deployed the complete solution on a website to enable real-time, emotion-aware interactions.
format Final Year Project / Dissertation / Thesis
id my-utar-eprints.7239
institution Universiti Tunku Abdul Rahman
publishDate 2025
record_format eprints
spelling my-utar-eprints.72392025-12-29T09:56:33Z Facial expression recognition for human-computer interaction Tey, Yong Sheng T Technology (General) TD Environmental technology. Sanitary engineering This project proposes the development of a robust Facial Expression Recognition (FER) system integrated within a chatbot framework, aimed at assisting individuals in recognizing and interpreting their emotional states more effectively. The system employs a deep learning-based approach, specifically utilizing the EfficientNet architecture, to improve the accuracy and reliability of emotion detection. It integrates advanced Convolutional Neural Network (CNN) techniques with preprocessing strategies to address variations in lighting conditions, patient demographics, and facial occlusions, thereby ensuring consistent performance across diverse clinical environments. Furthermore, the system delivers real-time feedback and personalized guidance based on the detected emotions, fostering more empathetic and patient-centered care. To achieve efficient real-time processing on resource-constrained medical devices, the model incorporates optimization techniques such as pruning, quantization, and lightweight CNN architectures. At the end, this project successfully trained a robust Facial Expression Recognition (FER) model with approximately 73% accuracy, integrated it with a chatbot system, and deployed the complete solution on a website to enable real-time, emotion-aware interactions. 2025-06 Final Year Project / Dissertation / Thesis NonPeerReviewed application/pdf http://eprints.utar.edu.my/7239/1/fyp_CS_2025_TYS.pdf Tey, Yong Sheng (2025) Facial expression recognition for human-computer interaction. Final Year Project, UTAR. http://eprints.utar.edu.my/7239/
spellingShingle T Technology (General)
TD Environmental technology. Sanitary engineering
Tey, Yong Sheng
Facial expression recognition for human-computer interaction
title Facial expression recognition for human-computer interaction
title_full Facial expression recognition for human-computer interaction
title_fullStr Facial expression recognition for human-computer interaction
title_full_unstemmed Facial expression recognition for human-computer interaction
title_short Facial expression recognition for human-computer interaction
title_sort facial expression recognition for human-computer interaction
topic T Technology (General)
TD Environmental technology. Sanitary engineering
url http://eprints.utar.edu.my/7239/1/fyp_CS_2025_TYS.pdf
http://eprints.utar.edu.my/7239/
url_provider http://eprints.utar.edu.my