Staff View: Analysis of performance between kinect v1 and kinect v2 for various facial part movements using supervised machine learning techniques

Analysis of performance between kinect v1 and kinect v2 for various facial part movements using supervised machine learning techniques

Facial exercises are a series of facial movements such as exaggeration and deflation in upper, middle, and lower face zone for promoting youth and rejuvenating facial muscles. Previously, the effectiveness of facial exercises for rehabilitation and rejuvenation purposes is still controversial due to...

Full description

Saved in:

Bibliographic Details
Main Author:	Heng, Sheng Guang
Format:	Thesis
Language:	English
Published:	2022
Subjects:	TA Engineering (General). Civil engineering (General) TK Electrical engineering. Electronics Nuclear engineering
Online Access:	http://umpir.ump.edu.my/id/eprint/37656/1/ir.Analysis%20of%20performance%20between%20kinect%20v1%20and%20kinect%20v2%20for%20various%20facial%20part%20movements%20using%20supervised%20machine%20learning%20techniques.pdf http://umpir.ump.edu.my/id/eprint/37656/
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my.ump.umpir.37656
record_format	eprints
spelling	my.ump.umpir.376562023-09-18T03:58:38Z http://umpir.ump.edu.my/id/eprint/37656/ Analysis of performance between kinect v1 and kinect v2 for various facial part movements using supervised machine learning techniques Heng, Sheng Guang TA Engineering (General). Civil engineering (General) TK Electrical engineering. Electronics Nuclear engineering Facial exercises are a series of facial movements such as exaggeration and deflation in upper, middle, and lower face zone for promoting youth and rejuvenating facial muscles. Previously, the effectiveness of facial exercises for rehabilitation and rejuvenation purposes is still controversial due to lack of quantitative study. However, recent studies have proven the efficacy of the facial exercises through assistive device and guidance from physiotherapist. The process of rehabilitation and rejuvenation through facial exercises is uninteresting and time consuming. Frequently, lack of motivation and patient are the main reasons for treatment failure. Hence, interesting course of facial exercise treatment and encouragement are essential to increase the success rate and effectiveness. The aim of this study is to analyse the performance of Kinect motion sensor version 1 and 2 for development of facial exercise application based on the analysis of face tracking performance. Common 2D cameras are lack of depth information, hence will result in inaccurate facial point detection. In this study, 3D cameras such as Kinect motion sensors version 1 (v1) and version 2 (v2) are used instead of ordinary 2D camera for more accurate facial points detection. Both Kinect sensors are used to apply the Active Appearance Models (AAM) method to detect and extract the facial features. Then, various classic classification methods such as neural network, complex decision tree, cubic support vector machine (SVM), fine Gaussian SVM, fine k-nearest neighbours (kNN), and quadratic discriminant analysis are applied to analyse the detection accuracy of both Kinect motion sensors. After that, the version of Kinect sensor which has better performance is adopted for facial exercises application. The dataset with highest testing accuracy is analysed for constructing rule-based system for the facial exercises application. Eventually, Kinect v2 has outperformed in almost every task by comparing to Kinect v1 except the raising eyebrows exercise. Furthermore, the training and testing accuracies of face data acquired by using Kinect v2 are significantly higher than Kinect v1. The kNN classification is the most suitable method among the applied classification methods as it marks the satisfying training and testing accuracy for both Kinect v2, which are 97.8% and 94.3% respectively. Hence, the correctly predicted dataset using kNN classification method is used for box plot analysis to obtain the threshold parameters, which are mean, lower quartile values, and upper quartile values of the facial part movements. Then, the threshold parameters are used to construct a rule-based system for the real-time facial exercises application. The facial exercises application features with House-Brackmann grading system which gives evaluation of score and grade after completing each set of selected facial exercises. In conclusion, the developed Kinect-based facial exercise application performs successfully and able to give scoring feedback to the user. The application will be able to motivate and encourage users for home facial exercise purpose. 2022-12 Thesis NonPeerReviewed pdf en http://umpir.ump.edu.my/id/eprint/37656/1/ir.Analysis%20of%20performance%20between%20kinect%20v1%20and%20kinect%20v2%20for%20various%20facial%20part%20movements%20using%20supervised%20machine%20learning%20techniques.pdf Heng, Sheng Guang (2022) Analysis of performance between kinect v1 and kinect v2 for various facial part movements using supervised machine learning techniques. Masters thesis, Universiti Malaysia Pahang (Contributors, Thesis advisor: Rosdiyana, Samad).
institution	Universiti Malaysia Pahang
building	UMP Library
collection	Institutional Repository
continent	Asia
country	Malaysia
content_provider	Universiti Malaysia Pahang
content_source	UMP Institutional Repository
url_provider	http://umpir.ump.edu.my/
language	English
topic	TA Engineering (General). Civil engineering (General) TK Electrical engineering. Electronics Nuclear engineering
spellingShingle	TA Engineering (General). Civil engineering (General) TK Electrical engineering. Electronics Nuclear engineering Heng, Sheng Guang Analysis of performance between kinect v1 and kinect v2 for various facial part movements using supervised machine learning techniques
description	Facial exercises are a series of facial movements such as exaggeration and deflation in upper, middle, and lower face zone for promoting youth and rejuvenating facial muscles. Previously, the effectiveness of facial exercises for rehabilitation and rejuvenation purposes is still controversial due to lack of quantitative study. However, recent studies have proven the efficacy of the facial exercises through assistive device and guidance from physiotherapist. The process of rehabilitation and rejuvenation through facial exercises is uninteresting and time consuming. Frequently, lack of motivation and patient are the main reasons for treatment failure. Hence, interesting course of facial exercise treatment and encouragement are essential to increase the success rate and effectiveness. The aim of this study is to analyse the performance of Kinect motion sensor version 1 and 2 for development of facial exercise application based on the analysis of face tracking performance. Common 2D cameras are lack of depth information, hence will result in inaccurate facial point detection. In this study, 3D cameras such as Kinect motion sensors version 1 (v1) and version 2 (v2) are used instead of ordinary 2D camera for more accurate facial points detection. Both Kinect sensors are used to apply the Active Appearance Models (AAM) method to detect and extract the facial features. Then, various classic classification methods such as neural network, complex decision tree, cubic support vector machine (SVM), fine Gaussian SVM, fine k-nearest neighbours (kNN), and quadratic discriminant analysis are applied to analyse the detection accuracy of both Kinect motion sensors. After that, the version of Kinect sensor which has better performance is adopted for facial exercises application. The dataset with highest testing accuracy is analysed for constructing rule-based system for the facial exercises application. Eventually, Kinect v2 has outperformed in almost every task by comparing to Kinect v1 except the raising eyebrows exercise. Furthermore, the training and testing accuracies of face data acquired by using Kinect v2 are significantly higher than Kinect v1. The kNN classification is the most suitable method among the applied classification methods as it marks the satisfying training and testing accuracy for both Kinect v2, which are 97.8% and 94.3% respectively. Hence, the correctly predicted dataset using kNN classification method is used for box plot analysis to obtain the threshold parameters, which are mean, lower quartile values, and upper quartile values of the facial part movements. Then, the threshold parameters are used to construct a rule-based system for the real-time facial exercises application. The facial exercises application features with House-Brackmann grading system which gives evaluation of score and grade after completing each set of selected facial exercises. In conclusion, the developed Kinect-based facial exercise application performs successfully and able to give scoring feedback to the user. The application will be able to motivate and encourage users for home facial exercise purpose.
format	Thesis
author	Heng, Sheng Guang
author_facet	Heng, Sheng Guang
author_sort	Heng, Sheng Guang
title	Analysis of performance between kinect v1 and kinect v2 for various facial part movements using supervised machine learning techniques
title_short	Analysis of performance between kinect v1 and kinect v2 for various facial part movements using supervised machine learning techniques
title_full	Analysis of performance between kinect v1 and kinect v2 for various facial part movements using supervised machine learning techniques
title_fullStr	Analysis of performance between kinect v1 and kinect v2 for various facial part movements using supervised machine learning techniques
title_full_unstemmed	Analysis of performance between kinect v1 and kinect v2 for various facial part movements using supervised machine learning techniques
title_sort	analysis of performance between kinect v1 and kinect v2 for various facial part movements using supervised machine learning techniques
publishDate	2022
url	http://umpir.ump.edu.my/id/eprint/37656/1/ir.Analysis%20of%20performance%20between%20kinect%20v1%20and%20kinect%20v2%20for%20various%20facial%20part%20movements%20using%20supervised%20machine%20learning%20techniques.pdf http://umpir.ump.edu.my/id/eprint/37656/
_version_	1778161079635935232
score	13.211869

Analysis of performance between kinect v1 and kinect v2 for various facial part movements using supervised machine learning techniques

Similar Items