Cover Image

Mobile application for real time baby sign language recognition using YOLOv8 / Siti Aishah Idris and Ahmad Firdaus Ahmad Fadzil

Nowadays, the use of baby sign language has increased among parents in recent years. This language utilizes simple hand gestures and motions as a medium to express the baby’s needs, wants, and feelings. This is particularly important because babies have not yet developed the ability to speak. Howeve...

Full description

Saved in:
Bibliographic Details
Main Authors: Idris, Siti Aishah, Ahmad Fadzil, Ahmad Firdaus
Format: Article
Language:English
Published: College of Computing, Informatics, and Mathematics 2024
Subjects:
Integer programming
Online Access:https://ir.uitm.edu.my/id/eprint/106008/1/106008.pdf
https://ir.uitm.edu.my/id/eprint/106008/
https://fskmjebat.uitm.edu.my/pcmj/
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.uitm.ir.106008
record_format eprints
spelling my.uitm.ir.1060082025-02-25T08:23:09Z https://ir.uitm.edu.my/id/eprint/106008/ Mobile application for real time baby sign language recognition using YOLOv8 / Siti Aishah Idris and Ahmad Firdaus Ahmad Fadzil Idris, Siti Aishah Ahmad Fadzil, Ahmad Firdaus Integer programming Nowadays, the use of baby sign language has increased among parents in recent years. This language utilizes simple hand gestures and motions as a medium to express the baby’s needs, wants, and feelings. This is particularly important because babies have not yet developed the ability to speak. However, this language is still neither widely used nor a generally recognized mode of communication, especially for caregivers. This can lead to tantrums when the baby’s needs are not understood or met promptly. Additionally, some parents have expressed difficulties in learning and remembering the sign. Hence, the development of real-time baby sign language recognition on mobile platforms could help to address these issues. This research will focus only on six basic baby sign languages that are commonly used in daily life. The model will be designed and developed using a deep learning algorithm, which is YOLOv8, the latest version of YOLO. This model can recognize and interpret baby signs based on visual input from the mobile phone’s camera in real time, and also includes a dictionary feature that can be a learning tool for parents and caregivers. In the development phase, the dataset is pre-processed before the modeling process is done using YOLOv8, and deployed on Android platforms using Java and Kotlin languages in Android Studio. Functionality testing and accuracy testing have been conducted. The functionality test produced successful results for all test cases, while for accuracy testing, the model achieved an accuracy of 99.50% for Mean Average Precision, indicating its proficiency in recognizing each of the classes. College of Computing, Informatics, and Mathematics 2024-10 Article NonPeerReviewed text en https://ir.uitm.edu.my/id/eprint/106008/1/106008.pdf Mobile application for real time baby sign language recognition using YOLOv8 / Siti Aishah Idris and Ahmad Firdaus Ahmad Fadzil. (2024) Progress in Computer and Mathematics Journal (PCMJ) <https://ir.uitm.edu.my/view/publication/Progress_in_Computer_and_Mathematics_Journal_=28PCMJ=29/>, 1. pp. 434-447. ISSN 3030-6728 (Submitted) https://fskmjebat.uitm.edu.my/pcmj/
institution Universiti Teknologi Mara
building Tun Abdul Razak Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Teknologi Mara
content_source UiTM Institutional Repository
url_provider http://ir.uitm.edu.my/
language English
topic Integer programming
spellingShingle Integer programming
Idris, Siti Aishah
Ahmad Fadzil, Ahmad Firdaus
Mobile application for real time baby sign language recognition using YOLOv8 / Siti Aishah Idris and Ahmad Firdaus Ahmad Fadzil
description Nowadays, the use of baby sign language has increased among parents in recent years. This language utilizes simple hand gestures and motions as a medium to express the baby’s needs, wants, and feelings. This is particularly important because babies have not yet developed the ability to speak. However, this language is still neither widely used nor a generally recognized mode of communication, especially for caregivers. This can lead to tantrums when the baby’s needs are not understood or met promptly. Additionally, some parents have expressed difficulties in learning and remembering the sign. Hence, the development of real-time baby sign language recognition on mobile platforms could help to address these issues. This research will focus only on six basic baby sign languages that are commonly used in daily life. The model will be designed and developed using a deep learning algorithm, which is YOLOv8, the latest version of YOLO. This model can recognize and interpret baby signs based on visual input from the mobile phone’s camera in real time, and also includes a dictionary feature that can be a learning tool for parents and caregivers. In the development phase, the dataset is pre-processed before the modeling process is done using YOLOv8, and deployed on Android platforms using Java and Kotlin languages in Android Studio. Functionality testing and accuracy testing have been conducted. The functionality test produced successful results for all test cases, while for accuracy testing, the model achieved an accuracy of 99.50% for Mean Average Precision, indicating its proficiency in recognizing each of the classes.
format Article
author Idris, Siti Aishah
Ahmad Fadzil, Ahmad Firdaus
author_facet Idris, Siti Aishah
Ahmad Fadzil, Ahmad Firdaus
author_sort Idris, Siti Aishah
title Mobile application for real time baby sign language recognition using YOLOv8 / Siti Aishah Idris and Ahmad Firdaus Ahmad Fadzil
title_short Mobile application for real time baby sign language recognition using YOLOv8 / Siti Aishah Idris and Ahmad Firdaus Ahmad Fadzil
title_full Mobile application for real time baby sign language recognition using YOLOv8 / Siti Aishah Idris and Ahmad Firdaus Ahmad Fadzil
title_fullStr Mobile application for real time baby sign language recognition using YOLOv8 / Siti Aishah Idris and Ahmad Firdaus Ahmad Fadzil
title_full_unstemmed Mobile application for real time baby sign language recognition using YOLOv8 / Siti Aishah Idris and Ahmad Firdaus Ahmad Fadzil
title_sort mobile application for real time baby sign language recognition using yolov8 / siti aishah idris and ahmad firdaus ahmad fadzil
publisher College of Computing, Informatics, and Mathematics
publishDate 2024
url https://ir.uitm.edu.my/id/eprint/106008/1/106008.pdf
https://ir.uitm.edu.my/id/eprint/106008/
https://fskmjebat.uitm.edu.my/pcmj/
_version_ 1825165086969298944
score 13.239859

Similar Items