Rock-paper-scissors game using real-time object detection

This project introduces an innovative Rock-Paper-Scissors (RPS) game that integrates real-time hand gesture recognition within a Flutter-based mobile application, leveraging advanced machine learning techniques. Utilizing MobileNetV2, a lightweight convolutional neural network, the system reliably c...

Full description

Saved in:
Bibliographic Details
Main Author: Lim, Xiao Yun
Format: Final Year Project / Dissertation / Thesis
Published: 2025
Subjects:
Online Access:http://eprints.utar.edu.my/6127/1/fyp_DE_2025_LXY.pdf
http://eprints.utar.edu.my/6127/
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This project introduces an innovative Rock-Paper-Scissors (RPS) game that integrates real-time hand gesture recognition within a Flutter-based mobile application, leveraging advanced machine learning techniques. Utilizing MobileNetV2, a lightweight convolutional neural network, the system reliably classifies rock, paper, and scissors gestures from live camera feeds. Developed through an evolutionary prototyping methodology, the project iteratively refined a TensorFlow Lite-deployed model and a user-friendly interface featuring tutorial screens, game history tracking, and celebratory animations. OpenCV ensured robust dataset preprocessing, enabling high-quality training data, while Flutter facilitated seamless cross-platform performance. Extensive testing confirmed the system’s effectiveness across diverse lighting conditions and device specifications, achieving consistent gesture detection and rapid UI responsiveness. By addressing challenges such as gesture variability and real-time processing latency through model optimization and efficient camera handling, the project delivers an immersive gaming experience without physical controllers. This work advances interactive gaming by demonstrating the feasibility of deploying sophisticated machine learning models on resource-constrained mobile devices. The framework offers potential for applications in educational tools and assistive technologies, contributing to further developments in computer vision and human-computer interaction.