Speech recognition-based wireless control system for mobile robotics: Design, implementation, and analysis

This paper describes an innovative wireless mobile robotics control system based on speech recognition, where the ESP32 microcontroller is used to control motors, facilitate Bluetooth communication, and deploy an Android application for the real-time speech recognition logic. With speech processed o...

Full description

Saved in:
Bibliographic Details
Main Authors: Al Gburi, Ahmed Jamal Abdullah, Gupta, Sandeep, Mamodiya, Udit
Format: Article
Language:en
Published: Multidisciplinary Digital Publishing Institute (MDPI) 2025
Online Access:http://eprints.utem.edu.my/id/eprint/29236/2/0270208102025176412281.pdf
http://eprints.utem.edu.my/id/eprint/29236/
https://www.mdpi.com/2673-4052/6/3/25
https://doi.org/10.3390/automation6030025
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1852709292282478592
author Al Gburi, Ahmed Jamal Abdullah
Gupta, Sandeep
Mamodiya, Udit
author_facet Al Gburi, Ahmed Jamal Abdullah
Gupta, Sandeep
Mamodiya, Udit
author_sort Al Gburi, Ahmed Jamal Abdullah
building UTEM Library
collection Institutional Repository
content_provider Universiti Teknikal Malaysia Melaka
content_source UTEM Institutional Repository
continent Asia
country Malaysia
description This paper describes an innovative wireless mobile robotics control system based on speech recognition, where the ESP32 microcontroller is used to control motors, facilitate Bluetooth communication, and deploy an Android application for the real-time speech recognition logic. With speech processed on the Android device and motor commands handled on the ESP32, the study achieves significant performance gains through distributed architectures while maintaining low latency for feedback control. In experimental tests over a range of 1–10 m, stable 110–140 ms command latencies, with low variation (±15 ms) were observed. The system’s voice and manual button modes both yield over 92% accuracy with the aid of natural language processing, resulting in training requirements being low, and displaying strong performance in high-noise environments. The novelty of this work is evident through an adaptive keyword spotting algorithm for improved recognition performance in high-noise environments and a gradual latency management system that optimizes processing parameters in the presence of noise. By providing a user-friendly, real-time speech interface, this work serves to enhance human–robot interaction when considering future assistive devices, educational platforms, and advanced automated navigation research.
format Article
id my.utem.eprints-29236
institution Universiti Teknikal Malaysia Melaka
language en
publishDate 2025
publisher Multidisciplinary Digital Publishing Institute (MDPI)
record_format eprints
spelling my.utem.eprints-292362025-12-12T01:56:37Z http://eprints.utem.edu.my/id/eprint/29236/ Speech recognition-based wireless control system for mobile robotics: Design, implementation, and analysis Al Gburi, Ahmed Jamal Abdullah Gupta, Sandeep Mamodiya, Udit This paper describes an innovative wireless mobile robotics control system based on speech recognition, where the ESP32 microcontroller is used to control motors, facilitate Bluetooth communication, and deploy an Android application for the real-time speech recognition logic. With speech processed on the Android device and motor commands handled on the ESP32, the study achieves significant performance gains through distributed architectures while maintaining low latency for feedback control. In experimental tests over a range of 1–10 m, stable 110–140 ms command latencies, with low variation (±15 ms) were observed. The system’s voice and manual button modes both yield over 92% accuracy with the aid of natural language processing, resulting in training requirements being low, and displaying strong performance in high-noise environments. The novelty of this work is evident through an adaptive keyword spotting algorithm for improved recognition performance in high-noise environments and a gradual latency management system that optimizes processing parameters in the presence of noise. By providing a user-friendly, real-time speech interface, this work serves to enhance human–robot interaction when considering future assistive devices, educational platforms, and advanced automated navigation research. Multidisciplinary Digital Publishing Institute (MDPI) 2025 Article PeerReviewed text en cc_by_4 http://eprints.utem.edu.my/id/eprint/29236/2/0270208102025176412281.pdf Al Gburi, Ahmed Jamal Abdullah and Gupta, Sandeep and Mamodiya, Udit (2025) Speech recognition-based wireless control system for mobile robotics: Design, implementation, and analysis. Automation, 6 (3). pp. 1-28. ISSN 2673-4052 https://www.mdpi.com/2673-4052/6/3/25 https://doi.org/10.3390/automation6030025
spellingShingle Al Gburi, Ahmed Jamal Abdullah
Gupta, Sandeep
Mamodiya, Udit
Speech recognition-based wireless control system for mobile robotics: Design, implementation, and analysis
title Speech recognition-based wireless control system for mobile robotics: Design, implementation, and analysis
title_full Speech recognition-based wireless control system for mobile robotics: Design, implementation, and analysis
title_fullStr Speech recognition-based wireless control system for mobile robotics: Design, implementation, and analysis
title_full_unstemmed Speech recognition-based wireless control system for mobile robotics: Design, implementation, and analysis
title_short Speech recognition-based wireless control system for mobile robotics: Design, implementation, and analysis
title_sort speech recognition-based wireless control system for mobile robotics: design, implementation, and analysis
url http://eprints.utem.edu.my/id/eprint/29236/2/0270208102025176412281.pdf
http://eprints.utem.edu.my/id/eprint/29236/
https://www.mdpi.com/2673-4052/6/3/25
https://doi.org/10.3390/automation6030025
url_provider http://eprints.utem.edu.my/