Smart home automation with wakeup word detection using ESP32
The limitations of traditional smart home automation systems that rely on costly, commercial voice assistants, which often lack customization and raise privacy concerns. The project aims to develop a low-cost, user-friendly smart home automation system that enhances privacy and flexibility to contro...
Saved in:
| Main Author: | |
|---|---|
| Format: | Final Year Project / Dissertation / Thesis |
| Published: |
2025
|
| Subjects: | |
| Online Access: | http://eprints.utar.edu.my/7274/1/GAnPY%2DFYP2_Smart_Home_Automation_with_wake_word_detection_using_ESP32_REPORT.pdf http://eprints.utar.edu.my/7274/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1854094499947479040 |
|---|---|
| author | Gan, Pey Yi |
| author_facet | Gan, Pey Yi |
| author_sort | Gan, Pey Yi |
| building | UTAR Library |
| collection | Institutional Repository |
| content_provider | Universiti Tunku Abdul Rahman |
| content_source | UTAR Institutional Repository |
| continent | Asia |
| country | Malaysia |
| description | The limitations of traditional smart home automation systems that rely on costly, commercial voice assistants, which often lack customization and raise privacy concerns. The project aims to develop a low-cost, user-friendly smart home automation system that enhances privacy and flexibility to control the lights. The method involved in this project is related to the continuous audio sampling via a microphone connected to the ESP32 microcontroller, with on-device wake word detection using TensorFlow Lite to recognize the trigger word "Marvin" locally, which reduces the reliance on cloud services. After wake word detection, voice commands are transmitted to the Wit.ai cloud service for natural language understanding that enables the system to interpret user intents and control commands. ESP32 then executes the user’s commands by managing the connected LED through the GPIO pins. Experiments evaluation showed that the wake word model had a high success rate in intent identification using the NLP service, minimal latency, and over 90% accuracy in controlled environments. This technique effectively protects users’ privacy by reducing the reliance on cloud services and cutting the expenses by utilizing affordable hardware. In comparison to traditional voice assistance, the project shows significant enhancements in system responsiveness and user convenience. At the end of this research, a flexible yet affordable and privacyconscious voice assistance solution is designed and built. This system offers consumer more control over their smart environment. Future work may explore expanding device compatibility and refining natural language processing to enhance system robustness further |
| format | Final Year Project / Dissertation / Thesis |
| id | my-utar-eprints.7274 |
| institution | Universiti Tunku Abdul Rahman |
| publishDate | 2025 |
| record_format | eprints |
| spelling | my-utar-eprints.72742025-12-31T10:46:14Z Smart home automation with wakeup word detection using ESP32 Gan, Pey Yi T Technology (General) TK Electrical engineering. Electronics Nuclear engineering The limitations of traditional smart home automation systems that rely on costly, commercial voice assistants, which often lack customization and raise privacy concerns. The project aims to develop a low-cost, user-friendly smart home automation system that enhances privacy and flexibility to control the lights. The method involved in this project is related to the continuous audio sampling via a microphone connected to the ESP32 microcontroller, with on-device wake word detection using TensorFlow Lite to recognize the trigger word "Marvin" locally, which reduces the reliance on cloud services. After wake word detection, voice commands are transmitted to the Wit.ai cloud service for natural language understanding that enables the system to interpret user intents and control commands. ESP32 then executes the user’s commands by managing the connected LED through the GPIO pins. Experiments evaluation showed that the wake word model had a high success rate in intent identification using the NLP service, minimal latency, and over 90% accuracy in controlled environments. This technique effectively protects users’ privacy by reducing the reliance on cloud services and cutting the expenses by utilizing affordable hardware. In comparison to traditional voice assistance, the project shows significant enhancements in system responsiveness and user convenience. At the end of this research, a flexible yet affordable and privacyconscious voice assistance solution is designed and built. This system offers consumer more control over their smart environment. Future work may explore expanding device compatibility and refining natural language processing to enhance system robustness further 2025-06 Final Year Project / Dissertation / Thesis NonPeerReviewed application/pdf http://eprints.utar.edu.my/7274/1/GAnPY%2DFYP2_Smart_Home_Automation_with_wake_word_detection_using_ESP32_REPORT.pdf Gan, Pey Yi (2025) Smart home automation with wakeup word detection using ESP32. Final Year Project, UTAR. http://eprints.utar.edu.my/7274/ |
| spellingShingle | T Technology (General) TK Electrical engineering. Electronics Nuclear engineering Gan, Pey Yi Smart home automation with wakeup word detection using ESP32 |
| title | Smart home automation with wakeup word detection using ESP32 |
| title_full | Smart home automation with wakeup word detection using ESP32 |
| title_fullStr | Smart home automation with wakeup word detection using ESP32 |
| title_full_unstemmed | Smart home automation with wakeup word detection using ESP32 |
| title_short | Smart home automation with wakeup word detection using ESP32 |
| title_sort | smart home automation with wakeup word detection using esp32 |
| topic | T Technology (General) TK Electrical engineering. Electronics Nuclear engineering |
| url | http://eprints.utar.edu.my/7274/1/GAnPY%2DFYP2_Smart_Home_Automation_with_wake_word_detection_using_ESP32_REPORT.pdf http://eprints.utar.edu.my/7274/ |
| url_provider | http://eprints.utar.edu.my |