Staff View: Virtual Piano Dynamics Enhancement with Electromyography

Virtual Piano Dynamics Enhancement with Electromyography

Pianos are musical instruments that are not easily accessible and portable, which can cause limitations in learning the instrument. Although various technologies have shown promising results in resolving this issue, an optimal solution that can overcome the physical limitation yet provide reality an...

Full description

Saved in:

Bibliographic Details
Main Authors:	Fen, Cherlynn Chew Hui, Lim, Woan Ning *
Format:	Conference or Workshop Item
Published:	2021
Subjects:	QA75 Electronic computers. Computer science TJ Mechanical engineering and machinery
Online Access:	http://eprints.sunway.edu.my/2155/ https://ieeexplore.ieee.org/document/9598948
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my.sunway.eprints.2155
record_format	eprints
spelling	my.sunway.eprints.21552023-03-20T05:50:29Z http://eprints.sunway.edu.my/2155/ Virtual Piano Dynamics Enhancement with Electromyography Fen, Cherlynn Chew Hui Lim, Woan Ning * QA75 Electronic computers. Computer science TJ Mechanical engineering and machinery Pianos are musical instruments that are not easily accessible and portable, which can cause limitations in learning the instrument. Although various technologies have shown promising results in resolving this issue, an optimal solution that can overcome the physical limitation yet provide reality and immersive playing experience has yet to be achieved. This research proposed a lightweight and portable virtual piano solution for beginner-level piano playing, enhanced with biofeedback and tactile sensation to overcome the limitation of lacking in dynamics in most of the virtual piano application. The player’s hands are detected and tracked for playing movements as they interact with the 3D graphical interface by using the Leap Motion Controller (LMC). The MyoWare muscle sensors are used to detect the electromyography (EMG) readings to enable the dynamic variation while playing. User testing was carried out on two groups of participants: experienced and novice players respectively. Quantitative and qualitative data have been collected for accuracy, usability, workload, and realism analysis. Results of the study show that this approach has the potential to be used as a beginner’s instrument for simple pieces or warm-up practices. The results also indicate that with the addition of tactile sensation by using an acrylic panel and incorporating dynamics with the EMG signals into the solution has led to a better immersive user experience. This study provides an alternative option and worthwhile insight for future development of virtual piano applications. 2021-11-18 Conference or Workshop Item PeerReviewed Fen, Cherlynn Chew Hui and Lim, Woan Ning * (2021) Virtual Piano Dynamics Enhancement with Electromyography. In: 2021 Innovations in Intelligent Systems and Applications Conference (ASYU), 6-8 October 2021, Elazig, Turkey. https://ieeexplore.ieee.org/document/9598948
institution	Sunway University
building	Sunway Campus Library
collection	Institutional Repository
continent	Asia
country	Malaysia
content_provider	Sunway University
content_source	Sunway Institutional Repository
url_provider	http://eprints.sunway.edu.my/
topic	QA75 Electronic computers. Computer science TJ Mechanical engineering and machinery
spellingShingle	QA75 Electronic computers. Computer science TJ Mechanical engineering and machinery Fen, Cherlynn Chew Hui Lim, Woan Ning * Virtual Piano Dynamics Enhancement with Electromyography
description	Pianos are musical instruments that are not easily accessible and portable, which can cause limitations in learning the instrument. Although various technologies have shown promising results in resolving this issue, an optimal solution that can overcome the physical limitation yet provide reality and immersive playing experience has yet to be achieved. This research proposed a lightweight and portable virtual piano solution for beginner-level piano playing, enhanced with biofeedback and tactile sensation to overcome the limitation of lacking in dynamics in most of the virtual piano application. The player’s hands are detected and tracked for playing movements as they interact with the 3D graphical interface by using the Leap Motion Controller (LMC). The MyoWare muscle sensors are used to detect the electromyography (EMG) readings to enable the dynamic variation while playing. User testing was carried out on two groups of participants: experienced and novice players respectively. Quantitative and qualitative data have been collected for accuracy, usability, workload, and realism analysis. Results of the study show that this approach has the potential to be used as a beginner’s instrument for simple pieces or warm-up practices. The results also indicate that with the addition of tactile sensation by using an acrylic panel and incorporating dynamics with the EMG signals into the solution has led to a better immersive user experience. This study provides an alternative option and worthwhile insight for future development of virtual piano applications.
format	Conference or Workshop Item
author	Fen, Cherlynn Chew Hui Lim, Woan Ning *
author_facet	Fen, Cherlynn Chew Hui Lim, Woan Ning *
author_sort	Fen, Cherlynn Chew Hui
title	Virtual Piano Dynamics Enhancement with Electromyography
title_short	Virtual Piano Dynamics Enhancement with Electromyography
title_full	Virtual Piano Dynamics Enhancement with Electromyography
title_fullStr	Virtual Piano Dynamics Enhancement with Electromyography
title_full_unstemmed	Virtual Piano Dynamics Enhancement with Electromyography
title_sort	virtual piano dynamics enhancement with electromyography
publishDate	2021
url	http://eprints.sunway.edu.my/2155/ https://ieeexplore.ieee.org/document/9598948
_version_	1761622092754714624
score	13.211869

Virtual Piano Dynamics Enhancement with Electromyography

Similar Items