Vision-Based Hand Detection and Tracking Using Fusion of Kernelized Correlation Filter and Single-Shot Detection
: Hand detection and tracking are key components in many computer vision applications, including hand pose estimation and gesture recognition for human–computer interaction systems, virtual reality, and augmented reality. Despite their importance, reliable hand detection in cluttered scenes remains...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | en en en |
| Published: |
MDPI
2023
|
| Subjects: | |
| Online Access: | http://eprints.uthm.edu.my/10103/1/J16219_8930626b82c06d4375e69da013ec81a8.pdf http://eprints.uthm.edu.my/10103/2/J16219_8930626b82c06d4375e69da013ec81a8.pdf http://eprints.uthm.edu.my/10103/3/J16219_8930626b82c06d4375e69da013ec81a8.pdf http://eprints.uthm.edu.my/10103/ https://doi.org/10.3390/app13137433 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1833419151944712192 |
|---|---|
| author | Haji Mohd, Mohd Norzali Mohd Asaar, Mohd Shahrimie Ong Lay Ping, Ong Lay Ping Rosdi, Bakhtiar Affendi |
| author_facet | Haji Mohd, Mohd Norzali Mohd Asaar, Mohd Shahrimie Ong Lay Ping, Ong Lay Ping Rosdi, Bakhtiar Affendi |
| author_sort | Haji Mohd, Mohd Norzali |
| building | UTHM Library |
| collection | Institutional Repository |
| content_provider | Universiti Tun Hussein Onn Malaysia |
| content_source | UTHM Institutional Repository |
| continent | Asia |
| country | Malaysia |
| description | : Hand detection and tracking are key components in many computer vision applications, including hand pose estimation and gesture recognition for human–computer interaction systems, virtual reality, and augmented reality. Despite their importance, reliable hand detection in cluttered
scenes remains a challenge. This study explores the use of deep learning techniques for fast and robust hand detection and tracking. A novel algorithm is proposed by combining the Kernelized Correlation Filter (KCF) tracker with the Single-Shot Detection (SSD) method. This integration enables
the detection and tracking of hands in challenging environments, such as cluttered backgrounds and
occlusions. The SSD algorithm helps reinitialize the KCF tracker when it fails or encounters drift issues due to sudden changes in hand gestures or fast movements. Testing in challenging scenes showed that the proposed tracker achieved a tracking rate of over 90% and a speed of 17 frames
per second (FPS). Comparison with the KCF tracker on 17 video sequences revealed an average improvement of 13.31% in tracking detection rate (TRDR) and 27.04% in object detection error (OTE). Additional comparison with MediaPipe hand tracker on 10 hand gesture videos taken from the
Intelligent Biometric Group Hand Tracking (IBGHT) dataset showed that the proposed method outperformed the MediaPipe hand tracker in terms of overall TRDR and tracking speed. The results demonstrate the promising potential of the proposed method for long-sequence tracking stability,
reducing drift issues, and improving tracking performance during occlusions. |
| format | Article |
| id | my.uthm.eprints-10103 |
| institution | Universiti Tun Hussein Onn Malaysia |
| language | en en en |
| publishDate | 2023 |
| publisher | MDPI |
| record_format | eprints |
| spelling | my.uthm.eprints-101032023-10-17T06:53:51Z http://eprints.uthm.edu.my/10103/ Vision-Based Hand Detection and Tracking Using Fusion of Kernelized Correlation Filter and Single-Shot Detection Haji Mohd, Mohd Norzali Mohd Asaar, Mohd Shahrimie Ong Lay Ping, Ong Lay Ping Rosdi, Bakhtiar Affendi TJ Mechanical engineering and machinery : Hand detection and tracking are key components in many computer vision applications, including hand pose estimation and gesture recognition for human–computer interaction systems, virtual reality, and augmented reality. Despite their importance, reliable hand detection in cluttered scenes remains a challenge. This study explores the use of deep learning techniques for fast and robust hand detection and tracking. A novel algorithm is proposed by combining the Kernelized Correlation Filter (KCF) tracker with the Single-Shot Detection (SSD) method. This integration enables the detection and tracking of hands in challenging environments, such as cluttered backgrounds and occlusions. The SSD algorithm helps reinitialize the KCF tracker when it fails or encounters drift issues due to sudden changes in hand gestures or fast movements. Testing in challenging scenes showed that the proposed tracker achieved a tracking rate of over 90% and a speed of 17 frames per second (FPS). Comparison with the KCF tracker on 17 video sequences revealed an average improvement of 13.31% in tracking detection rate (TRDR) and 27.04% in object detection error (OTE). Additional comparison with MediaPipe hand tracker on 10 hand gesture videos taken from the Intelligent Biometric Group Hand Tracking (IBGHT) dataset showed that the proposed method outperformed the MediaPipe hand tracker in terms of overall TRDR and tracking speed. The results demonstrate the promising potential of the proposed method for long-sequence tracking stability, reducing drift issues, and improving tracking performance during occlusions. MDPI 2023 Article PeerReviewed text en http://eprints.uthm.edu.my/10103/1/J16219_8930626b82c06d4375e69da013ec81a8.pdf text en http://eprints.uthm.edu.my/10103/2/J16219_8930626b82c06d4375e69da013ec81a8.pdf text en http://eprints.uthm.edu.my/10103/3/J16219_8930626b82c06d4375e69da013ec81a8.pdf Haji Mohd, Mohd Norzali and Mohd Asaar, Mohd Shahrimie and Ong Lay Ping, Ong Lay Ping and Rosdi, Bakhtiar Affendi (2023) Vision-Based Hand Detection and Tracking Using Fusion of Kernelized Correlation Filter and Single-Shot Detection. Applied Sciences, 13 (7433). pp. 1-16. https://doi.org/10.3390/app13137433 |
| spellingShingle | TJ Mechanical engineering and machinery Haji Mohd, Mohd Norzali Mohd Asaar, Mohd Shahrimie Ong Lay Ping, Ong Lay Ping Rosdi, Bakhtiar Affendi Vision-Based Hand Detection and Tracking Using Fusion of Kernelized Correlation Filter and Single-Shot Detection |
| title | Vision-Based Hand Detection and Tracking Using Fusion of
Kernelized Correlation Filter and Single-Shot Detection |
| title_full | Vision-Based Hand Detection and Tracking Using Fusion of
Kernelized Correlation Filter and Single-Shot Detection |
| title_fullStr | Vision-Based Hand Detection and Tracking Using Fusion of
Kernelized Correlation Filter and Single-Shot Detection |
| title_full_unstemmed | Vision-Based Hand Detection and Tracking Using Fusion of
Kernelized Correlation Filter and Single-Shot Detection |
| title_short | Vision-Based Hand Detection and Tracking Using Fusion of
Kernelized Correlation Filter and Single-Shot Detection |
| title_sort | vision-based hand detection and tracking using fusion of
kernelized correlation filter and single-shot detection |
| topic | TJ Mechanical engineering and machinery |
| url | http://eprints.uthm.edu.my/10103/1/J16219_8930626b82c06d4375e69da013ec81a8.pdf http://eprints.uthm.edu.my/10103/2/J16219_8930626b82c06d4375e69da013ec81a8.pdf http://eprints.uthm.edu.my/10103/3/J16219_8930626b82c06d4375e69da013ec81a8.pdf http://eprints.uthm.edu.my/10103/ https://doi.org/10.3390/app13137433 |
| url_provider | http://eprints.uthm.edu.my/ |