F-measure and intra-operator reliability of aerial imagery tracking in football / Khairul Imran Sainan, Ahmad Khushairy Makhtar and Zulkifli Mohamed

Current player tracking methods using multiple fixed stadium-based cameras and wearable sensors have limitations. To address this, a new computer vision system using aerial drone imagery has been developed to track football players. This approach is less expensive, has a wider field of view, and cap...

Full description

Saved in:
Bibliographic Details
Main Authors: Sainan, Khairul Imran, Makhtar, Ahmad Khushairy, Mohamed, Zulkifli
Format: Article
Language:English
Published: UiTM Press 2024
Subjects:
Online Access:https://ir.uitm.edu.my/id/eprint/105981/1/105981.pdf
https://ir.uitm.edu.my/id/eprint/105981/
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.uitm.ir.105981
record_format eprints
spelling my.uitm.ir.1059812024-11-21T03:14:41Z https://ir.uitm.edu.my/id/eprint/105981/ F-measure and intra-operator reliability of aerial imagery tracking in football / Khairul Imran Sainan, Ahmad Khushairy Makhtar and Zulkifli Mohamed jmeche Sainan, Khairul Imran Makhtar, Ahmad Khushairy Mohamed, Zulkifli Football Systems engineering Current player tracking methods using multiple fixed stadium-based cameras and wearable sensors have limitations. To address this, a new computer vision system using aerial drone imagery has been developed to track football players. This approach is less expensive, has a wider field of view, and captures data not accessible through sensors. However, the visual performance has not been extensively evaluated. In this study, we aimed to determine the system’s tracking performance using an F-measure score, which is calculated based on the number of true positives, false positives, and false negatives identified during the tracking process. We also investigated the tracking reliability by comparing the intra-operator performance using the ICC for distance, speed, and time metrics by repeating the measurements five times. The aerial-imagery data were taken from a test match recorded using a drone that was hovered away from the touchline. Four players were tracked and measured simultaneously. The system demonstrates accuracy by performing admirably with average F-measure scores of 0.80, 0.80, 0.89, and 0.84 for player A0, player A1, player B0, and player B1, respectively. Meanwhile, the intra-operator reliability for distance and speed was deemed good to moderate with %MD < 10%. The findings suggest that the system is a capable and reliable computer vision tracking tool with potential applications in performance analysis, training feedback, and injury prevention. UiTM Press 2024-11 Article PeerReviewed text en https://ir.uitm.edu.my/id/eprint/105981/1/105981.pdf F-measure and intra-operator reliability of aerial imagery tracking in football / Khairul Imran Sainan, Ahmad Khushairy Makhtar and Zulkifli Mohamed. (2024) Journal of Mechanical Engineering (JMechE) <https://ir.uitm.edu.my/view/publication/Journal_of_Mechanical_Engineering_=28JMechE=29/>, 13 (1): 7. pp. 121-134. ISSN 1823-5514 ; 2550-164X
institution Universiti Teknologi Mara
building Tun Abdul Razak Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Teknologi Mara
content_source UiTM Institutional Repository
url_provider http://ir.uitm.edu.my/
language English
topic Football
Systems engineering
spellingShingle Football
Systems engineering
Sainan, Khairul Imran
Makhtar, Ahmad Khushairy
Mohamed, Zulkifli
F-measure and intra-operator reliability of aerial imagery tracking in football / Khairul Imran Sainan, Ahmad Khushairy Makhtar and Zulkifli Mohamed
description Current player tracking methods using multiple fixed stadium-based cameras and wearable sensors have limitations. To address this, a new computer vision system using aerial drone imagery has been developed to track football players. This approach is less expensive, has a wider field of view, and captures data not accessible through sensors. However, the visual performance has not been extensively evaluated. In this study, we aimed to determine the system’s tracking performance using an F-measure score, which is calculated based on the number of true positives, false positives, and false negatives identified during the tracking process. We also investigated the tracking reliability by comparing the intra-operator performance using the ICC for distance, speed, and time metrics by repeating the measurements five times. The aerial-imagery data were taken from a test match recorded using a drone that was hovered away from the touchline. Four players were tracked and measured simultaneously. The system demonstrates accuracy by performing admirably with average F-measure scores of 0.80, 0.80, 0.89, and 0.84 for player A0, player A1, player B0, and player B1, respectively. Meanwhile, the intra-operator reliability for distance and speed was deemed good to moderate with %MD < 10%. The findings suggest that the system is a capable and reliable computer vision tracking tool with potential applications in performance analysis, training feedback, and injury prevention.
format Article
author Sainan, Khairul Imran
Makhtar, Ahmad Khushairy
Mohamed, Zulkifli
author_facet Sainan, Khairul Imran
Makhtar, Ahmad Khushairy
Mohamed, Zulkifli
author_sort Sainan, Khairul Imran
title F-measure and intra-operator reliability of aerial imagery tracking in football / Khairul Imran Sainan, Ahmad Khushairy Makhtar and Zulkifli Mohamed
title_short F-measure and intra-operator reliability of aerial imagery tracking in football / Khairul Imran Sainan, Ahmad Khushairy Makhtar and Zulkifli Mohamed
title_full F-measure and intra-operator reliability of aerial imagery tracking in football / Khairul Imran Sainan, Ahmad Khushairy Makhtar and Zulkifli Mohamed
title_fullStr F-measure and intra-operator reliability of aerial imagery tracking in football / Khairul Imran Sainan, Ahmad Khushairy Makhtar and Zulkifli Mohamed
title_full_unstemmed F-measure and intra-operator reliability of aerial imagery tracking in football / Khairul Imran Sainan, Ahmad Khushairy Makhtar and Zulkifli Mohamed
title_sort f-measure and intra-operator reliability of aerial imagery tracking in football / khairul imran sainan, ahmad khushairy makhtar and zulkifli mohamed
publisher UiTM Press
publishDate 2024
url https://ir.uitm.edu.my/id/eprint/105981/1/105981.pdf
https://ir.uitm.edu.my/id/eprint/105981/
_version_ 1817847210397663232
score 13.222552