ScannerVision: Scanner-based image acquisition of medically important arthropods for the development of computer vision and deep learning models

Computer vision methods offer great potential for rapid image-based identification of medically important arthropod specimens. However, imaging large numbers of specimens is time consuming, and it is difficult to achieve the high image quality required for machine learning models. Conventional imagi...

Full description

Saved in:
Bibliographic Details
Main Authors: Ong, Song Quan, Nathan Pinoy, Lim, Min Hui, Kim Bjerge, Francisco Javier Peris-Felipo, Rob Lind, Jordan P. Cuff, Samantha M. Cook, Toke Thomas Høye
Format: Article
Language:en
Published: Elsevier B.V. 2025
Subjects:
Online Access:https://eprints.ums.edu.my/id/eprint/44514/1/FULL%20TEXT.pdf
https://eprints.ums.edu.my/id/eprint/44514/
https://doi.org/10.1016/j.crpvbd.2025.100268
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Computer vision methods offer great potential for rapid image-based identification of medically important arthropod specimens. However, imaging large numbers of specimens is time consuming, and it is difficult to achieve the high image quality required for machine learning models. Conventional imaging methods for identifying and digitizing arthropods, such as insects and spiders, use a stereomicroscope or macro lenses with a camera. This method is challenging due to the narrow field of view, especially when large numbers of arthropods need to be processed. In this paper, we present a high-throughput scanner-based method for capturing images of arthropods that can be used to generate large datasets suitable for training machine learning algorithms for identification. We demonstrate the ability of this approach to image arthropod samples collected with different sampling methods, such as sticky traps (unbaited, in different colors), baited mosquito traps as used by the US Centers for Disease Control and Prevention (CDC) and BioGents-Sentinel (BGS), and UV light traps with a sticky pad. Using different strategies to place the arthropods on a charge-coupled device (CCD) flatbed scanner and optimized settings that balance processing time and image quality, we captured high-resolution images of various arthropods and obtained morphological details with resolution and magnification similar to a stereomicroscope. We validate the method by comparing the performance of three different deep learning models (InceptionV3, ResNet and MobileNetV2) on two different datasets, namely the scanned images from this study and the images captured with a camera of a stereomicroscope. The results show that the performance of the models trained on the two datasets is not significantly different, indicating that the quality of the scanned images is comparable to that of a stereomicroscope.