Cover Image

A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni

The rapid progress in agriculture continually increases the demand for high-quality fruits. Ficus Carica L. (figs) is considered as one of the high-value fruits that required quality assessment due to its prevalence benefits was highly demanding. However, the quality was usually assessed by a destru...

Full description

Saved in:
Bibliographic Details
Main Author: Mazni, Iylia Adhwa
Format: Thesis
Language:English
Published: 2023
Online Access:https://ir.uitm.edu.my/id/eprint/88802/1/88802.pdf
https://ir.uitm.edu.my/id/eprint/88802/
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.uitm.ir.88802
record_format eprints
spelling my.uitm.ir.888022023-12-26T07:25:59Z https://ir.uitm.edu.my/id/eprint/88802/ A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni Mazni, Iylia Adhwa The rapid progress in agriculture continually increases the demand for high-quality fruits. Ficus Carica L. (figs) is considered as one of the high-value fruits that required quality assessment due to its prevalence benefits was highly demanding. However, the quality was usually assessed by a destructive method that normally led to a concern which is the loss of destructed fruits. In addition to that, this traditional approach by employing human labour is time-consuming and prone to human mistakes. In order to address these problems, an automatic non-destructive quality assessment of fig fruits using a deep learning regression model based on RGB and Laser-light Back scattering images (LLBI) is developed in this research work. To achieve this, the image of 33 matured Super Red Hybrid (SRH) fig fruits and the chemical properties (i.e., Brix value) dataset was collected for training and testing the model. The image of fig fruits was captured based on RGB and back scattering images that involve three different wavelengths of laser (650nm, 532nm, and 405nm) which represent Red, Green, and Blue, respectively. To determine the best two image modalities for this regression task, the performance of single modality deep learning models on RGB and Laser-light Backscattering images for figs fruits quality assessment is investigated before the optimization of the model takes place. The investigation is done by comparing the performance of the proposed CNN regression model with the state-of-the-art architecture which is VGG-16 and ResNet-50 for each single image modality. Then, the optimized proposed CNN regression model is extended to a novel multimodal deep learning regression model for the non-destructive quality assessment. In this model, an additional fusion layer is added before the input layer in which the two best single image modalities (RGB and red LLBI) were fused using an average fusion technique. Based on the experimental result, the proposed model shows the best prediction result and capable to assess the quality of fig fruit non-destructively where the value of RMSE and R2 achieve 0.6039, and 0.8084, respectively. Therefore, the development of a multimodal deep learning approach for non-destructive quality assessment of fig fruit was successfully achieved throughout this study. 2023 Thesis NonPeerReviewed text en https://ir.uitm.edu.my/id/eprint/88802/1/88802.pdf A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni. (2023) Masters thesis, thesis, Universiti Teknologi MARA (UiTM).
institution Universiti Teknologi Mara
building Tun Abdul Razak Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Teknologi Mara
content_source UiTM Institutional Repository
url_provider http://ir.uitm.edu.my/
language English
description The rapid progress in agriculture continually increases the demand for high-quality fruits. Ficus Carica L. (figs) is considered as one of the high-value fruits that required quality assessment due to its prevalence benefits was highly demanding. However, the quality was usually assessed by a destructive method that normally led to a concern which is the loss of destructed fruits. In addition to that, this traditional approach by employing human labour is time-consuming and prone to human mistakes. In order to address these problems, an automatic non-destructive quality assessment of fig fruits using a deep learning regression model based on RGB and Laser-light Back scattering images (LLBI) is developed in this research work. To achieve this, the image of 33 matured Super Red Hybrid (SRH) fig fruits and the chemical properties (i.e., Brix value) dataset was collected for training and testing the model. The image of fig fruits was captured based on RGB and back scattering images that involve three different wavelengths of laser (650nm, 532nm, and 405nm) which represent Red, Green, and Blue, respectively. To determine the best two image modalities for this regression task, the performance of single modality deep learning models on RGB and Laser-light Backscattering images for figs fruits quality assessment is investigated before the optimization of the model takes place. The investigation is done by comparing the performance of the proposed CNN regression model with the state-of-the-art architecture which is VGG-16 and ResNet-50 for each single image modality. Then, the optimized proposed CNN regression model is extended to a novel multimodal deep learning regression model for the non-destructive quality assessment. In this model, an additional fusion layer is added before the input layer in which the two best single image modalities (RGB and red LLBI) were fused using an average fusion technique. Based on the experimental result, the proposed model shows the best prediction result and capable to assess the quality of fig fruit non-destructively where the value of RMSE and R2 achieve 0.6039, and 0.8084, respectively. Therefore, the development of a multimodal deep learning approach for non-destructive quality assessment of fig fruit was successfully achieved throughout this study.
format Thesis
author Mazni, Iylia Adhwa
spellingShingle Mazni, Iylia Adhwa
A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni
author_facet Mazni, Iylia Adhwa
author_sort Mazni, Iylia Adhwa
title A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni
title_short A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni
title_full A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni
title_fullStr A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni
title_full_unstemmed A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni
title_sort multimodal deep learning approach for non-desctructive quality assessment of ficus carica l. / iylia adhwa mazni
publishDate 2023
url https://ir.uitm.edu.my/id/eprint/88802/1/88802.pdf
https://ir.uitm.edu.my/id/eprint/88802/
_version_ 1787139641124585472
score 13.211869

Similar Items