An Open-Ended Continual Learning for Food Recognition Using Class Incremental Extreme Learning Machines

State-of-the-art deep learning models for food recognition do not allow data incremental learning and often suffer from catastrophic interference problems during the class incremental learning. This is an important issue in food recognition since real-world food datasets are open-ended and dynamic,...

Full description

Saved in:
Bibliographic Details
Main Authors: Tahir, Ghalib Ahmed, Loo, Chu Kiong
Format: Article
Published: Institute of Electrical and Electronics Engineers 2020
Subjects:
Online Access:http://eprints.um.edu.my/24851/
https://doi.org/10.1109/ACCESS.2020.2991810
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:State-of-the-art deep learning models for food recognition do not allow data incremental learning and often suffer from catastrophic interference problems during the class incremental learning. This is an important issue in food recognition since real-world food datasets are open-ended and dynamic, involving a continuous increase in food samples and food classes. Model retraining is often carried out to cope with the dynamic nature of the data, but this demands high-end computational resources and significant time. This paper proposes a new open-ended continual learning framework by employing transfer learning on deep models for feature extraction, Relief F for feature selection, and a novel adaptive reduced class incremental kernel extreme learning machine (ARCIKELM) for classification. Transfer learning is beneficial due to the high generalization ability of deep learning features. Relief F reduces computational complexity by ranking and selecting the extracted features. The novel ARCIKELM classifier dynamically adjusts network architecture to reduce catastrophic forgetting. It addresses domain adaptation problems when new samples of the existing class arrive. To conduct comprehensive experiments, we evaluated the model against four standard food benchmarks and a recently collected Pakistani food dataset. Experimental results show that the proposed framework learns new classes incrementally with less catastrophic inference and adapts domain changes while having competitive classification performance. © 2013 IEEE.