Cover Image

Reliable Information Retrieval Systems Performance Evaluation: A Review

With the progressive and availability of various search tools, interest in the evaluation of information retrieval based on user perspective has grown tremendously among researchers. The Information Retrieval System Evaluation is done through Cranfield-paradigm in which the test collections provide...

Full description

Saved in:
Bibliographic Details
Main Authors: Joseph, Minnu Helen, Ravana, Sri Devi
Format: Article
Published: Institute of Electrical and Electronics Engineers 2024
Subjects:
QA75 Electronic computers. Computer science
Online Access:http://eprints.um.edu.my/45868/
https://doi.org/10.1109/ACCESS.2024.3377239
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.um.eprints.45868
record_format eprints
spelling my.um.eprints.458682024-11-13T08:39:47Z http://eprints.um.edu.my/45868/ Reliable Information Retrieval Systems Performance Evaluation: A Review Joseph, Minnu Helen Ravana, Sri Devi QA75 Electronic computers. Computer science With the progressive and availability of various search tools, interest in the evaluation of information retrieval based on user perspective has grown tremendously among researchers. The Information Retrieval System Evaluation is done through Cranfield-paradigm in which the test collections provide the foundation of the evaluation process. The test collections consist of a document corpus, topics, and a set of relevant judgments. The relevant judgments are the documents which retrieved from the test collections based on the topics. The accuracy of the evaluation process is based on the number of relevant documents in the relevance judgment set, called qrels. This paper presents a comprehensive study, which discusses the various ways to improve the number of relevant documents in the qrels to improve the quality of qrels and through that increase the accuracy of the evaluation process. Different ways in which each methodology was performed to retrieve more relevant documents were categorized, described, and analyzed, resulting in an inclusive flow of these methodologies. Institute of Electrical and Electronics Engineers 2024 Article PeerReviewed Joseph, Minnu Helen and Ravana, Sri Devi (2024) Reliable Information Retrieval Systems Performance Evaluation: A Review. IEEE Access, 12. pp. 51740-51751. ISSN 2169-3536, DOI https://doi.org/10.1109/ACCESS.2024.3377239 <https://doi.org/10.1109/ACCESS.2024.3377239>. https://doi.org/10.1109/ACCESS.2024.3377239 10.1109/ACCESS.2024.3377239
institution Universiti Malaya
building UM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Malaya
content_source UM Research Repository
url_provider http://eprints.um.edu.my/
topic QA75 Electronic computers. Computer science
spellingShingle QA75 Electronic computers. Computer science
Joseph, Minnu Helen
Ravana, Sri Devi
Reliable Information Retrieval Systems Performance Evaluation: A Review
description With the progressive and availability of various search tools, interest in the evaluation of information retrieval based on user perspective has grown tremendously among researchers. The Information Retrieval System Evaluation is done through Cranfield-paradigm in which the test collections provide the foundation of the evaluation process. The test collections consist of a document corpus, topics, and a set of relevant judgments. The relevant judgments are the documents which retrieved from the test collections based on the topics. The accuracy of the evaluation process is based on the number of relevant documents in the relevance judgment set, called qrels. This paper presents a comprehensive study, which discusses the various ways to improve the number of relevant documents in the qrels to improve the quality of qrels and through that increase the accuracy of the evaluation process. Different ways in which each methodology was performed to retrieve more relevant documents were categorized, described, and analyzed, resulting in an inclusive flow of these methodologies.
format Article
author Joseph, Minnu Helen
Ravana, Sri Devi
author_facet Joseph, Minnu Helen
Ravana, Sri Devi
author_sort Joseph, Minnu Helen
title Reliable Information Retrieval Systems Performance Evaluation: A Review
title_short Reliable Information Retrieval Systems Performance Evaluation: A Review
title_full Reliable Information Retrieval Systems Performance Evaluation: A Review
title_fullStr Reliable Information Retrieval Systems Performance Evaluation: A Review
title_full_unstemmed Reliable Information Retrieval Systems Performance Evaluation: A Review
title_sort reliable information retrieval systems performance evaluation: a review
publisher Institute of Electrical and Electronics Engineers
publishDate 2024
url http://eprints.um.edu.my/45868/
https://doi.org/10.1109/ACCESS.2024.3377239
_version_ 1816130469507366912
score 13.239859

Similar Items