Evaluation of response quality for heterogeneous question answering systems

The research in this paper makes explicit why existing measures for response quality evaluation is not suitable for the ever-evolving field of question answering and following that, a short-term solution for evaluating response quality of heterogeneous systems is put forward. To demonstrate the chal...

Full description

Saved in:
Bibliographic Details
Main Authors: Wong, W., Sahib, S., Goh, Ong Sing
Format: Conference or Workshop Item
Language:English
Published: IEEE 2005
Subjects:
Online Access:http://eprints.utem.edu.my/id/eprint/12398/1/Evaluation_of_response_quality_for_heterogeneous_question_answering_systems_page_1-2.pdf
http://eprints.utem.edu.my/id/eprint/12398/
http://researchrepository.murdoch.edu.au/14622/
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.utem.eprints.12398
record_format eprints
spelling my.utem.eprints.123982015-05-28T04:24:43Z http://eprints.utem.edu.my/id/eprint/12398/ Evaluation of response quality for heterogeneous question answering systems Wong, W. Sahib, S. Goh, Ong Sing QA75 Electronic computers. Computer science The research in this paper makes explicit why existing measures for response quality evaluation is not suitable for the ever-evolving field of question answering and following that, a short-term solution for evaluating response quality of heterogeneous systems is put forward. To demonstrate the challenges in evaluating systems of different nature, this research presents a black-box approach using a classification scheme and scoring mechanism to assess and rank three example systems. IEEE 2005 Conference or Workshop Item PeerReviewed application/pdf en http://eprints.utem.edu.my/id/eprint/12398/1/Evaluation_of_response_quality_for_heterogeneous_question_answering_systems_page_1-2.pdf Wong, W. and Sahib, S. and Goh, Ong Sing (2005) Evaluation of response quality for heterogeneous question answering systems. In: The 2005 IEEE/WIC/ACM International Conference on Web Intelligence (WI'05), 19-22 Sept. 2005, France. http://researchrepository.murdoch.edu.au/14622/
institution Universiti Teknikal Malaysia Melaka
building UTEM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Teknikal Malaysia Melaka
content_source UTEM Institutional Repository
url_provider http://eprints.utem.edu.my/
language English
topic QA75 Electronic computers. Computer science
spellingShingle QA75 Electronic computers. Computer science
Wong, W.
Sahib, S.
Goh, Ong Sing
Evaluation of response quality for heterogeneous question answering systems
description The research in this paper makes explicit why existing measures for response quality evaluation is not suitable for the ever-evolving field of question answering and following that, a short-term solution for evaluating response quality of heterogeneous systems is put forward. To demonstrate the challenges in evaluating systems of different nature, this research presents a black-box approach using a classification scheme and scoring mechanism to assess and rank three example systems.
format Conference or Workshop Item
author Wong, W.
Sahib, S.
Goh, Ong Sing
author_facet Wong, W.
Sahib, S.
Goh, Ong Sing
author_sort Wong, W.
title Evaluation of response quality for heterogeneous question answering systems
title_short Evaluation of response quality for heterogeneous question answering systems
title_full Evaluation of response quality for heterogeneous question answering systems
title_fullStr Evaluation of response quality for heterogeneous question answering systems
title_full_unstemmed Evaluation of response quality for heterogeneous question answering systems
title_sort evaluation of response quality for heterogeneous question answering systems
publisher IEEE
publishDate 2005
url http://eprints.utem.edu.my/id/eprint/12398/1/Evaluation_of_response_quality_for_heterogeneous_question_answering_systems_page_1-2.pdf
http://eprints.utem.edu.my/id/eprint/12398/
http://researchrepository.murdoch.edu.au/14622/
_version_ 1665905499419181056
score 13.211869