Cover Image

Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework

Previous mobile usability studies are only pertinent in the context of ergonomics, physical user interface, and mobility aspects. In addition, much of the previous mobile usability conception was built on desktop computing measurements, such as desktop and web application checklists, or scarcely add...

Full description

Saved in:
Bibliographic Details
Main Authors: Zulzalil, Hazura, Rahmat, Hazwani, Abd Ghani, Abdul Azim, Kamaruddin, Azrina
Format: Article
Language:English
Published: Bilingual Publishing Group 2023
Online Access:http://psasir.upm.edu.my/id/eprint/107838/1/64d1b50fb6a4d.pdf
http://psasir.upm.edu.my/id/eprint/107838/
https://journals.bilpubgroup.com/index.php/jcsr/article/view/5816
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.upm.eprints.107838
record_format eprints
spelling my.upm.eprints.1078382024-11-05T06:24:26Z http://psasir.upm.edu.my/id/eprint/107838/ Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework Zulzalil, Hazura Rahmat, Hazwani Abd Ghani, Abdul Azim Kamaruddin, Azrina Previous mobile usability studies are only pertinent in the context of ergonomics, physical user interface, and mobility aspects. In addition, much of the previous mobile usability conception was built on desktop computing measurements, such as desktop and web application checklists, or scarcely addressed the mobile user interface. Moreover, the studies focus mainly on interface features for desktop applications and do not reflect comprehensive mobile interface features such as navigation drawers and spinners. Therefore, conducting usability evaluation using conventional usability measurement would result in irrelevant results. In addition, the resulting works are tailored for usability testing, which requires highly skilled evaluators and usability specialists (e.g., usability testers and user experience designers), who are rarely integrated into a development team. The lack of expertise could lead to unreliable usability evaluations. This paper presents a review from industrial experts on a comprehensive and feasible usability evaluation framework developed in our previous work. The framework is dedicated to smartphone apps, which integrate evaluator skills and design concerns. However, there is no evidence of its usefulness in practice. Therefore, the usefulness of the framework measurement for evaluating apps' usability in the eyes of non-usability specialists is empirically assessed in this paper through an expert review. The expert review involved eleven industrial developers and was complemented by a semi-structured interview. The method is replicated in comparison with a framework from another study. The findings show that the formulated framework significantly outperformed the framework (p = 0.0286) from other studies with large effect sizes (r = 1.81) in terms of usefulness. Bilingual Publishing Group 2023-07-31 Article PeerReviewed text en cc_by_nc_4 http://psasir.upm.edu.my/id/eprint/107838/1/64d1b50fb6a4d.pdf Zulzalil, Hazura and Rahmat, Hazwani and Abd Ghani, Abdul Azim and Kamaruddin, Azrina (2023) Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework. Journal of Computer Science Research, 5 (3). pp. 57-73. ISSN 2630-5151 https://journals.bilpubgroup.com/index.php/jcsr/article/view/5816 10.30564/jcsr.v5i3.5816
institution Universiti Putra Malaysia
building UPM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Putra Malaysia
content_source UPM Institutional Repository
url_provider http://psasir.upm.edu.my/
language English
description Previous mobile usability studies are only pertinent in the context of ergonomics, physical user interface, and mobility aspects. In addition, much of the previous mobile usability conception was built on desktop computing measurements, such as desktop and web application checklists, or scarcely addressed the mobile user interface. Moreover, the studies focus mainly on interface features for desktop applications and do not reflect comprehensive mobile interface features such as navigation drawers and spinners. Therefore, conducting usability evaluation using conventional usability measurement would result in irrelevant results. In addition, the resulting works are tailored for usability testing, which requires highly skilled evaluators and usability specialists (e.g., usability testers and user experience designers), who are rarely integrated into a development team. The lack of expertise could lead to unreliable usability evaluations. This paper presents a review from industrial experts on a comprehensive and feasible usability evaluation framework developed in our previous work. The framework is dedicated to smartphone apps, which integrate evaluator skills and design concerns. However, there is no evidence of its usefulness in practice. Therefore, the usefulness of the framework measurement for evaluating apps' usability in the eyes of non-usability specialists is empirically assessed in this paper through an expert review. The expert review involved eleven industrial developers and was complemented by a semi-structured interview. The method is replicated in comparison with a framework from another study. The findings show that the formulated framework significantly outperformed the framework (p = 0.0286) from other studies with large effect sizes (r = 1.81) in terms of usefulness.
format Article
author Zulzalil, Hazura
Rahmat, Hazwani
Abd Ghani, Abdul Azim
Kamaruddin, Azrina
spellingShingle Zulzalil, Hazura
Rahmat, Hazwani
Abd Ghani, Abdul Azim
Kamaruddin, Azrina
Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework
author_facet Zulzalil, Hazura
Rahmat, Hazwani
Abd Ghani, Abdul Azim
Kamaruddin, Azrina
author_sort Zulzalil, Hazura
title Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework
title_short Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework
title_full Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework
title_fullStr Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework
title_full_unstemmed Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework
title_sort expert review on usefulness of an integrated checklist-based mobile usability evaluation framework
publisher Bilingual Publishing Group
publishDate 2023
url http://psasir.upm.edu.my/id/eprint/107838/1/64d1b50fb6a4d.pdf
http://psasir.upm.edu.my/id/eprint/107838/
https://journals.bilpubgroup.com/index.php/jcsr/article/view/5816
_version_ 1814936565437169664
score 13.211869

Similar Items