Cover Image

Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model

Multiple choice tests are widely applied to assess students’ knowledge in science education. This study aimed at assessing the validity and reliability of Science Multiple-choice Test in Malaysia. The items for this test were formulated by the researcher together with a panel of science teachers and...

Full description

Saved in:
Bibliographic Details
Main Authors: Najah Hazirah Mohd Dzin, Lay, Yoon Fah
Format: Article
Language:English
English
Published: Scientia Socialis Ltd 2021
Subjects:
LB1603-1696.6 Secondary education. High schools
Online Access:https://eprints.ums.edu.my/id/eprint/31861/1/Assessing%20the%20validity%20and%20reliability%20of%20science%20multiple%20choice%20test%20using%20rasch%20dichotomous%20measurement%20model.pdf
https://eprints.ums.edu.my/id/eprint/31861/2/Assessing%20the%20validity%20and%20reliability%20of%20science%20multiple%20choice%20test%20using%20rasch%20dichotomous%20measurement%20model1.pdf
https://eprints.ums.edu.my/id/eprint/31861/
http://oaji.net/articles/2021/987-1639222215.pdf
https://dx.doi.org/10.33225/jbse/21.20.927
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.ums.eprints.31861
record_format eprints
spelling my.ums.eprints.318612022-03-16T07:34:08Z https://eprints.ums.edu.my/id/eprint/31861/ Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model Najah Hazirah Mohd Dzin Lay, Yoon Fah LB1603-1696.6 Secondary education. High schools Multiple choice tests are widely applied to assess students’ knowledge in science education. This study aimed at assessing the validity and reliability of Science Multiple-choice Test in Malaysia. The items for this test were formulated by the researcher together with a panel of science teachers and the head of the science department with close reference to Secondary School Standard Curriculum (KSSM) syllabus. The test consists of 50 multiple-choice items with four options. Rasch measurement model was adopted to evaluate the quality of the Science Multiple-choice Test in terms of reliability analysis, item polarity analysis (PTMEA-CORR), item fit analysis and Principal Component Analysis of Residuals (PCAR). The reliability analysis was performed using Cronbach’s Alpha, and the results of reliability and separation index respectively indicated good reliability level of the test items. In order to improve the validity of the test, two negatively worded items (Q39 and Q40) were removed. Lastly, the PCAR analysis showed the unexplained variance in the 1st contrast (5.4%) was found to be well controlled and was below the ceiling value of one-third of the variance explained by the item (18.7%). However, the positive value of the disattenuated correlations indicate no evidence of the presence of secondary dimension. Scientia Socialis Ltd 2021 Article PeerReviewed text en https://eprints.ums.edu.my/id/eprint/31861/1/Assessing%20the%20validity%20and%20reliability%20of%20science%20multiple%20choice%20test%20using%20rasch%20dichotomous%20measurement%20model.pdf text en https://eprints.ums.edu.my/id/eprint/31861/2/Assessing%20the%20validity%20and%20reliability%20of%20science%20multiple%20choice%20test%20using%20rasch%20dichotomous%20measurement%20model1.pdf Najah Hazirah Mohd Dzin and Lay, Yoon Fah (2021) Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model. Journal of Baltic Science Education, 20. pp. 924-941. ISSN 1648-3898 (P-ISSN) , 2538-7138 (E-ISSN) http://oaji.net/articles/2021/987-1639222215.pdf https://dx.doi.org/10.33225/jbse/21.20.927
institution Universiti Malaysia Sabah
building UMS Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Malaysia Sabah
content_source UMS Institutional Repository
url_provider http://eprints.ums.edu.my/
language English
English
topic LB1603-1696.6 Secondary education. High schools
spellingShingle LB1603-1696.6 Secondary education. High schools
Najah Hazirah Mohd Dzin
Lay, Yoon Fah
Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model
description Multiple choice tests are widely applied to assess students’ knowledge in science education. This study aimed at assessing the validity and reliability of Science Multiple-choice Test in Malaysia. The items for this test were formulated by the researcher together with a panel of science teachers and the head of the science department with close reference to Secondary School Standard Curriculum (KSSM) syllabus. The test consists of 50 multiple-choice items with four options. Rasch measurement model was adopted to evaluate the quality of the Science Multiple-choice Test in terms of reliability analysis, item polarity analysis (PTMEA-CORR), item fit analysis and Principal Component Analysis of Residuals (PCAR). The reliability analysis was performed using Cronbach’s Alpha, and the results of reliability and separation index respectively indicated good reliability level of the test items. In order to improve the validity of the test, two negatively worded items (Q39 and Q40) were removed. Lastly, the PCAR analysis showed the unexplained variance in the 1st contrast (5.4%) was found to be well controlled and was below the ceiling value of one-third of the variance explained by the item (18.7%). However, the positive value of the disattenuated correlations indicate no evidence of the presence of secondary dimension.
format Article
author Najah Hazirah Mohd Dzin
Lay, Yoon Fah
author_facet Najah Hazirah Mohd Dzin
Lay, Yoon Fah
author_sort Najah Hazirah Mohd Dzin
title Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model
title_short Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model
title_full Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model
title_fullStr Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model
title_full_unstemmed Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model
title_sort assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model
publisher Scientia Socialis Ltd
publishDate 2021
url https://eprints.ums.edu.my/id/eprint/31861/1/Assessing%20the%20validity%20and%20reliability%20of%20science%20multiple%20choice%20test%20using%20rasch%20dichotomous%20measurement%20model.pdf
https://eprints.ums.edu.my/id/eprint/31861/2/Assessing%20the%20validity%20and%20reliability%20of%20science%20multiple%20choice%20test%20using%20rasch%20dichotomous%20measurement%20model1.pdf
https://eprints.ums.edu.my/id/eprint/31861/
http://oaji.net/articles/2021/987-1639222215.pdf
https://dx.doi.org/10.33225/jbse/21.20.927
_version_ 1760230948434083840
score 13.211869

Similar Items