Cover Image

Estimation of Examinees' Ability Through Computer Adaptive Testing Based on Neural Network Approach

Examinee’s knowledge is measured through exams. A key purpose of using an exam is to determine the proficiency level of each examinee based on his/her responses to the administered test. A main problem of traditional test is that the asked questions are not match to actual ability of examinees and...

Full description

Saved in:
Bibliographic Details
Main Author: Kazemi, Azam
Format: Thesis
Language:English
English
Published: 2010
Online Access:http://psasir.upm.edu.my/id/eprint/19629/1/FSKTM_2010_13_F.pdf
http://psasir.upm.edu.my/id/eprint/19629/
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.upm.eprints.19629
record_format eprints
spelling my.upm.eprints.196292013-05-27T08:02:42Z http://psasir.upm.edu.my/id/eprint/19629/ Estimation of Examinees' Ability Through Computer Adaptive Testing Based on Neural Network Approach Kazemi, Azam Examinee’s knowledge is measured through exams. A key purpose of using an exam is to determine the proficiency level of each examinee based on his/her responses to the administered test. A main problem of traditional test is that the asked questions are not match to actual ability of examinees and doesn’t measure examinee’s proficiency accurately. Computer Adaptive Testing (CAT) has been developed to address this issue. In CAT,each examinee has to answer the questions that are tailored to his/her ability level. Some of the features such as test security, immediate score reporting, improved efficiency and measurement precision have increased popularity of CAT. It uses models of proficiency estimation such as Item Response Theory (IRT). It is a statistical method with theoretical foundation that is being widely used in the field of modern educational testing technology and psychological testing. However, this model has some drawbacks. IRT model relates the response of an examinee to a specific item to his/her ability level and characteristics of the item. But relationship between items characteristics and person’s skill are very complex and nonlinear. In addition, it relies on strict assumption and need a large amount of data to precise measurement. These limitations are the motivation behind this research to use other adaptive approach to estimate the proficiency level in the CAT. In this thesis, we proposed a novel solution based on Artificial Neural Network (ANN) to address the above mentioned limitations. The ANN with adaptive features is a suitable scheme for solving complex non-linear problems. In addition, it has the ability to learn and generalize. These strong potentials make it an appropriate method to measure proficiency level of examinees in CAT systems. This work has been organized in two phases. In the first phase, we use 3-PL (three parameter logistic) dichotomous and polytomous model of IRT to estimate examinees’ ability in adaptive testing. Statistical approaches such as maximum likelihood estimation method and Bayesian approach are used for this purpose. In the second phase, estimation of examinees’ ability has been obtained with multi-layer feed forward neural network with back propagation algorithm. Experiments have been repeated under different scenarios and results indicate the advantages of the proposed scheme by obtaining better accuracy in performance. 2010-12 Thesis NonPeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/19629/1/FSKTM_2010_13_F.pdf Kazemi, Azam (2010) Estimation of Examinees' Ability Through Computer Adaptive Testing Based on Neural Network Approach. Masters thesis, Universiti Putra Malaysia. English
institution Universiti Putra Malaysia
building UPM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Putra Malaysia
content_source UPM Institutional Repository
url_provider http://psasir.upm.edu.my/
language English
English
description Examinee’s knowledge is measured through exams. A key purpose of using an exam is to determine the proficiency level of each examinee based on his/her responses to the administered test. A main problem of traditional test is that the asked questions are not match to actual ability of examinees and doesn’t measure examinee’s proficiency accurately. Computer Adaptive Testing (CAT) has been developed to address this issue. In CAT,each examinee has to answer the questions that are tailored to his/her ability level. Some of the features such as test security, immediate score reporting, improved efficiency and measurement precision have increased popularity of CAT. It uses models of proficiency estimation such as Item Response Theory (IRT). It is a statistical method with theoretical foundation that is being widely used in the field of modern educational testing technology and psychological testing. However, this model has some drawbacks. IRT model relates the response of an examinee to a specific item to his/her ability level and characteristics of the item. But relationship between items characteristics and person’s skill are very complex and nonlinear. In addition, it relies on strict assumption and need a large amount of data to precise measurement. These limitations are the motivation behind this research to use other adaptive approach to estimate the proficiency level in the CAT. In this thesis, we proposed a novel solution based on Artificial Neural Network (ANN) to address the above mentioned limitations. The ANN with adaptive features is a suitable scheme for solving complex non-linear problems. In addition, it has the ability to learn and generalize. These strong potentials make it an appropriate method to measure proficiency level of examinees in CAT systems. This work has been organized in two phases. In the first phase, we use 3-PL (three parameter logistic) dichotomous and polytomous model of IRT to estimate examinees’ ability in adaptive testing. Statistical approaches such as maximum likelihood estimation method and Bayesian approach are used for this purpose. In the second phase, estimation of examinees’ ability has been obtained with multi-layer feed forward neural network with back propagation algorithm. Experiments have been repeated under different scenarios and results indicate the advantages of the proposed scheme by obtaining better accuracy in performance.
format Thesis
author Kazemi, Azam
spellingShingle Kazemi, Azam
Estimation of Examinees' Ability Through Computer Adaptive Testing Based on Neural Network Approach
author_facet Kazemi, Azam
author_sort Kazemi, Azam
title Estimation of Examinees' Ability Through Computer Adaptive Testing Based on Neural Network Approach
title_short Estimation of Examinees' Ability Through Computer Adaptive Testing Based on Neural Network Approach
title_full Estimation of Examinees' Ability Through Computer Adaptive Testing Based on Neural Network Approach
title_fullStr Estimation of Examinees' Ability Through Computer Adaptive Testing Based on Neural Network Approach
title_full_unstemmed Estimation of Examinees' Ability Through Computer Adaptive Testing Based on Neural Network Approach
title_sort estimation of examinees' ability through computer adaptive testing based on neural network approach
publishDate 2010
url http://psasir.upm.edu.my/id/eprint/19629/1/FSKTM_2010_13_F.pdf
http://psasir.upm.edu.my/id/eprint/19629/
_version_ 1643827094260547584
score 13.211869

Similar Items