Penilaian esei berbantukan komputer menggunakan teknik Bayesian dan pengunduran linear berganda

Disagreement of grade given by two human judges, time consuming and high evaluation cost became a reason of research on Computer-based Assessment System (CbAS) been studied. The main key is CbAS assessment must be closest to human assessment. Based on UPSR Essay Assessment Schema, there are three ma...

Full description

Saved in:
Bibliographic Details
Main Author: Mohamad @ Hamza, Mohd. Azwan
Format: Thesis
Language:English
Published: 2006
Subjects:
Online Access:http://eprints.utm.my/id/eprint/109/1/MohdAzwanMohamadMFC2006.pdf
http://eprints.utm.my/id/eprint/109/
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.utm.109
record_format eprints
spelling my.utm.1092018-01-10T07:59:16Z http://eprints.utm.my/id/eprint/109/ Penilaian esei berbantukan komputer menggunakan teknik Bayesian dan pengunduran linear berganda Mohamad @ Hamza, Mohd. Azwan LB Theory and practice of education QA Mathematics Disagreement of grade given by two human judges, time consuming and high evaluation cost became a reason of research on Computer-based Assessment System (CbAS) been studied. The main key is CbAS assessment must be closest to human assessment. Based on UPSR Essay Assessment Schema, there are three main assessment components consists of language, discourse element and style. Recently, Fuzzy Logic is used to determine and classify the discourse element while Stepwise Linear Regression Algorithm (SLR) is used to make closest prediction for style of writing. Both of them have its weakness. Fuzzy Logic did not measure the form of linguistic features and required a huge size of training data. SLR Algorithm derive prediction of writing style using un-standardize feature set and size of features set not clearly defined and no warranty of significance in contribute to get closest grade prediction. This study emphasized on optimization of prediction on discourse elements and writing style that leading to the development of CbAS through four phases of research methodology. (1) Pre-processing and data extraction phase where essay will be parsed into word (token) and implemented Word Correction Algorithm to re-correct the misspell word. (2) Training process of determination and classification of discourse elements using Multivariate Bernoulli Model (MMB) Technique. It considers both presence and absence features thus it measured the form of linguistic features that reflected essay quality. MMB Technique only required a small size of training data. (3) Prediction process of writing style using Multiple Linear Regression (MLR) Algorithm. MLR Algorithm applied six fixed features (based on previous research) to ensure the prediction is more standardize and feature set is more significant. (4) Test the performance agreement derived from the combination of MMB, MLR and data of language component (taken from human assessment) and compared it to human assessment for five cycles of cross-validation. The outcome shows performance is consistent with 95.2% agreement. Thus, the experiment has shown by utilizing both techniques (MMB and MLR), better prediction or essay assessment has been achieved compared to the one’s implemented using Fuzzy Logic and SLR Algorithm. 2006-07 Thesis NonPeerReviewed application/pdf en http://eprints.utm.my/id/eprint/109/1/MohdAzwanMohamadMFC2006.pdf Mohamad @ Hamza, Mohd. Azwan (2006) Penilaian esei berbantukan komputer menggunakan teknik Bayesian dan pengunduran linear berganda. Masters thesis, Universiti Teknologi Malaysia, Faculty of Computer Science and Information System.
institution Universiti Teknologi Malaysia
building UTM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Teknologi Malaysia
content_source UTM Institutional Repository
url_provider http://eprints.utm.my/
language English
topic LB Theory and practice of education
QA Mathematics
spellingShingle LB Theory and practice of education
QA Mathematics
Mohamad @ Hamza, Mohd. Azwan
Penilaian esei berbantukan komputer menggunakan teknik Bayesian dan pengunduran linear berganda
description Disagreement of grade given by two human judges, time consuming and high evaluation cost became a reason of research on Computer-based Assessment System (CbAS) been studied. The main key is CbAS assessment must be closest to human assessment. Based on UPSR Essay Assessment Schema, there are three main assessment components consists of language, discourse element and style. Recently, Fuzzy Logic is used to determine and classify the discourse element while Stepwise Linear Regression Algorithm (SLR) is used to make closest prediction for style of writing. Both of them have its weakness. Fuzzy Logic did not measure the form of linguistic features and required a huge size of training data. SLR Algorithm derive prediction of writing style using un-standardize feature set and size of features set not clearly defined and no warranty of significance in contribute to get closest grade prediction. This study emphasized on optimization of prediction on discourse elements and writing style that leading to the development of CbAS through four phases of research methodology. (1) Pre-processing and data extraction phase where essay will be parsed into word (token) and implemented Word Correction Algorithm to re-correct the misspell word. (2) Training process of determination and classification of discourse elements using Multivariate Bernoulli Model (MMB) Technique. It considers both presence and absence features thus it measured the form of linguistic features that reflected essay quality. MMB Technique only required a small size of training data. (3) Prediction process of writing style using Multiple Linear Regression (MLR) Algorithm. MLR Algorithm applied six fixed features (based on previous research) to ensure the prediction is more standardize and feature set is more significant. (4) Test the performance agreement derived from the combination of MMB, MLR and data of language component (taken from human assessment) and compared it to human assessment for five cycles of cross-validation. The outcome shows performance is consistent with 95.2% agreement. Thus, the experiment has shown by utilizing both techniques (MMB and MLR), better prediction or essay assessment has been achieved compared to the one’s implemented using Fuzzy Logic and SLR Algorithm.
format Thesis
author Mohamad @ Hamza, Mohd. Azwan
author_facet Mohamad @ Hamza, Mohd. Azwan
author_sort Mohamad @ Hamza, Mohd. Azwan
title Penilaian esei berbantukan komputer menggunakan teknik Bayesian dan pengunduran linear berganda
title_short Penilaian esei berbantukan komputer menggunakan teknik Bayesian dan pengunduran linear berganda
title_full Penilaian esei berbantukan komputer menggunakan teknik Bayesian dan pengunduran linear berganda
title_fullStr Penilaian esei berbantukan komputer menggunakan teknik Bayesian dan pengunduran linear berganda
title_full_unstemmed Penilaian esei berbantukan komputer menggunakan teknik Bayesian dan pengunduran linear berganda
title_sort penilaian esei berbantukan komputer menggunakan teknik bayesian dan pengunduran linear berganda
publishDate 2006
url http://eprints.utm.my/id/eprint/109/1/MohdAzwanMohamadMFC2006.pdf
http://eprints.utm.my/id/eprint/109/
_version_ 1643643001686196224
score 13.211869