Impact of Automated Essay Scorer with Feedback for Essay Writing

Immediacy in feedback is necessary to ensure the recursive cycles of improvement in essay writing in line with the process writing approach that enables the cognition of information. However, grading and providing immediate feedback to students’ essays are time consuming and laborious and often lea...

Full description

Saved in:
Bibliographic Details
Main Author: Ng, Sing Yii
Format: E-Thesis
Language:English
Published: Universiti Malaysia Sarawak(UNIMAS) 2018
Subjects:
Online Access:http://ir.unimas.my/id/eprint/30449/1/Impact%20of%20Automated%20Essay%20Score%20ft.pdf
http://ir.unimas.my/id/eprint/30449/
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.unimas.ir.30449
record_format eprints
spelling my.unimas.ir.304492020-07-15T07:27:42Z http://ir.unimas.my/id/eprint/30449/ Impact of Automated Essay Scorer with Feedback for Essay Writing Ng, Sing Yii LB Theory and practice of education Immediacy in feedback is necessary to ensure the recursive cycles of improvement in essay writing in line with the process writing approach that enables the cognition of information. However, grading and providing immediate feedback to students’ essays are time consuming and laborious and often lead to teacher burnout. This study aimed to develop and customise a computational method of grading to provide immediate feedback to students called the Automated Essay Scoring Feedback (AESF) and examine its impact on students writing achievement, motivation to write and their acceptance toward AESF. Differences in students’ writing echievement, motivation to write and acceptance of AESF based on gender, English proficiency and computer use experience were also investigated using a quasi-experimental research approach. Teachers’ views on the usability of AESF were also collected through interviews. Participants consisted of 360 Upper 6 students and 24 teachers from five schools in Kuching, Sarawak. Data were collected using a pre-test and a post-test (for writing achievement), Instructional Material Motivation Survey (IMMS) (for motivation for writing), Technology Acceptance Model questionnaire (TAM) (for acceptance of AESF) and general demographics such as gender, English proficiency and computer use experience. Data were analysed using the Statistical Packages for the Social Sciences (SPSS). As the data violated parametric tests assumptions, data were analysed using nonparametric tests of Wilcoxon Signed Rank Test, Mann Whitney-U Test, Kruskal Wallis and Spearman’s Rank Correlation Coefficient Test. Students who used the AESF showed better writing achievement, especially in males and students with lower English proficiency. Students using AESF were found to be moderately motivated, and those who preferred immediate paragraph level scoring by AESF have higher motivation to write. Students have moderate acceptance of AESF regardless of gender, language proficiency and computer use experience. Students’ motivation to write was strongly and positively correlated to their acceptance of AESF. Teachers in this study also agreed that AESF could be used as a teaching and assessment tool but opined that it should not be solely depended on to determine students’ writing achievement for summative purposes. Hence, AESF should be further developed and fine-tuned to cater for students need for ongoing writing practise and help teachers make essay marking and feedback provision more manageable. Universiti Malaysia Sarawak(UNIMAS) 2018 E-Thesis NonPeerReviewed text en http://ir.unimas.my/id/eprint/30449/1/Impact%20of%20Automated%20Essay%20Score%20ft.pdf Ng, Sing Yii (2018) Impact of Automated Essay Scorer with Feedback for Essay Writing. PhD thesis, Universiti Malaysia Sarawak (UNIMAS).
institution Universiti Malaysia Sarawak
building Centre for Academic Information Services (CAIS)
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Malaysia Sarawak
content_source UNIMAS Institutional Repository
url_provider http://ir.unimas.my/
language English
topic LB Theory and practice of education
spellingShingle LB Theory and practice of education
Ng, Sing Yii
Impact of Automated Essay Scorer with Feedback for Essay Writing
description Immediacy in feedback is necessary to ensure the recursive cycles of improvement in essay writing in line with the process writing approach that enables the cognition of information. However, grading and providing immediate feedback to students’ essays are time consuming and laborious and often lead to teacher burnout. This study aimed to develop and customise a computational method of grading to provide immediate feedback to students called the Automated Essay Scoring Feedback (AESF) and examine its impact on students writing achievement, motivation to write and their acceptance toward AESF. Differences in students’ writing echievement, motivation to write and acceptance of AESF based on gender, English proficiency and computer use experience were also investigated using a quasi-experimental research approach. Teachers’ views on the usability of AESF were also collected through interviews. Participants consisted of 360 Upper 6 students and 24 teachers from five schools in Kuching, Sarawak. Data were collected using a pre-test and a post-test (for writing achievement), Instructional Material Motivation Survey (IMMS) (for motivation for writing), Technology Acceptance Model questionnaire (TAM) (for acceptance of AESF) and general demographics such as gender, English proficiency and computer use experience. Data were analysed using the Statistical Packages for the Social Sciences (SPSS). As the data violated parametric tests assumptions, data were analysed using nonparametric tests of Wilcoxon Signed Rank Test, Mann Whitney-U Test, Kruskal Wallis and Spearman’s Rank Correlation Coefficient Test. Students who used the AESF showed better writing achievement, especially in males and students with lower English proficiency. Students using AESF were found to be moderately motivated, and those who preferred immediate paragraph level scoring by AESF have higher motivation to write. Students have moderate acceptance of AESF regardless of gender, language proficiency and computer use experience. Students’ motivation to write was strongly and positively correlated to their acceptance of AESF. Teachers in this study also agreed that AESF could be used as a teaching and assessment tool but opined that it should not be solely depended on to determine students’ writing achievement for summative purposes. Hence, AESF should be further developed and fine-tuned to cater for students need for ongoing writing practise and help teachers make essay marking and feedback provision more manageable.
format E-Thesis
author Ng, Sing Yii
author_facet Ng, Sing Yii
author_sort Ng, Sing Yii
title Impact of Automated Essay Scorer with Feedback for Essay Writing
title_short Impact of Automated Essay Scorer with Feedback for Essay Writing
title_full Impact of Automated Essay Scorer with Feedback for Essay Writing
title_fullStr Impact of Automated Essay Scorer with Feedback for Essay Writing
title_full_unstemmed Impact of Automated Essay Scorer with Feedback for Essay Writing
title_sort impact of automated essay scorer with feedback for essay writing
publisher Universiti Malaysia Sarawak(UNIMAS)
publishDate 2018
url http://ir.unimas.my/id/eprint/30449/1/Impact%20of%20Automated%20Essay%20Score%20ft.pdf
http://ir.unimas.my/id/eprint/30449/
_version_ 1672614459205484544
score 13.211869