Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios
Although writing electronic portfolios (ePortfolios) help learners communicate digitally and provide a platform for works to be better collected and presented, challenges are present in their assessment. This paper reports the development and validation of a writing ePortfolio scoring rubric for an...
Saved in:
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Elsevier
2016
|
Subjects: | |
Online Access: | http://irep.iium.edu.my/52378/1/Development%20%26%20Initial%20Argument-Based%20Validation.pdf http://irep.iium.edu.my/52378/ http://www.journals.elsevier.com/assessing-writing |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my.iium.irep.52378 |
---|---|
record_format |
dspace |
spelling |
my.iium.irep.523782016-12-07T02:18:41Z http://irep.iium.edu.my/52378/ Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios Lallmamode, Sheila Parveen Mat Daud, Nuraihan Abu Kassim, Noor Lide L Education (General) PE English Although writing electronic portfolios (ePortfolios) help learners communicate digitally and provide a platform for works to be better collected and presented, challenges are present in their assessment. This paper reports the development and validation of a writing ePortfolio scoring rubric for an action research course for L2 learners. Using Bachman's (2005) 'Assessment Use Argument' as a basis, two main claims to support the validity of the rubric were examined: (1) the rubric is a reliable tool; and, (2) the rubric is relevant to the construct being measured. A mixed-method approach was used in the development and validation of the eight-criteria analytic and holistic evaluation scoring rubric. Thirteen raters evaluated thirty-eight ePortfolios in the study. The analyses of raters' rating using many-facet Rasch measurement approach and raters' individual standardised open-ended interviews indicated that overall the rubric's analytic categories functioned appropriately to assess the intended construct. However, the criterion 'Ease of Navigation' was found to be misfitting due to a differences in raters' evaluation of the same ePortfolios. Overall, the argument-based validation indicated that the scoring rubric is a reliable and valid instrument for the purpose of assessing L2 writing ePortfolios in the context for which it was developed. Elsevier 2016-10-01 Article REM application/pdf en http://irep.iium.edu.my/52378/1/Development%20%26%20Initial%20Argument-Based%20Validation.pdf Lallmamode, Sheila Parveen and Mat Daud, Nuraihan and Abu Kassim, Noor Lide (2016) Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios. Assessing Writing, 30. pp. 44-62. ISSN 1075-2935 http://www.journals.elsevier.com/assessing-writing DOI: 10.1016/j.asw.2016.06.001 |
institution |
Universiti Islam Antarabangsa Malaysia |
building |
IIUM Library |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
International Islamic University Malaysia |
content_source |
IIUM Repository (IREP) |
url_provider |
http://irep.iium.edu.my/ |
language |
English |
topic |
L Education (General) PE English |
spellingShingle |
L Education (General) PE English Lallmamode, Sheila Parveen Mat Daud, Nuraihan Abu Kassim, Noor Lide Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios |
description |
Although writing electronic portfolios (ePortfolios) help learners communicate digitally and provide a platform for works to be better collected and presented, challenges are present in their assessment. This paper reports the development and validation of a writing ePortfolio scoring rubric for an action research course for L2 learners. Using Bachman's (2005) 'Assessment Use Argument' as a basis, two main claims to support the validity of the rubric were examined: (1) the rubric is a reliable tool; and, (2) the rubric is relevant to the construct being measured. A mixed-method approach was used in the development and validation of the eight-criteria analytic and holistic evaluation scoring rubric. Thirteen raters evaluated thirty-eight ePortfolios in the study. The analyses of raters' rating using many-facet Rasch measurement approach and raters' individual standardised open-ended interviews indicated that overall the rubric's analytic categories functioned appropriately to assess the intended construct. However, the criterion 'Ease of Navigation' was found to be misfitting due to a differences in raters' evaluation of the same ePortfolios. Overall, the argument-based validation indicated that the scoring rubric is a reliable and valid instrument for the purpose of assessing L2 writing ePortfolios in the context for which it was developed. |
format |
Article |
author |
Lallmamode, Sheila Parveen Mat Daud, Nuraihan Abu Kassim, Noor Lide |
author_facet |
Lallmamode, Sheila Parveen Mat Daud, Nuraihan Abu Kassim, Noor Lide |
author_sort |
Lallmamode, Sheila Parveen |
title |
Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios |
title_short |
Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios |
title_full |
Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios |
title_fullStr |
Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios |
title_full_unstemmed |
Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios |
title_sort |
development and initial argument-based validation of a scoring used in the assessment of l2 writing electronic portfolios |
publisher |
Elsevier |
publishDate |
2016 |
url |
http://irep.iium.edu.my/52378/1/Development%20%26%20Initial%20Argument-Based%20Validation.pdf http://irep.iium.edu.my/52378/ http://www.journals.elsevier.com/assessing-writing |
_version_ |
1643614153009528832 |
score |
13.211869 |