Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios

Although writing electronic portfolios (ePortfolios) help learners communicate digitally and provide a platform for works to be better collected and presented, challenges are present in their assessment. This paper reports the development and validation of a writing ePortfolio scoring rubric for an...

Full description

Saved in:
Bibliographic Details
Main Authors: Lallmamode, Sheila Parveen, Mat Daud, Nuraihan, Abu Kassim, Noor Lide
Format: Article
Language:English
Published: Elsevier 2016
Subjects:
Online Access:http://irep.iium.edu.my/52378/1/Development%20%26%20Initial%20Argument-Based%20Validation.pdf
http://irep.iium.edu.my/52378/
http://www.journals.elsevier.com/assessing-writing
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.iium.irep.52378
record_format dspace
spelling my.iium.irep.523782016-12-07T02:18:41Z http://irep.iium.edu.my/52378/ Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios Lallmamode, Sheila Parveen Mat Daud, Nuraihan Abu Kassim, Noor Lide L Education (General) PE English Although writing electronic portfolios (ePortfolios) help learners communicate digitally and provide a platform for works to be better collected and presented, challenges are present in their assessment. This paper reports the development and validation of a writing ePortfolio scoring rubric for an action research course for L2 learners. Using Bachman's (2005) 'Assessment Use Argument' as a basis, two main claims to support the validity of the rubric were examined: (1) the rubric is a reliable tool; and, (2) the rubric is relevant to the construct being measured. A mixed-method approach was used in the development and validation of the eight-criteria analytic and holistic evaluation scoring rubric. Thirteen raters evaluated thirty-eight ePortfolios in the study. The analyses of raters' rating using many-facet Rasch measurement approach and raters' individual standardised open-ended interviews indicated that overall the rubric's analytic categories functioned appropriately to assess the intended construct. However, the criterion 'Ease of Navigation' was found to be misfitting due to a differences in raters' evaluation of the same ePortfolios. Overall, the argument-based validation indicated that the scoring rubric is a reliable and valid instrument for the purpose of assessing L2 writing ePortfolios in the context for which it was developed. Elsevier 2016-10-01 Article REM application/pdf en http://irep.iium.edu.my/52378/1/Development%20%26%20Initial%20Argument-Based%20Validation.pdf Lallmamode, Sheila Parveen and Mat Daud, Nuraihan and Abu Kassim, Noor Lide (2016) Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios. Assessing Writing, 30. pp. 44-62. ISSN 1075-2935 http://www.journals.elsevier.com/assessing-writing DOI: 10.1016/j.asw.2016.06.001
institution Universiti Islam Antarabangsa Malaysia
building IIUM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider International Islamic University Malaysia
content_source IIUM Repository (IREP)
url_provider http://irep.iium.edu.my/
language English
topic L Education (General)
PE English
spellingShingle L Education (General)
PE English
Lallmamode, Sheila Parveen
Mat Daud, Nuraihan
Abu Kassim, Noor Lide
Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios
description Although writing electronic portfolios (ePortfolios) help learners communicate digitally and provide a platform for works to be better collected and presented, challenges are present in their assessment. This paper reports the development and validation of a writing ePortfolio scoring rubric for an action research course for L2 learners. Using Bachman's (2005) 'Assessment Use Argument' as a basis, two main claims to support the validity of the rubric were examined: (1) the rubric is a reliable tool; and, (2) the rubric is relevant to the construct being measured. A mixed-method approach was used in the development and validation of the eight-criteria analytic and holistic evaluation scoring rubric. Thirteen raters evaluated thirty-eight ePortfolios in the study. The analyses of raters' rating using many-facet Rasch measurement approach and raters' individual standardised open-ended interviews indicated that overall the rubric's analytic categories functioned appropriately to assess the intended construct. However, the criterion 'Ease of Navigation' was found to be misfitting due to a differences in raters' evaluation of the same ePortfolios. Overall, the argument-based validation indicated that the scoring rubric is a reliable and valid instrument for the purpose of assessing L2 writing ePortfolios in the context for which it was developed.
format Article
author Lallmamode, Sheila Parveen
Mat Daud, Nuraihan
Abu Kassim, Noor Lide
author_facet Lallmamode, Sheila Parveen
Mat Daud, Nuraihan
Abu Kassim, Noor Lide
author_sort Lallmamode, Sheila Parveen
title Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios
title_short Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios
title_full Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios
title_fullStr Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios
title_full_unstemmed Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios
title_sort development and initial argument-based validation of a scoring used in the assessment of l2 writing electronic portfolios
publisher Elsevier
publishDate 2016
url http://irep.iium.edu.my/52378/1/Development%20%26%20Initial%20Argument-Based%20Validation.pdf
http://irep.iium.edu.my/52378/
http://www.journals.elsevier.com/assessing-writing
_version_ 1643614153009528832
score 13.211869