Cover Image

NCI evalution: assessment of higher order thinking skills via short free text answer

NCI a hybrid approach of Natural Language Processing (NLP), Convolutional Neural Network (CNN) and Information Theory are applied to assess higher order thinking skills via short free text answer. Data of students' examination scripts are collected from 3 domains namely Information Technology,...

Full description

Saved in:
Bibliographic Details
Main Authors: Lajis, Adidah, Nasir, Haidawati, Abdul Aziz, Normaziah
Format: Conference or Workshop Item
Language:English
English
English
Published: IEEE 2020
Subjects:
T Technology (General)
Online Access:http://irep.iium.edu.my/80429/1/80429%20NCI%20Evalution.pdf
http://irep.iium.edu.my/80429/2/80429%20NCI%20Evalution%20SCOPUS.pdf
http://irep.iium.edu.my/80429/13/NCI%20evalution_assessment%20of%20higher%20order%20thinking%20skills%20via%20short%20free%20text%20answer.pdf
http://irep.iium.edu.my/80429/
https://ieeexplore.ieee.org/document/9057335
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.iium.irep.80429
record_format dspace
spelling my.iium.irep.804292021-01-27T23:48:35Z http://irep.iium.edu.my/80429/ NCI evalution: assessment of higher order thinking skills via short free text answer Lajis, Adidah Nasir, Haidawati Abdul Aziz, Normaziah T Technology (General) NCI a hybrid approach of Natural Language Processing (NLP), Convolutional Neural Network (CNN) and Information Theory are applied to assess higher order thinking skills via short free text answer. Data of students' examination scripts are collected from 3 domains namely Information Technology, Engineering and Management with a total of 479 answer scripts. All data are of tertiary level examinations. These answer text are firstly, processed by applying NLP. Next, the pattern of known-information is generated by applying CNN-seq concept and finally based on the pattern the amount of known-information is computed by applying information theory approach. Result shows that the proposed techniques achieved an excellent achievement of 0.89 and above for all domains and all level of higher order thinking skills. LSA based testing achieved from 0.47 to 0.83 agreement. This result supports that the proposed hybrid technique can improve automated short free text assessment in a given scope of domain and competency level. IEEE 2020-04-06 Conference or Workshop Item PeerReviewed application/pdf en http://irep.iium.edu.my/80429/1/80429%20NCI%20Evalution.pdf application/pdf en http://irep.iium.edu.my/80429/2/80429%20NCI%20Evalution%20SCOPUS.pdf application/pdf en http://irep.iium.edu.my/80429/13/NCI%20evalution_assessment%20of%20higher%20order%20thinking%20skills%20via%20short%20free%20text%20answer.pdf Lajis, Adidah and Nasir, Haidawati and Abdul Aziz, Normaziah (2020) NCI evalution: assessment of higher order thinking skills via short free text answer. In: 2019 IEEE 6th International Conference on Smart Instrumentation, Measurement and Applications (ICSIMA 2019), 27 - 29 Aug 2019, Kuala Lumpur, Malaysia. https://ieeexplore.ieee.org/document/9057335 10.1109/ICSIMA47653.2019.9057335
institution Universiti Islam Antarabangsa Malaysia
building IIUM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider International Islamic University Malaysia
content_source IIUM Repository (IREP)
url_provider http://irep.iium.edu.my/
language English
English
English
topic T Technology (General)
spellingShingle T Technology (General)
Lajis, Adidah
Nasir, Haidawati
Abdul Aziz, Normaziah
NCI evalution: assessment of higher order thinking skills via short free text answer
description NCI a hybrid approach of Natural Language Processing (NLP), Convolutional Neural Network (CNN) and Information Theory are applied to assess higher order thinking skills via short free text answer. Data of students' examination scripts are collected from 3 domains namely Information Technology, Engineering and Management with a total of 479 answer scripts. All data are of tertiary level examinations. These answer text are firstly, processed by applying NLP. Next, the pattern of known-information is generated by applying CNN-seq concept and finally based on the pattern the amount of known-information is computed by applying information theory approach. Result shows that the proposed techniques achieved an excellent achievement of 0.89 and above for all domains and all level of higher order thinking skills. LSA based testing achieved from 0.47 to 0.83 agreement. This result supports that the proposed hybrid technique can improve automated short free text assessment in a given scope of domain and competency level.
format Conference or Workshop Item
author Lajis, Adidah
Nasir, Haidawati
Abdul Aziz, Normaziah
author_facet Lajis, Adidah
Nasir, Haidawati
Abdul Aziz, Normaziah
author_sort Lajis, Adidah
title NCI evalution: assessment of higher order thinking skills via short free text answer
title_short NCI evalution: assessment of higher order thinking skills via short free text answer
title_full NCI evalution: assessment of higher order thinking skills via short free text answer
title_fullStr NCI evalution: assessment of higher order thinking skills via short free text answer
title_full_unstemmed NCI evalution: assessment of higher order thinking skills via short free text answer
title_sort nci evalution: assessment of higher order thinking skills via short free text answer
publisher IEEE
publishDate 2020
url http://irep.iium.edu.my/80429/1/80429%20NCI%20Evalution.pdf
http://irep.iium.edu.my/80429/2/80429%20NCI%20Evalution%20SCOPUS.pdf
http://irep.iium.edu.my/80429/13/NCI%20evalution_assessment%20of%20higher%20order%20thinking%20skills%20via%20short%20free%20text%20answer.pdf
http://irep.iium.edu.my/80429/
https://ieeexplore.ieee.org/document/9057335
_version_ 1690370722640166912
score 13.211869

Similar Items