Staff View: An assessment of open data sets completeness

An assessment of open data sets completeness

The rapid growth of open data sources is driven by free-of-charge contents and ease of accessibility. While it is convenient for public data consumers to use data sets extracted from open data sources, the decision to use these data sets should be based on data sets’ quality. Several data quality di...

Full description

Saved in:

Bibliographic Details
Main Authors:	Mohamed Abdulrahim, Abdulrazzak Ali, Emran, Nurul Akmar, Asmai, Siti Azirah, Ismail, Amelia Ritahani
Format:	Article
Language:	English
Published:	The Science And Information (SAI) Organization Limited 2019
Online Access:	http://eprints.utem.edu.my/id/eprint/24592/2/AN%20ASSESSMENT%20OF%20OPEN%20DATA%20SETS%20COMPLETENESS.PDF http://eprints.utem.edu.my/id/eprint/24592/ https://thesai.org/Downloads/Volume10No6/Paper_72-An_Assessment_of_Open_Data_Sets_Completeness.pdf
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my.utem.eprints.24592
record_format	eprints
spelling	my.utem.eprints.245922023-07-17T16:42:21Z http://eprints.utem.edu.my/id/eprint/24592/ An assessment of open data sets completeness Mohamed Abdulrahim, Abdulrazzak Ali Emran, Nurul Akmar Asmai, Siti Azirah Ismail, Amelia Ritahani The rapid growth of open data sources is driven by free-of-charge contents and ease of accessibility. While it is convenient for public data consumers to use data sets extracted from open data sources, the decision to use these data sets should be based on data sets’ quality. Several data quality dimensions such as completeness, accuracy, and timeliness are common requirements to make data fit for use. More importantly, in many cases, high-quality data sets are desirable in ensuring reliable outcomes of reports and analytics. Even though many open data sources provide data quality guidelines, the responsibility to ensure data of high quality requires commitment from data contributors. In this paper, an initial investigation on the quality of open data sets in terms of completeness dimension was conducted. In particular, the results of the missing values in 20 open data sets measurement were extracted from the open data sources. The analysis covered all the missing values representations which are not limited to nulls or blank spaces. The results exhibited a range of missing values ratios that indicated the level of the data sets completeness. The limited coverage of this analysis does not hinder understanding of the current level of data completeness of open data sets. The findings may motivate open data providers to design initiatives that will empower data quality policy and guidelines for data contributors. In addition, this analysis may assist public data users to decide on the acceptability of open data sets by applying the simple methods proposed in this paper or performing data cleaning actions to improve the completeness of the data sets concerned The Science And Information (SAI) Organization Limited 2019 Article PeerReviewed text en http://eprints.utem.edu.my/id/eprint/24592/2/AN%20ASSESSMENT%20OF%20OPEN%20DATA%20SETS%20COMPLETENESS.PDF Mohamed Abdulrahim, Abdulrazzak Ali and Emran, Nurul Akmar and Asmai, Siti Azirah and Ismail, Amelia Ritahani (2019) An assessment of open data sets completeness. International Journal Of Advanced Computer Science And Applications (IJASCA), 10 (6). pp. 557-562. ISSN 2158-107X https://thesai.org/Downloads/Volume10No6/Paper_72-An_Assessment_of_Open_Data_Sets_Completeness.pdf 10.14569/ijacsa.2019.0100672
institution	Universiti Teknikal Malaysia Melaka
building	UTEM Library
collection	Institutional Repository
continent	Asia
country	Malaysia
content_provider	Universiti Teknikal Malaysia Melaka
content_source	UTEM Institutional Repository
url_provider	http://eprints.utem.edu.my/
language	English
description	The rapid growth of open data sources is driven by free-of-charge contents and ease of accessibility. While it is convenient for public data consumers to use data sets extracted from open data sources, the decision to use these data sets should be based on data sets’ quality. Several data quality dimensions such as completeness, accuracy, and timeliness are common requirements to make data fit for use. More importantly, in many cases, high-quality data sets are desirable in ensuring reliable outcomes of reports and analytics. Even though many open data sources provide data quality guidelines, the responsibility to ensure data of high quality requires commitment from data contributors. In this paper, an initial investigation on the quality of open data sets in terms of completeness dimension was conducted. In particular, the results of the missing values in 20 open data sets measurement were extracted from the open data sources. The analysis covered all the missing values representations which are not limited to nulls or blank spaces. The results exhibited a range of missing values ratios that indicated the level of the data sets completeness. The limited coverage of this analysis does not hinder understanding of the current level of data completeness of open data sets. The findings may motivate open data providers to design initiatives that will empower data quality policy and guidelines for data contributors. In addition, this analysis may assist public data users to decide on the acceptability of open data sets by applying the simple methods proposed in this paper or performing data cleaning actions to improve the completeness of the data sets concerned
format	Article
author	Mohamed Abdulrahim, Abdulrazzak Ali Emran, Nurul Akmar Asmai, Siti Azirah Ismail, Amelia Ritahani
spellingShingle	Mohamed Abdulrahim, Abdulrazzak Ali Emran, Nurul Akmar Asmai, Siti Azirah Ismail, Amelia Ritahani An assessment of open data sets completeness
author_facet	Mohamed Abdulrahim, Abdulrazzak Ali Emran, Nurul Akmar Asmai, Siti Azirah Ismail, Amelia Ritahani
author_sort	Mohamed Abdulrahim, Abdulrazzak Ali
title	An assessment of open data sets completeness
title_short	An assessment of open data sets completeness
title_full	An assessment of open data sets completeness
title_fullStr	An assessment of open data sets completeness
title_full_unstemmed	An assessment of open data sets completeness
title_sort	assessment of open data sets completeness
publisher	The Science And Information (SAI) Organization Limited
publishDate	2019
url	http://eprints.utem.edu.my/id/eprint/24592/2/AN%20ASSESSMENT%20OF%20OPEN%20DATA%20SETS%20COMPLETENESS.PDF http://eprints.utem.edu.my/id/eprint/24592/ https://thesai.org/Downloads/Volume10No6/Paper_72-An_Assessment_of_Open_Data_Sets_Completeness.pdf
_version_	1772816018008178688
score	13.211869

An assessment of open data sets completeness

Similar Items