Framework for Interoperable and Distributed Extraction-Transformation-Loading (ETL) Based on Service Oriented Architecture

Extraction. Transformation and Loading (ETL) are the major functionalities in data warehouse (DW) solutions. Lack of component distribution and interoperability is a gap that leads to many problems in the ETL domain, which is due to tightly-coupled components in the current ETL framework. This resea...

Full description

Saved in:
Bibliographic Details
Main Author: Awad, Mohammed M.I.
Format: Thesis
Language:en
en
Published: 2012
Subjects:
Online Access:https://etd.uum.edu.my/3409/1/Mohammed_M.I._Awad.pdf
https://etd.uum.edu.my/3409/4/Mohammed_M.I._Awad.pdf
https://etd.uum.edu.my/3409/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1833436130530295808
author Awad, Mohammed M.I.
author_facet Awad, Mohammed M.I.
author_sort Awad, Mohammed M.I.
building UUM Library
collection Institutional Repository
content_provider Universiti Utara Malaysia
content_source UUM Electronic Theses
continent Asia
country Malaysia
description Extraction. Transformation and Loading (ETL) are the major functionalities in data warehouse (DW) solutions. Lack of component distribution and interoperability is a gap that leads to many problems in the ETL domain, which is due to tightly-coupled components in the current ETL framework. This research discusses how to distribute the Extraction, Transformation and Loading components so as to achieve distribution and interoperability of these ETL components. In addition, it shows how the ETL framework can be extended. To achieve that, Service Oriented Architecture (SOA) is adopted to address the mentioned missing features of distribution and interoperability by restructuring the current ETL framework. This research contributes towards the field of ETL by adding the distribution and inter- operability concepts to the ETL framework. This Ieads to contributions towards the area of data warehousing and business intelligence, because ETL is a core concept in this area. The Design Science Approach (DSA) and Scrum methodologies were adopted for achieving the research goals. The integration of DSA and Scrum provides the suitable methods for achieving the research objectives. The new ETL framework is realized by developing and testing a prototype that is based on the new ETL framework. This prototype is successfully evaluated using three case studies that are conducted using the data and tools of three different organizations. These organizations use data warehouse solutions for the purpose of generating statistical reports that help their top management to take decisions. Results of the case studies show that distribution and interoperability can be achieved by using the new ETL framework.
format Thesis
id my.uum.etd-3409
institution Universiti Utara Malaysia
language en
en
publishDate 2012
record_format eprints
spelling my.uum.etd-34092022-04-10T06:32:32Z https://etd.uum.edu.my/3409/ Framework for Interoperable and Distributed Extraction-Transformation-Loading (ETL) Based on Service Oriented Architecture Awad, Mohammed M.I. QA71-90 Instruments and machines Extraction. Transformation and Loading (ETL) are the major functionalities in data warehouse (DW) solutions. Lack of component distribution and interoperability is a gap that leads to many problems in the ETL domain, which is due to tightly-coupled components in the current ETL framework. This research discusses how to distribute the Extraction, Transformation and Loading components so as to achieve distribution and interoperability of these ETL components. In addition, it shows how the ETL framework can be extended. To achieve that, Service Oriented Architecture (SOA) is adopted to address the mentioned missing features of distribution and interoperability by restructuring the current ETL framework. This research contributes towards the field of ETL by adding the distribution and inter- operability concepts to the ETL framework. This Ieads to contributions towards the area of data warehousing and business intelligence, because ETL is a core concept in this area. The Design Science Approach (DSA) and Scrum methodologies were adopted for achieving the research goals. The integration of DSA and Scrum provides the suitable methods for achieving the research objectives. The new ETL framework is realized by developing and testing a prototype that is based on the new ETL framework. This prototype is successfully evaluated using three case studies that are conducted using the data and tools of three different organizations. These organizations use data warehouse solutions for the purpose of generating statistical reports that help their top management to take decisions. Results of the case studies show that distribution and interoperability can be achieved by using the new ETL framework. 2012 Thesis NonPeerReviewed text en https://etd.uum.edu.my/3409/1/Mohammed_M.I._Awad.pdf text en https://etd.uum.edu.my/3409/4/Mohammed_M.I._Awad.pdf Awad, Mohammed M.I. (2012) Framework for Interoperable and Distributed Extraction-Transformation-Loading (ETL) Based on Service Oriented Architecture. PhD. thesis, Universiti Utara Malaysia.
spellingShingle QA71-90 Instruments and machines
Awad, Mohammed M.I.
Framework for Interoperable and Distributed Extraction-Transformation-Loading (ETL) Based on Service Oriented Architecture
title Framework for Interoperable and Distributed Extraction-Transformation-Loading (ETL) Based on Service Oriented Architecture
title_full Framework for Interoperable and Distributed Extraction-Transformation-Loading (ETL) Based on Service Oriented Architecture
title_fullStr Framework for Interoperable and Distributed Extraction-Transformation-Loading (ETL) Based on Service Oriented Architecture
title_full_unstemmed Framework for Interoperable and Distributed Extraction-Transformation-Loading (ETL) Based on Service Oriented Architecture
title_short Framework for Interoperable and Distributed Extraction-Transformation-Loading (ETL) Based on Service Oriented Architecture
title_sort framework for interoperable and distributed extraction-transformation-loading (etl) based on service oriented architecture
topic QA71-90 Instruments and machines
url https://etd.uum.edu.my/3409/1/Mohammed_M.I._Awad.pdf
https://etd.uum.edu.my/3409/4/Mohammed_M.I._Awad.pdf
https://etd.uum.edu.my/3409/
url_provider http://etd.uum.edu.my/