Cover Image

Available Techniques In Hadoop Small File Issue

Hadoop is an optimal solution for big data processing and storing since being released in the late of 2006, hadoop data processing stands on master-slaves manner that’s splits the large file job into several small files in order to process them separately, this technique was adopted instead of pushi...

Full description

Saved in:
Bibliographic Details
Main Authors: Al-Masadeh, Mohammad Bahjat, Azmi, Mohd Sanusi, Syed Ahmad, Sharifah Sakinah
Format: Article
Language:English
Published: Institute Of Advanced Engineering And Science (IAES) 2020
Online Access:http://eprints.utem.edu.my/id/eprint/24343/2/AVAILABLE%20TECHNIQUES%20IN%20HADOOP%20SMALL%20FILE%20ISSUE.PDF
http://eprints.utem.edu.my/id/eprint/24343/
http://ijece.iaescore.com/index.php/IJECE/article/view/20039/13737
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.utem.eprints.24343
record_format eprints
spelling my.utem.eprints.243432020-10-28T12:26:20Z http://eprints.utem.edu.my/id/eprint/24343/ Available Techniques In Hadoop Small File Issue Al-Masadeh, Mohammad Bahjat Azmi, Mohd Sanusi Syed Ahmad, Sharifah Sakinah Hadoop is an optimal solution for big data processing and storing since being released in the late of 2006, hadoop data processing stands on master-slaves manner that’s splits the large file job into several small files in order to process them separately, this technique was adopted instead of pushing one large file into a costly super machine to insights some useful information. Hadoop runs very good with large file of big data, but when it comes to big data in small files it could facing some problems in performance, processing slow down, data access delay, high latency and up to a completely cluster shutting down. In this paper we will high light on one of hadoop’s limitations, that’s affects the data processing performance, one of these limits called “big data in small files” accrued when a massive number of small files pushed into a hadoop cluster which will rides the cluster to shut down totally. This paper also high light on some native and proposed solutions for big data in small files, how do they work to reduce the negative effects on hadoop cluster, and add extra performance on storing and accessing mechanism Institute Of Advanced Engineering And Science (IAES) 2020-04 Article PeerReviewed text en http://eprints.utem.edu.my/id/eprint/24343/2/AVAILABLE%20TECHNIQUES%20IN%20HADOOP%20SMALL%20FILE%20ISSUE.PDF Al-Masadeh, Mohammad Bahjat and Azmi, Mohd Sanusi and Syed Ahmad, Sharifah Sakinah (2020) Available Techniques In Hadoop Small File Issue. International Journal Of Electrical And Computer Engineering (IJECE), 10 (2). 2097 - 2101. ISSN 2088-8708 http://ijece.iaescore.com/index.php/IJECE/article/view/20039/13737 10.11591/ijece.v10i2.pp2097-2101
institution Universiti Teknikal Malaysia Melaka
building UTEM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Teknikal Malaysia Melaka
content_source UTEM Institutional Repository
url_provider http://eprints.utem.edu.my/
language English
description Hadoop is an optimal solution for big data processing and storing since being released in the late of 2006, hadoop data processing stands on master-slaves manner that’s splits the large file job into several small files in order to process them separately, this technique was adopted instead of pushing one large file into a costly super machine to insights some useful information. Hadoop runs very good with large file of big data, but when it comes to big data in small files it could facing some problems in performance, processing slow down, data access delay, high latency and up to a completely cluster shutting down. In this paper we will high light on one of hadoop’s limitations, that’s affects the data processing performance, one of these limits called “big data in small files” accrued when a massive number of small files pushed into a hadoop cluster which will rides the cluster to shut down totally. This paper also high light on some native and proposed solutions for big data in small files, how do they work to reduce the negative effects on hadoop cluster, and add extra performance on storing and accessing mechanism
format Article
author Al-Masadeh, Mohammad Bahjat
Azmi, Mohd Sanusi
Syed Ahmad, Sharifah Sakinah
spellingShingle Al-Masadeh, Mohammad Bahjat
Azmi, Mohd Sanusi
Syed Ahmad, Sharifah Sakinah
Available Techniques In Hadoop Small File Issue
author_facet Al-Masadeh, Mohammad Bahjat
Azmi, Mohd Sanusi
Syed Ahmad, Sharifah Sakinah
author_sort Al-Masadeh, Mohammad Bahjat
title Available Techniques In Hadoop Small File Issue
title_short Available Techniques In Hadoop Small File Issue
title_full Available Techniques In Hadoop Small File Issue
title_fullStr Available Techniques In Hadoop Small File Issue
title_full_unstemmed Available Techniques In Hadoop Small File Issue
title_sort available techniques in hadoop small file issue
publisher Institute Of Advanced Engineering And Science (IAES)
publishDate 2020
url http://eprints.utem.edu.my/id/eprint/24343/2/AVAILABLE%20TECHNIQUES%20IN%20HADOOP%20SMALL%20FILE%20ISSUE.PDF
http://eprints.utem.edu.my/id/eprint/24343/
http://ijece.iaescore.com/index.php/IJECE/article/view/20039/13737
_version_ 1683234173619273728
score 13.211869

Similar Items