No Detail Found!

Smart-etl-mr: novel etl framework for building data warehouse from big data source using mapreduce

Author(s)
ABDELJALIL BOUMLIK University Hassan 1, Faculty of Sciences and Technology, Department of mathematics and computer science, Morocco
NASSIMA SOUSSI National School of Applied Sciences, Sultan Moulay Slimane University, Khouribga, Morocco
MOHAMED BAHAJ University Hassan 1, Faculty of Sciences and Technology, Department of mathematics and computer science, Morocco
Abstract
The concept of Big Data created to face the massive explosion of data produced from web 2.0, smart devices, sensors, social networks platforms like Facebook, Twitter, Instagram, LinkedIn, has increased continuously. However, new challenges and opportunities appear due to the growth of data. Nevertheless, several prominent organizations and companies have realized that data is valuable and offers competitive advantages, great benefits, and relevant knowledge when it gets converted to actionable information they can use. However, collecting these massive data is not enough, as we should be able to integrate and analyze these data pulled from different heterogeneous sources after loading them to improve analysis goals. This research article's primary objective is to adapt the ETL (extraction transformation-loading) processes with the potential of Big Data technologies in order to deal with these new challenges from data warehousing perspective and knowledge discovery that directly impacts business decision-making systems. In this article, a new approach based called SMART-ETL-MR presented on the Map-Reduce paradigm to expedite data handling and to build a well-organized data warehouse. Experimental results prove that the ETL operation performs successfully with optimal algorithms.
Publication Details
Page(s) 3449-3460
DOI DOI not available
Published Journal: Journal of Theoretical and Applied Information Technology, Volume: 98, Issue: 17, Year: 2020

Request the full text from PASTIC

Keywords
Facebook, Big Data, Data Warehouse, Map Reduce, ETL
0

Citations

0

Downloads

46

Views