No Detail Found!

Evaluation of high-performance computing techniques for big data applications.

Author(s)
Waleed Al Shehri Department of Computer Science, King Abdul-Aziz University, Jeddah, KSA
Maher Khemakhem Department of Computer Science, King Abdul-Aziz University, Jeddah, KSA
Abdullah Basuhail Department of Computer Science, King Abdul-Aziz University, Jeddah, KSA
Fathy E. Eassa Department of Computer Science, King Abdul-Aziz University, Jeddah, KSA
Abstract
The big data revolution has led to the emergence of many technologies for processing the enormous volume, high velocity and variety of data sources. The capabilities provided by high-performance computing (HPC) have had a substantial impact in supporting this revolution through the integration of heterogeneous hardware and crafting software and algorithms that exploit the parallelism of HPC. However, big data platforms, written in high-level programming languages, and their architectures differ from HPC languages and architectures. This misalignment has resulted in the underutilization of HPC resources and capabilities for big data problems. In this paper, we highlight and evaluate many of the techniques used in the HPC environment based on the most critical factors influencing performance and resource utilization: load balancing and data locality, job scheduling strategies, topology awareness, decomposition techniques and programming models. We recommend establishing a research roadmap that considers these influential factors in the field of resource and job management within HPC environments for big data computing.
Publication Details
Page(s) 149-163
DOI DOI not available
Published Journal: Science International, Volume: 31, Issue: 1A, Year: 2019

Request the full text from PASTIC

Keywords
Data-Locality
0

Citations

0

Downloads

34

Views