An optimized strategy for speculative execution in a heterogeneous environment

Liu, Q; Cai, W; Fu, Z; Shen, J; Linge, N

Abstract

MapReduce is a popular programming model for the purposes of processing large data sets. Speculative execution known as an approach for dealing with the above problems works by backing up those tasks running on a low performance machine to a higher one. In this paper, we have modified some pitfalls and taken computer hardware into consideration (HWC-Speculation). We also have implemented it in Hadoop-2.6 and experiment results show that our method can assign tasks evenly, improve the performance of MRV2 and decrease the execution time.

Citation

Liu, Q., Cai, W., Fu, Z., Shen, J., & Linge, N. (2015). An optimized strategy for speculative execution in a heterogeneous environment. In 2015 9th International Conference on Future Generation Communication and Networking (FGCN) (9-12). IEEE. https://doi.org/10.1109/FGCN.2015.9

• Publication Date: Jan 1, 2015
• Deposit Date: Dec 15, 2016
• Pages: 9-12
• Book Title: 2015 9th International Conference on Future Generation Communication and Networking (FGCN)
• ISBN: 9781467398343
• DOI: https://doi.org/10.1109/FGCN.2015.9
• Publisher URL: http://dx.doi.org/10.1109/FGCN.2015.9