An extreme learning approach to fast prediction in the reduce phase of a cloud platform

Liu, Q, Cai, W, Shen, J, Wang, B, Fu, Z and Linge, N 2015, 'An extreme learning approach to fast prediction in the reduce phase of a cloud platform' , Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9483 , pp. 417-423.

Full text not available from this repository.

Abstract

As a widely used programming model for the purposes of processing large data sets, MapReduce (MR) becomes inevitable in data clusters or grids, e.g. a Hadoop environment. However, experienced programmers are needed to decide the number of reducers used during the reduce phase of the MR, which makes the quality of MR scripts differ. In this paper, an extreme learning method is employed to recommend potential number of reducer a mapped task needs. Execution time is also predicted for user to better arrange their tasks. According to the results, our method can provide fast prediction than SVM with similar accuracy maintained.

Item Type: Article
Schools: Schools > School of Computing, Science and Engineering
Journal or Publication Title: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Publisher: Springer Verlag
ISSN: 0302-9743
Depositing User: WM Taylor
Date Deposited: 29 Nov 2016 15:32
Last Modified: 29 Nov 2016 15:32
URI: http://usir.salford.ac.uk/id/eprint/40924

Actions (login required)

Edit record (repository staff only) Edit record (repository staff only)