A speculative approach to spatial-temporal efficiency with multi-objective optimization in a heterogeneous cloud environment

Liu, Q, Cai, W, Shen, J, Fu, Z, Liu, X and Linge, N ORCID: https://orcid.org/0000-0002-4318-8782 2016, 'A speculative approach to spatial-temporal efficiency with multi-objective optimization in a heterogeneous cloud environment' , Security and Communication Networks, 9 (17) , pp. 4002-4012.

Full text not available from this repository. (Request a copy)

Abstract

A heterogeneous cloud system, for example, a Hadoop 2.6.0 platform, provides distributed but cohesive services with rich features on large‐scale management, reliability, and error tolerance. As big data processing is concerned, newly built cloud clusters meet the challenges of performance optimization focusing on faster task execution and more efficient usage of computing resources. Presently proposed approaches concentrate on temporal improvement, that is, shortening MapReduce time, but seldom focus on storage occupation; however, unbalanced cloud storage strategies could exhaust those nodes with heavy MapReduce cycles and further challenge the security and stability of the entire cluster. In this paper, an adaptive method is presented aiming at spatial–temporal efficiency in a heterogeneous cloud environment. A prediction model based on an optimized Kernel‐based Extreme Learning Machine algorithm is proposed for faster forecast of job execution duration and space occupation, which consequently facilitates the process of task scheduling through a multi‐objective algorithm called time and space optimized NSGA‐II (TS‐NSGA‐II). Experiment results have shown that compared with the original load‐balancing scheme, our approach can save approximate 47–55 s averagely on each task execution. Simultaneously, 1.254‰ of differences on hard disk occupation were made among all scheduled reducers, which achieves 26.6% improvement over the original scheme.

Item Type: Article
Schools: Schools > School of Computing, Science and Engineering
Journal or Publication Title: Security and Communication Networks
Publisher: Wiley
ISSN: 1939-0122
Related URLs:
Funders: NSFC, Marie Curie Fellowship, Basic Research Programs (Natural Science Foundation) of Jiangsu Province, PAPD fund
SWORD Depositor: Publications Router
Depositing User: Publications Router
Date Deposited: 21 Aug 2018 09:06
Last Modified: 17 Aug 2020 13:40
URI: http://usir.salford.ac.uk/id/eprint/48087

Actions (login required)

Edit record (repository staff only) Edit record (repository staff only)