Resource provisioning for data-intensive applications with deadline constraints on hybrid clouds using Aneka

摘要

AbstractCloud computing has emerged as a mainstream paradigm for hosting various types of applications by supporting easy-to-use computing services. Among the many different forms of cloud computing, hybrid clouds, which mix on-premises private cloud and third-party public cloud services to deploy applications, have gained broad acceptance. They are particularly relevant for applications requiring large volumes of computing power exceeding the computational capacity within the premises of a single organization. However, the use of hybrid clouds introduces the challenge of how much and when public cloud resources should be added to the pool of resources – and especially when it is necessary to support quality of service requirements of applications with deadline constraints. These resource provisioning decisions are far from trivial if scheduling involves data-intensive applications using voluminous amounts of data. Issues such as the impact of network latency, bandwidth constraints, and location of data must be taken into account in order to minimize the execution cost while meeting the deadline for such applications. In this paper, we propose a new resource provisioning algorithm to support the deadline requirements of data-intensive applications in hybrid cloud environments. To evaluate our proposed algorithm, we implement it in Aneka, a platform for developing scalable applications on the Cloud. Experimental results using a real case study executing a data-intensive application to measure the walkability index on a hybrid cloud platform consisting of dynamic resources from the Microsoft Azure cloud show that our proposed provisioning algorithm is able to more efficiently allocate resources compared to existing methods.Highlights•A new data-aware provisioning algorithm is proposed to meet user-defined deadline requirements for data-intensive applications. The proposed algorithm takes into account available bandwidth and data transfer time.•The proposed provisioning algorithm is integrated into the Aneka platform. Aneka is extended to support the Microsoft Azure Resource Manager (ARM) deployment service model.•In an actual hybrid cloud environment, we evaluate the proposed algorithm’s ability in meeting deadlines for a case study data-intensive application in smart cities context.