An efficient data transfer service for scientific applications in cloud environments. (29th October 2019)

• Record Type: Journal Article
• Authors: Hu, Ying; Liu, Changsong
• Is Part Of: International journal of networking and virtual organisations. Volume 21:Number 3(2020)
• Page Start: 289
• Page End: 306
• Publication Date: 2019-10-29
• Subjects: cloud computing -- data transfer -- data scheduler -- performance prediction; Computer networks -- Periodicals; Information networks -- Periodicals; Virtual corporations -- Periodicals; Electronic commerce -- Periodicals; Management information systems -- Periodicals; Management -- Data processing -- Periodicals; 004.65
• Languages: English
• ISSNs: 1470-9503

Abstract

Recently, more and more data-intensive scientific applications have been deployed in cloud environments. Therefore, how to improve the efficiency of data transfer becomes an important issued that needs to be addressed. In this paper, we present an efficient data transfer framework which provides an integrated platform for data transfer, data scheduling and performance monitoring. Unlike those existing studies that focus on the utilisation of bandwidth resources, the proposed framework is implemented by integrating data transfer service and data scheduling service through a performance prediction service. In this way, it provides a flexible mechanism to enable a cloud system to improve the efficiency of data transfer. The implementation of the proposed framework has been deployed in a real-world cloud system, and experimental results have shown that in can significantly improve the efficiency of massive-data transfer comparing with many existing approaches.