File Access Optimization with the Lustre Filesystem at Florida CMS T2. Issue 4 (December 2015)

• Record Type: Journal Article
• Authors: Avery, P.; Bourilkov, D.; Fu, Y.; Kim, B.
• Is Part Of: Journal of physics. Volume 664:Issue 4(2015)
• Publication Date: 2015-12
• Subjects: Physics -- Congresses; 530.5
• DOI: 10.1088/1742-6596/664/4/042028
• Languages: English
• ISSNs: 1742-6588

Abstract

Abstract: The Florida CMS Tier2 center, one of the CMS Tier2 centers, has been using the Lustre filesystem for its data storage backend system since 2004. Recently, the data access pattern at our site has changed greatly due to various new access methods that include file transfers through the GridFTP servers, read access from the worker nodes, and the remote read access through the xrootd servers. In order to optimize the file access performance, we have to consider all the possible access patterns and each pattern needs to be studied separately. In this presentation, we report on our work to optimize file access with the Lustre filesystem at the Florida CMS T2 using an approach based on analyzing these access patterns.