Sharing lattice QCD data over a widely distributed file system. Issue 4 (December 2015)

• Record Type: Journal Article
• Authors: Amagasa, T; Aoki, S; Aoki, Y; Aoyama, T; Doi, T; Fukumura, K; Ishii, N; Ishikawa, K.-I; Jitsumoto, H; Kamano, H; Konno, Y; Matsufuru, H; Mikami, Y; Miura, K; Sato, M; Takeda, S; Tatebe, O; Togawa, H; Ukawa, A; Ukita, N; Watanabe, Y; Yamazaki, T; Yoshie, T
• Is Part Of: Journal of physics. Volume 664:Issue 4(2015)
• Publication Date: 2015-12
• Subjects: Physics -- Congresses; 530.5
• DOI: 10.1088/1742-6596/664/4/042058
• Languages: English
• ISSNs: 1742-6588

Abstract

Abstract: JLDG is a data-grid for the lattice QCD (LQCD) community in Japan. Several large research groups in Japan have been working on lattice QCD simulations using supercomputers distributed over distant sites. The JLDG provides such collaborations with an efficient method of data management and sharing. File servers installed on 9 sites are connected to the NII SINET VPN and are bound into a single file system with the GFarm. The file system looks the same from any sites, so that users can do analyses on a supercomputer on a site, using data generated and stored in the JLDG at a different site. We present a brief description of hardware and software of the JLDG, including a recently developed subsystem for cooperating with the HPCI shared storage, and report performance and statistics of the JLDG. As of April 2015, 15 research groups (61 users) store their daily research data of 4.7PB including replica and 68 million files in total. Number of publications for works which used the JLDG is 98. The large number of publications and recent rapid increase of disk usage convince us that the JLDG has grown up into a useful infrastructure for LQCD community in Japan.