A virtual memory manager optimized for node-level cooperative multi-tasking in memory constrained systems. (September 2018)
- Record Type:
- Journal Article
- Title:
- A virtual memory manager optimized for node-level cooperative multi-tasking in memory constrained systems. (September 2018)
- Main Title:
- A virtual memory manager optimized for node-level cooperative multi-tasking in memory constrained systems
- Authors:
- Iverson, Jeremy
Karypis, George - Other Names:
- Bland Wesley guest-editor.
Erez Mattan guest-editor.
Hidalgo J Ignacio guest-editor.
Fernández de Vega Francisco guest-editor.
Mercier Guillaume guest-editor. - Abstract:
- There is a growing need to perform large computations on small systems, as access to large systems is not widely available and cannot keep up with the size of the data that needs to be processed. Recently, a runtime system for programs using a library that implements the Message Passing Interface (MPI), called Big Data MPI (BDMPI), that allows MPI programs whose aggregate amount of memory exceeds the physical amount of memory to be executed efficiently by utilizing node-level cooperative multi-tasking. In this paper we present a virtual memory subsystem which we implemented as part of the BDMPI runtime. Our new virtual memory subsystem, which we call SBMA takes advantage of BDMPI's node-level cooperative multi-tasking in order to intelligently determine the parts of the virtual address space that need to be loaded to and unloaded from the main memory. Benchmarking using a synthetic application shows that for the use cases relevant to BDMPI, the overhead incurred by the memory protection constructs necessary for the BDMPI-SBMA system is amortized such that it performs as fast as explicit data movement by the application developer. Furthermore, testing SBMA with five different classes of applications showed that with no modification to the original MPI program, speedups from 2×–12× over a standard BDMPI implementation can be achieved for the included applications.
- Is Part Of:
- International journal of high performance computing applications. Volume 32:Number 5(2018)
- Journal:
- International journal of high performance computing applications
- Issue:
- Volume 32:Number 5(2018)
- Issue Display:
- Volume 32, Issue 5 (2018)
- Year:
- 2018
- Volume:
- 32
- Issue:
- 5
- Issue Sort Value:
- 2018-0032-0005-0000
- Page Start:
- 744
- Page End:
- 759
- Publication Date:
- 2018-09
- Subjects:
- distributed computing -- virtual memory -- out-of-core -- mpi
High performance computing -- Periodicals
Supercomputers -- Periodicals
004.1105 - Journal URLs:
- http://hpc.sagepub.com ↗
http://www.uk.sagepub.com/home.nav ↗
http://firstsearch.oclc.org ↗ - DOI:
- 10.1177/1094342017690975 ↗
- Languages:
- English
- ISSNs:
- 1094-3420
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 8501.xml