A virtual tile approach to raster-based calculations of large digital elevation models in a shared-memory system. (September 2015)

• Record Type: Journal Article
• Authors: Yıldırım, Ahmet Artu; Watson, Dan; Tarboton, David; Wallace, Robert M.
• Is Part Of: Computers & geosciences. Volume 82(2015)
• Page Start: 78
• Page End: 88
• Publication Date: 2015-09
• Subjects: Multithreaded parallel digital elevation model analysis -- Pit filling algorithm -- User-level virtual memory management; Environmental policy -- Periodicals; 550.5
• DOI: 10.1016/j.cageo.2015.05.014
• Languages: English
• ISSNs: 0098-3004

Abstract

Abstract: Grid digital elevation models (DEMs) are commonly used in hydrology to derive information related to topographically driven flow. Advances in technology for creating DEMs have increased their resolution and data size with the result that algorithms for processing them are frequently memory limited. This paper presents a new approach to the management of memory in the parallel solution of hydrologic terrain processing using a user-level virtual memory system for shared-memory multithreaded systems. The method includes tailored virtual memory management of raster-based calculations for datasets that are larger than available memory and a novel order-of-calculations approach to parallel hydrologic terrain analysis applications. The method is illustrated for the pit filling algorithm used first in most hydrologic terrain analysis workflows. Abstract : Highlights: We presented a tiled virtual memory system to process large DEM datasets on a machine with limited memory Efficiencies were achieved using algorithm refinements such as multi-threading, load balancing and the pre-fetching approaches. We found optimal tile sizes for the cases of best performance and better memory usage efficiency.