A large‐area, spatially continuous assessment of land cover map error and its impact on downstream analyses. (12th October 2017)

• Record Type: Journal Article
• Authors: Estes, Lyndon; Chen, Peng; Debats, Stephanie; Evans, Tom; Ferreira, Stefanus; Kuemmerle, Tobias; Ragazzo, Gabrielle; Sheffield, Justin; Wolf, Adam; Wood, Eric; Caylor, Kelly
• Is Part Of: Global change biology. Volume 24:Number 1(2018)
• Page Start: 322
• Page End: 337
• Publication Date: 2017-10-12
• Subjects: agent‐based model -- agriculture -- bias -- carbon -- crop yield -- evapotranspiration -- land cover -- remote sensing; Climatic changes -- Environmental aspects -- Periodicals; Troposphere -- Environmental aspects -- Periodicals; Biodiversity conservation -- Periodicals; Eutrophication -- Periodicals; 551.5
• DOI: 10.1111/gcb.13904
• Languages: English
• ISSNs: 1354-1013

Abstract

Abstract: Land cover maps increasingly underlie research into socioeconomic and environmental patterns and processes, including global change. It is known that map errors impact our understanding of these phenomena, but quantifying these impacts is difficult because many areas lack adequate reference data. We used a highly accurate, high‐resolution map of South African cropland to assess (1) the magnitude of error in several current generation land cover maps, and (2) how these errors propagate in downstream studies. We first quantified pixel‐wise errors in the cropland classes of four widely used land cover maps at resolutions ranging from 1 to 100 km, and then calculated errors in several representative "downstream" (map‐based) analyses, including assessments of vegetative carbon stocks, evapotranspiration, crop production, and household food security. We also evaluated maps' spatial accuracy based on how precisely they could be used to locate specific landscape features. We found that cropland maps can have substantial biases and poor accuracy at all resolutions (e.g., at 1 km resolution, up to ∼45% underestimates of cropland (bias) and nearly 50% mean absolute error (MAE, describing accuracy); at 100 km, up to 15% underestimates and nearly 20% MAE). National‐scale maps derived from higher‐resolution imagery were most accurate, followed by multi‐map fusion products. Constraining mapped values to match survey statistics may be effective at minimizing bias (provided the statistics are accurate). Errors in downstream analyses could be substantially amplified or muted, depending on the values ascribed to cropland‐adjacent covers (e.g., with forest as adjacent cover, carbon map error was 200%–500% greater than in input cropland maps, but ∼40% less for sparse cover types). The average locational error was 6 km (600%). These findings provide deeper insight into the causes and potential consequences of land cover map error, and suggest several recommendations for land cover map users. Abstract : Land cover (LC) maps are essential for studying social and environmental change, but map errors can confuse our understanding of such changes. The scarcity of ground‐truth data makes it difficult to measure how map errors influence our understanding. We used a unique map of South African cropland to measure errors in four land cover maps and how they impact studies based on them (e.g., carbon accounting). Errors in LC maps are large and under some circumstances lead to much bigger errors in "downstream" studies. Maps made from high‐resolution satellite imagery are the first choice for minimizing error.