Comparison between geostatistical and machine learning models as predictors of topsoil organic carbon with a focus on local uncertainty estimation. (June 2019)

• Record Type: Journal Article
• Authors: Veronesi, Fabio; Schillaci, Calogero
• Is Part Of: Ecological indicators. Volume 101(2019)
• Page Start: 1032
• Page End: 1044
• Publication Date: 2019-06
• Subjects: Boosted regression trees -- Digital soil mapping -- Machine learning -- Kriging -- Local uncertainty -- Random forest -- Regression kriging; Environmental monitoring -- Periodicals; Environmental management -- Periodicals; Environmental impact analysis -- Periodicals; Environmental risk assessment -- Periodicals; Sustainable development -- Periodicals; 333.71405
• DOI: 10.1016/j.ecolind.2019.02.026
• Languages: English
• ISSNs: 1470-160X

Abstract

Highlights: Kriging methods are the most accurate and RF provides reliable confidence intervals. BRT yielded less accurate but more precise confidence intervals. The local uncertainty must be mapped robustly or it will have little practical value. ML algorithms can be modified to compute the local uncertainty. Algorithms differ in their approaches to computing uncertainty, which should be considered. Abstract: In recent years, the environmental modeling community has moved away from kriging as the main mapping algorithm and embraced machine learning (ML) as the go-to method for spatial prediction. The drawback of this shift has been a gradual decline in the number of papers in which uncertainty is presented and mapped alongside estimates of the target variables because in some ML algorithms, computing the local uncertainty can be challenging. This drawback has been recently identified in the literature as one of the key areas in DSM where progress is most needed. The main objective of this work is to compare geostatistical techniques, ML methods and hybrid methods, e.g., regression kriging, in terms of not only their overall accuracy but also their precision in providing useful confidence intervals at unsampled locations. We aim to provide clear application guidelines for future mapping exercises. For this experiment, we used a legacy soil dataset (n = 414) of topsoil observations from the semi-arid Mediterranean region of Sicily. This dataset was collected in a 2008 survey with a pedo-landscape sampling design; hence, it is ideal for comparing geostatistics and ML. In the comparison, we included algorithms that have been widely adopted in the literature: ordinary and universal kriging, linear regression, random forest (RF), quantile regression forest, boosted regression trees (BRT) and hybrid forms of kriging (e.g., regression kriging with RF and BRT used as regressors). To evaluate the accuracy of each algorithm, a validation test that was based on the random exclusion of 25% of the samples was repeated 100 times. In addition, we performed a test of the transferability, in which the locations with the largest nearest-neighbor distances were excluded from training and re-predicted. The validation results demonstrate that ordinary and universal kriging are the best performers, followed closely by random forest (RF) and quantile regression forest (QRF). In terms of local uncertainty, RF and QRF provide confidence intervals that most often include the observed values of SOC. However, they both provide very wide confidence intervals, which may be problematic in some studies. Other algorithms, such as boosted regression trees and boosted regression kriging, performed slightly worse (on this dataset), but produced narrower ranges of uncertainty. Hence, they may be more attractive since their estimates are very robust against changes and noise in the predictors.