Case-Specific Random Forests. Issue 1 (2nd January 2016)

• Record Type: Journal Article
• Authors: Xu, Ruo; Nettleton, Dan; Nordman, Daniel J.
• Is Part Of: Journal of computational and graphical statistics. Volume 25:Issue 1(2016)
• Page Start: 49
• Page End: 65
• Publication Date: 2016-01-02
• Subjects: Machine learning -- Prediction -- Variable importance; Mathematical statistics -- Data processing -- Periodicals; Mathematical statistics -- Graphic methods -- Periodicals; 519.50285
• DOI: 10.1080/10618600.2014.983641
• Languages: English
• ISSNs: 1061-8600

Abstract

Abstract : Random forest (RF) methodology is a nonparametric methodology for prediction problems. A standard way to use RFs includes generating a global RF to predict all test cases of interest. In this article, we propose growing different RFs specific to different test cases, namely case-specific random forests (CSRFs). In contrast to the bagging procedure in the building of standard RFs, the CSRF algorithm takes weighted bootstrap resamples to create individual trees, where we assign large weights to the training cases in close proximity to the test case of interest a priori. Tuning methods are discussed to avoid overfitting issues. Both simulation and real data examples show that the weighted bootstrap resampling used in CSRF construction can improve predictions for specific cases. We also propose a new case-specific variable importance (CSVI) measure as a way to compare the relative predictor variable importance for predicting a particular case. It is possible that the idea of building a predictor case-specifically can be generalized in other areas.