Universal predictive systems. (June 2022)

• Record Type: Journal Article
• Authors: Vovk, Vladimir
• Is Part Of: Pattern recognition. Volume 126(2022)
• Publication Date: 2022-06
• Subjects: Conformal prediction -- Predictive distribution -- Probabilistic calibration -- Universal consistency; 68Q32 -- 62G20 -- 68M20 -- 68T05; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2022.108536
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: The paper constructs a universally consistent conformal predictive system. Being a conformal predictive system, it is automatically probabilistically calibrated. It also constructs a simpler universally consistent probability forecasting system. Abstract: This paper describes probability forecasting systems that are universal, or universally consistent, in the sense of being consistent under any data-generating distribution, assuming that the observations are produced independently in the IID fashion. The notion of universal consistency is asymptotic and does not imply any small-sample guarantees of validity. On the other hand, the method of conformal prediction has been recently adapted to producing predictive distributions that satisfy a natural property of small-sample validity, namely they are automatically probabilistically calibrated. The main result of the paper is the existence of universal conformal predictive systems, which output predictive distributions that are both probabilistically calibrated and universally consistent.