A survey of knowledge‐based sequential decision‐making under uncertainty. Issue 2 (23rd June 2022)

• Record Type: Journal Article
• Authors: Zhang, Shiqi; Sridharan, Mohan
• Is Part Of: AI magazine. Volume 43:Issue 2 (2022)
• Page Start: 249
• Page End: 266
• Publication Date: 2022-06-23
• Subjects: Artificial intelligence -- Periodicals; Artificial intelligence -- Computer programs -- Periodicals; System design -- Periodicals; Artificial intelligence -- Technological innovations -- Periodicals; Artificial intelligence -- Industrial applications -- Periodicals; Artificial intelligence -- Educational applications -- Periodicals; Intelligence artificielle -- Périodiques; Intelligence artificielle -- Logiciels -- Périodiques; Conception de systèmes -- Périodiques; Intelligence artificielle -- Innovations -- Périodiques; Intelligence artificielle -- Applications industrielles -- Périodiques; Intelligence artificielle -- Applications en éducation -- Périodiques; Artificial intelligence; Artificial intelligence -- Computer programs; Artificial intelligence -- Educational applications; Artificial intelligence -- Industrial applications; System design; Kunstmatige intelligentie; Electronic journals; Periodicals; Periodicals; 006.305
• DOI: 10.1002/aaai.12053
• Languages: English
• ISSNs: 0738-4602

Abstract

Abstract: Reasoning with declarative knowledge (RDK) and sequential decision‐making (SDM) are two key research areas in artificial intelligence. RDK methods reason with declarative domain knowledge, including commonsense knowledge, that is either provided a priori or acquired over time, while SDM methods (probabilistic planning [PP] and reinforcement learning [RL]) seek to compute action policies that maximize the expected cumulative utility over a time horizon; both classes of methods reason in the presence of uncertainty. Despite the rich literature in these two areas, researchers have not fully explored their complementary strengths. In this paper, we survey algorithms that leverage RDK methods while making sequential decisions under uncertainty. We discuss significant developments, open problems, and directions for future work.