Cognitive instabilities under contention, friction, and the fog-of-war challenge the AI revolution. Issue 3 (2nd July 2020)

• Record Type: Journal Article
• Authors: Wallace, Rodrick
• Is Part Of: Connection science. Volume 32:Issue 3(2020)
• Page Start: 264
• Page End: 279
• Publication Date: 2020-07-02
• Subjects: Artificial intelligence -- Clausewitz -- conflict -- information theory -- punctuated equilibrium -- rate-distortion theorem -- symmetry breaking; Neural computers -- Periodicals; Artificial intelligence -- Periodicals; Cognitive science -- Periodicals; Connectionism -- Periodicals; 006.3
• DOI: 10.1080/09540091.2019.1684441
• Languages: English
• ISSNs: 0954-0091

Abstract

Abstract : The asymptotic limit theorems of information theory, and related formalism from punctuated equilibrium evolutionary theory, allow exploration of the dynamics of real-time, multi-component, hierarchical, cognitive enterprises – institutional, machine, or man/machine hybrid – under constraints of time, material resources, internal communication, situational awareness, and adversarial intent. Surprisingly direct argument shows such enterprises can almost always be confounded by an opponent with comparatively limited resources, provided it has sufficient situational understanding, adaptive capacity, and resolve. Consequently, there can be no free lunch for AI combat systems, driverless cars on intelligent roads, or other such entities, tasked with the control of real-time critical processes. Intelligent adversaries, resource limitations, "design flaws", inattentional blindness, command stupidity, coevolutionary dynamics, and the like confront all real-time, multi-component cognitive processes. AI systems will not be spared simply by being labelled "high tech" in marketing campaigns.