The challenges for artificial intelligence and systems engineering. Issue 1 (31st December 2022)

• Record Type: Journal Article
• Authors: Vanderlinde, Jake; Robinson, Kevin; Mashford, Benjamin
• Is Part Of: Australian journal of multi-disciplinary engineering. Volume 18:Issue 1(2022)
• Page Start: 47
• Page End: 53
• Publication Date: 2022-12-31
• Subjects: Artificial intelligence -- system assurance -- Autonomous Systems -- System Engineering; Engineering -- Periodicals; Engineering -- Australia -- Periodicals; 620.005
• DOI: 10.1080/14488388.2022.2044607
• Languages: English
• ISSNs: 1448-8388

Abstract

ABSTRACT: Artificial Intelligence (AI) has the potential to offer huge improvements both to the performance and the efficiency of systems. When engineering any system, it is important to ensure that the user of the system can be confident that the behaviour and performance of that system is as needed. AI presents challenges to achieveing this confidence when introduced into a system. This paper broadly considers these challenges, including the new failure modes exhibited by AI, the unpredictable and evolving behaviour of AI systems and the inability to explicitly validate due the level of trust in the systems and its robustness to future environments. Traditional system assurance techniques have proved ineffective to address these challenges. The paper then looks at potential solutions that are currently being developed that have the potential to address this need and assist in the assurance of the performance of AI enabled systems throughout their lifecycle.