Accountability, secrecy, and innovation in AI-enabled clinical decision software. Issue 1 (14th November 2020)

• Record Type: Journal Article
• Authors: Rai, Arti K; Sharma, Isha; Silcox, Christina
• Is Part Of: Journal of law and the biosciences. Volume 7:Issue 1(2020)
• Publication Date: 2020-11-14
• Subjects: machine learning -- clinical decision software -- accountability -- secrecy -- innovation -- intellectual property; Life sciences -- Law and legislation -- Periodicals; Science and law -- Periodicals; Law and biology -- Periodicals; Biotechnology -- Law and legislation -- Periodicals; Bioethics -- Periodicals; 344.0957
• DOI: 10.1093/jlb/lsaa077
• Languages: English
• ISSNs: 2053-9711

Abstract

Abstract: This article employs analytical and empirical tools to dissect the complex relationship between secrecy, accountability, and innovation incentives in clinical decision software enabled by machine learning (ML-CD). Although secrecy can provide incentives for innovation, it can also diminish the ability of third parties to adjudicate risk and benefit responsibly. Our first aim is descriptive. We address how the interrelated regimes of intellectual property law, Food and Drug Administration (FDA) regulation, and tort liability are currently shaping information flow and innovation incentives. We find that developers regard secrecy over training data and details of the trained model as central to competitive advantage. Meanwhile, neither FDA nor adopters are currently asking for these types of details. In addition, in some cases, it is not clear whether developers are being asked to provide rigorous evidence of performance. FDA, Congress, developers, and adopters could all do more to promote information flow, particularly as ML-CD models move into areas of higher risk. We provide specific suggestions for how FDA regulation, patent law, and tort liability could be tweaked to improve information flow without sacrificing innovation incentives.