自主人工智能发展过程中的经验教训:寻找安全、有效且合乎伦理的路径
本文通过文献综述生物伦理原则,推导出自主AI的评估规则,涵盖患者结局、验证、参考标准、设计、数据使用和医疗责任问责。应用这些规则解释了FDA首次de novo授权自主糖尿病视网膜病变检查系统的成功案例。医生需理解自主AI的潜在风险与获益、设计、安全性、有效性、公平性、验证及数据获取方式。
要点
- 自主AI指无需人类监督即可做出临床决策的系统,需严格验证。
- 评估规则基于生物伦理原则,涵盖结局、验证、设计、数据与问责。
- 医生应掌握自主AI的风险、获益、验证与责任归属。
核心结论
- 自主AI有望改善医疗可及性、准确性和成本,但需从生物伦理与问责角度评估其对患者结局、设计、验证、数据使用和责任的影响。
研究设计与样本
- 本文为文献综述,基于生物伦理原则推导自主AI的评估规则。
主要发现
- 推导出的评估规则包括患者结局、验证、参考标准、设计、数据使用和医疗责任问责。
- 应用这些规则解释了FDA首次de novo授权自主糖尿病视网膜病变检查系统的成功案例,该授权基于预注册临床试验。
关键数值与推荐
- 评估规则涵盖患者结局、验证、参考标准、设计、数据使用和医疗责任问责。
临床怎么用
- 医生需胜任理解自主AI的潜在风险与获益、设计、安全性、有效性、公平性、验证、责任及数据获取方式。
- 本文引入的自主AI评估规则可帮助医生理解自主AI对患者的局限、风险及潜在获益。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
Artificial intelligence (AI) describes systems capable of making decisions of high cognitive complexity; autonomous AI systems in healthcare are AI systems that make clinical decisions without human oversight. Such rigorously validated medical diagnostic AI systems hold great promise for improving access to care, increasing accuracy, and lowering cost, while enabling specialist physicians to provide the greatest value by managing and treating patients whose outcomes can be improved. Ensuring that autonomous AI provides these benefits requires evaluation of the autonomous AI's effect on patient outcome, design, validation, data usage, and accountability, from a bioethics and accountability perspective. We performed a literature review of bioethical principles for AI, and derived evaluation rules for autonomous AI, grounded in bioethical principles. The rules include patient outcome, validation, reference standard, design, data usage, and accountability for medical liability. Application of the rules explains successful US Food and Drug Administration (FDA) de novo authorization of an example, the first autonomous point-of-care diabetic retinopathy examination de novo authorized by the FDA, after a preregistered clinical trial. Physicians need to become competent in understanding the potential risks and benefits of autonomous AI, and understand its design, safety, efficacy and equity, validation, and liability, as well as how its data were obtained. The autonomous AI evaluation rules introduced here can help physicians understand limitations and risks as well as the potential benefits of autonomous AI for their patients.
引用
- Abràmoff MD, Tobey D, Char DS, et al. Lessons Learned About Autonomous AI: Finding a Safe, Efficacious, and Ethical Path Through the Development Process. Am J Ophthalmol. 2020. PMID: 32171769. doi:10.1016/j.ajo.2020.02.022
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。