人工智能能否替代人工检索系统文献?原发干燥综合征皮肤表现综述
该综述比较了人工检索与人工智能软件BIBOT检索原发干燥综合征皮肤表现文献的效果,并评估皮肤表现患病率。人工检索获855篇、BIBOT获1042篇,经排除标准后共202篇纳入,两种方法一致性κ=0.84。最终发现52种皮肤表现,最常见为皮肤血管炎、干燥症和环形红斑。
要点
- BIBOT检索速度更快且能自动分类文章,与人工检索一致性κ=0.84。
- 两种方法共同检出155/202篇(77%),联合检索可获得最多文献。
- 原发干燥综合征报告52种皮肤表现,常见为皮肤血管炎、干燥症和环形红斑。
核心结论
- 在202篇最终入选文献中,155篇(77%)被两种方法共同检出,BIBOT更快且能自动分类文章,联合两种方法可检索到最多文献。
研究设计与样本
- 比较人工检索与内部计算机软件BIbliography BOT(BIBOT)检索,针对原发干燥综合征皮肤表现这一复杂主题进行系统文献综述。
- 通过计算Cohen's κ系数评估可重复性,κ值解释标准为:轻微0-0.20、一般0.21-0.40、中等0.41-0.60、显著0.61-0.80、几乎完美0.81-1。
主要发现
- 人工检索获得855篇文章,BIBOT获得1042篇文章。
- 应用排除标准后共选择202篇文章,其中155篇由两种方法共同检索到,33篇仅人工检索到,14篇仅BIBOT检索到。
- 可靠性κ=0.84,为几乎完美的一致性。
- 共发现原发干燥综合征患者报告52种皮肤表现。
- 描述最多的皮肤表现为皮肤血管炎(561例患者)、干燥症(651例患者)和环形红斑(215例患者)。
临床怎么用
- 临床文献检索中可考虑联合使用人工智能软件BIBOT与人工检索,以提高查全率并利用自动分类功能。
局限性
- 各出版物的队列规模以及皮肤表现的性质和患病率存在差异。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: Manual systematic literature reviews are becoming increasingly challenging due to the sharp rise in publications. The primary objective of this literature review was to compare manual and computer software using artificial intelligence retrieval of publications on the cutaneous manifestations of primary SS, but we also evaluated the prevalence of cutaneous manifestations in primary SS. METHODS: We compared manual searching and searching with the in-house computer software BIbliography BOT (BIBOT) designed for article retrieval and analysis. Both methods were used for a systematic literature review on a complex topic, i.e. the cutaneous manifestations of primary SS. Reproducibility was estimated by computing Cohen's κ coefficients and was interpreted as follows: slight, 0-0.20; fair, 0.21-0.40; moderate, 0.41-0.60; substantial, 0.61-0.80; and almost perfect, 0.81-1. RESULTS: The manual search retrieved 855 articles and BIBOT 1042 articles. In all, 202 articles were then selected by applying exclusion criteria. Among them, 155 were retrieved by both methods, 33 by manual search only, and 14 by BIBOT only. Reliability (κ = 0.84) was almost perfect. Further selection was performed by reading the 202 articles. Cohort sizes and the nature and prevalence of cutaneous manifestations varied across publications. In all, we found 52 cutaneous manifestations reported in primary SS patients. The most described ones were cutaneous vasculitis (561 patients), xerosis (651 patients) and annular erythema (215 patients). CONCLUSION: Among the final selection of 202 articles, 155/202 (77%) were found by the two methods but BIBOT was faster and automatically classified the articles in a chart. Combining the two methods retrieved the largest number of publications.
引用
- Orgeolet L, Foulquier N, Misery L, et al. Can artificial intelligence replace manual search for systematic literature? Review on cutaneous manifestations in primary Sjögren's syndrome. Rheumatology (Oxford). 2020. PMID: 31504928. doi:10.1093/rheumatology/kez370
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。