腹壁下动脉穿支皮瓣乳房再造相关视频内容质量:社交媒体平台与大型语言模型的比较
本研究从YouTube、Instagram和Facebook选取50个英文和西班牙文DIEP皮瓣相关视频,向ChatGPT和Google Bard各提出3个问题,由2名独立委员会认证整形外科医生用JAMA和DISCERN量表评估信息质量。LLMs的DISCERN评分显著高于SMPs,ChatGPT和Google Bard平均分别为54±6.841和61.17±6.306(质量良好);SMPs的JAMA和DISCERN平均分分别为2.31±0.67(质量不足)和32.87±9.62(质量低)。38%的SMPs视频由非医学作者制作。
要点
- LLMs提供的DIEP皮瓣乳房再造信息质量良好,DISCERN评分显著高于社交媒体平台。
- ChatGPT和Google Bard平均DISCERN评分分别为54±6.841和61.17±6.306(质量良好)。
- SMPs的JAMA和DISCERN平均分分别为2.31±0.67(质量不足)和32.87±9.62(质量低),38%视频由非医学作者制作。
核心结论
- LLMs提供的DIEP皮瓣乳房再造信息质量被认为良好,且显著优于SMPs。
- SMPs中的信息质量不足且质量低。
- 学术整形外科医生有机会在LLM和SMPs上提供此类再造的高质量内容。
研究设计与样本
- 从主要社交媒体平台(YouTube、Instagram和Facebook)以关键词「DIEP flap」和「colgajo DIEP」选取50个英文和西班牙文视频。
- 分析视频时长、点赞数、点踩数、访问次数、上传日期、作者及视频类别(机构视频、媒体、患者体验、学术和手术)。
- 向2个新LLMs(ChatGPT和Google Bard)各提出3个具体问题。
- 由2名独立委员会认证整形外科医生使用Journal of American Medical Association和DISCERN量表分析并比较SMPs与LLMs的信息质量。
主要发现
- 基于DISCERN评分,LLMs的信息质量显著高于SMPs。
- ChatGPT和Google Bard回答的平均DISCERN评分分别为54±6.841和61.17±6.306(质量良好)。
- SMPs的JAMA和DISCERN平均评分分别为2.31±0.67(质量不足)和32.87±9.62(质量低)。
- SMPs中38%的视频由非医学作者制作。
关键数值与推荐
- ChatGPT平均DISCERN评分54±6.841(质量良好)。
- Google Bard平均DISCERN评分61.17±6.306(质量良好)。
- SMPs平均JAMA评分2.31±0.67(质量不足)。
- SMPs平均DISCERN评分32.87±9.62(质量低)。
临床怎么用
- 学术整形外科医生有机会在LLM和SMPs上提供DIEP皮瓣乳房再造的高质量内容。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
INTRODUCTION: The deep inferior epigastric perforator (DIEP) flap is currently one of the main options in breast reconstruction. The information about this surgery is critical for the patient, in order to choose the breast reconstruction method. Our study aims to analyze and compare the quality and accuracy of the information related to the DIEP flap reconstruction method provided by social media platforms (SMPs) and the new large language models (LLMs). MATERIALS AND METHODS: A total of 50 videos in English and Spanish were selected from the main SMPs (YouTube, Instagram, and Facebook) using the keywords "DIEP flap" and "colgajo DIEP." The duration, number of likes, dislikes, number of visits, upload date, author, and the video category (institutional video, media, patient experience, academic, and surgery) were analyzed. 3 specific questions were asked to 2 new LLMs (ChatGPT and Google Bard). The quality of information in SMPs and LLMs was analyzed and compared by 2 independent board-certified plastic surgeons using the Journal of American Medical Association and DISCERN scales. RESULTS: LLMs showed a statistically significant higher quality of information when compared with SMPs based on the DISCERN scores. The average DISCERN scores for answers given by ChatGPT and Google Bard were 54 ± 6.841 and 61.17 ± 6.306, respectively (good quality). In SMPs, the average scores were 2.31 ± 0.67 (insufficient quality) and 32.87 ± 9.62 (low quality) for the Journal of American Medical Association and DISCERN scales respectively. Thirty-eight percent of the videos in SMPs were performed by nonmedical authors. CONCLUSIONS: The quality of information for breast reconstruction using DIEP flaps from LLMs was considered good and significantly better than in SMPs. The information found in SMPs was insufficient and of low quality. Academic plastic surgeons have an opportunity to provide quality content on this type of reconstruction in LLM and SMPs.
引用
- Viñuela Florido M, Suárez Aguilar J, Maldonado AA, et al. Quality of Video Content Related to Deep Inferior Epigastric Perforator Flap Breast Reconstruction: Social Media Platforms Versus Large Language Models. Ann Plast Surg. 2024. PMID: 39150845. doi:10.1097/SAP.0000000000004045
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。