全腹腔镜子宫切除术手术室操作评估:H-OSATS评分量表的效度证据
本研究在法国两家学术医院对新手、中级和资深外科医生进行的全腹腔镜子宫切除术(LH)及输卵管卵巢切除术的7项任务进行视频记录,由两名评估者盲法使用H-OSATS量表评分。结果显示,膀胱瓣创建、阴道切开和阴道残端缝合三项任务具有良好效度证据,组间总分差异有意义,信度>0.7,通过/不通过分数的理论假阳性率<10%。
要点
- H-OSATS量表对LH的7项任务效度证据不一,仅3项任务效度良好。
- 膀胱瓣创建、阴道切开和阴道残端缝合在三个经验组间总分差异有意义。
- 上述3项任务信度>0.7,通过/不通过分数理论假阳性率<10%。
核心结论
- H-OSATS量表对LH的7项任务效度证据不同,其中膀胱瓣创建、阴道切开和阴道残端缝合三项任务效度良好。
研究设计与样本
- 观察性队列研究,在法国马赛和蒙彼利埃两家学术医院进行,对新手、中级和资深外科医生在简单病例中实时表演LH的视频进行评分,每组获得十余个未剪辑视频,涵盖7项任务。
主要发现
- 膀胱瓣创建、阴道切开和阴道残端缝合三项任务在三个经验组间总分差异有意义,中级与资深外科医生间也有差异。
- 上述三项任务的信度结果>0.7,通过/不通过分数的理论假阳性率<10%。
- 其他任务更符合低风险的形成性评估标准。
关键数值与推荐
- 三项任务(膀胱瓣创建、阴道切开、阴道残端缝合)的通过/不通过分数采用对比组方法设定,理论假阳性率<10%。
- 信度结果>0.7。
临床怎么用
- H-OSATS量表可用于评估LH中膀胱瓣创建、阴道切开和阴道残端缝合的技术技能,尤其适用于对资深外科医生的评估。
- 其他任务更适合用于低风险的形成性评估。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
STUDY OBJECTIVE: The technical conduct of total laparoscopic hysterectomy (LH) is critical to surgical outcomes. This study explored the validity evidence of an objective scale specific to the assessment of technical skills (H-OSATS) for 7 tasks of an LH with salpingo-oophorectomy procedure performed in the operating room. DESIGN: Observational cohort study. SETTING: Two academic hospitals in Marseille and Montpellier, France. PATIENTS: Three groups of operators (novice, intermediate, and experienced surgeons) were video recorded during their live performances of LH on a simple case. For each group, a dozen unedited videos were obtained for the following tasks: division of the round ligament, division of the infundibulopelvic ligament, creation of the bladder flap, opening of the posterior peritoneum, division of the uterine vessels, colpotomy, and closure of the vault. INTERVENTIONS: Two qualified raters blindly assessed each video using the H-OSATS rating scale. Inter-rater reliability and test-retest reliability were calculated as measures of internal structure. In a separate round of evaluations, the raters provided a global competent/noncompetent decision for each performance. As a measure of consequential validity, a pass/fail score was set for each task using the contrasting group method. MEASUREMENTS AND MAIN RESULTS: Three tasks (creation of the bladder flap, colpotomy, and closure of the vault) displayed sound validity evidence: a meaningful total score difference among the 3 groups of experience as well as between the intermediate and experienced surgeons, reliability outcomes of >0.7, and a pass/fail score with a theoretical false-positive rate of <10%. CONCLUSION: The validity evidence of the H-OSATS rating scale differed for separate evaluations of the 7 tasks. Three tasks (i.e., creation of the bladder flap, colpotomy, and closure of the vault) revealed sound validity evidence, including at the level of the attending surgeon, whereas other tasks were more consistent with low-stakes formative evaluation standards.
引用
- Crochet P, Netter A, Schmitt A, et al. Performance Assessment for Total Laparoscopic Hysterectomy in the Operating Room: Validity Evidence of a Procedure-specific Rating Scale. J Minim Invasive Gynecol. 2021. PMID: 33621693. doi:10.1016/j.jmig.2021.02.013
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。