文献速递颅颌面外科

优化计算机自适应测试以可靠减轻CLEFT-Q实施负担:蒙特卡洛模拟研究

Optimising the computerised adaptive test to reliably reduce the burden of administering the CLEFT-Q: A Monte Carlo simulation study.
PubMed 文献 · J Plast Reconstr Aesthet Surg · 2020-12-14

该研究通过蒙特卡洛模拟优化CLEFT-Q计算机自适应测试(CAT)的评分估计与选题方法。结果显示CAT准确性不受方法选择显著影响,条目较多的子量表经CAT可更大程度减少条目数,推荐采用计算强度较低的技术。

要点

  • CLEFT-Q CAT准确性不受评分估计与选题方法选择的显著影响。
  • 原始条目较多的子量表经CAT可实现更大程度的条目缩减。
  • 推荐未来CLEFT-Q CAT研究使用计算强度较低的技术。

核心结论

  • 评分估计与选题方法选择不显著影响CLEFT-Q CAT准确性。
  • 低计算强度技术可用于CLEFT-Q CAT而不损害准确性。
  • 推荐未来CLEFT-Q CAT研究采用计算强度较低的技术。

研究设计与样本

  • 蒙特卡洛模拟研究,在R统计计算环境中使用模拟数据进行。
  • 模拟涵盖多种评分估计与选题技术。
  • 通过平均施测条目数、CAT评分与配对线性评估评分的相关性及均方根偏差(RMSD)评估性能与准确性。

主要发现

  • CLEFT-Q CAT的准确性不受评分估计或选题方法选择的显著影响。
  • 原始条目较多的子量表经CAT可实现更大程度的条目缩减。

临床怎么用

  • CLEFT-Q CAT可在基本硬件需求下快速高效施测。
  • 临床实施CLEFT-Q CAT时可选用计算强度较低的评分估计与选题方法。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Computerised adaptive testing (CAT) has the potential to transform plastic surgery outcome measurement by making patient-reported outcome measures (PROMs) shorter, individualised and more accurate than pen-and-paper questionnaires. OBJECTIVES: This paper reports the results of two optimisation studies for the CLEFT-Q CAT, a CAT intended for use in the field of cleft lip and/or palate. Specifically, we aimed to identify the optimal score estimation and item selection methods for using this CAT in clinical practice. These represent two major components of any CAT algorithm. METHOD: Monte Carlo simulations were performed using simulated data in the R statistical computing environment and incorporated a range of score estimation and item selection techniques. The performance and accuracy of the CAT was assessed by mean items administered, correlation between CAT scores and paired linear assessment scores, and the root mean squared deviation (RMSD) of these score pairs. RESULTS: The accuracy of the CLEFT-Q CAT was not significantly affected by the choice of score estimation or item selection method. Sub-scales which originally contain more items were amenable to greater item reduction with CAT. CONCLUSION: This study shows that score estimation and item selection methods that need minimal processing power can be used in the CLEFT-Q CAT without compromising accuracy. This means that the CLEFT-Q CAT could be administered quickly and efficiently with basic hardware demands. We recommend the use of less computationally intensive techniques in future CLEFT-Q CAT studies.

来源:J Plast Reconstr Aesthet Surg,查看原文。版权归原作者所有。

引用

  1. Harrison CJ, Rodrigues JN, Furniss D, et al. Optimising the computerised adaptive test to reliably reduce the burden of administering the CLEFT-Q: A Monte Carlo simulation study. J Plast Reconstr Aesthet Surg. 2020. PMID: 33376081. doi:10.1016/j.bjps.2020.12.029

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。