指南与共识儿科与产科急症

共识评分作为发展评价性判断的评分方法:评估者与学生比较

Consensus marking as a grading method for the development of evaluative judgement: Comparing assessor and students.
指南 / 共识 · Nurse Educ Pract · 2022-06-23
一句话结论在研究生急诊护理在线口试中,共识评分较传统评估者评分显著降低学生焦虑(p<0.001)并提高满意度(p<0.01)。

本研究探讨研究生护理学生对在线口试创新评分方法「共识评分」的感知、焦虑和满意度,并与传统评估者判断比较。采用收敛混合方法平行研究设计,学生完成两次在线口试,一次用传统评估者判断,另一次用共识评分(双向反馈对话,学生有机会与评估者一起评自己的作业)。46名参与者(82%)有两次测试的完整焦虑和满意度数据纳入分析,其中13人参加后续访谈。结果:共识评分前学生焦虑显著低于评估者判断口试(p<0.001),学生对共识评分满意度显著更高(p<0.01)。作者认为共识评分通过反思和自我评价为学生提供了识别知识缺陷的机会,对护理教育中新评分方法的开发与应用有启示。

要点

  • 46名研究生急诊护理学生有两次在线口试的完整焦虑和满意度数据(82%),其中13人参加后续访谈。
  • 共识评分前学生焦虑显著低于传统评估者判断口试(p<0.001)。
  • 学生对共识评分的满意度显著高于传统评估者判断(p<0.01)。
  • 学生认为共识评分中自我评价和与评估者讨论成绩的能力层级感更低,类似同侪汇报。
  • 作者认为共识评分通过反思和自我评价让学生在外评前识别知识缺陷。

适用人群与场景

  • 入组研究生急诊护理单元课程的学生,完成两次在线口试。
  • 46名参与者有两次测试的完整焦虑和满意度数据(82%)纳入分析,其中13人参加后续访谈。

处置流程与药物剂量

  • 共识评分涉及双向反馈对话,学生有机会与评估者一起主动参与给自己的作业评分。

研究设计与关键结果

  • 采用收敛混合方法平行研究设计,学生完成两次在线口试:一次用传统评估者判断,另一次用共识评分。
  • 通过半结构化访谈探讨学生对每种评分方法的感知,访谈数据采用六阶段主题分析法分析。
  • 每次口试前后使用有效且可靠的问卷测量学生焦虑和满意度,非参数分析探讨两种评分方法间焦虑和满意度的差异,α设为0.05。
  • 46名参与者有两次测试的完整焦虑和满意度数据(82%)纳入分析,其中13人参加后续访谈。
  • 学生认为共识评分中自我评价和与评估者讨论成绩的能力层级感更低,类似同侪汇报。
  • 共识评分前学生焦虑显著低于评估者判断口试(p<0.001)。
  • 学生对共识评分的满意度显著高于评估者判断(p<0.01)。

证据类型、等级与局限

  • 证据类型:收敛混合方法平行研究设计(定性访谈+定量问卷)。
  • 局限:原文未报告局限性。

对床旁实践的改变

  • 作者认为共识评分通过反思和自我评价让学生在外评前识别知识缺陷,学生满意度更高、焦虑更低。
  • 作者认为这些发现对护理教育中新评分方法的开发与应用有启示,以促进评价性判断的发展。

提炼说明

  • 本条依据论文摘要整理;摘要未涉及「诊断标准与关键阈值」「红旗征与不能漏的情况」「指南或共识出处」,故未列出这些栏目;全文请点「阅读原文」。
英文原文(摘要)· 点击展开

AIM: This study explored postgraduate nursing students' perceptions, anxiety and satisfaction of an innovative and novel grading method for online vivas, consensus marking, compared with traditional assessor judgement.

BACKGROUND: Reflection, self-evaluation and feedback conversations have the potential to develop nursing students' evaluative judgement. Consensus marking is a novel method of grading students' performance that supports students to reflect, self-evaluate and grade their own work. Active engagement in a feedback dialogue supports students to calibrate their self-evaluation to the required standard in a grade negotiation. Through this approach, students are supported to develop evaluative judgement and lifelong learning skills.

DESIGN: A convergent mixed-methods parallel research design was used.

METHODS: Students enrolled in a postgraduate emergency nursing unit of study completed two online viva assessments. One viva was graded using traditional assessor judgement and the other used consensus marking, involving a two-way feedback dialogue, where students had an opportunity to actively engage in grading their own work with the assessor. Student perceptions of each grading method were explored through semi-structured interviews. Interview data were analysed thematically using a six-stage approach. Student anxiety and satisfaction were measured pre- and post each viva using valid and reliable questionnaires. Non-parametric analyses explored differences in anxiety and satisfaction between the two grading methods. Alpha was set at 0.05.

RESULTS: Forty-six participants had complete data for anxiety and satisfaction across both test occasions (82%) and were included in the analysis. Of these, 13 students participated in follow up interviews. Students perceived that the ability to self-evaluate performance and discuss their grade with the assessor using consensus marking was less hierarchical and similar to a collegial debrief. Student anxiety was significantly lower prior to consensus marking compared with the assessor judged viva (p < 0.001). Students were significantly more satisfied with consensus marking compared with assessor judgement (p < 0.01).

CONCLUSIONS: Consensus marking created an opportunity for students to identify knowledge deficits through reflection and self-evaluation of their own performance prior to external judgement. Students were more satisfied and less anxious with the consensus marking grading method compared with traditional assessor judgement. These findings have implications for the development and application of new grading methods in nursing education to facilitate the development of evaluative judgement.

来源:Nurse Educ Pract,查看原文。版权归原作者所有。

参考来源

  1. Henderson B, Chipchase L, Aitken R, et al. Consensus marking as a grading method for the development of evaluative judgement: Comparing assessor and students. Nurse Educ Pract. 2022. PMID: 35772306. doi:10.1016/j.nepr.2022.103386

供执业医师抢救与诊疗参考,不替代临床判断;剂量请结合体重、肝肾功能和本院药品规格复核,以指南原文为准。