Catherine Stephenson
Comparing the influence of ‘describing findings to the examiner’ or ‘examining as in usual practice’ on the students’ performance and assessors’ judgements during physical examination skills assessment
Stephenson, Catherine; Yeates, Peter; Lefroy, Janet
Abstract
Background:
Within assessment of physical examination skills, two approaches are common: “Describing Findings” (students comment throughout); and examining as “Usual Practice” (students only report findings at the end). Despite numerous potential influences on both students’ performances and assessors’ judgements, no prior studies have investigated the influence of either approach on assessments.
Methods:
Two group, randomised, crossover design. Within a 2-station simulated physical examination OSCE, we manipulated whether students “described findings” or examined as “usual practice”, collecting 1/. performance scores; 2/. Students’/examiners’ cognitive load ratings; ratings of the 3/. fluency and 4/. completeness of students’ presentations and 5/. Students’ task-finishing, comparing all 5 end-points across conditions.
Results:
Neither students’ performance scores nor examiners’ cognitive load were influenced by experimental condition. Students reported higher cognitive load (7/9) when “describing findings” than “usual practice” (6/9, p=0.002), and were less likely to finish (4 vs 12, p=0.007). Presentation completeness was higher for “describing findings” (mean=2.40, (95CIs=2.05-2.74)) than “usual practice” (mean=1.92 (1.65-2.18),p=0.016), whilst fluency ratings showed a similar trend.
Conclusions:
The decision to “Describe Findings” or examine as “Usual Practice” does not appear neutral, potentially influencing students’ efficiency, recall and (by inference) learning. Institutions should explicitly select one option based on assessment goals.
Acceptance Date | Jan 20, 2020 |
---|---|
Publication Date | Jan 21, 2020 |
Publicly Available Date | Jun 12, 2023 |
Journal | MedEdPublish |
Print ISSN | 2312-7996 |
Publisher | Taylor and Francis |
DOI | https://doi.org/10.15694/mep.2020.000018.1 |
Keywords | influence, examiner, practice, physical exercise, |
Publisher URL | https://doi.org/10.15694/mep.2020.000018.1 |
Files
MededPublish - 2718.pdf
(252 Kb)
PDF
Publisher Licence URL
https://creativecommons.org/licenses/by-sa/4.0/
MededPublish - 2718.pdf
(252 Kb)
PDF
Publisher Licence URL
https://creativecommons.org/licenses/by-sa/4.0/
MededPublish - 2718.pdf
(252 Kb)
PDF
Publisher Licence URL
https://creativecommons.org/licenses/by-sa/4.0/
You might also like
Technology enhanced assessment: Ottawa consensus statement and recommendations.
(2022)
Journal Article
In Reply to Anto et al
(2022)
Journal Article
The influence of candidates' physical attributes on assessors' ratings in clinical practice.
(2021)
Journal Article
Understanding and developing procedures for video-based assessment in medical education
(2020)
Journal Article
Downloadable Citations
About Keele Repository
Administrator e-mail: research.openaccess@keele.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search