Cleaton, N, Yeates, P and McCrae, G (2018) Exploring the Relationship between Examiners’ Memories for performances, domain separation and score variability. Medical Teacher, 40 (11). pp. 1159-1165. ISSN 0142-159X

[thumbnail of Archived manuscript Remembering to differentiate.docx] Text
Archived manuscript Remembering to differentiate.docx - Accepted Version
Available under License Creative Commons Attribution Non-commercial.

Download (96kB)


Background: OSCE examiners' scores are variable and may discriminate domains of performance poorly. Examiners must hold their observations of OSCE performances in "episodic memory" until performances end. We investigated whether examiners vary in their recollection of performances; and whether this relates to their score variability or ability to separate disparate performance domains. Methods: Secondary analysis was performed on data where examiners had: 1/scored videos of OSCE performances showing disparate student ability in different domains; and 2/performed a measure of recollection for an OSCE performance. We calculated measures of "overall-score variance" (the degree individual examiners' overall scores varied from the group mean) and "domain separation" (the degree to which examiners separated different performance domains). We related these variables to the measure of examiners' recollection. Results: Examiners varied considerably in their recollection accuracy (recognition beyond chance -5% to +75% for different examiners). Examiners' recollection accuracy was weakly inversely related to their overall score accuracy (R = -0.17, p < 0.001) and related to their ability to separate domains of performance (R = 0.25, p < 0.001). Conclusions: Examiners vary substantially in their memories for students' performances which may offer a useful point of difference to study processing and integration phases of judgment. Findings could have implication for the utility of feedback.

Item Type: Article
Additional Information: This is an Accepted Manuscript of an article published by Taylor & Francis in Medical Teacher on 27 April 2018, available online:
Subjects: R Medicine > R Medicine (General)
R Medicine > R Medicine (General) > R735 Medical education. Medical schools. Research
Divisions: Faculty of Medicine and Health Sciences > Primary Care Health Sciences
Depositing User: Symplectic
Date Deposited: 12 Apr 2018 08:20
Last Modified: 27 Apr 2019 01:30

Actions (login required)

View Item
View Item