Feedback after OSCE: A comparison of face to face versus an enhanced written feedback

Abstract Background The Objective Structured Clinical Exam (OSCE) is a useful means of generating meaningful feedback. OSCE feedback may be in various forms (written, face to face and audio or video recordings). Studies on OSCE feedback are uncommon, especially involving Asian medical students. Meth...

Full description

Bibliographic Details
Main Authors: Chin Fang Ngim, Paul Douglas Fullerton, Vanassa Ratnasingam, Valliammai Jayanthi Thirunavuk Arasoo, Nisha Angela Dominic, Cindy Pei Sze Niap, Sivakumar Thurairajasingam
Format: Article
Language:English
Published: BMC 2021-03-01
Series:BMC Medical Education
Subjects:
Online Access:https://doi.org/10.1186/s12909-021-02585-z
id doaj-50bbb55490f748b5aaf86b56c9ce3445
record_format Article
spelling doaj-50bbb55490f748b5aaf86b56c9ce34452021-03-28T11:09:56ZengBMCBMC Medical Education1472-69202021-03-012111910.1186/s12909-021-02585-zFeedback after OSCE: A comparison of face to face versus an enhanced written feedbackChin Fang Ngim0Paul Douglas Fullerton1Vanassa Ratnasingam2Valliammai Jayanthi Thirunavuk Arasoo3Nisha Angela Dominic4Cindy Pei Sze Niap5Sivakumar Thurairajasingam6Jeffrey Cheah School of Medicine and Health Sciences, Monash UniversityJeffrey Cheah School of Medicine and Health Sciences, Monash UniversityJeffrey Cheah School of Medicine and Health Sciences, Monash UniversityJeffrey Cheah School of Medicine and Health Sciences, Monash UniversityJeffrey Cheah School of Medicine and Health Sciences, Monash UniversityJeffrey Cheah School of Medicine and Health Sciences, Monash UniversityJeffrey Cheah School of Medicine and Health Sciences, Monash UniversityAbstract Background The Objective Structured Clinical Exam (OSCE) is a useful means of generating meaningful feedback. OSCE feedback may be in various forms (written, face to face and audio or video recordings). Studies on OSCE feedback are uncommon, especially involving Asian medical students. Methods We compared two methods of OSCE feedback delivered to fourth year medical students in Malaysia: (i) Face to face (FTF) immediate feedback (semester one) (ii) Individualised enhanced written (EW) feedback containing detailed scores in each domain, examiners’ free text comments and the marking rubric (semester two). Both methods were evaluated by students and staff examiners, and students’ responses were compared against their OSCE performance. Results Of the 116 students who sat for both formative OSCEs, 82.8% (n=96) and 86.2% (n=100) responded to the first and second survey respectively. Most students were comfortable to receive feedback (91.3% in FTF, 96% in EW) with EW feedback associated with higher comfort levels (p=0.022). Distress affected a small number with no differences between either method (13.5% in FTF, 10% in EW, p=0.316). Most students perceived both types of feedback improved their performance (89.6% in FTF, 95% in EW); this perception was significantly stronger for EW feedback (p=0.008). Students who preferred EW feedback had lower OSCE scores compared to those preferring FTF feedback (mean scores ± SD: 43.8 ± 5.3 in EW, 47.2 ± 6.5 in FTF, p=0.049). Students ranked the “marking rubric” to be the most valuable aspect of the EW feedback. Tutors felt both methods of feedback were equally beneficial. Few examiners felt they needed training (21.4% in FTF, 15% in EW) but students perceived this need for tutors’ training differently (53.1% in FTF, 46% in EW) Conclusion Whilst both methods of OSCE feedback were highly valued, students preferred to receive EW feedback and felt it was more beneficial. Learning cultures of Malaysian students may have influenced this view. Information provided in EW feedback should be tailored accordingly to provide meaningful feedback in OSCE exams.https://doi.org/10.1186/s12909-021-02585-zAssessmentOSCEfeedbackwrittenface to faceculture
collection DOAJ
language English
format Article
sources DOAJ
author Chin Fang Ngim
Paul Douglas Fullerton
Vanassa Ratnasingam
Valliammai Jayanthi Thirunavuk Arasoo
Nisha Angela Dominic
Cindy Pei Sze Niap
Sivakumar Thurairajasingam
spellingShingle Chin Fang Ngim
Paul Douglas Fullerton
Vanassa Ratnasingam
Valliammai Jayanthi Thirunavuk Arasoo
Nisha Angela Dominic
Cindy Pei Sze Niap
Sivakumar Thurairajasingam
Feedback after OSCE: A comparison of face to face versus an enhanced written feedback
BMC Medical Education
Assessment
OSCE
feedback
written
face to face
culture
author_facet Chin Fang Ngim
Paul Douglas Fullerton
Vanassa Ratnasingam
Valliammai Jayanthi Thirunavuk Arasoo
Nisha Angela Dominic
Cindy Pei Sze Niap
Sivakumar Thurairajasingam
author_sort Chin Fang Ngim
title Feedback after OSCE: A comparison of face to face versus an enhanced written feedback
title_short Feedback after OSCE: A comparison of face to face versus an enhanced written feedback
title_full Feedback after OSCE: A comparison of face to face versus an enhanced written feedback
title_fullStr Feedback after OSCE: A comparison of face to face versus an enhanced written feedback
title_full_unstemmed Feedback after OSCE: A comparison of face to face versus an enhanced written feedback
title_sort feedback after osce: a comparison of face to face versus an enhanced written feedback
publisher BMC
series BMC Medical Education
issn 1472-6920
publishDate 2021-03-01
description Abstract Background The Objective Structured Clinical Exam (OSCE) is a useful means of generating meaningful feedback. OSCE feedback may be in various forms (written, face to face and audio or video recordings). Studies on OSCE feedback are uncommon, especially involving Asian medical students. Methods We compared two methods of OSCE feedback delivered to fourth year medical students in Malaysia: (i) Face to face (FTF) immediate feedback (semester one) (ii) Individualised enhanced written (EW) feedback containing detailed scores in each domain, examiners’ free text comments and the marking rubric (semester two). Both methods were evaluated by students and staff examiners, and students’ responses were compared against their OSCE performance. Results Of the 116 students who sat for both formative OSCEs, 82.8% (n=96) and 86.2% (n=100) responded to the first and second survey respectively. Most students were comfortable to receive feedback (91.3% in FTF, 96% in EW) with EW feedback associated with higher comfort levels (p=0.022). Distress affected a small number with no differences between either method (13.5% in FTF, 10% in EW, p=0.316). Most students perceived both types of feedback improved their performance (89.6% in FTF, 95% in EW); this perception was significantly stronger for EW feedback (p=0.008). Students who preferred EW feedback had lower OSCE scores compared to those preferring FTF feedback (mean scores ± SD: 43.8 ± 5.3 in EW, 47.2 ± 6.5 in FTF, p=0.049). Students ranked the “marking rubric” to be the most valuable aspect of the EW feedback. Tutors felt both methods of feedback were equally beneficial. Few examiners felt they needed training (21.4% in FTF, 15% in EW) but students perceived this need for tutors’ training differently (53.1% in FTF, 46% in EW) Conclusion Whilst both methods of OSCE feedback were highly valued, students preferred to receive EW feedback and felt it was more beneficial. Learning cultures of Malaysian students may have influenced this view. Information provided in EW feedback should be tailored accordingly to provide meaningful feedback in OSCE exams.
topic Assessment
OSCE
feedback
written
face to face
culture
url https://doi.org/10.1186/s12909-021-02585-z
work_keys_str_mv AT chinfangngim feedbackafterosceacomparisonoffacetofaceversusanenhancedwrittenfeedback
AT pauldouglasfullerton feedbackafterosceacomparisonoffacetofaceversusanenhancedwrittenfeedback
AT vanassaratnasingam feedbackafterosceacomparisonoffacetofaceversusanenhancedwrittenfeedback
AT valliammaijayanthithirunavukarasoo feedbackafterosceacomparisonoffacetofaceversusanenhancedwrittenfeedback
AT nishaangeladominic feedbackafterosceacomparisonoffacetofaceversusanenhancedwrittenfeedback
AT cindypeiszeniap feedbackafterosceacomparisonoffacetofaceversusanenhancedwrittenfeedback
AT sivakumarthurairajasingam feedbackafterosceacomparisonoffacetofaceversusanenhancedwrittenfeedback
_version_ 1724200359563362304