Professionalism Milestones Assessments Used by Emergency Medicine Residency Programs: A Cross-sectional Survey

Introduction: Professionalism is a vital component of quality patient care. While competency in professionalism is Accreditation Council for Graduate Medical Education (ACGME)-mandated, the methods used to evaluate professionalism are not standardized, calling into question the validity of reported...

Full description

Bibliographic Details
Main Authors: Christine R. Stehman, Steven Hochman, Madonna Fernández-Frackelton, Emilio G. Volz, Rui Domingues, Jeffrey N. Love, William Soares
Format: Article
Language:English
Published: eScholarship Publishing, University of California 2019-12-01
Series:Western Journal of Emergency Medicine
Online Access:https://escholarship.org/uc/item/5kt7n1kd
id doaj-1c420209de604d43a768f4d0ac07e336
record_format Article
spelling doaj-1c420209de604d43a768f4d0ac07e3362020-11-25T02:12:10ZengeScholarship Publishing, University of CaliforniaWestern Journal of Emergency Medicine1936-90182019-12-0121110.5811/westjem.2019.11.44456wjem-21-152Professionalism Milestones Assessments Used by Emergency Medicine Residency Programs: A Cross-sectional SurveyChristine R. Stehman0Steven Hochman1Madonna Fernández-Frackelton2Emilio G. Volz3Rui Domingues4Jeffrey N. Love5William Soares6Indiana University School of Medicine, Department of Emergency Medicine, Indianapolis, IndianaSt. Joseph’s University Medical Center, Department of Emergency Medicine, Paterson, New JerseyDavid Geffen School of Medicine at UCLA, Harbor-UCLA Medical Center, Department of Emergency Medicine, Los Angeles, CaliforniaKendall Regional Medical Center, Department of Emergency Medicine, Broward County, FloridaLincoln Medical and Mental Health Center, Department of Emergency Medicine, Bronx, New YorkGeorge Washington University School of Medicine, Department of Emergency Medicine, Washington, District of ColumbiaUniversity of Massachusetts Medical Center-Baystate Health, Springfield, MassachusettsIntroduction: Professionalism is a vital component of quality patient care. While competency in professionalism is Accreditation Council for Graduate Medical Education (ACGME)-mandated, the methods used to evaluate professionalism are not standardized, calling into question the validity of reported measurements. We aimed to determine the type and frequency of methods used by United States (US) -based emergency medicine (EM) residencies to assess accountability (Acc) and professional values (PV), as well as how often graduating residents achieve competency in these areas. Methods: We created a cross-sectional survey exploring assessment and perceived competency in Acc and PV, and then modified the survey for content and clarity through feedback from emergency physicians not involved in the study. The final survey was sent to the clinical competency committee (CCC) chair or program director (PD) of the 185 US-based ACGME-accredited EM residencies. We summarized results using descriptive statistics and Fisher’s exact testing. Results: A total of 121 programs (65.4%) completed the survey. The most frequently used methods of assessment were faculty shift evaluation (89.7%), CCC opinion (86.8%), and faculty summative evaluation (76.4%). Overall, 37% and 42% of residency programs stated that nearly all (greater than 95%) of their graduating residents achieve mastery of Acc and PV non-technical skills, respectively. Only 11.2% of respondents felt their programs were very effective at determining mastery of non-technical skills. Conclusion: EM residency programs relied heavily on faculty shift evaluations and summative opinions to determine resident competency in professionalism, with feedback from peers, administrators, and other staff less frequently incorporated. Few residency programs felt their current methods of evaluating professionalism were very effective.https://escholarship.org/uc/item/5kt7n1kd
collection DOAJ
language English
format Article
sources DOAJ
author Christine R. Stehman
Steven Hochman
Madonna Fernández-Frackelton
Emilio G. Volz
Rui Domingues
Jeffrey N. Love
William Soares
spellingShingle Christine R. Stehman
Steven Hochman
Madonna Fernández-Frackelton
Emilio G. Volz
Rui Domingues
Jeffrey N. Love
William Soares
Professionalism Milestones Assessments Used by Emergency Medicine Residency Programs: A Cross-sectional Survey
Western Journal of Emergency Medicine
author_facet Christine R. Stehman
Steven Hochman
Madonna Fernández-Frackelton
Emilio G. Volz
Rui Domingues
Jeffrey N. Love
William Soares
author_sort Christine R. Stehman
title Professionalism Milestones Assessments Used by Emergency Medicine Residency Programs: A Cross-sectional Survey
title_short Professionalism Milestones Assessments Used by Emergency Medicine Residency Programs: A Cross-sectional Survey
title_full Professionalism Milestones Assessments Used by Emergency Medicine Residency Programs: A Cross-sectional Survey
title_fullStr Professionalism Milestones Assessments Used by Emergency Medicine Residency Programs: A Cross-sectional Survey
title_full_unstemmed Professionalism Milestones Assessments Used by Emergency Medicine Residency Programs: A Cross-sectional Survey
title_sort professionalism milestones assessments used by emergency medicine residency programs: a cross-sectional survey
publisher eScholarship Publishing, University of California
series Western Journal of Emergency Medicine
issn 1936-9018
publishDate 2019-12-01
description Introduction: Professionalism is a vital component of quality patient care. While competency in professionalism is Accreditation Council for Graduate Medical Education (ACGME)-mandated, the methods used to evaluate professionalism are not standardized, calling into question the validity of reported measurements. We aimed to determine the type and frequency of methods used by United States (US) -based emergency medicine (EM) residencies to assess accountability (Acc) and professional values (PV), as well as how often graduating residents achieve competency in these areas. Methods: We created a cross-sectional survey exploring assessment and perceived competency in Acc and PV, and then modified the survey for content and clarity through feedback from emergency physicians not involved in the study. The final survey was sent to the clinical competency committee (CCC) chair or program director (PD) of the 185 US-based ACGME-accredited EM residencies. We summarized results using descriptive statistics and Fisher’s exact testing. Results: A total of 121 programs (65.4%) completed the survey. The most frequently used methods of assessment were faculty shift evaluation (89.7%), CCC opinion (86.8%), and faculty summative evaluation (76.4%). Overall, 37% and 42% of residency programs stated that nearly all (greater than 95%) of their graduating residents achieve mastery of Acc and PV non-technical skills, respectively. Only 11.2% of respondents felt their programs were very effective at determining mastery of non-technical skills. Conclusion: EM residency programs relied heavily on faculty shift evaluations and summative opinions to determine resident competency in professionalism, with feedback from peers, administrators, and other staff less frequently incorporated. Few residency programs felt their current methods of evaluating professionalism were very effective.
url https://escholarship.org/uc/item/5kt7n1kd
work_keys_str_mv AT christinerstehman professionalismmilestonesassessmentsusedbyemergencymedicineresidencyprogramsacrosssectionalsurvey
AT stevenhochman professionalismmilestonesassessmentsusedbyemergencymedicineresidencyprogramsacrosssectionalsurvey
AT madonnafernandezfrackelton professionalismmilestonesassessmentsusedbyemergencymedicineresidencyprogramsacrosssectionalsurvey
AT emiliogvolz professionalismmilestonesassessmentsusedbyemergencymedicineresidencyprogramsacrosssectionalsurvey
AT ruidomingues professionalismmilestonesassessmentsusedbyemergencymedicineresidencyprogramsacrosssectionalsurvey
AT jeffreynlove professionalismmilestonesassessmentsusedbyemergencymedicineresidencyprogramsacrosssectionalsurvey
AT williamsoares professionalismmilestonesassessmentsusedbyemergencymedicineresidencyprogramsacrosssectionalsurvey
_version_ 1724911142368706560