A common standard for the evaluation of public engagement with research

Despite growing interest in public engagement with research, there are many challenges to evaluating engagement. Evaluation findings are rarely shared or lead to demonstrable improvements in engagement practice. This has led to calls for a common 'evaluation standard' to provide tools and...

Full description

Bibliographic Details
Main Authors: Mark Reed, Sophie Duncan, Paul Manners, Diana Pound, Lucy Armitage, Lynn Jayne Frewer, Charlotte Thorley, Bryony Frost
Format: Article
Language:English
Published: UCL Press 2018-01-01
Series:Research for All
Online Access:https://www.scienceopen.com/document?vid=a7ffe736-af4b-42e0-b504-925c3a7defba
id doaj-ee138c91575e432a9490a600a2d3da39
record_format Article
spelling doaj-ee138c91575e432a9490a600a2d3da392020-12-16T09:43:07ZengUCL PressResearch for All2399-81212018-01-0110.18546/RFA.02.1.13A common standard for the evaluation of public engagement with researchMark ReedSophie DuncanPaul MannersDiana PoundLucy ArmitageLynn Jayne FrewerCharlotte ThorleyBryony FrostDespite growing interest in public engagement with research, there are many challenges to evaluating engagement. Evaluation findings are rarely shared or lead to demonstrable improvements in engagement practice. This has led to calls for a common 'evaluation standard' to provide tools and guidance for evaluating public engagement and driving good practice. This paper proposes just such a standard. A conceptual framework summarizes the three main ways in which evaluation can provide judgements about, and enhance the effectiveness of, public engagement with research. A methodological framework is then proposed to operationalize the conceptual framework. The standard is developed via a literature review, semi-structured interviews at Queen Mary University of London and an online survey. It is tested and refined in situ in a large public engagement event and applied post hoc to a range of public engagement impact case studies from the Research Excellence Framework. The goal is to standardize good practice in the evaluation of public engagement, rather than to use standard evaluation methods and indicators, given concerns from interviewees and the literature about the validity of using standard methods or indicators to cover such a wide range of engagement methods, designs, purposes and contexts. Adoption of the proposed standard by funders of public engagement activities could promote more widespread, high-quality evaluation, and facilitate longitudinal studies to draw our lessons for the funding and practice of public engagement across the higher education sector.https://www.scienceopen.com/document?vid=a7ffe736-af4b-42e0-b504-925c3a7defba
collection DOAJ
language English
format Article
sources DOAJ
author Mark Reed
Sophie Duncan
Paul Manners
Diana Pound
Lucy Armitage
Lynn Jayne Frewer
Charlotte Thorley
Bryony Frost
spellingShingle Mark Reed
Sophie Duncan
Paul Manners
Diana Pound
Lucy Armitage
Lynn Jayne Frewer
Charlotte Thorley
Bryony Frost
A common standard for the evaluation of public engagement with research
Research for All
author_facet Mark Reed
Sophie Duncan
Paul Manners
Diana Pound
Lucy Armitage
Lynn Jayne Frewer
Charlotte Thorley
Bryony Frost
author_sort Mark Reed
title A common standard for the evaluation of public engagement with research
title_short A common standard for the evaluation of public engagement with research
title_full A common standard for the evaluation of public engagement with research
title_fullStr A common standard for the evaluation of public engagement with research
title_full_unstemmed A common standard for the evaluation of public engagement with research
title_sort common standard for the evaluation of public engagement with research
publisher UCL Press
series Research for All
issn 2399-8121
publishDate 2018-01-01
description Despite growing interest in public engagement with research, there are many challenges to evaluating engagement. Evaluation findings are rarely shared or lead to demonstrable improvements in engagement practice. This has led to calls for a common 'evaluation standard' to provide tools and guidance for evaluating public engagement and driving good practice. This paper proposes just such a standard. A conceptual framework summarizes the three main ways in which evaluation can provide judgements about, and enhance the effectiveness of, public engagement with research. A methodological framework is then proposed to operationalize the conceptual framework. The standard is developed via a literature review, semi-structured interviews at Queen Mary University of London and an online survey. It is tested and refined in situ in a large public engagement event and applied post hoc to a range of public engagement impact case studies from the Research Excellence Framework. The goal is to standardize good practice in the evaluation of public engagement, rather than to use standard evaluation methods and indicators, given concerns from interviewees and the literature about the validity of using standard methods or indicators to cover such a wide range of engagement methods, designs, purposes and contexts. Adoption of the proposed standard by funders of public engagement activities could promote more widespread, high-quality evaluation, and facilitate longitudinal studies to draw our lessons for the funding and practice of public engagement across the higher education sector.
url https://www.scienceopen.com/document?vid=a7ffe736-af4b-42e0-b504-925c3a7defba
work_keys_str_mv AT markreed acommonstandardfortheevaluationofpublicengagementwithresearch
AT sophieduncan acommonstandardfortheevaluationofpublicengagementwithresearch
AT paulmanners acommonstandardfortheevaluationofpublicengagementwithresearch
AT dianapound acommonstandardfortheevaluationofpublicengagementwithresearch
AT lucyarmitage acommonstandardfortheevaluationofpublicengagementwithresearch
AT lynnjaynefrewer acommonstandardfortheevaluationofpublicengagementwithresearch
AT charlottethorley acommonstandardfortheevaluationofpublicengagementwithresearch
AT bryonyfrost acommonstandardfortheevaluationofpublicengagementwithresearch
AT markreed commonstandardfortheevaluationofpublicengagementwithresearch
AT sophieduncan commonstandardfortheevaluationofpublicengagementwithresearch
AT paulmanners commonstandardfortheevaluationofpublicengagementwithresearch
AT dianapound commonstandardfortheevaluationofpublicengagementwithresearch
AT lucyarmitage commonstandardfortheevaluationofpublicengagementwithresearch
AT lynnjaynefrewer commonstandardfortheevaluationofpublicengagementwithresearch
AT charlottethorley commonstandardfortheevaluationofpublicengagementwithresearch
AT bryonyfrost commonstandardfortheevaluationofpublicengagementwithresearch
_version_ 1724381564655108096