A science impact framework to measure impact beyond journal metrics.

Measuring the impact of public health science or research is important especially when it comes to health outcomes. Achieving the desired health outcomes take time and may be influenced by several contributors, making attribution of credit to any one entity or effort problematic. Here we offer a sci...

Full description

Bibliographic Details
Main Authors: Mary D Ari, John Iskander, John Araujo, Christine Casey, John Kools, Bin Chen, Robert Swain, Miriam Kelly, Tanja Popovic
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2020-01-01
Series:PLoS ONE
Online Access:https://doi.org/10.1371/journal.pone.0244407
id doaj-7f3055e1d19f49a59ac79920c139879b
record_format Article
spelling doaj-7f3055e1d19f49a59ac79920c139879b2021-03-18T05:31:43ZengPublic Library of Science (PLoS)PLoS ONE1932-62032020-01-011512e024440710.1371/journal.pone.0244407A science impact framework to measure impact beyond journal metrics.Mary D AriJohn IskanderJohn AraujoChristine CaseyJohn KoolsBin ChenRobert SwainMiriam KellyTanja PopovicMeasuring the impact of public health science or research is important especially when it comes to health outcomes. Achieving the desired health outcomes take time and may be influenced by several contributors, making attribution of credit to any one entity or effort problematic. Here we offer a science impact framework (SIF) for tracing and linking public health science to events and/or actions with recognized impact beyond journal metrics. The SIF was modeled on the Institute of Medicine's (IOM) Degrees of Impact Thermometer, but differs in that SIF is not incremental, not chronological, and has expanded scope. The SIF recognizes five domains of influence: disseminating science, creating awareness, catalyzing action, effecting change and shaping the future (scope differs from IOM). For public health, the goal is to achieve one or more specific health outcomes. What is unique about this framework is that the focus is not just on the projected impact or outcome but rather the effects that are occurring in real time with the recognition that the measurement field is complex, and it takes time for the ultimate outcome to occur. The SIF is flexible and can be tailored to measure the impact of any scientific effort: from complex initiatives to individual publications. The SIF may be used to measure impact prospectively of an ongoing or new body of work (e.g., research, guidelines and recommendations, or technology) and retrospectively of completed and disseminated work, through linking of events using indicators that are known and have been used for measuring impact. Additionally, linking events offers an approach to both tell our story and also acknowledge other players in the chain of events. The value added by science can easily be relayed to the scientific community, policy makers and the public.https://doi.org/10.1371/journal.pone.0244407
collection DOAJ
language English
format Article
sources DOAJ
author Mary D Ari
John Iskander
John Araujo
Christine Casey
John Kools
Bin Chen
Robert Swain
Miriam Kelly
Tanja Popovic
spellingShingle Mary D Ari
John Iskander
John Araujo
Christine Casey
John Kools
Bin Chen
Robert Swain
Miriam Kelly
Tanja Popovic
A science impact framework to measure impact beyond journal metrics.
PLoS ONE
author_facet Mary D Ari
John Iskander
John Araujo
Christine Casey
John Kools
Bin Chen
Robert Swain
Miriam Kelly
Tanja Popovic
author_sort Mary D Ari
title A science impact framework to measure impact beyond journal metrics.
title_short A science impact framework to measure impact beyond journal metrics.
title_full A science impact framework to measure impact beyond journal metrics.
title_fullStr A science impact framework to measure impact beyond journal metrics.
title_full_unstemmed A science impact framework to measure impact beyond journal metrics.
title_sort science impact framework to measure impact beyond journal metrics.
publisher Public Library of Science (PLoS)
series PLoS ONE
issn 1932-6203
publishDate 2020-01-01
description Measuring the impact of public health science or research is important especially when it comes to health outcomes. Achieving the desired health outcomes take time and may be influenced by several contributors, making attribution of credit to any one entity or effort problematic. Here we offer a science impact framework (SIF) for tracing and linking public health science to events and/or actions with recognized impact beyond journal metrics. The SIF was modeled on the Institute of Medicine's (IOM) Degrees of Impact Thermometer, but differs in that SIF is not incremental, not chronological, and has expanded scope. The SIF recognizes five domains of influence: disseminating science, creating awareness, catalyzing action, effecting change and shaping the future (scope differs from IOM). For public health, the goal is to achieve one or more specific health outcomes. What is unique about this framework is that the focus is not just on the projected impact or outcome but rather the effects that are occurring in real time with the recognition that the measurement field is complex, and it takes time for the ultimate outcome to occur. The SIF is flexible and can be tailored to measure the impact of any scientific effort: from complex initiatives to individual publications. The SIF may be used to measure impact prospectively of an ongoing or new body of work (e.g., research, guidelines and recommendations, or technology) and retrospectively of completed and disseminated work, through linking of events using indicators that are known and have been used for measuring impact. Additionally, linking events offers an approach to both tell our story and also acknowledge other players in the chain of events. The value added by science can easily be relayed to the scientific community, policy makers and the public.
url https://doi.org/10.1371/journal.pone.0244407
work_keys_str_mv AT marydari ascienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT johniskander ascienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT johnaraujo ascienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT christinecasey ascienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT johnkools ascienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT binchen ascienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT robertswain ascienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT miriamkelly ascienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT tanjapopovic ascienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT marydari scienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT johniskander scienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT johnaraujo scienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT christinecasey scienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT johnkools scienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT binchen scienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT robertswain scienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT miriamkelly scienceimpactframeworktomeasureimpactbeyondjournalmetrics
AT tanjapopovic scienceimpactframeworktomeasureimpactbeyondjournalmetrics
_version_ 1714780404587692032