Use of progression criteria to support monitoring and commissioning decision making of public health services: lessons from Better Start Bradford

Abstract Background Commissioning and monitoring of community-based interventions is a challenge due to the complex nature of the environment and the lack of any explicit cut-offs to guide decision making. At what point, for example, is participant enrolment to interventions, course completion or sa...

Full description

Bibliographic Details
Main Authors: M. Bryant, N. Dharni, J. Dickerson, K. Willan, R. McEachan, J. Duffy, M. Howell
Format: Article
Language:English
Published: BMC 2019-06-01
Series:BMC Public Health
Subjects:
Online Access:http://link.springer.com/article/10.1186/s12889-019-7149-7
id doaj-330d5fe195fa49c89077ab14acf2c64b
record_format Article
spelling doaj-330d5fe195fa49c89077ab14acf2c64b2020-11-25T03:04:13ZengBMCBMC Public Health1471-24582019-06-011911910.1186/s12889-019-7149-7Use of progression criteria to support monitoring and commissioning decision making of public health services: lessons from Better Start BradfordM. Bryant0N. Dharni1J. Dickerson2K. Willan3R. McEachan4J. Duffy5M. Howell6Clinical Trials Research Unit, University of LeedsBradford Institute of Health Research, Bradford Teaching Hospitals NHS Foundation TrustBradford Institute of Health Research, Bradford Teaching Hospitals NHS Foundation TrustBradford Institute of Health Research, Bradford Teaching Hospitals NHS Foundation TrustBradford Institute of Health Research, Bradford Teaching Hospitals NHS Foundation TrustBradford Trident Charity and Social EnterpriseBradford Trident Charity and Social EnterpriseAbstract Background Commissioning and monitoring of community-based interventions is a challenge due to the complex nature of the environment and the lack of any explicit cut-offs to guide decision making. At what point, for example, is participant enrolment to interventions, course completion or satisfaction deemed to be acceptable or sufficient for continued funding? We aimed to identify and quantify key progression criteria for fourteen early years interventions by (1) agreeing the top three criteria for monitoring of successful implementation and progress; and (2) agreeing boundaries to categorise interventions as ‘meeting anticipated target’ (green); ‘falling short of targets’ (amber) and ‘targets not being met’ (red). Methods We ran three workshops in partnership with the UK’s Big Lottery Fund commissioned programme ‘Better Start Bradford’ (implementing more than 20 interventions to improve the health, wellbeing and development of children aged 0–3) to support decision making by agreeing progression criteria for the interventions being delivered. Workshops included 72 participants, representing a range of professional groups including intervention delivery teams, commissioners, intervention-monitoring teams, academics and community representatives. After discussion and activities, final decisions were submitted using electronic voting devices. All participants were invited to reconsider their responses via a post-workshop questionnaire. Results Three key progression criteria were assigned to each of the 14 interventions. Overall, criteria that participants most commonly voted for were recruitment, implementation and reach, but these differed according to each intervention. Cut-off values used to indicate when an intervention moved to ‘red’ varied by criteria; the lowest being for recruitment, where participants agreed that meeting less than 65% of the targeted recruitment would be deemed as ‘red’ (falling short of target). Conclusions Our methodology for monitoring the progression of interventions has resulted in a clear pathway which will support commissioners and intervention teams in local decision making within the Better Start Bradford programme and beyond. This work can support others wishing to implement a formal system for monitoring the progression of public health interventions.http://link.springer.com/article/10.1186/s12889-019-7149-7ImplementationMonitoringEarly years interventionChild healthObesityLanguage
collection DOAJ
language English
format Article
sources DOAJ
author M. Bryant
N. Dharni
J. Dickerson
K. Willan
R. McEachan
J. Duffy
M. Howell
spellingShingle M. Bryant
N. Dharni
J. Dickerson
K. Willan
R. McEachan
J. Duffy
M. Howell
Use of progression criteria to support monitoring and commissioning decision making of public health services: lessons from Better Start Bradford
BMC Public Health
Implementation
Monitoring
Early years intervention
Child health
Obesity
Language
author_facet M. Bryant
N. Dharni
J. Dickerson
K. Willan
R. McEachan
J. Duffy
M. Howell
author_sort M. Bryant
title Use of progression criteria to support monitoring and commissioning decision making of public health services: lessons from Better Start Bradford
title_short Use of progression criteria to support monitoring and commissioning decision making of public health services: lessons from Better Start Bradford
title_full Use of progression criteria to support monitoring and commissioning decision making of public health services: lessons from Better Start Bradford
title_fullStr Use of progression criteria to support monitoring and commissioning decision making of public health services: lessons from Better Start Bradford
title_full_unstemmed Use of progression criteria to support monitoring and commissioning decision making of public health services: lessons from Better Start Bradford
title_sort use of progression criteria to support monitoring and commissioning decision making of public health services: lessons from better start bradford
publisher BMC
series BMC Public Health
issn 1471-2458
publishDate 2019-06-01
description Abstract Background Commissioning and monitoring of community-based interventions is a challenge due to the complex nature of the environment and the lack of any explicit cut-offs to guide decision making. At what point, for example, is participant enrolment to interventions, course completion or satisfaction deemed to be acceptable or sufficient for continued funding? We aimed to identify and quantify key progression criteria for fourteen early years interventions by (1) agreeing the top three criteria for monitoring of successful implementation and progress; and (2) agreeing boundaries to categorise interventions as ‘meeting anticipated target’ (green); ‘falling short of targets’ (amber) and ‘targets not being met’ (red). Methods We ran three workshops in partnership with the UK’s Big Lottery Fund commissioned programme ‘Better Start Bradford’ (implementing more than 20 interventions to improve the health, wellbeing and development of children aged 0–3) to support decision making by agreeing progression criteria for the interventions being delivered. Workshops included 72 participants, representing a range of professional groups including intervention delivery teams, commissioners, intervention-monitoring teams, academics and community representatives. After discussion and activities, final decisions were submitted using electronic voting devices. All participants were invited to reconsider their responses via a post-workshop questionnaire. Results Three key progression criteria were assigned to each of the 14 interventions. Overall, criteria that participants most commonly voted for were recruitment, implementation and reach, but these differed according to each intervention. Cut-off values used to indicate when an intervention moved to ‘red’ varied by criteria; the lowest being for recruitment, where participants agreed that meeting less than 65% of the targeted recruitment would be deemed as ‘red’ (falling short of target). Conclusions Our methodology for monitoring the progression of interventions has resulted in a clear pathway which will support commissioners and intervention teams in local decision making within the Better Start Bradford programme and beyond. This work can support others wishing to implement a formal system for monitoring the progression of public health interventions.
topic Implementation
Monitoring
Early years intervention
Child health
Obesity
Language
url http://link.springer.com/article/10.1186/s12889-019-7149-7
work_keys_str_mv AT mbryant useofprogressioncriteriatosupportmonitoringandcommissioningdecisionmakingofpublichealthserviceslessonsfrombetterstartbradford
AT ndharni useofprogressioncriteriatosupportmonitoringandcommissioningdecisionmakingofpublichealthserviceslessonsfrombetterstartbradford
AT jdickerson useofprogressioncriteriatosupportmonitoringandcommissioningdecisionmakingofpublichealthserviceslessonsfrombetterstartbradford
AT kwillan useofprogressioncriteriatosupportmonitoringandcommissioningdecisionmakingofpublichealthserviceslessonsfrombetterstartbradford
AT rmceachan useofprogressioncriteriatosupportmonitoringandcommissioningdecisionmakingofpublichealthserviceslessonsfrombetterstartbradford
AT jduffy useofprogressioncriteriatosupportmonitoringandcommissioningdecisionmakingofpublichealthserviceslessonsfrombetterstartbradford
AT mhowell useofprogressioncriteriatosupportmonitoringandcommissioningdecisionmakingofpublichealthserviceslessonsfrombetterstartbradford
_version_ 1724682208550060032