Indigenous health program evaluation design and methods in Australia: a systematic review of the evidence

• Main Authors: Kamalini Lokuge, Katherine Thurber, Bianca Calabria, Meg Davis, Kathryn McMahon, Lauren Sartor, Raymond Lovett, Jill Guthrie, Emily Banks
• Format: Article
• Language: English
• Published: Wiley 2017-10-01
• Series: Australian and New Zealand Journal of Public Health
• Subjects: Aboriginal and Torres Strait Islander health; Indigenous health; program evaluation; evaluation methods
• Online Access: https://doi.org/10.1111/1753-6405.12704
• ISSN: 1326-0200; 1753-6405

Abstract Objective: Indigenous Australians experience a disproportionately higher burden of disease compared to non‐Indigenous Australians. High‐quality evaluation of Indigenous health programs is required to inform health and health services improvement. We aimed to quantify methodological and other characteristics of Australian Indigenous health program evaluations published in the peer‐reviewed literature. Methods: Systematic review of peer‐reviewed literature (November 2009–2014) on Indigenous health program evaluation. Results: We identified 118 papers describing evaluations of 109 interventions; 72.0% were university/research institution‐led. 82.2% of evaluations included a quantitative component; 49.2% utilised quantitative data only and 33.1% used both quantitative and qualitative data. The most common design was a before/after comparison (30.5%, n=36/118). 7.6% of studies (n=9/118) used an experimental design: six individual‐level and three cluster‐randomised controlled trials. 56.8% (67/118) reported on service delivery/process outcomes (versus health or health risk factor outcomes) only. Conclusions: Given the number of Indigenous health programs that are implemented, few evaluations overall are published in the peer‐reviewed literature and, of these, few use optimal methodologies such as mixed methods and experimental design. Implications for public health: Multiple strategies are required to increase high‐quality, accessible evaluation in Indigenous health, including supporting stronger research‐policy‐practice partnerships and capacity building for evaluation by health services and government.