Designing diagnostics in complexity: Measuring technical and contextual aspects in monitoring and evaluation systems

Background: This article emphasizes the importance of reflecting on the methods employed when designing diagnostic tools for monitoring and evaluation (M&E) systems. It sheds light on a broader debate about how we understand and assess M&E systems within their political and organisational co...

Full description

Bibliographic Details
Main Authors: Caitlin Blaser Mapitsa, Marcel T. Korth
Format: Article
Language:English
Published: AOSIS 2017-04-01
Series:African Evaluation Journal
Subjects:
Online Access:https://aejonline.org/index.php/aej/article/view/196
Description
Summary:Background: This article emphasizes the importance of reflecting on the methods employed when designing diagnostic tools for monitoring and evaluation (M&E) systems. It sheds light on a broader debate about how we understand and assess M&E systems within their political and organisational contexts. Objectives: The article looks at what divergent purposes of M&E mean for how M&E systems are assessed, and how context-appropriate diagnostic studies can be designed. Method: The article draws on two different approaches: a survey that looks at the technical components of an M&E system and a complexity framework that analyses the way a system functions in a broader political and organisational context. The foundation is provided by survey and interview data from over 70 officials from across the City of Johannesburg’s administration. Results: The study revealed great diversity as to respondents’ understanding of what M&E structures and processes should do and achieve within the city, ranging from a management function closely linked to auditing and oversight responsibilities to a governance role that is more linked to learning and planning. Limitations in M&E capacity and/or performance were linked to contested political and bureaucratic structures. Conclusion: The mixed method approach to diagnostics proposed in this article contributes to the call in the ‘Made in Africa’ debate for more contextualised methods and tools around the practice and the assessment of M&E. The article proposes the development of a synthetic tool that covers both M&E technical components and capacity on one hand, and an analysis of how these are embedded in a political and organisational context on the other.
ISSN:2310-4988
2306-5133