Course in Impact Evaluations for Health Systems Strengthening

Course Content

The following subjects are covered during the course:

• Theory of Change, impact, causality
• Primary data and secondary analyses of existing data (health monitoring and information systems, population health surveys)
• Counterfactual evaluations, Theory-based evaluations, Mixed-methods evaluations, programme evaluations
• Triangulation of evidence to inform existing programs and policies
• Ethics and conflict of interest
• Targeted Dissemination and communication of evaluation findings

Content

This intensive course explores the critical role of impact evaluations in strengthening health systems.

You will start by critically analysing stakeholder information needs in order to define relevant evaluation questions. You will learn to define impact and causality and how to use tools to understand and communicate these concepts (e.g. theories of change). You will appraise the use of various data sources for evaluations, ranging from primary data (qualitative and quantitative) to secondary analysis of existing data (e.g. routine health systems or population health data). Additionally, you will learn to differentiate the type of evidence generated by various types of evaluation designs, ranging from counterfactual to theory-based evaluations.

You will also learn to triangulate quantitative and qualitative evidence to inform programs and policies while ensuring that recommendations contribute to strengthening health systems.

The course will also address ethical considerations and conflicts of interest in conducting impact evaluations, and the importance of targeted dissemination efforts to key audiences.

This course is tropEd accredited and can be followed as a stand-alone course or as a specialisation course of the Master in Public Health and Health Equity programme.

Learning methods

Engagement in this course will involve a blend of interactive lectures, practical workshops, case studies, and group discussions.

You will obtain hands-on experience in triangulating quantitative and qualitative evidence to inform programs and policies while ensuring that recommendations contribute to strengthening health systems.

Feedback and guidance from experienced instructors will facilitate an immersive learning experience, fostering critical thinking and problem-solving abilities essential for conducting impactful impact evaluations in health system strengthening.

Assessment:

For participants who wish to receive a certificate of completion of the course, including the ECTS credits, the assessment is required.

If you do not wish to do the assessment, you can receive a certificate of attendance of the course.

Objectives

At the end of this course, participants will be able to:

• Critically analyse how multiple stakeholder needs in the health system influence the design of an evaluation strategy as well as participation and decision-making
• Compare and discuss the fundamental concepts that underpin evaluations of health programs within health systems
• Appraise and select new and innovative approaches to evaluations (ranging from counterfactual to Theory-based evaluations) and use this information to formulate the most appropriate evaluation strategy in a given situation
• Triangulate quantitative and qualitative data analyses and appraise evidence to inform programs and policies, while ensuring that recommendations contribute to strengthening health systems