In this module, we focus on the ways evaluation processes, especially those related to data, implicate equity and how designing evaluations around responsible data practices can help an organization further their mission and increase their impact. We will cover data responsibility and the data lifecycle, and provide an introduction to evaluation through an equity lens.
Conducting evaluations with an equity lens takes time; it is an ongoing, learning process that may lead to (or require) deep change at your organization.
This worksheet sketches out a process that alone may take two hours to complete. This is not to scare you off. It is to provide a realistic introduction to what is involved.
The Stanford Digital Civil Society Lab has identified a few key resources to help you think through questions of security, access, encryption and many other topics that may arise as you work through the data lifecycle. In addition to the resources listed here, we have also compiled a more comprehensive list, which we will share with you following the workshop.
This powerpoint by Sally Leiderman explores how evaluation is both a technical and a political exercise. In 13 slides, she breaks down the power dynamics at play in any evaluation process, between funders, evaluations, the community that is being evaluated, the people running an intervention, and the people being served by an intervention.
Her powerpoint contains useful infographics explaining participatory evaluation as well as a list of additional resources for further understanding systemic racism, participatory evaluation, and power (im)balances in evaluation processes.
The Equitable Evaluation Framework is designed to help foundations and nonprofits, and the consultants and philanthropy serving organizations that support them, explore what it means to be about and for equity by considering how all their assets and efforts align.
The framework is built around three core principles:
Oxfam designed this training pack to:
This policy written and adapted by Oxfam is a great example of how an organization can take measures to ensure that data is collected and used responsible at all stages of the data life cycle. To this end, this policy includes definitions and requirements for high-, medium- and low-risk data.
This leaflet will help anyone handling, sharing or accessing programme data to properly consider responsible data issues throughout the data lifecycle. It focuses mainly on the responsible management of data in humanitarian crises, from the perspective of data collection. However, the principles, tools and approaches are also more widely applicable. The steps outlined here should be seen as a framework for ensuring that data collectors are responsive, uphold accountability and raise voices.
In this paper, Oxfam discusses privacy and data security from a rights-based perspective, with a focus on quantitative impact evaluation. We situate protocols we have developed within the context of the General Data Protection Regulation (GDPR), sharing relevant debates along the way. This article provides a useful overview for translating principles and regulations into everyday impact evaluation practice.