Equitable Evaluation Toolkit

This downloadable toolkit contains six tools and is meant to be adapted to the needs of your project.

Project partners:

2023 – present

Tomatoes. Photo credit: Roland Dahwen

Beginning in 2023, Ecotrust’s Measurement & Evaluation (M&E) team engaged with consultants from Austin Advocates With and Insight for Action for several activities, including developing a set of equitable evaluation principles, workshops to identify white supremacy culture characteristics in evaluation and how to counter them, and developing an equitable evaluation toolkit, which is shared below.

Equitable Evaluation Toolkit

This toolkit contains six tools and is meant to be adapted to the needs of your project. Successful use of the toolkit doesn’t require the use of every tool, and the tools themselves can be modified. We strongly encourage you to use the first two tools, Equity Considerations and Thumbnail Evaluation Plan (in whole or in part, based on what your project needs). The remaining four tools may be useful based on the needs of your project.

Full Instructions for Use 

This guide provides full context and instructions for each tool linked below.

number_1
These three sets of questions are for review before your evaluation project begins. The purpose is to ensure that you are centering racial equity, as well as all other forms of social equity, from the outset of your project. These questions are meant to be answered at a high level, in brief summary. The tools that follow will help you answer these questions in more detail.
number_2

This tool is the cornerstone of your evaluation project. It is an essential tool for identifying the primary purpose or motivation for your evaluation; assigning roles and responsibilities to team members; identifying and justifying evaluation methods; and planning the sequence of activities, from design to data collection, analysis, meaning-making, and reporting. It can also be modified to suit your purposes; or filled out in stages over time as you gain more clarity on your evaluation process.

number_3

These questions are meant to guide a participatory design and data collection process that engages a range of affected parties to your program, such as current and former participants, partner organizations, community leaders, and at-large community members. One or more of your M&E Team members will facilitate or co-facilitate the design sessions, ideally in collaboration with a program leader. There are separate sets of questions to follow the first two phases of the evaluation process, Design and Data Collection. Answering these questions will set your evaluation process up for success.

number_4
This tool is a template for designing data collection processes for two types of instruments: surveys and interviews. It should be filled out by M&E staff with input from program leaders and managers. It is not meant to be a participatory tool, rather, a series of checkpoints to ensure that the data collection process incorporates equity-centered considerations. If you conducted participatory design sessions for the data collection phase (see tool #3 above), please refer to the results of those sessions to inform your answers to the questions on this template.
number_5
This is an example budget, in Google Sheets workbook form, for an equitable evaluation process that includes participatory design and meaning-making sessions. The budget estimates hours by phase of the project, including Design, Data Collection, Analysis, Meaning-Making, and Reporting; as well as Orientation and Close-Out, and hours set aside for Project Management including regular team and partner check-ins, file organization, and task management. Complete instructions for use are contained on the first tab of the workbook. To use the template, please make a copy and label it according to the project you are evaluating.
number_6
This tool walks you through the process of making meaning from evaluation data, and sharing the findings with a range of impacted parties, including program staff, leaders, partners, and funders. Your evaluation team should convene at least one meaning-making session with program leaders, partners, and possibly other affected parties as appropriate. The purpose of this session is to make meaning from the results of the evaluation, and generate learnings and recommendations. The way you design this session is up to you – we’ve provided an example format followed by a larger bank of questions. Finally, the evaluation team should hold a discussion with program leaders about how, and with whom, to share and report out learnings.

Partners

Project Partners

Austin Advocates With (AAW) LLC advocates with the community by uplifting and listening well to the voices of those most impacted and historically marginalized by our systems in order to cultivate brave space for racial justice and transformation through a data-informed approach.

AAW LLC is a black and woman-owned business founded by Amani Austin.

We are a woman-owned, boutique consulting group who works with purpose-driven organizations to strengthen their social impact by serving as a learning partner. 

Ecotrust is engaged in transformative work both internally and externally. Their commitment to aligning their practices with their values and allowing the communities’ priorities to shape how and where they engage will continue to put Ecotrust in spaces where transformation happens.

—Amani Austin, Austin Advocates With

Ecotrust Project Team & Services

Want to learn more? Check out the full Ecotrust Staff & Board and all of our Tools for Building Collective Change.

Ecotrust project team
services
We cultivate leaders and assist with funding sources through culturally competent curriculum development.

We build and deliver mission-aligned projects in partnership through large group facilitation, developing ideas into programs, program evaluation and reporting, and
measuring progress in racial equity.

We contribute tools, analyses, and frameworks that move projects forward, through measurement frameworks and indicators.

Additional Resources

Cover of the Equitable Evaluation at Ecotrust brief

Brief

A summary of activities conducted to develop and adopt evaluation principles, practices, and tools that are equity-centered and community-focused

presentation

Webinar

On April 18, 2024, evaluators Denise Chin and Noah Enelow held a webinar to discuss the process of adopting an Equitable Evaluation approach at Ecotrust.

tomato

Blog post

Learn more about the four principles we adopted to better guide the design and execution of our evaluation.

Radical, practical change starts with you.

support our work

Share

Email
Print
StumbleUpon
XING
Telegram