Oh No, These Results Aren't What I Expected!

Have you ever hired a research firm to do a study of your impact? I bet you eagerly awaited their report so you could share the results on your website or with a funder. Then the day finally came when you got the research report, and it was…well... a big let down. Maybe your research team said “no impact” or “no relationship between usage or participation and outcome”.  

Wah wah. 

As a researcher and evaluator, I’ve been in the difficult position of sharing disappointing results with passionate teams who worked hard to create something meaningful to them. While investigating the impact of education or after-school programs, educator initiatives, and edtech products, I recognized the importance of both helping organizations to understand their results and supporting them as they navigate data, especially when they are feeling the disappointment of seeing “no impact” in their results. To me, disappointing results are not the end of the road but an opportunity for growth and learning. 

The approach I like to take is collaborative and empathetic. Unexpected results can evoke a range of emotions, from frustration to self-doubt. Creating space to process those emotions helps teams to overcome disappointment, let go of blame, and foster resilience. 

Embracing the power of reflection for continuous improvement

After acknowledging the disappointment, we can take a step back and reflect on the data objectively, looking for patterns, outliers, or factors that may have influenced the results. I help teams to engage in honest self-reflection and ask critical questions: Did we set realistic goals? Did we account for all relevant variables? Are there external factors beyond our control? This introspection will help you gain insights and identify areas for improvement.

When teams adopt a growth mindset that emphasizes learning and resilience, they begin to see that setbacks are a part of every journey. Reviewing data is an opportunity to reassess your strategies and explore new possibilities, while also identifying potential gaps or areas for improvement. I encourage teams to stay focused on their long-term goals while remaining adaptable by being willing to iterate and adjust their approach. This will allow teams to more easily realign expectations and build a culture of continuous improvement. Plus, having open and honest discussions within your team fosters an environment built on collaboration and finding solutions, readying them for whatever the next research report may hold. 

Reach out to learn more about how The Research & Insights Lab can help your team study impact and engage in continuous improvement.