Transparency Talk

Category: "#OpenForGood" (36 posts)

WEBINAR—#OpenForGood: Sharing Knowledge to Advance Foundation Impact
September 5, 2019

Square (1)
Meg Long
Square (2)

Veronica Olazabal
Square

Lee Alexander Risby

Learn how to go about sharing knowledge to drive broader impact across the social sector. This webinar coming up on September 17th, hosted by Grantmakers for Effective Organizations, featuring the inaugural winners of Candid’s #OpenForGood Award, will present best practices and approaches to help your foundation shift to a culture of learning.

The webinar will explore how foundations can take specific steps to better support knowledge-sharing by providing an overview of Candid’s #OpenForGood field scan and how-to guide, and asking participants to identify challenges and possible solutions when it comes to opening up knowledge for the greater good. Recent #OpenForGood award-winning foundations, the Rockefeller Foundation and the C&A Foundation, will share their insights and lessons learned in shifting to a culture of learning.

Building on a recent field scan and interviews with leaders across the globe, we will explore the following questions:

  • Why share knowledge? What are the benefits and for whom?
  • What barriers get in the way of foundations sharing their knowledge, and what are practical strategies for overcoming those barriers?
  • How can knowledge-sharing be used to level power dynamics and advance equity?
  • What role can technology play in helping to simplify the act of knowledge sharing?

REGISTER HERE

Meet Our #OpenForGood Award Winner: An Interview with Veronica Olazabal, Director of Measurement, Evaluation and Organizational Performance, The Rockefeller Foundation
July 10, 2019

Nqrwrzfk





Veronica Olazabal

This post is part of the Glasspockets’ #OpenforGood series done in partnership with the Fund for Shared Insight. The series explores new tools, promising practices, and inspiring examples showing how some foundations are opening up the knowledge that they are learning for the benefit of the larger philanthropic sector. Contribute your comments on each post and share the series using #OpenForGood. View more posts in the series.

The Rockefeller Foundation advances new frontiers of science, data, policy, and innovation to solve global challenges related to health, food, power, and economic mobility. In this interview, Veronica Olazabal shares insights with GlassPockets' Janet Camarena about how the foundation’s practices support learning and open knowledge.

GlassPockets: Congratulations on being one of our inaugural recipients of the #OpenForGood award! The award was designed to recognize those foundations that are working to advance the field by sharing what they are learning. Can you please share why you have prioritized knowledge sharing at the Rockefeller Foundation and how this practice has helped you to advance your work? Or put another way, what is the good that has come about as a result?

Veronica Olazabal: We are excited to be an inaugural recipient of the #OpenForGood award! As you may be aware, since its founding more than 100 years ago, The Rockefeller Foundation's mission has been “ to promote the well-being of humanity throughout the world.” To this end, the Foundation seeks to catalyze and scale transformative innovation across sectors and geographies, and take risks where others cannot, or will not.

While often working in new and innovative spaces, the Foundation has always recognized that the full impact of its programs and investments can only be realized if it measures - and shares - what it is learning. Knowledge and evidence sharing have been core to the organization's DNA dating back to its founder John D. Rockefeller Sr., who espoused the virtues of learning from and with others—positing that this was the key to "enlarging the boundaries of human knowledge." You can imagine how this, in turn, resulted in transformational breakthroughs such as the Green Revolution, the eradication of Yellow Fever and the formalization of Impact Investing.

The-rockefeller-foundationGP: Your title has the word “evaluation” in its name and increasingly we are seeing foundations move toward this staffing structure of having staff dedicated to evaluation and learning. For those foundations that are considering adding such a unit to their teams, what advice do you have about the structures needed to create a culture of learning across the organization and avoid the creation of one more silo? 

VO: Learning is a team sport and to that end, an evaluation and learning team should be centrally positioned and accessible to all teams across a foundation. At the Rockefeller Foundation, the Measurement and Evaluation team engages with both the programmatic and the impact investing teams. We see our role as enablers of good practices around impact management and programmatic learning -- often working with teams in early stage design support, through start-up, implementation and exit. We also work collaboratively with others at the Foundation such as our grants-management and data teams to ensure the “right” M&E data is being captured throughout our grantee’s lifecycle.

Yet, I will be the first to say that building a culture of learning by continuously reaching “over the fence” is a lot of work and might be challenging for a small team, which is the reality for most foundations. Benchmarking data produced by the Center for Evaluation Innovation (CEI) and the Center for Effective Philanthropy (CEP) lands most M&E teams at foundations at around 1.5. So, capacity for culture change is clearly a challenge. My suggestion here is to source evaluation and learning talent that balances the hard technical chops with the softer people skills. I believe you truly need both and if an organization optimizes for one over the other, might experience a series of false starts. A good place to start in sourcing evaluation talent is the American Evaluation Association (AEA).

GP: As you heard during the award presentation, one of the reasons the Rockefeller Foundation was selected to receive this award is because of your commitment to sharing the results of any evaluation you commission, before you even know the outcome. This pledge seems designed to not let negative findings affect your decision about whether or not to share what your learned. We often hear that foundation boards and leaders are worried about reputational issues with such sharing. What would you say to those leaders about how opening up these pain points and lessons has affected Rockefeller’s reputation in the field, and why it’s worth it?

VO: In 2017, The Rockefeller Foundation was pleased to be the first to make all of its evaluations available to IssueLab as part of #OpenForGood. But to the Foundation, being open goes well beyond passively making information available to those seeking it. Being truly open necessarily involves the proactive sharing of lessons so that others can be aware of and leverage from the things that we are learning. To that end, we regularly author blogs, disseminate evaluation reports and M&E learnings via digital channels, and – perhaps most importantly – share back evaluation results with our grantees and partners – so that evaluation is more than a one-way extractive exercise.

"Being truly open necessarily involves the proactive sharing of lessons so that others can be aware of and leverage from the things that we are learning."

Taking sharing one step further, earlier this year, The Rockefeller Foundation adopted a new Data Asset Policy aimed at making the data that we collect as part of our grantmaking freely available to others who could use it to effect more good in the world. The policy is grounded on two core principles: 1) that the data we fund has incredible value for public good and that these assets can serve as fuel for better decision-making; and 2) we commit ourselves to being responsible stewards of these data, which means prioritizing privacy and protection, especially of those individuals and communities we seek to serve. Moving forward, this opens up the ability to amplify our learning even further and in even more innovative ways.

GP: A concern we often hear is that a funder creating a culture of learning leads to an increased burden on grantees who are then asked for robust evaluations and outcomes measures that no one is willing to pay for. Does Rockefeller include funding for the evaluations and reporting or other technical assistance to mitigate the burden on grantees?

VO: Having had the experience of being both a funder and a grantee, I know this is a real barrier to enabling robust learning cultures and evidence-informed decision-making. For this reason, at The Rockefeller Foundation we approach resourcing in a few different ways:

  • First, through embedding resources for evaluation and learning into individual grantee budgets and agreements from the start. This type of funding enables grantees to generate the type of data they need for their own decision-making, learning and reporting.
  • We also often work in a consortia model where we commission an evaluation and learning grantee separately to synthesize learnings across groups of grantees and provide technical assistance as needed. This approach helps decrease the reporting burden for “implementation” types of grantees as it generates what is it the Foundation would like to learn (which could differ from what the grantees and their clients find useful). Here is an example from our Digital Jobs Africa portfolio generated through this evaluation and learning model.
  • Finally, we have also at times, and upon request, seconded our own M&E staff to grantees and partners to help build their M&E muscle and enable them to measure their own impact. While this is rare, we are seeing this request more and more and hence why we value both technical expertise and relationship management skills.

GP: Learning is a two-way street and foundations are both producers and consumers of knowledge. Let’s close this interview with hearing about a noteworthy piece of knowledge you recently learned thanks to another foundation or organization sharing it, and how it helped inform your own work.

VO: There are many opportunities to learn from others. In my current role, I am in continuous engagement with colleagues in similar roles at other philanthropies and regularly meet before or after convenings organized by CEP, GEO and AEA. In addition, as part of my work on the Fund for Shared Insight which is a funding collaborative working to make listening to end-users the norm, my philanthropy colleagues and I often exchange on where we all are in our personal and institutional learning journeys.

Finally, as part of a W.K. Kellogg Foundation-funded Lab for Learning, The Rockefeller Foundation was most recently among a cohort of 15 foundations that took part in a year-long series of convenings to address systemic barriers to learning. Participation here required us to experiment with ideas for supporting learning in our own settings and then sharing our experiences with the group. Through this engagement, we learned about how others were building learning habits in their foundations (written about in Julia Coffman’s post here). More specifically, the measurement and evaluation team was able to introduce Making Thinking Visible and Asking Powerful Questions in our early stage support to program teams to push thinking about assumptions and concrete dimensions of the work. This engagement then helped to structure the foundations of a learning agenda (e.g. theory of change-like tool with clear outcomes, hypotheses, assumptions and evidence) that would be used to anchor adaptive management and continuous improvement once the program strategy rolled out.

--Veronica Olazabal & Janet Camarena

Meet Our #OpenForGood Award Winner: An Interview with Lee Alexander Risby, Head of Effective Philanthropy & Savi Mull, Senior Evaluation Manager, C&A Foundation
June 19, 2019

1




Lee Alexander Risby

This post is part of the Glasspockets’ #OpenforGood series done in partnership with the Fund for Shared Insight. The series explores new tools, promising practices, and inspiring examples showing how some foundations are opening up the knowledge that they are learning for the benefit of the larger philanthropic sector. Contribute your comments on each post and share the series using #OpenForGood. View more posts in the series.

C&A Foundation is a European foundation that supports programs and initiatives to transform fashion into a fair and sustainable industry that enables everyone – from farmer to factory worker – to thrive. In this interview, Lee Alexander Risby and Savi Mull share insights with GlassPockets' Janet Camarena about how the foundation’s practices support learning and open knowledge.

GlassPockets: Congratulations on being one of our inaugural recipients of the #OpenForGood award! The award was designed to recognize those foundations that are working to advance the field by sharing what they are learning. Can you please share why you have prioritized knowledge sharing at the C&A Foundation and how this practice has helped you to advance your work?

2




Savi Mull

Savi Mull: For almost five years, C&A Foundation has been dedicated to transforming the fashion industry into a force for good. A large part of that work includes instilling transparency and accountability in supply chains across the industry. From the start, we also wanted to lead by example by being transparent and accountable as an organization, sharing what we were learning whilst on this journey, being true to our work and helping the rest of the industry learn from our successes and failures.

Lee Alexander Risby: Indeed, from the beginning, we made a commitment to be open about our results and lessons by publishing evaluations on our website and dashboards in our Annual Reports. After all, you cannot encourage the fashion industry to be transparent and accountable and not live by the same principles yourself. Importantly, our commitment to transparency has always been championed both by our Executive Director and our Board.

Savi: To do this, over the years we have put many processes in place.  For example, internally we use after-action reviews to gather lessons from our initiatives and allow our teams to discuss honestly what could have been done better in that program or partnership.  We also do third party, external evaluations of our initiatives, sharing the reports and lessons learned. This helps us and our partners to learn, and it informs initiatives and strategies going forward.

The Role of Evaluation Inside Foundations

GP: Your title has the word “evaluation” in its name and increasingly we are seeing foundations move toward this staffing structure of having staff dedicated to evaluation and learning. For those foundations that are considering adding such a unit to their teams, what advice do you have about the structures needed to create a culture of learning across the organization and avoid the creation of one more silo?

SM: I believe it is essential to have this type of function in a foundation to drive formal learning from and within programs. But at the same time, it is an ongoing process that cannot be driven by one function alone. All staff needs to be responsible for the learning that makes philanthropy effective – not just evaluators.

LAR: To begin, we were deliberate in building a team of evaluation professionals to promote accountable learning. We started hiring slowly and built the team over time. What I looked for with each new member of the team, and I am always looking for, is an evaluator with more than just skills, they also need the influencing, listening, communication and negotiating skills to help others learn. Evaluations have little effect without good internal and external communication.

”For us, it was important to be a critical friend, listener, and enabler of learning and not the police.”

The evaluation function itself has also evolved over the last five years. It started off as a monitoring, evaluation and learning function (MEL) and is now Effective Philanthropy. From the start, the function was as not set up as an independent department but created to help programmatic teams in the design of appropriate monitoring and evaluation for the programs, and facilitators and advisors on strategy. However, it has not always been a straight-forward process from the inside. In the first years, we had to spend a lot of time explaining and persuading staff of the need for evaluation, transparency and learning and the benefits of doing so. We wanted to avoid a strong independent evaluation function as that can reduce learning by placing too much emphasis on accountability. For us, it was important to be a critical friend, listener, and enabler of learning and not the police.

SM: So, the first bit of advice is that evaluators should be supportive listeners, assisting programmatic teams throughout the design and implementation phases to get the best results possible. They should not come in just at the end of an initiative to do an evaluation.

LAR: The second piece of advice is on positioning, support, and structure of evaluation within a foundation.  Firstly, it is critical to have is to have the buy-in of the leadership and board for both evaluation and transparency. And secondly, the evaluation function must be part of the management team and report to the CEO or Executive Director. This gives reporting and learning the appropriate support structure and importance.

The third piece of advice is to consider not creating an evaluation function, but an effective philanthropy function. Evaluation is done for learning, and learning drives effectiveness in grant-making for better results and long-term impacts on systems.

SM: The final piece of advice is to take guidance from others outside your organization. The whole team has consulted broadly with former colleagues and mentors from across the evaluation community as well as experienced philanthropic professionals. Remember you are part of a field with peers whose knowledge and experience can help guide you.

Opening Up Pain Points

GP: One of the reasons the committee selected C&A Foundation to receive the award is because of your institutional comfort level with sharing not just successes, but also being very forthright about what didn’t work. We often hear that foundation boards and leaders are worried about reputational issues with such sharing. What would you say to those leaders about how opening up these pain points and lessons has affected C&A Foundation’s reputation in the field, and why it’s worth it?

LAR: I would say this. The question for foundation boards and leaders is straightforward: do you want to be more effective and have an impact? The answer to that will always be yes, but it is dependent on learning and sharing across the organization and with others. If we do not share evaluations, research or experiences, we do not learn from each other and we cannot be effective in our philanthropic endeavors.

"There is a benefit to being open, you build trust and integrity – success and failure is part of all of us."

The other question for boards and leaders is: who does philanthropy serve? For us, we want to transform the fashion industry, which is made up of cotton farmers, workers in spinning mills and cut and sew factories, consumers and entrepreneurs, to name a few – they are our public. As such we have the duty to be transparent to the public about where we are succeeding and where we have failed and how we can improve. We do not think there is a reputation risk. In fact, there is a benefit to being open, you build trust and integrity – success and failure is part of all of us.

SM: Adding to what Lee has said, being open about our failures not only helps us but the entire field. Some of our partners have felt reticent about our publishing evaluations, but we always reassure them and stress from the beginning of an evaluation process that it is an opportunity to understand how to they can improve their work and how we can improve our partnership, as well as a chance to share those lessons more broadly.

Learning While Lean

GP: Given the lean philanthropy staffing structures in place at many corporate foundations, do you have any advice for your peers on how those without a dedicated evaluation team might still be able to take some small steps to sharing what they are learning?

SM: Learning is a continuous process. In the absence of staff dedicated to evaluation, take baby steps within your power, such as implementing after-action reviews, holding thematic webinars, or doing quick summaries of lessons from grants and/or existing evaluations from others. If the organization’s leadership endorses learning, these small steps are a good place to start.

GP: And speaking of lean staffing structures, a concern we often hear is that a funder creating a culture of learning leads to an increased burden on grantees who are then asked for robust evaluations and outcomes measures that no one is willing to pay for. Does C&A Foundation include funding for the evaluations and reporting or other technical assistance to mitigate the burden on grantees?

SM: The foundation has a Monitoring and Evaluation Policy that lays out the role of the programmatic staff and partners as well as of the dedicated Effective Philanthropy Team. C&A Foundation partners are generally responsible for the design and execution of self-evaluation - to be submitted at the end of the grant period. External evaluation budgets are covered by the foundation and do not pose a financial burden on partners at all. They are included in the overall cost of an initiative, and when needed we have an additional central evaluation fund that is used to respond to the programmatic team’s and partner’s ad hoc demands for evaluations and learning.

The Effective Philanthropy team does provide technical assistance to partners and foundation staff upon request. The guidance ranges from technical inputs related to the theory of change development to the design of baseline and mid-line data collection exercises. The theory of change work has been really rewarding for partners and ourselves. We all enjoy that part of the work.

GP: Learning is a two-way street and foundations are both producers and consumers of knowledge. Let’s close this interview with hearing about a noteworthy piece of knowledge you recently learned thanks to another foundation or organization sharing it, and how it helped inform your work.

Learning Leads to Effectiveness

C-a-foundation (1)LAR: In the moving from a more traditional MEL approach to effective philanthropy we looked at the work of other foundations. This included learning from the William and Flora Hewlett Foundation, the Rockefeller Foundation, and others. We had discussions with a number of peers in the field. We also asked Nancy MacPherson (formerly Managing Director of Evaluation at Rockefeller) and Fay Twersky (Director of Effective Philanthropy at Hewlett) to review our Effective Philanthropy strategy when it was under development. Their feedback and advice helped a lot. In the end, we decided to begin to build out the function in a similar way to the Hewlett Foundation. But there are some differences. For example, our evaluation practice is currently positioned at a deeper initiative level, which is related to the field context where there is a significant evidence gap across the fashion industry that needs to be filled. Concomitant to this is our emphasis on piloting and testing and that goes hand-in-hand with the demand for evaluative thinking, reporting, and learning.

Our team has also been influenced by our own successes and failures from previous roles. That has also inspired us to embrace a slightly different approach.

SM: In terms of where we are at the moment, we still oversee performance monitoring, evaluation, and support to the program teams in developing theories of change and KPIs; but we are also building out organizational learning approach and are in the process of hiring a Senior Learning Manager. Lastly, we are piloting our organizational and network effectiveness in Brazil, which is being led by a colleague who joined the foundation last year.

LAR: We are also in the midst of an Overall Effectiveness Evaluation (OEE) of C&A Foundation’s first 5-year strategy. In general, this is not a type of evaluation that foundations use much. As well as looking at results, the evaluators are evaluating the whole organization, including Effective Philanthropy. For me as an evaluator, it has been really rewarding to be on the other side of a good question.

We are learning from the OEE as we go along and we decided to create ongoing opportunities for reporting/feedback from the process rather than waiting until the very end for a report. This means that program staff can be engaged in proactive discussions about performance and emerging lessons in a timely way. The OEE is already starting to play a vital role to inform the development of the next 5-year strategy and our organization. But you will surely hear more on that evaluation process later as it will be published. There is always room for improvement and learning never stops.

--Lee Alexander Risby and Savi Mull

Meet Our #OpenForGood Award Winner: An Interview with Craig Connelly, Chief Executive Officer, The Ian Potter Foundation
June 12, 2019

Download



Craig Connelly

This post is part of the Glasspockets’ #OpenforGood series done in partnership with the Fund for Shared Insight. The series explores new tools, promising practices, and inspiring examples showing how some foundations are opening up the knowledge that they are learning for the benefit of the larger philanthropic sector. Contribute your comments on each post and share the series using #OpenForGood. View more posts in the series.

The Ian Potter Foundation is an Australian foundation that supports and promotes excellence and innovation working for a vibrant, healthy, fair, and sustainable Australia. In this interview, Craig Connelly shares insights with GlassPockets' Janet Camarena about how the foundation’s practices support learning and open knowledge.

GlassPockets: Congratulations on being one of our inaugural recipients of the #OpenForGood award! The award was designed to recognize those foundations that are working to advance the field by sharing what they are learning. Can you please share why you have prioritized knowledge sharing at the Ian Potter Foundation and how this practice has helped you to advance your work? Or put another way, what is the good that has come about as a result?

Craig Connelly: The Ian Potter Foundation decided to invest in our research and evaluation capability primarily to improve the quality of our grantmaking. We believe that evaluating our grantees and the work that we fund through measuring and evaluating outcomes enables us to understand the extent to which our funding guidelines are achieving the intended outcomes. This results in a more informed approach to our grantmaking which should improve the quality of our grantmaking over time.

A core part of this includes being completely transparent with our grantees and with the broader sector. To do anything otherwise is not being consistent with our expectations of our grantees. We are asking our grantees to be partners, to pursue a strategic relationship with them and that requires open and honest conversation. Therefore, we need to be an open, honest and transparent funder and demonstrate that in order to win the trust of the organizations we fund.

Examples of this transparency are the learnings that we glean from our grantees that we share with the broader sector. We’re getting very positive feedback from both funders and grantees on the quality of the learnings that we’re sharing and the value that they add to the thought processes that nonprofit organizations and other funders go through.

The-ian-potter-foundationGP: Increasingly we are seeing foundations move toward a structure of having staff dedicated to evaluation and learning. For those foundations that are considering adding such a unit to their teams, what advice do you have about the structures needed to create a culture of learning across the organization and avoid the creation of one more silo?

CC: Anyone in a research and evaluation role needs to be an integral part of the program management team. The research and evaluation process informs our grantmaking. It needs to assist the program managers to be better at what they do, and it needs to learn from what the program managers are doing as well. You don’t want it to be a silo, it is just another function of your program management team. It is an integral part of that team and it is in constant communication both with the program management team and with grantees from day one.

GP: As you heard during the award presentation, one of the reasons the Ian Potter Foundation was selected to receive this award is because of how you prioritize thinking about how stakeholders like grantees might benefit from the reports and knowledge you possess. We often hear that while there is a desire to share grantee reports publicly, that there are reputational concerns that prevent it or that to scrub the reports of sensitive information would be too time consuming, yet you do it for all of your portfolios. What are your tips for how to keep this a manageable process?

CC: The initial work to compile and anonymize our grantee learnings required some investment in time from our Research & Evaluation Manager and communications team. To make this task manageable, the work was tackled one program area at a time. Now that a bank of learnings has been created for each program area, new learnings are easily compiled and added on a yearly basis. This work is scheduled at less busy times for those staff involved. The Ian Potter Foundation is also looking at ways learnings can be shared directly from grantees to the wider nonprofit sector. One idea is to create a forum (e.g. a podcast) where nonprofits can share their experiences with their peers in the sector.

GP: A concern we often hear is that a funder creating a culture of learning leads to an increased burden on grantees who are then asked for robust evaluations and outcomes measures that no one is willing to pay for. Does The Ian Potter Foundation include funding for the evaluations and reporting or other technical assistance to mitigate the burden on grantees?

"...we need to be an open, honest and transparent funder and demonstrate that in order to win the trust of the organizations we fund."

CC: One of the benefits that we found at The Ian Potter Foundation of having a Research & Evaluation Manager becoming an integral part of our process is that our authorizing environment – our board and the committees responsible for program areas – have become very comfortable including funding evaluation for all of our grants. We now also understand what it costs to complete an effective evaluation. We often ask grantees to add more to their budget to ensure a good quality evaluation can be completed as part of the grant.

GP: Learning is a two-way street and foundations are both producers and consumers of knowledge. Let’s close this interview with hearing about a noteworthy piece of knowledge you recently learned thanks to another foundation or organization sharing it, and how it helped inform your own work.

CC: Yes, we have a couple of examples I can point to. The first comes from our Education Program Manager, Rikki Andrews, who points to the creation of the Early Childhood Impact Alliance (ECIA) through a grant to the University of Melbourne. The purpose of the ECIA is to convene, connect and increase understanding of research and policy among early childhood philanthropic funders, to ensure there is more strategic and concerted philanthropic support of research and its application.

Additionally, the Foundation’s Senior Program Manager, Dr. Alberto Furlan, explains, ‘We are in the process of learning from organizations we partner with all the time. In the last few years, program managers have been prioritizing extensive site visits to shortlisted applicants to discuss and see the projects in situ. In a ‘big country’ such as Australia, this takes a considerable amount of time and resources, but it invariably pays off. Such visits highlight the importance of relationship building deep and honest listening when partnering with not-for-profits. The Foundation prides itself in being open and approachable and site visits greatly contribute to understanding the reality of the day-to-day challenges, and successes, of the organizations working on the ground.’

--Craig Connelly & Janet Camarena

Candid Announces Inaugural #OpenForGood Award Winners
May 30, 2019

Janet Camarena is director of transparency initiatives at Candid.

This post is part of the Glasspockets’ #OpenforGood series done in partnership with the Fund for Shared Insight. The series explores new tools, promising practices, and inspiring examples showing how some foundations are opening up the knowledge that they are learning for the benefit of the larger philanthropic sector. Contribute your comments on each post and share the series using #OpenForGood. View more posts in the series.

Open For Good Awardees and Committee MembersLeft to Right: Meg Long, President, Equal Measure (#OpenForGood selection committee); Janet Camarena, Director, Transparency Initiatives, Candid; Awardee Savi Mull, Senior Evaluation Manager, C&A Foundation; Awardee Veronica Olazabal, Director, Measurement, Evaluation & Organizational Performance, The Rockefeller Foundation; Clare Nolan, Co-Founder, Engage R + D (#OpenForGood selection committee).

Yesterday as part of the Grantmakers for Effective Organizations Learning Conference, Candid announced the inaugural recipients of the #OpenForGood Award, which is designed to recognize and encourage foundations to openly share what they learn so we can all get collectively smarter. The award, part of a larger #OpenForGood campaign started in 2017, includes a set of tools to help funders work more transparently including a GrantCraft Guide about how to operationalize knowledge sharing, a growing collection of foundation evaluations on IssueLab, and advice from peers in a curated blog series.

The three winning foundations each demonstrate an active commitment to open knowledge and share their evaluations through IssueLab, an open repository that is free, searchable, and accessible to all. Selected by an external committee from a globally sourced nomination process, the committee reviewed the contenders looking for evidence of an active commitment to open knowledge, creative approaches to making knowledge shareable, field leadership, and incorporating community insights into knowledge sharing work.

And the Winners Are…

Here are some highlights from the award presentation remarks:

C and A FoundationC&A Foundation
Award Summary: Creativity, Demonstrated Field Leadership, and Willingness to Openly Share Struggles

The C&A Foundation is a multi-national, corporate foundation working to fundamentally transform the fashion industry. C&A Foundation gives its partners financial support, expertise and networks so they can make the fashion industry work better for every person it touches. Lessons learned and impact for each of its programs are clearly available on its website, and helpful top-level summaries are provided for every impact evaluation making a lengthy narrative evaluation very accessible to peers, grantees and other stakeholders. C&A Foundation even provides such summaries for efforts that didn’t go as planned, packaging them in an easy-to-read, graphic format that it shares via its Results & Learning blog, rather than hiding them away and quietly moving on as is more often the case in the field.

The Ian Potter FoundationIan Potter Foundation
Award Summary: Creativity, Field Leadership, and Lifting Up Community Insights

This foundation routinely publishes collective summaries from all of its grantee reports for each portfolio as a way to support shared learning among its existing and future grantees. It’s a refreshing reinvention of the traditional grantee report, placing priority on collecting and sharing the kinds of information that will be helpful to other practitioners, rather than questions to satisfy the typical ritual of a grant report that goes something like submit, data enter, file away never to be seen, and repeat.

Beyond being transparent with its grantee learning and reports, the Ian Potter Foundation also recently helped lift the burden on its grantees when it comes to measurement and outcomes. Instead of asking overworked charities to invent a unique set of metrics just for their grant process, foundation evaluation staff took it upon themselves to mine the Sustainable Development Goals targets framework to provide grantees with optional and ready-made outcomes templates that would work across the field for many funders. You can read more about that effort underway in a recent blog post here.

The Rockefeller FoundationThe Rockefeller Foundation
Award Summary: Field Leadership, Consistent Knowledge Sharing, and Commitment to Working Transparently

The Rockefeller Foundation can boast early adopter status to transparency and openness—it  has had a longstanding commitment to creating a culture of learning and as such was one of the very first foundations to join the GlassPockets transparency movement and also to commit to #OpenForGood principles by sharing its published evaluations widely. Rockefeller Foundation also took the unusual step of upping the ante on the #OpenForGood Pledge aiming for both creating a culture of learning and accountability, with its monitoring and evaluation team stating that: “To ensure that we hold ourselves to a high bar, our foundation pre-commits itself to publicly sharing the results of its evaluations - well before the results are even known.” This ensures that even if the evaluation reports unfavorable findings, the intent is to share it all.

In an earlier GlassPockets blog post, Rockefeller’s monitoring and evaluation team shows a unique understanding of how sharing knowledge can advance the funder’s goals: “Through the documentation of what works, for who, and how/under what conditions, there is potential to amplify our impact, by crowding-in other funders to promising solutions, and diverting resources from being wasted on approaches that prove ineffectual.”  Rockefeller’s use of IssueLab’s open knowledge platform is living up to this promise as anyone can currently query and find more than 400 knowledge documents funded, published, or co-published by the Rockefeller Foundation.

Winners will receive technical support to create a custom Knowledge Center for their foundation or for a grantee organization, as well as promotional support in knowledge dissemination. Knowledge Centers are a service of IssueLab that provides organizations with a simple way to manage and share knowledge on their own websites. By leveraging this tool, you can showcase your insight, promote analysis on your grantees, and feature learnings from network members. All documents that are uploaded to an IssueLab Knowledge Center are also made searchable and discoverable via systems like WorldCat, which serves more than 2,000 libraries worldwide, ensuring your knowledge can be found by researchers, regardless of their familiarity with your organization.

Why Choose Openness?

The #OpenForGood award is focused on inspiring foundations to use existing and emerging technologies to collectively improve the sector. Today, we live in a time when most expect to find the information they need on the go, via tablets, laptops, and mobile phones, just a swipe or click away. Despite this digital era reality today only 13 percent of foundations have websites, and even fewer share their reports publicly, indicating that the field has a long way to go to creating a culture of shared learning. With this award, we hope to change these practices. Rather than reinvent the wheel, this award and campaign encourages the sector to make it a priority to learn from one another, share content with a global audience, so that we can build smartly one another’s work and accelerate the change we want to see in the world. The more you share your foundation's work, the greater the opportunities to make all our efforts more effective and farther reaching.

Congratulations to our inaugural class of #OpenForGood Award Winners! What will you #OpenForGood?

--Janet Camarena

Opening Up Emerging Knowledge: New Shared Learning from IssueLab
May 23, 2019

Janet Camarena is the director of transparency initiatives at Candid.

This post is part of the Glasspockets’ #OpenForGood series in partnership with the Fund for Shared Insight. The series explores new tools, promising practices, and inspiring examples showing how some foundations are opening up the knowledge that they are learning for the benefit of the larger philanthropic sector. Contribute your comments on each post and share the series using #OpenForGood.

Balloons1024x512

Though it’s hard to believe, we are already almost halfway through 2019! Given that midpoints are often a time to reflect and take stock, it seemed good timing to mine the knowledge that the field has shared in IssueLab to see some examples of a few of the reports and lessons learned that our GlassPockets foundations have shared over the last six months. Scanning the recent titles, some themes immediately jumped out at me that seemed to be a focus of research across the field, such as racial and gender equity, global trends, and impact measurement.

This is also a good reminder that IssueLab helps make your knowledge discoverable. Though I’m highlighting seven recent publications here, I only had to visit one website to find and freely download them. Acting as a “collective brain” for the field, IssueLab organizes the social sector’s knowledge so we can all have a virtual filing cabinet that makes this knowledge readily available. If it’s been a while since you uploaded your knowledge to IssueLab, you can add any of your publications to our growing library here. It’s a great way to make your knowledge discoverable, mitigate the knowledge fragmentation in the field, and make your foundation live up to being #OpenForGood.

And, speaking of #OpenForGood, our inaugural awards designed to encourage more knowledge sharing across the field will be announced at the upcoming GEO Learning Conference during lunch on May 29th. If you will be at GEO, join us to learn who the #OpenForGood knowledge sharing champions will be! And remember, if you’ve learned something, share something!

Opening Up Evaluations & Grantee Reports

“It’s a refreshing reinvention of the traditional grantee report, placing priority on collecting and sharing the kinds of information that will be helpful to other practitioners, rather than just the data that the funder might need.”

Foundations pilot initiatives all the time, but do they share what they learned from them once the evaluation is all said and done? And what about all the potentially helpful data filed away in grantee reports? This first cluster of new reports opens up this kind of knowledge:

  • Creative City (published by Animating Democracy, Funded by the Barr and Boston Foundations, April 2019) The Creative City pilot program, created by the New England Foundation for the Arts in partnership with the Barr Foundation, supported artists of all disciplines for art in Boston that would serve to drive public imagination and community engagement. Artists, funders, and administrators alike will find much to learn from this report about how to rethink arts in the context of people and place. One compelling example is the Lemonade Stand installation, created by artists Elisa H. Hamilton and Silvia Lopez Chavez, which made the rounds of many Boston neighborhoods, and attracted many people with its bright yellow kiosk glow. Though it looked on the surface like a lemonade stand, it was actually an art installation inviting the community to connect by exchanging stories about how they turned lemons into lemonade.
  • Giving Refugees A Voice: Independent Evaluation (MacroScope London, Funded by the C&A Foundation, March 2018-February 2019) The C&A Foundation supported the Giving Refugees a Voice initiative, designed to improve working conditions for Syrian and other refugees in the Turkish apparel sector using social media monitoring technology. The pilot initiative used social media monitoring technology to analyze the public Facebook posts of millions of refugees associated with the apparel sector in Turkey. The purpose of this analysis was to galvanize brands, employers, and others to take actions and make changes that would directly improve the working conditions for Syrian people in Turkey. This impact report forthrightly reveals that though the social media efforts were an innovative way to document the scale of the Syrians working informally in the Turkish apparel industry, the pilot fell short of its goals as there was no evidence that the social media analysis led to improved working conditions. Rather than keep such a negative outcome quiet, the C&A Foundation publicly released its findings and also created a blog summary about them earlier this year outlining the results, what they learned from them, and what would be helpful for stakeholders and partners to know in an easy-to-read outline.
  • Grantee Learnings: Disability (Published by Ian Potter Foundation, December 2018) The information documented in this publication has been taken from the final reports of disability-serving grantees, which were submitted to The Ian Potter Foundation following the completion of their projects. The Ian Potter Foundation routinely shares out grantee learnings for each of its portfolios as a way to support shared learning among its existing and future grantees, and this is the most recent of these. The report is easily arranged so that other disability services providers can benefit from the hard-won lessons learned of their peers when it comes to likely areas of shared challenges such as staffing, program planning, working with parents and partners, scaling, evaluation measurement, and technology use. It’s a refreshing reinvention of the traditional grantee report, placing priority on collecting and sharing the kinds of information that will be helpful to other practitioners, rather than just the data that the funder might need.

Lessons Learned from Scholarship & Fellowship Funding

Donors looking to make a difference using scholarships and student aid to improve diversity, equity, and inclusion have two new excellent sources of knowledge available to them:

  • Delivering on the Promise: An Impact Evaluation of the Gates Millennium Scholars Program (Published by American Institutes for Research, Funded by the Bill & Melinda Gates Foundation, May 2019) This report shares findings from an impact evaluation of the Gates Millennium Scholars (GMS) program and reflects on findings from implementation evaluations conducted on the program since its inaugural year. The GMS program is an effort designed to improve higher education access and opportunity for high achieving low-income students of color by reducing the cost of entry. The program also seeks to develop a new and diverse generation of leaders to serve America by encouraging leadership participation, civic engagement, and the pursuit of graduate education and careers in seven fields in which minorities are underrepresented—computer science, engineering, mathematics, science, education, library science, and public health. It discusses the extent to which the program has made an impact, and offers concluding thoughts on how the Foundation can maximize its investment in the higher education arena. A central argument of this report is that philanthropic activities like the GMS program can indeed play a crucial role in improving academic outcomes for high-achieving, disadvantaged students.
  • Promoting Gender Equity: Lessons From Ford’s International Fellows Program (Published by IIE Center for Academic Mobility Research & Impact, Funded by Ford Foundation, January 2019) As part of its mission to provide higher education access to marginalized communities, the Ford Foundation International Fellowships Program (IFP) sought to address gender inequality by providing graduate fellowships to nearly 2,150 women—50% of the IFP fellow population—from 22 countries in the developing world. This brief explores how international fellowship programs like IFP can advance educational, social, and economic equity for women. In addition to discussing the approach, the program took in providing educational access and opportunity to women. The brief looks at two stories of alumnae who have not only benefitted from the fellowship themselves, but who are working to advance gender equity in their home communities and countries. Activists, advocates, and practitioners can draw upon the strategies and stories that follow to better understand the meaning of gender equity and advance their own efforts to achieve social justice for women and girls worldwide.

Sharing Knowledge about the Social Sector

Foundations invest in knowledge creation to better understand the ecosystem of the social sector, as well as to address critical knowledge gaps they see in the fields in which they work. Thanks to these titles being added to IssueLab, we can all learn from them too! Here’s a couple of recent titles added to IssueLab that shed new and needed light on the fields of philanthropy and nonprofits:

  • Philanthropy in China (Published by Asian Venture Philanthropy Network, Funded by The Rockefeller Foundation, April 2019) Philanthropy is now a global growth industry, but philanthropic transparency norms in other parts of the world are often lacking, so knowledge can be scarce. Philanthropy in China today is expanding and evolving rapidly, so filling in these knowledge gaps is even more pressing. This report presents an overview of the philanthropy ecosystem in China by reviewing existing knowledge and drawing insights from influential practitioners. It also provides an analysis of the key trends, opportunities as well as a set of recommendations for funders and resource providers who are inspired to catalyze a more vibrant and impactful philanthropy ecosystem in China.
  • Race to Lead: Women of Color in the Nonprofit Sector (Published by the Building Movement Project, Funded by New York Community Trust, Robert Sterling Clark Foundation, Community Resource Exchange, New York Foundation, Meyer Memorial Trust, Center for Nonprofit Excellence at the United Way of Central New Mexico, North Carolina Center for Nonprofits, Russ Finkelstein, February 2019) This report is part of the Race to Lead series by the Building Movement Project, seeking to understand why there are still relatively so few leaders of color in the nonprofit sector. Using data taken from a national survey of more than 4,000 people, and supplemented by numerous focus groups around the country, this latest report reveals that women of color encounter systemic obstacles to their advancement over and above the barriers faced by white women and men of color. Another key finding in the report is that education and training are not enough to correct systemic inequities—women of color with high levels of education are more likely to be in administrative roles and are more likely to report frustrations about inadequate and inequitable salaries. Building Movement Project’s call to action focuses on systems change, organizational change, and individual support for women of color in the sector.

Is this reminding you that you have new knowledge to share? Great—I can’t wait to see what you will #OpenForGood!

--Janet Camarena

Don’t “Ghost” Declined Applicants: The Ins and Outs of Giving Applicant Feedback
April 4, 2019

Mandy Ellerton joined the [Archibald] Bush Foundation in 2011, where she created and now directs the Foundation's Community Innovation programs. The programs allow communities to develop and test new solutions to community problems, using approaches that are collaborative and inclusive of people who are most directly affected by the problem.

GlassPockets Road to 100

This post is part of our “Road to 100 & Beyond series, in which we are featuring the foundations that have helped GlassPockets reach the milestone of 100 published profiles by publicly participating in the “Who Has GlassPockets? self-assessment. This blog series highlights reflections on why transparency is important, how openness evolves inside foundations over time, promising practices in transparency, helpful examples, and lessons learned.

I’ve often thought that fundraising can be as bad as dating. (Kudos to you lucky few who have had great experiences dating!) Lots of dates, lots of dead ends, lots of frustrating encounters before you (maybe) find a match. All along the way you look for even the smallest sign to indicate that someone likes you. “They laughed at my joke!” or, in the case of fundraising, “they seemed really excited about page five of last year’s impact report!” Not to mention the endless time spent doing online searches for shreds of information that might be useful. This reality is part of the reason why Bush Foundation was proud to be among the first 100 foundations to participate in GlassPockets. We believe that transparency and opening lines of communication is critical to good grantmaking, because both in dating and in fundraising, it can be heartbreaking and crazymaking to try and sort out whether you have a connection or if someone’s “just not that into you.” If only there was a way to just “swipe left” or “swipe right” and make everything a little simpler.

“We believe that transparency and opening lines of communication is critical to good grantmaking.”

I’m not proposing a Tinder for grantmaking (nor should anyone, probably, although hat tip to Vu Le for messing with all of us and floating the idea on April Fool’s Day). But over the past several years, Bush Foundation’s Community Innovation program staff has used a system to provide feedback calls for declined applicants, in the hopes of making foundation fundraising a little less opaque and crazymaking. We use the calls to be transparent and explain why we made our funding decisions. The calls also help us live out our “Spread Optimism” value because they allow us to help and encourage applicants and potentially point them to other resources. This is all part of our larger engagement strategy, described in “No Moat Philanthropy.”

 

Ellertonmandy20152
Mandy Ellerton

How Feedback Calls Work

We use a systematic approach for feedback calls:

  • We proactively offer the opportunity to sign up for feedback calls in the email we send to declined applicants.
  • We use a scheduling tool (after trying a couple different options we’ve landed on Slotted, which is relatively cheap and easy to use) and offer a variety of times for feedback calls every week. Collectively five Community Innovation Team members hold about an hour a week for feedback calls. The calls typically last about 20 minutes. We’ve found this is about the right amount of time so that we can offer feedback calls to most of the declined applicants who want them.
  • We prepare for our feedback calls. We re-read the application and develop an outline for the call ahead of time.
  • During the call we offer a couple of reasons why we declined the application. We often discuss what an applicant could work on to strengthen their project and whether they ought to apply again.
  • We also spend a lot of time listening; sometimes these calls can understandably be emotional. Grant applications are a representation of someone’s hopes and dreams and sometimes your decline might feel like the end of the road for the applicant. But hang with them. Don’t get defensive. However hard it might feel for you, it’s a lot harder for the declined applicant. And ultimately, hard conversations can be transformative for everyone involved. I will say, however, that most of our feedback calls are really positive exchanges.
  • We use anonymous surveys to evaluate what people think of the feedback calls and during the feedback call we ask whether the applicant has any feedback for us to improve our programs/grantmaking process.
  • We train new staff on how to do feedback calls. We have a staff instruction manual on how to do feedback calls, but we also have new team members shadow more seasoned team members for a while before they do a feedback call alone.

 

What’s Going Well

The feedback calls appear to be useful for both declined applicants and for us:

  • In our 2018 surveys, respondents (n=38) rated the feedback calls highly. They gave the calls an average rating of 6.1 (out of 7) for overall helpfulness, 95% said the calls added some value or a lot of value, and 81.2% said they had a somewhat better or much better understanding of the programs after the feedback call.
  • We’ve seen the number of applications for our Community Innovation Grant and Bush Prize for Community Innovation programs go down over time and we’ve seen the overall quality go up. We think that’s due, in part, to feedback calls that help applicants decide whether to apply again and that help applicants improve their projects to become a better fit for funding in the future.
  • I’d also like to think that doing feedback calls has made us better grantmakers. First, it shows up in our selection meetings. When you might have to talk to someone about why you made the funding decision you did, you’re going to be even more thoughtful in making the decision in the first place. You’re going to hew even closer to your stated criteria and treat the decision with care. We regularly discuss what feedback we plan to give to declined applicants in the actual selection meeting. Second, in a system that has inherently huge power differentials (foundations have all of it and applicants have virtually none of it), doing feedback calls forces you to come face to face with that reality. Never confronting the fact that your funding decisions impact real people with hopes and dreams is a part of what corrupts philanthropy. Feedback calls keep you a little more humble.

 

What We’re Working On

We still have room to improve our feedback calls:

  • We’ve heard from declined applicants that they sometimes get conflicting feedback from different team members when they apply (and get declined) multiple times; 15% of survey respondents said their feedback was inconsistent with prior feedback from us. Cringe. That definitely makes fundraising more crazymaking. We’re working on how to have more staff continuity with applicants who have applied multiple times.
  • We sometimes struggle to determine how long to keep encouraging a declined applicant to improve their project for future applications versus saying more definitively that the project is not a fit. Yes, we want to “Spread Optimism,” but although it never feels good for anyone involved, sometimes the best course of action is to encourage an applicant to seek funding elsewhere.

I’m under no illusions that feedback calls are going to fix the structural issues with philanthropy and fundraising. I welcome that larger conversation, driven in large part by brave critiques of philanthropy emerging lately like Decolonizing Wealth, Just Giving and Winners Take All. In the meantime, fundraising, as with dating, is still going to have moments of heartache and uncertainty. When you apply for a grant, you have to be brave and vulnerable; you’re putting your hopes and dreams out into a really confusing and opaque system that’s going to judge them, perhaps support them, or perhaps dash them, and maybe even “ghost” them by never responding. Feedback calls are one way to treat those hopes and dreams with a bit more care.

--Mandy Ellerton

Putting a Stop to Recreating the Wheel: Strengthening the Field of Philanthropic Evaluation
December 13, 2018

Clare Nolan is Co-Founder of Engage R+D, which works with nonprofits, foundations, and public agencies to measure their impact, bring together stakeholders, and foster learning and innovation.

Meg Long is President of Equal Measure, Philadelphia-based professional services nonprofit focused on helping its clients—foundations, nonprofit organizations, and public entities—deepen and accelerate social change.

2
Clare Nolan

In 2017, Engage R+D and Equal Measure, with support from the Gordon and Betty Moore Foundation launched an exploratory dialogue of funders and evaluators to discuss the current state of evaluation and learning in philanthropy, explore barriers to greater collaboration and impact, and identify approaches and strategies to build the collective capacity of small and mid-sized evaluation firms. Our goal was to test whether there was interest in our sector for building an affinity network of evaluation leaders working with and within philanthropy. Since our initial meeting with a few dozen colleagues in 2017, our affinity network has grown to 250 individuals nationally, and there is growing momentum for finding ways funders and evaluators can work together differently to deepen the impact of evaluation and learning on philanthropic practice.

At the recent 2018 American Evaluation Association (AEA) conference in Cleveland, Ohio, nearly 100 funders and evaluators gathered to discuss four action areas that have generated the most “buzz” during our previous network convening at the Grantmakers for Effective Organizations (GEO) conference and from our subsequent network survey:

1. Improving the application of evaluation in philanthropic strategy and practice.

2. Supporting the sharing and adaptation of evaluation learning for multiple users.

3. Supporting formal partnerships and collaborations across evaluators and evaluation firms.

4. Strengthening and diversifying the pipeline of evaluators working with and within philanthropy.

1
Meg Long

We asked participants to choose one of these action areas and join the corresponding large table discussion to reflect on what they have learned about the topic and identify how the affinity network can contribute to advancing the field. Through crowd-sourcing, participants identified some key ways in which action teams that will be launched in early 2019 can provide a value-add to the field.

1. What will it take to more tightly connect evaluation with strategy and decision-making? Provide more guidance on what evaluation should look like in philanthropy.

Are there common principles, trainings, articles, case studies, guides, etc. that an action team could identify and develop? Could the affinity network be a space to convene funders and evaluators that work in similar fields to share evaluation results and lessons learned?

2. What will it take to broaden the audience for evaluations beyond individual organizations? Create a “market place” for knowledge sharing and incentivize participation.

As readers of this blog will know from Foundation Center’s #OpenForGood efforts, there is general agreement around the need to do better at sharing knowledge, building evidence, and being willing to share what foundations are learning – both successes and failures. How can an action team support the creation of a culture of knowledge sharing through existing venues and mechanisms (e.g., IssueLab, Evaluation Roundtable)? How could incentives be built in to support transparency and accountability?

3. How can the field create spaces that support greater collaboration and knowledge sharing among funders and evaluators? Identify promising evaluator partnership models that resulted in collaboration and not competition.

Partnerships have worked well where there are established relationships and trust and when power dynamics are minimized. How can an action team identify promising models and practices for successful collaborations where collaboration is not the main goal? How can they establish shared values, goals, etc. to further collaboration?

4. What will it take to create the conditions necessary to attract, support, and retain new talent? Build upon existing models to support emerging evaluators of color and identify practices for ongoing guidance and mentorship.

Recruiting, hiring, and retaining talent to fit evaluation and learning needs in philanthropy is challenging due to education and training programs as well as changing expectations in the field. How can we leverage and build on existing programs (e.g., AEA Graduate Education Diversity Internship, Leaders in Equitable Evaluation and Diversity, etc.) to increase the pipeline, and support ongoing retention and professional development?

Overall, we are delighted to see that there is much enthusiasm in our field to do more work on these issues. We look forward to launching action teams in early 2019 to further flesh out the ideas shared above in addition to others generated over the past year.

If you are interested in learning more about this effort, please contact Pilar Mendoza. If you would like to join the network and receive updates about this work, please contact Christine Kemler.

--Clare Nolan and Meg Long

What Does It Take to Shift to a Learning Culture in Philanthropy?
November 20, 2018

Janet Camarena is director of transparency initiatives at Foundation Center.

This post also appears in the Center for Effective Philanthropy blog.

Janet Camarena PhotoIf there was ever any doubt that greater openness and transparency could benefit organized philanthropy, a new report from the Center for Effective Philanthropy (CEP) about knowledge-sharing practices puts it to rest. Besides making a case for the need for greater transparency in the field, the report also provides some hopeful signs that, among foundation leaders, there is growing recognition of the value of shifting to a culture of learning to improve foundations’ efforts.

Understanding & Sharing What Works: The State of Foundation Practice reveals how well foundation leaders understand what is and isn’t working in their foundation’s programs, how they figure this out, and what, if anything, they share with others about what they’ve learned. These trends are explored through 119 survey responses from, and 41 in-depth interviews with foundation CEOs. A companion series of profiles tell the story about these practices in the context of four foundations that have committed to working more openly.

Since Foundation Center’s launch of GlassPockets in 2010, we have tracked transparency around planning and performance measurement within the “Who Has Glass Pockets?” self-assessment. Currently, of the nearly 100 foundations that have participated in GlassPockets, only 27 percent publicly share any information about how they measure their progress toward institutional goals. Given this lack of knowledge sharing, we undertook a new #OpenForGood campaign to encourage foundations to publicly share published evaluations through the IssueLab open archive.

As someone who has spent the last decade examining foundation transparency practices (or the lack thereof) and championing greater openness, I read CEP’s findings with an eye for elements that might help us better understand the barriers and catalysts to this kind of culture shift in the field. Here’s what I took away from the report.

Performance Anxiety

UWW_MAIN_COV_border (1)While two-thirds of foundation CEOs in CEP’s study report having a strong sense of what is working programmatically within their foundations, nearly 60 percent report having a weaker grasp on what is not working. This begs the question: If you don’t know something is broken, then how do you fix it? Since we know foundations have a tendency to be success-oriented, this by itself wasn’t surprising. But it’s a helpful metric that proves the point of how investing in evaluation, learning, and sharing can only lead to wiser use of precious resources for the field as a whole.

The report also reveals that many CEOs who have learned what is not working well at their foundations are unlikely to share that knowledge, as more than one-third of respondents cite hesitancy around disclosing missteps and failures. The interviews and profiles point to what can best be described as performance anxiety. CEOs cite the need for professionals to show what went well, fear of losing the trust of stakeholders, and a desire to impress their boards as motivations for concealing struggles. Of these motivations, board leadership seems particularly influential for setting the culture when it comes to transparency and failure.

In the profiles, Rockefeller Brothers Fund (RBF) President Stephen Heintz discusses both the importance of his board and his background in government as factors that have informed RBF’s willingness to share the kinds of information many foundations won’t. RBF was an early participant in GlassPockets, and now is an early adopter of the #OpenForGood movement to openly share knowledge. As a result, RBF has been one of the examples we often point to for the more challenging aspects of transparency such as frameworks for diversity data, knowledge sharing, and investment practices.

An important takeaway of the RBF profile is the Fund’s emphasis on the way in which a board can help ease performance anxiety by simply giving leadership permission to talk about pain points and missteps. Yet one-third of CEOs specifically mention that their foundation faces pressure from its board to withhold information about failures. This sparks my interest in seeing a similar survey asking foundation trustees about their perspectives in this area.

Utility or Futility?

Anyone who works inside a foundation — or anyone who has ever applied for a grant from a foundation — will tell you they are buried in the kind of paperwork load that often feels futile (which actually spawned a whole other worthy movement led by PEAK Grantmaking called Project Streamline). In the CEP study, the majority of foundation CEOs report finding most of the standard sources of knowledge that they require not very useful to them. Site visits were most consistently ranked highly, with the majority of CEOs (56 percent) pointing to them as one of the most useful sources for learning about what is and isn’t working. Grantee focus groups and convenings came in a distant second, with only 38 percent of CEOs reporting these as a most useful source. And despite the labor involved on both sides of the table, final grant reports were ranked as a most useful source for learning by only 31 percent of CEOs.

”Thanks to CEP’s research, we have evidence of real demand for a greater supply of programmatic knowledge.“

If most foundations find greater value in higher touch methods of learning, such as meeting face-to-face or hosting grantee gatherings, then perhaps this is a reminder that if foundations reduce the burdens of their own bureaucracies and streamline application and reporting processes, there will be more time for learning from community and stakeholder engagement.

The companion profile of the Weingart Foundation, another longtime GlassPockets participant, shows the benefits of funders making more time for grantee engagement, and provides a number of methods for doing so. Weingart co-creates its learning and assessment frameworks with grantees, routinely shares all the grantee feedback it receives from its Grantee Perception Report (GPR), regularly makes time to convene grantees for shared learning, and also pays grantees for their time in helping to inform Weingart’s trustees about the problems it seeks to solve.

Supply and Demand

One of the questions we get the most about #OpenForGood’s efforts to build an open, collective knowledge base for the field is whether anyone will actually use this content. This concern also surfaces in CEP’s interviews, with a number of CEOs citing the difficulty of knowing what is useful to share as an impediment to openness. A big source of optimism here is learning that a majority of CEOs report that their decisions are often informed by what other foundations are learning, meaning foundations can rest assured that if they supply knowledge about what is and isn’t working, the demand is there for that knowledge to make a larger impact beyond their own foundation. Think of all that untapped potential!

Of course, given the current state of knowledge sharing in the field, only 19 percent of CEOs surveyed report having quite a bit of knowledge about what’s working at peer foundations, and just 6 percent report having quite a bit of knowledge about what’s not working among their programmatic peers. Despite this dearth of knowledge, still fully three-quarters of foundation CEOs report that they use what they have access to from peers in informing strategy and direction within their own foundations.

Thanks to CEP’s research, we have evidence of real demand for a greater supply of programmatic knowledge. Now there is every reason for knowledge sharing to become the norm rather than the exception.

--Janet Camarena

Creating a Culture of Learning: An Interview with Yvonne Belanger, Director of Evaluation & Learning, Barr Foundation
November 8, 2018

Yvonne Belanger is the director of learning & evaluation at the Barr Foundation and leads Barr's efforts to gauge its impact and support ongoing learning among staff, grantees, and the fields in which they work.

Recently, Janet Camarena, director of transparency initiatives for Foundation Center, interviewed Belanger about how creating a culture of learning and openness can improve philanthropy. This post is part of the Glasspockets’ #OpenForGood series in partnership with the Fund for Shared Insight. The series explores new tools, promising practices, and inspiring examples showing how some foundations are opening up the knowledge that they are learning for the benefit of the larger philanthropic sector. Contribute your comments on each post and share the series using #OpenForGood.


YvonneGlassPockets: More and more foundations seem to be hiring staff with titles having to do with evaluation and learning. You’ve been in this role at the Barr Foundation for just about a year, having come over from a similar role at the Bill & Melinda Gates Foundation. Why do you think roles like this are on the rise in philanthropy, and what are your aspirations for how greater capacity for evaluation and learning can benefit the field?

Yvonne Belanger: I think the spread of these roles in strategic philanthropy comes from increasing recognition that building a stronger learning function is a strategic investment, and it requires dedicated expertise and leadership. My hope is that strong evaluation and learning capacity at Barr (and across the philanthropic sector generally) will enable better decisions and accelerate the pace of social change to make the world more equitable and just.

GP: What have been your priorities in this first year and what is your approach to learning? More specifically, what is Barr’s learning process like, what sources do you learn from, how do you use the learnings to inform your work?

YB: At Barr, we are committed to learning from our efforts and continuously improving. Our programmatic work benefits from many sources of knowledge to inform strategy including landscape scans, academic research, ongoing conversations with grantees and formal site visits, and program evaluations to name a few. During this first year, I have been working with Barr’s program teams to assess their needs, to sketch out a trajectory for the next few years, and to launch evaluation projects across our strategies to enhance our strategic learning. Learning is not limited to evaluating the work of our programs, but also includes getting feedback from our partners. Recently, we were fortunate to hear from grantees via our Grantee Perception Report survey, including specific feedback on our learning and evaluation practices. As we reflected on their responses in relation to Barr’s values and examples of strong practice among our peers, we saw several ways we could improve.

GP: What kinds of improvements are you making as a result of feedback you received?

YB: We identified three opportunities for improvement: to make evaluation more useful, to be clearer about how Barr defines success and measures progress, and to be more transparent with our learning.

  • Make evaluations more collaborative and beneficial to our partners. We heard from our grantees that participating in evaluations funded by Barr hasn’t always felt useful or applicable to their work. We are adopting approaches to evaluation that prioritize grantee input and benefit. For example, in our Creative Commonwealth Initiative, a partnership with five community foundations to strengthen arts and creativity across Massachusetts, we included the grantees early in the evaluation design phase. With their input, we modified and prioritized evaluation questions and incorporated flexible technical assistance to build their capacity for data and measurement. In our Education Program, the early phase of our Engage New England evaluation is focused on sharing learning with grantees and the partners supporting their work to make implementation of these new school models stronger.
  • Be clearer about how we measure outcomes. Our grantees want to understand how Barr assesses progress. In September, we published a grantee guide to outputs and outcomes to clarify what we are looking for from grantees and to support them in developing a strong proposal. Currently, our program teams are clarifying progress measures for our strategies, and we plan to make that information more accessible to our grantees.
  • Share what we learn. To quote your recent GrantCraft Open for Good report, “Knowledge has the power to spark change, but only if it is shared.” To maximize Barr’s impact, we aim to be #OpenForGood and produce and share insights that help our grantees, practitioners, policymakers, and others. To this end, we are proactively sharing information about evaluation work in progress, such as the evaluation questions we are exploring, and when the field can expect results. Our Barr Fellows program evaluation is one example of this practice. We are also building a new knowledge center for Barr to highlight and share research and reports from our partners, and make these reports easier for practitioners and policymakers to find and re-share.

GP: Clearly all of this takes time and resources to do well. What benefits can you point to of investing in learning and knowledge sharing?

YB: Our new Impact & Learning page reflects our aspiration that by sharing work in progress and lessons learned, we hope to influence nonprofits and other funders, advance field knowledge, inform policy, and elevate community expertise. When you are working on changing complex systems, there are almost never silver bullets. To make headway on difficult social problems we need to view them from multiple perspectives and build learning over time by analyzing the successes – and the failures - of many different efforts and approaches.

GP: Barr’s president, Jim Canales, is featured in a video clip on the Impact & Learning page talking about the important role philanthropy plays as a source of “risk capital” to test emerging and untested solutions, some of which may not work or fail, and that the field should see these as learning opportunities. And, of course, these struggles and failures could be great lessons for philanthropy as a whole. How do you balance this tension at Barr, between a desire to provide “risk capital,” the desire to open up what you are learning, and reputational concerns about sharing evaluations of initiatives that didn’t produce the desired results?

YB: It’s unusual for Foundations to be open about how they define success, and admissions of failure are notably rare. I think foundations are often just as concerned about their grantees’ reputation and credibility as their own. At Barr we do aspire to be more transparent, including when things that haven’t worked or our efforts have fallen short of our goals. To paraphrase Jim Canales, risk isn’t an end in itself, but a foundation should be willing to take risks in order to see impact. Factors that influence impact or the pace of change are often ones that funders often have control over, such as the amount of risk we were willing to take, or the conceptualization and design of an initiative. When a funder can reflect openly about these issues, these usually generate valuable lessons for philanthropy and reflect the kind of risks we should be able to take more often.

GP: Now that you are entering your second year in this role, where are the next directions you hope to take Barr’s evaluation and learning efforts?

YB: In addition to continuing and sustaining robust evaluation for major initiatives across our program areas, and sharing what we’re learning as we go, we have two new areas of focus in 2019 – people and practices. We will have an internal staff development series to cultivate mindsets, skills, and shared habits that support learning, and we will also be working to strengthen our practices around strategy measurement so that we can be clearer both internally and externally about how we measure progress and impact. Ultimately, we believe these efforts will make our strategies stronger, will improve our ability to learn with and from our grantees, and will lead to greater impact.

 

Share This Blog

  • Share This

Subscribe to Transparency Talk

  • Enter your email address:

About Transparency Talk

  • Transparency Talk, the Glasspockets blog, is a platform for candid and constructive conversation about foundation transparency and accountability. In this space, Foundation Center highlights strategies, findings, and best practices on the web and in foundations–illuminating the importance of having "glass pockets."

    The views expressed in this blog do not necessarily reflect the views of the Foundation Center.

    Questions and comments may be
    directed to:

    Janet Camarena
    Director, Transparency Initiatives
    Foundation Center

    If you are interested in being a
    guest contributor, contact:
    glasspockets@foundationcenter.org

Categories