The Glass Filing Cabinet: What the Packard Foundation is Learning about Learning in Public

(Paul Connolly is Senior Vice President of TCC Group, a management consulting firm that serves nonprofit organizations, foundations, and corporate community involvement programs.) 

Typically, when a foundation hires an evaluator to assess a program, that evaluator collects lots of information from a range of stakeholders, analyzes the data, writes a report, and discusses it with the funder. Then, an abridged final report is maybe shared with the field. The Packard Foundation has pursued a much more transparent and interactive approach for the current review of its Organizational Effectiveness program—an approach which the foundation staff likens to having "a glass filing cabinet."

For over two decades, Packard has been making grants to support such efforts as strategic planning, board development, succession planning, and web site upgrades to strengthen the organizational capacity of its nonprofit grantees. Packard retained TCC Group several months ago to help retrospectively assess 1,300 of these grants made during the past ten years and ascertain what constitutes a successful organizational effectiveness project. Packard is grappling with questions like: What is the sustained impact of the grants we make? How and to what extent can we quantify impact, its staff, and their outcomes? What contributes to the consultant relationship success? What are the factors that contribute to a successful project?

Packard began by compiling a huge data set based on grantee records and survey research and then asked TCC to help with the analysis. Rather than scrutinizing Packard's data on our own behind closed office doors, we are facilitating a "learning in public" process through which we are sharing early research findings widely and encouraging input. Leveraging Packard's organizational effectiveness wiki site, the project has set up a section of the wiki for grantees, consultants, funders, and other interested parties to review preliminary findings and provide feedback (we invite yours, too!). And conversations have been emerging on Twitter, blogs, and other social media venues.

What have we discovered so far about this networked approach to collective learning?

• The Packard Foundation has been praised at several recent philanthropy conferences (such as the June 6-7 Grantmakers for Effective Organizations learning conference) for its open approach, so there seems to be some support in the field for this type of inclusive evaluation process.
• There has been some engagement on the wiki, but not very much. We recognized that the wiki was not as technologically accessible as we had wished and are working on improving that. We are also realizing that asking a broad array of people to sift through and comment on a lot of "semi-baked" data is, well, asking a lot. (A few consultants even went so far as to say, justifiably, that they would only do so if they were paid for their time.)
• We have learned to cull the findings and extract a few noteworthy nuggets that we then highlight and ask for feedback on—so it is more like drinking water from a cup rather than a fire hose.
• We are also creating more opportunities for select constituents to participate in "old-fashioned" in-person discussion groups and teleconference webinars, during which we can "think out loud" with them. We have found that this live interaction engages people and make them more motivated to contribute their ideas online, too, as part of an ongoing conversation.

Ralph Waldo Emerson observed that "there are many things of which a wise man may wish to be ignorant." And New York University new media professor Clay Shirky points out that our society does not have a problem with information overload, but filter failure.

What are other foundations finding out about seeking broad input through two-way social media exchanges? How can philanthropies create better filters for seeking commentary when most people actually might not be that interested in poring through all of the information in those glass filing cabinets? At what point can a funder "over share" and ask constituents to review and comment on "too much information?" When is the best time to seek feedback from various types of stakeholders on slightly baked, half-baked, or fully baked findings? When soliciting experts' opinions, where exactly is that fine line between a foundation being open and receptive—and being presumptuous and insensitive? What is the best ways to blend online and offline input to maximize collective intelligence?

These are questions we are mulling over. We would like to hear what you think. And we would be glad to share more of our experience and insights as this public learning process evolves.

— Paul Connolly

Comments

[James_nathaniel]

This is a great effort.

Wikis aren't great for dialogue. In fact, they are often places to hide valuable information in the open public. Very easy at that point to pat yourself on the back for "doing transparency" and go home.

It's great to see that you've enhanced your wiki with more immediate communications fora, like discussion groups and social media channels.

Wikis are great places to create flexible banks of "canonical knowledge," which is to say - find patterns of consensus truths among your participants through dialogue, and later fit them into your wiki taxonomy.

You can then target appeals to stewarding the wiki to your most active participants. Caveat: wiki UI's aren't the most user-friendly, so staff time is invaluable in that stewardship - keeping the structure clean and navigable and participants trained and supported.

Nathaniel James, www.nathanieljames.org

[Cary Walski]

Good point, Nathaniel. I've been a part of many Wiki experiments that died with a whimper.

[Lesley Grady, Senior Vice President, Community Foundation for Greater Atlanta]

I tend to agree with the sentiments expressed above. I'm not as familiar with wiki's strengths and weaknesses, however i am sure that foundtaions must be strategic in our use of social media -- in fact, in the use of all of our relationship tools -- or we will overload, overinform, and over-expect--leading to underwhelming feedback and reaction that is not healpful. Everyone is in a relationship for a reason, and the connections between grantmaker and grant seeker is inherently unequal and tricky on its best days. Foundations should be deliberate in when and what we post, when we ask for feedback (bite sized nuggets on which the general public can provide value) and when we convene (live and on-line) specific folks with specific experience, exptertise and more. We should feel when things are cooked enough, even in our own minds, to share opr we will cause as much anxiety and transparency. Finally, we have to be okay with the fact that ultimately it is our job to sift through all the feedback to respond in ways that honor our mission and vlaues, our role in community (immediate and as a sector) and our place. And some folks are gonna have a problem with that.

[Joe]

I know Ismael enough to know this is the swsteeet kid, and the nicest family. I would love to help by organizing a fundraiser event and a jar at ihop. Please contact me (jamie walker) through cindy at Main St elementary. Much love and many prayers