In an ideal world, one of the things a nonprofit board of directors does is annually evaluate the performance of the executive director. But let’s be honest, how often does that actually happen?
I once had an executive director so desperate for feedback about her job performance from a board who refused to evaluate her that she hired me to interview board and staff and write her performance review.
Perhaps boards are uncomfortable with reviewing the CEO, or they don’t know how to manage it, or they are simply unaware that it’s their responsibility. Whatever the reasons, effective evaluation of nonprofit CEO performance doesn’t happen enough in the sector.
But for a nonprofit to be effective and sustainable there must be a system in place for regularly evaluating it’s chief staff member (not to mention the rest of the staff and the board of directors itself, but those are for another day).
As I’ve said before, the head staff member (CEO or executive director) is the most important position in a nonprofit organization. She affects the level of engagement of the board, the financial sustainability of the organization, the productivity of the staff, and ultimately the organization’s ability to achieve it’s mission. She is the chief spokesperson, chief fundraiser, chief cheerleader and so much more. At the very least, she deserves to know, on an annual basis, how well her board and staff think she is doing.
The CEO evaluation is an opportunity for the board to discuss the performance of their lead staff person, whether the organization is going in the right direction, and what, if any, adjustments need to be made. The discussion can offer a real point of organizational self-reflection that can re-energize and re-orient all involved.
So in order to inspire your nonprofit to create an annual system for evaluating the performance of your CEO or executive director, I’d like to offer some suggested questions to guide your board’s process. Ideally the board’s Governance or Board Affairs committee would be charged with managing the CEO evaluation each year. These are the types of questions they would want to answer (by surveying, compiling and analyzing staff and board feedback):
- What does the CEO do really well? What are his/her strengths as the leader of our nonprofit?
- Where is there room for improvement? What are his/her weaknesses as a leader of our nonprofit?
- How well does she/he recruit, manage and develop the board?
- How well does she/he recruit, manage, and develop the staff?
- How well does she/he guide the overall strategy of our nonprofit?
- How well does she/he serve as a spokesperson and external relationship builder for our nonprofit?
- How well does she/he ensure the financial sustainability of our organization?
It is critical to mention that the data gathered in the review process should be kept anonymous. You want board and staff to feel free to be honest in their responses and not fear reprisal or embarrassment for their candor. And when the board delivers the final evaluation to the CEO, they should do it in a way in which the CEO feels appreciated for the things she does well and supported in addressing any areas of concern. Ideally both board and CEO come away from the process feeling that the CEO has a clear path for the coming year and the tools and support she needs to get there.
If you need help getting your board moving forward on this process, or help coaching your leader to become more effective, check out the Leadership Coaching services I provide.
Photo Credit: Packer, poster artist, U.S. National Archives and Records Administration
In this month’s Social Velocity interview, I’m talking with Kathy Reich. Kathy leads the Ford Foundation’s BUILD initiative both in the United States and in 10 global regions. BUILD is an essential part of the foundation’s strategy to reduce inequality, a strategy arising from the conviction that healthy civil society organizations are essential to driving and sustaining just, inclusive societies. To that end, Kathy guides Ford’s efforts to implement sector-leading approaches to supporting the vitality and effectiveness of institutions and networks that serve as pillars of broader social movements.
Before joining Ford in 2016, Kathy was director of organizational effectiveness and philanthropy at the David and Lucile Packard Foundation, where she led a cross-cutting program to help grantees around the world strengthen their strategy, leadership and impact.
You can also read interviews with other social changemakers here.
Nell: You recently moved from the Packard Foundation to the Ford Foundation in order to launch their BUILD initiative, which is all about strengthening organizations. What are your goals with this new initiative and what successes have you seen so far? And what are you finding in terms of the areas where nonprofits need most help?
Kathy: The Ford Foundation has two big goals in mind for BUILD. First, we want to foster a measurably stronger, more powerful set of civil society organizations and networks working to address inequality around the world. Second, we aim to build understanding within the Ford Foundation, and ultimately throughout the field of philanthropy, about how strengthening key institutions can advance social justice.
The foundation has committed $1 billion over five years to BUILD because we believe that the fight against inequality needs resilient, durable, and fortified civil society institutions. Individuals and ideas also are critical, but the key role of institutions as drivers of sustained social change is a core, and sometimes overlooked, aspect of social justice work.
Each of the BUILD grantee organizations and networks will receive five years of support, at levels higher than what they have historically received from the Ford Foundation. Much of this support will be as flexible as we can legally make it; most grants will include generous general support. The remainder of each BUILD grant will provide support for nonprofit organizations and networks to strengthen their strategies, leadership, management, and finances. Each BUILD grantee will develop and then implement its own institutional strengthening plan. Although Ford Foundation staff will consult on drafts of these plans, the grantee will be “in the driver’s seat” in determining their institutional strengthening priorities and how best to address them.
So far we’ve made about 90 BUILD grants, and honestly it’s a bit early to say how well they are working. We do know where organizations are planning to spend the money. The vast majority of BUILD grantees, 79 percent, are choosing to strengthen their core operations, investing in areas such as financial management, fundraising, communications, evaluation, and HR. About two-thirds also are investing in strengthening capacities critical to social justice work, such as legal, research, network building, and advocacy. Close to half are investing in strengthening their strategic clarity and coherence, 36 percent are investing in leadership development and governance, and 32 percent are choosing to deepen their organizational commitments to diversity, equity, and inclusion.
It’s important to note that BUILD is not the Ford Foundation’s only investment in strengthening nonprofit institutions. BUILD is part of FordForward, the Ford Foundation’s multi-pronged effort to make philanthropy part of the solution to inequality in a deep and lasting sense. In addition to BUILD, two other aspects of FordForward focus on strengthening nonprofits. The foundation is giving more general support grants across all program areas, with a goal of making general support our default type of grant whenever possible. We also are increasing overhead rates on project grants to a minimum of 20 percent, to more adequately address the indirect costs of executing projects and programs.
Nell: This is a pretty innovative approach to capacity building, how do you plan to share what you learn with other funders and with the sector overall?
Kathy: We’re planning a robust evaluation and learning strategy, although we’re really just getting started. Our hope is to share some early findings by year’s end. We’ll be focusing on three sets of key questions throughout the five-year initiative:
- Do BUILD grants work? Do the organizations and networks that receive this funding become stronger and more durable over time? And if so, what if any impact does that have on the organization’s effectiveness?
- If the BUILD approach works, what about it works? Is it the general operating support, or a specific kind of organizational strengthening, or something else?
- Have we changed the way we do business at Ford, moving away from one-year project grants in favor of larger, more flexible grants?
Along with our evaluation and learning plan, we’re also developing a communications strategy to share what we learn with the field and engage in dialogue with others. We’ll be publishing evaluation results, speaking at conferences, and making active use of social media.
Nell: Both the Ford Foundation and the Packard Foundation are rare funders in that they are very committed to creating strong nonprofit organizations through heavy investment in capacity building. Do you think philanthropic and government funders are starting to follow your lead? Or what will it take to make that happen?
Kathy: Well, we certainly hope they are! It’s important to acknowledge that capacity building grantmaking is not new; in launching BUILD, we’ve learned from and appreciate the work of leaders in this field like the David and Lucile Packard Foundation, as well as the William and Flora Hewlett Foundation and the Evelyn and Walter Haas Jr. Foundation.
Over time, we hope that the ranks of capacity building funders will grow. We hope that BUILD will influence other donors by contributing to the evidence base that nonprofit capacity building works—that stronger, more durable, and more resilient organizations and networks are more effective at achieving their missions.
We also hope to contribute to the evidence base about what kinds of capacity building work best for organizations and networks of different types and sizes, working on different issues in diverse geographies. That’s a tall order, but one of the great things about being a global funder and being able to invest significant resources in BUILD is that we’re able to try this grantmaking approach with a broad range of institutions.
Nell: The Ford Foundation made a very public move two years ago to focus their efforts on fighting inequality. But that goal has arguably become harder given the political winds. How does a foundation like Ford navigate achievement of their desired impact in a potentially more difficult external environment?
Kathy: The Ford Foundation has worked in the U.S. and around the world for more than 70 years, and we’ve seen a lot of upheaval during that time. We’re acutely aware of the challenges facing our work, but we’re moving ahead with optimism and with what my boss Darren Walker calls “radical hope.”
BUILD is a big part of that hope. I believe strongly that in uncertain times, a BUILD approach to grantmaking is one of the smartest choices a foundation can make. By giving our grantees multi-year general operating support, we are giving them the resources and the flexibility to pivot their work quickly in the face of new realities. By also giving them thoughtful and flexible institutional strengthening support, we are enabling them to invest in their own leadership, strategy, management and operations at a time when they have to be at the top of their games.
Photo Credit: Ford Foundation
In today’s Social Velocity interview, I’m talking with Isaac Castillo, Director of Outcomes, Assessment, and Learning at Venture Philanthropy Partners, where he leads VPP’s approach to data collection, data reporting, and outcome measurement.
Prior to coming to VPP, Isaac served as the Deputy Director for the DC Promise Neighborhood Initiative (DCPNI). At DCPNI, Isaac led efforts to improve outcomes in the Kenilworth-Parkside community in Ward 7 of the District of Columbia through the strategic coordination of programmatic solutions and research-based strategies. Prior to his time at DCPNI, Isaac served as a Senior Research Scientist at Child Trends where he worked with nonprofits throughout the United States on the development and modification of performance management systems and evaluation designs. In addition, Isaac was also the Director of Learning and Evaluation for the Latin American Youth Center (LAYC) where he led the organization’s evaluation and performance management work.
You can read interviews with other social change leaders here.
Nell: You have spent your career using data to improve the performance of the nonprofits for which you worked. Why do you think performance management is so important for nonprofits? Do you think all nonprofits should pursue performance management? When does it make sense and when doesn’t it?
Isaac: I believe that every nonprofit should pursue some form of performance management because they owe it to the clients they serve. Most nonprofits will assume that they are making a positive difference in people’s lives, but in the vast majority of cases they are just guessing. Using some form of performance management will allow every nonprofit organization to confirm this thinking and to identify areas that can and should be improved so that the next cohort of participants can get better services than the last.
Unfortunately, one of the greatest challenges preventing a nonprofit from implementing some form of performance management isn’t a lack of resources, expertise, or time. It is fear. The fear that they will find out that their work isn’t having a positive effect. This fear is what nonprofit leaders need to overcome, not for the benefit of themselves or their organization, but because they owe it to the clients they serve today and the clients they will serve in the future. I believe that every nonprofit should strive to serve tomorrow’s clients better than today’s clients, and one of the only ways to ensure that this happens is the sustained use of performance management.
The type of performance management that each nonprofit should pursue should vary by the size and scope of their work. At a minimum, small nonprofits should be tracking basic demographic and attendance information on their participants, and hopefully at least one meaningful output or outcome. Whether this occurs in a computerized system or in a spiral paper notebook is up to the nonprofit. But it doesn’t have to be costly, and it doesn’t take expertise. It only takes the will and desire to improve as a nonprofit.
Nell: In the nonprofits in which you’ve worked how have you been able to secure resources to fund performance management? What is the case you and your colleagues have made to funders and what do you think it will take to get more funders investing in performance management?
Isaac: Raising funding for performance management work usually takes a mix of several different strategies and approaches for potential and existing funders.
First, I strongly encourage nonprofits to include some percentage (1 to 5 percent – possibly more) of funding in each grant submission or proposal dedicated to supporting performance management and outcome measurement work. By placing this small percentage into each proposal, a nonprofit can begin to raise funds for internal evaluation and performance management activities. It may not seem like a lot, but it can add up, and eventually generate enough funds for a half-time or full-time position to support in-house performance management work.
Second, I also strongly encourage nonprofits to engage in regular ‘funder education’ – where a nonprofit proactively meets with their funders to have ongoing conversations about outcome measurement and evaluation. This allows both the funder and the nonprofit to come to agreement on measurement expectations and to ensure that both groups are focused on the same concepts. I often suggest that the first of these types of meetings focuses on each group’s definitions of three commonly misunderstood terms: outputs, outcomes, and impact.
Finally, I would recommend that the nonprofit and funder have an honest discussion regarding expectations of results and the funding necessary to support the related evaluation work. If a funder is expecting an random control trial (RCT) to be completed to determine ‘impact,’ then the nonprofit should be willing to push the funder to support a large investment to pay for a high quality evaluation. If the funder is only willing to support a small amount for outcome measurement, then the nonprofit should clearly articulate what is possible.
Nell: Ken Berger and Caroline Fiennes recently argued that we may have gone too far by asking nonprofits to produce research about their own outcomes. What’s your response to that argument?
Isaac: I fully support Ken and Caroline in their argument that most nonprofits should stay away from trying to produce impact research. The desire for ‘impact’ is something that has been (and continues to be) pushed unfairly (and without financial support) by the funding community.
I honestly think a lot of confusion in this space comes from inconsistent use and understanding of the term ‘impact’. The term ‘impact’ has a precise definition among researchers but is often used in a much broader context among funders, nonprofits, and the general public. In the research and evaluation world, impact is used to describe the effectiveness of a program while eliminating as many potential confounding factors as possible. That is why the use of random control trials (RCTs) is usually the cornerstone of impact research – RCTs are the easiest way to control for and eliminate confounding factors.
When most non-researchers use the term ‘impact’ however, they are usually just asking if the program or organization works and if it is making a difference for its intended service population. That is a much lower bar to set, and yet it is a critical distinction in this discussion. If you are thinking about ‘impact’ as a researcher, you will need a large amount of resources and expertise to determine ‘impact,’ which usually means completing one or more formal evaluations. If you are thinking about ‘impact’ in the more general sense and less strict way, then pursuing some form of performance management system will allow a nonprofit to determine if their efforts have been successful.
I do think every nonprofit should pursue some form of performance management to ensure that their work is having a positive effect as a complement to existing research that others have done. Relying only on the use of others’ research does not guarantee that a nonprofit will provide effective services and achieve positive outcomes. This type of research is a like a recipe – it shows what has worked in the past and provides a guide for the nonprofit – but a recipe can still be ruined with poor implementation or planning.
Every nonprofit has an obligation to the people they serve (and not to their funders) to ensure that their programming is having a positive effect (or at the very least not causing harm). Without some form of performance management system in place (even one that just uses paper and pencil), a nonprofit will never know if they have strayed too far from the recipe provided by previous research.
I also think there are a growing number of very sophisticated nonprofits that should be using AND producing research on effective programs. Every year, I see more and more nonprofits that hire talented and unbiased researchers dedicated to internal evaluation and outcome measurement work. These individuals are just as talented and unbiased as their colleagues working in traditional research and evaluation organizations. They can, and should, produce original research that can help inform the nonprofit field. The real challenge comes in nonprofit organizations finding the resources to support the hiring and retention of these individuals. Not every nonprofit will have the resources or capacity to hire one or more of these individuals – but those that do should absolutely be trying to produce original outcome and impact research to provide ‘recipes’ for effective programming that nonprofits with fewer resources can use in the future.
Nell: Your former organization, DC Promise Neighborhoods, is part of the national Promise Neighborhoods Initiative launched by the US Department of Education in 2010 and modeled after the famous Harlem Children’s Zone. How successful has this national replication of a successful local model been? Have you been able to replicate outcomes? And what hurdles, if any, have you and other replication sites found?
Isaac: I think that there has been some initial success among the Promise Neighborhoods. Part of the challenge that all the Promise Neighborhoods face is that the Harlem Children’s Zone did not achieve their success overnight. They have been working in Harlem for decades, so it would be unrealistic to believe that the Promise Neighborhoods would be able to create large scale change in a matter of a few years.
However, there are signs of progress across all of the Promise Neighborhoods. Each of the Promise Neighborhoods started to address a few outcomes with the initial round of funding, and these outcomes varied. Some focused on math and reading proficiency for students, some focused on obtaining medical homes for young children, and others sought to increase the amount of healthy food consumed by residents. In DC, we focused on improving school attendance.
I do think that most of the 12 Promise Neighborhood Implementation grantees were able to make progress on the outcomes they identified as initial focus areas. However, the very nature of the work (creating community level change) doesn’t lend itself to the rapid accomplishment of multiple outcomes in a short period of time. Each of the Promise Neighborhoods had to prioritize certain outcomes for their respective communities, and only several years later are they able to claim success and begin to identify the next set of outcomes to be addressed. So while certain outcomes haven’t necessarily been replicated across all the Promise Neighborhoods, that is due to the differences in priorities and community conditions rather than any problem with the model itself.
Photo Credit: Venture Philanthropy Partners
Note: I was asked by The Center for Effective Philanthropy to review their latest research report, Sharing What Matters: Perspectives on Foundation Transparency, released in late February, and provide my thoughts about it for their on-going blog series on the report. Below is my post which originally appeared on the CEP blog.
Sharing What Matters: Perspectives on Foundation Transparency provides some startling data about the state of transparency in the foundation world.
While for the most part, foundation leaders recognize the importance of transparency and are trying to be more transparent, the report shows there is still much work to do.
To me, this question of foundation transparency is part of the larger, ever-present power imbalance in the nonprofit sector between those with money (funders), and those who seek that money (nonprofits). Funders often encourage nonprofits to be transparent about their results and when they have succeeded or failed. But it appears that in these two areas (results and lessons learned), funders are less transparent than either their grantees want them to be, or they would like themselves to be.
This is all critically important because a more transparent philanthropic sector — particularly if foundations were more transparent about how they assess their results and what has worked and what hasn’t — could mean more money flowing to more social change.
CEP’s report delineates two levels of foundation transparency. First is transparency about grantmaking: who leads the foundation, how they have made grants in the past, how they make decisions. The second is transparency about the results foundations themselves achieve: how they assess the performance of their investments, how they share successes and failures.
This second (and I would argue much more interesting) level of transparency is about foundations reporting the very thing they are often asking nonprofits to report: their performance.
In particular, the research uncovers three stark disconnects:
- Foundations Don’t Share How They Assess Their Performance
Of the foundation leaders surveyed, 61 percent said they believe being transparent about how their foundation assesses its performance could increase effectiveness to a significant extent. Yet, only 35 percent of foundations reported actually being very or extremely transparent about it.
- Foundations Aren’t Transparent about Successes and Failures
While 69 percent of foundation leaders think that being transparent about what’s worked in their grantmaking could increase their effectiveness, only 46 percent report being very or extremely transparent about what’s worked. And transparency about what hasn’t worked is even worse. 30 percent of foundation leaders say their foundations are very or extremely transparent about what does not work, which makes failures the lowest-rated area of foundation transparency. And nonprofits agree that foundation transparency is lowest when it comes to sharing what hasn’t worked.
- Foundations Want to Be More Transparent, But Aren’t
While 94 percent of foundation leaders surveyed say that increased transparency is a medium or high priority at their foundation, 75 percent of foundation leaders say that their current levels of transparency are not sufficient. And shockingly, 24 percent of foundation leaders say that nothing limits their ability to be more transparent. So it’s a big priority, yet it’s not getting done.
The report suggests some reasons why transparency about performance and lessons learned is recognized as important, but still far from ubiquitous in the philanthropic sector:
- Lack of Strategy: Foundations aren’t creating clear enough goals around which they can actually assess their performance.
- Lack of Capacity for Evaluation: Foundations aren’t allocating enough resources to assessing their performance.
- Fear of Diminished Reputation: Foundations are afraid of harming their own or their grantees’ reputations by revealing what has or hasn’t worked.
Surprisingly (or maybe not so surprisingly), these impediments to foundation transparency mimic the hurdles nonprofits find (or place) in their own way. Nonprofits often pour as much money as possible into programs and skimp on investing in organization-building efforts like strategy and evaluation. This bias against organization-building is often encouraged (or demanded) by their funders. And so it appears that funders put these same hurdles in their own way. Perhaps foundations, just like their nonprofit grantees, need to acknowledge that with sufficient investments in smart strategy and performance evaluation, greater results can be achieved.
The third and final impediment to foundation transparency about performance and lessons learned is trickier. Fear of harming the reputations of their grantees by sharing lessons learned is a real issue. Foundations tend to invest in packs. So if a foundation reveals investments that have failed, there is a risk that other foundations will flee.
But if we truly want to move to a place where more resources flow to what works, don’t we have to be more transparent about what worked and what didn’t work? If a foundation investment failed because of the foundation’s shortcomings (the investment didn’t fit with foundation goals, the foundation didn’t invest enough, or it didn’t invest in capacity as well as programs), the foundation (and other foundations learning from these lessons) could learn to become more effective investors. And if the investment didn’t work simply because it was the wrong intervention, then isn’t it better to move investments to interventions that do work? Fear can be a debilitating thing, and for the sake of greater results, I think both foundations and their nonprofit grantees must work to overcome it.
Ultimately, the CEP report is hopeful. It uncovers a desire among both foundation leaders and their grantees to move from a basic level of transparency toward a deeper (and more important) one that reveals performance and lessons learned.
Let’s hope that this stated desire for a change in foundation transparency, and the requisite changes in how foundations invest in strategy and performance assessment and overcome fear, becomes reality.
Photo Credit: The Center for Effective Philanthropy
From an historic blizzard that blanketed the country, to tackling poverty, to the leadership of Black Lives Matter, to technology in the new year, to using social media to stop ISIS, to advice for Charity Navigator, January was an interesting month in the world of social change.
- Winter storm Jonas dumped several feet of snow across the country, but also offered a couple of interesting lessons in social change. First, the sheer amount of snow piled up on east coast urban streets provided a glimpse into better urban design. And after the blizzard hit Washington, DC it seems only female senators were brave enough to come to work. Among them, Senator Lisa Murkowski wondered: “Perhaps it speaks to the hardiness of women…that put on your boots and put your hat on and get out and slog through the mess that’s out there.”
- Writing in the Nonprofit Quarterly, Tom Klaus took issue with those who criticize the Ferguson and Black Lives Matters movements as being “leaderless.” Instead, he argued that they demonstrate a more effective “shared leadership” model: “Shared leadership…means that multiple members of a team or group step up to the responsibility and task of leadership, often as an adaptive response to changing circumstances. Multiple members may emerge to lead at the same time, or it may be serial as multiple leaders emerge over the life of a team or group.” And The Chronicle of Philanthropy profiled three of the leaders of the Black Lives Matter movement.
- One of my favorite bloggers, David Henderson, has made a new year’s resolution to write more often. Let’s hope he keeps it up because he offered us two great ones this month. First, he wrote a scathing critique of the nonprofit and philanthropy sectors for not standing up against presidential candidate Donald Trump’s hate-filled ideology. And then he took it further in a later post arguing that the philanthropic sector must get more political: “It seems a strange consensus that philanthropy and politics do not mix. Yet it is our politics, and more specifically our collective values, that creates the maladies we aim to address. Martin Luther King was a civil rights pioneer not for creating a nonprofit that provided social services to help African Americans live a little better, but by challenging the laws and social values that subjugated a significant portion of our community. Social interventions like homeless shelters, food pantries, and tutoring programs are fundamentally responses to injustice. While these programs are wrapped in apolitical blankets, they are plainly and intuitively critiques of the system we live in.”
- And speaking of critiques, columnist Tom Watson wrote a sharp commentary on American philanthropy arguing that it is going the way of American politics — moving from democracy towards plutocracy: “The disparity between democratic philanthropy and its plutocratic cousin is nowhere more apparent than in the importance placed on the Facebook co-founder’s commitment to giving away much of his vast personal fortune compared with the potential of the largest digital social network in the nation. Mr. Zuckerberg’s billions may create major causes and eventually steer public policy, but many nonprofits will struggle to find in their budgets the money required to purchase desperately needed social-media eyeballs from his advertising department. If there’s a better example of the power gulf in American philanthropy, I’m not sure what it is.”
- And other critiques of philanthropy in January went even further, with some arguing that modern American philanthropy attempting to address growing wealth inequality (illustrated by a new Oxfam infographic “An Economy for the 1%“) is a paradox because philanthropy itself emerged from the wealth excesses of capitalism. A new book by Erica Kohl-Arenas argued that philanthropic interventions to solve poverty have been flawed because they don’t address the structural issues causing the poverty in the first place. And her argument was extended when she wrote about her view of a January 7th public event at the Ford Foundation where Darren Walker (who recently announced a new foundation focus on overcoming poverty) and Rob Reich discussed these issues.
- Caroline Fiennes argued that nonprofits should not try to “prove their impact,” since proof of impact is impossible, but rather use evaluation to gain knowledge that can help “maximize our chances of making a significant impact.” Patrick Lester, writing in the Stanford Social Innovation Review, offered a similar caution about outcomes, but this time to the Obama administration: “A dose of…realism, combined with a greater reliance on evidence and a willingness to learn from the past, could transform the administration’s focus on outcomes into an important step forward. By openly acknowledging the challenges and dangers, recognizing the difference between mere outcomes and true impact, and demonstrating how this time we will do better, the administration could show that what it’s really calling for is not just an outcomes mindset, but an Outcomes Mindset 2.0.”
- Speaking of proving results, Charity Navigator’s new leader, former Microsoft exec Michael Thatcher, and the board that hired him came under attack in January for not moving quickly enough away from rating nonprofits on financials and towards rating them based on results. But Doug White, writing an opinion piece in The Chronicle of Philanthropy and who created the beginning data behind Charity Navigator many years ago, took it even further took it even further: “Charity Navigator is far worse than nothing. The best that could happen is for the group to sink into oblivion, with no charities, no news outlets, and no donors giving it any thought. Or the group could take serious steps to grow up, humbly taking the time and effort to truly try to understand the charitable world.”
- Wanting to get further into the social change game, Facebook COO Sheryl Sandberg announced a new effort to use Facebook “Likes” to stop ISIS recruitment efforts on social media. It will be interesting to see how effective this slacktivism effort becomes at creating real change.
- Kivi Leroux Miller released her annual Nonprofit Communication Trends Report, including lots of data about how and where nonprofits are marketing. And while she found that YouTube is currently the #3 social network for nonprofits, that may change since YouTube just announced new “donation cards” that allow donors to give while watching a video.
- And finally, in January we lost David Bowie. But Callie Oettinger urged us not to be sad, but rather, inspired: “I [am] comforted in thinking of Bowie…on Mars, mixing it up with other artists…a place where the greats go to keep an eye on the rest of us and send down jolts of inspiration from above.” Yes.
Photo Credit: Northside777
There is an interesting report out today on the effectiveness of the Social Innovation Fund (SIF). Authored by the Social Innovation Research Center (SIRC), a nonpartisan nonprofit research organization, the new report details what has worked and what hasn’t in the six year history of the SIF.
Launched by the Obama administration in 2009, the SIF — a program within the Corporation for National and Community Service — provides significant funding to foundations that follow a venture philanthropy model by regranting that growth capital, along with technical assistance, to evidence-based nonprofits in “youth development, economic opportunity, and healthy futures” areas. In 2014, SIF expanded its efforts to include a portfolio of Pay for Success (social impact bond) grantees.
Now, 6 years on it is interesting to take a look back to understand what, if any, effect SIF has had on the nonprofit sector. The effect of the SIF is also critical given that, as of right now, the House and Senate have both defunded SIF in their respective funding bills.
To date, the SIF portfolio is made up of $241 million of federal investments and $516 million in private matching funds, which was invested in 35 intermediary grantees and 189 subgrantee nonprofits working in 37 states and D.C.
The SIRC report focuses on the current progress of SIF grants made during the first three years of the program (2010-2012). The report finds two clear positive results for the SIF so far. The SIF has:
- Added to the nonprofit sector’s evidence base about which programs work, and
- Built the capacity of nonprofit subgrantees, especially in the areas of “performance management systems, evaluations, financial management, regulatory compliance systems, and experience with replicating evidence-based models.”
On the negative side, however, the report finds that the SIF put real burdens on funders and nonprofits with its fundraising match requirements and the federal regulatory requirements. The report also finds that the SIF has had little effect on the sector as a whole because the SIF has not very broadly communicated their learnings so far.
To me, of course, most interesting are the report’s finding about capacity building at nonprofit subgrantees. There is such a need for nonprofit capacity building in the sector, and this was a clear goal of the SIF.
The SIF is one of few funders that do more than pay lip service to performance management by actually investing in building the capacity of nonprofits to do it. However, the SIF has been criticized for mostly selecting nonprofits that already had strong capacity. And indeed, the SIRC report finds that the SIF was most successful among those nonprofits that already had high capacity (in performance management, fundraising function, etc.) prior to SIF funding. Indeed, the report found that “poorly-resourced intermediaries working with less well-resourced community based organizations have been at a disadvantage.”
One SIF grantee in particular, The Foundation for a Healthy Kentucky, really struggled to build the capacity of their subgrantees whose starting capacity was so low. As they put it:
During the course of participation, it became clear that…[SIF] was really better suited for replicating existing programs or, at a minimum, investing in well-established programs that had some level of sophistication around organization systems and evaluation.
This mirrors earlier criticism of the SIF that it was set up to grow only those nonprofits that were already doing well, while those nonprofits that struggled with basic capacity issues were left out. The SIF has struggled to determine whether it is funding innovation (new solutions with limited capacity), or proven solutions (with a long track record and the corresponding capacity). It seems the two are mutually exclusive.
What the SIF is trying to do is such tricky business. To identify, fund and and scale solutions that work is really the holy grail in the social change sector. Certainly there are hurdles and missteps, but I think it’s exciting when government gets in the social change game in a big way. Six years is really too soon to tell. So I hope that this brief SIF experiment is allowed to continue, and we can see what a social change public/private partnership of this scale can really do.
To read the full SIRC report go here.
Photo Credit: Obama signs the Serve America Act in 2009, Corporation for National and Community Service
In today’s Social Velocity interview I’m talking with Mary Kopczynski Winkler, senior research associate with the Center on Nonprofits and Philanthropy at the Urban Institute. Mary is a nationally recognized expert in the field of performance measurement and management. She is a founding member of the Leap of Reason Ambassadors Community, a private community of nonprofit thought leaders and practitioners committed to increasing the expectation and adoption of high performance in the social sector and who released the Performance Imperative earlier this year.
You can read past interviews in the Social Velocity interview series here.
Nell: PerformWell is an effort among Urban Institute, Child Trends and Social Solutions to offer tools and strategies for human services nonprofits to measure their work. How successful has this effort been and what are your plans for continuing to grow the capacity of nonprofits to measure their work?
Mary: PerformWell is a free, interactive, web-based resource designed to help human services nonprofits gain knowledge about performance management, access tools and resources they need to better service clients and meet outcomes, and obtain strategies for effective, efficient service delivery. Launched in March 2012, the demand for PerformWell has exceeded our expectations with more than 400,000 visitors (from all 50 states and more than 200 countries); 25,000 individuals have registered for our webinars; and more than 140,000 assessment tools have been downloaded from our site. Webinar survey results are routinely high, but we are working to put additional systems in place to track how nonprofits are using various aspects of PerformWell and to what end.
In 2013, the PeformWell partners engaged in a business planning process with Root Cause. Market research confirmed our views about a large unmet need for performance measurement knowledge and high interest in the resources offered through PerformWell, but that additional products and services are also desired, such as webinar training series, regional user conferences, and customized engagements with nonprofits. Users wanted a more interactive web-experience.
Our short- to medium-term goals include substantial updates to the website to improve the user experience (we also plan to solicit user feedback during and after these changes are implemented); development of additional products and services better aligned with the feedback obtained from the market research undertaken by Root Cause; and exploration of partnerships and sponsorships with nonprofits, consultants and funders to generate additional revenue and resources to expand the content, reach and use of PerformWell to improve the adoption and application of performance measurement and management practice across the nonprofit sector.
Nell: Some believe that measurement is perhaps more straightforward for human services nonprofits — you can measure change to an individual’s behavior or life circumstances — but measurement is more difficult for arts organizations or advocacy groups. What are your thoughts on that?
Mary: Sometimes I think this argument serves as a convenient excuse for organizations to avoid putting even the most basic systems in place to track progress or otherwise hold themselves accountable to their constituents. In 2007, with support from the Hewlett Foundation, the Urban Institute and the Center for What Works, we published a series of simple frameworks, as part of our Outcome Indicators Project, to help nonprofits in 14 program areas engage in performance measurement. Two of these areas are advocacy and performing arts. The Urban Institute also provided research support to the Performing Arts Research Coalition (PARC) to develop standardized surveys to help performing arts organizations across the country obtain more routine and better data from audience members, subscribers, and the community.
Establishing a causal link between advocacy or arts interventions and impact is, in my view, more challenging than for human service organizations. In the case of advocacy organizations, it can be very difficult to isolate the contributions of a particular campaign or even organization to a policy or legislative outcome.
It is, however, possible to devise strategies for capturing information on earlier stage outcomes, such as increased awareness.
I recently participated on a panel at the annual OPERA America conference – on “internal metrics for civic impact.” As much as measurement activities have evolved from the days of the PARC coalition, I observed that most of the metrics and data points were still very internally focused on measures of participation and attendance and fall well-short of anything approximating community or civic impact. I encouraged those present to consider stepping away from a focus on the impact of an individual opera company’s contribution to civic impact, and recommended instead more of a collective impact approach in collaboration with other arts, civic, and education organizations in a community.
In this case, I even hesitated to use the word “impact,” and suggested the group consider distinguishing between collective contribution toward a modest set of civic outcomes (e.g., performing arts promote understanding of other cultures or are a source of pride for those in the community) and the more traditional causal attribution usually reserved for the term “impact.”
Nell: Caroline Fiennes, among others, has argued that individual nonprofits should actually do less evaluation and rather rely on larger research studies to prove their theories of change. What do you make of that argument and the difference between evaluation and measurement?
Mary: I agree with some of what Caroline puts forth here – particularly her observations about “withholding (unflattering research) and publication bias” – an issue that University of Wisconsin-Madison professor Donald Moynihan has termed “performance perversity.” I also agree both with her suggestion that evaluations be done by a third-party to reduce any tendencies toward subjective reporting or bias and her endorsement of a greater consideration of shared metrics.
I am troubled, however, by the fact that only 7% of UK social-purpose organizations are interested in improving services, and her somewhat cavalier suggestion that monitoring and evaluation “wastes time and money.” Although she is not alone in this second argument (see for example Bill Shambra’s “take-down” of Charity Navigator’s efforts to encourage greater use of performance metrics in “Charity Navigator 3.0: The Empirical Empire’s Death Star?”), such sweeping generalizations undermine the legitimate and courageous attempts of many nonprofits to use data for program improvement efforts.
I agree with Phil Buchanan in that there is a “moral imperative” to make an honest attempt to understand if resources are being used effectively and certainly to guard against the possibility that programs could be doing more harm than good as organizations like Latin American Youth Center and Harlem Children’s Zone have discovered and since corrected.
I see measurement as a necessary practice for every nonprofit. But measurement is different from evaluation. Nonprofits need to start by developing a measurement infrastructure that makes sense for their organization – one that supports their mission and commitment to serve and improve the lives of their clients or constituents – not one that is reactionary and responsive to funders. It is precisely this kind of infrastructure that can lay the groundwork for a more rigorous evaluation, at a time that is right and appropriate for the organization’s stage in development.
I see measurement and evaluation along a continuum of inquiry that should be designed to support the learning objectives of an organization. Measurement helps organizations to take the day-to-day or month-to-month pulse of various activities and program results – these snapshots in time or scorecards help managers and service providers understand trends and provide an opportunity to correct, modify or otherwise adapt operations.
Evaluation is, by definition, more rigorous, more expensive, and takes considerably more time to see results. Evaluation serves a very important role as organizations make decisions about whether to continue, grow, scale or otherwise expand services, but it needs to occur at the right time – and certainly not as an organization is just getting off the ground.
Nell: It is difficult for most nonprofits to find funding for measurement work. For example, in the most recent Nonprofit Finance Fund State of the Sector survey, 69% of nonprofit respondents said their funders rarely or never cover the costs of measurement. How do we change that, or can we?
Mary: Although I am sympathetic to this argument and argue frequently that foundations have a unique and critical role to play in helping to build the capacity of nonprofits to better engage in measurement and evaluation, I think we need to change the conversation to one that focuses on the shared responsibility between nonprofits and funders for making the necessary investments in measurement and evaluation.
If nonprofits are truly ready to embrace a culture of measurement and high performance, then they need to reorganize operations in ways that embed measurement practice at every level of the organization, and change expectations from front-line workers all the way to the board of directors.
This means things like: defining expectations about data collection in job descriptions; setting aside a small percentage of funding for evaluation as a line-item in every grant request; and using data in meaningful ways in everyday discourse. Likewise, funders need to work more collaboratively with grantees to understand the data needs and capacity of nonprofits, consider funding longer-term grants that build in support for measurement and evaluation, and stop asking for data or reports that aren’t part of the conversation about continuous improvement and learning. Funders, too, can support field-building efforts to develop additional tools and resources in support of the measurement work nonprofits seek to accomplish.
There are a number of exemplary efforts already underway including Edna McConnell Clark Foundation’s Propel Next and the World Bank Group’s support of Measure4Change and the East of the River Initiative. Each of these efforts feature: targeted grants to build measurement and evaluation capacity of participating nonprofits; access to technical assistance resources; and a community of practice to help grantees learn from each other, share successes or failures, and reduce what is all too often a sense of isolation among measurement and evaluation practitioners.
Photo Credit: Urban Institute
There were some pretty exciting things happening in the world of social innovation last month. From a new fund to make philanthropy more effective, to a new blog series written by funders making the case for investing in nonprofit leadership, to some ideas for making performance measurement more accessible to small nonprofits and arts and culture organizations, to some interesting partnerships between philanthropy and city government.
It all made for a great month of reads. Below is my pick of the 10 best reads in social innovation in September. As always, add what I missed to the comments. And if you want a longer list, follow me on Twitter, Facebook, Google+ or LinkedIn.
You can read past months’ 10 Great Social Innovation Reads lists here.
- The Fund for Shared Insight, a collaboration among seven major foundations, launched in September. The group plans to “pool financial and other resources to make grants to improve philanthropy…to encourage and incorporate feedback from the people we seek to help; understand the connection between feedback and better results; foster more openness between and among foundations and grantees; and share what we learn.” They plan to be very transparent with this entire experiment. I can’t wait to see what develops.
- Another development in the realm of improving philanthropy was the launch of the Stanford Social Innovation Review blog series where foundation leaders discuss why and how they have invested in nonprofit leadership development. As I mentioned earlier, Ira Hirschfield from the Haas Foundation kicked off the series, and Surina Khan from the Women’s Foundation of California was next up. To have such an open dialogue about nonprofit capacity investments, particularly around leadership development, is amazing. Let’s hope it encourages similar conversations outside the blogosphere.
- And the third piece from the world of philanthropic enlightenment, Daniel Stid of the Hewlett Foundation wrote a great post about ending the nonprofit starvation cycle. As he put it, “Effective leaders need to be willing to take the risk of saying something that a funder might not want to hear when their organization’s long run effectiveness is at stake. If they are not, then shame on them. Funders, for our part, should fund the full cost of the work we are asking our grantees to undertake in a way that leaves their overall organization and its finances whole; if we don’t, then shame on us.” Amen!
- There is further evidence that philanthropy as we know it is changing – a new report by The Economist takes a hard look at how Generations X and Y (those born between 1966 and 1994) are transforming philanthropy, particularly around “a strong desire to have a measurable, enduring impact.” This is exciting because if donors increasingly invest based on results, we can shift more money to social change. As the authors of the report put it, “The young generation of givers is focused on data, measurement and demonstrable results. More than any other generation, they want to check facts, know all the information ahead of time and ensure that they are well-informed at every stage of the process.”
- And there was lots to say about measuring performance this month. The Foundation Center and WINGS, a global network of 90 support organizations serving philanthropy in 35 countries, announced the creation of The Global Philanthropy Data Charter to gather and share philanthropy data for public benefit.
- Measuring impact is complex and costly, but Carly Pippin from Measuring Success, offers 4 steps for how small nonprofits can assess impact affordably.
- Measurement is particularly challenging in the arts and culture arena because, as Natasha Bloor of The Old Vic Theatre explains, “There is an understandable reticence within the cultural and creative industries when it comes to proving the social value of art. For many, the arts have an intrinsic worth that cannot be mapped or measured, with the primary benefit found in creative self-expression itself, rather than the longer-term effects experienced afterwards.” But she offers a new approach that they have found very effective.
- And for a completely free way to assess the social value of building low-cost housing, child-care centers, and health clinics there is the Social Impact Calculator, developed by the Low Income Investment Fund. They developed the tool to measure the effect of their own work and then decided to share it.
- Stephanie Jacobs of the Nonprofits Assistance Fund offers some tips to turn your board into the financial leaders they need to be.
- And finally, there were some interesting examples of partnerships between local government and philanthropy aimed at strengthening cities. Rona Jackson from Living Cities described 5 ways philanthropy and local government can work together. And the Kalamazoo Promise, a partnership between local philanthropists and city schools that pays tuition at a Michigan college for any student who graduates from a Kalamazoo school, shows these ideas in action.
Photo Credit: Valerie Everett