Note: As I mentioned earlier, I am taking a few weeks away from the blog to relax and reconnect with the world outside of social change. But I am leaving you in the incredibly capable hands of a rockstar set of guest bloggers. First up is David Henderson, Director of Analytics for Family Independence Initiative, a national nonprofit which leverages the power of information to illuminate and accelerate the initiative low-income families take to improve their lives. David also writes his own blog, Full Contact Philanthropy, which is amazing. Here is his guest post…
In early June I was invited to be on a data mining panel at the Stanford Social Innovation Review Data on Purpose conference. The conference was full of nonprofit executives interested in tapping the big data revolution for social good. Naturally, the panel moderator asked us panelist to weigh in on if, and how, data was changing the social sector. Characteristically, I turned a feel-good question into a critique of the state of analytics in the social sector, which I’ve written about elsewhere and will expand on here.
Data is not changing the social sector. I would argue it’s not changing the world either. While it is very likely that data is changing your world, I do not believe data is changing the world.
For all the talk about how data is revolutionizing the world and that software is eating everyone’s lunch, the fact is that for the over two billion people who have no lunch to eat (literally and figuratively), the impact of the data revolution is muted, if nonexistent all together. Changing the world indeed.
The corporate data revolution has largely been fueled by data exhaust. Data exhaust is comprised of the various digital breadcrumbs you and I leave all over the Internet but that we might not think about as data in a traditional sense. For example, companies like Facebook and Amazon don’t simply log data when you click “submit”, they track your every movement around the Internet, logging every click and clack, allowing unprecedented marketing optimization. All these additional metrics are data exhaust, as consumers are almost passively generating data marketers can capture and monetize for almost nothing.
On the social sector data conference circuit, countless data-wonk hopefuls mindlessly espouse all the incredible things nonprofits can do now that data acquisition costs have been driven almost to zero. This is nonsense, as the social sector has no such data exhaust analogue, which is why the social sector doesn’t truly have big data.
Nonprofits often work with populations with a number of barriers, which drives up the cost of data acquisition relative to for-profit counterparts. Just some of the data collection barriers nonprofits grapple with include working with populations with low levels of literacy or limited to no access to technology. How exactly is one going to generate digital exhaust without any digital possessions in the first place, or while working three jobs to support her family?
Obviously, you don’t. The barriers too many people face in this world are exactly why nonprofits are in the business of social change in the first place. But it is also why we are so poorly poised to capitalize on the alleged data ubiquity, as that revolution is not permeating class boundaries to the extent technology evangelists would have us believe.
Another reason why data is not changing the world, or rather, why the social sector is failing to change the world with data, is that by and large we simply are not investing in the necessary capacity to turn data into insights.
While a new “data for the social sector” company with an unfortunate misspelling of a common word seems to pop up every day, there are very few companies actually building the tools the sector needs to put data in to action. Meanwhile, our technological overlords in Silicon Valley are depressingly stuck on the assumption that innovation in the social sector means fundraising software. Sigh.
If we want to use data to change the world, we need to think beyond software tools and simple (if colorful) data visualizations. Nonprofits need to invest in building their own analytical capacity, both by hiring analysts and also by investing in the entire staff’s ability to be intelligent consumers of data analysis.
Illusion of Insight
Everyone loves the idea of being data driven, but very few organizations actually want to make the investment. My employer, the Family Independence Initiative (FII), did make that investment. In turn, FII is now able to not only run regressions and build decision tree models, but can continuously learn from its data, augmenting every level of the organization from Chief Executive to line staff.
That investment is not cheap. Worse yet, like any good analyst, I can be a major buzz-kill. Much of my time is spent explaining why a particular regression coefficient doesn’t necessarily mean we are super awesome. In fact, a good analyst can make you less sure of your social impact.
But facing the tough reality paves the way to real impact. We cannot collectively do more without exactingly quantifying how little we’ve accomplished. These are tough truths, and most nonprofits would rather assume the hypothesis of their greatness, leaving no room for data’s insights.
The Path Forward
Just because data is not changing the world does not mean data cannot change the world. I believe it can, which is why I do what I do. While by and large nonprofits fail to invest in rigorous analysis, organizations like GiveDirectly are leading by example, showing what is possible when fact is paramount to fundraising.
Ultimately, being data driven is less about statistical techniques and more about a relentless commitment to the truth. The truth is that data is not changing the world. But if we, as a sector, can elevate the truth above all else, then we might just be able to change the world after all.
June was an amazing month in the world of social change.
Most notably, the long fight for marriage equality was won with the Supreme Court’s ruling in Obergefell v. Hodges. It is moments like these where the long, arduous road towards social change makes sense. But that wasn’t all that was going on in the busy month of June. From “new” tech philanthropy, to the orthodoxies of philanthropy, to the oversight of philanthropy, it was all up for debate. Add to that some fascinating new ideas for museums, new data on how Millennials get their news, and a fabulous new blog about the history of philanthropy. It was a whirlwind.
And if you want to see past 10 Great Reads lists go here.
- The biggest news by far in June was the Supreme Court’s 5-4 ruling in Obergefell v. Hodges making gay marriage legal. In the ruling opinion Justice Kennedy writes: “As some of the petitioners in these cases demonstrate, marriage embodies a love that may endure even past death…Their hope is not to be condemned to live in loneliness, excluded from one of civilization’s oldest institutions. They ask for equal dignity in the eyes of the law. The Constitution grants them that right.” While this is a huge win for equality, I think the two really interesting parts of the story are 1) how relatively quickly gay marriage went from banned to law and 2) the various actors that made that social change happen. Some argue that Andrew Sullivan’s 1989 landmark essay in New Republic started the intellectual case for gay marriage. This New York Times interactive map shows how gay marriage went from banned to legalized state by state over time. And Evan Wolfson, founder of Freedom to Marry, describes the decades long struggle of nonprofit reformers and their donors, including the Haas Fund in San Francisco, to make marriage equality happen.
- A new blog, the HistPhil blog, launched in June to much acclaim. There is an enormous need for a historical perspective as we work to make nonprofits and the philanthropy that funds them more effective. HistPhil has already begun to provide that in spades with excellent posts on the Supreme Court ruling, among many other topics you will see below.
- Sean Parker, co-founder of Napster and founding president of Facebook, launched a new foundation and wrote a controversial piece in the Wall Street Journal about his “new” vision for philanthropy. Some found his ideas full of hubris, while others found him to be “an articulate evangelist for tech philanthropy.“
- And if that wasn’t enough philanthropic controversy for you, there were two other debates waging in June. First was the response to David Callahan’s New York Times piece, “Who Will Watch the Charities?” where he argued that we need greater oversight on nonprofits and their funders. Phil Buchanan of the Center for Effective Philanthropy quickly shot back that while Callahan raised some important questions, he ignored the complexity of the sector and reform efforts already under way. And then the two got into an interesting back and forth. Finally, Callahan wrote a follow up piece for Inside Philanthropy. Good stuff!
- Along the same lines, the other point of debate in June centered around a Stanford Social Innovation Review article where Gabriel Kasper & Jess Ausinheiler attempted to challenge the underlying assumptions in philanthropy. But now that we have a new expert on the history of philanthropy on the block, Benjamin Soskis from the HistPhil blog gave us a more accurate historical perspective about just what is and isn’t philanthropic orthodoxy.
- Michael O’Hare, professor of public policy at UC Berkeley, wrote a great long form piece in the Democracy Journal arguing that museums could become much more relevant and financially sustainable if, among other things, they began selling their stored artwork. Crazy controversial, but fascinating, ideas.
- Writing in the Stanford Social Innovation Review, Matthew Scharpnick cofounder of Elefint Designs, argued that recent ProPublica investigations of the American Red Cross uncovered our double standard for nonprofits. As he writes: “We are asking organizations to meet competing demands—many of which are at odds with how they are funded. We want nonprofits and NGOs to solve problems as effectively as private-sector organizations, and we want them to do it without any of the advantages and with far more constraints.”
- The Ford Foundation announced a sweeping overhaul in their grantmaking strategy. They will now focus solely on financial, gender, racial and other inequalities, and double their unrestricted giving. Larry Kramer, president of the Hewlett Foundation, described how he is closely watching this historic move. And Brad Smith, president of the Foundation Center, offered a view of how philanthropy has approached inequality.
- The Hewlett Foundation’s Kelly Born provided some interesting thoughts about what a new Pew Research Center report about how Millennials get their news means for civic engagement.
- And finally, on an inspirational note, Steven Pressfield articulated how “artists,” or really anyone hoping to bring something new into the world (a painting, a novel, a solution to a social challenge), should think: “As artists, [we believe]…that the universe has a gift that it is holding specifically for us (and specifically for us to pass on to others) and that, if we can learn to make ourselves available to it, it will deliver this gift into our hands.” Yes.
As I mentioned earlier, it is so important to take time away to rejuvenate and reconnect with your passions, family and friends. So I am taking my own advice and taking some time off later this summer to connect with the world outside of social change.
And so for the second summer in a row I’ve asked a group of social change thought leaders to write guest blog posts in my absence (you can read last summer’s guest blog posts here).
I am so excited about this year’s group of amazing social change thinkers. They are experts in social change finance, philanthropy, political reform, outcomes data, organizational effectiveness and much, much more. They are smart, thoughtful, engaged and visionary leaders. And they are all helping to move social change forward in big ways.
Below is the lineup of guest bloggers with background information on each of them. Their posts will begin in late July. Enjoy!
Antony is the CEO of Nonprofit Finance Fund (NFF), a national nonprofit and financial intermediary where he oversees more than $340 million of investment capital and works with philanthropic, private sector and government partners to develop and implement innovative approaches to financing social change. NFF also creates the annual State of the Sector Survey. Antony writes and speaks on the evolution of the social sector and the emergence of the global impact investing industry. Prior to leading NFF he was Managing Director at the Rockefeller Foundation. He is the founding board chair of the Global Impact Investing Network and convened the 2007 meeting that coined the phrase “impact investing.” You can read my past interview with Antony here.
UPDATE: Here is Antony’s guest post.
Kelly is a program officer at the Hewlett Foundation working on their Madison Initiative, which focuses on reducing today’s politically polarized environment. Before joining Hewlett, Kelly worked as a strategy consultant with the Monitor Institute, a nonprofit consulting firm, where she supported a range of foundations’ strategic planning efforts. In addition to her experience as a strategy consultant, Kelly has worked with various nonprofit and multilateral organizations including Ashoka in Peru, the World Bank’s microfinance group CGAP in Paris, Technoserve in East Africa, and both The Asia Foundation and Rubicon National Social Innovation in the Bay Area. Kelly guest lectures on impact investing at Stanford’s Graduate School of Business and often writes for the always thoughtful Hewlett Foundation blog.
UPDATE: Here is Kelly’s guest post.
Phil is President of the Center for Effective Philanthropy (CEP), a nonprofit that is the leading provider of data and insight on foundation effectiveness. CEP helps bring the voice of grantees and other stakeholders into the foundation boardroom and encourages foundations to set clear goals, and coherent strategies, be disciplined in implementation, and use relevant performance indicators. Phil writes and speaks extensively about nonprofits and philanthropy and rarely pulls punches when he does. He is a columnist for The Chronicle of Philanthropy and a frequent blogger for the excellent CEP Blog. He was named to the 2007, 2008 and 2014 “Power and Influence Top 50” list in The Nonprofit Times. You can read my past interview with Phil here.
UPDATE: Here is Phil’s guest post.
Kathy is Organizational Effectiveness and Philanthropy Director at the David and Lucile Packard Foundation where she helps grantees around the world improve their strategy, leadership, and impact. Her team makes grants on a broad range of organizational development issues, from business planning to social media strategy to network effectiveness. She also manages the Packard Foundation’s grantmaking to support the philanthropic sector. Prior to joining the Foundation, she worked in a non-profit, on Capitol Hill, and in state and local government in California. Kathy serves on the board of Grantmakers for Effective Organizations and on the advisory committee for the Center for Effective Philanthropy. You can read my past interview with her here.
UPDATE: Here is Kathy’s guest post.
I asked David to be a guest blogger again this summer because he is so insightful and often points out things that few others in the sector are willing to acknowledge. He is Director of Analytics for Family Independence Initiative, a national nonprofit which leverages the power of information to illuminate and accelerate the initiative low-income families take to improve their lives. David is also the former founder of Idealistics, a social sector consulting firm that helped organizations increase outcomes, demonstrate results, and organize information. He writes his own blog, Full Contact Philanthropy, which is amazing. You can read his past guest blog post here and my interview with him here.
UPDATE: Here is David’s guest post.
There is an interesting report out today on the effectiveness of the Social Innovation Fund (SIF). Authored by the Social Innovation Research Center (SIRC), a nonpartisan nonprofit research organization, the new report details what has worked and what hasn’t in the six year history of the SIF.
Launched by the Obama administration in 2009, the SIF — a program within the Corporation for National and Community Service — provides significant funding to foundations that follow a venture philanthropy model by regranting that growth capital, along with technical assistance, to evidence-based nonprofits in “youth development, economic opportunity, and healthy futures” areas. In 2014, SIF expanded its efforts to include a portfolio of Pay for Success (social impact bond) grantees.
Now, 6 years on it is interesting to take a look back to understand what, if any, effect SIF has had on the nonprofit sector. The effect of the SIF is also critical given that, as of right now, the House and Senate have both defunded SIF in their respective funding bills.
To date, the SIF portfolio is made up of $241 million of federal investments and $516 million in private matching funds, which was invested in 35 intermediary grantees and 189 subgrantee nonprofits working in 37 states and D.C.
The SIRC report focuses on the current progress of SIF grants made during the first three years of the program (2010-2012). The report finds two clear positive results for the SIF so far. The SIF has:
- Added to the nonprofit sector’s evidence base about which programs work, and
- Built the capacity of nonprofit subgrantees, especially in the areas of “performance management systems, evaluations, financial management, regulatory compliance systems, and experience with replicating evidence-based models.”
On the negative side, however, the report finds that the SIF put real burdens on funders and nonprofits with its fundraising match requirements and the federal regulatory requirements. The report also finds that the SIF has had little effect on the sector as a whole because the SIF has not very broadly communicated their learnings so far.
To me, of course, most interesting are the report’s finding about capacity building at nonprofit subgrantees. There is such a need for nonprofit capacity building in the sector, and this was a clear goal of the SIF.
The SIF is one of few funders that do more than pay lip service to performance management by actually investing in building the capacity of nonprofits to do it. However, the SIF has been criticized for mostly selecting nonprofits that already had strong capacity. And indeed, the SIRC report finds that the SIF was most successful among those nonprofits that already had high capacity (in performance management, fundraising function, etc.) prior to SIF funding. Indeed, the report found that “poorly-resourced intermediaries working with less well-resourced community based organizations have been at a disadvantage.”
One SIF grantee in particular, The Foundation for a Healthy Kentucky, really struggled to build the capacity of their subgrantees whose starting capacity was so low. As they put it:
During the course of participation, it became clear that…[SIF] was really better suited for replicating existing programs or, at a minimum, investing in well-established programs that had some level of sophistication around organization systems and evaluation.
This mirrors earlier criticism of the SIF that it was set up to grow only those nonprofits that were already doing well, while those nonprofits that struggled with basic capacity issues were left out. The SIF has struggled to determine whether it is funding innovation (new solutions with limited capacity), or proven solutions (with a long track record and the corresponding capacity). It seems the two are mutually exclusive.
What the SIF is trying to do is such tricky business. To identify, fund and and scale solutions that work is really the holy grail in the social change sector. Certainly there are hurdles and missteps, but I think it’s exciting when government gets in the social change game in a big way. Six years is really too soon to tell. So I hope that this brief SIF experiment is allowed to continue, and we can see what a social change public/private partnership of this scale can really do.
To read the full SIRC report go here.
Photo Credit: Obama signs the Serve America Act in 2009, Corporation for National and Community Service
This spring I have been trumpeting the Performance Imperative, a detailed definition of a high-performing nonprofit released by the Leap Ambassador community in March. Today I continue the ongoing blog series describing each of the 7 Pillars of the Performance Imperative with Pillar #2: Disciplined, People-Focused Management.
With this second Pillar, the Performance Imperative obviously makes a distinction between “leaders” in Pillar 1, and “managers” in Pillar 2. There is a note in the Performance Imperative that “leaders” and “managers” are typically two separate people in nonprofits with budgets over $1 million. So this distinction, and perhaps this Pillar, applies only to larger nonprofits.
But I think there is actually application to any nonprofit. In any nonprofit there are leadership tasks (creating the vision, being the cheerleader, marshaling resources) and there are management tasks (making sure the trains run on time, putting each resource to its highest and best use). In smaller organizations both sets of tasks fall to the same person, yet they both still need to be performed well. So I think it behooves any size nonprofit to analyze whether they are BOTH leading and managing well.
Effective managers put organization resources to their highest and best use. They recruit, train and retain the right talent, they use data to make good decisions, they manage to performance, and they are accountable.
You can read a larger description of Pillar 2 in the Performance Imperative, but here are some of the characteristics of a nonprofit that exhibits Disciplined, People-Focused Management:
- Managers translate leaders’ drive for excellence into clear workplans and incentives to carry out the work effectively and efficiently.
- Managers…recruit, develop, engage, and retain the talent necessary to deliver on the mission.
- Managers provide opportunities for staff to see…how each person’s work contributes to the desired results.
- Managers establish accountability systems that provide clarity at each level of the organization about the standards for success and yet provide room for staff to be creative about how they achieve these standards.
- Managers acknowledge when staff members are not doing their work well…managers are not afraid to make tough personnel decisions so that the organization can live up to the promises it makes.
The Center for Employment Opportunities (CEO) is an example of how strong management is necessary to create a culture of high-performance. CEO employs people entering parole in New York State in transitional jobs at government facilities while helping them access better paying, unsubsidized employment. CEO Chief Operating Officer, Brad Dudding described to me how CEO management created, over the past 10 years, a culture and system of high performance.
Here is his story:
In the early years, CEO focused program performance on meeting individual contract milestones, not a set of unified organizational outcomes. They were proficient in collecting data and reporting it to funders, but did not use data to track participant progress, to make course corrections, and to manage to short-term outcomes.
In 2004 the Edna McConnell Clark Foundation provided CEO with a multi-year capital investment to:
- Create a theory of change as a blueprint for program intervention and outcomes measurement.
- Develop a performance measurement system to track progress toward those outcomes.
- Nurture a performance culture that uses data to understand program progress, build knowledge and correct performance gaps.
First, CEO management had to agree on a theory of change and the specific outcomes for which the organization would hold itself accountable. Next, management shared the theory of change with staff and demonstrated how each staff member contributed to its achievement through an all staff event, follow-up trainings and consistent messaging that the organization was entering an exciting period of change. CEO then adopted a new performance measurement system to reinforce the theory of change.
But reorienting the organization was not easy. Not everyone was ready to embrace a new culture of performance accountability and data tracking. CEO management was initially surprised by staff resistance and responded impatiently with compliance measures. Looking back, not enough time was invested in staff training and promoting the value proposition of new changes. At times it was an enormous effort to get front line staff to track and use data everyday to ensure participant goals were being met.
But the tipping point came when CEO promoted early adopters of the data system to management positions. These new managers were comfortable operating in a data-driven environment and holding others accountable to use data to track program participants’ progress. Once there was a group of strong managers in place, CEO’s performance culture started to take hold and program outcomes improved.
By 2010, CEO was managing to annual performance targets and short-term outcomes through staff’s real-time documentation and data analysis.
In 2012, the results of a three-year randomized control trial showed that CEO’s program resulted in a reduction in recidivism of 16-22%. But the evaluation also uncovered a need to improve CEO’s strategies for advancing long-term employment and for connecting individuals to the full-time labor market. In response, CEO created a job retention unit and developed innovative job retention strategies, including training programs and financial incentives for participants.
In 2013, CEO entered the New York State Social Impact Bond, the first state-sponsored transaction, through which CEO will serve 2,000 high-risk parolees in New York City and Rochester between 2014 and 2018. If CEO hits benchmarks and reduces the use of prison and jail beds by program participants, investors will be repaid their principal and will receive a return of up to 12.5% by the U.S. Department of Labor and New York state.
The tenets of a performance based culture — supportive leadership, disciplined managers, goal setting, data collection and analysis to track and improve outcomes — are now fully accepted by CEO staff and reinforced by management. CEO now has a highly developed system of tactical performance management, which allows the organization to know on a daily basis if it is delivering on its promise to its participants.
Photo Credit: Australian Paralympic Committee
In today’s Social Velocity interview I’m talking with Mary Kopczynski Winkler, senior research associate with the Center on Nonprofits and Philanthropy at the Urban Institute. Mary is a nationally recognized expert in the field of performance measurement and management. She is a founding member of the Leap of Reason Ambassadors Community, a private community of nonprofit thought leaders and practitioners committed to increasing the expectation and adoption of high performance in the social sector and who released the Performance Imperative earlier this year.
You can read past interviews in the Social Velocity interview series here.
Nell: PerformWell is an effort among Urban Institute, Child Trends and Social Solutions to offer tools and strategies for human services nonprofits to measure their work. How successful has this effort been and what are your plans for continuing to grow the capacity of nonprofits to measure their work?
Mary: PerformWell is a free, interactive, web-based resource designed to help human services nonprofits gain knowledge about performance management, access tools and resources they need to better service clients and meet outcomes, and obtain strategies for effective, efficient service delivery. Launched in March 2012, the demand for PerformWell has exceeded our expectations with more than 400,000 visitors (from all 50 states and more than 200 countries); 25,000 individuals have registered for our webinars; and more than 140,000 assessment tools have been downloaded from our site. Webinar survey results are routinely high, but we are working to put additional systems in place to track how nonprofits are using various aspects of PerformWell and to what end.
In 2013, the PeformWell partners engaged in a business planning process with Root Cause. Market research confirmed our views about a large unmet need for performance measurement knowledge and high interest in the resources offered through PerformWell, but that additional products and services are also desired, such as webinar training series, regional user conferences, and customized engagements with nonprofits. Users wanted a more interactive web-experience.
Our short- to medium-term goals include substantial updates to the website to improve the user experience (we also plan to solicit user feedback during and after these changes are implemented); development of additional products and services better aligned with the feedback obtained from the market research undertaken by Root Cause; and exploration of partnerships and sponsorships with nonprofits, consultants and funders to generate additional revenue and resources to expand the content, reach and use of PerformWell to improve the adoption and application of performance measurement and management practice across the nonprofit sector.
Nell: Some believe that measurement is perhaps more straightforward for human services nonprofits — you can measure change to an individual’s behavior or life circumstances — but measurement is more difficult for arts organizations or advocacy groups. What are your thoughts on that?
Mary: Sometimes I think this argument serves as a convenient excuse for organizations to avoid putting even the most basic systems in place to track progress or otherwise hold themselves accountable to their constituents. In 2007, with support from the Hewlett Foundation, the Urban Institute and the Center for What Works, we published a series of simple frameworks, as part of our Outcome Indicators Project, to help nonprofits in 14 program areas engage in performance measurement. Two of these areas are advocacy and performing arts. The Urban Institute also provided research support to the Performing Arts Research Coalition (PARC) to develop standardized surveys to help performing arts organizations across the country obtain more routine and better data from audience members, subscribers, and the community.
Establishing a causal link between advocacy or arts interventions and impact is, in my view, more challenging than for human service organizations. In the case of advocacy organizations, it can be very difficult to isolate the contributions of a particular campaign or even organization to a policy or legislative outcome.
It is, however, possible to devise strategies for capturing information on earlier stage outcomes, such as increased awareness.
I recently participated on a panel at the annual OPERA America conference – on “internal metrics for civic impact.” As much as measurement activities have evolved from the days of the PARC coalition, I observed that most of the metrics and data points were still very internally focused on measures of participation and attendance and fall well-short of anything approximating community or civic impact. I encouraged those present to consider stepping away from a focus on the impact of an individual opera company’s contribution to civic impact, and recommended instead more of a collective impact approach in collaboration with other arts, civic, and education organizations in a community.
In this case, I even hesitated to use the word “impact,” and suggested the group consider distinguishing between collective contribution toward a modest set of civic outcomes (e.g., performing arts promote understanding of other cultures or are a source of pride for those in the community) and the more traditional causal attribution usually reserved for the term “impact.”
Nell: Caroline Fiennes, among others, has argued that individual nonprofits should actually do less evaluation and rather rely on larger research studies to prove their theories of change. What do you make of that argument and the difference between evaluation and measurement?
Mary: I agree with some of what Caroline puts forth here – particularly her observations about “withholding (unflattering research) and publication bias” – an issue that University of Wisconsin-Madison professor Donald Moynihan has termed “performance perversity.” I also agree both with her suggestion that evaluations be done by a third-party to reduce any tendencies toward subjective reporting or bias and her endorsement of a greater consideration of shared metrics.
I am troubled, however, by the fact that only 7% of UK social-purpose organizations are interested in improving services, and her somewhat cavalier suggestion that monitoring and evaluation “wastes time and money.” Although she is not alone in this second argument (see for example Bill Shambra’s “take-down” of Charity Navigator’s efforts to encourage greater use of performance metrics in “Charity Navigator 3.0: The Empirical Empire’s Death Star?”), such sweeping generalizations undermine the legitimate and courageous attempts of many nonprofits to use data for program improvement efforts.
I agree with Phil Buchanan in that there is a “moral imperative” to make an honest attempt to understand if resources are being used effectively and certainly to guard against the possibility that programs could be doing more harm than good as organizations like Latin American Youth Center and Harlem Children’s Zone have discovered and since corrected.
I see measurement as a necessary practice for every nonprofit. But measurement is different from evaluation. Nonprofits need to start by developing a measurement infrastructure that makes sense for their organization – one that supports their mission and commitment to serve and improve the lives of their clients or constituents – not one that is reactionary and responsive to funders. It is precisely this kind of infrastructure that can lay the groundwork for a more rigorous evaluation, at a time that is right and appropriate for the organization’s stage in development.
I see measurement and evaluation along a continuum of inquiry that should be designed to support the learning objectives of an organization. Measurement helps organizations to take the day-to-day or month-to-month pulse of various activities and program results – these snapshots in time or scorecards help managers and service providers understand trends and provide an opportunity to correct, modify or otherwise adapt operations.
Evaluation is, by definition, more rigorous, more expensive, and takes considerably more time to see results. Evaluation serves a very important role as organizations make decisions about whether to continue, grow, scale or otherwise expand services, but it needs to occur at the right time – and certainly not as an organization is just getting off the ground.
Nell: It is difficult for most nonprofits to find funding for measurement work. For example, in the most recent Nonprofit Finance Fund State of the Sector survey, 69% of nonprofit respondents said their funders rarely or never cover the costs of measurement. How do we change that, or can we?
Mary: Although I am sympathetic to this argument and argue frequently that foundations have a unique and critical role to play in helping to build the capacity of nonprofits to better engage in measurement and evaluation, I think we need to change the conversation to one that focuses on the shared responsibility between nonprofits and funders for making the necessary investments in measurement and evaluation.
If nonprofits are truly ready to embrace a culture of measurement and high performance, then they need to reorganize operations in ways that embed measurement practice at every level of the organization, and change expectations from front-line workers all the way to the board of directors.
This means things like: defining expectations about data collection in job descriptions; setting aside a small percentage of funding for evaluation as a line-item in every grant request; and using data in meaningful ways in everyday discourse. Likewise, funders need to work more collaboratively with grantees to understand the data needs and capacity of nonprofits, consider funding longer-term grants that build in support for measurement and evaluation, and stop asking for data or reports that aren’t part of the conversation about continuous improvement and learning. Funders, too, can support field-building efforts to develop additional tools and resources in support of the measurement work nonprofits seek to accomplish.
There are a number of exemplary efforts already underway including Edna McConnell Clark Foundation’s Propel Next and the World Bank Group’s support of Measure4Change and the East of the River Initiative. Each of these efforts feature: targeted grants to build measurement and evaluation capacity of participating nonprofits; access to technical assistance resources; and a community of practice to help grantees learn from each other, share successes or failures, and reduce what is all too often a sense of isolation among measurement and evaluation practitioners.
Photo Credit: Urban Institute
May was another busy month in the world of social change. For a start there was: a behavioral economics approach to social change, continued focus on civic tech, a tool for calculating a nonprofit’s true costs, new definitions of membership in the digital age, the evolving public library, digital sabbaticals, and much more.
Below are my 10 favorite reads in the world of social change in May, but feel free to add to the list in the comments. And if you want a longer list, follow me on Twitter, LinkedIn, Google+, or Facebook.
You can also read 10 Great Reads lists from past months here.
- Perhaps some solutions to social problems lie in behavioral economics. Writing in The New York Times, economists Erez Yoeli and Syon Bhanot and psychologists Gordon Kraft-Todd and David Rand argue that the opinion of others, in this case regarding the preservation of natural resources, is a strong social change motivator.
- Civic tech, (the use of new technology to better engage citizens in democracy) has become quite the buzzword lately. But how do we know which civic tech solutions are actually creating change? Anne Whatley from Network Impact offers some tools for assessment in that arena.
- And another nonprofit tool comes from Kate Barr of the Nonprofits Assistance Fund. She provides a great tool to help nonprofits calculate and then articulate to funders the full costs of their work.
- Daniel Stid from the Hewlett Foundation writes a thoughtful piece on what separates good strategic planning from bad, because as he puts it “The real benefit of planning is not the final document but rather the discipline the process imposes, the new information it generates, the working relationships it fosters, and the conversations, insights, and commitments it sparks.” Amen to that!
- In this age of social media and technological connectedness, how do we create more formal structures for belonging to institutions? Melody Kramer, formerly of National Public Radio, is a Knight Visiting Nieman Fellow working on that very question, and she offers some beginning thoughts on the project, including, “Imagine if public radio stations functioned as Main Streets…or in the same way that local public libraries do? It would transform the way people could interact — and participate — in the local news process, and would enhance the stories stations put out on air.” Fascinating.
- Speaking of libraries, NPR writer Linton Weeks provides a history of the public library and how it continues to (and must) evolve in the digital age.
- Great philanthropic futurist Lucy Bernholz has been offline for a bit, and it turns out she took a digital sabbatical. She reports that “without the addictive stimulation and distractions of digital life it feels like my brain grew three sizes.” What a great (and necessary) idea!
- Writing on the UnSectored blog, Marie Mainil describes the importance of building and supporting social movements to create global social change. As she puts it “Collecting data on the dynamics of local, regional, national, and international social change campaigns is the next frontier of organizing for social change. With a visual multi-level collection of ladders of engagement from across the world, social change actors would be able to better plan and coordinate tactics and actions at scale, thereby increasing their chances of success.”
- In May the Center for Effective Philanthropy held their biennial conference. Ethan McCoy provides great roundups of day one and day two. I almost feel like I was there!
- Never one to put things lightly, William Schambra cautions against what he sees as the hubris of tech philanthropists and his fear that they desire to “fundamentally…reshape the social sector in their own image, based on their supreme faith in advanced technology.”
Photo Credit: Erin Kelly
April was another busy month in the world of social change writing. From Google’s shift to mobile, to the Baltimore protests, to using sitcoms to change public opinion, to the pace of social change, to teens and social media, to a new way to measure a country’s performance, there was much to read and digest.
Below are my 10 picks of the best in the world of social change in April, but please add to the list in the comments. And to see what else I found beyond these 10, follow me on Twitter, Facebook, Google+, or LinkedIn.
And you can read past months’ 10 Great Reads lists here.
- There was much analysis about what went wrong in Baltimore, but I found the most insightful to be Dan Diamond’s Forbes piece about how it is fundamentally a “tale of two cities” and the persistent inequality between two very different Baltimores.
- As is Google’s way, they made a huge change to their search algorithm in late April that will affect us all. Google is now favoring websites that are mobile friendly. But fear not, Beth Kanter offers some advice for upgrading your nonprofit’s website.
- For those in the trenches, the pace of social change can seem glacial. But this great graphic from Bloomberg demonstrates that for many issues (prohibition, interracial marriage, women’s suffrage, same-sex marriage) there was a tipping point at which America very quickly changed its mind. Fascinating.
- Civic Tech, or using technology to make citizens more engaged and government more effective, is a huge investment opportunity, says Stacy Donohue from the Omidyar Network. With venture capitalists, the federal government and nonprofit and for-profit solutions all poised to make change, Donohue sees civic tech as a “very real, very now investment opportunity.” Let’s hope that new ideas and (most importantly) lots of new money can turn our struggling democracy around.
- Social change can happen in many different ways, including by altering popular culture. Former Daily Show correspondent Aasif Mandvi is attempting this kind of shift with his new web sitcom that takes a “Cosby Show” approach to portraying American Muslims in order to combat Islamophobia.
- Writing in Slate, Krista Langlois takes a hard look at her fellow environmental journalists and whether they have failed to adequately describe the environmental challenges facing our planet since American concern about climate change has actually declined in the last 20 years.
- One of the most common hurdles to nonprofits raising capacity dollars is the challenge of articulating to funders the potential impact of a capacity investment. Grantmakers for Effective Organizations (GEO) have put together some tools to help funders understand the importance of and return on capacity investments. Share these with your funders.
- In April, MIT and the Social Progress Imperative launched the Social Progress Index, an effort to create a complement to the Gross Domestic Product that measures a nation’s social and environmental performance. The Social Progress Index looks at 52 indicators of a country’s social and environmental performance (like child mortality rate, adult literacy rate, greenhouse gas emissions). As Michael Porter, one of the chief architects behind it puts it, “Measuring social progress offers citizens and leaders a more complete picture of how their country is developing. And that will help societies make better choices, create stronger communities, and enable people to lead more fulfilling lives.”
- Writing on the Huffington Post Politics blog, Robert Reich describes a worrying trend where nonprofits are silencing themselves for fear of losing their big donors. As he writes, “Our democracy is directly threatened when the rich buy off politicians. But no less dangerous is the quieter and more insidious buy-off of institutions democracy depends on to research, investigate, expose, and mobilize action against what is occurring.”
- And finally, if you want to understand where social media is going, Pew Research Center released their most recent findings about teens use of social media and technology.
Photo Credit: Patrick Neil