In today’s Social Velocity interview, I’m talking with Tris Lumley.
Tris is Director of Development for New Philanthropy Capital (NPC), a U.K. think tank and consultancy that works with both nonprofits and funders. Tris focuses on both the demand and supply sides of innovation around social impact. His particular interest is putting impact at the heart of the social sector, including shared measurement, open data and systems thinking. He helped initiate, and now coordinates, the Inspiring Impact program which aims to embed impact measurement across the UK charity sector by 2022. He is also a trustee of the Social Impact Analysts Association, a member of the EU GECES subgroup on impact measurement in social enterprise, and the Leap of Reason Ambassadors Community.
You can read interviews with other social change leaders here.
Nell: A big focus of your work at NPC is making impact measurement ubiquitous in the UK’s nonprofit sector. How far is there to go and how does the UK compare to the US in impact measurement being a norm?
Tris: There’s undoubtedly been significant progress over the last decade on impact measurement in the UK, and NPC has been at the heart of that. There are several ways in which that progress is visible, as well as in the sector level surveys NPC has done to track change. For example, most charities say that they have invested more in impact measurement in the last five years, and as a result we see that it is increasingly the norm for charities to have a defined theory of change, a role within the organisation to lead on impact measurement, and to talk about their impact measurement efforts in their public reporting. Most institutional funders also say that they look for evidence of charities’ impact measurement efforts in their funding decisions. Demand for measurement advice is growing, and the impact measurement industry is growing in response – there are more consultants offering services in this area.
The growth of social (or impact) investing has also driven greater interest in impact measurement. The industry as a whole acknowledges the centrality of impact measurement and the need for social returns to be as well evidenced as financial returns. There have been a number of key developments to move the field forward here, from Big Society Capital’s outcomes matrix to the G8 Social Impact Investment Taskforce and European GECES reports and guidance on impact measurement – all of which NPC has helped to deliver.
What’s not as clear is how much progress there’s been on the use of impact measurement, rather than its mere existence. When NPC repeats our field level state of the sector research in 2016, we’ll be asking a number of questions to tease out whether impact measurement activity is leading to use of impact evidence in decision-making – whether it’s becoming embedded in practice.
My concern is that we don’t see the signs that impact measurement is driving learning, improvement, decision-making or wholesale shifts in allocating resources towards higher impact interventions, programmes and organisations. It feels like impact measurement is something that everyone acknowledges we need to do, but few have worked out how to use. With the result that it’s bolted on to the reality of organisations delivering services and raising funding, but not embedded at the core.
A few examples of what I mean: if impact measurement were driving learning, I’d expect to see lots of organisations sharing their insights on success and failure, and learning from each other. I’d expect to see common measurement frameworks which allow organisations to understand their relative performance. These are still very rare. I’d also expect to see investment by funders and investors in the infrastructure that we know is needed for learning – journals, online forums and repositories and practitioner networks. There are some emerging examples of these, like the What Works Centres, but they’re still mostly just getting off the drawing board.
Most importantly I’d expect to see charities adjusting strategies and programmes in response to their learning. Maybe I’m not looking in the right places, but the examples I do see are the exception, not the norm.
When it comes to comparing the UK and US, it’s really hard. We don’t have comparable field-level studies, and we need to work together more closely on these if we want robust insights. For example, if you compare the findings in NPC’s 2012 paper with a recent US study it looks like nonprofits are more likely to say the main purpose of impact measurement is learning and improvement. But actually we don’t know if this is the result of the questions we asked and how we asked them.
In both the US and the UK, it’s clear that the rhetoric on impact measurement has advanced over the last decade. What’s not yet clear is how the reality underlying that has shifted.
Nell: While there are many similarities between the US and UK nonprofit sectors there are some fundamental differences, in particular views about how much government (vs. private charity) should do for public welfare. How does the UK’s view of government’s role help or hurt the capacity building efforts of nonprofits?
Tris: The UK government has taken on a leading role in the social investment space, and it’s here that efforts to build capacity are most visible. Investment readiness programmes have been introduced over the past few years to build general capacity to access social investment. More recently, impact readiness programmes have arrived to do the same for impact measurement capacity. NPC has been working within these programmes to help a number of charities, and cohorts of charities, and it’s clear that they can play a major role in helping the sector to improve. But capacity-building in general has felt the effects of austerity just as much as any other area of government funding. Perhaps more so, as limited funds are increasingly focused on service delivery, not on efforts to improve services.
When NPC repeats its survey of the field, I am certain that we’ll find that limited funding to develop impact measurement capacity is still the major barrier cited by charities. It doesn’t look like anything’s going to change that any time soon.
Nell: NPC works at the nexus between nonprofits and funders, helping the two groups to understand and adopt impact measurement. In the US few funders will fund impact measurement systems, even though they want the data. How does NPC work to convince funders of the need for investments in measurement (among other capacity building investments)? What progress have you seen and what’s necessary for similar progress to happen in the US?
Tris: While a proportion of funders have for a long time supported evaluation, the majority still don’t. We’ve worked through programmes like Inspiring Impact (a sector-level collaborative programme to help embed impact measurement) with a group of funders to develop principles, and help them to embed support for impact measurement in their practice. These efforts can help those who already see the benefit of capacity-building to advance their work, but it’s tough to engage those who aren’t already thinking in this way. I think that the leap we need to make is to selling impact measurement through its benefits, by showing how organisations improve, and their impact increases, as a result. And because impact measurement isn’t yet typically embedded in organisations, those benefits aren’t as evident as they should be.
What does seem to work well is trying to get funders and charities to work together in a specific outcome area to make progress, rather than making a general case for impact measurement. Cohort capacity-building programmes, learning forums and shared measurement initiatives are all part of this. The key thing here is that then the funder is committed to the outcomes everyone’s working towards, and impact measurement becomes a tool for everyone to achieve those outcomes together.
Nell: You are part of the Leap Ambassador Community that recently released the Performance Imperative. Have you seen similar interest groups forming around these issues in the UK? And what role do you think interest groups like these play in a norm shift for the sector?
I have been privileged to be part of this amazing community of leaders, and one of a minority initially from outside the US. I’m convinced we need a similar movement here in the UK, and globally and have been discussing whether and how to approach this with the group from the start. And as co-Chair of Social Value International – a network of those working in the social impact field, I’m part of an effort to do this at the practitioner level too.
The Leap Ambassadors Community brings a human face to what is often seen as a technical subject. After 11 years of working in the social impact field, I am convinced that we cannot sell impact measurement just by increasing the supply of good technical solutions. We need a movement to build the demand for those solutions. We need the right frameworks to measure impact and manage performance. But we need the leaders to demand them, and to harness them to hold themselves accountable, learn and improve, and share what they find.
Photo Credit: NPC