Note: Third in my list of guest bloggers this summer is David Henderson. David’s professional focus is on improving the way social sector organizations use information to address poverty. Here is his guest post:
I was recently turned down for a position at a startup-up big-data company focused on the philanthropic sector because I’m “too pessimistic”. This company initially sought me out since they don’t have any social sector expertise on staff, a likely requisite to make successful nonprofit software. Our courtship turned sour when I expressed my view that we have a lot more social sector initiatives than evidence that those interventions actually work.
My skepticism that social sector initiatives by and large work was wrongly misconstrued as pessimism that social progress is possible. Skepticism is a critical driver of intellectual curiosity. I spent a pretty penny on two degrees that essentially taught me how to critically assess the divide between rhetoric and results. Indeed, the null hypothesis in a statistical model assumes the intended effect is not present. I guess statisticians are just a bunch of pessimists.
Fundamentally, I believe the company I interviewed with was mirroring the widespread lack of intellectual curiosity that plagues the social sector and impedes real progress. Too many nonprofits are terrified of having their claims of social impact investigated, lest their effects are discovered to be more modest than claimed. And I don’t blame them. The funding community’s emphasis on investing in “what works” has resulted in a proliferation of noise as every nonprofit steadfastly argues their interventions cure everything. It’s no wonder evaluators are seen as Angels of Death.
I generally don’t favor taking cues from the for-profit world, but venture capital and angel investors’ practice of investing in people and teams over ideas is far more conducive to intellectual honesty in product (and social intervention) development. The basic premise of this investment strategy is that initial product ideas are generally wrong, but smart people will investigate, iterate, and innovate.
Compare that philosophy to the social sector, where the expectation is that nonprofits already have the answers, they just need money to scale them up. This assumption is largely incorrect, but by making funding contingent on the perception of effectiveness, the nonprofit sector is incentivized to not question the efficacy of its own work. In this model, continued funding depends on a lack of intellectual curiosity at best, and intellectual dishonesty at worst.
A better alternative is for nonprofits to embrace intellectual curiosity, and to be the first to question their own results. Under this model, nonprofits would invest in their capacity to intelligently probe the effectiveness of their own interventions, by staffing those with the capacity to sift through outcomes data and investing in the growing list of tools that are democratizing evaluation. Of course, this would require a shift in the funding community away from “investing in what works” to more humbly “investigating what works”.
A shift toward intellectual curiosity would create more space for the sector to solicit beneficiary feedback in the design of social interventions, as organizations would no longer be incentivized to defensively “prove” existing approaches work, and instead would be rewarded for proactively evolving practices to achieve better results. It is this very intellectual curiosity that led organizations like GiveDirectly and the Family Independence Initiative to invest in the poor directly, a departure from long-standing anti-poverty practices that the evidence suggests might actually work. It’s a shame that organizations imbued with a mission of experimentation deviate so far from the norm.
I don’t consider it pessimistic to question whether the sector is achieving its intended social impact. To the contrary, it’s rather cynical to set aside what should be the critical question for any nonprofit organization in the name of self-preservation. In order to achieve social progress, the sector needs to expel anti-intellectual policies and actors in favor of a healthy skepticism that questions everything, and is willing to try anything.
Photo Credit: NASA