Measuring impact without data

For the last few years my organization has launched a major initiative that has been paraded as a mission imperative. This initiative has the right intentions and a solid foundation that feeds right into the new strategic plan and vision. It is wonderful when it all comes together. But (of course there is a but in this story) it pushes for all of us to start measuring impact, not just outcomes and numbers. Dont just tell us how many people you served and what the objectives were, tell us how those people changed and what else was impacted.

When I hear them talk like that it makes me chuckle a little, not because I disagree, because I do agree. But rather I chuckle because we already have a hard enough time with filling complete and timely 990s, getting simple counts and gathering solid data. So now we expect them to measure real impact? But wait it gets better...

Not only does this new initiative ask for impact measurements, it provides no insight on how to do that, what data to gather, what to track, data standards or any tactical operation changes needed. To their credit after years of this, they finally see this weakness and they are working on it, but (wow there are a lot of buts in this story) the key word is "they" in that sentence. We, meaning the tech and operations staff, helped point out the needed clarity. But it is "they" who are working alone to try to fix this and develop a strategy, "they" have yet to include us in the conversation.

Anyway, I guess the lesson here is that it is not enough for leadership and others to just set a vision and hope people will figure out how to follow it.

Random things I have bumped into lately:

www.capaciteria.org, this seems like a cool site, but it does not appear to get used or to be very active, hmmm. In their words, Capaciteria is a comprehensive, searchable database directory of administrative resources that help nonprofits leverage their own capacity. It promotes peer review because MEMBERS can comment on and rate individual resource links as well as add useful new links. Like Google, search requests return link results weighted to rise based on ratings and popularity given to them by nonprofit users.

The Anecdote blog offered up an article, Why people don't use collaboration tools, that I found to be true and interesting. Often we throw a website or technology at a problem to fix it, which will always work, NOT!