LIFE, THE UNIVERSE & EVERYTHING: NONPROFIT PERFORMANCE MEASUREMENT

NonProfit Performance Measurement
by pam ashlund

I am fascinated by how quickly legislators determine our agenda. The latest example? Evaluations and Performance Objectives.

Anyone remember the way the introduction of the Performance Objective was heralded in to the non-profit world? "This will make you more effective", they told us. "This will validate our work". Blah Blah Blah. I, for one, drank the kool aid.

Then came the truth, somewhere between the ideal and the reality, the stats didn't change anything. Now a huge amount of staff time (not to mention trees sacrificed) is devoted to counting numbers, which go nowhere. Consider the following three problems:
  • There was no funding for a decent evaluation;
  • Evaluations take good research design;
  • Nonprofit administrators learned how to game the system by ever reducing their goals so that they might be achieved (after all you WILL get penalized if you don't meet those goals).

If that wasn't enough to drive a stake into the heart of performance objectives...how about asking some hard questions:

Example Goal: Ex: Reduce Poverty in Lincoln Heights

  • How much paperwork will it take to state and measure your goals?
  • How will the results you gather further your goal?
  • How will you pay for the evaluation?
  • How will you determine your research is valid (sample size, bias, etc.)?
  • Are your goals really goals or are you counting heads?


Technorati Tags: , , ,

Comments

Nonprofit Pundit said…
I heartily agree, but am concerned you have left out one key area:

Even if an organization had the ability to design and manage an appropriate and accurate evaluation consisting of a statistically meaningful sample, what are the realistic chances the report will be read by anyone who would actually understand the data?

What is the likelihood right now that any conclusion backed by "numbers," (no matter how meaningless accepted statistical normst would find them,) will be accepted as valid so long as it is quantifiable. What is the chance that anyone reading this very same report will have the sophistication to question the validity of what is measured? So if the bull shit that is measured in the Lincoln Heights example is defined (by someone with no idea what might actually eliminate or even ameliorate poverty in Lincoln Heights) as completion of a set of classes or training, and 7 out of 10 people enrolled complete the training, a legitimately expressed success rate of 70% will be used for utterly bogus conclusions. Is a discrete set of classes provided to 10 people likely to have a measurable effect on the overall poverty in the region? Not logically, so if this is a legitimate claim (that the classes were transformative) it would take much more complex data covering an extensive period of time and measuring a significantly larger number of people and elements than just the 10 enrollees and the 7 individuals that completed the class. Do program monitors, auditors or heaven forbid the politicians they are answerable to generally have high level statistics skills? Not bloody likely. Even accountants who are auditing program files and related outcome documentation, though used to working with numbers are unlikely to have ever taken a class in social science research methodology, which afterall is what these evaluations rest on. I must stop here to snurf up my sleeve, and roll my eyes.
11/13/2006 9:42 AM
Lovekandinsky said…
There's a really excellent article on evaluation at:

http://tinyurl.com/yy4gc6

It gets at a lot of your points here--worst of all, most of the time your results don't really matter to foundations anyway.
11/18/2006 6:23 PM
Post a Comment

Popular posts from this blog

BIRTH OF A BLOG: GUERILLA MARKETING, EFFECTIVE USE OF TECHNOLOGY & GOOD CONTENT WIN THE DAY

Birth of a Blog: Guerilla Marketing, Effective Use of Technology and Good Content Win the Day by pam ashlund A funny thing happened when I started using Technorati. All I wanted was a quick way to see who ( if ANYONE ) was linking to my blog. First, I had to sign up with one of these services and I picked Technorati because it was the first one I came across. Second, I then found out that I was right from the beginning, no one was linking to my site. Third, I decided to try my hand at a bit of self-marketing, which went as follows: Get my brother-in-law to link to my site Set up another dummy blog and link to myself Arm wrestle another friend to link to my site None of that had much of an impact (of course) so I moved on to some actual strategy: Add tags to my blog configuration on Technorati Add tags to my posts (this was painful and manual although I later found a script for it) Test the results - found I showed up in search engines a LITTLE bit more frequently Still no links (tap,
Read more

THE LIES PEOPLE TELL US (AND THE ONES WE TELL OURSELVES)

"I don’t understand these fundraisers, …they waste all this money…why don't they just give the money to …the sick people?" "…you know what? They don’t! They throw a party so rich people like me can spend $10,000 on a table and then they give it to the sick people!" ...that’s how it’s done ! Joan Cusack to Jennifer Aniston in "Friends with Money" Alright, let's get this over with folks: Fundraisers are a Lie! Yes that's right you heard me. A few months back, I attended a luncheon to raise funds for a school for the deaf. Yes, it was luncheon and a fashion show and a fundraiser all in one. First there was the obligatory silent auction, then (during lunch) the not-so-silent auction, and then after lunch when the plates were taken away, we were asked if we would like to purchase the Orchid Centerpieces! Hadn't they got enough from us? Let me think-No! Easy as it is to lampoon a fundraiser, that is not where I am going today. One of the ladies w
Read more

THREE NONPROFIT BLOG FAVORITES

The Best of 2007 and one new-comer Forgive me if I sing the praises (one more time) of my three favorite bloggers, but I simply must. These three blogs have enough material to keep me reading all winter (and real I will!). But before I begin, let me introduce a new nonprofit blog on the block. I don't know how I missed it, but it looks like it launched with a bang last September. UnCivilized Society is quite the entertaining blog. Admittedly I'm partial to the "Un's", ever since the Un-Cola, I've been into un. White Courtesy Telephone - Last time I checked this was Albert Ruesga's baby, but on a recent visit (shows how long I am on the uptake), I see a community of bloggers. I am here to sing the praises of them all. If I had to pick one word, I'd say "entranced". I'm still hoping to craft a post title so clever as this: Nonprofits, Virtual Worlds, and the Triumph of Ironic Distance GiftHub - What kind of being could blen
Read more