tag:blogger.com,1999:blog-25220098.post7893841464713810501..comments2023-10-02T09:09:12.963-07:00Comments on NonprofitEye: LIFE, THE UNIVERSE & EVERYTHING: NONPROFIT PERFORMANCE MEASUREMENTP. Ashlundhttp://www.blogger.com/profile/08849994782572188510noreply@blogger.comBlogger2125tag:blogger.com,1999:blog-25220098.post-91903372708309834062006-11-18T18:23:00.000-08:002006-11-18T18:23:00.000-08:00There's a really excellent article on evaluation a...There's a really excellent article on evaluation at: <br /><br />http://tinyurl.com/yy4gc6<br /><br />It gets at a lot of your points here--worst of all, most of the time your results don't really matter to foundations anyway.Lovekandinskyhttps://www.blogger.com/profile/17971255476487539791noreply@blogger.comtag:blogger.com,1999:blog-25220098.post-68761056489188959102006-11-13T09:42:00.000-08:002006-11-13T09:42:00.000-08:00I heartily agree, but am concerned you have left o...I heartily agree, but am concerned you have left out one key area:<br /><br />Even if an organization had the ability to design and manage an appropriate and accurate evaluation consisting of a statistically meaningful sample, what are the realistic chances the report will be read by anyone who would actually understand the data? <br /><br />What is the likelihood right now that any conclusion backed by "numbers," (no matter how meaningless accepted statistical normst would find them,) will be accepted as valid so long as it is quantifiable. What is the chance that anyone reading this very same report will have the sophistication to question the validity of what is measured? So if the bull shit that is measured in the Lincoln Heights example is defined (by someone with no idea what might actually eliminate or even ameliorate poverty in Lincoln Heights) as completion of a set of classes or training, and 7 out of 10 people enrolled complete the training, a legitimately expressed success rate of 70% will be used for utterly bogus conclusions. Is a discrete set of classes provided to 10 people likely to have a measurable effect on the overall poverty in the region? Not logically, so if this is a legitimate claim (that the classes were transformative) it would take much more complex data covering an extensive period of time and measuring a significantly larger number of people and elements than just the 10 enrollees and the 7 individuals that completed the class. Do program monitors, auditors or heaven forbid the politicians they are answerable to generally have high level statistics skills? Not bloody likely. Even accountants who are auditing program files and related outcome documentation, though used to working with numbers are unlikely to have ever taken a class in social science research methodology, which afterall is what these evaluations rest on. I must stop here to snurf up my sleeve, and roll my eyes.Nonprofit Pundithttps://www.blogger.com/profile/02091571125550822079noreply@blogger.com