Why evaluate your program?

33 %
67 %
Information about Why evaluate your program?
Government & Nonprofit

Published on October 1, 2014

Author: EricGraig

Source: slideshare.net

Description

This slideshare explains why nonprofit organizations should evaluate their programs. Beyond documenting program outcomes, it argues that program evaluation can and should be a key component of program improvement.

Why Evaluate?

Organizations evaluate in order to find the number.

The number of kids who graduate from high school. View slide

The number of people who are able to get and keep a new job for six months. View slide

The number of points by which students’ math scores rise.

The number of points by which a psychiatric patient’s depression score decreases.

These numbers all describe outcomes.

Outcomes are about the results of a program.

Outputs are about the steps you followed to produce those outcomes.

It’s important to understand the difference.

But what is the number for?

Why do we need to know the number?

Well, existing funders want to know if their investments yielded results.

New funders want to invest in programs that work.

Board members, staff, clients and community stakeholders want to associate with programs that are effective.

But what really is the number?

To be useful, the number has to represent a comparison against expectations.

Expectations that without the program, people/ institutions/ communities would not have changed.

Expectations that without the program, people/ institutions/ communities would not have changed. * If you remember back to your statistics course, this was called the null hypothesis.

So essentially, we have an experiment.

Differences between the number before the program and the number after the program have to be due to the program*. *All other things being equal

That was easy, right?

Pretty reasonable, wouldn’t you say?

Did you ever sign up for an online service where you had to check a box indicating that you had read and agreed to all the fine print?

Did you actually read all the fine print?

Neither did we.

But in this case you have to.

Differences between the number before the program and the number after the program have to be due to the program*. *All other things being equal

But all other things are N E V E R equal.

The boys may do better than the girls.

Counselors may interpret the treatment modality differently.

Participants with different work histories may respond differently to the work readiness program.

Looking at the average change in: Math Grade Depression Score Months on the job may not be enough.

But wait, it gets even worse. 

What if the boys do better than the girls UNLESS the girls are taught by Ms. Smith in which case they do better?

What if more experienced counselors do better regardless of differences in treatment modality?

What if differences in work histories are only important for workers moving from traditional office work?

Organizations that want to improve their programs need to understand these differences.

Because maybe the girls need more teachers like Ms. Smith.

Because maybe the girls need more teachers like Ms. Smith. *Find out what Ms. Smith does that she’s so effective with the girls.

And only the less experienced counselors need more training.

And only the less experienced counselors need more training. * Devote resources to retraining just the less experienced counselors.

And the workforce readiness program needs to treat people with experience doing office work differently than those who held blue collar jobs.

And the workforce readiness program needs to treat people with experience doing office work differently than those who held blue collar jobs. * Create two different programs, one for former office workers, the other for former blue collar workers.

Maybe what this means is that evaluation is about more than just the number.

Maybe beyond asking the question “did the program work” it should ask: Where did it work? For whom? Under what circumstances?

We believe that effective organizations use evaluation to document positive outcomes….

& to inform continuous improvement.

If these ideas interest you, we hope you’ll stay in touch. www.usablellc.net

Add a comment

Related presentations

Photos from Lodi Public LIbrary NJ of successful community partnership programs th...

This was presented at the Mauritius UNESCO Conference 2014 to celebrate the Inden...

The field of behavioral economics is revolutionizing the policy and business world...

Denne præsentation blev holdt 6/11-14 til et Rotary seminar. Indeholder tips og tr...

Related pages

Why Evaluate Your Program? - Early Childhood Learning and ...

Why Evaluate Your Program? Self-evaluation is an essential part of delivering high quality services to children with disabilities and their families.
Read more

Thinking About How to Evaluate Your Program? These ...

Thinking About How to Evaluate Your Program? These Strategies Will Get You Started. Rebecca Gajda & Jennifer Jewiss The University of Vermont.
Read more

WHY EVALUATE? - Kathryn Lindholm Leary Website

Why a Toolkit? How to use the Toolkit. Organization of Toolkit 1 Why Evaluate 2 How to Frame Evaluation ... it is difficult to evaluate your program, ...
Read more

Your Community-Based Program - Maternal and Child Health

Your Community-Based Program Putting Your Evaluation Plan to Work Part II Evaluating A publication of the American Academy of Pediatrics A Cooperative ...
Read more

Why Evaluate Your School Programs? - SAGE Publications Inc

Why Evaluate Your School Programs? T his is a legitimate question. After all, aren’t teachers and other school staff busy enough trying to educate students?
Read more

Basic Guide to Program Evaluation (Including Many ...

Your program evaluation plans depend on ... a program outcome model, why to ... If your program is new, you may need to evaluate the process in the ...
Read more

Illness Management and Recovery - Evaluating Your Program

Evaluating Your Program 1 Why Evaluate Your Illness and Management Recovery Program Has IMR been implemented Has IMR resulted in the Evaluating Your Program
Read more

www.vamentoring.org

Why Evaluate Your Program? You should evaluate your program because an evaluation helps you accomplish the following: Find out what is and is not working ...
Read more

Evaluate Your Corporate Compliance Program | ProPharma Group

Wondering Why You Should Evaluate the Effectiveness of Your Corporate Compliance Program?
Read more