A Model Program
Evaluation Process
© By Barry Sweeny, 2008
The following table presents the basic program
evaluation model which I use to guide my work. Of course, in practice,
the steps are more complex than is evident here. Never-the-less,
I share this to aid you in evaluating your own mentoring programs.
The original ideas for this model are loosely
derived from the research and work of both Tom Gusky and Donald
Kirkpatrick. See below for citations. The model has been refined
over about 20 years of work in staff development, with grants,
and many other kinds of programs. It has been refined and adapted
to the point where I feel it represents a "best practice"
model.
| Steps
in the Process: |
Check
If Done |
Planning
Details |
| 1. Set the
Goals - purpose for the evaluation |
|
|
| 2. Identify
the Audiences for the data |
|
|
| 3. Define the
Indicators of success for each audience |
|
|
| 4. Check the
Relevance of each indicator to program goals |
|
|
| 5. Determine
the Scope of the evaluation process |
|
|
| 6. Organize
the indicators by Data Type:
- Reactions (survey attitudes)
- Learning (self-assessment/test)
- Behavior (observe extent of use)
- Needs Assessment (obstacles to use? needs?)
- Results (effectiveness, gains)
|
|
|
| 7. State the
evaluation Questions that will guide
this research |
|
|
| 8. Refine
the evaluation questions for:
- Measurability
- Feasibility
- Clarity
- Validity & Fairness
- Consensus
|
|
|
| 9. Select
How to Collect the data:
- Method
- Design/Select Instruments
- Need to Validate instrument?
|
|
|
| 10. List
the evaluation Action Plan:
- List the Activities
- Set the Time Line
- Decide the Persons Responsible
|
|
|
| 11. Estimate
the Cost of the evaluation |
|
|
| 12. Gain Approval
of Evaluation Plan and costs |
|
|
| 13. Collect
the Data |
|
|
| 14. Analyze
and Interpret the data |
|
|
| 15. Report
the conclusions & offer recommendations |
|
|
Gusky, T. (1998). "The Age of Our Accountability".
Journal of Staff Development. Fall, 36-44. National Staff
Development Council. This is not the original source I used, but
it is a good and more recent one.
Kirkpatrick, D. (1975). "Evaluating Training
Programs". Madison, WI. American Society for Training and
Development.
Kirkpatrick, D. (1977). "Evaluating Training
Programs: Evidence Vs Proof". Training and Development Journal.
31, (11), 9-12.