Articles  |  Consulting  |  Training  |  Presentations  |  Individual Mentoring  |  Q & A  |  Contact Barry  |  Home Page  |
A Model Program Evaluation Process

© By Barry Sweeny, 2008

The following table presents the basic program evaluation model which I use to guide my work. Of course, in practice, the steps are more complex than is evident here. Never-the-less, I share this to aid you in evaluating your own mentoring programs.

The original ideas for this model are loosely derived from the research and work of both Tom Gusky and Donald Kirkpatrick. See below for citations. The model has been refined over about 20 years of work in staff development, with grants, and many other kinds of programs. It has been refined and adapted to the point where I feel it represents a "best practice" model.

 Steps in the Process:

Check If Done

Planning Details

1. Set the Goals - purpose for the evaluation    
2. Identify the Audiences for the data    
3. Define the Indicators of success for each audience    
4. Check the Relevance of each indicator to program goals    
5. Determine the Scope of the evaluation process    

6. Organize the indicators by Data Type:

  • Reactions (survey attitudes)
  • Learning (self-assessment/test)
  • Behavior (observe extent of use)
  • Needs Assessment (obstacles to use? needs?)
  • Results (effectiveness, gains)
   
7. State the evaluation Questions that will guide this research    

8. Refine the evaluation questions for:

  • Measurability
  • Feasibility
  • Clarity
  • Validity & Fairness
  • Consensus
   

9. Select How to Collect the data:

  • Method
  • Design/Select Instruments
  • Need to Validate instrument?
   

10. List the evaluation Action Plan:

  • List the Activities
  • Set the Time Line
  • Decide the Persons Responsible
   
11. Estimate the Cost of the evaluation    
12. Gain Approval of Evaluation Plan and costs    
13. Collect the Data    
14. Analyze and Interpret the data    
15. Report the conclusions & offer recommendations    

Gusky, T. (1998). "The Age of Our Accountability". Journal of Staff Development. Fall, 36-44. National Staff Development Council. This is not the original source I used, but it is a good and more recent one.

Kirkpatrick, D. (1975). "Evaluating Training Programs". Madison, WI. American Society for Training and Development.

Kirkpatrick, D. (1977). "Evaluating Training Programs: Evidence Vs Proof". Training and Development Journal. 31, (11), 9-12.