Design high-impact professional learning programs with results-based evaluations With increasing accountability pressure for evidence-based strategies and ever-tightening budgets, you want to make sure that the time, effort, and resources you are investing in your professional learning programs is truly making an impact on educator effectiveness and student achievement. In this third edition of Assessing Impact, Joellen Killion guides administrators, professional learning leaders, school improvement teams, and evaluators step by step through the rigors of producing an effective, in-depth, results-based analysis of your professional learning programs. A recognized expert in professional learning, Killion emphasizes the critical role of evaluation in bolstering effectiveness and retaining stakeholder support for ongoing educator development. The methods outlined here help you: • Adhere to changes in federal and state policy relating to professional learning and educator development • Facilitate the use of extensive datasets crucial for measuring feasibility, equity, sustainability, and impact of professional learning • Produce more powerful, data-driven professional learning programs that benefit both students and educators • Evaluate the effectiveness and impact of professional learning to make data-informed decisions and increase quality and results Assessing Impact is a vital resource for staff developers and educational leaders seeking to improve the effectiveness and sustainability of professional learning, while retaining the support of parents and the public alike. Praise for the Second Edition: “Anyone who reads this book has to feel obligated to ‘set their world on fire.’ The text not only forces the reader to see how we are failing our children and their teachers, it provides the means for each of us to do better.” —Michael J. Ford, Superintendent Phelps-Clifton Springs CSD, Clifton Springs, NY
Chapter 11: Evaluate the Evaluation
Evaluate the Evaluation
The work of evaluators is not finished when the evaluation results are disseminated. It is at this point when evaluators step back from their work and evaluate the evaluation. Daniel Stufflebeam and Anthony Shinkfield (2007) describes meta-evaluation as
an evaluation to help detect and address problems, ensure quality, and reveal an evaluation’s strengths and limitations. It is the process of delineating, obtaining, and applying descriptive information and judgmental information—about the utility, feasibility, propriety, and accuracy of an evaluation and its systematic nature, competent execution, integrity and honesty, respectfulness, and social responsibility—to guide the evaluation and report its strengths and weaknesses. Meta-evaluation is a professional evaluation of evaluators. (p. 705)
This meta-evaluation step gives evaluators an opportunity to (1) assess their work ...