Program Development and Evaluation in Prevention
Publication Year: 2013
This seventh book in the Prevention Practice Kit illustrates how carefully constructed programs are involved with reaching prevention goals. Using examples and drawing from a clearly presented framework, this book helps readers easily translate concepts of program development and evaluation (PD&E) into doable, practical steps.
This book is guided by five tenets:
Prevention occurs through programs applied early.; A program is comprised of interrelated elements existing within an open system.; PD&E involves cyclical phases of planning, implementation and effects, while being infused by the processes of community, collaboration, and cultural relevance.; Conducting prevention PD&E relies on both technical and people skills.; Effective programs depend on sound processes that are guided by an overall 10-step PD&E in Prevention Model, which include planning the program, implementing process evaluation, and ...
- Front Matter
- Back Matter
- Subject Index
Other Books in the Prevention Practice Kit
Evidence-Based Prevention (9781452258003)
Prevention Groups (9781452257983)
Prevention in Psychology (9781452257952)
Social Justice and Culturally Relevant Prevention (9781452257969)
Public Policy and Mental Health (9781452258027)
Prevention and Consultation (9781452257990)
Best Practices in Prevention (9781452257976)
To my family: Lynn, Suzanne and Pete, Zack, and our dog, Lucy.
And to Andy Horne, my good friend and fellow trooper in prevention lo these many years.
Copyright © 2013 by SAGE Publications, Inc.
All rights reserved. No part of this book may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, or by any information storage and retrieval system, without permission in writing from the publisher.
Printed in the United States of America
Library of Congress Cataloging-in-Publication Data
Program development and evaluation in prevention / editor, Robert K. Conyne.
p. cm. — (Prevention practice kit)
Includes bibliographical references and index.
ISBN 978-1-4522-5801-0 (pbk.)
1. Preventive health services—Planning. 2. Medicine, Preventive. 3. Medical policy. I. Conyne, Robert K.
This book is printed on acid-free paper.
12 13 14 15 16 10 9 8 7 6 5 4 3 2 1
SAGE Publications, Inc.
2455 Teller Road
Thousand Oaks, California 91320
SAGE Publications Ltd.
1 Oliver's Yard
55 City Road
London EC1Y 1SP
SAGE Publications India Pvt. Ltd.
B 1/I 1 Mohan Cooperative Industrial Area
Mathura Road, New Delhi 110 044
SAGE Publications Asia-Pacific Pte. Ltd.
3 Church Street
#10–04 Samsung Hub
Acquisitions Editor: Kassie Graves
Editorial Assistant: Elizabeth Luizzi
Production Editor: Brittany Bauhaus
Copy Editor: QuADS Prepress (P) Ltd.
Typesetter: C&M Digitals (P) Ltd.
Proofreader: Jeff Bryant
Indexer: Diggs Publication Services, Inc.
Cover Designer: Glenn Vogel
Marketing Manager: Lisa Sheldon Brown
Permissions Editor: Adele Hutchinson
Thanks to Kim Bolen and to Kat Raczynski for all your assistance and to Lynn Rapin, all the University of Cincinnati students, and organizational consultees who have helped refine the model described in this book.
Appendix A: The 10-Step PD&E in Prevention Model[Page 46]
- Plan the Program
- Lay the groundwork for community, collaboration, and cultural relevance.
- Analyze local context and conduct professional literature review.
- Create problem statement.
- Develop preventive goals, objectives, strategies, and evaluations.
- Obtain inputs and resources.
- Implement, Including Process Evaluation
- Implement program plan with participants through strategies comprising sequenced and coordinated activities, tasks, responsibilities, resources, and timelines.
- Examine process evaluation data to generate feedback.
- Effects: Evaluate Output
- Examine outcome evaluation data to determine outcomes.
- Identify impacts, incidence reduction.
- Disseminate results.
Appendix B: Design the Prevention Program Implementation Plan[Page 47]
- Determine problem
- Set objectives
- Choose among alternative strategies
- Plan implementation
Appendix C: Design the Prevention Program Evaluation[Page 48]
- Plan A. Process/Formative Evaluation
- Key Processes
- Community orientation
- Cultural relevance/fit
- Evidence base
- Key Evaluation Criteria
- Adequacy, appropriateness
- Effectiveness, efficiency
- Side effects, sustainability
- Transferability, dissemination
- Usefulness and general contribution
- Key Processes
- Plan B. Outcome/Summative Evaluation
- Design process/formative evaluation
- Design outcome/summative evaluation
- Plan for sustainability
- Plan for replication and transferability
- Plan for dissemination and usefulness
Appendix D: Key Prevention Questions[Page 49]
- Were new cases eliminated or diminished?
- Were deficits reduced?
- Was the environment improved?
- Were strengths and natural supports increased?
References[Page 50]1982). Preventing psychopathology and promoting human potential. American Psychologist, 37, 1043–1050.(1985). The argument for primary prevention. Journal of Primary Prevention, 5, 213–219.(Albee, G., & Gullotta, T. (Eds.). (1997). Primary prevention works. Thousand Oaks, CA: Sage.http://dx.doi.org/10.4135/97814522438012005). Financial impact of a comprehensive multisite workplace health promotion program. Preventive Medicine, 40, 131–137., , , , & (American Psychological Association. (2002). Guidelines on multicultural education, training, research, practice, and organization change for psychologists. American Psychologist, 61, 271–285. Retrieved from http://www.apa.org/pi/multiculturalguidelines.pdfAmerican Psychological Association Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271–285.Association for Specialists in Group Work. (1998). Principles for diversity-competent group workers. Retrieved from http://www.asgw.org/PDF/Principles_for_Diversity.pdfBoard of Regents. (2008). Developing a logic model: Teaching and training guide. University of Wisconsin System. Retrieved from http://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html1979). The ecology of human development. Cambridge, MA: Harvard University Press.(Center for the Study and Prevention of Violence. (2002–2004). Blueprints for violence prevention. Retrieved from http://www.colorado.edu/cspv/blueprints/Centers for Disease Control and Prevention. (1999). Framework for program evaluation in public health. Morbidity and Mortality Weekly Report, 48 (RR11), 1–40.Centers for Disease Control and Prevention. (2005). Child maltreatment prevention. Retrieved from http://www.cdc.gov/ncipc/dvp/CMP/CMP-conque.htm2005). Practical program evaluation: Assessing and improving planning, implementation, and effectiveness. Thousand Oaks, CA: Sage.(2010). Prevention is primary: Strategies for community well-being. San Francisco, CA: Jossey-Bass.http://dx.doi.org/10.1300/J274v14n02_09, , & (1993). The science of prevention: A conceptual framework and some directions for a national research program. American Psychologist, 48, 1013–1022., , , , , , … ([Page 51]The Collaborative for Academic, Social, and Emotional Learning. (2003). Safe and sound: An educational leader's guide to evidence-based social and emotional learning (SEL) programs. Chicago, IL: Author.The Collaborative for Academic, Social, and Emotional Learning. (2008). Retrieved from http://www.casel.org/1989). How personal growth and task groups work. Newbury Park, CA: Sage.(2004). Preventive counseling: Helping people to become empowered in systems and settings ((2nd ed.). New York, NY: Brunner-Routledge.2010). Prevention program development and evaluation: An incidence reduction, culturally relevant approach. Thousand Oaks, CA: Sage.(1981). Environmental assessment and design: A new tool for the applied behavioral scientist. New York, NY: Praeger., & (Conyne, R., & Cook, E. (Eds.). (2004). Ecological counseling: An innovative approach to conceptualizing person-environment interaction. Alexandria, VA: American Counseling Association.2008). Group techniques: How to use them more purposefully. Upper Saddle River, NJ: Prentice Hall., , & (1997). A model for leading task groups. In H.Forester-Miller & J.Kottler (Eds.), Issues and challenges for group practitioners (pp. 117–132). Denver, CO: Love., , & (1978). HIP pocket guide to planning & evaluation. Austin, TX: Learning Concepts.(2006). Sustainable schoolwide social and emotional learning (SEL): Implementation guide and toolkit. Chicago, IL: CASEL., , , , & (1991). Cogenerative learning: Bringing participation into action research. In W.F.Whyte (Ed.), Participatory action research (pp. 127–142). Newbury Park, CA: Sage., & (2006). Transformative leadership for social-emotional learning. Retrieved from http://www.nasponline.org/resources/principals/Social%20Emotional%20Learning%20NASSP.pdf, , & (2001). Creating effective groups: The art of small group communication. San Francisco, CA: Acada Books.(2008). Cultural considerations in adolescent suicide prevention and psychosocial treatment. American Psychologist, 63, 14–31., , , , , & (2007). A resource for instructors, students, health practitioners, and researchers using the PRECEDE-PROCEED model for health program planning and evaluation. Retrieved from http://www.lgreen.net/(1999). Health promotion planning: An educational and ecological approach (, & (3rd ed.). Mountain View, CA: Mayfield.A group of brave otters vs. an alligator. (2011). Retrieved from http://www.pbs.org/wnet/nature/episodes/invasion-of-the-giant-pythons/video-alligator-vs-python/5541/Gullotta, T., & Bloom, M. (Eds.). (2003). Encyclopedia of primary prevention and health promotion. New York, NY: Kluwer.http://dx.doi.org/10.1007/978-1-4615-0195-42007). Best practice guidelines on prevention practice, research, training, and social advocacy for psychologists. The Counseling Psychologist, 35, 493–566., , , , , , & ([Page 52]Holden, D., & Zimmerman, M. (Eds.). (2009). A practical guide to program evaluation planning. Thousand Oaks, CA: Sage.2001). Making task groups work in your world. Upper Saddle River, NJ: Prentice Hall., , & (Institute of Medicine. (1994). Reducing risks for mental disorder: Frontiers for preventive intervention research. Washington, DC: National Academies Press.Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st century. Washington, DC: National Academies Press.2007). Community-based participatory research: Group work for social justice and community change. Journal of Primary Prevention, 30, 21–39., & (2008). Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. American Psychologist, 63, 146–159.(Kelly, J., & Hess, R. (Eds.). (1987). The ecology of prevention: Illustrating mental health consultation. New York, NY: Haworth.http://dx.doi.org/10.1300/J293v04n03_01Kenny, M., Horne, A., Orpinas, P., & Reese, L. (Eds.). Realizing social justice: The challenge of preventive interventions. Washington, DC: American Psychological Association.http://dx.doi.org/10.1037/11870-0002008). Individual and societal effects of mental disorders on earnings in the United States: Results from the national comorbidity survey replication. American Journal of Psychiatry, 165, 703–711., , , , , , … (2008). Designing and managing programs: An effectiveness-based approach (, , & (3rd ed.). Thousand Oaks, CA: Sage.2002). The mental health continuum: From languishing to flourishing in life. Journal of Health and Social Research, 43, 207–222.(2011, January 14). ACA update: Student-to-counselor ratio remains high. Retrieved from http://mail.google.com/mail/?hl=en&tab=wm#inbox/12d85143d505fa07(2011). Schools watch court case on breast cancer bracelets. Retrieved from http://www.usatoday.com/news/education/2011-01-12-bracelets12_ST_N.htm(2008). Transformative research and evaluation. New York, NY: Guilford Press.(1976). Training manual for student service program development. Boulder, CO: WICHE., & (1974). Dimensions of counselor functioning. Personnel and Guidance Journal, 52, 354–359., , & (Norcross, J. (Ed.). (2002). Psychotherapy relationships that work: Therapist contributions and responsiveness to patient needs. New York, NY: Oxford University Press.Office of Disease Prevention and Health Promotion. (2011). Improve heart health. Retrieved from http://mail.google.com/mail/#mbox/12e34551e7b0e7481997). Utilization-focused evaluation ((3rd ed.). Thousand Oaks, CA: Sage.2011). Universities miss the chance to identify depressed students. Retrieved from http://www.northwestern.edu/newscenter/stories/2011/01/depression-university-students.html(2010). Primary prevention and evaluation. In L.Cohen, V.Chavez, & S.Chehimi (Eds.), Prevention is primary: Strategies for community well-being (([Page 53]2nd ed., pp. 205–229). San Francisco, CA: Jossey-Bass.2007). Major contribution: Culturally-relevant prevention: The scientific and practical considerations of community-based programs. The Counseling Psychologist, 35, 763–778., & (1965). The “helper” therapy principle. Social Work, 10, 27–32.(1995). What is motivational interviewing?Behavioural and Cognitive Psychotherapy, 23, 325–334., & (2000). Major contribution: Prevention in counseling psychology. The Counseling Psychologist, 28, 733–763., & (2000). Evidence-based medicine: What it is and what it isn't. British Medical Journal, 31, 71–72., , , , & (2005). The logic model: A tool for incorporating theory in development and evaluation of programs. Administration in Social Work, 29, 180–190., & (2002). The skilled facilitator: A comprehensive resource for consultants, facilitators, manager, trainers, and coaches. San Francisco, CA: Jossey-Bass.(2006). Major contribution: The strength-based counseling model. The Counseling Psychologist, 34, 13–79.(2005). Psychotherapy, classism, and the poor: Conspicuous by their absence. American Psychologist, 60, 687–696.(2008). Positioning classism within counseling psychology's social justice agenda. The Counseling Psychologist, 36, 895–924.(2003, October). The CIPP model for evaluation. Paper presented at the annual meeting of the Oregon Program Evaluators Network, Portland, Oregon. Retrieved from http://www.scribd.com/doc/58435354/The-Cipp-Model-for-Evaluation-by-Daniel-l-Stufflebeam(1992). Multicultural counseling competencies and standards: A call to the profession. Journal of Counseling & Development, 70, 477–486., , & (1994). Research on psychotherapy with culturally diverse populations. In A.Bergin & S.Garfield (Eds.), Handbook of psychotherapy and behavior change (, , & (4th ed., pp. 783–817). New York, NY: Wiley.1978). Differential social program evaluation. Itasca, IL: Peacock., , & (U.S. Public Health Service. (2000). Report of the Surgeon General's conference on children's mental health: A national action agenda. Washington, DC: Department of Health and Human Services.2008, March). Commentary on the Choices program. In (Chair), Prevention practice: A workshop on prevention application programs that have demonstrated effectiveness. Paper presented at the 2008 International Counseling Psychology Conference, Chicago, IL.(2007). The Choices program: Multisystemic interventions for enhancing the personal and academic effectiveness of urban adolescents of color. The Counseling Psychologist, 35, 779–796., , , , , & (2003). Community interventions and effective prevention. American Psychologist, 58, 441–448., & (2006). The costs and benefits of enhanced depression care to employers. Archives of General Psychiatry, 63, 1345–1353., , , , , , … ([Page 54]Washington State Institute for Public Policy. (2004). Benefits and costs of prevention and early intervention programs for youth. Olympia: Washington State University.2010). Mental health in the realm of primary prevention. In L.Cohen, V.Chavez, & S.Chehimi (Eds.), Prevention is primary: Strategies of community well-being (pp. 370–405). San Francisco, CA: Jossey-Bass.http://dx.doi.org/10.1383/medc.184.108.40.206288, , , & (1950). The music man. New York, NY: Frank Music.(1979). The right stuff. New York, NY: Farrar, Straus, & Giroux. Retrieved from http://www.aarpmagazine.org/lifestyle(
About the Author[Page 57]
Robert K. Conyne, PhD, Professor Emeritus from the University of Cincinnati, is a Licensed Psychologist, Clinical Counselor, and Fellow of the Association for Specialists in Group Work (ASGW) and the American Psychological Association. He compiled 36 years of professional experience as a University Professor and Department Head, counselor, administrator, consultant, and trainer. Dr. Conyne has received many awards, including Eminent Career Award from the ASGW; Lifetime Achievement Award in Prevention, Society of Counseling Psychology of the APA; Distinguished Alumni Award of Distinction from Purdue University, and a Soros International Scholar. He was President of the APA's Division of Group Psychology and Group Psychotherapy and also of the ACA's ASGW. With more than 200 scholarly publications and presentations including 12 books in his areas of expertise (group work, prevention, and ecological counseling), along with broad international consultation in these areas—most recently with U.S. military personnel, Dr. Conyne is recognized as an expert in working with people and systems. With colleague (and wife), Lynn S. Rapin, PhD, he also helps people plan and prepare psychologically for their upcoming retirement, using the holistic approach they developed, “Charting Your Personal Future.” The edited Oxford Handbook of Group Counseling (2011) is his most recent offering, preceded by Prevention Program Development and Evaluation (Sage), and 12 other books. When not working, Dr. Conyne and his wife—as often as possible with their children Suzanne (married to Pete) and Zack—can be found traveling or enjoying life at their Northern Ontario cottage with their dog, Lucy.