You are here

Experimental Evaluation Design for Program Improvement
Share

Experimental Evaluation Design for Program Improvement



October 2019 | 104 pages | SAGE Publications, Inc
The concepts of cause and effect are critical to the field of program evaluation. Experimentally-designed evaluations—those that randomize to treatment and control groups—offer a convincing means for establishing a causal connection between a program and its effects. Experimental Evaluation Design for Program Improvement considers a range of impact evaluation questions, particularly those questions that focus on the impact of specific aspects of a program. Laura R. Peck shows how a variety of experimental evaluation design options can provide answers to these questions, and she suggests opportunities for experiments to be applied in more varied settings and focused on program improvement efforts.
 
List of Boxes, Figures, and Tables
 
Volume Editors’ Introduction
 
About the Author
 
Acknowledgments
 
Chapter 1 • Introduction
The State of the Field

 
The Ethics of Experimentation

 
What This Book Covers

 
Questions and Exercises

 
Resources for Additional Learning

 
 
Chapter 2 • Conceptual Framework: From Program Logic Model to Evaluation Logic Model
Program Logic Model

 
Evaluation Logic Model

 
Conclusion

 
Questions and Exercises

 
Resources for Additional Learning

 
 
Chapter 3 • The Basic Experimental Design Defined
Random Assignment Explained

 
The Basic (Two-Armed) Experimental Design

 
To Have a Control Group or Not to Have A Control Group?

 
Questions and Exercises

 
Resources for Additional Learning

 
 
Chapter 4 • Variants of the Experimental Design
Multi-Armed Designs

 
Factorial Designs

 
Multistage Designs

 
Staggered Introduction Designs

 
Blended Designs

 
Aligning Evaluation Design Options With Program Characteristics and Research Questions

 
Conclusion

 
Questions and Exercises

 
 
Chapter 5 • Practical Considerations and Conclusion
Some Practical Considerations

 
Road Testing

 
Principles for Conducting High-Quality Evaluation

 
Questions and Exercises

 
Resources for Additional Learning

 
 
Appendix • Doing the Math and Other Technical Considerations
Estimating Treatment Impacts

 
How to Interpret Results

 
Handling Treatment Group No-Shows and Control Group Crossovers

 
Subgroup Analyses

 
Conclusion

 
Questions and Exercises

 
Resources for Additional Learning

 
 
References
 
Glossary
 
Index

Peck reminds us that the results from experiments only inform us about average effects, but more importantly provides us with the information necessary to look inside the "black box."

Roger Boothroyd
University of South Florida
Post-revision review

Experimental evaluations are feasible under the right conditions. This book is an excellent guide for evaluators that want to apply this underutilized design in their practice.

Sebastian Galindo
University of Florida
Post-revision review

 A sophisticated and well-written treatise of evaluation design to improve policies and programs.

Katrin Anacker
George Mason University
pre-publication review

Sample Materials & Chapters

Chapter 1: Introduction


Laura R. Peck

Laura R. Peck, Ph.D., is a principal scientist at Abt Associates and has spent her career evaluating social welfare and employment policies and programs, both in research and academic settings. A policy analyst by training, Dr. Peck specializes in innovative ways to estimate program impacts in experimental and quasi-experimental evaluations, and she applies this to many social safety net programs. Dr. Peck is currently the principal investigator, co-PI, or director of analysis for several major national evaluations for the U.S. Departments of Health and Human Services, Labor, and Housing and Urban Development and over her career has... More About Author

Purchasing options

Please select a format:

ISBN: 9781506390055
$42.00

SAGE Research Methods is a research methods tool created to help researchers, faculty and students with their research projects. SAGE Research Methods links over 175,000 pages of SAGE’s renowned book, journal and reference content with truly advanced search and discovery tools. Researchers can explore methods concepts to help them design research projects, understand particular methods or identify a new method, conduct their research, and write up their findings. Since SAGE Research Methods focuses on methodology rather than disciplines, it can be used across the social sciences, health sciences, and more.