You are here

Experimental Evaluation Design for Program Improvement

Experimental Evaluation Design for Program Improvement

October 2019 | 104 pages | SAGE Publications, Inc
The concepts of cause and effect are critical to the field of program evaluation. Experimentally-designed evaluations—those that randomize to treatment and control groups—offer a convincing means for establishing a causal connection between a program and its effects. Experimental Evaluation Design for Program Improvement considers a range of impact evaluation questions, particularly those questions that focus on the impact of specific aspects of a program. Laura R. Peck shows how a variety of experimental evaluation design options can provide answers to these questions, and she suggests opportunities for experiments to be applied in more varied settings and focused on program improvement efforts.
List of Boxes, Figures, and Tables
Volume Editors’ Introduction
About the Author
Chapter 1 • Introduction
The State of the Field

The Ethics of Experimentation

What This Book Covers

Questions and Exercises

Resources for Additional Learning

Chapter 2 • Conceptual Framework: From Program Logic Model to Evaluation Logic Model
Program Logic Model

Evaluation Logic Model


Questions and Exercises

Resources for Additional Learning

Chapter 3 • The Basic Experimental Design Defined
Random Assignment Explained

The Basic (Two-Armed) Experimental Design

To Have a Control Group or Not to Have A Control Group?

Questions and Exercises

Resources for Additional Learning

Chapter 4 • Variants of the Experimental Design
Multi-Armed Designs

Factorial Designs

Multistage Designs

Staggered Introduction Designs

Blended Designs

Aligning Evaluation Design Options With Program Characteristics and Research Questions


Questions and Exercises

Chapter 5 • Practical Considerations and Conclusion
Some Practical Considerations

Road Testing

Principles for Conducting High-Quality Evaluation

Questions and Exercises

Resources for Additional Learning

Appendix • Doing the Math and Other Technical Considerations
Estimating Treatment Impacts

How to Interpret Results

Handling Treatment Group No-Shows and Control Group Crossovers

Subgroup Analyses


Questions and Exercises

Resources for Additional Learning


Peck reminds us that the results from experiments only inform us about average effects, but more importantly provides us with the information necessary to look inside the "black box."

Roger Boothroyd
University of South Florida
Post-revision review

Experimental evaluations are feasible under the right conditions. This book is an excellent guide for evaluators that want to apply this underutilized design in their practice.

Sebastian Galindo
University of Florida
Post-revision review

 A sophisticated and well-written treatise of evaluation design to improve policies and programs.

Katrin Anacker
George Mason University
pre-publication review

Sample Materials & Chapters

Chapter 1: Introduction

Laura R. Peck

Laura R. Peck, Ph.D., is a principal scientist at Abt Associates and has spent her career evaluating social welfare and employment policies and programs, both in research and academic settings. A policy analyst by training, Dr. Peck specializes in innovative ways to estimate program impacts in experimental and quasi-experimental evaluations, and she applies this to many social safety net programs. Dr. Peck is currently the principal investigator, co-PI, or director of analysis for several major national evaluations for the U.S. Departments of Health and Human Services, Labor, and Housing and Urban Development and over her career has... More About Author

Purchasing options

Please select a format:

ISBN: 9781506390055

SAGE Research Methods is a research methods tool created to help researchers, faculty and students with their research projects. SAGE Research Methods links over 175,000 pages of SAGE’s renowned book, journal and reference content with truly advanced search and discovery tools. Researchers can explore methods concepts to help them design research projects, understand particular methods or identify a new method, conduct their research, and write up their findings. Since SAGE Research Methods focuses on methodology rather than disciplines, it can be used across the social sciences, health sciences, and more.