For each step there are a subset of standards that are generally most relevant to consider box 2. In 1998 he received the senior biomedical research service award from the cdc. Similar to the policy evaluation case, a theory based approach to evaluating a horizontal initiative may focus on the overarching intervention theory i. All references in the checklist to exhibits and menus refer to this book. The role of theory in program evaluation is an important but neglected area in evaluation practice and theory. Introduction to carry out research on educational assessment henceforth ea in higher education, it will be supportive to have some theoretical considerations at hand. In this book, we use evaluation in a more restricted sense, as program evaluation or interchangeably as evaluation research, defined as a social science activity directed at collecting, analyzing, interpreting, and communicating information about the. The book features examples of small and largescale evaluations from a range of fields, many with reflective. Handbook on the theory and practice of program evaluation edward elgar. Program evaluation theory and practice, first edition. A theory based approach to impact evaluation maps out the causal chain from inputs to outcomes and impact, and tests the underlying assumptions.
Evaluation for education, learning and change theory and. Featuring helpful checklists, procedural steps, provocative questions that invite readers to explore their own theoretical assumptions, and practical exercises, the book provides concrete guidance for conducting large and smallscale evaluations. The main influences were the efforts to vastly strengthen the u. The framework comprises steps in evaluation practice and standards for effective evaluation figure 1.
Publications center for culturally responsive evaluation. Featuring helpful checklists, procedural steps, provocative questions that. Examining the role of cultural competency in program evaluation. Evaluation is the systematic process of delineating, obtaining, reporting, and applying descriptive and. Pdf theory and practice of program evaluation sandra. This resource guide discusses program theory and logic models. The checklist is based on essentials of utilizationfocused evaluation patton, 2012, sage publications. Despite wide agreement that this approach will address the why question, it has not often been effectively used. Handbook on the theory and practice of program evaluation. In its broadest meaning, to evaluate means to ascertain the worth of or to fix a value on some object. Applying program theorydriven approach to design and. Program theory has several important functions that can improve our ability to generalize from particular evaluations, contribute to social science theory, and achieve consensus in evaluation planning. May 04, 2008 effective program evaluation is a carefully planned and systematic approach to documenting the nature and results of program implementation. Because this volume is intended to demonstrate the diversity of practice, we have used a broad definition of program theory.
In practice, it is often helpful for an evaluation to. Program evaluation theory and practice, first edition 1st. A variety of search terms were used, including evaluation, program evaluation and history of evaluation. The evaluation process described below is designed to give you good information on your program and what it is doing for students, clients, the community and society. One way to do this is for the evaluator and program people to develop a very good description of. Program theory and logic models evaluation resources from wilder research. What is evaluation back to determining the evaluation question. Program evaluation represents an adaptation of social research methods to the task of studying social interventions so that sound judgments can be drawn about the social problems addressed, and the design, implementation, impact, and. Historical and contemporary evaluation paradigms, branches, theories, and approaches. We explore the theory and practice of evaluation and some of the key issues for informal and community educators, social pedagogues youth workers and others.
Evaluation theory gives me helpful ideas for practice 3. Program evaluation theory and practice 2nd edition request pdf. Mar 01, 2019 specific changes in program participants behavior, knowledge, skills, status and level of functioning are referred to as outcomes, and only changes to organizations, communities or systems as a result of program activities within seven to 10 years are described as impacts. There are several subpoints to address when completing each step, all of which are governed by the standards for effective program evaluation box 1. Administration is of importance for another reason too. Theory and practice page 7 public administration is the machinery used by the service state to place itself in a position to make plans and programmes that can carried out, and to carry out the plans and programmes it has made. Theory based approaches to evaluation use an explicit. Giovanni bruno, bocconi university giovanni cerulli, national research council of italy, institute of research on economic sustainable growth useful texts.
All human service programs are designed to make a difference in the lives of people or to improve our society. Program evaluation is a rich and varied combination of theory and practice. Evaluation theory, design and methods tei the evaluators. This description helps to identify how the program should lead to the. Definitions for experimental and quasi experimental evaluations 63. The leading text that covers both the theory and practice of evaluation in one engaging volume has now been revised and updated with additional evaluation. Read program evaluation theory and practice a comprehensive guide pdf on our digital library.
Collaborative evaluation of a high school prevention curriculum. Feb 07, 2012 the leading text that covers both the theory and practice of evaluation in one engaging volume has now been revised and updated with additional evaluation approaches such as mixed methods and principlesfocused evaluation and new methods such as technologically based strategies. Program evaluation models and related theories unc school of. Reviewing the overarching domains of evaluation theory. From program evaluation tip sheets from wilder research, issue 4. Each of the chapters has been revised to reflect current theory and practice, and four new chapters have been added. Theory based stakeholder evaluation tse, instead of fusing the theories of different stakeholders into a single unified theory, keeps the program theories of diverse stakeholder groups separate from each other and from the program theory embedded in the institutionalized intervention itself. This second edition of the theory and practice of online learning is an updated version of the highly successful 2004 first edition. Areas requiring further research are also highlighted, including the need to develop appropriate evaluation methodologies.
Program evaluation theory and practice, first edition a comprehensive guide 1st edition by donna m. Request pdf program evaluation theory and practice. If it does, the task of the evaluator is to produce a plausible case, with evidence, that shows what has. Evaluation theory and practice american university online. Hacsi for over thirty years now, many evaluators have recommended making explicit the underlying assumptions about how programs are expected to workthe program theory and then using this theory to guide the eval uation. Program evaluation theory and practice, second edition. Supporting documents include a glossary of terms appendix a. Program theory in evaluation is formulated in many different ways and applied for a variety of purposes. And when it comes to evaluating your results, a clear program theory makes it much easier to choose the. The principles and organizational roles should be fairly enduring, while the practice guide should be regularly updated with new examples, tools, and. Evaluation theory as a concept components of a meaningful evaluation theory alkins evaluation theory tree sample evaluation theories program theory that brings theory to life in evaluations 10 the concept of evaluation theory and so we begin.
An overview of program evaluation sage publications inc. Program theory and logic models 1 wilder research, august 2009 wilder research. Evaluation for education, learning and change theory and practice. Next, the theory of change and conflict assessment concepts are differentiated, and the role that theories of change can play for improved conflict program design, monitoring, and evaluation are discussed. Thus, the steps and standards are used together throughout the evaluation process. Further, universities began to recognize the importance of evaluation by offering courses in evaluation. How methods of collaborative evaluation enhanced a randomized control trial to inform program improvement muhsin michael orsini, david l.
As such, the program has been developed to encompass both. Feb 21, 2012 program evaluation theory and practice. It is widely used in public, nonprofit, and private sector organizations to. Regardless of the term used, it should be clearly stated at the outset of this paper that the content is provided with respect to developing a theory of the program works and that the evaluation of the program s theory is an evaluation of the program and. Theory and practice using stata course leaders unalouise bell, tstat s. A comprehensive guide this engaging text takes an evenhanded approach to major theoretical. The challenges to evaluating plans and planning are discussed, including the reliance on ex ante evaluations, a lack of outcome evaluation methodologies, the attribution gap, and institutional hurdles. Lipsey 1993 identified six elements of a program theory consisting of problem definition.
Processproduct model in the context of the theories that influenced their development. Not only will a clear program theory help others see the sense of your program, but it will help you make sure you are actually providing the package of services that have the best possible chance of helping participants. Theory based approaches are a logic of enquiry, which complement and can be used in combination with most of the evaluation. A program theory explains how and why a program is supposed to work. Wednesdays 34pm, institute for health and social policy, or by appointment email. Wilson was program director of the international development program. Central to ea are the dichotomous concepts like testing, evaluation, assessment, and examination. Step 1 assess and build program and organizational readiness for utilizationfocused evaluation. Mark daku, phd institute for health and social policy, mcgill university office hours.
Evaluation is part and parcel of educating yet it can be experienced as a burden and an unnecessary intrusion. This text explores the philosophical and theoretical roots of evaluation and builds a bridge between those roots and evaluation practice. The report then summarizes the december 2009 workshops sessions and key indicator and theory of change refinement outputs. Conceptual framework, methodology, and application. Request pdf program evaluation theory and practice 2nd edition the leading text that covers both the theory and practice of evaluation in one engaging.
Eric ed530598 program evaluation theory and practice. The evaluation is designed to test the theory to see if it holds true. Chen has contributed to the development of evaluation theory and methodology, especially in the areas of program theory and theory driven evaluations. This approach to evaluation focuses on theoretical rather than methodological issues. The theory and practice of online learning, second edition. It provides a logical and reasonable description of why the things you do your program activities should lead to the intended results or benefits. A comprehensive guide this engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from.
353 921 817 730 875 1131 1103 453 1208 919 576 882 871 426 360 1454 453 157 787 453 170 365 1498 1399 738 852 939 890 1029 1271 1434 969 894 946 954 1147 466 1543