Principles-Focused Evaluation

The GUIDE

Michael Quinn Patton

HardcoverPaperbacke-bookprint + e-book
Hardcover
September 28, 2017
ISBN 9781462531905
Price: $105.00 $89.25
435 Pages
Size: 7" x 10"
order
Paperback
October 3, 2017
ISBN 9781462531820
Price: $50.00 $42.50
435 Pages
Size: 7" x 10"
order
e-book
September 12, 2017
PDF ?
Price: $50.00 $42.50
435 Pages
order
print + e-book
Paperback + e-Book (PDF) ?
Price: $100.00 $55.00
435 Pages
order

How can programs and organizations ensure they are adhering to core principles—and assess whether doing so is yielding desired results? From evaluation pioneer Michael Quinn Patton, this book introduces the principles-focused evaluation (P-FE) approach and demonstrates its relevance and application in a range of settings. Patton explains why principles matter for program development and evaluation and how they can serve as a rudder to navigate the uncertainties, turbulence, and emergent challenges of complex dynamic environments. In-depth exemplars illustrate how the unique GUIDE framework is used to determine whether principles provide meaningful guidance (G) and are useful (U), inspiring (I), developmentally adaptable (D), and evaluable (E). User-friendly features include rubrics, a P-FE checklist, firsthand reflections and examples from experienced P-FE practitioners, sidebars and summary tables, and end-of-chapter application exercises.

“In the past two decades, Patton has been perhaps the most creative contemporary thinker about how best to advance evaluation practice, with contributions including utilization-focused evaluation, qualitative evaluation methods, process use, complexity concepts, systems change in evaluation, and developmental evaluation, among others. Principles-Focused Evaluation continues Patton's impressive tradition of major breakthrough innovation. This book will undoubtedly expand your thinking and is a 'must read' for evaluation practitioners, scholars, and students. I give it my absolute highest endorsement.”

—Stewart I. Donaldson, PhD, Director, Claremont Evaluation Center, Claremont Graduate University


“Patton is one of our most innovative evaluation theorists—and this book underscores that point. P-FE provides the framework for implementing evaluations that are grounded in meaningful, actionable, and rigorous evidence. The book offers guidance on theory and practice plus examples that bring the concepts to life. No one else engages readers quite like Patton. Another exceptional contribution by a master!”

—Christina A. Christie, PhD, Chair, Department of Education, University of California, Los Angeles


Principles-Focused Evaluation provides a practical toolkit for guiding and shaping the urgent work of shifting institutions, systems, and cultures from maladaptive to adaptive states. Patton builds on his foundational work in utilization-focused evaluation and developmental evaluation. This is a timely and important book for evaluators—and for the social innovators, policymakers, educators, and funders with whom they work.”

—Stephen Huddart, President and CEO, The J. W. McConnell Family Foundation, Montréal, Québec, Canada


“Gender equity, empowerment, climate mitigation, poverty reduction, peacebuilding—these prevalent programmatic initiatives take many different forms but share principled foundations of action. In this book, Patton shifts the attention of evaluators to the fundamental propositions that drive change, offering a valuable approach for addressing the complexities of many—if not most—evaluation environments.”

—Ann M. Doucette, PhD, Research Professor, Claremont Graduate University; Director of Special Projects, The Evaluators’ Institute
Table of Contents

I. Principles: What They Are, Why They Matter, and Their Niche in Program Development and Evaluation

1. First Principles

2. Effectiveness Principles: What? Why? When? How? Who? Where?

3. Examples of Principles-Driven Change Initiatives and Programs

4. Evaluating Principles: Historical Context and Forward-Looking Challenge

5. The Niche and Nature of Principles-Focused Evaluation: Serving Diverse Purposes

II. GUIDE: Criteria for Effectiveness Principles

6. GUIDE for PRINCIPLES: The Characteristics of High-Quality Effectiveness Principles

G: Guidance

7. Guidance for Developing and Distinguishing Principles: Principles versus Rules, and the Alternative Principles Test

8. Referring to Something as a Principle Doesn’t Make It One: Distinguishing Effectiveness Principles

9. Still More Guidance on Developing and Distinguishing Principles: Principles Derived from and Contrasted with Assumptions, Truths, and Lessons

10. Conceptual Triangulation: Evaluating the Similarities of Parallel Principles

11. Holistic, Sequential, and Pole Star Approaches to Principles

U: Useful

12. Principles Point the Way to Desired Results

13. Diverse Uses of Principles across an Organization, Nora F. Murphy & Heather Huseby

14. Evaluating the Utility of Research-Derived Principles for Enhancing Online Learning

I: Inspiring

15. Inspirational Principles Are Infused with Values

16. Principles-Focused Evaluation at the Grassroots in Africa: Inspirational Examples and Reflections, John Wilson

17. Inspiring Principles: Distinguishing Overarching Principles from Operational Principles, Charmagne Campbell-Patton

18. Principles-Focused Pedagogy of Evaluation: Inspired by Freirean Pedagogy

D: Developmental

19. The Developmental Nature of Effectiveness Principles: A Case Example of Adapting Principles in Practice, Yve Susskind & Peggy Holman

20. Simple Rules and Minimum Specifications: Spotlight on Complexity Concepts with Developmental Implications

E: Evaluable

21. Evaluable Principles: Methods and Measures for Evaluating the Effectiveness of Principles

22. Principles-Focused Sampling

23. Rendering Judgments about the Effectiveness of Principles

24. Evaluating Principles for Evidence of Effectiveness: Three Kinds of Evidence-Based Judgments and Effective Principles in Contrast to Best Practices

Summary of Parts I and II: Major Themes of Principles-Focused Evaluation

III. Principles-Driven Initiatives with Principles-Focused Evaluations: Exemplars of Principles in Practice

III-A.Three Levels of Principles-Based Interventions: Macro (Global), Micro (Program), and Meso (Community)

25. Principles Driving Reform: Evaluation of the Paris Declaration Principles on Aid Effectiveness

26. Discovering and ValidatingEffectiveness PrinciplestoHelp Youth Overcome Homelessness

27. Vibrant Communities Canada: A Principles-Driven Systems Change Initiative and Emergent Example of Principles-Focused Evaluation Potential

Part III-B. Three Different Agriculture-Focused Initiatives

28. Collaborative Principles Supporting Shared Commitment: The Global Alliance for the Future of Food

29. Principles Enhancing Coherence: The McKnight Foundation Collaborative Crop Research Program

30. Principles Defining a Field of Agroecology: How Principles Inform and GUIDE Practices

IV. Principles for Evaluations and Evaluators

31. Evaluating Evaluation Principles: Examining Principles That Guide Evaluations and Evaluators

32. Outcome Harvesting Evaluation: Practical Application of Essential Principles, Ricardo Wilson-Grau

33. Reflections of a Principles-Focused Evaluator: What's in a Name?, Donna Podems

34. Waking Lumina: A Personal Principles-Based Evaluation Philosophy, Nora F. Murphy

V. Principles-Focused Evaluation in Practice: Tools and Checklist

35. Tools for Principles-Focused Evaluation

36. Principles-Focused Evaluation Checklist

Conclusion and Final Practice Exercise

Epilogue: Eleven Questions, Eleven Principles-Focused Responses


About the Author

Michael Quinn Patton, PhD, is an independent consultant who has been conducting program evaluations since the 1970s. Based in Minnesota, he was on the faculty of the University of Minnesota for 18 years and is a former president of the American Evaluation Association (AEA). His books include Developmental Evaluation, Developmental Evaluation Exemplars, Principles-Focused Evaluation,; Qualitative Research and Evaluation Methods (now in its fourth edition), and Utilization-Focused Evaluation (now in its fourth edition), among others. He is a recipient of the Alva and Gunnar Myrdal Evaluation Practice Award and the Paul F. Lazarsfeld Evaluation Theory Award, both from AEA, as well as the Lester F. Ward Distinguished Contribution to Applied and Clinical Sociology Award from the Association for Applied and Clinical Sociology. Dr. Patton is an active trainer and workshop presenter who has conducted applied research and evaluation on a broad range of issues and has worked with organizations and programs at the international, national, state, provincial, and local levels.
Contributors

Author

Michael Quinn Patton, PhD, Utilization-Focused Evaluation, Minneapolis, Minnesota



Chapter Authors

Charmagne E. Campbell-Patton, MA, Utilization-Focused Evaluation, Minneapolis, Minnesota

Peggy Holman, MBA, Journalism That Matters, Bellevue, Washington

Heather Huseby, PhD, Youthlink, Minneapolis, Minnesota

Nora F. Murphy, PhD, TerraLuna Collaborative, Minneapolis, Minnesota

Donna Podems, PhD, OtherWISE, Capetown, South Africa

Yve Susskind, PhD, Praxis Associates LLC, Vashon, Washington

John Wilson, PhD, independent consultant, Africa

Ricardo Wilson-Grau, MA, Richardo Wilson-Grau Consulting, Rio de Janeiro, Brazil
Audience

Applied researchers who do evaluations; instructors and graduate students in education, psychology, sociology, management, social work, nursing, and public policy.
Will serve as a core or supplemental text in graduate-level courses in evaluation, social research methods, program planning, and management consulting.