Evaluation for an Open Society: Then and Now
Background: Karl Popper’s views about science and political economy remain relevant to evaluation theory and practice. His Open Society opus inspired pioneering contributions to experimental evaluation and shaped the evaluation discipline. Yet, his ideas are not widely known without the evaluation c...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
The Evaluation Center at Western Michigan University
2018-10-01
|
| Series: | Journal of MultiDisciplinary Evaluation |
| Subjects: | |
| Online Access: | https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/503 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832592957086105600 |
|---|---|
| author | Robert Picciotto |
| author_facet | Robert Picciotto |
| author_sort | Robert Picciotto |
| collection | DOAJ |
| description | Background: Karl Popper’s views about science and political economy remain relevant to evaluation theory and practice. His Open Society opus inspired pioneering contributions to experimental evaluation and shaped the evaluation discipline. Yet, his ideas are not widely known without the evaluation community even though populist leaders are once again threatening to undermine democracy.
Purpose: To define the Open Society, probe its epistemological tenets, confirm that they remain valid as the foundation of evaluation practice, identify the ways in which the operating environment for evaluation has changed and, against this background, propose a policy change agenda relevant to the contemporary evaluation discipline.
Setting: The Open Society is once again being undermined. Modern authoritarianism is tightening its grip. The lure of the strong man is once again gaining traction. The dominance of an international order grounded in democracy, human rights, and the rule of law is giving way to a world in which leaders are pursuing narrow nationalist and vested interests. In this troubled context, policy making has become more complex than when evaluation emerged out of the ashes of World War II. Economic and social dysfunctions have led to extraordinary concentration of wealth and privilege. Ominous environmental threats loom. The architecture of international relations designed in the mid-1940’s has become obsolete.
Research Design: To design this commentary about the prospects of the evaluation discipline, the author drew on his personal experience as evaluation academic, international development practitioner, manager of the World Bank’s Independent Evaluation Group for two consecutive five-year terms and senior independent evaluation adviser to governments and international development agencies.
Intervention: As an intervention, this article adds value to evaluation theory and practice by showing why and how the Popper/Campbell mandate for evaluation needs to be upgraded to protect the public interest in a new operating environment. Specifically, Popper’s piecemeal social experimentation concept should be refined to forge links between small scale experiments and the broader fabric of society. In addition, the ambiguity regarding the relationship between the Open Society and evaluation should be lifted through a reconsideration of the democratic evaluation model.
Data Collection and Analysis: The author conducted an extensive review of the literature and consulted with a wide range of evaluation thinkers to examine the extent to which Popper’s philosophy remains relevant to the evaluation discipline.
Findings: Popper’s Open Society ideas aimed at avoiding the rise and perpetuation of autocracy and remain highly relevant. But the current threats to democracy call for a more ambitious and detailed remit for the evaluation occupation. Beyond the promotion of evaluation in democracy and of democracy in evaluation, evaluation for democracy should be pursued. This implies putting value, ethics, and the public interest at the very center of the evaluation occupation; breaking free of Popper’s parsimonious piecemeal social engineering concept to inform systemic social reform; bringing peace to a methodologically divided house; systematic mixing of evaluation methods and models; and the promotion of evaluation independence through professionalization.
|
| format | Article |
| id | doaj-art-c44757bf5622404aabe6049a8778e6fc |
| institution | Kabale University |
| issn | 1556-8180 |
| language | English |
| publishDate | 2018-10-01 |
| publisher | The Evaluation Center at Western Michigan University |
| record_format | Article |
| series | Journal of MultiDisciplinary Evaluation |
| spelling | doaj-art-c44757bf5622404aabe6049a8778e6fc2025-01-20T22:59:56ZengThe Evaluation Center at Western Michigan UniversityJournal of MultiDisciplinary Evaluation1556-81802018-10-01143110.56645/jmde.v14i31.503Evaluation for an Open Society: Then and NowRobert Picciotto0https://orcid.org/0000-0001-6269-9679University of AucklandBackground: Karl Popper’s views about science and political economy remain relevant to evaluation theory and practice. His Open Society opus inspired pioneering contributions to experimental evaluation and shaped the evaluation discipline. Yet, his ideas are not widely known without the evaluation community even though populist leaders are once again threatening to undermine democracy. Purpose: To define the Open Society, probe its epistemological tenets, confirm that they remain valid as the foundation of evaluation practice, identify the ways in which the operating environment for evaluation has changed and, against this background, propose a policy change agenda relevant to the contemporary evaluation discipline. Setting: The Open Society is once again being undermined. Modern authoritarianism is tightening its grip. The lure of the strong man is once again gaining traction. The dominance of an international order grounded in democracy, human rights, and the rule of law is giving way to a world in which leaders are pursuing narrow nationalist and vested interests. In this troubled context, policy making has become more complex than when evaluation emerged out of the ashes of World War II. Economic and social dysfunctions have led to extraordinary concentration of wealth and privilege. Ominous environmental threats loom. The architecture of international relations designed in the mid-1940’s has become obsolete. Research Design: To design this commentary about the prospects of the evaluation discipline, the author drew on his personal experience as evaluation academic, international development practitioner, manager of the World Bank’s Independent Evaluation Group for two consecutive five-year terms and senior independent evaluation adviser to governments and international development agencies. Intervention: As an intervention, this article adds value to evaluation theory and practice by showing why and how the Popper/Campbell mandate for evaluation needs to be upgraded to protect the public interest in a new operating environment. Specifically, Popper’s piecemeal social experimentation concept should be refined to forge links between small scale experiments and the broader fabric of society. In addition, the ambiguity regarding the relationship between the Open Society and evaluation should be lifted through a reconsideration of the democratic evaluation model. Data Collection and Analysis: The author conducted an extensive review of the literature and consulted with a wide range of evaluation thinkers to examine the extent to which Popper’s philosophy remains relevant to the evaluation discipline. Findings: Popper’s Open Society ideas aimed at avoiding the rise and perpetuation of autocracy and remain highly relevant. But the current threats to democracy call for a more ambitious and detailed remit for the evaluation occupation. Beyond the promotion of evaluation in democracy and of democracy in evaluation, evaluation for democracy should be pursued. This implies putting value, ethics, and the public interest at the very center of the evaluation occupation; breaking free of Popper’s parsimonious piecemeal social engineering concept to inform systemic social reform; bringing peace to a methodologically divided house; systematic mixing of evaluation methods and models; and the promotion of evaluation independence through professionalization. https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/503democracyexperimentationfalsificationparadigm warspiecemeal social engineering |
| spellingShingle | Robert Picciotto Evaluation for an Open Society: Then and Now Journal of MultiDisciplinary Evaluation democracy experimentation falsification paradigm wars piecemeal social engineering |
| title | Evaluation for an Open Society: Then and Now |
| title_full | Evaluation for an Open Society: Then and Now |
| title_fullStr | Evaluation for an Open Society: Then and Now |
| title_full_unstemmed | Evaluation for an Open Society: Then and Now |
| title_short | Evaluation for an Open Society: Then and Now |
| title_sort | evaluation for an open society then and now |
| topic | democracy experimentation falsification paradigm wars piecemeal social engineering |
| url | https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/503 |
| work_keys_str_mv | AT robertpicciotto evaluationforanopensocietythenandnow |