The Fairy Godmother—and Her Warts

American Journal of Evaluation - Tập 29 Số 1 - Trang 29-47 - 2008
Carol H. Weiss1, Erin Murphy‐Graham2, Anthony Petrosino3, Allison Gruner Gandhi4
1Harvard Graduate School of Education
2University of California
3WestEd
4American Institutes for Research

Tóm tắt

Evaluators sometimes wish for a Fairy Godmother who would make decision makers pay attention to evaluation findings when choosing programs to implement. The U.S. Department of Education came close to creating such a Fairy Godmother when it required school districts to choose drug abuse prevention programs only if their effectiveness was supported by “scientific” evidence. The experience showed advantages of such a procedure (e.g., reduction in support for D.A.R.E., which evaluation had found wanting) but also shortcomings (limited and in some cases questionable evaluation evidence in support of other programs). Federal procedures for identifying successful programs appeared biased. In addition, the Fairy Godmother discounted the professional judgment of local educators and did little to improve the fit of programs to local conditions. Nevertheless, giving evaluation more clout is a worthwhile way to increase the rationality of decision making. The authors recommend research on procedures used by other agencies to achieve similar aims.

Từ khóa


Tài liệu tham khảo

Alkin, M.C., 1979, Using evaluations: Does evaluation make a difference?

Anderson, L., 2003, Pursuing truth, exercising power: Social science and public policy in the 21st century

10.1177/000169938302600103

10.1016/B978-0-08-030820-3.50016-1

10.2307/2392533

10.1111/j.1741-5446.2006.00241.x

10.1016/j.evalprogplan.2005.04.001

Bobrow, D.B. (2006). Social and cultural factors: Constraining and enabling. In M. Moran, M. Rein, & R. E. Goodin (Eds.), The Oxford handbook of public policy (pp. 572-586). Oxford, UK: Oxford University Press.

Boudett, K. P., 2005, Data wise: A step-by-step guide to using assessment results to improve teaching and learning

Bowen, S., 2005, Public Library of Science, 2, 600

Breslau, D., 1998, In search of the unequivocal: The political economy of measurement in U.S. labor market policy

Bulmer, M., 1986, Social science and social policy

10.1177/1469004704041705

Campbell, S., 2007, Analysis for policy: Evidence-based policy in practice

Canadian Health Services Research Foundation., 2006, Links, 9, 1

Caplan, N. (1977). A minimal set of conditions necessary for the utilization of social science knowledge in policy formulation at the national level. In C. H. Weiss (Ed.), Using research in public policy making (pp. 183-197). Lexington, MA: Lexington-Heath.

Center for Substance Abuse Prevention, Substance Abuse and Mental Health Administration, Department of Health and Human Services., 2007, Identifying and selecting evidence-based interventions: Guidance document for the strategic prevention framework, State Incentive Grant Program

Center on Education Policy., 2006, Keeping watch on reading first

Clark, G., 2005, New directions for knowledge transfer and knowledge brokerage in Scotland

Clayton, R., 1996, R.E.): 5-year follow up results. Preventative Medicine, 25, 307

10.3102/00346543056003331

Davies, H., 2000, What works? Evidence-based policy and practice in public services. Bristol, UK, 10.46692/9781847425119

DeJong, W., 1987, (Drug Abuse Resistance Education): Preliminary indicators of effectiveness. Journal of Drug Education, 17, 279

10.1093/acprof:oso/9780199259014.001.0001

Dukes, R.L., 1997, R.E.): Results of a 6-year follow-up. Evaluation Review, 21, 483

10.2105/AJPH.83.6.856

10.2105/AJPH.84.9.1394

Furubo, J.E., 1994, Transaction, 45

10.1177/0193841X06287188

10.1016/S0955-3959(02)00002-6

10.1002/1520-6688(200022)19:3<367::AID-PAM1>3.0.CO;2-A

Greenberg, D., 2004, The digest of social experiments, 3

Gueron, J.M., 1991, From welfare to work

Henig, J.R., Paper presented at American Enterprise Institute Conference

Kemm, J., 2006, Journal of Evaluation in Clinical Practice, 12, 319, 10.1111/j.1365-2753.2006.00600.x

Knott, J., 1980, Utilization, 1, 537

Lakoff, G., 1996, Moral politics

Lampinen, O., 1992, The utilisation of social science research in public policy

Lemieux-Charles, L., 2004, Using knowledge and evidence in health care: Multidisciplinary perspectives. Toronto, Ontario, Canada

Lindblom, C.E., 1979, Usable knowledge: Social science and social problem solving

Lyons, G.M., 1969, The uneasy partnership: Social science and the federal government in the twentieth century

10.1332/1744264053730789

National Academy of Sciences., 1968, The behavioral sciences and the federal government

National Science Foundation., 1968, Knowledge into action: Improving the nation's use of the social sciences

Office of Chief Researcher, Knowledge Transfer Team (G. Clark &amp; L. Kelly), Scottish Executive Social Research., 2005, New directions for knowledge transfer and knowledge brokerage in Scotland

Office of Inspector General, U.S. Department of Education., 2006, The Reading First program's grant application process; final inspection report

10.4135/9781849209120

Petersilia, J., 1987, The influence of criminal justice research

10.1177/0002716203251218

10.1332/174426406778023685

10.1007/s11292-005-3540-8

Pogrow, S., 1996, Phi Delta Kappan, 77, 656

Preskill, H., 1999, Evaluative inquiry for learning in organizations, 10.4135/9781452231488

Pyra, K., 2003, Knowledge translation: A review of the literature

10.1017/CBO9780511509889

10.1332/1744264053730798

10.1177/0022427898035004002

10.2105/AJPH.92.1.14

10.1146/annurev.psych.52.1.59

10.1111/1467-9299.00292

10.1332/1744264054851568

10.3102/0013189X035002013

Schweinhart, L.J., 1993, Significant benefits: The High/Scope Perry Preschool study through age 27

10.1177/0002716203256266

10.1111/1467-8624.00132

10.1016/S0886-1633(97)90027-1

Simmons, W., 2005, Voices in Urban Education (Annenberg Institute for School Reform), 6, 5

Sowell, T., 1980, Knowledge and decisions

St. Pierre,R.G. & Puma, M.J. (2000). Toward the dream of the experimenting society . In L. Bickman (Ed.), Validity and social experimentation: Donald Campbell's legacy (pp. 169-192). Thousand Oaks, CA: Sage.

10.1017/S0047279405009177

10.1177/002204268601600405

10.1332/1744264054851612

Walter, I., 2004, Improving the use of research in social care practice (Knowledge Review 7)

10.1177/1098214004273337

Weiss, C. H., 1977, Using research in public policy making

10.2307/3324932

10.1016/0883-0355(95)91498-6