Đánh giá như một nền tảng kiến thức hợp lý? Mô tả và giải thích chất lượng của các đánh giá lập pháp ex-post của Ủy ban Châu Âu

Policy Sciences - Tập 52 - Trang 625-644 - 2019
Stijn van Voorst1, Ellen Mastenbroek1
1Institute for Management Research, Radboud University, Nijmegen, The Netherlands

Tóm tắt

Các đánh giá là một công cụ có tiềm năng quan trọng cho các chính phủ dân chủ: chúng cung cấp cơ sở để chịu trách nhiệm và học hỏi chính sách. Để đóng góp vào những chức năng chính này, các đánh giá phải có chất lượng phương pháp đủ cao. Tuy nhiên, chất lượng này đang bị đe dọa bởi cả ảnh hưởng chính trị và sự phức tạp về kỹ thuật. Bài báo này mô tả và giải thích sự khác biệt trong chất lượng của các đánh giá lập pháp ex-post (EPL) được thực hiện bởi Ủy ban Châu Âu, đơn vị tiên phong trong lĩnh vực này. Một số giải thích chính trị và kỹ thuật tiềm năng về chất lượng đánh giá đã được kiểm tra bằng một bộ dữ liệu độc đáo, tự xây dựng gồm 153 đánh giá EPL. Kết quả cho thấy rằng các đánh giá EPL của Ủy ban thường áp dụng một phương pháp tiếp cận vững chắc, trong khi tính rõ ràng của phạm vi, độ chính xác của dữ liệu và nền tảng của các kết luận đều gặp vấn đề. Sự khác biệt này chủ yếu được giải thích bởi loại người thực hiện đánh giá: các đánh giá EPL do các tác nhân bên ngoài thực hiện có chất lượng cao hơn so với các đánh giá được Ủy ban thực hiện nội bộ.

Từ khóa

#đánh giá lập pháp #chất lượng đánh giá #Ủy ban Châu Âu #phương pháp đánh giá #chính phủ dân chủ

Tài liệu tham khảo

Adam, C., Steinebach, Y., & Knill, C. (2018). Neglected challenges to evidence-based policy-making: The problem of policy accumulation. Policy Sciences,51(3), 269–290. Adcock, R., & Collier, D. (2001). Measurement validity: A shared standard for qualitative and quantitative research. The American Political Science Review,95(3), 529–546. Boswell, C. (2008). The political functions of expert knowledge: Knowledge and legitimization in European Union immigration policy. Journal of European Public Policy,15(4), 471–488. Bovens, M., ‘t Hart, P., & Kuipers, S. (2008). The politics of policy evaluation. In R. E. Goodin, M. Rein, & M. Moran (Eds.), The Oxford handbook of public policy (pp. 320–335). Oxford: University Press. Bussmann, W. (2010). Evaluation of legislation: Skating on thin ice. Evaluation,16(3), 279–293. Chelimsky, E. (2008). A clash of cultures: Improving the “Fit” between evaluative independence and the political requirements of a democratic society. American Journal of Evaluation,29(4), 400–415. Coglianese, C. (2012). Evaluating the performance of regulation and regulatory policy. Report to the Organization of Economic Cooperation and Development. Conley-Tyler, M. (2005). A fundamental choice: Internal or external evaluation? Evaluation Journal of Australasia,4(1), 3–11. Cooksy, L. J., & Caracelli, V. J. (2005). Quality, context and use. Issues in achieving the goals of meta-evaluation. American Journal of Evaluation,26(1), 31–42. Cooksy, J. M., & Mark, M. M. (2012). Influences on evaluation quality. American Journal of Evaluation,33(1), 79–89. Datta, L. (2011). Politics and evaluation: More than methodology. American Journal of Evaluation,32(2), 273–294. Daviter, F. (2015). The political use of knowledge in the policy process. Policy Sciences,48(4), 491–505. European Commission. (2007). Responding to strategic needs: Reinforcing the use of evaluation [SEC(2007) 213]. Brussels: European Commission. European Commission. (2010). Multi-annual overview (2002–2009) of evaluations and impact assessments. Available at: http://ec.europa.eu/dgs/secretariat_general/evaluation/docs/multiannual_overview_en.pdf. Retrieved from July 10, 2015. European Commission. (2015). Better regulation toolbox [SWD(2015) 111]. Brussels: European Commission. European Commission. (2016). Communication from the Commission to the European Parliament, the European Council and the Council. Better regulation: Delivering better results for a stronger Union [COM(2016) 615 final]. Brussels: European Commission. European Court of Auditors. (2018). Ex-post review of EU legislation: A well-established system, but incomplete [Special Report no 16]. Luxembourg: European Court of Auditors. Fitzpatrick, T. (2012). Evaluating legislation: An alternative approach for evaluating EU internal market and services law. Evaluation,18(4), 477–499. Forss, K., & Carlsson, J. (1997). The quest for quality—Or can evaluation findings be trusted? Evaluation,3(4), 481–501. Häge, F. M. (2007). Committee decision-making in the council of the European Union. European Union Politics,8(3), 299–328. House, E. R. (2008). Blowback: Consequences of evaluation for evaluation. American Journal of Evaluation,29(4), 416–426. Huitema, D., Jordan, A., Massey, E., Rayner, T., Asselt, H., Haug, C., et al. (2011). The evaluation of climate policy: Theory and emerging practice in Europe. Policy Sciences,44(2), 179–198. Kaeding, M. (2006). Determinants of transposition delay in the European Union. Journal of Public Policy,26(3), 229–253. Majone, G. (1999). The regulatory state and its legitimacy problems. West European Politics,22(1), 1–24. Mastenbroek, E., Van Voorst, S., & Meuwese, A. (2016). Closing the regulatory cycle? A meta-evaluation of ex-post legislative evaluations by the European Commission. Journal of European Public Policy,23(9), 1329–1348. Mayne, J., & Schwartz, R. (2005). Assuring the quality of evaluative information. In R. Schwartz & J. Mayne (Eds.), Quality Matters: Seeking confidence in evaluating, auditing and performance reporting (pp. 1–17). New Brunswick: Transaction Publishers. Mead, L. M. (2015). Only connect: Why government often ignores research. Policy Sciences,48(2), 257–272. Miles, J., & Shevlin, M. (2001). Applying regression and correlation: A guide for students and researchers. London: Sage. Mousmouti, M. (2012). Operationalising quality of legislation through the effectiveness test. Legisprudence,6(2), 191–205. Neuendorf, K. (2002). The content analysis guidebook. Thousand Oaks: Sage. Nielsen, S. B., Lemire, S., & Skov, M. (2011). Measuring evaluation capacity: Results and implications of a Danish study. American Journal of Evaluation,32(3), 324–344. OECD. (2015). OECD regulatory policy outlook 2015. Paris: OECD Press. Pollack, M. A. (2008). Member-state principals, supranational agents, and the EU budgetary process, 1970–2008. Paper prepared for presentation at the Conference on Public Finances in the European Union, sponsored by the European Commission Bureau of Economic Policy Advisors, Brussels, 3–4 April 2008. Poptcheva, E. M. (2013). Library briefing. Policy and legislative evaluation in the EU. Brussels: European Parliament. Radaelli, C. M., & Meuwese, A. C. M. (2010). Hard questions, hard solutions: Proceduralisation through impact assessment in the EU. West European Politics,33(1), 136–153. Rasmussen, A., & Toshkov, D. (2010). The inter-institutional division of power and time allocation in the European Parliament. West European Politics,34(1), 71–96. Regulatory Scrutiny Board. (2018). Regulatory scrutiny board—Annual report 2017. Brussels: European Commission. Rossi, P. H., Lipsy, M. W., & Freeman, H. E. (2004). Evaluation: A systematic approach. Thousand Oaks: Sage. Sanderson, I. (2002). Evaluation, policy learning and evidence-based policy making. Public Administration,80(1), 1–22. Schoenefeld, J. J., & Jordan, A. J. (2019). Environmental policy evaluation in the EU: Between learning, accountability, and political opportunities? Environmental Politics,28(2), 365–384. Stern, E. (2009). Evaluation policy in the European Union and its institutions. In W. M. K. Trochim, M. M. Mark, & L. J. Cooksy (Eds.), Evaluation policy and evaluation practice: New directions for evaluation (pp. 67–85). San Fransisco: Jossey-Bass. Steunenberg, B. (2006). Turning swift policymaking into deadlock and delay: National policy coordination and the transposition of EU directives. European Union Politics,7(3), 293–319. Summa, H., & Toulemonde, J. (2002). Evaluation in the European Union: Addressing complexity and ambiguity. In J. Furubo, R. C. Rist, & R. Sandahl (Eds.), International atlas of evaluation (pp. 407–424). New Brunswick: Transaction. Torriti, J. (2010). Impact assessment and the liberalization of the EU energy markets: Evidence-based policy-making or policy-based evidence-making? Journal of Common Market Studies,48(4), 1065–1081. Van Aeken, K. (2011). From vision to reality: Ex-post evaluation of legislation. Legisprudence,5(1), 41–68. Van Voorst, S. (2017). Evaluation capacity in the European Commission. Evaluation,23(1), 24–41. Van Voorst, S., & Mastenbroek, E. (2017). Enforcement tool or strategic instrument? The initiation of ex-post legislative evaluations by the European Commission. European Union Politics,17(4), 640–657. Van Voorst, S., & Zwaan, P. (2018). The (non-)use of ex-post legislative evaluations by the European Commission. Journal of European Public Policy. https://doi.org/10.1080/13501763.2018.1449235. Varvasovszky, Z., & Brugha, R. (2000). How to do (or not to do) a stakeholder analysis. Health Policy and Planning,15(3), 338–345. Vedung, E. (1997). Public policy and program evaluation. New Brunswick: Transaction. Versluis, E., Van Keulen, M., & Stephenson, P. (2011). Analyzing the European Union policy process. Houndmills: Palgrave MacMillan. Weiss, C. H. (1993). Where politics and evaluation research meet. American Journal of Evaluation,14(1), 93–106.