Forecasting effectiveness of policy implementation strategies: working with semi‐experts

Emerald - Tập 11 Số 6 - Trang 86-93 - 2009
Nicolas D.Savio1, KonstantinosNikolopoulos2
1Business Systems Division, Manchester Business School, Manchester, UK
2Fellow of the Herbert Simon Institute, Manchester Business School, Manchester, UK

Tóm tắt

PurposePolicy implementation strategies (PIS) are schemes designed by a government with an aim of hitting targets or attaining objectives set out by a policy. Forecasting by analogies (FBA) has been shown to be successful in situations of high uncertainty and low quantitative data as is that of PIS effectiveness forecasts. What is more, a structured approach to FBA helps the expert structure his thoughts in an organized manner before making a prediction, which is hypothesized to improve accuracy. This paper aims to discuss these issues.Design/methodology/approachThis research suggests a semi‐structured analogies (S‐SA) approach for such a task. A pilot experiment was carried to test the performance of the S‐SA approach in the hands of semi‐experts when compared with unaided judgment (UJ).FindingsThe results of the experiment showed that for this level of expertise, there is no statistical evidence to suggest any approach is better than the other. Possible explanations of this result is that analogy recall of experts was hindered by four constructs: information, complexity, worldview, and expertise. It was concluded that the structured analogies approach for forecasting PIS effectiveness must be investigated further by means of a study involving “true experts”.Research limitations/implicationsThe sample sizes were small.Practical implicationsForecasting PIS effectiveness is seen as an important tool for deciding upon which PIS to ultimately adopt (as there may be many available!) and this then has important implications for governmental budgeting.Originality/valueThe paper offers further insight into the performance of a structured analogies approach to forecasting PIS effectiveness in the hands of individuals with a mid‐level of expertise.

Từ khóa


Tài liệu tham khảo

Brown, T. and Potoski, M. (2006), “Contracting for management: assessing management capacity under alternative service delivery arrangements”, Journal of Policy Analysis and Management, Vol. 25 No. 2, pp. 323‐46.

European Commission Impact Assessment Guidelines (2009), available at: http://ec.europa.eu/governance/impact/docs/key_docs/iag_2009_en.pdf (accessed 27 February 2009).

Green, K. and Armstrong, J.S. (2007), “Structured analogies for forecasting”, International Journal of Forecasting, Vol. 23 No. 3, pp. 365‐76.

Haas, P.J. (2008), “Introduction to the symposium performance measurement: can it improve performance?”, International Journal of Public Administration, Vol. 31, pp. 593‐4.

Harvey, N. and Fischer, I. (1997), “Taking advice: accepting help, improving judgment and sharing responsibility”, Organizational Behaviour and Human Decision Processes, Vol. 70, pp. 117‐33.

Heath, C. and Gonzalez, R. (1995), “Interaction with other increases decision confidence but not decision quality: evidence against information collection views of interactive decision making”, Organizational Behaviour and Human Decision Processes, Vol. 61, pp. 305‐26.

Lee, W.Y., Goodwin, P., Fildes, R., Nikolopoulos, K. and Lawrence, M. (2007), “Providing support for the use of analogies in demand forecasting tasks”, International Journal of Forecasting, Vol. 23 No. 3, pp. 377‐90.

Peters, B.G. and Savoie, D.J. (2000), Governance in the 21st Century: Revitalizing the Public Service, McGill‐Queen's Press, Montreal.

Savio, N. and Nikolopoulos, K. (2009a), “Forecasting the economic impact of new policies”, Foresight, Vol. 11 No. 2, pp. 7‐18.

Savio, N. and Nikolopoulos, K. (2009b), “Forecasting the effectiveness of policy implementation strategies”, International Journal of Public Administration (in press).

Shanteau, J., Weiss, D.J., Thomas, R.P. and Pounds, J.C. (2002), “Performance‐based assessment of expertise: how to decide if someone is an expert or not”, European Journal of Operational Research, Vol. 136, pp. 253‐63.

Sniezek, J.A., Schrah, G.E. and Dalal, R.S. (2004), “Improving judgment with prepaid expert advice”, Journal of Behavioural Decision Making, Vol. 17, pp. 173‐90.

Talbot, C. (2008), “Performance regimes: the institutional context of performance policies”, International Journal of Public Administration, Vol. 31, pp. 1569‐91.

Talbot, C. (2009), “Public value: the next ‘big thing’ in public management?”, International Journal of Public Administration, Vol. 32, pp. 167‐70.

Thông tin
Thông tin xuất bản

Emerald

Tập 11 Số 6

86-93

Thông tin tác giả