Understanding the (non-)Use of Societal Wellbeing Indicators in National Policy Development: What Can We Learn from Civil Servants? A UK Case Study
Tóm tắt
Gross Domestic Product is often used as a proxy for societal well-being in the context of policy development. Its shortcomings in this context are, however, well documented, and numerous alternative indicator sets have been developed. Despite this, there is limited evidence of widespread use of these alternative indicator sets by people working in policy areas relevant to societal wellbeing. Civil servants are an important group of indicator end-users. Better understanding their views concerning measuring societal wellbeing can support wider discussions about what factors determine indicator use and influence in policy decision-making. Taking the UK as a case study, we ask what views exist among civil servants in the UK about measuring societal well-being? To answer this question, we used a bootstrapped Q methodology, interviewing 20 civil servants to elicit their views about measuring societal well-being. Three distinct discourses emerged from our analysis: one that was concerned about the consequences of ignoring natural, social and human capital in decision making; one that emphasised opportunity and autonomy as key determinants of well-being; and one that focused on the technical aspects of measuring societal well-being. Each of these discourses has direct implications for the way that we integrate societal wellbeing into policy making and highlights the potential benefits of including end-users in indicator development and strategy.
Tài liệu tham khảo
Allin, P., & Hand, D. J. (2017). New statistics for old? Measuring the wellbeing of the UK. Journal of the Royal Statistical Society: Series A (Statistics in Society),180(1), 3–43.
Atkinson, R., & Flint, J. (2001). Accessing hidden and hard-to-reach populations: Snowball research strategies. Social Research Update,33(1), 1–4.
Baker, R., Thompson, C., & Mannion, R. (2006). Q methodology in health economics. Journal of Health Services Research & Policy,11(1), 38–45.
Barrington-Leigh, C., & Escande, A. (2018). Measuring progress and well-being: A comparative review of indicators. Social Indicators Research,135(3), 893–925.
Barry, J., & Proops, J. (1999). Seeking sustainability discourses with Q methodology. Ecological Economics,28(3), 337–345.
Bauler, T. (2012). An analytical framework to discuss the usability of (environmental) indicators for policy. Ecological Indicators,17, 38–45.
Bell, S., & Morse, S. (2011). An analysis of the factors influencing the use of indicators in the European Union. Local Environment,16(3), 281–302.
Birkland, T. A. (2015). An introduction to the policy process: Theories, concepts, and models of public policy making (3rd ed.). New York, NY: Routledge.
Brown, S. R. (1980). Political subjectivity: Applications of Q methodology in political science. New Haven, CT: Yale University Press.
Brown, S. R. (1993). A primer on Q methodology. Operant Subjectivity,16(3/4), 91–138.
Brown, S. R., Danielson, S., & van Exel, J. (2015). Overly ambitious critics and the Medici effect: A reply to Kampen and Tamás. Quality & Quantity,49(2), 523–537.
Brown, S. R., Durning, D. W., & Selden, S. (1999). Q methodology. Public Administration and Public Policy,71, 599–638.
Cameron, D. (2010). PM speech on wellbeing. GOV.UK. Retrieved June 15, 2018, from https://www.gov.uk/government/speeches/pm-speech-on-wellbeing.
Cobb, C. W., & Daly, H. (1989). The index for sustainable economic welfare. In H. E. Daly & J. B. Cobb (Eds.), For the common good (pp. 401–455). Boston: Beacon Press.
Collingridge, D., & Reeve, C. (1986). Science and Policy-Why the Marriage Is So Unhappy. Bulletin of Science, Technology & Society,6, 356–372.
Community Empowerment (Scotland) Act. (2015). Retrieved January 21, 2020, from http://www.legislation.gov.uk/asp/2015/6.
Cross, R. M. (2004). Exploring attitudes: The case for Q methodology. Health Education Research,20(2), 206–213.
Cuppen, E., Breukers, S., Hisschemöller, M., & Bergsma, E. (2010). Q methodology to select participants for a stakeholder dialogue on energy options from biomass in the Netherlands. Ecological Economics,69(3), 579–591.
Davies, B. B., & Hodge, I. D. (2007). Exploring environmental perspectives in lowland agriculture: A Q methodology study in East Anglia, UK. Ecological Economics,61(2–3), 323–333.
Doody, D. G., Kearney, P., Barry, J., Moles, R., & O’Regan, B. (2009). Evaluation of the Q-method as a method of public participation in the selection of sustainable development indicators. Ecological Indicators,9(6), 1129–1137.
Ellis, G., Barry, J., & Robinson, C. (2007). Many ways to say ‘no’, different ways to say ‘yes’: Applying Q-methodology to understand public acceptance of wind farm proposals. Journal of Environmental Planning and Management,50(4), 517–551.
Everett, G. (2015). Measuring national well-being: A UK perspective. Review of Income and Wealth,61(1), 34–42.
Fu, B. J., Su, C. H., Wei, Y. P., Willett, I. R., Lü, Y. H., & Liu, G. H. (2011). Double counting in ecosystem services valuation: Causes and countermeasures. Ecological Research,26(1), 1–14.
Fujiwara, D., & Campbell, R. (2011). Valuation techniques for social cost-benefit analysis: Stated preference, revealed preference and subjective well-being approaches: a discussion of the current issues. London: HM Treasury, Department for Work and Pensions. Retrieved June 15, 2018, from https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/209107/greenbook_valuationtechniques.pdf.
Gall, S. C., & Rodwell, L. D. (2016). Evaluating the social acceptability of Marine protected areas. Marine Policy,65, 30–38.
Gerston, L. N. (2014). Public policy making: Process and principles (3rd ed.). New York, NY: Routledge.
GOV.UK. (2013). Wellbeing policy and analysis. An update of wellbeing work across Whitehall. GOV.UK. Retrieved June 15, 2018, from https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/224910/Wellbeing_Policy_and_Analysis_FINAL.PDF.
Hezri, A. A., & Dovers, S. R. (2006). Sustainability indicators, policy, governance: Issues for ecological economics. Ecological Economics,60, 86–99.
HM Treasury. (2018). The Green Book: Central government guidance on appraisal and evaluation. London: HM Treasury. Retrieved January 21, 2020, from https://www.gov.uk/government/publications/the-green-book-appraisal-and-evaluation-in-central-governent.
Howlett, M., Ramesh, M., & Perl, A. (2009). Studying public policy: Policy cycles and policy subsystems (3rd ed.). Oxford: Oxford University Press.
Institute for Government. (2018). Grade structures of the civil service. The Institute for Government. Retrieved June 15, 2018, from https://www.instituteforgovernment.org.uk/explainers/grade-structures-civil-service.
Jackson, T. (2010). Reviewing the research: Report of the commission on the measurement of economic performance and social progress. Environment,53(1), 38–40.
Jones, B. D. (2002). Bounded rationality and public policy: Herbert A. Simon and the decisional foundation of collective choice. Policy Sciences,35(3), 269–284.
Kampen, J. K., & Tamás, P. (2014). Overly ambitious: contributions and current status of Q methodology. Quality & Quantity,48(6), 3109–3126.
Kubiszewski, I., Costanza, R., Franco, C., Lawn, P., Talberth, J., Jackson, T., et al. (2013). Beyond GDP: Measuring and achieving global genuine progress. Ecological Economics,93, 57–68.
Lancaster, K. (2017). Confidentiality, anonymity and power relations in elite interviewing: Conducting qualitative policy research in a politicised domain. International Journal of Social Research Methodology,20(1), 93–103.
Lehtonen, M., Sébastien, L., & Bauler, T. (2016). The multiple roles of sustainability indicators in informational governance: Between intended use and unanticipated influence. Current Opinion in Environmental Sustainability,18, 1–9.
Leiserowitz, A. (2006). Climate change risk perception and policy preferences: The role of affect, imagery, and values. Climatic Change,77(1–2), 45–72.
Marmot, M. G. (2004). Evidence based policy or policy based evidence? BMJ,328, 906–907.
Matheson, J. (2011). Measuring what matters: National statistician’s reflections on the National debate on measuring wellbeing. London: Office for National Statistics. Retrieved June 15, 2018, from https://www.ons.gov.uk/aboutus/transparencyandgovernance/freedomofinformationfoi/uknationalwellbeingindex.
National Assembly for Wales. (2015). Well-being of future generations (Wales) Act 2015. The Stationery Office Limited. Retrieved June 15, 2018, from https://futuregenerations.wales/wp-content/uploads/2017/01/WFGAct-English.pdf.
O’Neill, S. J., Boykoff, M., Niemeyer, S., & Day, S. A. (2013). On the use of imagery for climate change engagement. Global Environmental Change,23(2), 413–421.
Ockwell, D. G. (2008). ‘Opening up’ policy to reflexive appraisal: A role for Q methodology? A case study of fire management in Cape York. Australia. Policy Sciences,41(4), 263–292.
OECD. (2018). Better life initiative: Measuring well-being and progress. OECD. Retrieved June 15, 2018, from http://www.oecd.org/statistics/better-life-initiative.htm.
Office for National Statistics. (2017). Social capital in the UK: May 2017. Office for National Statistics. Retrieved January 10, 2020, from https://www.ons.gov.uk/peoplepopulationandcommunity/wellbeing/bulletins/socialcapitalintheuk/may2017.
Office for National Statistics. (2018). Measuring national well-being: Domains and measures. Office for National Statistics. Retrieved June 15, 2018, from https://www.ons.gov.uk/peoplepopulationandcommunity/wellbeing/datasets/measuringnationalwellbeingdomainsandmeasures.
Office for National Statistics. (2019a). UK natural capital accounts: 2019. Office for National Statistics. Retrieved January 10, 2020, from https://www.ons.gov.uk/economy/environmentalaccounts/bulletins/uknaturalcapitalaccounts/2019.
Office for National Statistics. (2019b). Human capital estimates in the UK: 2004 to 2018. Office for National Statistics. Retrieved January 10, 2020, from https://www.ons.gov.uk/peoplepopulationandcommunity/wellbeing/articles/humancapitalestimates/2004to2018.
Office for National Statistics. (2019c). Human capital indicators consultation. Office for National Statistics. Retrieved January 10, 2020, from https://consultations.ons.gov.uk/well-being-inequalities-sustainability-and-environment/indicator-based-approach-to-measuring-human-capita/supporting_documents/Human_capital_consultation_final.pdf.
PWC. (2014). 11 Quality of life: Assessment. Airports Commission. PricewaterhouseCoopers LLP. Retrieved June 15, 2018, from https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/372165/11-Quality_of_life–quality-of-life-assessment.pdf.
R Core Team. (2016). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved June 15, 2018, from https://www.R-project.org/.
Rich, R. F. (1991). Knowledge creation, diffusion, and utilization: Perspectives of the founding editor of Knowledge. Knowledge,12(3), 319–337.
Rinne, J., Lyytimäki, J., & Kautto, P. (2012). Beyond the’indicator industry’: Use and potential influences of sustainable development indicators in Finland and the EU. Progress in Industrial Ecology, an International Journal,7(4), 271–284.
Scottish Government. (2018). National Performance Framework. Scottish Government. Retrieved June 15, 2018, from http://www.gov.scot/About/Performance/purposestratobjs.
Sébastien, L., & Bauler, T. (2013). Use and influence of composite indicators for sustainable development at the EU-level. Ecological Indicators,35, 3–12.
Sébastien, L., Bauler, T., & Lehtonen, M. (2014). Can indicators bridge the gap between science and policy? An exploration into the (non) use and (non) influence of indicators in EU and UK policy making. Nature and Culture,9(3), 316–343.
Stainton Rogers, R., Stenner, P., Gleeson, K., & Stainton Rogers, W. (1995). Social psychology: A critical agenda. Cambridge: Polity Press.
Steelman, T. A., & Maguire, L. A. (1999). Understanding participant perspectives: Q-methodology in national forest management. Journal of Policy Analysis and Management,18, 361–388.
Stiglitz, J., Sen, A., & Fitoussi, J. P. (2009). The measurement of economic performance and social progress revisited. Reflections and overview. Paris: Commission on the Measurement of Economic Performance and Social Progress.
The Treasury. (2018). Living standards framework: Introducing the dashboard. New Zealand Government. Retrieved January 21, 2020, from https://treasury.govt.nz/publications/tp/living-standards-framework-introducing-dashboard.
The Treasury. (2019). Budget policy statement 2019. New Zealand Government. Retrieved January 21, 2020, from https://treasury.govt.nz/publications/budget-policy-statement/budget-policy-statement-2019.
Thiry, G., & Roman, P. (2014). The Inclusive Wealth Index. A sustainability indicator, really? HAL Working Paper Series No. 71. Retrieved June 15, 2018, from https://halshs.archives-ouvertes.fr/halshs-01011250.
Turnhout, E., Hisschemöller, M., & Eijsackers, H. (2007). Ecological indicators: Between the two fires of science and policy. Ecological Indicators,7(2), 215–228.
Valenta, A. L., & Wigger, U. (1997). Q-methodology: Definition and application in health care informatics. Journal of the American Medical Informatics Association,4(6), 501–510.
Van den Bergh, J. C. (2009). The GDP paradox. Journal of Economic Psychology,30(2), 117–135.
Van Eeten, M. J. G. (2000). Recasting environmental controversies: A Q study of the expansion of amsterdam airport. In H. Addams & J. Proops (Eds.), Social discourse and environmental policy: An application of Q methodology (pp. 41–70). Cheltenham, UK: Edward Elgard Publishing Limited.
Van Exel, J., & De Graaf, G. (2005). Q methodology: A sneak preview. Retrieved June 15, 2018, from www.jobvanexel.nl.
Watts, S., & Stenner, P. (2005). Doing Q methodology: Theory, method and interpretation. Qualitative Research in Psychology,2(1), 67–91.
Weible, C. M. (2008). Expert-based information and policy subsystems: A review and synthesis. Policy Studies Journal,36(4), 615–635.
Well-being of Future Generations (Wales) Act. (2015). Retrieved January 21, 2020, from http://www.legislation.gov.uk/anaw/2015/2/contents/enacted.
What Works Centre for Wellbeing. (2018). Wellbeing in policy analysis. London: What Works Wellbeing. Retrieved January 21, 2020, from https://www.whatworkswellbeing.org/wp-content/uploads/2018/03/Overview-incorporating-wellbeing-in-policy-analysis-vMarch2018.pdf.
Yang, L. (2014). An inventory of composite measures of human progress. UNDP Human Development Report Office: Occasional Paper on Methodology. Retrieved June 15, 2018, from http://hdr.undp.org/sites/default/files/inventory_report_working_paper.pdf.
Zabala, A., & Pascual, U. (2016). Bootstrapping Q methodology to improve the understanding of human perspectives. PLoS ONE,11(2), e0148087.
Zagorin, P. (1998). Francis Bacon. Princeton: Princeton University Press.