A new metric of consensus for Likert-type scale questionnaires: an application to consumer expectations
Tóm tắt
In this study, we present a metric of consensus for Likert-type scales. The statistic provides the level of agreement for any given number of response options as the percentage of consensus among respondents. With this aim, we use a geometric framework that allows us to analytically derive a positional indicator. The statistic is obtained as the relative weight of the distance from the point containing the proportions of observations that fall in each category to the centre of a regular polygon with as many vertices as categories, which corresponds to the point of maximum dissent. The polygon can be regarded as the area that encompasses all possible answering combinations. In order to assess the performance of the proposed metric of consensus, we conduct an iterated forecasting experiment to test whether the inclusion of the degree of agreement in households’ expectations improves out-of-sample forecast accuracy of the unemployment rate in seven European countries and the Euro Area. We find evidence that the level of consensus among households contains useful information to predict unemployment rates in all cases. This result shows the potential of agreement metrics to track the evolution of economic variables. Finally, we design a simulation experiment in which we compare the sampling distribution of the proposed metric for three- and five-response alternatives, finding that the distribution of the former shows a higher level of granularity and dispersion.
Tài liệu tham khảo
Likert R (1932) A technique for the measurement of attitudes. Arch Psychol 140: 1–55. https://psycnet.apa.org/record/1933-01885-001
Cox EP (1980) The optimal number of response alternatives for a scale: a review. J Mark Res 17(4):407–422. https://doi.org/10.2307/3150495
Barnes ML, Olivei GP (2016) Are survey expectations theory-consistent? The role of central bank communication and news. J Money Credit Bank 49(5):1031–1058. https://doi.org/10.1016/j.euroecorev.2016.01.010
Berge TJ (2018) Understanding survey-based inflation expectations. Int J Forecast 34(4):788–801. https://doi.org/10.1016/j.ijforecast.2018.07.003
Binder CC (2015) Whose expectations augment the Phillips curve? Econ Lett 136:35–38. https://doi.org/10.1016/j.econlet.2015.08.013
Binder CC (2017) Measuring uncertainty based on rounding: New method and application to inflation expectations. J Monet Econ 90:1–12. https://doi.org/10.1016/j.jmoneco.2017.06.001
Dräger L, Lamla MJ, Pfajfar D (2016) Are survey expectations theory-consistent? The role of central bank communication and news. Eur Econ Rev 85:84–111. https://doi.org/10.1016/j.euroecorev.2016.01.010
Rosenblatt-Wisch R, Scheufele R (2015) Quantification and characteristics of household inflation expectations in Switzerland. Appl Econ 47(26):2699–2716. https://doi.org/10.1080/00036846.2015.1008773
Von der Gracht HA (2012) Consensus measurement in Delphi studies. Review and implications for future quality assurance. Tech Forecast Soc Change 79(8):1525–1536. https://doi.org/10.1016/j.techfore.2012.04.013
European Commission (2020) A user guide to the Joint Harmonized EU Programme of Business and Consumer Surveys. Directorate-General for Economic and Financial Affairs, Brussels. https://ec.europa.eu/info/files/user-guide-joint-harmonised-eu-programme-business-and-consumer-surveys_en. Accessed 31 Jan 2018
Bachmann R, Elstner S, Sims ER (2013) Uncertainty and economic activity: evidence from business survey data. Am Econ J Macroecon 5(2):217–249. https://doi.org/10.1257/mac.5.2.217
Claveria O (2020) Uncertainty indicators based on expectations of business and consumer surveys. Empirica. https://doi.org/10.1007/s10663-020-09479-1Forthcoming
Dibiasi A, Iselin D (2019) Measuring Knightian uncertainty. KOF Working Papers No. 456. ETH Zurich, KOF Swiss Economic Institute, Zurich. https://doi.org/10.3929/ethz-b-000341984
Girardi A, Reuter A (2017) New uncertainty measures for the euro area using survey data. Oxf Econ Pap 69(1):278–300. https://doi.org/10.1093/oep/gpw058
Lamla MJ, Maag T (2012) The role of media for inflation forecast disagreement of households and professional forecasters. J Money Credit Bank 44(7):1325–1350. https://doi.org/10.1111/j.1538-4616.2012.00534.x
Mokinski F, Sheng X, Yang J (2015) Measuring disagreement in qualitative expectations. J Forecast 34(5):405–426. https://doi.org/10.1002/for.2340
Maag T (2009) On the accuracy of the probability method for quantifying beliefs about inflation. KOF Working Papers, No. 230. ETH Zurich, KOF Swiss Economic Institute, Zurich. https://doi.org/10.3929/ethz-a-005859391
Saari DG (2008) Complexity and the geometry of voting. Math Comput Model 48(9–10):551–573. https://doi.org/10.1016/j.mcm.2008.05.033
Coxeter HSM (1969) Introduction to geometry, 2nd edn. Wiley, London. https://www.wiley.com/en-es/Introduction+to+Geometry,+2nd+Edition-p-9780471504580
D’Amuri F, Marcucci J (2017) The predictive power of Google searches in forecasting US unemployment. Int J Forecast 33(4):801–816. https://doi.org/10.1016/j.ijforecast.2017.03.004
Vicente MR, López-Menéndez AJ, Pérez R (2015) Forecasting unemployment with internet search data: does it help to improve predictions when job destruction is skyrocketing? Technol Forecast Soc Change 92:132–139. https://doi.org/10.1016/j.techfore.2014.12.005
Akaike H (1974) A new look at the statistical model identification. IEEE Trans Autom Control 19(6):716–723. https://doi.org/10.1109/TAC.1974.1100705
Hyndman RJ, Koehler AB (2006) Another look at measures of forecast accuracy. Int J Forecast 22(4):679–688. https://doi.org/10.1016/j.ijforecast.2006.03.001
Harvey D, Leybourne S, Newbold P (1997) Testing the equality of prediction mean squared errors. Int J Forecast 13(2):281–291. https://doi.org/10.1016/S0169-2070(96)00719-4
Claveria O, Monte E, Torra S (2015) A new forecasting approach for the hospitality industry. Int J Contemp Hosp Manag 27(7):1520–1538. https://doi.org/10.1108/IJCHM-06-2014-0286
Cowles A, Jones H (1937) Some a posteriori probabilities in stock market action. Econometrica 5(3):280–294. https://doi.org/10.2307/1905515
Makridakis S, Hibon M (2000) The M3-competition: results, conclusions and implications. Int J Forecast 16(4):451–476. https://doi.org/10.1016/S0169-2070(00)00057-1
Claveria O (2019) A new consensus-based unemployment indicator. Appl Econ Lett 26(10):812–817. https://doi.org/10.1080/13504851.2018.1497846
Lahiri K, Monokroussos G, Zhao Y (2016) Forecasting consumption: The role of consumer confidence in real time with many predictors. J Appl Econom 31(7):1254–1275. https://doi.org/10.1002/jae.2494