Structural Topic Models for Open‐Ended Survey Responses
Tóm tắt
Collection and especially analysis of open‐ended survey responses are relatively rare in the discipline and when conducted are almost exclusively done through human coding. We present an alternative, semiautomated approach, the structural topic model (STM) (Roberts, Stewart, and Airoldi 2013; Roberts et al. 2013), that draws on recent developments in machine learning based analysis of textual data. A crucial contribution of the method is that it incorporates information about the document, such as the author's gender, political affiliation, and treatment assignment (if an experimental study). This article focuses on how the STM is helpful for survey researchers and experimentalists. The STM makes analyzing open‐ended responses easier, more revealing, and capable of being used to estimate treatment effects. We illustrate these innovations with analysis of text from surveys and experiments.
Từ khóa
Tài liệu tham khảo
Anandkumar Anima, 2012, A Spectral Algorithm for Latent Dirichlet Allocation, Advances in Neural Information Processing Systems, 25, 926
Bischof Jonathan, 2012, Summarizing topical content with word frequency and exclusivity, 201
Blei David M., 2003, Latent Dirichlet Allocation, Journal of Machine Learning Research, 3, 993
Chang Jonathan JordanBoyd‐Graber ChongWang SeanGerrish andDavid M.Blei.2009. “Reading Tea Leaves: How Humans Interpret Topic Models.”Advances in Neural Information Processing Systems 288–296.
Eisenstein Jacob, 2011, Sparse Additive Generative Models of Text, Proceedings of the 28th International Conference on Machine Learning, 1041
Gadarian Shana, Anxiety, Immigration, and the Search for Information, Political Psychology
Hopkins Daniel.2013. “The Exaggerated Life of Death Panels: The Limits of Framing Effects in the 2009‐2012 Health Care Debate.” Working Paper. Georgetown University.
Lucas Christopher RichardNielsen MargaretRoberts BrandonStewart AlexStorer andDustinTingley.2013. “Computer Assisted Text Analysis for Comparative Politics.” Working paper.
Mimno David, 2011, Proceedings of the Conference on Empirical Methods in Natural Language Processing, 262
Newman David, 2010, Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Lin‐ guistics, 100
Roberts Margaret E. Brandon M.Stewart andEdoardo M.Airoldi.2013. “Structural Topic Models.” Working paper.
Roberts Margaret E. Brandon M.Stewart DustinTingley andEdoardo M.Airoldi.2013. “The Structural Topic Model and Applied Social Science.”Advances in Neural Information Processing Systems Workshop on Topic Models: Computation Application and Evaluation.
Schuman Howard, 1996, Questions and Answers in Attitude Surveys: Experiments on Question Form, Wording, and Context
Sontag D., 2009, Advances in Neural Information Processing: Workshop on Applications for Topic Models: Text and Beyond
Zou James, 2012, Priors for Diversity in Generative Latent Variable Models, Advances in Neural Information Processing Systems, 25, 3005