An Evaluation of Amazon’s Mechanical Turk, Its Rapid Rise, and Its Effective Use

Perspectives on Psychological Science - Tập 13 Số 2 - Trang 149-154 - 2018
Michael D. Buhrmester1, Sanaz Talaifar2, Samuel D. Gosling2,3
1Institute of Cognitive and Evolutionary Anthropology, University of Oxford
2Department of Psychology, University of Texas at Austin
3Melbourne School of Psychological Sciences, University of Melbourne

Tóm tắt

Over the past 2 decades, many social scientists have expanded their data-collection capabilities by using various online research tools. In the 2011 article “Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality, data?” in Perspectives on Psychological Science, Buhrmester, Kwang, and Gosling introduced researchers to what was then considered to be a promising but nascent research platform. Since then, thousands of social scientists from seemingly every field have conducted research using the platform. Here, we reflect on the impact of Mechanical Turk on the social sciences and our article’s role in its rise, provide the newest data-driven recommendations to help researchers effectively use the platform, and highlight other online research platforms worth consideration.

Từ khóa


Tài liệu tham khảo

10.1177/1525822X15603149

Arditte K. A., 2016, Psychological Assessment, 28, 684, 10.1037/pas0000217

Berinsky A. J., 2012, Political Analysis, 20, 351, 10.1093/pan/mpr057

Berinsky A. J., 2016, Journal of Experimental Social Psychology, 60, 20, 10.1016/j.jesp.2015.09.010

Black J., 2013, Personality and Individual Differences, 54, 426, 10.1016/j.paid.2012.10.012

Buchanan T., 2010, Advanced methods for conducting online behavioral research, 255, 10.1037/12076-016

10.1177/1745691610393980

Callegaro M., 2014, Online panel research: A data quality perspective, 10.1002/9781118763520

Casler K., 2013, Computers in Human Behavior, 29, 2156, 10.1016/j.chb.2013.05.009

Chandler J., 2014, Behavior Research Methods, 46, 112, 10.3758/s13428-013-0365-7

10.1177/1948550617698203

10.1146/annurev-clinpsy-021815-093623

Clifford S., 2016, Public Opinion Quarterly, 80, 858, 10.1093/poq/nfw030

Fraley R. C., 2004, How to conduct behavioral research over the internet: A beginner’s guide to HTML and CGI/Perl

10.1145/3022198.3023270

Gillan C. M., 2016, Neuron, 91, 19, 10.1016/j.neuron.2016.06.002

10.3758/s13428-016-0789-y

Goodman J. K., 2013, Journal of Behavioral Decision Making, 26, 213, 10.1002/bdm.1753

Gosling S. D., 2010, Advanced methods for conducting online behavioral research, 10.1037/12076-000

Gosling S. D., 2015, Annual Review of Psychology, 66, 877, 10.1146/annurev-psych-010814-015321

Gosling S. D., 2004, American Psychologist, 59, 93, 10.1037/0003-066X.59.2.93

10.1177/2158244015584617

10.3758/s13428-015-0578-z.

Harari G. M., 2017, Computers in Human Behavior, 67, 129, 10.1016/j.chb.2016.10.027

Horton J. J., 2011, Experimental Economics, 14, 399, 10.1007/s10683-011-9273-9

Kosinski M., 2015, American Psychologist, 70, 543, 10.1037/a0039210

Litman L., 2015, Behavior Research Methods, 47, 519, 10.3758/s13428-014-0483-x

Lowry P. B., 2016, The Journal of Strategic Information Systems, 25, 232, 10.1016/j.jsis.2016.06.002

Mason W., 2012, Behavior Research Methods, 44, 1, 10.3758/s13428-011-0124-6

Mason W., 2009, Association for Computing Machinery Explorations Newsletter, 11, 100

10.1073/pnas.1110069108

Oppenheimer D. M., 2009, Journal of Experimental Social Psychology, 45, 867, 10.1016/j.jesp.2009.03.009

Paolacci G., 2010, Judgment and Decision Making, 5, 411, 10.1017/S1930297500002205

Peer E., 2014, Behavior Research Methods, 46, 1023, 10.3758/s13428-013-0434-y

Peer E., 2017, Journal of Experimental Social Psychology, 70, 153, 10.1016/j.jesp.2017.01.006

Ramsey S. R., 2016, Computers in Human Behavior, 58, 354, 10.1016/j.chb.2015.12.049

Rand D.G., 2012, Journal of Theoretical Biology, 299, 172, 10.1016/j.jtbi.2011.03.004

10.1177/1948550616662122

10.1145/1753846.1753873

Sheehan K. B., 2016, Amazon’s Mechanical Turk for academics: The HIT handbook for social science research

Stewart N., 2015, Judgment and Decision Making, 10, 479, 10.1017/S1930297500005611

Van Dijck J, 2013, The culture of connectivity: A critical history of social media, 10.1093/acprof:oso/9780199970773.001.0001

10.1037/pspa0000056

Thông tin
Thông tin xuất bản

Perspectives on Psychological Science

Tập 13 Số 2

149-154

Thông tin tác giả