Machine Learning, Social Learning and the Governance of Self-Driving Cars

Jack Stilgoe1
1University College London

Tóm tắt

Từ khóa


Tài liệu tham khảo

E Ackerman, 2016, After mastering Singapore's streets, NuTonomy's robo-taxies are poised to take on new cities, IEEE Spectrum. 29 December

M Ananny, 2016, Toward an ethics of algorithms: Convening, observation, probability, and timeliness, Technology & Human Values, 41, 93, 10.1177/0162243915606523

M Ananny, 2016, Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability, New Media & Society, 10.1177/1461444816676645

A Anderson, 2016, Human complacency is a serious but separate issue best addressed with education, monitoring & enforcement, not dumbed down safety systems

July, 2017, 10.1093/ww/9780199540884.013.u229901

D Baker, 2017, Driverless milestone: No hands across America

A Bandura, 1988, Organisational applications of social cognitive theory, Australian Journal of Management, 13, 275, 10.1177/031289628801300210

F Berkes, 2006, Knowledge, learning and the evolution of conservation practice for social-ecological system resilience, Human Ecology, 34, 479, 10.1007/s10745-006-9008-2

1987, The Social Construction of Technological Systems: New Directions in the Sociology and History of Technology

Bild, 2016, AutoTesla weist beh�rdenkritik am �Autopilot�-namen zur�ck

October, 2017

M Bojarski, 2016, End to end learning for self-driving cars. arXiv, 25 April

M Bojarski, 2016, End-to-end deep learning for self-driving cars

August, 2017

J F Bonnefon, 2016, The social dilemma of autonomous vehicles, Science, 352, 1573, 10.1126/science.aaf2654

M Borup, 2006, The sociology of expectations in science and technology, Technology Analysis & Strategic Management, 18, 285, 10.1080/09537320600777002

G Both, 2014, What drives research in self-driving cars

R Bradley, 2016, Tesla Autopilot. MIT Technology Review. Available

J M Bradshaw, 2013, The seven deadly myths of "Autonomous Systems, IEEE Intelligent Systems, 28, 54, 10.1109/mis.2013.70

Brooks, 1993, Real robots, real learning problems, Robot Learning, 193, 10.1007/978-1-4615-3184-5_8

B Brown, 2017, The trouble with autopilots: Assisted and autonomous driving on the social road

J Burrell, 2016, How the machine 'thinks': understanding opacity in machine learning algorithms, Big Data & Society, 3, 10.1177/2053951715622512

A Chander, 2014, How law made Silicon Valley, Emory Law Journal, 63, 639

A Charton, 2015, Tesla owners need to stop doing crazy things with Autopilot, says Elon Musk, International Business Times. 4 November

T Cohen, 2017, Social and behavioural questions associated with automated vehicles. Scoping study by UCL Transport Institute. Final report. London: Department for Transport, 10.1080/01441647.2018.1524401

D Collingridge, 1980, The Social Control of Technology

H M Collins, 1988, Public experiments and displays of virtuosity: The core-set revisited, Social Studies of Science, 18, 725, 10.1177/030631288018004006

2016, Tesla's Autopilot: Too much autonomy too soon, Consumer Reports

Crawford K Calo, 2016, There is a blind spot in AI research, Nature, 538, 311, 10.1038/538311a

Pre-print version, Social Studies of Science, 10.1177/0306312717741687

M L Cummings, 2011, Paying attention to the man behind the curtain, IEEE Pervasive Computing, 10, 58, 10.1109/mprv.2011.7

A Davies, 2016, Cadillac's delaying its first whack at a self-driving car

January, 2017

J De Greeff, 2015, Why robots should be social: Enhancing machine learning through social human-robot interaction, PLoS One, 10, 10.1371/journal.pone.0138061

De Vos, 2016, Testimony of Glen W. De Vos -Senate Commerce, Science and Transportation Committee Hearing. Delphi Automotive. Available

J Dewey, 1916, Essays in Experimental Logic, 10.1037/13833-000

D Dolgov, 2017, Accelerating the pace of learning

L Edwards, 2017, Slave to the algorithm? Why a 'right to explanation' is probably not the remedy you are looking for, 10.31228/osf.io/97upg

M C Elish, 2016, Moral crumple zones: Cautionary tales in human-robot interaction, 10.2139/ssrn.2757236

M Eriksson, 2017, The normativity of automated driving: A case study of embedding norms in technology, Information & Communications Technology Law, 26, 46, 10.1080/13600834.2017.1269872

D Etherington, 2016, Musk targeting coast-to-coast test drive of fully self-driving Tesla by late 2017

2001, Late Lessons from Early Warnings: The Precautionary Principle 1896-2000, European Environment Agency

C Faife, 2017, Drivers use Tesla Autopilot at their own risk, investigators conclude. Vice Motherboard

K Fehrenbacher, 2015, How Tesla is ushering in the age of the learning car

October, 2017

W Fierman, 2016, BMW just announced that self-driving cars are coming in less than 5 years, Business Insider. 1 July. Available at

A Filipowicz, 2017, Learning to recognize distance to stop signs using the virtual world of Grand Theft Auto 5

E Finn, 2017, What Algorithms Want: Imagination in the Age of Computing, 10.7551/mitpress/9780262035927.001.0001

F Fischer, 2000, Citizens, Experts and the Environment: The Politics of Local Knowledge, 10.1215/9780822380283

T Frankel, 2016, Elon Musk says Tesla's Autopilot is already 'probably' better than human drivers, The Washington Post

J Friedmann, 1976, Social learning: A model for policy research, Environment and Planning A, 8, 927, 10.1068/a080927

J Golson, 2016, Volvo autonomous car engineer calls Tesla's Autopilot a 'wannabe'. The Verge, 27

L Gomes, 2016, Available at: http://spectrum.ieee.org/cars-thatthink/transportation/self-driving/google-selfdriving-car-will-be-ready-soon-for-somein-decades-for-others

B Goodman, 2016, European Union regulations on algorithmic decision-making and a' right to explanation, 10.1609/aimag.v38i3.2741

2016, Autonomous vehicles meet human drivers: Traffic safety issues for states, GHSA (Governors Highway Safety Association

M Gross, 2010, Ignorance and Surprise: Science, Society, and Ecological Design, 10.7551/mitpress/9780262013482.001.0001

E Guizzo, 2015, Gill Pratt discusses Toyota's AI plans and the future of robots and cars, IEEE Spectrum, 11

D H Guston, 2014, Understanding 'anticipatory governance, Social Studies of Science, 44, 218, 10.1177/0306312713508669

M Hajer, 2003, Policy without polity? Policy analysis and the institutional void, Policy Sciences, 36, 175, 10.1023/A:1024834510939

Pre-print version, Social Studies of Science, 10.1177/0306312717741687

P A Hall, 1993, Policy paradigms, social learning, and the state: The case of economic policymaking in Britain, Comparative Politics, 275, 10.2307/422246

A Hawkins, 2016, Self-driving car makers don't sound super excited to share data with the federal government. The Verge

R Hoppe, 2011, The Governance of Problems: Puzzling, Powering and Participation, 10.1332/policypress/9781847429629.001.0001

A Irwin, 1999, Faulty environments and risk reasoning: The local understanding of industrial hazards, Environment and Planning A, 31, 1311, 10.1068/a311311

N Jafarinaimi, 2017, Our bodies in the trolley's path, or why self-driving cars must *not* be programmed to kill, Technology, & Human Values, 10.1177/0162243917718942

S Jasanoff, 1995, Product, process, or programme: Three cultures and the regulation of biotechnology, Resistance to New Technology: Nuclear Power, Information Technology and Biotechnology, 311, 10.1017/cbo9780511563706.016

S Jasanoff, 2003, Technologies of humility: Citizen participation in governing science, Minerva, 41, 223, 10.1023/A:1025557512320

S Jasanoff, 2016, The Ethics of Invention: Technology and the Human Future

N Jaynes, 2016, Mercedes Drive Pilot isn't as precise as Tesla Autopilot, and that's OK. Mashable, 16 June

T Jochem, 1996, Life in the fast lane: The evolution of an adaptive vehicle control system, AI magazine, 17

N Kalra, 2016, Driving to safety: How many miles of driving would it take to demonstrate autonomous vehicle reliability? Available at, 10.1016/j.tra.2016.09.010

M Kearnes, 2006, From bio to nano: Learning lessons from the UK agricultural biotechnology controversy, Science as Culture, 15, 291, 10.1080/09505430601022619

K Kelly, 2010, What Technology Wants

Pre-print version, Social Studies of Science, 10.1177/0306312717741687

M K�rber, 2015, Vigilance decrement and passive fatigue caused by monotony in automated driving, Procedia Manufacturing, 3, 2403, 10.1016/j.promfg.2015.07.499

A W Kosner, 2013, Why is machine learning (CS 229) the most popular course at Stanford? Forbes, 29

A Krizhevsky, 2012, Imagenet classification with deep convolutional neural networks, Advances in Neural Information Processing Systems, 25, 1097, 10.1145/3065386

J Kuzma, 2016, Reboot the debate on genetic engineering, Nature, 531, 165, 10.1038/531165a

F Lambert, 2016, Transcript: Elon Musk's press conference about Tesla Autopilot under v8.0 update

Electrek, 2017, 10.4159/harvard.9780674599468.c3

Landskroner Grieco Merriman, 2017, Statement from the Family of Joshua Brown

A Lane, 2016, Lo and Behold' and 'Mia Madre' reviews. The New Yorker, 29

August, 10.1093/benz/9780199773787.article.b00121828

B Latour, 2002, Morality and technology: The end of the means. Theory, Culture & Society, 19, 247, 10.1177/026327602761899246

Y Lecun, 2015, Deep learning, Nature, 521, 436, 10.1038/nature14539

P M Leonardi, 2010, From road to lab to math: The co-evolution of technological, regulatory, and organizational innovations for automotive crash testing, Social Studies of Science, 40, 243, 10.1177/0306312709346079

H Lipson, 2016, Driverless: Intelligent Cars and the Road Ahead

C Loomis, 2016, Elon Musk says Autopilot death 'not material' to Tesla shareholders

D Lupton, 1999, Risk and Sociocultural Theory: New Directions and Perspectives, 10.1017/cbo9780511520778

A Mackenzie, 2015, The production of prediction: What does machine learning want?, European Journal of Cultural Studies, 18, 429, 10.1177/1367549415577384

Pre-print version, Social Studies of Science, 10.1177/0306312717741687

D A Mackenzie, 1990, Inventing Accuracy: A Historical Sociology of Nuclear Missile Guidance

C Mcgoogan, 2016, You're killing people': Elon Musk attacks critics of self-driving cars, The Telegraph. 20 October

2016, Silence and defeat the Tesla Autopilot nanny feature in v8, 16 September. Available at

E Millstone, 1999, Beyond 'substantial equivalence', Nature, 401, 525, 10.1038/44006

B D Mittelstadt, 2016, The ethics of algorithms: Mapping the debate, Big Data & Society, 3, 10.1177/2053951716679679

V Mnih, 2015, Human-level control through deep reinforcement learning, Nature, 518, 529, 10.1038/nature14236

M M Moore, 2011, Autonomous vehicles for personal transport: A technology assessment, 10.2139/ssrn.1865047

P Morgan, 2016, Handover issues in autonomous driving: A literature review

E Morozov, 2013, To Save Everything, Click Here: Technology, Solutionism, and the Urge to Fix Problems that Don't Exist, 10.3233/ip-130311

D Muoio, 2017, 2016) I was behind the wheel when a self-driving Uber failed -here's what happens, Business Insider. 24 December. Available at

E Musk, 2016, Great rebuttal by a Tesla owner to those calling for Autopilot to be disabled. Was written with zero input from us, 17 July. Available at

E Musk, 2016, Master plan, part deux

E Musk, 2017, @TOCHOTE Our target is a 90% reduction with HW2 as the software matures

E Musk, 2017, Autopilot for HW2 rolling out to all HW2 cars today. Please be cautious. Some cars will require adjustment of camera pitch angle by service

January, 2017

E Musk, 2017, Auto steer limited to 45 mph on highways for now, i.e. heavy traffic, where it is needed most. Limit will raise as we get more data, 22 January. Available at

D Neyland, 2016, Bearing account-able witness to the ethical algorithmic system, Technology & Human Values, 41, 50, 10.1177/0162243915598056

A Ng, 2016, It's irresponsible to ship driving system that works 1,000 times and lulls false sense of safety

2008, National motor vehicle crash causation survey, Report to Congress. Available

2014, Human factors evaluation of level 2 and level 3 automated driving concepts, Letter from Jeffrey Quandt to Mathew Schwall. 8 July. Available at

2016, Federal automated vehicles policy, NHTSA

2017, Office of defects investigation, investigation PE 16-007, NHTSA

H Nissenbaum, 1994, Computing and accountability, Communications of the ACM, 37, 72, 10.1145/175222.175228

I R Nourbakhsh, 2013, Robot Futures

NTSB (2017a) HWY16FH018 Driver assistance system

Pre-print version, Social Studies of Science, 10.1177/0306312717741687

2017, HWY16FH018 Human performance factors group chairman's factual report. Attachment 4: Witness Interview, NTSB

2017, Transcript of board meeting, NTSB

Nvidia, 2017, Reading an AI car's mind: How NVIDIA's neural net makes decisions

B Obama, 2016, Barack Obama: Self-driving, yes, but also safe. Pittsburgh PostGazette

R Owen, 2014, Solar radiation management and the governance of hubris. Geoengineering of the Climate System, 38

E A Parson, 1995, Sustainable development as social learning: Theoretical perspectives and practical challenges for the design of a research program, 428

G Paquet, 2005, The new geo-governance: A baroque approach

F Pasquale, 2015, The Black Box Society: The Secret Algorithms that Control Money and Information, 10.4159/harvard.9780674736061

C Perrow, 1984, Normal Accidents: Living with High Risk Systems

S Pinker, 1995, The Language Instinct: The New Science of Language and Mind

J Puzzanghera, 2016, Fatal Tesla crash exposes lack of regulation over autopilot technology, Los Angeles Times, 1

M Ramsey, 2016, Mobileye ends partnership with Tesla. The Wall Street Journal, 26

J Ramsey, 2017, The way we talk about autonomy is a lie, and that's dangerous. The Drive, 8 March

Pre-print version, Social Studies of Science, 10.1177/0306312717741687

Rand, 2016, Autonomous vehicle technology: A guide for policymakers

S Rayner, 2004, The novelty trap: Why does institutional learning about new technologies seem so difficult? Industry and Higher Education, 18, 349, 10.5367/0000000042683601

S Rayner, 1987, How fair is safe enough? The cultural approach to societal technology choice, Risk Analysis, 7, 3, 10.1111/j.1539-6924.1987.tb00963.x

Recode, 2017, We liveblogged all the news and updates from Las Vegas

Recode, 2017, 10.4135/9781412983907.n1625

Redebo, 2016, Mothra strikes back! Knocks me out of autopilot on a lonely stretch of road? Reddit

M Reed, 2010, What is social learning, Ecology and Society, 15, 10.5751/es-03564-1504r01

O Renn, 1998, The role of risk perception for risk management, Reliability Engineering & System Safety, 59, 49, 10.1016/s0951-8320(97)00119-1

K Reynolds, 2016, Testing (semi) autonomous cars with Tesla, Cadillac, Hyundai, and Mercedes. Motor Trend

H J Rheinberger, 1997, Toward a History of Epistemic Things. Synthesizing Proteins in the Test Tube, 10.1086/384059

A Rip, 1986, Controversies as informal technology assessment, Knowledge, 8, 349, 10.1177/107554708600800216

J Scoltock, 2015, Driving the future. Automotive Engineer

S Shalev-Shwartz, 2016, On the sample complexity of end-to-end training vs. semantic abstraction training

A Shashua, 2016, Autonomous car -what goes into sensing for autonomous driving? Mobileye

Sheikh, 2017, Class action complaint submitted to United States district court northern district of California San Jose division

Pre-print version, Social Studies of Science, 10.1177/0306312717741687

S E Shladover, 2009, Cooperative (rather than autonomous) vehicle-highway automation systems, IEEE Intelligent Transportation Systems Magazine, 1, 10, 10.1109/mits.2009.932716

S Shorrock, 2013, State of California Department of Motor Vehicles (2016) Express terms

E Stayton, 2015, Driverless Dreams; Technological Narratives and the Shape of the Automated Car, MIT. Available at

J Stilgoe, 2013, Developing a framework for responsible innovation, Research Policy, 42, 1568, 10.1016/j.respol.2013.05.008

J Stilgoe, 2016, Geoengineering as collective experimentation, Science and Engineering Ethics, 22, 851, 10.1007/s11948-015-9646-0

H Surden, 2016, Technological opacity, predictability, and selfdriving cars, Cardozo Law Review, 38, 10.2139/ssrn.2747491

B Szerszynski, 2013, Why solar radiation management geoengineering and democracy won't mix, Environment and Planning A, 45, 2809, 10.1068/a45649

Tesla, 2013, Tesla Model S achieves best safety rating of any car ever tested

August, 2017

Tesla, 2015, Autopilot has arrived. 14 October. Available at, 10.1515/9780691188881-009

Tesla, 2016, All Tesla cars being produced now have full self-driving hardware

October, 2017

Tesla, 2016, A tragic loss

Tesla, 2016, Upgrading Autopilot: seeing the world in radar

Tesla, 2017, Self-driving hardware on all cars

Pre-print version, Social Studies of Science, 10.1177/0306312717741687

Tesla, 2017, Letter to California Department of Motor Vehicles

Usa Toyota, 2017, CES 2017 Live Stream | Toyota. YouTube. 4 January

2016, Florida traffic crash report. Highway Safety & Motor Vehicles, Traffic Crash Records

C Urmson, 2015, How a driverless car sees the road

T Vanderbilt, 2012, Let the robot drive: the autonomous car of the future is here

A Vellido, 2012, Making machine learning models interpretable, In ESANN, 12, 163

Vinsel L (forthcoming) Taming the American Idol: Cars, Risks, and Regulations

S Wachter, 2017, Why a right to explanation of automated decision-making does not exist in the general data protection regulation, International Data Privacy Law, 7, 76, 10.1093/idpl/ipx005

T Walsh, 2016, Turing's red flag, Communications of the ACM, 59, 34, 10.1145/2838729

Waymo, 2017, On the road to fully self-driving

T Webler, 1995, Public participation in impact assessment: A social learning perspective, Environmental Impact Assessment Review, 15, 443, 10.1016/0195-9255(95)00043-e

A M Weinberg, 1972, Science and trans-science, Minerva, 10, 209, 10.1007/bf01682418

J Westbrook, 2016, PSA: don't try to take highway off-ramps with Tesla's Autopilot just yet. Jalopnik. 30 September

J Wetmore, 2003, Driving the dream, The history and motivations behind 60 years of automated highway systems in America, Automotive History Review, 7, 4

Pre-print version, Social Studies of Science, 10.1177/0306312717741687

E L Wiener, 1977, Controlled flight into terrain accidents: System-induced errors, Human Factors: The Journal of the Human Factors and Ergonomics Society, 19, 171, 10.1177/001872087701900207

A F Winfield, 2017, The case for an ethical black box, 18 th Conference Towards Autonomous Robotic Systems, 262, 10.1007/978-3-319-64107-2_21

L Winner, 1977, Autonomous Technology: Technology-out-of-Control as a Theme in Political Thought

L Winner, 1980, Do artifacts have politics? Daedalus, 121, 10.4324/9781315259697-21

Wired, 2016, Barack Obama, neural nets, self-driving cars, and the future of the world

B Wynne, 1988, Unruly technology: Practical rules, impractical discourses and public understanding, Social Studies of Science, 18, 147, 10.1177/030631288018001006

B Wynne, 1989, Frameworks of rationality in risk management: towards the testing of naive sociology. Environmental Threats: Social Sciences Approaches to Public Risk Perceptions, 33

B Wynne, 1992, Risk and social learning: Reification to engagement, Theories of Risk, 275

B Wynne, 1993, Public uptake of science: A case for institutional reflexivity, Public Understanding of Science, 2, 321, 10.1088/0963-6625/2/4/003

Xkwizit, 2016, Autopilot -note to drivers and Consumer Reports, Tesla Motors Club. 16 July. Available at

Xrayvsn, 2016, How Autopilot has added years to my life. Tesla Motors Club

February, 2017, 10.4135/9781446212660.n16

J Yoshida, 2017, Uber crash exposes V2X politics. EE Times, 28

Y You, 2017, Virtual to real reinforcement learning for autonomous driving

Jack Stilgoe is senior lecturer in Science and Technology Studies at University College London. He is interested in the governance of emerging technologies such as Pre-print version, Social Studies of Science, 10.1177/0306312717741687

He previously worked at the Royal Society and the think tank Demos, and continues to advise policymakers in the UK and Brussels, 2016-17 he was a visiting researcher at the University of Colorado