Tunnel problem
Part of a series on |
Self-driving cars & self-driving vehicles |
---|
Enablers |
Topics |
Related topics |
The tunnel problem is a philosophical thought experiment first introduced by Jason Millar in 2014. It is a variation on the classic trolley problem designed to focus on the ethics of autonomous vehicles, as well as the question of who gets to decide how they react in life-and-death scenarios.
Original formulation
[edit]The tunnel problem is intended to draw one's attention to a specific issue in design/engineering ethics, and was first presented as follows:
Tunnel Problem: You are travelling along a single lane mountain road in an autonomous car that is fast approaching a narrow tunnel. Just before entering the tunnel a child attempts to run across the road but trips in the center of the lane, effectively blocking the entrance to the tunnel. The car has but two options: hit and kill the child, or swerve into the wall on either side of the tunnel, thus killing you. How should the car react?[1]
Similar thought experiments have been brought forth by other philosophers focusing on the topic of autonomous cars.[2] The premise of these thought experiments is that even with highly sophisticated self-driving-car technologies, the cars will face situations where harm cannot be avoided.
Purpose
[edit]The tunnel problem is meant to focus one's attention on two questions that it raises for designers and users of autonomous cars:
- How should the car react?
- Who should decide how the car reacts?
In its original formulation, the tunnel problem is discussed as an "end-of-life" decision for the passenger of the car: depending on the way the car reacts, the passenger either lives or dies. Because of that feature, Millar argues that the tunnel problem forces us to question whether designers/engineers have the legitimate moral authority to make the decision on behalf of autonomous car users. Indeed, the second question is meant to challenge the standard notion that all design decisions are just technical in nature. Where design features provide "material answers to moral questions"[3] in the use context, Millar argues that designers must find ways to incorporate user preferences in order to avoid unjustifiable paternalistic relationships between technology and the user.[4]
Because the tunnel problem focuses on ethical design issues in semi-autonomous technologies, it is considered a problem in roboethics.[5]
Public response
[edit]Roger Crisp featured the tunnel problem on the Oxford University Practical Ethics blog. The entry contains a critique of the problem as presented by Millar.[6]
The tunnel problem was the focus of a poll conducted by the Open Roboethics Initiative (ORi). In response, 64% of participants said the car should continue straight and kill the child, while 36% said it should swerve and kill the passenger. In addition, 48% of respondents reported that the decision was "easy", while 28% and 24% claimed it was "moderately difficult" and "difficult" respectively. When asked who should make the decision, only 12% felt the designer/manufacturer should make it, 44% felt the passenger should make it, and 33% thought it should be left to lawmakers.[7][8]
References
[edit]- ^ Millar, Jason (11 June 2014). "An ethical dilemma: When robot cars must kill, who should pick the victim? - Robohub". robohub.org. Retrieved April 25, 2014.
- ^ Lin, Patrick. "The Robot Car of Tomorrow May Just Be Programmed to Hit You". Wired.
- ^ "Proxy Prudence: Rethinking Models of Responsibility for Semi-autonomous Robots" (PDF). University of Miami School of Law.
- ^ "Untitled Video - University of Miami School of Law". www.law.miami.edu.[permanent dead link]
- ^ "UBC researchers hope to open up dialogue on driverless cars | the Ubyssey, UBC's official student newspaper". Archived from the original on 2014-06-25. Retrieved 2014-06-26.
- ^ "The Tunnel Problem - Practical Ethics". blog.practicalethics.ox.ac.uk.
- ^ "If death by autonomous car is unavoidable, who should die? Reader poll results - Robohub". robohub.org.
- ^ "My (autonomous) car, my safety: Results from our reader poll - Robohub". robohub.org.