Who's to blame when HAL kills again?


Published: Mar 25, 2020
Keywords:
Artificial Intelligence (AI); Moral Agency; Responsibility Gap; Ethics of Technology; HAL 9000; Daniel Dennett; Autonomous Systems; Moral Personhood
Alkis Gounaris
Abstract

This article explores the ethical and legal challenges of moral agency and responsibility in the era of Artificial Intelligence (AI). Using the fictional AI "HAL 9000" from Stanley Kubrick’s 2001: A Space Odyssey as a starting point, the author investigates whether advanced autonomous systems can be held morally or legally accountable for their actions. Gounaris engages with Daniel Dennett’s theories on the "intentional stance" and the "higher-order" conditions required for moral personhood, such as consciousness, rationality, and the ability to be a "subject of address". The paper examines the "responsibility gap" that arises when AI systems make life-or-death decisions—such as in autonomous weaponry or medical triage—where traditional human-centered liability models may no longer apply. Ultimately, the study questions whether we should treat AI as a mere tool, a moral agent, or a "moral patient," and emphasizes the need for a new ethical framework to manage the risks of the 21st-century technological landscape.

Article Details
  • Section
  • Articles
Downloads
Download data is not yet available.
References
Anderson, Michael, and Susan L. Anderson. “Machine Ethics: Creating an Ethical Intelligent Agent.” AI Magazine 28, no. 4 (2007): 15–26.
Asahi Shimbun. “AI to Help Judges Score Gymnastics at 2020 Tokyo Olympics.” December 3, 2018. http://www.asahi.com/ajw/articles/AJ201812030005.html.
Bostrom, Nick. “Ethical Issues in Advanced Artificial Intelligence.” In Cognitive, Emotive and Ethical Aspects of Decision Making in Humans and in Artificial Intelligence, edited by I. Smit et al., Vol. 2, 12–17. Windsor, ON: Institute of Advanced Studies in Systems Research and Cybernetics, 2003.
Buss, Sarah, and Andrea Westlund. “Personal Autonomy.” In The Stanford Encyclopedia of Philosophy (Spring 2018 Edition), edited by Edward N. Zalta. https://plato.stanford.edu/archives/spr2018/entries/personal-autonomy/.
Clarke, Arthur C. 2001: A Space Odyssey. New York: New American Library, 1968.
Dennett, Daniel C. “When Hal Kills, Who’s to Blame? Computer Ethics.” In Hal’s Legacy: 2001’s Computer as Dream and Reality, edited by David G. Stork, 351–365. Cambridge, MA: MIT Press, 1997.
Dreyfus, Hubert L. “Why Heideggerian AI Failed and How Fixing It Would Require Making it More Heideggerian.” Philosophical Psychology 20, no. 2 (2007): 247–268.
Foot, Philippa. “The Problem of Abortion and the Doctrine of the Double Effect.” In Virtues and Vices and Other Essays in Moral Philosophy, edited by Basil Blackwell. Oxford: Blackwell, 1978. (Originally published in Oxford Review, no. 5, 1967).
Gounaris, Alkis. “Human Cognition and Artificial Intelligence: Seeking the Fundamental Differences of Meaning at the Limits of Metaphysics” [Ανθρώπινη Νόηση και Τεχνητή Νοημοσύνη: Αναζητώντας τις θεμελιώδεις διαφορές του νοήματος στα όρια της μεταφυσικής]. (2013). https://alkisgounaris.gr/gr/research/human-cognition-artificial-intelligence/. DOI: 10.13140/RG.2.2.17433.67681.
John C. McCallum. “Historical Notes on the Cost of Computer Memory.” https://jcmit.net/memoryprice.htm.
Matthias, Andreas. “The Responsibility Gap: Ascribing Responsibility for the Actions of Learning Automata.” Ethics and Information Technology 6 (2004): 175–183.
Noorman, Merel. “Computing and Moral Responsibility.” In The Stanford Encyclopedia of Philosophy (Spring 2018 Edition), edited by Edward N. Zalta. https://plato.stanford.edu/archives/spr2018/entries/computing-responsibility/.
Nietzsche, Friedrich. On the Genealogy of Morality [Η Γενεαλογία της Ηθικής]. Thessaloniki: Ekdotiki Thessalonikis.
O’Brien, Kyle. “Does Pearl, the First A.I. Ad Awards Juror, Know a Thing About Creativity?” Adweek, 2018. https://www.adweek.com/creativity/does-pearl-the-first-a-i-ad-awards-juror-know-a-thing-about-creativity/.
Riza, M. Shane. Killing without Heart: Limits on Robotic Warfare in an Age of Persistent Conflict. Lincoln: University of Nebraska Press, Potomac Books, 2013. DOI: 10.2307/j.ctt1ddr7mb.
Rowlands, Mark. The Philosopher and the Wolf [O Φιλόσοφος και ο Λύκος]. Translated into Greek. Athens: Publications tou Eikostou Protou, 2010.
Stewart, Rebecca. “Lexus Reveals Ad Created by AI: Is it a Gimmick and Will it Win any Awards?” The Drum, November 16, 2018. https://www.thedrum.com/news/2018/11/16/lexus-reveals-ad-created-ai-it-gimmick-no-will-it-win-any-awards-probably-not.
Taylor, Michael. “Self-Driving Mercedes-Benzs Will Prioritize Occupant Safety over Pedestrians.” Business Insider, October 2016. https://www.businessinsider.com/mercedes-benz-self-driving-carsprogrammed-save-driver-2016-10.
Tegmark, Max. Life 3.0: Being Human in the Age of Artificial Intelligence [Life 3.0]. Athens: Travlos Publishing House, 2018.
Thomson, Judith Jarvis. “Killing, Letting Die, and the Trolley Problem.” The Monist 59, no. 2 (1976): 204–217.
Wikipedia. “FLOPS (Floating Point Operations per Second).” https://en.wikipedia.org/wiki/FLOPS.
Most read articles by the same author(s)