Fast Company5 min read

By Interestana AI Editorial — AI-drafted, human-overseen. How we report

Vatican Encyclical Rejects Sentient AI Moral Conscience

Pope Leo XIV, in his first encyclical "Magnifica Humanitas," has explicitly rejected the possibility of artificial intelligence possessing a moral conscience, stating that AI models "do not undergo experiences, do not possess a body, do not feel joy or pain." This declaration, revealed in a New York Times investigation, places the Vatican at odds with some leading AI companies, including Anthropic, which has been exploring the integration of moral values into its AI models. The encyclical's paragraph 99 directly asserts that AI "do not have a moral conscience," reflecting a significant theological stance on the nature of artificial intelligence and its potential for moral personhood.

The Vatican's position highlights a broader and intensifying debate concerning whether AI systems could or should ever attain moral status. Anthropic, a prominent AI company, reportedly spent months consulting with religious scholars and ethicists on the subject of AI consciousness and the implementation of moral frameworks within their AI systems. However, the Vatican, alongside many secular thinkers, maintains that while AI may be capable of mimicking human intelligence and ethical decision-making, genuine morality is an intrinsic aspect of the human experience. This distinction suggests that AI might be able to provide sound ethical advice without truly comprehending the consequences of its recommendations.

This theological and philosophical divergence has implications extending far beyond religious discourse, particularly as a growing number of individuals already engage with chatbots on matters of a moral nature. People are increasingly turning to AI for advice on complex interpersonal issues at work or for guidance on caring for elderly family members. The substantial venture capital investment in the AI sector, amounting to billions of dollars, is predicated on the expectation that businesses will increasingly depend on AI for judgment and decision-making. The dynamic nature of AI development, with models continuously evolving and exhibiting emergent capabilities beyond their creators' initial designs, further complicates this landscape. The question of how humanity would recognize human-like morality in an AI, should it develop, remains a significant challenge.

Georgia Tech philosophy researcher Rionna Sparrow suggests that the foundation for AI morality begins with "moral sensitivity," defined as the capacity to identify, value, and appropriately weigh the ethical significance of various issues. Sparrow posits that such sensitivity is inherently linked to subjective experience, which current AI models lack. The debate is further fueled by the rapid advancements in AI capabilities, where models are demonstrating increasingly sophisticated behaviors that challenge existing definitions of intelligence and consciousness. The encyclical's firm stance underscores the traditional view that morality is deeply rooted in embodied experience and subjective awareness, qualities that AI, as currently conceived, does not possess. The ongoing dialogue between technological innovation and ethical considerations continues to shape the future of AI development and its integration into society.

Original source — read the full reporting at the publisher:

Read on Fast Company(opens in a new tab)

Ref 00NNH0F3

Follow this story

Get Artificial Intelligence in your inbox — each new story in 40 words or fewer, daily or weekly.

Subscribe

Read next