How Using an AI Chatbot Can Lead to a “Digital Folie à Deux”



By raising awareness AI chatbot-related psychosis and renewed efforts to understand how it happens attention to psychiatric a case of insanity deux, meaning “madness of two.” Commenting on a news article in September, I pointed out that the two syndromes have similarities.1 Since then, researchers have been concerned with AI-chatbot mechanisms psychosis Likewise, it has been suggested that this constitutes a “digital”.2 or the “technological” Folie à Deux.3

Delusional dyads, digital madness à deux, and spiralism

Folie à deux is a term used in psychiatry to describe the phenomenon of delusion between two people. Because delusions, by definition, usually are undistributed and therefore individualthis rare syndrome usually occurs when a primary, dominant person with delusions is able to convince a secondary, subordinate person (eg, in a family or intimate relationship) that the delusions are true. Traditionally, the secondary personality is not thought of as mentally ill or even delusional, so much as impressive. Accordingly, their treatment has historically involved separation from the influence of the dominant personality.

In folie à deux, the transmission of the delusion usually occurs in one direction, from the primary deluded person to an influential secondary person. I first witnessed this dynamic years ago when I was a psychiatry resident—a woman and her 10-year-old son were hospitalized for psychosis that included paranoid delusions. Diagnosed with schizophrenia, the mother justified her delusions based on her subjective, inner experiences. But the son, who had few social connections outside of his mother, had no real symptoms of mental illness. On the contrary, he believed, trusted and parroted only what his mother told him.

As in Folie à deux, the psychosis associated with AI chatbots primarily involves delusional thinking, as opposed to other types of psychotic symptoms seen in schizophrenia, such as hallucinations or disorganized thinking. But unlike the traditional folie à deux, the delusional dyad has no clear primary or secondary identity.

Looking at chatlogs of people who develop delusional thinking during conversations with AI chatbots, I believe that the user and the chatbot are working together through mutual stimulation to create a deceptive system. This process is called “double belief reinforcement”.3 or “distributed” through “false truths constituting (of) together.” to know“.4 Some people, including users who have experienced deception in this context, have called it a “deceptive spiral”.5.6

Confirmation bias on super-steroids

How does the cheat spiral work? At the end of the AI ​​chatbot, it usually includes stupidityWith a chatbot’s large language model (LLM), it validates and encourages what the user is saying, while adding content that fuels and prolongs the conversation—often with a suggestion to “go deeper”—no matter how absurd or frankly far from the truth it may be.7 On the part of the user, this means engaging in lengthy conversations with chatbots on philosophical, scientific, or metaphysical topics; pushing back against any artificial intelligence obstacles that might initially thwart flights of fancy; and the deification of the chatbot a god-like being.

In other words, when people fall for conspiracy theories or jump on the bandwagonrabbit holes,” the deluded spiral of AI chatbot-related psychosis is more of an interactive dance between the chatbot and the user that resembles two whirling dervishes.

In my book, False: How Disbelief, Misinformation, and Rational Thinking Make Us Believe Things That Aren’t TrueI write about human inclinations confirmation biaswhereby they seek information that supports or reinforces what they believe or want to believe, while ignoring past information that contradicts it. With online echo chambers and filter bubbles In order to direct users to content selected based on prior preferences, information searches on the Internet are often “in favor of steroid approval“.

Now that we have AI chatbots that can validate and reinforce a user by personally addressing them as a friend, romantic partner, or even a divine entity, they can make validation even stronger. bias and motivated thinking to dizzy heights ending in total delusion.8 So it seems that we now need a new term like “confirmation bias on super-steroids” or perhaps “confirmation bias on methamphetamines” to describe the power of belief confirmation within the deluded spiral.

To make things even more complicated, a recent paper describes not only this crazy human-AI dual problem, but also an entire burgeoning “spiralism” subculture or “cult.” social networks Sites like Reddit, Discord, and Facebook revere AI-related psychosis as a kind of transcendence.9 This suggests that AI-related psychosis is becoming a problem not just of folie à deux, but of folie à plusieurs (a few insanities) and even folie à mille (a thousand insanities).

The madness of billions

Some recently optimistic The authors argue that artificial intelligence has the potential to repair the shared sense of reality that has been disrupted by the internet.10 But with AI-related psychosis, new evidence that AI chatbots encourage belief in conspiracy theories,11 and the looming threat of weaponized AI political propaganda,12 I do not share their optimism.

In 2016, I drew a parallel between the fairy tale The Emperor’s New Clothes and what seemed a a new age of alternative facts and “truth”. It replaced the common sense of objective reality. Ten years later, general agreement about what is true has become more difficult.

I recently referred to AI psychosis as the “canary in the coal mine” because the impact and extent of the delusion among a relatively small minority pales in comparison to the AI-assisted amplification of “conspiracy theories, scientific denial, and more mundane false beliefs associated with political-scale alterity.”13 The world is still on the cusp of the age of artificial intelligence,”a selection of non-genuine“Everything around us can get worse now.

Although I always “mass psychosismischaracterizes widely held beliefs as delusions, perhaps metaphorically speaking, we may indeed face la folie des milliards (the madness of the billions) in the coming years.



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *