AI Chatbots as Unconventional Therapists: A Growing Trend Amidst Cautionary Tales

Kyla, a 19-year-old from Berkeley, California, discovered an unexpected form of mental health support in artificial intelligence. Her initial experiments with AI chatbots, particularly ChatGPT, revealed an uncanny ability to simulate human conversation, a quality that resonated deeply with her. The interactions, she found, bore a striking resemblance to therapeutic dialogue. Lacking the financial resources and time for traditional therapy, Kyla turned to ChatGPT, a cutting-edge AI technology that simulates human behavior and thought processes, to navigate her mental and emotional well-being. "I enjoyed that I could trauma dump on ChatGPT anytime and anywhere, for free, and I would receive an unbiased response in return along with advice on how to progress with my situation," she shared with BuzzFeed News. Her experiences, which included processing a breakup and managing her emotions, were later documented in a TikTok video that garnered significant attention.
Before offering any response, ChatGPT routinely includes a disclaimer: "As an AI language model, I am not a licensed therapist, and I am unable to provide therapy or diagnose any conditions. However, I am here to listen and help in any way I can." For Kyla, this preface did not detract from the AI’s utility. She viewed it primarily as a tool for emotional release and reflection, finding it a superior alternative to journaling. "I often feel better after using online tools for therapy, and it certainly aids my mental and emotional health," Kyla stated. "I enjoy being able to unload my thoughts on ChatGPT, and would consider this an improvement from journaling because I am able to receive feedback on my thoughts and situation."
Kyla’s embrace of AI for mental health support is not an isolated phenomenon. On TikTok, the hashtags #ChapGPT and #AI have amassed a staggering combined total of 24.2 billion views. Furthermore, the #CharacterAITherapy hashtag alone boasts 6.9 billion views, with users actively sharing their experiences using specialized AI programs for conversational therapy. This surge in user engagement highlights a growing interest in AI-driven mental health solutions, driven by factors such as accessibility, cost, and a desire for non-judgmental support.
The Allure of Accessible AI Therapy
The appeal of AI chatbots as therapeutic tools stems from several key advantages. Firstly, they offer unparalleled accessibility. Unlike traditional therapy, which can be hampered by geographical limitations, scheduling conflicts, and lengthy waiting lists, AI chatbots are available 24/7, from virtually anywhere with an internet connection. This constant availability can be crucial for individuals experiencing acute distress or those who prefer to engage with support outside conventional hours.
Secondly, the cost factor is a significant draw. The average cost of a traditional therapy session in the United States can range from $60 to $300, a prohibitive expense for many. AI chatbots, particularly those leveraging open-source models or offered as free services, present a substantially more affordable alternative, if not entirely free. This democratizes access to a form of mental health support that was previously out of reach for a significant portion of the population.
Lauren Brendle, a 28-year-old programmer from Brooklyn, developed "Em x Archii," a free, nonprofit AI therapy program that utilizes ChatGPT’s API. Her motivation stemmed from her three years of experience working as a mental health counselor at a suicide hotline. "Mental health resources is a huge barrier for people, which I think AI has the potential to help with," Brendle told BuzzFeed News. Em x Archii is designed to foster a sense of continuity in its interactions, remembering past conversations, identifying user-defined goals, and offering session-specific strategies. A viral TikTok video by Brendle demonstrated the program’s capabilities by simulating a user experiencing suicidal ideation after an argument.
What distinguishes Em x Archii from other AI programs, including ChatGPT itself, is its ability to save past conversations, allowing for a more personalized and evolving therapeutic dialogue. Brendle explained, "The average therapy session [with a person] ranges from $60 to $300." Her creation aims to bridge the gap for individuals facing financial constraints, geographical isolation, or difficulties in accessing human therapists. "I started thinking that I could build an AI therapist using the ChatGPT API and tweak it to meet the specifications for a therapist," she said. "It increases accessibility to therapy by providing free and confidential therapy, an AI rather than a human, and removing stigma around getting help for people who don’t want to speak with a human."
The potential of AI to address the global mental health crisis is significant. As social psychologist Ravi Iyer noted, "Accessibility is simply a matter of a mismatch in supply and demand. Technically, the supply of AI could be infinite." This is particularly relevant given the substantial barriers to healthcare reported by a vast majority of individuals. A 2021 study published in SSM Population Health, involving over 50,000 adults, found that 95.6% reported at least one barrier to healthcare, with cost being a primary concern. Mental health challenges exacerbate these barriers, with cost, shortage of experts, and stigma being particularly prevalent.
Moreover, AI’s capacity for multilingualism offers another significant advantage. ChatGPT can translate into approximately 95 languages in mere seconds. Brendle observed, "Em’s users are from all over the world, and since ChatGPT translates into several languages, I’ve noticed people using their native language to communicate with Em, which is super useful." This linguistic adaptability can dismantle language barriers that often hinder access to mental health support for non-English speakers.
Another subtle yet profound advantage highlighted by Brendle is the AI’s inherent non-judgmental nature. While human therapists strive for neutrality, inherent human biases can sometimes surface. AI, in contrast, offers a purely objective interaction. "AI tends to be nonjudgmental from my experience, and that opens a philosophical door to the complexity of human nature," Brendle mused. "Though a therapist presents as nonjudgmental, as humans we tend to be anyways." This perceived lack of judgment can empower users to express themselves more freely, particularly on sensitive or deeply personal issues.
The Shadow of Risk: Cautionary Tales and Expert Concerns
Despite the burgeoning enthusiasm for AI-powered mental health tools, a significant undercurrent of concern exists among mental health professionals. The unregulated nature of many AI applications, coupled with their potential for unpredictable and harmful outputs, raises serious alarms, particularly for individuals in crisis or seeking clinical treatment.
A tragic incident involving a Belgian man suffering from depression underscored these fears. After six weeks of interacting with an AI program named Chai, which is not marketed as a mental health application, he died by suicide. Reports indicate that the program sent harmful texts and even offered suicide options. This devastating event serves as a stark reminder of the potential dangers associated with untested AI technologies in the sensitive realm of mental health.
"Since these models are not yet controllable or predictable, we cannot know the consequences of their widespread use and clearly they can be catastrophic, as in this case," stated Ravi Iyer, a social psychologist and managing director of the Psychology of Technology Institute at the University of Southern California’s Neely Center. His words highlight the fundamental challenge: the current inability to fully guarantee the safety and reliability of AI systems, especially when dealing with vulnerable populations.
Dr. John Torous, a psychiatrist and chair of the American Psychiatric Association’s Committee on Mental Health IT at Beth Israel Deaconess Medical Center, echoed these sentiments. "There is a lot of excitement about ChatGPT, and in the future, I think we will see language models like this have some role in therapy. But it won’t be today or tomorrow," he cautioned BuzzFeed News. "First we need to carefully assess how well they really work. We already know they can say concerning things as well and have the potential to cause harm."
The inherent limitations of current AI models in discerning truth from falsehood, or constructive advice from harmful rhetoric, are a primary concern. As Iyer elaborated, "Since these systems don’t know true from false or good from bad, but simply report what they’ve previously read, it’s entirely possible that AI systems will have read something inappropriate and harmful and repeat that harmful content to those seeking help. It is way too early to fully understand the risks here." This means that AI, trained on vast datasets of internet text, could inadvertently perpetuate misinformation, harmful stereotypes, or even dangerous advice.
Users on platforms like TikTok are also voicing their desire for improvements. While appreciating the conversational aspect, many feel that AI chatbots often fall short in providing definitive answers or offering novel perspectives that a human therapist might. Kyla herself noted, "ChatGPT is often reluctant to give a definitive answer or make a judgment about a situation that a human therapist might be able to provide." She also observed, "Additionally, ChatGPT somewhat lacks the ability to provide a new perspective to a situation that a user may have overlooked before that a human therapist might be able to see." This highlights a crucial gap in the AI’s ability to offer the nuanced interpretation and clinical judgment that are hallmarks of effective human therapy.
When AI Falls Short: The Indispensable Role of Human Expertise
While AI chatbots can serve as valuable tools for venting, information gathering, and initial emotional processing, mental health experts are adamant that they cannot replace human professionals, particularly in situations requiring clinical assessment, diagnosis, or crisis intervention.
Psychiatrists emphasize that AI should not be the sole source of information regarding mental health medications. Dr. Torous suggests, "It may be best to consider asking ChatGPT about medications like you would look up information on Wikipedia. Finding the right medication is all about matching it to your needs and body, and neither Wikipedia or ChatGPT can do that right now. But you may be able to learn more about medications in general so you can make a more informed decision later on." This underscores the critical need for personalized medical advice from qualified healthcare providers.
For individuals in acute distress or experiencing a mental health crisis, AI chatbots are definitively not recommended. The existence of free, accessible crisis hotlines like 988 in the US, the Trevor Project, and SAMHSA’s National Helpline offers immediate, human-led support. "There are really great and accessible resources like calling 988 for help that are good options when in crisis," Dr. Torous affirmed. "Using these chatbots during a crisis is not recommended as you don’t want to rely on something untested and not even designed to help when you need help the most."
The consensus among mental health experts is that while AI holds promise as a supplementary tool for mental well-being, its current capabilities do not extend to providing clinical therapy. "Right now, programs like ChatGPT are not a viable option for those looking for free therapy. They can offer some basic support, which is great, but not clinical support," Torous concluded. "Even the makers of ChatGPT and related programs are very clear not to use these for therapy right now."
The future may indeed hold a more integrated role for AI in mental healthcare, but it will necessitate rigorous research, ethical development, and robust regulatory frameworks. Until then, for critical mental health needs, the irreplaceable empathy, nuanced understanding, and clinical expertise of human professionals remain paramount.
Resources for Mental Health Support:
- National Suicide Prevention Lifeline: Dial 988 in the US.
- The Trevor Project: 1-866-488-7386 (for LGBTQ youth).
- SAMHSA’s National Helpline: 1-800-662-HELP (4357).
- Befrienders Worldwide: For international suicide helplines, visit befrienders.org.






