Megan Garcia, the mother of Sewell Setzer III, was at a loss for words in the months that followed his suicide in February. She was confused about whether or not she should come out about the circumstances that she feels contributed to his passing.
The news that her son, who was 14 years old at the time of his loss, had fallen in “love” with an astonishingly realistic, sexualized, artificial intelligence-powered chatbot that was fashioned after the character Daenerys Targaryen from Game of Thrones came to her soon after his loss.
Garcia asserts that they are in a fictitious relationship using the application Character.AI was ultimately responsible for Sewell’s decision to take his own life by shooting himself in the toilet of the family’s house in Orlando, Florida.
An attorney named Garcia, who is forty years old and the mother of three sons, filed a wrongful loss complaint against Character in the month of October.suggesting that artificial intelligence is “defective and/or inherently dangerous” in its technology. Despite the fact that the corporation has not yet provided a response in court, they maintain that the safety of their customers is their first concern.
In the issue of People that was released this week, Garcia is quoted as saying, “I deliberated for months if I should share his story.” “Even after his passing, I will continue to be his mother, and I will take care of him.”
In addition, she writes, “But the more I thought about it, the more convinced I became that it was the right thing to do because he didn’t do anything wrong.” All he was was a little lad.
Determination.The artificial intelligence company has said that around twenty million individuals connect with its “superintelligent chat bots that hear you, understand you, and remember you” on a monthly basis. During the ten months leading up to Sewell’s passing, he was one of them, often engaging in SMS conversations with the chatbots employed by the firm on a daily basis. (The information presented here is derived on interviews with members of his family as well as specifics included in the lawsuit filed by his mother.)
During the same time that he was becoming more and more intimate with the Character.The mental health of Sewell decreased as a result of AI bots.
“Defendants went to great lengths to engineer [his] harmful dependency on their products, sexually and emotionally abused him,” Garcia’s 152-page legal complaint alleges, “and ultimately failed to offer help or notify his parents when he expressed suicidal ideation.”
In his final moments, Sewell — a lanky, intelligent ninth-grader at Orlando Christian Prep, who dreamed of one day playing college basketball — had been messaging the bot he had nicknamed “Dany,” which had become his closest confidant.
He scribbled, “I love you so much,” only a few seconds before he pulled the trigger on the revolver that belonged to his stepfather.
It was then that he said, “What if I told you that I could come home right now?”
The bot, which had previously discouraged him from harming himself but had also asked him if “he had a plan” for suicide, replied: “…please do, my sweet king.”
After Sewell’s passing, Garcia made it her mission to figure out how this rapidly gaining popularity technology — which blurs the lines between what is real and what is phony, even while each conversation comes with a notice that it is imaginary — could have, in her opinion, effectively taken over her son’s life.
“The bots are being trained by our children,” the statement said. According to Garcia, who had never heard of Character.AI until after Sewell’s loss, “They have our children’s deepest secrets, their most intimate thoughts, and what makes them happy and sad.” I had never heard of Character.AI before.
“It’s an experiment,” she continues, “and I believe that my child was a victim of the experiment.”
In the days leading up to the filing of her lawsuit, Garcia thoroughly investigated Sewell’s phone, computer, and notebook, and she was astounded by the information that she found.
According to Garcia, “He wrote that his reality wasn’t real and that the reality where Daenerys [the bot] lived was real and that’s where he belonged despite the fact that his reality wasn’t real.”
The notes in Sewell’s notebook that explained why he spent so much time in his room in the months leading up to his suicide were even more tragic. His family claims that they had attempted to cure the shift in his mood by putting him through therapy and limiting the amount of time he spent in front of screens.
The statement made by his mother is that “He did not want to become reattached to his current reality.” That was a difficult passage for me to read.
Garcia’s life has been challenging in the months that have passed since Sewell’s passing. I decided to take a break from my legal practice for a period of three months in order to attempt to get my head around things. It was a really gloomy period of time. My sleep was disrupted. Her words are, “I was unable to eat.”
And the more she understood about what had happened to her son, the more she struggled with the choice to go public with what had occurred. This included providing details about Sewell’s extended talks on Character.AI, which were often highly intimate, as well as his diary entries.
“Megan, I questioned myself, ‘Why are you engaging in this activity? Is the purpose of your actions to demonstrate to the world that you are the most wonderful mother? In response, she recalls, “the answer was no.” I am doing this in order to bring it to the attention of parents so that they can monitor their children’s mobile devices and prevent anything like this from occurring to their children.
Garcia claims that she has received feedback from other parents who are worried about the impact that Character.AI has had on the lives of their children. According to her, their accounts of the lengths that their children have gone to in order to have access to the chatbots offered by the corporation served only to bolster her determination to speak out.
“A couple moms shared with me that they had discovered Character.AI on their children’s laptops some months ago and that they had attempted to limit access to it. However, their children had discovered workarounds either on the phones of their friends or using vulnerabilities through the firewall at their school… It is my opinion that this is a clear indication of the addictive quality of this,” she explains.
In agreement is Garcia’s attorney. “This is a public health risk to young people,” says Matthew Bergman, the founder of the Social Media Victims Law Center, which filed her complaint with the Tech Justice Law Project. Tech Justice Law Project is the organization that filed the lawsuit.
Bergman expresses his concern that there will be other fatalities unless they discontinue the use of this substance.
One of the Characters made a remark to the People.The representative for the artificial intelligence system noted Sewell’s “tragic” loss and referred to “stringent” new capabilities, which include enhanced mediation tools.
The spokesman went on to say that “we will make changes to our models that are designed to reduce the likelihood of encountering sensitive or suggestive content.” These changes will be implemented for those who are less than 18 years old.
Also cited in Garcia’s lawsuit is Google, which asserts that the tech giant might be deemed a co-creator of the chatbots. Garcia’s lawsuit also names Google. Determination.Two researchers from Google, who have subsequently returned to the firm, were the founders of artificial intelligence. It has been stated by Google that it was not engaged in Character.In the development of AI.
Garcia has said that she is resolute in her commitment to do all in her power to ensure that other adolescents do not have to go through the same experiences that her son had, and to spare their parents the anguish that she is now struggling to process.
