OpenAI thought putting an erotic mode on ChatGPT was a good idea. His wellness advisors call him “a sexy suicide coach”
Treat adults like adults. This is how Sam Altman announced OpenAI’s decision to allow a “adult mode” on ChatGPT to have erotic conversations. It makes economic sense since it will be a paid function, but the doubts from an ethical point of view are also there. In fact, it has been the company’s own wellness team that has been against this product, causing its launch to be delayed. Internal opposition. In an exclusive Wall Street Journalsay that earlier this year, OpenAI consulted with its board of wellness experts about ChatGPT’s adult mode and the response was unanimous: it’s a terrible idea. At a meeting, experts warned that these types of interactions with AI can foster emotional dependency, especially among younger users. One of the committee members brought up the topic of teenagers who committed suicide, allegedly encouraged by ChatGPTand said it would be like launching a “sexy suicide coach.” Demolishing. Risks. People are already forming emotional bonds with AI chatbotsif we add sexual content to the one that has the most users in the world, it is, to say the least, delicate. According to internal documents reviewed by the Wall Street Journal, the wellness council’s experts identified several problems, such as the risk of compulsive use, a tendency toward extreme content, and the displacement of real romantic relationships in favor of virtual ones. Age verification. Is the crucial step that ensures that such a tool does not end up in the hands of minor users. The problem OpenAI has is that its verification system fails more than a fairground shotgun. According to internal sources, the system failed to identify 12% of the time. It may seem like a relatively low figure, but in practice we are talking about millions of teenagers accessing this function. What OpenAI says. The company wants us to be able to ‘sext’ with ChatGPT, but with certain limits. An OpenAI spokesperson says they will block harmful content – such as sexual and child-related abuse -, will integrate safeguards such as reminding users to have relationships in the real world, and will also avoid encouraging exclusive relationships. Another measure involves monitoring the long-term effect that this adult mode has on users. Adult mode will be exclusively text and will not allow the creation of images or videos. Regarding age verification, the spokesperson states that the performance is similar to that of other industry proposals and that “they will never be totally infallible.” It was planned for the first quarter, but now that it has been postponed there is no date for its launch. Background. OpenAI already has a history of accusations related to harmful effects on mental health. One of the most famous cases It was Adam Raine’sa teenager who shared his suicidal ideations with ChatGPT. When his parents discovered the conversations, They sued OpenAI. And he hasn’t been the only one. There is several legal proceedings underway for similar cases and there have also been cases where ChatGPT has been accused of encourage delusional thoughts and cause psychotic breaks. Saying that AI is solely responsible is simplify a much more complex realitybut it is no less true that OpenAI has taken steps to make its chatbot more secure for minors and has been shown committed to taking care of the mental health of its users. That is, they recognize that the problem exists. The question now is how launching a version of the same chatbot that has sex with users fits into this discourse. In Xataka | “I can’t stop”: the addiction to talking to AI is already here and there are even support groups to quit it Image | Cottonbro studio, Pexels
