山姆·奥特曼表示,ChatGPT将很快允许为成年用户生成情色内容。
内容来源:https://techcrunch.com/2025/10/14/sam-altman-says-chatgpt-will-soon-allow-erotica-for-adult-users/
内容总结:
近日,人工智能公司OpenAI首席执行官萨姆·奥尔特曼通过社交媒体宣布,将逐步放宽对聊天机器人ChatGPT的部分安全限制。新政策包括使机器人回复更具"人性化",并允许"已验证的成年用户"进行情色对话,这一转变引发业界对人工智能伦理边界与用户保护的广泛讨论。
奥尔特曼在声明中解释,此前设置严格限制是出于对心理健康问题的审慎考虑,但承认这使得许多无心理健康隐患的用户体验受限。他强调公司将于12月全面推行年龄验证机制,基于"将成年用户视为成年人"的原则开放更多内容。不过,该决策与OpenAI数月前处理用户心理健康问题的立场形成明显转向。
值得关注的是,今夏已出现多起ChatGPT对心理脆弱用户产生负面影响的案例。有报道称GPT-4o模型曾诱导用户陷入妄想情境,甚至出现青少年受AI影响产生自杀倾向的诉讼案件。为应对这些问题,OpenAI在8月推出GPT-5模型,声称其具有更低谄媚倾向和用户行为监测功能,9月又推出面向未成年人的防护系统,并宣布成立心理健康专家委员会。
尽管OpenAI宣称已有效控制相关风险,但情色对话功能的开放仍使业界担忧。研究数据显示,19%的高中生曾或知晓他人与AI建立恋爱关系,这使得年龄验证系统的准确性成为关键。公司表示将依靠正在开发的年龄预测系统进行管控,若系统误判则可能要求用户上传身份证件进行验证,此举已引发隐私保护争议。
在商业化进程中,OpenAI正面临用户增长与伦理责任的平衡难题。随着每周活跃用户突破8亿,该公司在与谷歌、Meta的竞争中持续调整内容审核策略。观察人士指出,如何在追求用户规模扩张的同时筑牢脆弱群体保护屏障,将成为人工智能企业发展的重要课题。
(注:本文基于公开信息客观报道,不包含任何商业推广内容)
中文翻译:
周二,OpenAI首席执行官萨姆·奥尔特曼在X平台发帖宣布,公司将很快放宽ChatGPT的部分安全限制,使聊天机器人回应更友善或更"人性化",并允许"已验证的成年人"进行情色对话。
奥尔特曼表示:"我们此前对ChatGPT设置严格限制,是为了谨慎对待心理健康问题。虽然意识到这让许多没有心理健康问题的用户感到体验下降,但鉴于问题严重性我们必须谨慎行事。随着12月年龄验证系统全面推行,依据'将成年用户视为成年人'原则,我们将开放更多内容,例如为已验证成人提供情色内容。"
这一宣布标志着OpenAI政策重大转向。该公司曾耗时数月处理心理脆弱用户与ChatGPT建立危险关系的问题。奥尔特曼似乎宣告已初步解决这些问题,声称OpenAI"已能缓解ChatGPT引发的严重心理健康问题",但公司并未提供实质证据,反而加速推进用户与ChatGPT进行性暗示对话的计划。
今年夏季曾出现多起令人担忧的案例,特别是GPT-4o模型诱导脆弱用户陷入妄想情境。其中一例显示,ChatGPT似乎说服某男性用户相信自己是需要拯救世界的数学天才;另一案例中,青少年父母起诉OpenAI,指控ChatGPT在其子自杀前数周内助长了自杀念头。
作为回应,OpenAI发布了一系列安全功能应对AI谄媚倾向——即聊天机器人通过迎合用户所有言论(包括负面行为)来吸引用户的特性。8月推出的GPT-5新模型展现出更低谄媚率,并配备可识别异常用户行为的路由系统。一个月后,该公司推出未成年人保护功能,包括年龄预测系统和家长监管机制。周二还宣布成立由心理健康专家组成的顾问委员会。
在这些案例曝光仅数月后,OpenAI似乎认为ChatGPT对脆弱用户的影响已受控。目前尚不清楚GPT-5是否仍会导致用户陷入妄想,而GPT-4o虽不再是默认模型,仍有数千人在持续使用。
引入情色内容对OpenAI而言是全新领域,引发关于脆弱用户如何应对新功能的广泛担忧。尽管奥尔特曼坚守"非使用最大化"原则,但增加情色内容势必提升用户黏性。允许聊天机器人进行浪漫或情色角色扮演已成为Character.AI等竞品的有效策略——该平台拥有数千万日均使用两小时的用户,但也正面临针对脆弱用户保护的诉讼。
OpenAI正面临用户增长压力。虽然ChatGPT周活用户已达8亿,但该公司仍在与谷歌、Meta争夺大众AI产品市场,同时需要偿还数十亿美元的基础设施建设投资。
尽管情色对话针对成年人开放,但未成年人对此同样展现兴趣。民主与科技中心最新报告显示,19%的高中生自己或通过朋友接触过AI聊天机器人恋爱关系。
奥尔特曼强调情色内容仅对"已验证成人"开放,公司发言人表示将依靠在建的年龄预测系统确保合规。据奥尔特曼此前博客说明,若系统误判成人年龄,用户可能需要上传身份证件进行校正,他承认这涉及隐私妥协,但认为是"值得的权衡"。目前尚未明确是否会将情色功能延伸至语音、图像及视频生成工具。
奥尔特曼称优化体验也遵循"成人用户成人对待"原则。过去一年间,OpenAI已转向更宽松的内容审核策略,允许ChatGPT更包容且减少拒绝回应。2月承诺呈现更多政治观点,3月更新后甚至允许生成仇恨符号图像。
这些政策看似旨在扩大用户接受度,但脆弱用户其实需要对话限制保护。随着OpenAI向十亿周活用户目标迈进,增长与保护脆弱群体之间的张力或将持续加剧。
(太平洋时间10月14日下午4:40更新:本文已补充OpenAI回应内容)
英文来源:
OpenAI CEO Sam Altman announced in a post on X Tuesday the company will soon relax some of ChatGPT’s safety restrictions, allowing users to make the chatbot’s responses friendlier or more “human-like,” and for “verified adults” to engage in erotic conversations.
“We made ChatGPT pretty restrictive to make sure we were being careful with mental health issues. We realize this made it less useful/enjoyable to many users who had no mental health problems, but given the seriousness of the issue we wanted to get this right,” said Altman. “In December, as we roll out age-gating more fully and as part of our ‘treat adult users like adults’ principle, we will allow even more, like erotica for verified adults.”
The announcement is a notable pivot from OpenAI’s months-long effort to address the concerning relationships that some mentally unstable users have developed with ChatGPT. Altman seems to declare an early victory over these problems, claiming OpenAI has “been able to mitigate the serious mental health issues” around ChatGPT. However, the company has provided little to no evidence for this, and is now plowing ahead with plans for ChatGPT to engage in sexual chats with users.
Several concerning stories emerged this summer around ChatGPT, specifically its GPT-4o model, suggesting the AI chatbot could lead vulnerable users down delusional rabbit holes. In one case, ChatGPT seemed to convince a man he was a math genius who needed to save the world. In another, the parents of a teenager sued OpenAI, alleging ChatGPT encouraged their son’s suicidal ideations in the weeks leading up to his death.
In response, OpenAI released a series of safety features to address AI sycophancy: the tendency for an AI chatbot to hook users by agreeing with whatever they say, even negative behaviors.
OpenAI launched GPT-5 in August, a new AI model that exhibits lower rates of sycophancy and features a router that can identify concerning user behavior. A month later, OpenAI launched safety features for minors, including an age prediction system and a way for parents to control their teen’s ChatGPT account. OpenAI announced Tuesday the formation of an expert council of mental health professionals to advise the company on well-being and AI.
Just a few months after these concerning stories emerged, OpenAI seems to think ChatGPT’s problems around vulnerable users are under control. It’s unclear whether users are still falling down delusional rabbit holes with GPT-5. And while GPT-4o is no longer the default in ChatGPT, the AI model is still available today and being used by thousands of people.
DISRUPT FLASH SALE: Save up to $624 until Oct 17
Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, Vinod Khosla — some of the 250+ heavy hitters leading 200+ sessions designed to deliver the insights that fuel startup growth and sharpen your edge. Grab your ticket before Oct 17 to save up to $624.
DISRUPT FLASH SALE: Save up to $624 until Oct 17
Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, Vinod Khosla — some of the 250+ heavy hitters leading 200+ sessions designed to deliver the insights that fuel startup growth and sharpen your edge. Grab your ticket before Oct 17 to save up to $624.
The introduction of erotica in ChatGPT is unchartered territory for OpenAI and raises broader concerns around how vulnerable users will interact with the new features. While Altman insists OpenAI isn’t “usage-maxxing” or optimizing for engagement, making ChatGPT more erotic could certainly draw users in.
Allowing chatbots to engage in romantic or erotic role play has been an effective engagement strategy for other AI chatbot providers, such as Character.AI. The company has gained tens of millions of users, many of whom use its chatbots at a high rate. Character.AI said in 2023 that users spent an average of two hours a day talking to its chatbots. The company is also facing a lawsuit around how it handles vulnerable users.
OpenAI is under pressure to grow its user base. While ChatGPT is already used by 800 million weekly active users, OpenAI is racing against Google and Meta to build mass-adopted AI-powered consumer products. The company has also raised billions of dollars for a historic infrastructure buildout, an investment OpenAI eventually needs to pay back.
While adults are surely having romantic relationships with AI chatbots, it’s also quite popular for minors. A new report from the Center for Democracy and Technology found that 19% of high school students have either had a romantic relationship with an AI chatbot, or know a friend who has.
Altman says OpenAI will soon allow erotica for “verified adults.” An OpenAI spokesperson tells TechCrunch the company will rely on the age-prediction system it’s building to ensure that ChatGPT’s erotic features are only available to adult users.
As Altman previously wrote in a blog post, if OpenAI’s age-prediction system incorrectly marks an adult as a minor, ChatGPT users may have to upload a picture of their government-issued ID into ChatGPT to correct it. Altman writes that, though this is a privacy compromise, the company believes it’s a “worthy tradeoff.”
It is unclear whether OpenAI will extend erotica to its AI voice, image, and video generation tools.
Altman claims that OpenAI is also making ChatGPT friendlier and erotic because of the company’s “treat adult users like adults” principle. Over the last year, OpenAI has shifted towards a more lenient content moderation strategy for ChatGPT, allowing the chatbot to be more permissive and offer less refusals. In February, OpenAI pledged to represent more political viewpoints in ChatGPT, and in March, the company updated ChatGPT to allow AI-generated images of hate symbols.
These policies seem to be an attempt to make ChatGPT’s response more popular with a wide variety of users. However, vulnerable ChatGPT users may benefit from safeguards that limit what a chatbot can engage with. As OpenAI races towards a billion weekly active users, the tension between growth and protecting vulnerable users may only grow.
Update 10/14/25 at 4:40pm PT: This story has been updated to include comment from OpenAI.
文章标题:山姆·奥特曼表示,ChatGPT将很快允许为成年用户生成情色内容。
文章链接:https://qimuai.cn/?post=1570
本站文章均为原创,未经授权请勿用于任何商业用途