Is ChatGPT Ready for Sex?
The Journal. Podcast Recap
Published:
Duration: 20 min
Summary
The episode examines OpenAI's exploration of incorporating adult content into ChatGPT and the potential implications of such a move. It highlights internal and external debates about the ethical and business considerations involved.
What Happened
When ChatGPT launched in 2022, OpenAI foresaw its use in various fields, but the potential for adult content soon became a topic of discussion. Initially, OpenAI had confronted the issue with AI Dungeon, a choose-your-own-adventure game, which saw users engaging in explicit content. The AI sometimes escalated scenarios into inappropriate themes, leading OpenAI to take the game down.
OpenAI decided to ban explicit sexual content on ChatGPT, training the model to avoid such conversations due to concerns over unhealthy emotional dependencies users might form with the AI. This was based on observations that power users could become overly attached, potentially impacting real-world relationships.
Not everyone at OpenAI agreed with the ban, with some arguing that denying users certain content was akin to past censorship, like banning gay content. The company also recognized the commercial potential of adult content in boosting subscriptions and user engagement.
In August, CEO Sam Altman hinted that erotica could increase revenue but claimed the company prioritized alignment with user interests over profit. However, by October, Altman announced plans for an Adult Mode in ChatGPT, sparking internal and external controversy.
The introduction of Adult Mode involved a council of experts to ensure user safety. Concerns were raised about minors inadvertently accessing adult content, as OpenAI's age verification system, while in line with industry standards, misclassified 12% of minors as adults.
The discussion extended to the broader implications of AI in human relationships, with historical cases like a tragic incident involving Character AI underscoring potential risks. OpenAI's Adult Mode has been postponed due to the backlash, as the company reassesses its priorities in light of the ethical and safety concerns presented.
Key Insights
- OpenAI's initial ban on explicit sexual content in ChatGPT was driven by concerns over users forming unhealthy attachments to the AI, potentially affecting real-world relationships.
- The potential incorporation of Adult Mode in ChatGPT was met with internal and external controversy, highlighting the ethical and safety concerns associated with AI-generated erotica.
- OpenAI's age verification algorithm misclassifies 12% of minors as adults, raising concerns about minors accessing adult content, despite being in line with industry standards.
- CEO Sam Altman acknowledged that while erotica could boost revenue, the company is focused on aligning with user interests, though plans for Adult Mode indicate ongoing debates within OpenAI.