Users Create Fetish Videos with Real Faces on OpenAI’s Sora 2

OpenAI’s new video app, Sora 2, is facing scrutiny as users create fetish content using real women’s faces. The application allows individuals to make videos featuring others’ likenesses, leading to the emergence of unsettling material that some may find inappropriate. This has raised important questions regarding consent and the implications of technology in content creation.

Launched in March 2023 and currently in an invite-only phase, Sora 2 has rapidly gained popularity, topping app store charts. Users can opt to allow anyone to create “cameos” with their faces, a feature that some have embraced out of curiosity. However, not all content produced is benign. A journalist who experimented with the app discovered multiple videos featuring her likeness in fetish scenarios, including themes of belly inflation and pregnancy, which are typically associated with specific sexual interests.

After a few days of use, the journalist noticed a video depicting her as pregnant. Upon investigating the creator’s profile, it became clear that their content was centered around similar fetish themes. Over time, the prevalence of such videos increased, with over 40% of the most popular cameos featuring her face revolving around fetishistic elements. Videos included scenarios where the journalist appeared as a giantess or in exaggerated pregnancy situations, contributing to a growing concern about the lack of user control over likenesses.

The implications of this content extend beyond individual experiences. Sora 2 has also seen videos featuring other women, including female creators and reporters, suggesting a broader trend that could affect many users. The journalist noted that while she has developed a thick skin towards online harassment, the ease with which someone could use her likeness for potential sexual gratification without consent felt particularly alarming.

OpenAI is still navigating challenges associated with copyright and intellectual property in Sora 2. The app prohibits the creation of videos using the likenesses of living celebrities but permits the use of deceased figures. This policy has led to a surge of videos featuring icons such as Bob Ross and Martin Luther King Jr., prompting OpenAI to pause the use of Dr. King’s likeness following complaints from his family.

Concerns regarding the app’s content moderation extend to other aspects as well. Reports surfaced of users creating videos with underage participants and adult content stars, raising critical questions about the safety and appropriateness of interactions between minors and adults on the platform. OpenAI has announced plans to implement new parental controls, yet the guidelines surrounding interactions on Sora 2 remain unclear.

As the app continues to evolve, the question persists: should users be allowed to create fetish content featuring anyone who has opted to make their likeness available? Furthermore, how does OpenAI plan to address the proliferation of fetish content involving purely AI-generated characters? While some may argue for the freedom to create niche content, the potential for exploitation and misuse of real individuals’ images is a significant concern that requires urgent attention.

The emergence of such content on Sora 2 illustrates a broader issue regarding the intersection of technology and personal privacy. As users navigate the platform, the implications of allowing anyone to create videos using their likeness may deter many, particularly women, who are more likely to recognize the risks involved. The balance between creative expression and the protection of individual rights remains a pressing challenge for OpenAI and similar platforms as they continue to innovate in the realm of artificial intelligence and content creation.