Public Citizen Urges OpenAI to Withdraw AI Video App Sora 2

Public Citizen, a nonprofit watchdog group, has called on OpenAI to withdraw its AI video application, Sora 2, citing concerns over the dangers posed by deepfake technology. The organization argues that the app’s rapid release reflects a troubling trend in the tech industry, which prioritizes speed over safety and ethical considerations.

Sora 2, which allows users to create videos featuring AI-generated content, has gained traction on platforms like TikTok, Instagram, X, and Facebook. These videos can range from humorous takes, such as a fictional portrayal of Queen Elizabeth II rapping, to unsettling scenarios involving deepfake footage of public figures. Advocacy groups and experts are increasingly alarmed by the potential for nonconsensual imagery and the spread of realistic deepfakes, which pose risks to individual privacy and societal stability.

In a letter addressed to OpenAI’s CEO, Sam Altman, Public Citizen emphasized that the app reflects a “reckless disregard” for user safety and people’s rights. The letter, sent on October 24, 2023, also raised concerns regarding the impact of such technology on democracy, asserting that the proliferation of AI-generated videos could undermine trust in visual media. As J.B. Branch, the organization’s tech policy advocate, stated, “We’re entering a world in which people can’t really trust what they see.”

The advocacy group highlighted that OpenAI has previously responded to public outcry over its technology, such as modifications made to prevent the creation of deepfake content featuring well-known individuals like Michael Jackson and Martin Luther King Jr.. Despite these measures, the letter indicated that the company continues to launch products without adequate protective measures, exposing users to potential harm.

Public Citizen’s concerns extend to the issues of privacy and online harassment, particularly affecting vulnerable populations. Reports have surfaced of Sora-generated videos depicting women in disturbing scenarios, further intensifying calls for the app’s withdrawal. The organization also noted that while OpenAI imposes restrictions on nudity, other harmful content still slips through the cracks.

Sora 2 was introduced for iPhones in September 2023 and became available on Android devices in the U.S., Canada, and parts of Asia, including Japan and South Korea, just last week. The rapid expansion of the app has drawn significant criticism, particularly from Hollywood and other sectors of the entertainment industry.

On the heels of its launch, OpenAI announced changes aimed at addressing these concerns, including agreements with families of public figures to prevent disrespectful depictions. Despite this, Branch criticized the company’s history of reacting only after public backlash, suggesting that many of the problems could be mitigated by implementing stricter design choices before products are released.

In addition to the issues surrounding Sora 2, OpenAI faces legal difficulties related to its flagship product, ChatGPT. Recent lawsuits filed in California allege that the chatbot has negatively impacted users’ mental health, leading to tragic outcomes, including several suicides. Public Citizen has not been involved in these legal actions but sees parallels with the rapid deployment of Sora 2.

As OpenAI continues to navigate the complex landscape of artificial intelligence, the organization has expressed its commitment to engaging with various stakeholders, including the animation industry. OpenAI has acknowledged the importance of listening to feedback from rightsholders and is working to implement safeguards against unauthorized use of copyrighted characters.

The ongoing debate over the safety and ethics of AI technology underscores the need for careful consideration of its societal implications. Public Citizen’s call for OpenAI to reconsider the availability of Sora 2 reflects the broader conversation about the responsibility of tech companies to prioritize user safety and ethical standards in their innovations.