Meta’s Oversight Board is taking a closer look at how the company handles deepfake pornography, particularly in light of concerns that artificial intelligence is fueling the creation of fake, explicit imagery as a form of online harassment. The Board will be reviewing Meta’s response to two explicit, AI-generated images of female public figures to determine if the company has appropriate policies and practices in place to address such content and if those policies are enforced consistently worldwide.
In recent months, the issue of AI-generated pornography has gained attention as celebrities like Taylor Swift, US high school students, and women around the world have become victims of online abuse. Advancements in generative AI tools have made it easier and faster to create these images, while social media platforms facilitate their rapid spread. Deepfake pornography is being used as a tool to target, silence, and intimidate women both online and offline, making it a growing form of gender-based harassment.
The Oversight Board, comprised of experts in freedom of expression and human rights, acts as a kind of Supreme Court for Meta, allowing users to appeal content decisions on the company’s platforms. The Board evaluates content moderation decisions and provides recommendations to Meta on how to handle certain content, as well as broader policy suggestions. By selecting cases from both the US and India, the Board aims to assess whether Meta is effectively protecting all women globally in a fair manner.
The first case under review by the Oversight Board involves an AI-generated nude image of a public figure from India posted on Instagram by an account that shares only AI-generated images of Indian women. Despite a user reporting the image as pornographic, Instagram failed to review the report within 48 hours, leading to the report being automatically closed. After the Oversight Board flagged the issue, Meta determined that the image violated bullying and harassment rules and removed it from the platform. The second case involves an AI-generated image of a nude woman being groped on a Facebook group for AI creations, reminiscent of an American public figure.
As part of the review process, the Oversight Board is inviting public comments on deepfake pornography and Meta’s response to posts featuring AI-generated explicit imagery. Feedback can be submitted anonymously, offering individuals the opportunity to share how such content can harm women and provide insights into how Meta has handled these issues in the past. The public comment period closes on April 30th, signaling the Board’s efforts to gather diverse perspectives and insights on this critical issue. In light of the growing threat of AI-generated pornography as a tool for online harassment, the Oversight Board’s evaluation of Meta’s approach to tackling this issue is a significant step towards enhancing platform safety and protecting users.
