Combatting CSAM

AI Studio fights to combat the creation and distribution of child sexual abuse materials (CSAM).

AI Studio is building the safest digital media platform in the world. We do not tolerate CSAM on our platform, and actively work to block it. The creation or distribution of CSAM is immoral, wrong, illegal and against our Terms of Service and our Acceptable Use Policy.

We have a dedicated team of people who work around the clock to prevent and swiftly remove any suspected CSAM from our platform.

What is CSAM?

CSAM is any image or video of sexually explicit conduct, including nudity, involving a person less than 18 years old. These images amount to child sexual abuse and exploitation.

How Often Does CSAM Appear on AI Studio?

• AI Studio aggressively targets and reports people who create, or try to use our platform to distribute, CSAM.
• Incidents of suspected CSAM make up less than 0.0002% of all content submitted by creators to be posted on AI Studio. We report all suspected incidents of CSAM to NCMEC. Each suspected image or video is blocked and removed from the platform while we investigate it.

How Does AI Studio Identify CSAM on Its Platform?

• We continuously scan our platform to prevent the posting of CSAM. All our content moderators are trained to identify and swiftly report any suspected CSAM.
• Before content can appear on a newsfeed, we inspect it with state-of-the-art digital technologies to check whether the content is allowed on the platform. All content that passes this initial review is then manually reviewed by our trained human moderators within 24 hours.

What is AI Studio Looking For When Trying to Identify CSAM?

• Before any content can appear on a creator’s newsfeed, we compare it against databases and tools used by law enforcement to prevent the distribution of known CSAM.
• CSAM can be harder to identify if it is "new" CSAM, meaning it is CSAM which is not already part of databases and tools used by law enforcement. So we closely inspect images, text, and sound files to look for possible "new" CSAM. Our technology and our people work together to report suspected CSAM which has not previously been identified.

What Happens When AI Studio Finds Suspected CSAM on Its Platform?

• When we identify suspected CSAM, we immediately remove it, and make a "CyberTipline" report to the National Center for Missing & Exploited Children (NCMEC).
• NCMEC reviews these reports and shares them with the appropriate law enforcement around the world so they can combat CSAM. We work closely with law enforcement to investigate, prosecute, and punish any person who tries to use our platform to create or distribute CSAM.
• We immediately investigate any user who tries to share suspected CSAM on AI Studio and we take appropriate action. We ban anyone who tries to create or distribute CSAM on AI Studio.

How Can AI Studio Tell if a Direct Message or Other Private Post Contains CSAM Material?

• AI Studio does not use end-to-end encryption. Everything on the site is visible to our team of trained reviewers. There are no "hidden" posts, "secret" areas, or disappearing messages on AI Studio.
• We can review and remove any image or video shared on AI Studio at any time, including in all direct messages.

Does AI Studio’s Subscription Model Enable the Distribution of CSAM?

• No. Our subscription model makes it more difficult for people to create and distribute CSAM.
• To subscribe to content, or to post content on AI Studio users need to pass our strict identity verification checks. Unlike many other digital media platforms, this means we know the legal identity of all our users. No one can post anonymously on AI Studio.
• Because our users are not anonymous, and we do not have end to end encryption, AI Studio users are less likely to try to create or distribute CSAM. If any user does try to create or distribute CSAM material on our platform, we know who they are, we report them, and we ban them from AI Studio.

How Do I Report Suspected CSAM?

Each post and account on AI Studio has a report button. If you see any content on AI Studio which you suspect could be CSAM, please immediately click the report button or tell us what you saw by emailing [EMAIL_SUPPORT].

How Can I Trust That AI Studio Takes This Issue Seriously?

• AI Studio is committed to building the safest social media platform in the world. We take responsibility for our actions, and we regularly publish data which proves the steps we say we are taking.
• We have also gone a step further and we chose to put in place an independent third party monitor to check the processes we have in place to fight against the creation and distribution of CSAM.

What Else Do You Do to Prevent the Creation or Distribution of CSAM?

• We work closely with governments, regulators, law enforcement, non-governmental organizations, charities, and other companies in the fight against CSAM.
• We receive and act on intelligence from our safety partners on emerging trends relating to child safety and offender prevention.
• As well as working closely with NCMEC to report any instances of CSAM on our platform through NCMEC’s CyberTipline, we are also part of NCMEC’s TakeItDown initiative.

If you would like to know more about our fight against the creation and distribution of CSAM please email [EMAIL_COMPLIANCE].