AI or Not
Menu
SynthID Detector Study · October 2026

SynthID Detector vs. an AI Image Detector: The Test Data

We removed SynthID from Google images. The SynthID Detector found 18% of them. AI or Not's AI image detector found 100%. Get every file and every verdict.

Every image in the test set with SynthID removed, labelled with the SynthID Detector verdict from synthid.com and AI or Not's AI image detector verdict
18%
Removed set: SynthID Detector on images with SynthID removed
100%
Removed set: AI or Not on the same images
100%
Intact set: SynthID Detector with the watermark intact

What's in the download

  • The original images with SynthID intact: Google Nano Banana output in JPG, PNG and WebP. We capped the run at 50 images because synthid.com limits how many files you can upload per day and the SynthID Detector is web-only (manual upload, one file at a time, no API), so a larger run is a multi-day job
  • SynthID-removed versions of the same images, paired by a 3-digit id
  • synthid.com verdict screenshots for the removed images
  • results.csv with 17 columns per image triplet, including every AI or Not verdict and confidence score
  • README.md with the method, the exact verdict strings, the caveats and a per-image table

Who this is for

  • Newsrooms and fact-checkers who want to check the pairs and the verdict screenshots themselves
  • Trust and safety and platform compliance teams working under California's AI Transparency Act (SB 1000) and its disclosure verification tool requirement
  • Insurers, KYC and fraud teams who need to know what a watermark check does and does not tell them about a submitted image
Published
October 2026
Audience
Fraud, trust & safety, policy, press
Formats
Images · CSV · Screenshots

Get the test data

Two required fields. The Google Drive folder opens right after you submit.

No signup needed for the results table: Download summary.csv