SixFingers.

Scorecard

Model v16, measured 2026-11-20. All numbers come from images the detector never trained on.

What we catch

Share of AI images we flag as AI, per image generator. These generators were held back from training, so this is how we do on a generator we have never seen.

GeneratorImagesCaughtCaught after compression
FLUX35296%97%

How often real photos are wrongly flagged

Share of real photos we wrongly call AI, per photo source. Lower is better.

SourcePhotosWrongly flaggedAfter compression
RAISE (raw camera photos)2997%10%
COCO*3555%–
Open Images*4026%–
Open Images originals (full-size camera files)*320%–
wikimedia_commons*3003%–

* Validation photos. The detector never trained on them, but its cut-off was tuned so that about 5% of them are flagged, so these rows sit near 5% by design. "–" means not measured.

Clean vs compressed

Images shared online are usually re-compressed. We test each image as stored and after compression.

All test imagesCleanCompressed
AI images caught when 5% of real photos are flagged95%93%
Ranking score (AUROC: 100% is perfect, 50% is a coin flip)99%99%
Images tested651651

The visual check (Claude Haiku)

Right answer (an "uncertain" counts as wrong)96%
Answered "uncertain"2%
Test images300

What the percentage means

When we say 80% AI, about 80% of such images are AI. On test images the gap between what we say and how often it is true averages 2.8 percentage points for the visual check and 3.5 for the detector. A number near 50% means the evidence is mixed.

Usage

Checks since launch2
Checks in the last 30 days2

Not enough feedback yet.

Feedback comes from the "Was this right?" box under each result. Only people who chose to answer are counted, and one person can answer for several checks, so this is not a measured accuracy. We show it once there are at least 20 answers.

Honest limits