Model checks

Claude Opus 5.5, provider by provider. Model →

last audit 18 Nov · epoch 31 · evidence checked on-chain
16 of 21

providers answered as the model

Approved auditors check that each provider serves the model it sells.

  • They buy from it like any buyer: ~100 obscure number questions, compared with the real model.
  • The real model misses some too: that is the noise. A provider fails only if it misses clearly more, and two auditors must agree.
  • Each pass +2% on $ANTS points, up to +50%. Fails cost more: 1 −4%, 2 −16%, 3 −36%. Checked again every week.
How this works (Antseed's announcement ↗)

Approved auditors check that each provider serves the model it sells.

  • They buy from it like any buyer: ~100 obscure number questions, compared with the real model.
  • The real model misses some too: that is the noise. A provider fails only if it misses clearly more, and two auditors must agree.
  • Each pass +2% on $ANTS points, up to +50%. Fails cost more: 1 −4%, 2 −16%, 3 −36%. Checked again every week.
Passed
16
SAME
Failed
5
DIFF
Not tested
3
the audit could not run
By provider

Compared with anthropic/claude-opus-5.5 on OpenRouter · pinned to anthropic · reasoning minimal

ProviderDiffered↑× noiseFail lineNoiseProof
12 older checks · 3 failed · not counting now
ProviderDiffered↑× noiseFail lineNoiseProof
Where providers miss
SubjectPassed providers missedFailed providers missed
Biology (chromosome numbers)7%59%
Programming (release years)2%22%
Chinese internet (platform dates)13%32%
Astronomy (periods and distances)1%26%
Medical (drug half-lives)5%25%
Pop culture (box office and ratings)1%8%
Chinese literature (publication years)0%19%
Internet culture (dates and numbers)2%18%
Chinese history (specific dates)0%16%
Chinese geography (measurements)4%24%
Audit rounds
RoundPassedFailedNot tested
17 Novepoch 31165+1 waiting3
7 Novepoch 301356
4 Novepoch 291494
21 Octepoch 27 · before points743

Audited by approved auditors · evidence on IPFS, hash-checked on-chain.