Model checks

Claude Sonnet 5.5, provider by provider. Model →

last audit 18 Nov · epoch 31 · evidence checked on-chain
12 of 15

providers answered as the model

Approved auditors check that each provider serves the model it sells.

  • They buy from it like any buyer: ~100 obscure number questions, compared with the real model.
  • The real model misses some too: that is the noise. A provider fails only if it misses clearly more, and two auditors must agree.
  • Each pass +2% on $ANTS points, up to +50%. Fails cost more: 1 −4%, 2 −16%, 3 −36%. Checked again every week.
How this works (Antseed's announcement ↗)

Approved auditors check that each provider serves the model it sells.

  • They buy from it like any buyer: ~100 obscure number questions, compared with the real model.
  • The real model misses some too: that is the noise. A provider fails only if it misses clearly more, and two auditors must agree.
  • Each pass +2% on $ANTS points, up to +50%. Fails cost more: 1 −4%, 2 −16%, 3 −36%. Checked again every week.
Passed
12
SAME
Failed
3
DIFF
Not tested
3
the audit could not run
By provider

Compared with anthropic/claude-sonnet-5.5 on OpenRouter · pinned to anthropic · reasoning minimal

ProviderDiffered↑× noiseFail lineNoiseProof
9 older checks · 3 failed · not counting now
ProviderDiffered↑× noiseFail lineNoiseProof
Where providers miss
SubjectPassed providers missedFailed providers missed
Biology (chromosome numbers)7%46%
Medical (drug half-lives)12%38%
Programming (release years)6%35%
Astronomy (periods and distances)2%32%
Chinese geography (measurements)9%32%
Chemistry (melting points)11%38%
Mathematics (special values)6%36%
Physics (material properties)11%21%
Pop culture (box office and ratings)5%36%
Chinese literature (publication years)0%39%
Audit rounds
RoundPassedFailedNot tested
17 Novepoch 311233
7 Novepoch 301255
4 Novepoch 29126+1 waiting3
21 Octepoch 27 · before points830

Audited by approved auditors · evidence on IPFS, hash-checked on-chain.