Model checks
Vikey Seller, as the auditors found it. Provider →
last audit 18 Nov · evidence checked on-chain×0.88
on its $ANTS points now
Approved auditors check that each provider serves the model it sells.
- 🧪They buy from it like any buyer: ~100 obscure number questions, compared with the real model.
- 📏The real model misses some too: that is the noise. A provider fails only if it misses clearly more, and two auditors must agree.
- 💰Each pass +2% on $ANTS points, up to +50%. Fails cost more: 1 −4%, 2 −16%, 3 −36%. Checked again every week.
How this works (Antseed's announcement ↗)
Approved auditors check that each provider serves the model it sells.
- 🧪They buy from it like any buyer: ~100 obscure number questions, compared with the real model.
- 📏The real model misses some too: that is the noise. A provider fails only if it misses clearly more, and two auditors must agree.
- 💰Each pass +2% on $ANTS points, up to +50%. Fails cost more: 1 −4%, 2 −16%, 3 −36%. Checked again every week.
Passed
2
SAME · counting now
Last audit
18 Nov
epoch 31 · counts to 32
| Model | Differed↑ | × noise | Fail line | Noise | Proof |
|---|
| Kimi K3.1 Pro no verdict this round | 0% | 0.0× | 10 under | 2.3% | ↗ |
| MiMo V2.6 Pro no verdict this round | 0% | 0.0× | 7 under | 12.1% | ↗ |
| GPT-6.1 SolSAME | 10% | 5.0× | 7 under | 2.0% | ↗ |
| MiniMax M3 no verdict this round | 14% | 1.0× | 8 under | 14.1% | ↗ |
| GLM 5.3SAME | 18% | 1.6× | 16 under | 11.3% | ↗ |
| Claude Sonnet 5.5DIFF | 36% | 14× | +24 over | 2.5% | ↗ |
| Claude Opus 5.5DIFF | 39% | 24× | +30 over | 1.7% | ↗ |
| Claude Fable 5.1 not tested · rate limited | — | — | — | — | ↗ |
Evidence of some checks not found
Claude Opus 5.5DIFF
47 of 120 differed (fails from 17) · 45 of 110 differed (fails from 15) · the real model differs from itself on 2%
Where it missed
Biology (chromosome numbers)42/54
Chemistry (melting points)2/3
Chinese internet (platform dates)17/27
Astronomy (periods and distances)9/22
For example
osmunda regalis sporophyte diploid chromosome number 2n countreal 44 · provider 220
Salvinia natans 2n chromosome countreal 18 · provider 72
Hymenophyllum tunbrigense 2n chromosome countreal 26 · provider 72
✓Reasoning switched off with reasoning effort none, as the real model was asked.
Claude Sonnet 5.5DIFF
48 of 130 differed (fails from 25) · 43 of 120 differed (fails from 19) · the real model differs from itself on 3%
Where it missed
Biology (chromosome numbers)18/28
Chinese geography (measurements)12/20
Medical (drug half-lives)12/29
Astronomy (periods and distances)10/25
For example
Deuteron magnetic moment in units of 10^-27 J/Treal 0.4331 · provider 4.331
Area of Yanqi Hui Autonomous County in Xinjiang (square kilometers, rounded)real 2,429 · provider 7,400
Melting point of Au5Sn (zeta phase) peritectic decomposition in degrees Celsiusreal 190 · provider 500
✓Reasoning switched off with reasoning effort none, as the real model was asked.
3 older checks · 1 failed · not counting now
| Model | Differed↑ | × noise | Fail line | Noise | Proof |
|---|
| DeepSeek V4 ProSAME 7 Nov · expired | 12% | 1.8× | 12 under | 6.7% | ↗ |
| GPT-6 AstraDIFF 7 Nov · expired | 24% | 13× | +9 over | 1.8% | ↗ |
| Kimi K3 7 Nov · replaced · not tested · provider unreachable | — | — | — | — | ↗ |
GPT-6 AstraDIFFno longer counts
26 of 110 differed (fails from 17) · 51 of 220 differed over 2 sets (fails from 44) · the real model differs from itself on 2%
Where it missed
Programming (release years)20/36
Pop culture (box office and ratings)7/13
Cryptography (parameters)1/2
Physics (material properties)5/11
For example
vera drake 2004 original camera negative gauge mmreal 16 · provider 35
the station agent 2003 original camera negative gauge mmreal 16 · provider 35
Silver(I) molybdate (Ag2MoO4) melting point (°C)real 483 · provider 705
✓Reasoning switched off with reasoning effort none, as the real model was asked.
| Round | Passed | Failed | Not tested | Multiplier |
|---|
| 17 Novepoch 31 | 2 | 2 | 4 | ×0.70 |
| 7 Novepoch 30 | 9 | 1 | 1 | ×1.12 |
| 4 Novepoch 29 | 7 | 0 | 1 | ×1.14 |