Model checks
Apiport, as the auditors found it. Provider →
last audit 18 Nov · evidence checked on-chain×0.96
on its $ANTS points now
Approved auditors check that each provider serves the model it sells.
- 🧪They buy from it like any buyer: ~100 obscure number questions, compared with the real model.
- 📏The real model misses some too: that is the noise. A provider fails only if it misses clearly more, and two auditors must agree.
- 💰Each pass +2% on $ANTS points, up to +50%. Fails cost more: 1 −4%, 2 −16%, 3 −36%. Checked again every week.
How this works (Antseed's announcement ↗)
Approved auditors check that each provider serves the model it sells.
- 🧪They buy from it like any buyer: ~100 obscure number questions, compared with the real model.
- 📏The real model misses some too: that is the noise. A provider fails only if it misses clearly more, and two auditors must agree.
- 💰Each pass +2% on $ANTS points, up to +50%. Fails cost more: 1 −4%, 2 −16%, 3 −36%. Checked again every week.
Passed
0
SAME · counting now
Last audit
18 Nov
epoch 31 · counts to 32
| Model | Differed↑ | × noise | Fail line | Noise | Proof |
|---|
| GPT-6 AstraDIFF | 51% | 51× | +37 over | 1.0% | ↗ |
GPT-6 AstraDIFF
31 of 110 differed (fails from 21) · 51 of 100 differed (fails from 14) · the real model differs from itself on 1%
Where it missed
Chinese literature (publication years)9/11
Biology (chromosome numbers)14/21
Medical (drug half-lives)15/24
Chinese history (specific dates)3/5
For example
Nedosiran terminal plasma half-life in hoursreal 15 · provider 153
Sichuan Garze County total area (square kilometres)real 7,357 · provider 14,785
NGC 1514 central-binary orbital period reported by Jones et al. (2017) (days)real 3,306 · provider 3.161
✓Reasoning switched off with reasoning effort none, as the real model was asked.
4 older checks · 1 failed · not counting now
| Model | Differed↑ | × noise | Fail line | Noise | Proof |
|---|
| Claude Sonnet 5.5SAME 21 Oct · first round, before points | 11% | 1.1× | 12 under | 9.8% | ↗ |
| Kimi K3SAME 21 Oct · first round, before points | 16% | 1.7× | 4 under | 9.0% | ↗ |
| GPT-6.1 SolDIFF 7 Nov · expired | 19% | 38× | +7 over | 0.0% | ↗ |
| Claude Opus 5.5 21 Oct · not tested · provider unreachable | — | — | — | — | ↗ |
GPT-6.1 SolDIFFno longer counts
19 of 100 differed (fails from 12) · 18 of 99 differed (fails from 12) · the real model differs from itself on 0%
Where it missed
Chemistry (melting points)1/3
Chemistry (boiling points)1/3
Programming (release years)5/16
Pop culture (box office and ratings)7/24
For example
Phenoxathiin melting point (°C)real 56 · provider 155
Salvinia cucullata somatic chromosome count (2n, chromosomes)real 18 · provider 45
Anqing Yangtze River Highway Bridge main span length (metres)real 510 · provider 1,200
✓Reasoning switched off with reasoning effort none, as the real model was asked.
| Round | Passed | Failed | Not tested | Multiplier |
|---|
| 18 Novepoch 31 | 0 | 1 | 0 | ×0.84 |
| 7 Novepoch 30 | 0 | 2 | 0 | ×0.84 |
| 4 Novepoch 29 | 0 | 2 | 0 | ×0.84 |
| 21 Octepoch 27 · before points | 4 | 0 | 1 | — |