Model checks
Phala, as the auditors found it. Provider →
last audit 17 Nov · evidence checked on-chain×1.06
on its $ANTS points now
Approved auditors check that each provider serves the model it sells.
- 🧪They buy from it like any buyer: ~100 obscure number questions, compared with the real model.
- 📏The real model misses some too: that is the noise. A provider fails only if it misses clearly more, and two auditors must agree.
- 💰Each pass +2% on $ANTS points, up to +50%. Fails cost more: 1 −4%, 2 −16%, 3 −36%. Checked again every week.
How this works (Antseed's announcement ↗)
Approved auditors check that each provider serves the model it sells.
- 🧪They buy from it like any buyer: ~100 obscure number questions, compared with the real model.
- 📏The real model misses some too: that is the noise. A provider fails only if it misses clearly more, and two auditors must agree.
- 💰Each pass +2% on $ANTS points, up to +50%. Fails cost more: 1 −4%, 2 −16%, 3 −36%. Checked again every week.
Passed
3
SAME · counting now
Last audit
17 Nov
epoch 31 · counts to 32
| Model | Differed↑ | × noise | Fail line | Noise | Proof |
|---|
| Kimi K3.1 ProSAME | 2% | 0.7× | 17 under | 2.3% | ↗ |
| GLM 5.3SAME | 18% | 1.6× | 14 under | 11.3% | ↗ |
Evidence of some checks not found
2 older checks · 1 failed · not counting now
| Model | Differed↑ | × noise | Fail line | Noise | Proof |
|---|
| Kimi K3SAME 7 Nov · replaced | 7% | 0.8× | 26 under | 8.7% | ↗ |
| Qwen 3.8 27BDIFF 7 Nov · expired | 21% | 2.6× | +13 over | 7.9% | ↗ |
Qwen 3.8 27BDIFFno longer counts
47 of 160 differed (fails from 38) · 71 of 340 differed over 2 sets (fails from 58) · the real model differs from itself on 8%
Where it missed
Astronomy (periods and distances)7/13
Medical (drug half-lives)8/17
Biology (chromosome numbers)10/23
Cryptography (parameters)5/12
For example
Angular diameter in arcseconds of Andromeda Galaxy M31real 178 · provider 10,680
Number of shots in the long take of Birdman or (The Unexpected Virtue of Ignorance)real 1 · provider 39
Number of original BGP version numbersreal 1 · provider 4
✓Reasoning switched off with reasoning effort none, as the real model was asked.
| Round | Passed | Failed | Multiplier |
|---|
| 17 Novepoch 31 | 2 | 0 | ×1.02 |
| 7 Novepoch 30 | 2 | 1 | ×1.02 |
| 4 Novepoch 29 | 1 | 0 | ×1.02 |