Subscribe
Topic

Benchmarks

Evals and leaderboards: what the numbers measure and what they miss.

7 stories · updated Sep 11

GPT-6 Astra vs Claude Fable 5.1: how do they actually compare?

6 min read

What are open-weight models, and how far behind the frontier are they?

6 min read

Five frontier models, one benchmark, zero cancers cured

3 min read

Open weights sit at 58 percent of the frontier and 44 percent of the price

3 min read

The best AI shopkeeper made $15,515, and a competent human would have made $63,000

3 min read

The benchmark changed and the cheap models slipped. The frontier pair did not move

4 min read

AMD says ROCm 10 is 3.3x faster than ROCm 7. Its own footnote says neither side ran ROCm 10

2 min read