AI leaderboards are no longer useful. It's time to switch to Pareto curves.

What spending $2,000 can tell us about evaluating AI agents

9 months ago

Logged in users get linked directly to articles resulting in a better reading experience. Please login for free, it takes less than 1 minute.

More from AI Snake Oil

Is AI progress slowing down?

Making sense of recent technology trends and claims

2 months ago • 55 votes

Technology Isn’t the Problem—or the Solution.

2 months ago • 57 votes

Seemingly minor technical decisions can have life-or-death effects

3 months ago • 47 votes

FAQ about the book and our writing process

What's in the book and how we wrote it

4 months ago • 72 votes

A new benchmark to measure the impact of AI on improving science

5 months ago • 90 votes

Go Grok Yourself

That title is Elon Musk’s fault, not mine, I mean, sorry not sorry:

23 hours ago • 3 votes

Success Theater

29 minutes ago • 1 votes

AI engineering and related jobs 02-18-25

2 days ago • 2 votes

Medical Roundup #4

It seems like as other things drew our attention more, medical news slowed down.

2 days ago • 4 votes

Grok 3 Hot Take

Elon Musk promised that Grok 3 would be the smartest AI ever.

2 days ago • 4 votes