How much does a 10 million token context window actually cost?

Some back-of-the-napkin math for Meta's Llama 4 Scout

3 months ago

Logged in users get linked directly to articles resulting in a better reading experience. Please login for free, it takes less than 1 minute.

More from Society's Backend: Machine Learning for Software Engineers

An overview of important updates and why they're important

2 months ago • 31 votes

How to be an agentic engineer

Everyone tells you to be an 'agentic engineer' but no one tells you how

2 months ago • 38 votes

Help me improve Society's Backend!

Two simple questions to help make Society's Backend better

3 months ago • 28 votes

Machine learning for software engineers 5-5-25

3 months ago • 25 votes

Top AI Articles and Resources April 2025

A noise-free curated roundup of the best resources for machine learning engineers

3 months ago • 20 votes

AI Roundup 130: GPT-5

August 8, 2025.

4 hours ago • 2 votes

GPT-5: It Just Does Stuff

Putting the AI in Charge

yesterday • 8 votes

Welcome to machine learning for software engineers.

2 days ago • 5 votes

The Age of AI Flattery

How Wrong Incentives Can Undermine Honest AI-Human Dialogue

3 days ago • 8 votes

August 1, 2025.

a week ago • 11 votes