Full Width [alt+shift+f] Shortcuts [alt+shift+k]
Sign Up [alt+shift+s] Log In [alt+shift+l]
117

How to Use Benchmarks to Build Successful Machine Learning Systems

from Society's Backend: Machine Learning for Software Engineers [alt+shift+b] in AI

And what benchmarks mean for real-world applications
2nd Aug 2024

Stay updated

Get a weekly newsletter with the top 5 articles worth reading every week.

More from Society's Backend: Machine Learning for Software Engineers

Now is The Best Time to Be a Software Engineer (ML for SWEs 9)

Machine learning for software engineers 5-5-25

5th May 2025 • 44 votes
3 Ways You Can Sabotage Your Own Tech Career

What they are and what you need to understand to avoid them

1st Apr 2025 • 47 votes
Why You Should Never Let AI Debug for You

And 3 ways you should be using AI to code

5th Mar 2025 • 55 votes
How AI companies get around data regulation

An overview of federated machine learning, why it exists, and why it's important

5th Feb 2025 • 54 votes
5 Highlights From Society's Backend in 2024

The top 5 articles and resources

1st Jan 2025 • 61 votes

More in AI

Update: I’ve returned to fast.ai

I started this blog a few years ago when I began my journey studying immunology, to have a place to write about what I was learning and about applications of AI to the field. My studies were a success: I completed a Masters in Microbiology-Immunology, explored interesting applications, and met some awesome people along the way. At the end of last year, I decided to return to my origins and re-joined fast.ai, which had grown into Answer.AI while I was away. Why now? AI is an increasingly hated field, and for good reason. I wrote about my decision: There are tons of false and over-hyped claims about what AI can do, but underneath those, it is a genuinely useful technology. I want to use AI in ways that don’t degrade my own critical thinking skills and that don’t pretend that resources are unlimited. The biggest companies have made their vision for the technology seem like the only option. It isn’t. OpenAI, Anthropic, Google, and xAI don’t own AI. Their values and decisions aren’t the only version of what AI technology can be. I understand why many people are anti-AI. My new job is rooted in the same objections. I returned to the field because I want to figure out how to use AI in ways that protect human creativity, autonomy, and problem-solving. You can read my full essay here. I am excited to continue exploring how to design AI tools that better encourage human understanding and human autonomy, particularly in the area of education. I have written several essays in the last year, posted at fast.ai and answer.ai, about how AI intersects with education, coding, and science: Breaking the Spell of Vibe Coding Stop Saying Boredom is Good for Kids I Don’t Want a Learning Dashboard for My Child Risks and Limitations of AI in the Life Sciences My friends all hate AI; I just joined an AI startup Going forward, you can find me at fast.ai, answer.ai, on twitter, and on LinkedIn. I look forward to reading your responses. Create a free GitHub account to comment below.

yesterday • 1 votes
The Good Thing About Hard Things

A new research paper titled “​AI Assistance Reduces Persistence and Hurts Independent Performance,”​ which was recently presented at the ​Conference on Language Modeling​, has been ... Read more The post The Good Thing About Hard Things appeared first on Cal Newport.

yesterday • 1 votes
Stumblebug - simulation - beta
6 days ago • 1 votes
Run AI agents safely with Ollama and Fly.io

AI agents can now use Ollama's cloud models safely inside Fly.io's cloud computers.

a week ago • 1 votes
Agentic Primitives 101

Inside the harnesses that let AI carry a job across hours, days, and conversations.

a week ago • 2 votes
📚 BoredReading

You seem to be enjoying this.

Join free to unlock everything.

Create free account

Already have an account? Sign in