Full Width [alt+shift+f] Shortcuts [alt+shift+k]
Sign Up [alt+shift+s] Log In [alt+shift+l]
59
We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but now we think it shows LLMs can learn effectively from a single example.
a year ago

Improve your reading experience

Logged in users get linked directly to articles resulting in a better reading experience. Please login for free, it takes less than 1 minute.

More from fast.ai

fasttransform: Reversible Pipelines Made Simple

Introducing fasttransform, a Python library that makes data transformations reversible and extensible through the power of multiple dispatch.

5 months ago 25 votes
What AI can tell us about microscope slides

A friendly introduction to Foundation Models for Computational Pathology

6 months ago 46 votes
What AI can tell us about microscope slides

A friendly introduction to Foundation Models for Computational Pathology

6 months ago 34 votes
A New Chapter for fast.ai: How To Solve It With Code

fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To Solve It With Code’

8 months ago 82 votes
In defense of screen time

Pundits say my husband and I are parenting wrong.

9 months ago 95 votes

More in AI

AI Roundup 129: Personal Superintelligence

August 1, 2025.

14 hours ago 4 votes
You're invited to the ML for SWEs Discord server!

I’ve set up a Discord server for paid machine learning for software engineer subscribers, so you can have access to all of my curated feeds that I use to keep up with AI resources, news and jobs. This is also a private space for paid subscribers to chat, learn, network, and get feedback from one another.

16 hours ago 2 votes
Ads are inevitable in AI, and that's okay

Convergent evolution in LLMs will get us there

5 days ago 10 votes
The Bitter Lesson versus The Garbage Can

Does process matter? We are about to find out.

5 days ago 20 votes
The US Should Run Faster on AI Instead of Trying to Trip Up China

Export Controls and Trump's New AI Action Plan

a week ago 12 votes