Full Width [alt+shift+f] Shortcuts [alt+shift+k]
Sign Up [alt+shift+s] Log In [alt+shift+l]
1

Evaluate LLM Apps in Go

from maragu’s blog [alt+shift+b] in AI

As Large Language Models (LLMs) become a bigger part of our apps, making sure they work reliably brings some challenges. Unlike traditional code with predictable outputs, LLMs are indeterministic and can output downright weird stuff. That’s where good evaluation tools come in! In this post, I’ll show you the eval package from my newly renamed maragu.dev/gai module.
25th Feb 2025

Stay updated

Get a weekly newsletter with the top 5 articles worth reading every week.

More from maragu’s blog

Choosing what to keep human

A quote from Ethan Mollick on figuring out what to keep human using AI.

27th May 2026 • 1 votes
Headless software

How do we design software when users use it primarily through agents?

20th Apr 2026 • 1 votes
autoresearch and diary agent skills

I keep adding to and refining my agents skills repo.

26th Mar 2026 • 1 votes
23 skills I wrote with my AI

My AI, maragubot, has a blog post up with the skills we've been developing.

20th Feb 2026 • 2 votes
Do we still have time for human code review?

I’m increasingly convinced that in the near future, we software developers won’t be looking at our production code anymore.

5th Jan 2026 • 1 votes

More in AI

Slice of AI Life (With a Baby)

Parenting a Newborn with AI Is Radically Different from a Few Years Ago

14 hours ago • 1 votes
How Public Evals Work and Fail, and What Should Change

How to read benchmarks and what to question, from a teardown of 12 benchmarks.

2 days ago • 1 votes
In Search of the Deep Life

Early in the coronavirus pandemic, as I sat at home channeling my anxiety into publishing daily essays on this newsletter (a streak I kept up ... Read more The post In Search of the Deep Life appeared first on Cal Newport.

5 days ago • 2 votes
Making open models work for long-horizon agentic workloads

Prefix caching helps coding agents stay fast as conversations grow. Prompts, tool calls, and inference routing determine how much work the model can reuse.

5 days ago • 2 votes
Announcing the Public Launch of SolveIt

The tool we created to build understanding and mastery for our own internal work at Answer.AI

6 days ago • 1 votes
📚 BoredReading

You seem to be enjoying this.

Join free to unlock everything.

Create free account

Already have an account? Sign in