Full Width [alt+shift+f] Shortcuts [alt+shift+k]
Sign Up [alt+shift+s] Log In [alt+shift+l]
46

Don’t Let a Data Leak Sink Your Project

from Win Vector LLC [alt+shift+b] in AI

One of the bigger risks of iterative statistical or machine learning fitting procedures is over-fit or the dreaded data leak. Over-fit is when: a model performs better on training data than on future data. Some degree of over-fit is expected. A data leak is when: the model learns things about […]
6th May 2025

Stay updated

Get a weekly newsletter with the top 5 articles worth reading every week.

More from Win Vector LLC

Estimating the Value of AppSec Methods

Really excited to share some work we did with Xint.io. We don’t always get to publicly share what we do. We have permission to share this one, and it is some public good. Xint.io provides a code vulnerability scan service that helps flag Common Vulnerabilities and Exposures (CVEs) in a […]

2 weeks ago • 1 votes
Speaking at the Bayesian Interest Group November 2026 Virtual Meeting

I’ll be speaking at the Bayesian Interest Group November 2026 Virtual Meeting. The topic is using Bayesian models to interactively pre-estimate the value of applying an expensive inspection or procedure to a large population. For example: estimating the value of using an LLM security service on a great number of […]

21st Oct 2026 • 1 votes
Choose by Probability, not by Expectation

A lot of financial thinking and intuition attempts to phrase decisions and choices in terms of claimed returns or in terms of expected values. For example: An ultra greedy gambler may pick the highest claimed winning payoff, independent of win or success probabilities. A greedy gambler may pick the highest […]

4th Aug 2026 • 1 votes
Maybe Jacobian Conjecture Counterexamples are not Rare

The (now falsified) Jacobian conjecture was a well known conjecture expressing the hope that a family of functions had nice properties. In July 2026 Levent Alpöge exhibited a simple counter-example that he said was found by Claude Fable 5. Fields medalist Terence Tao wrote on this result try to relate […]

23rd Jul 2026 • 1 votes
Who’s the Best Batter? Estimating Probabilities from Unevenly Collected Data

Win Vector’s Dr. Nina Zumel has an exciting new article to share: Who’s the Best Batter? Estimating Probabilities from Unevenly Collected Data. It is a technical demonstration on how what one observes (outcomes, frequencies, and so on) differ from what we want to know (effectiveness, probabilities, and so on). In […]

21st May 2026 • 1 votes

More in AI

What AI Is Bad at?

为什么 AI 几乎统治了所有智力活动,却还没在投资上打败人类?文章以全美投资大赛(USIC)最新成绩为引子,提出「简单输入→复杂输出」与「复杂输入→简单输出」的四象限框架,解释 AI 为何在围棋、编程、数学上已彻底超越人类,却在面对开放、复杂的真实世界输入时仍显不足。投资只是表象,真正的问题是:当输入不再有限且可离散化时,人类的经验、直觉与对异常的敏感仍具独特优势。 Why hasn’t AI beaten humans at investing, even as it dominates almost every other intellectual domain? Using recent US Investing Championship results as a starting point, this essay introduces a simple 2×2 framework of input/output complexity. It explains why AI has thoroughly surpassed humans in “simple input → complex output” tasks like Go, programming, and math, yet still struggles with open-ended, complex real-world inputs—of which investing is a prime example.

an hour ago • 1 votes
Slice of AI Life (With a Baby)

Parenting a Newborn with AI Is Radically Different from a Few Years Ago

2 days ago • 1 votes
How Public Evals Work and Fail, and What Should Change

How to read benchmarks and what to question, from a teardown of 12 benchmarks.

3 days ago • 1 votes
In Search of the Deep Life

Early in the coronavirus pandemic, as I sat at home channeling my anxiety into publishing daily essays on this newsletter (a streak I kept up ... Read more The post In Search of the Deep Life appeared first on Cal Newport.

6 days ago • 2 votes
Making open models work for long-horizon agentic workloads

Prefix caching helps coding agents stay fast as conversations grow. Prompts, tool calls, and inference routing determine how much work the model can reuse.

6 days ago • 2 votes
📚 BoredReading

You seem to be enjoying this.

Join free to unlock everything.

Create free account

Already have an account? Sign in