The bait and switch behind AI risk prediction tools • BoredReading.com

Full Width [alt+shift+f]

Shortcuts [alt+shift+k]

Sign Up [alt+shift+s]

Log In [alt+shift+l]

Back to articles

32

The bait and switch behind AI risk prediction tools

from AI Snake Oil [alt+shift+b] in AI

Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry. The developer claimed the tool achieved over 90% accuracy in predicting when beaches would be safe to swim in. But the tool did much worse: on a majority of the days when the water was in fact unsafe, beaches remained open based on the tool’s assessments. It was less accurate than the previous method of simply testing the water for bacteria each day.

over a year ago

Remove from reading list Add to reading list [alt+a] Read now [→]

Improve your reading experience

Logged in users get linked directly to articles resulting in a better reading experience. Please login for free, it takes less than 1 minute.

More from AI Snake Oil

AGI is not a milestone

There is no capability threshold that will lead to sudden impacts

a month ago • 9 votes

AI as Normal Technology

A new paper that we will expand into our next book

2 months ago • 33 votes

Is AI progress slowing down?

Making sense of recent technology trends and claims

5 months ago • 82 votes

We Looked at 78 Election Deepfakes. Political Misinformation is not an AI Problem.

Technology Isn’t the Problem—or the Solution.

6 months ago • 79 votes

Does the UK’s liver transplant matching algorithm systematically exclude younger patients?

Seemingly minor technical decisions can have life-or-death effects

7 months ago • 70 votes

More in AI

AI Roundup 122: Economies of Scale

June 13, 2025.

2 days ago • 2 votes

How to afford Machine Learning for Software Engineers

How I'm planning to make ML for SWEs more helpful while remaining affordable

3 days ago • 4 votes

The State of AI Engineering (2025)

Big ideas from the 2025 World's Fair.

4 days ago • 4 votes

ML for SWES Weekly #11: The engineer's perspective on Apple's LLM reasoning paper

An AI reading list curated to make you a better engineer: 6-10-25

5 days ago • 6 votes

Silicon Valley's quest to remove friction from our lives

Dreaming of Thoreau on Instagram

6 days ago • 9 votes